Multi-Agent-Medical-Assistant

souvikmajumder26/Multi-Agent-Medical-Assistant

โš•๏ธGenAI powered multi-agentic medical diagnostics and healthcare research assistance chatbot. ๐Ÿฅ Designed for healthcare professionals, rese

924
Stars
204
Forks
3
Open issues
13
Watchers
Python Apache-2.0Last pushed May 3, 2025

โš•๏ธGenAI powered multi-agentic medical diagnostics and healthcare research assistance chatbot. ๐Ÿฅ Designed for healthcare professionals, researchers and patients.

Categories

Tags

Similar tools

Install

pip install Multi-Agent-Medical-Assistant

README

โš•๏ธ Multi-Agent-Medical-Assistant :
AI-powered multi-agentic system for medical diagnosis and assistance


[!IMPORTANT]
๐Ÿ“‹ Version Updates from v2.0 to v2.1 and further:

  1. Document Processing Upgrade: Unstructured.io has been replaced with Docling for document parsing and extraction of text, tables, and images to be embedded.
  2. Enhanced RAG References: Links to source documents and reference images present in reranked retrieved chunks stored in local storage are added to the bottom of the RAG responses.

To use Unstructured.io based solution, refer release - v2.0.

๐Ÿ“š Table of Contents

  • Overview
  • Demo
  • Technical Flow Chart
  • Key Features
  • Tech Stack
  • Installation and Setup
    • Using Docker
    • Manual Installation
  • Usage
  • Contributions
  • License
  • Citing
  • Contact

๐Ÿ“Œ Overview

The Multi-Agent Medical Assistant is an AI-powered chatbot designed to assist with medical diagnosis, research, and patient interactions.

๐Ÿš€ Powered by Multi-Agent Intelligence, this system integrates:

  • ๐Ÿค– Large Language Models (LLMs)
  • ๐Ÿ–ผ๏ธ Computer Vision Models for medical imaging analysis
  • ๐Ÿ“š Retrieval-Augmented Generation (RAG) leveraging vector databases
  • ๐ŸŒ Real-time Web Search for up-to-date medical insights
  • ๐Ÿ‘จโ€โš•๏ธ Human-in-the-Loop Validation to verify AI-based medical image diagnoses

What Youโ€™ll Learn from This Project ๐Ÿ“–

๐Ÿ”น ๐Ÿ‘จโ€๐Ÿ’ป Multi-Agent Orchestration with structured graph workflows
๐Ÿ”น ๐Ÿ” Advanced RAG Techniques โ€“ hybrid retrieval, semantic chunking, and vector search
๐Ÿ”น โšก Confidence-Based Routing & Agent-to-Agent Handoff
๐Ÿ”น ๐Ÿ”’ Scalable, Production-Ready AI with Modularized Code & Robust Exception Handling

๐Ÿ“‚ For learners: Check out agents/README.md for a detailed breakdown of the agentic workflow! ๐ŸŽฏ


๐Ÿ’ซ Demo

https://github.com/user-attachments/assets/d27d4a2e-1c7d-45e2-bbc5-b3d95ccd5b35

If you like what you see and would want to support the project's developer, you can Buy Me A Coffee ! :)

๐Ÿ“‚ For an even more detailed demo video: Check out Multi-Agent-Medical-Assistant-v1.9. ๐Ÿ“ฝ๏ธ


๐Ÿ›ก๏ธ Technical Flow Chart


โœจ Key Features

  • ๐Ÿค– Multi-Agent Architecture : Specialized agents working in harmony to handle diagnosis, information retrieval, reasoning, and more

  • ๐Ÿ” Advanced Agentic RAG Retrieval System :

    • Docling based parsing to extract text, tables, and images from PDFs.
    • Embedding markdown formatted text, tables and LLM based image summaries.
    • LLM based semantic chunking with structural boundary awareness.
    • LLM based query expansion with related medical domain terms.
    • Qdrant hybrid search combining BM25 sparse keyword search along with dense embedding vector search.
    • HuggingFace Cross-Encoder based reranking of retrieved document chunks for accurate LLM reponses.
    • Input-output guardrails to ensure safe and relevant responses.
    • Links to source documents and images present in reference document chunks