Multi-Agent-Medical-Assistant
souvikmajumder26/Multi-Agent-Medical-Assistant
โ๏ธGenAI powered multi-agentic medical diagnostics and healthcare research assistance chatbot. ๐ฅ Designed for healthcare professionals, rese
โ๏ธGenAI powered multi-agentic medical diagnostics and healthcare research assistance chatbot. ๐ฅ Designed for healthcare professionals, researchers and patients.
Categories
Tags
Similar tools
ECC
affaan-m/ECC
The agent harness performance optimization system
hermes-agent
NousResearch/hermes-agent
The self-improving AI agent built by Nous Research
AutoGPT
Significant-Gravitas/AutoGPT
AutoGPT: Build, Deploy, and Run AI Agents
ollama
ollama/ollama
Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
prompts.chat
f/prompts.chat
The world's largest open-source prompt library for AI
transformers
huggingface/transformers
๐ค Transformers: the model-definition framework for state-of-the-art machine learning models
Install
pip install Multi-Agent-Medical-AssistantREADME
โ๏ธ Multi-Agent-Medical-Assistant :AI-powered multi-agentic system for medical diagnosis and assistance
[!IMPORTANT]
๐ Version Updates from v2.0 to v2.1 and further:
- Document Processing Upgrade: Unstructured.io has been replaced with Docling for document parsing and extraction of text, tables, and images to be embedded.
- Enhanced RAG References: Links to source documents and reference images present in reranked retrieved chunks stored in local storage are added to the bottom of the RAG responses.
To use Unstructured.io based solution, refer release - v2.0.
๐ Table of Contents
- Overview
- Demo
- Technical Flow Chart
- Key Features
- Tech Stack
- Installation and Setup
- Using Docker
- Manual Installation
- Usage
- Contributions
- License
- Citing
- Contact
๐ Overview
The Multi-Agent Medical Assistant is an AI-powered chatbot designed to assist with medical diagnosis, research, and patient interactions.
๐ Powered by Multi-Agent Intelligence, this system integrates:
- ๐ค Large Language Models (LLMs)
- ๐ผ๏ธ Computer Vision Models for medical imaging analysis
- ๐ Retrieval-Augmented Generation (RAG) leveraging vector databases
- ๐ Real-time Web Search for up-to-date medical insights
- ๐จโโ๏ธ Human-in-the-Loop Validation to verify AI-based medical image diagnoses
What Youโll Learn from This Project ๐
๐น ๐จโ๐ป Multi-Agent Orchestration with structured graph workflows
๐น ๐ Advanced RAG Techniques โ hybrid retrieval, semantic chunking, and vector search
๐น โก Confidence-Based Routing & Agent-to-Agent Handoff
๐น ๐ Scalable, Production-Ready AI with Modularized Code & Robust Exception Handling
๐ For learners: Check out agents/README.md for a detailed breakdown of the agentic workflow! ๐ฏ
๐ซ Demo
https://github.com/user-attachments/assets/d27d4a2e-1c7d-45e2-bbc5-b3d95ccd5b35
If you like what you see and would want to support the project's developer, you can
! :)
๐ For an even more detailed demo video: Check out Multi-Agent-Medical-Assistant-v1.9. ๐ฝ๏ธ
๐ก๏ธ Technical Flow Chart
โจ Key Features
-
๐ค Multi-Agent Architecture : Specialized agents working in harmony to handle diagnosis, information retrieval, reasoning, and more
-
๐ Advanced Agentic RAG Retrieval System :
- Docling based parsing to extract text, tables, and images from PDFs.
- Embedding markdown formatted text, tables and LLM based image summaries.
- LLM based semantic chunking with structural boundary awareness.
- LLM based query expansion with related medical domain terms.
- Qdrant hybrid search combining BM25 sparse keyword search along with dense embedding vector search.
- HuggingFace Cross-Encoder based reranking of retrieved document chunks for accurate LLM reponses.
- Input-output guardrails to ensure safe and relevant responses.
- Links to source documents and images present in reference document chunks