Results for “multimodal”

29 tools

transformers

huggingface/transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models

162k 34kPython

anything-llm

Mintplex-Labs/anything-llm

Stop renting your intelligence. Own it with AnythingLLM.

63k 6.9kJavaScript

UI-TARS-desktop

bytedance/UI-TARS-desktop

The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra

38k 3.8kTypeScript

sglang

sgl-project/sglang

SGLang high-performance serving framework

30k 7.0kPython

heretic

p-e-w/heretic

Fully automatic censorship removal for language models

26k 2.8kPython

haystack

deepset-ai/haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications.

26k 2.9kMDX

Open-AutoGLM

zai-org/Open-AutoGLM

An Open Phone Agent Model & Framework. Unlocking the AI Phone for Everyone

26k 4.0kPython

serve

jina-ai/serve

Build multimodal AI applications with cloud-native stack

22k 2.2kPython

Awesome-Multimodal-Large-Language-Models

BradyFU/Awesome-Multimodal-Large-Language-Models

Latest Advances on Multimodal Large Language Models

18k 1.1k

OmniRoute

diegosouzapw/OmniRoute

OmniRoute — The Free AI Gateway

13k 1.9kTypeScript

lancedb

lancedb/lancedb

Developer-friendly embedded retrieval library for multimodal AI

11k 937HTML

all-in-rag

datawhalechina/all-in-rag

大模型应用开发实战一:RAG技术全栈指南

9.3k 4.6kPython

deeplake

activeloopai/deeplake

Deeplake: AI Data Runtime for Agents

9.2k 721C++

BentoML

bentoml/BentoML

The easiest way to serve AI apps and models

8.7k 981Python

awesome-LLM-resources

WangRongsheng/awesome-LLM-resources

Summary of the world's best LLM resources.

8.7k 920

Machine-Learning-Interviews

alirezadir/Machine-Learning-Interviews

Repository for preparing AI/ML technical interviews with chapters on general coding, ML coding, fundamentals/breadth (including LLMs and multimodal AI), system design, behavioral questions, and more.

8.5k 1.5kJupyter Notebook

R2R

SciPhi-AI/R2R

SoTA production-ready AI retrieval system.

7.9k 644Python

FinRobot

AI4Finance-Foundation/FinRobot

FinRobot: An AI Agent Platform for Financial Analysis

7.5k 1.3kJupyter Notebook

genkit

genkit-ai/genkit

Open-source framework for building AI-powered apps in JavaScript, Go, and Python

6.2k 779TypeScript

PixelRAG

StarTrail-org/PixelRAG

The end of web parsing. The beginning of scalable pixel-native search.

6.1k 481Python

pyspur

PySpur-Dev/pyspur

A visual playground for iterating over AI agents faster.

5.7k 428TypeScript

UltraRAG

OpenBMB/UltraRAG

Less Code, Lower Barrier, Faster Deployment

5.6k 434Python

align-anything

PKU-Alignment/align-anything

Align Anything: Training All-modality Model with Feedback

4.7k 505Python

lmms-eval

EvolvingLMMs-Lab/lmms-eval

Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

4.3k 613Python

NExT-GPT

NExT-GPT/NExT-GPT

Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model

3.6k 361Python

LLaMA-Omni

ictnlp/LLaMA-Omni

LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct.

3.1k 223Python

pixeltable

pixeltable/pixeltable

Unified multimodal backend for AI data apps

1.6k 216Python

EmbedAnything

StarlightSearch/EmbedAnything

Highly Performant, Modular and Memory Safe Ingestion, Inference and Indexing in Rust 🦀

1.3k 139Rust

vectordb-recipes

lancedb/vectordb-recipes

Resource, examples & tutorials for multimodal AI, RAG and agents using vector search and LLMs

966 172Jupyter Notebook