EmbedAnything
StarlightSearch/EmbedAnything
Highly Performant, Modular and Memory Safe Ingestion, Inference and Indexing in Rust 🦀
Overview
EmbedAnything is a minimalist yet highly performant embedding pipeline built in Rust. It supports various types of embeddings and seamlessly integrates them into vector databases, offering robust multisource and multimodal support.
Categories
Tags
Similar tools
transformers
huggingface/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models
langflow
langflow-ai/langflow
Langflow is a powerful platform for building and deploying AI-powered agents and workflows.
firecrawl
firecrawl/firecrawl
The API to search, scrape, and interact with the web at scale.
open-webui
open-webui/open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
vllm
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
PaddleOCR
PaddlePaddle/PaddleOCR
PaddleOCR: A powerful OCR toolkit for transforming PDFs/images into structured data
Install
cargo add EmbedAnythingREADME
Highly Performant, Modular and Memory Safe
Ingestion, Inference and Indexing in Rust 🦀
Python docs »
Rust docs »
Benchmarks
·
FAQ
·
Adapters
.
Collaborations
.
Notebooks
EmbedAnything is a minimalist, yet highly performant, modular, lightning-fast, lightweight, multisource, multimodal, and local embedding pipeline built in Rust. Whether you're working with text, images, audio, PDFs, websites, or other media, EmbedAnything streamlines the process of generating embeddings from various sources and seamlessly streaming (memory-efficient-indexing) them to a vector database. It supports dense, sparse, ONNX, model2vec and late-interaction embeddings, offering flexibility for a wide range of use cases.
Table of Contents
🚀 Key Features
- No Dependency on Pytorch: Easy to deploy on cloud, comes with low memory footprint.
- Highly Modular : Choose any vectorDB adapter for RAG, with
1 line1 word of code - Backend : Supports Candle, ONNX and cloud models
- MultiModality : Works with text sources like PDFs, txt, md, Images JPG and Audio, .WAV
- GPU support : Hardware acceleration on GPU as well.
- Chunking : In-built chunking methods like semantic, late-chunking
- Vector Streaming: : Separate file processing, Indexing and Inferencing on different threads, reduces latency.
- AWS S3 Bucket: : Directly import AWS S3 bucket files.
- Prebult Docker Image : Just pull it: starlightsearch/embedanything-server
- SearchAgent : Example of how you can use index for Searchr1 reasoning.
💡What is Vector Streaming
Embedding mo