Comparison
mteb vs chunktuner
Verdict
Pick mteb when license: mteb is Apache-2.0, chunktuner is MIT; pick chunktuner when license: chunktuner is MIT, mteb is Apache-2.0.
Markdown twin · mteb alternatives · chunktuner alternatives
GraphCanon updated today
vs
Trust & integrity
| Signal | mteb | chunktuner |
|---|---|---|
| Maintenance | Very active (1d since push) As of today · github_public_v1 | Active (20d since push) As of today · github_public_v1 |
| Provenance | Not a fork · Organization account As of today · github_public_v1 | Not a fork · Personal account As of today · github_public_v1 |
| Security (OSV) | No lockfile As of today · none | 2 low (2 low) As of today · mcp_manifest@v1 |
Tagline
- mteb
- State-of-the-art evaluation of embeddings across languages and modalities
- chunktuner
- Benchmark and optimize chunking strategies for RAG corpus
Stars
- mteb
- 3.3k
- chunktuner
- 2
Forks
- mteb
- 638
- chunktuner
- 0
Open issues
- mteb
- 295
- chunktuner
- 0
Language
- mteb
- Python
- chunktuner
- Python
Adopt for
- mteb
- -
- chunktuner
- A specialized benchmarking suite for optimizing chunking strategies in RAG corpora, offering a comprehensive toolkit inclusive of CLI and server components.
Persona
- mteb
- -
- chunktuner
- -
Runtime
- mteb
- -
- chunktuner
- -
License
- mteb
- Apache-2.0
- chunktuner
- MIT
Last pushed
- mteb
- Jul 9, 2026
- chunktuner
- Jun 21, 2026
Categories
- mteb
- Evaluation & Observability
- chunktuner
- Data & Retrieval, Evaluation & Observability
Trust and health
Maintenance
- mteb
- Very active (96%)
- chunktuner
- Active (82%)
Days since push
- mteb
- 1d
- chunktuner
- 20d
Open issues (now)
- mteb
- 295
- chunktuner
- 0
Owner type
- mteb
- Organization
- chunktuner
- User
Security scan
- mteb
- No lockfile
- chunktuner
- 2 low (2 low)
Full report
- mteb
- Trust report
- chunktuner
- Trust report
Choose mteb if…
- License: mteb is Apache-2.0, chunktuner is MIT.
- Tags unique to mteb: benchmark, embeddings, information-retrieval, multilingual-nlp.
- mteb ships Docker support for self-hosted deployment.
When NOT to use mteb
- Evaluation & Observability: Defer heavyweight eval infra only until you have real traffic - never skip it once users depend on answers.
Choose chunktuner if…
- License: chunktuner is MIT, mteb is Apache-2.0.
- Pricing: Open source with an MIT license, offering free use for both personal and commercial projects. No costs beyond typical computing resources are implied by its usage..
- Tags unique to chunktuner: chunking, embedding, langchain, litellm.
- Also covers Data & Retrieval.
- - You are working specifically with retrieval-augmented generation (RAG) systems which require tailored optimization and evaluation.
When NOT to use chunktuner
- - If you do not deal with RAG systems or if the nature of your workflow does not benefit from specific optimizations in text chunking strategies across a corpus.
- - You are working on projects that don't necessitate evaluation and optimization at the level provided by 'chunktuner', such as simpler tasks that can be managed without extensive configuration tools.
Explore
Sources
Every stat on this page traces to a dated GitHub sync, license file, enrichment field, or trust scan.
- GitHub stars (embeddings-benchmark/mteb) · observed Jul 11, 2026
- GitHub forks (embeddings-benchmark/mteb) · observed Jul 11, 2026
- Last push (embeddings-benchmark/mteb) · observed Jul 9, 2026
- License file (Apache-2.0) · observed Jul 11, 2026
- Trust scan (lockfile / OSV) · observed Jul 11, 2026
- GitHub stars (shantanu-deshmukh/chunktuner) · observed Jul 11, 2026
- GitHub forks (shantanu-deshmukh/chunktuner) · observed Jul 11, 2026
- Last push (shantanu-deshmukh/chunktuner) · observed Jun 21, 2026
- License file (MIT) · observed Jul 11, 2026
- Decision facts (enrichment) · observed Jul 12, 2026
- Trust scan (lockfile / OSV) · observed Jul 11, 2026
GitHub stars on cards: mteb 3.3k · chunktuner 2 (synced Jul 11, 2026).
Common questions
- What is the difference between mteb and chunktuner?
- mteb: State-of-the-art evaluation of embeddings across languages and modalities. chunktuner: Benchmark and optimize chunking strategies for RAG corpus. See the comparison table for live GitHub stats and shared categories.
- When should I choose mteb over chunktuner?
- Choose mteb over chunktuner when License: mteb is Apache-2.0, chunktuner is MIT; Tags unique to mteb: benchmark, embeddings, information-retrieval, multilingual-nlp; mteb ships Docker support for self-hosted deployment.
- When should I choose chunktuner over mteb?
- Choose chunktuner over mteb when License: chunktuner is MIT, mteb is Apache-2.0; Pricing: Open source with an MIT license, offering free use for both personal and commercial projects. No costs beyond typical computing resources are implied by its usage.; Tags unique to chunktuner: chunking, embedding, langchain, litellm; Also covers Data & Retrieval; - You are working specifically with retrieval-augmented generation (RAG) systems which require tailored optimization and evaluation.
- When should I avoid mteb?
- Evaluation & Observability: Defer heavyweight eval infra only until you have real traffic - never skip it once users depend on answers.
- When should I avoid chunktuner?
- - If you do not deal with RAG systems or if the nature of your workflow does not benefit from specific optimizations in text chunking strategies across a corpus. - You are working on projects that don't necessitate evaluation and optimization at the level provided by 'chunktuner', such as simpler tasks that can be managed without extensive configuration tools.
- Is mteb or chunktuner more popular on GitHub?
- mteb has more GitHub stars (3,349 vs 2). Stars measure visibility, not whether either tool fits your constraints.
- Are mteb and chunktuner open source?
- Yes - both are open-source projects on GitHub (mteb: Apache-2.0, chunktuner: MIT).
- Where can I find alternatives to mteb or chunktuner?
- GraphCanon lists graph-backed alternatives at mteb alternatives and chunktuner alternatives (mteb markdown twin, chunktuner markdown twin), ranked by typed relationship edges rather than popularity votes.
- Is there a machine-readable version of this comparison?
- Yes. The markdown twin at this comparison mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers.
- Which is better maintained, mteb or chunktuner?
- mteb: Very active. chunktuner: Active. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance.
- Where are the full trust reports for mteb and chunktuner?
- GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: mteb trust report; chunktuner trust report.