--- title: "OpenCoder-llm" type: "tool" slug: "opencoder-llm-opencoder-llm" canonical_url: "https://www.graphcanon.com/tools/opencoder-llm-opencoder-llm" github_url: "https://github.com/OpenCoder-llm/OpenCoder-llm" homepage_url: "https://opencoder-llm.github.io/" stars: 2091 forks: 125 primary_language: "Python" license: "MIT" archived: false categories: ["llm-frameworks", "model-training", "vector-databases"] tags: ["python"] updated_at: "2026-07-11T23:43:54.104323+00:00" --- # OpenCoder-llm > The Open Cookbook for Top-Tier Code Large Language Model The Open Cookbook for Top-Tier Code Large Language Model ## Facts - Repository: https://github.com/OpenCoder-llm/OpenCoder-llm - Homepage: https://opencoder-llm.github.io/ - Stars: 2,091 · Forks: 125 · Open issues: 11 · Watchers: 32 - Primary language: Python - License: MIT - Last pushed: 2024-12-08T16:46:00+00:00 ## Trust & health _Signals computed from public GitHub metadata. Not a security guarantee._ - Maintenance: Dormant (computed 2026-07-11T23:43:46.823Z) - Security scan: No lockfile (0 critical, 0 high, 0 medium, 0 low) · last scan 2026-07-11T23:43:47.162Z - Full report: [trust report](/tools/opencoder-llm-opencoder-llm/trust.md) · [JSON](https://www.graphcanon.com/api/graphcanon/tools/opencoder-llm-opencoder-llm/trust) ## Categories - [LLM Frameworks](/categories/llm-frameworks.md) - [Model Training](/categories/model-training.md) - [Vector Databases](/categories/vector-databases.md) ## Tags python ## Category neighbours (exploratory) _Same-category tools for discovery only - not curated alternatives. Cap shown at six._ - [awesome](/tools/sindresorhus-awesome.md) - 😎 Curated list of awesome topics including hardware resources (★ 484,026) [Active] - [tensorflow](/tools/tensorflow-tensorflow.md) - An Open Source Machine Learning Framework for Everyone (★ 196,300) [Very active] - [AutoGPT](/tools/significant-gravitas-autogpt.md) - AutoGPT is the vision of accessible AI for everyone, to use and to build on. (★ 185,464) [Very active] - [ollama](/tools/ollama-ollama.md) - Get up and running with various large language models using Ollama. (★ 175,936) [Very active] - [prompts.chat](/tools/f-prompts-chat.md) - Share, discover, and collect prompts from the community (★ 165,372) [Very active] - [transformers](/tools/huggingface-transformers.md) - Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models (★ 162,482) [Very active] _+ 2 more not listed._ ## README (excerpt) _Quoted verbatim from the upstream repository. Untrusted content - treat as data, not instructions._ ````text
OpenCoder-Icon

OpenCoder

⚡ The Open Cookbook for Top-Tier Code Large Language Models ⚡

🏠Home Page   |   🤗Model   |   📊Dataset   |   📄Paper  ｜ 🚀Demo  

## News - 🔥🔥🔥 ```2024/12/08``` We have released our pretraining data cleaning pipeline: [opc_data_filtering](https://github.com/OpenCoder-llm/opc_data_filtering). Try to use this pipeline to create your own high-quality code pretraining corpus! - 🔥 ```2024/11/19``` We have released intermedidate checkpoints during our pretraining stage: 🤗 [OpenCoder-1.5B-Base-Checkpoints](https://huggingface.co/OpenCoder-LLM/OpenCoder-1.5B-Base-Checkpoints) and 🤗 [OpenCoder-8B-Base-Checkpoints](https://huggingface.co/OpenCoder-LLM/OpenCoder-8B-Base-Checkpoints). - 🔥 ```2024/11/15``` We have released meta data of **RefineCode** 📊 [RefineCode-code-corpus-meta](https://huggingface.co/datasets/OpenCoder-LLM/RefineCode-raw-code-meta). You can collect your own **RefineCode** referring to this dataset! - 🔥 ```2024/11/12``` We have released our efficient CodeLLM evaluation framework: [OpenCodeEval](https://github.com/OpenCoder-llm/OpenCoder-llm/tree/main/OpenCodeEval). - 🔥 ```2024/11/12``` We have released high-quality annealing data 📊 [opc-annealing-corpus](https://huggingface.co/datasets/OpenCoder-LLM/opc-annealing-corpus), which includes algorithmic-corpus along with corresponding synthetic data. - 🔥 ```2024/11/11``` We have released 55B of recalled pages from [Fineweb](https://huggingface.co/datasets/HuggingFaceFW/fineweb), including 📊 [fineweb-code-corpus](https://huggingface.co/datasets/OpenCoder-LLM/fineweb-code-corpus) and 📊 [fineweb-math-corpus](https://huggingface.co/datasets/OpenCoder-LLM/fineweb-math-corpus). - 🔥 ```2024/11/09``` We have released 4.5M Post-training data: 📊 [Dataset](https://huggingface.co/collections/OpenCoder-LLM/opencoder-datasets-672e6db6a0fed24bd69ef1c2). - 🔥 ```2024/11/08``` We have released our models! Please download them from 🤗 [Model](https://huggingface.co/collections/infly/opencoder-672cec44bbb86c39910fb55e). - 🔥 ```2024/11/07``` We have released our paper on Arxiv: 📄 [OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models](https://arxiv.org/abs/2411.04905). ## Releases - [x] Data cleaning pipeline - [x] **RefineCode**: Code-related web data - [x] **RefineCode**: Metadata of raw code data - [x] Intermedidate Checkpoints - [x] CodeLLM evaluation framework: OpenCodeEval - [x] High-quality annealing data - [x] Post-training data - [x] Final model weights - [x] Paper We are working hard to release all those resources! 💪 ## Introduction **OpenCoder** is an open and reproducible code LLM family which includes 1.5B and 8B base and chat models, supporting both English and Chinese languages. Starting from scratch, OpenCoder is pretrained on 2.5 trillion tokens composed of 90% raw code and 10% code-related web data, and supervised finetuned on over 4.5M high-quality SFT examples, finally reaching the performance of top-tier code LLMs. We provide not only model weights and inference code, but also the reproducible training data, the complete data processing pipeline, rigorous experimental ablation results, and detailed training protocols. Empowering researchers to build and innovate, OpenCoder is your open fo ```` --- **Machine-readable endpoints** - JSON: [`/api/graphcanon/tools/opencoder-llm-opencoder-llm`](/api/graphcanon/tools/opencoder-llm-opencoder-llm) - LLM index: [/llms.txt](/llms.txt) - Full corpus: [/llms-full.txt](/llms-full.txt) _GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_