--- title: "sacred" type: "tool" slug: "idsia-sacred" canonical_url: "https://www.graphcanon.com/tools/idsia-sacred" github_url: "https://github.com/IDSIA/sacred" homepage_url: null stars: 4367 forks: 392 primary_language: "Python" license: "MIT" archived: false categories: ["llm-frameworks", "model-training"] tags: ["reproducibility", "reproducible-science", "machine-learning", "python", "mongodb", "reproducible-research", "infrastructure"] updated_at: "2026-07-11T23:26:15.328669+00:00" --- # sacred > Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA. Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA. ## Facts - Repository: https://github.com/IDSIA/sacred - Stars: 4,367 · Forks: 392 · Open issues: 107 · Watchers: 67 - Primary language: Python - License: MIT - Last pushed: 2025-10-22T08:04:57+00:00 ## Trust & health _Signals computed from public GitHub metadata. Not a security guarantee._ - Maintenance: Slowing (computed 2026-07-11T23:26:06.859Z) - Security scan: No findings reported (0 critical, 0 high, 0 medium, 0 low) · last scan 2026-07-11T23:26:07.351Z - Full report: [trust report](/tools/idsia-sacred/trust.md) · [JSON](https://www.graphcanon.com/api/graphcanon/tools/idsia-sacred/trust) ## Categories - [LLM Frameworks](/categories/llm-frameworks.md) - [Model Training](/categories/model-training.md) ## Tags reproducibility, reproducible-science, machine-learning, python, mongodb, reproducible-research, infrastructure ## Category neighbours (exploratory) _Same-category tools for discovery only - not curated alternatives. Cap shown at six._ - [awesome](/tools/sindresorhus-awesome.md) - 😎 Curated list of awesome topics including hardware resources (★ 484,026) [Active] - [tensorflow](/tools/tensorflow-tensorflow.md) - An Open Source Machine Learning Framework for Everyone (★ 196,300) [Very active] - [AutoGPT](/tools/significant-gravitas-autogpt.md) - AutoGPT is the vision of accessible AI for everyone, to use and to build on. (★ 185,464) [Very active] - [ollama](/tools/ollama-ollama.md) - Get up and running with various large language models using Ollama. (★ 175,936) [Very active] - [prompts.chat](/tools/f-prompts-chat.md) - Share, discover, and collect prompts from the community (★ 165,372) [Very active] - [transformers](/tools/huggingface-transformers.md) - Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models (★ 162,482) [Very active] _+ 2 more not listed._ ## README (excerpt) _Quoted verbatim from the upstream repository. Untrusted content - treat as data, not instructions._ ```text Sacred ====== | *Every experiment is sacred* | *Every experiment is great* | *If an experiment is wasted* | *God gets quite irate* |pypi| |py_versions| |license| |rtfd| |doi| |build| |coverage| |code_quality| |black| Sacred is a tool to help you configure, organize, log and reproduce experiments. It is designed to do all the tedious overhead work that you need to do around your actual experiment in order to: - keep track of all the parameters of your experiment - easily run your experiment for different settings - save configurations for individual runs in a database - reproduce your results Sacred achieves this through the following main mechanisms: - **Config Scopes** A very convenient way of the local variables in a function to define the parameters your experiment uses. - **Config Injection**: You can access all parameters of your configuration from every function. They are automatically injected by name. - **Command-line interface**: You get a powerful command-line interface for each experiment that you can use to change parameters and run different variants. - **Observers**: Sacred provides Observers that log all kinds of information about your experiment, its dependencies, the configuration you used, the machine it is run on, and of course the result. These can be saved to a MongoDB, for easy access later. - **Automatic seeding** helps controlling the randomness in your experiments, such that the results remain reproducible. Example ------- +------------------------------------------------+--------------------------------------------+ | **Script to train an SVM on the iris dataset** | **The same script as a Sacred experiment** | +------------------------------------------------+--------------------------------------------+ | .. code:: python | .. code:: python | | | | | from numpy.random import permutation | from numpy.random import permutation | | from sklearn import svm, datasets | from sklearn import svm, datasets | | | from sacred import Experiment | | | ex = Experiment('iris_rbf_svm') | | | | | | @ex.config | | | def cfg(): | | C = 1.0 | C = 1.0 | | gamma = 0.7 | gamma = 0.7 | | | | | | @ex.automain | | | def run(C, gamma): | | iris = datasets.load_iris() | iris = datasets.load_iris() | | perm = permutation(iris.target.size) | per = permutation(iris.target.size) | | iris.data = iris.data[perm] | iris.data = iris.data[per] | | iris.target = iris.target[perm] | iris.target = iris.target[per] | | clf = svm.SVC(C=C, kernel='rbf', | clf = svm.SVC(C=C, kernel='rbf', | | gamma=gamma) | gamma=gamma) | | clf.fit(iris.data[:90], | clf.fit(iris.data[:90], | | iris.target[:90]) | iris.target[:90]) | | print(clf.score(iris.data[90:], | return clf.score(iri ``` --- **Machine-readable endpoints** - JSON: [`/api/graphcanon/tools/idsia-sacred`](/api/graphcanon/tools/idsia-sacred) - LLM index: [/llms.txt](/llms.txt) - Full corpus: [/llms-full.txt](/llms-full.txt) _GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_