{"data":{"slug":"future-agi-future-agi","name":"future-agi","tagline":"End-to-end platform for evaluating, observing, and improving LLM and AI agent applications","github_url":"https://github.com/future-agi/future-agi","owner":"future-agi","repo":"future-agi","owner_avatar_url":"https://avatars.githubusercontent.com/u/147392366?v=4","primary_language":"Python","stars":1559,"forks":449,"topics":["ai-agents","ai-evals","ai-gateway","ai-optimization","ai-simulations","evaluation-framework","guardrails","hallucination-detection","llm","llm-evaluation","llm-observability","llmops","model-evaluation","observability","opentelemetry","rag","rag-evaluation","simulation","telemetry","tracing"],"archived":false,"github_pushed_at":"2026-08-01T14:44:07+00:00","maintenance_label":"Very active","url":"https://www.graphcanon.com/tools/future-agi-future-agi","markdown_url":"https://www.graphcanon.com/tools/future-agi-future-agi.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/future-agi-future-agi","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=future-agi-future-agi","description":"Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.","homepage_url":"https://futureagi.com","license":"Apache-2.0","open_issues":596,"watchers":11,"ai_summary":"Open-source toolkit providing comprehensive features including tracing, evaluations, simulations, datasets, gateway operations, and guardrails. Supports self-hosting with diverse deployment options such as Docker Compose, Production compose overlay, and VM-based services on public clouds.","readme_excerpt":"##  Deployment options\n\n\n\n| Target | Status | Notes |\n|---|:---:|---|\n|  Docker Compose | ✅ | Published images with `docker compose up -d` from a fresh clone |\n|  Production Compose overlay | ✅ | `./deploy/setup.sh` generates secrets, pins image tags, pulls images, and starts the stack |\n|  Kubernetes / Helm | ⏳ | Official manifests and Helm charts are coming soon |\n|  AWS / GCP / Azure | ✅ | Run Docker Compose on a VM today; managed Kubernetes support is coming soon |\n|  AWS Marketplace | ⏳ | Coming soon |\n|  Air-gapped / on-prem | ✅ | No phone-home — [contact sales](mailto:sales@futureagi.com) |\n\n---\n\n---\n\n## 📄 License\n\nFuture AGI is licensed under the **Apache License 2.0**. See [LICENSE](LICENSE) and [NOTICE](NOTICE).\n\n**You own your evaluation logic and your data.** Inspect every evaluator, every prompt, every trace — no black-box scoring, no vendor lock-in.\n\n---\n\n<div align=\"center\">\n\n**Built with ❤️ by the Future AGI team and [contributors worldwide](https://github.com/future-agi/future-agi/graphs/contributors).**\n\nIf Future AGI helps you ship better AI, a ⭐ helps more teams find us.\n\n[🌐 futureagi.com](https://futureagi.com) · [📖 docs.futureagi.com](https://docs.futureagi.com) · [☁️ app.futureagi.com](https://app.futureagi.com) · [📊 status.futureagi.com](https://status.futureagi.com)\n\n</div>","github_created_at":"2026-04-23T14:11:31+00:00","created_at":"2026-07-11T23:18:46.1028+00:00","updated_at":"2026-08-02T18:00:55.858969+00:00","categories":[{"slug":"ai-agents","name":"AI Agents","url":"https://www.graphcanon.com/categories/ai-agents","markdown_url":"https://www.graphcanon.com/categories/ai-agents.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/ai-agents"},{"slug":"evaluation-observability","name":"Evaluation & Observability","url":"https://www.graphcanon.com/categories/evaluation-observability","markdown_url":"https://www.graphcanon.com/categories/evaluation-observability.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/evaluation-observability"}],"tags":[{"slug":"ai-gateway","name":"ai-gateway"},{"slug":"docker-compose","name":"docker-compose"},{"slug":"evals","name":"evals"},{"slug":"llm","name":"llm"},{"slug":"observability","name":"observability"},{"slug":"simulation","name":"simulation"}],"trust":{"provenance":{"is_fork":false,"github_id":1219087723,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-08-02T18:00:55.011Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":11,"days_since_push":1,"last_release_at":"2026-07-30T15:56:53Z"},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T23:18:48.982Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"mcp":{"source":"repo_scan","observed_at":"2026-08-02T18:00:55.483Z","server_manifest":false},"scan":{"source":"repo_scan","observed_at":"2026-08-02T18:00:55.483Z"},"deploy":{"source":"dockerfile:Dockerfile","self_host":true,"observed_at":"2026-08-02T18:00:55.483Z","managed_saas":false},"languages":{"value":["python","javascript"],"source":"github.language+package.json","observed_at":"2026-08-02T18:00:55.483Z"},"has_docker":{"value":true,"source":"dockerfile:Dockerfile","observed_at":"2026-08-02T18:00:55.483Z"},"license_spdx":{"value":"Apache-2.0","source":"github.license","observed_at":"2026-08-02T18:00:55.483Z"}},"decision_facts":{"hosting":null,"pricing":{"model":"freemium","summary":"Future-AGI is open-source under the Apache 2.0 license, allowing for free use but with potential paid services through deployment and support channels."},"requirements":{"min_ram_gb":4,"requires_docker":true},"constraints":{"min_ram_gb":4,"pricing_model":"freemium","requires_docker":true},"when_to_use":["- Use Future-AGI when you require an end-to-end evaluation platform that supports self-hosting through Docker Compose or VM-based services on public clouds.","- If your project demands a transparent approach where you can inspect every evaluator, prompt, and trace without vendor lock-in issues, this tool is suitable."],"when_not_to_use":["- Avoid using Future-AGI if you require Kubernetes or Helm support as of the current state; though these are planned for future release, they are not yet available.","- If your deployment strategy relies on a managed service like AWS Marketplace, consider other options since it is currently 'Coming Soon'."],"source":"enrich:decision_facts","observed_at":"2026-07-12T17:08:12.074Z"},"constraint_facets":{"min_ram_gb":4,"pricing_model":"freemium","requires_docker":true},"decision_summary":[{"label":"Pricing","value":"freemium - Future-AGI is open-source under the Apache 2.0 license, allowing for free use but with potential paid services through deployment and support channels."},{"label":"Requirements","value":"Min 4 GB RAM; Requires Docker"},{"label":"Adopt for","value":"Future-AGI is an open-source toolkit for evaluating and improving LLMs and AI agents. It includes features like tracing, evaluations, simulations, datasets, gateway operations, and guardrails."}]}}