{"data":{"slug":"arthur-ai-arthur-engine","name":"arthur-engine","tagline":"Make AI work for Everyone - Monitoring and governing for your AI/ML","github_url":"https://github.com/arthur-ai/arthur-engine","owner":"arthur-ai","repo":"arthur-engine","owner_avatar_url":"https://avatars.githubusercontent.com/u/62756214?v=4","primary_language":"Python","stars":85,"forks":13,"topics":["agentic","benchmarking","evaluation","genai","guardrails","llm","ml","monitoring","tracing"],"archived":false,"github_pushed_at":"2026-07-15T05:12:50+00:00","maintenance_label":"Very active","url":"https://www.graphcanon.com/tools/arthur-ai-arthur-engine","markdown_url":"https://www.graphcanon.com/tools/arthur-ai-arthur-engine.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/arthur-ai-arthur-engine","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=arthur-ai-arthur-engine","description":"Make AI work for Everyone - Monitoring and governing for your AI/ML ","homepage_url":"https://arthur.ai","license":"MIT","open_issues":37,"watchers":4,"ai_summary":null,"readme_excerpt":"<div align=\"center\">\n\n<img src=\"https://cdn.prod.website-files.com/5a749d2c4f343700013366d4/67eab9e594ec4accb58badeb_arthur-logo-symbol.svg\" alt=\"Arthur AI Logo\" width=\"150\"/>\n\n<i>Make AI work for Everyone.</i>\n\n\n\n\n[Website](https://arthur.ai?utm_source=github&utm_medium=readme) - [Documentation](https://docs.arthur.ai/?utm_source=github&utm_medium=readme) - [Talk to someone at Arthur](https://www.arthur.ai/book-demo?utm_source=github&utm_medium=readme)\n\n</div>\n\n# The Arthur Engine\n\nThe Arthur Engine provides a **complete service** for developing, monitoring, and governing your AI/ML workloads using popular open-source technologies and frameworks. It is a tool designed for:\n\n- **Enforcing Guardrails in your LLM Applications and Generative AI Workflows**\n  - Configurable metrics for real-time detection of PII or Sensitive Data leakage, Hallucination, Prompt Injection attempts, Toxic language, and other quality metrics\n- **Building, Evaluating, Observing and Governing Agentic Applications**\n  - Collect and analyze OpenInference OpenTelemetry (OTEL) traces from any agentic workflow or LLM application\n  - Run continuous evaluations on live traces to catch regressions and quality issues automatically\n  - Manage, version, and iterate on prompts across your applications\n  - Run experiments to compare prompt variants and measure their impact on quality metrics\n  - Evaluate and monitor Retrieval-Augmented Generation (RAG) pipelines end-to-end\n- **Monitoring and Benchmarking Machine Learning models (requires the Arthur Platform)**\n  - Support for a wide range of evaluation metrics (e.g., drift, accuracy, precision, recall, F1, and AUC)\n  - Tools for comparing models, exploring feature importance, and identifying areas for optimization\n  - For LLMs/GenAI applications, measure and monitor response relevance, hallucination rates, token counts, latency, and more\n- **Extensibility to fit into your application's architecture**\n  - Native support for custom metrics and extensible API\n\n## Quickstart\n\n**Claude Code users**\n\nPaste this prompt directly into Claude Code that's running on your agent application:\n\n```\nFor each skill name in this list — arthur-onboard-oss, arthur-onboard-oss-engine, arthur-onboard-task, arthur-onboard-analyze, arthur-onboard-instrument, arthur-onboard-prompts, arthur-onboard-verify, arthur-onboard-eval-provider, arthur-onboard-evals, arthur-skills-upgrade — fetch https://raw.githubusercontent.com/arthur-ai/arthur-engine/refs/heads/main/integrations/claude-code-skills/arthur-onboard/<skill-name>/SKILL.md and save it to ~/.claude/skills/<skill-name>/SKILL.md (create the directory if it doesn't exist). Also fetch https://raw.githubusercontent.com/arthur-ai/arthur-engine/refs/heads/main/integrations/claude-code-skills/arthur-onboard/arthur-onboard-instrument/EXAMPLES.md and save it to ~/.claude/skills/arthur-onboard-instrument/EXAMPLES.md. Once all files are saved, read ~/.claude/skills/arthur-onboard-oss/SKILL.md and follow its instructions.\n```\n\n**Codex users**\n\nPaste this prompt directly into a Codex session that's running on your agent application:\n\n```\nInstall the Arthur OSS onboarding Codex skills from arthur-ai/arthur-engine.\n\nInstall these skill folders into ${CODEX_HOME:-~/.codex}/skills:\n- arthur-onboard-oss\n- arthur-onboard-oss-engine\n- arthur-onboard-task\n- arthur-onboard-analyze\n- arthur-onboard-instrument\n- arthur-onboard-prompts\n- arthur-onboard-verify\n- arthur-onboard-eval-provider\n- arthur-onboard-evals\n\nFetch each SKILL.md from:\nhttps://raw.githubusercontent.com/arthur-ai/arthur-engine/main/integrations/claude-code-skills/arthur-onboard/<skill-name>/SKILL.md\n\nCreate each directory as needed. After installation, remind me to restart Codex.\n```\n\n**Everyone else**\n\n1. Run the engine installer with the below command:\n\nMac\n```\nbash <(curl -sSL https://get-genai-engine.arthur.ai/mac)\n```\n\nWindows\n```\niex (iwr -Uri \"https://get-genai-engine.arthur.ai/win\" -UseBasicParsing).Content\n```\n\n2. Instrument your agents","github_created_at":"2025-03-26T21:08:54+00:00","created_at":"2026-07-15T10:43:43.005877+00:00","updated_at":"2026-07-15T10:43:45.846524+00:00","categories":[{"slug":"ai-agents","name":"AI Agents","url":"https://www.graphcanon.com/categories/ai-agents","markdown_url":"https://www.graphcanon.com/categories/ai-agents.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/ai-agents"},{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"},{"slug":"llm-frameworks","name":"LLM Frameworks","url":"https://www.graphcanon.com/categories/llm-frameworks","markdown_url":"https://www.graphcanon.com/categories/llm-frameworks.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/llm-frameworks"}],"tags":[{"slug":"agentic","name":"agentic"},{"slug":"benchmarking","name":"benchmarking"},{"slug":"evaluation","name":"evaluation"},{"slug":"genai","name":"genai"},{"slug":"guardrails","name":"guardrails"},{"slug":"llm","name":"llm"},{"slug":"ml","name":"ml"},{"slug":"monitoring","name":"monitoring"}],"trust":{"provenance":{"is_fork":false,"github_id":955570780,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-07-15T10:43:44.164Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":25,"days_since_push":0,"last_release_at":"2026-07-14T04:07:28Z"},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-15T10:43:44.497Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-07-15T10:43:43.923Z"},"languages":{"value":["python"],"source":"github.language","observed_at":"2026-07-15T10:43:43.923Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-07-15T10:43:43.923Z"}}}}