{"data":{"slug":"rhesis-ai-rhesis","name":"rhesis","tagline":"Collaboration layer for AI teams to annotate, review, and improve agent behavior","github_url":"https://github.com/rhesis-ai/rhesis","owner":"rhesis-ai","repo":"rhesis","owner_avatar_url":"https://avatars.githubusercontent.com/u/168341335?v=4","primary_language":"Python","stars":392,"forks":34,"topics":["annotations","feedback-loop","hypothesis-testing","llmops","regression-testing","systematic-evaluation"],"archived":false,"github_pushed_at":"2026-09-18T08:22:45+00:00","maintenance_label":"Very active","stars_delta_30d":11,"url":"https://www.graphcanon.com/tools/rhesis-ai-rhesis","markdown_url":"https://www.graphcanon.com/tools/rhesis-ai-rhesis.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/rhesis-ai-rhesis","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=rhesis-ai-rhesis","description":"The collaboration layer for AI teams: domain experts annotate and review agent behavior, engineers improve the agent from what they find.","homepage_url":"https://www.rhesis.ai/","license":"Other","open_issues":57,"watchers":1,"ai_summary":"Rhesis-ai/rhesis is a platform that facilitates collaboration between domain experts and engineers to annotate, review, and improve AI agent behavior through a feedback loop, hypothesis testing, and systematic evaluation.","readme_excerpt":"### Local (Docker)\n\n```bash\ngit clone https://github.com/rhesis-ai/rhesis.git && cd rhesis && ./rh start\n```\n\n`./rh start` pulls prebuilt images from GHCR. To build from the repo instead, use `./rh start --build` (and `./rh restart --build` after local Dockerfile changes).\n\n**Access:** Frontend at `localhost:3000`, API at `localhost:8080/docs`\n\n**Commands:** `./rh logs` · `./rh stop` · `./rh restart` · `./rh delete`\n\n> This setup enables auto-login for local testing. For production self-hosting, see [Deployment docs](https://docs.rhesis.ai/docs/deployment).\n\nOnce the platform is running, connect your agent with the SDK:\n\n```bash\npip install rhesis-sdk\n```\n\nSee [sdk/README.md](sdk/README.md).\n\n| Option | Best for |\n|--------|----------|\n| **[Rhesis Cloud](https://app.rhesis.ai)** | Managed deployment |\n| **Local Docker (`./rh start`)** | Development and trying the platform |\n| **Self-hosted** | Production deployment — [docs](https://docs.rhesis.ai/docs/deployment) |\n\n---","github_created_at":"2024-10-09T19:32:19+00:00","created_at":"2026-07-11T12:00:09.400245+00:00","updated_at":"2026-09-20T04:31:07.913781+00:00","categories":[{"slug":"developer-tools","name":"Developer Tools","url":"https://www.graphcanon.com/categories/developer-tools","markdown_url":"https://www.graphcanon.com/categories/developer-tools.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/developer-tools"},{"slug":"evaluation-observability","name":"Evaluation & Observability","url":"https://www.graphcanon.com/categories/evaluation-observability","markdown_url":"https://www.graphcanon.com/categories/evaluation-observability.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/evaluation-observability"}],"tags":[{"slug":"annotations","name":"annotations"},{"slug":"feedback-loop","name":"feedback-loop"},{"slug":"hypothesis-testing","name":"hypothesis-testing"},{"slug":"llmops","name":"llmops"},{"slug":"regression-testing","name":"regression-testing"},{"slug":"systematic-evaluation","name":"systematic-evaluation"}],"trust":{"provenance":{"is_fork":false,"github_id":870296864,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-09-18T08:29:07.170Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":30,"days_since_push":0,"last_release_at":"2026-09-16T13:06:43Z","stars_delta_30d":11,"open_issues_delta_30d":-42},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-09-18T08:29:09.355Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-09-18T08:29:06.103Z"},"deploy":{"source":"dockerfile:docker-compose.yml","self_host":true,"observed_at":"2026-09-18T08:29:06.103Z","managed_saas":false},"languages":{"value":["python"],"source":"github.language","observed_at":"2026-09-18T08:29:06.103Z"},"has_docker":{"value":true,"source":"dockerfile:docker-compose.yml","observed_at":"2026-09-18T08:29:06.103Z"},"license_spdx":{"value":"Other","source":"github.license","observed_at":"2026-09-18T08:29:06.103Z"}},"decision_facts":{"hosting":null,"pricing":{"model":"unknown","summary":"Pricing details are not provided in the repository data."},"requirements":{"notes":["The platform can be started locally using Docker with the command `./rh start`."],"min_ram_gb":null,"requires_docker":true},"constraints":{"min_ram_gb":null,"pricing_model":"unknown","requires_docker":true},"when_to_use":["When your team requires a structured feedback loop for continuous improvement of AI agent behavior.","If you need to integrate domain expert insights directly into the AI development process for more informed decisions.","For teams that want to perform systematic evaluations and hypothesis testing to refine AI models."],"when_not_to_use":["If your team does not require a collaborative platform for annotating and reviewing AI behavior.","When you are looking for a tool that focuses solely on model training without the need for a feedback loop or systematic evaluation.","If your project does not involve domain experts who can provide annotations and reviews to improve AI behavior."],"source":"enrich:decision_facts","observed_at":"2026-09-18T09:34:08.399Z"},"constraint_facets":{"min_ram_gb":null,"pricing_model":"unknown","requires_docker":true},"decision_summary":[{"label":"Pricing","value":"unknown - Pricing details are not provided in the repository data."},{"label":"Requirements","value":"Requires Docker; The platform can be started locally using Docker with the command `./rh start`."},{"label":"Adopt for","value":"Rhesis is a collaboration layer for AI teams to annotate, review, and improve agent behavior through a feedback loop, hypothesis testing, and systematic evaluation."}]}}