{"data":{"slug":"darkrishabh-agent-skills-eval","name":"agent-skills-eval","tagline":"A test runner for agentskills.io-style AI agent skills","github_url":"https://github.com/darkrishabh/agent-skills-eval","owner":"darkrishabh","repo":"agent-skills-eval","owner_avatar_url":"https://avatars.githubusercontent.com/u/812474?v=4","primary_language":"TypeScript","stars":790,"forks":42,"topics":["agent-evals","agent-skills","agentskills","ai-agents","cli","jsonl","llm-evals","llm-evaluation","openai-compatible","typescript","yaml"],"archived":false,"github_pushed_at":"2026-08-05T15:24:37+00:00","maintenance_label":"Steady","stars_delta_30d":153,"url":"https://www.graphcanon.com/tools/darkrishabh-agent-skills-eval","markdown_url":"https://www.graphcanon.com/tools/darkrishabh-agent-skills-eval.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/darkrishabh-agent-skills-eval","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=darkrishabh-agent-skills-eval","description":"A test runner for agentskills.io-style AI agent skills","homepage_url":"https://darkrishabh.github.io/agent-skills-eval/","license":"MIT","open_issues":15,"watchers":4,"ai_summary":"Provides utilities to evaluate and test capabilities of AI agents based on the agentskills.io framework using TypeScript.","readme_excerpt":"## Install\n\n```bash\nnpm install agent-skills-eval\n```\n\nOr run directly without installing:\n\n```bash\nnpx agent-skills-eval --help\n```\n\n---\n\n## License\n\nMIT. See [LICENSE](LICENSE).\n\n---\n\n<div align=\"center\">\n\nBuilt for the [Agent Skills](https://agentskills.io) ecosystem.\n\n</div>","github_created_at":"2026-05-06T05:10:29+00:00","created_at":"2026-07-11T11:59:57.76475+00:00","updated_at":"2026-09-20T06:57:57.740204+00:00","categories":[{"slug":"ai-agents","name":"AI Agents","url":"https://www.graphcanon.com/categories/ai-agents","markdown_url":"https://www.graphcanon.com/categories/ai-agents.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/ai-agents"},{"slug":"evaluation-observability","name":"Evaluation & Observability","url":"https://www.graphcanon.com/categories/evaluation-observability","markdown_url":"https://www.graphcanon.com/categories/evaluation-observability.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/evaluation-observability"}],"tags":[{"slug":"agent-evals","name":"agent-evals"},{"slug":"agent-skills","name":"agent-skills"},{"slug":"agentskills","name":"agentskills"},{"slug":"ai-agents","name":"ai-agents"},{"slug":"cli","name":"cli"},{"slug":"jsonl","name":"jsonl"},{"slug":"llm-evals","name":"llm-evals"},{"slug":"llm-evaluation","name":"llm-evaluation"}],"trust":{"provenance":{"is_fork":false,"github_id":1230541272,"owner_type":"User","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-09-20T06:57:55.515Z","maintenance":{"label":"Steady","score":60,"methodology":"github_public_v1","releases_90d":0,"days_since_push":45,"last_release_at":null,"stars_delta_30d":153,"open_issues_delta_30d":4},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T11:59:58.968Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"mcp":{"source":"repo_scan","observed_at":"2026-09-20T06:57:56.526Z","server_manifest":false},"scan":{"source":"repo_scan","observed_at":"2026-09-20T06:57:56.526Z"},"has_cli":{"value":true,"source":"package.json:bin|scripts","observed_at":"2026-09-20T06:57:56.526Z"},"languages":{"value":["typescript","javascript"],"source":"github.language+package.json","observed_at":"2026-09-20T06:57:56.526Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-09-20T06:57:56.526Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":null,"constraints":null,"when_to_use":["When you use the agentskills.io framework for your project and require robust evaluation tools that can understand this specific framework's nuances.","If your application is built with TypeScript, as agent-skills-eval provides native support for TypeScript which can streamline integration."],"when_not_to_use":["This tool may not be suitable if you are using a different AI agent development framework outside of agentskills.io, as it specializes in evaluating skills based on this particular framework.","If your project does not use TypeScript and avoiding transpiler overhead is a priority, then opting for another evaluation tool that supports your primary language might be more beneficial."],"source":"enrich:decision_facts","observed_at":"2026-07-17T11:56:05.699Z"},"constraint_facets":null,"decision_summary":[{"label":"Adopt for","value":"agent-skills-eval offers utilities to evaluate AI agents in line with agentskills.io framework using TypeScript."}]}}