{"data":{"slug":"swe-bench-swe-bench","name":"SWE-bench","tagline":"SWE-bench: Can Language Models Resolve Real-world Github Issues?","github_url":"https://github.com/SWE-bench/SWE-bench","owner":"SWE-bench","repo":"SWE-bench","owner_avatar_url":"https://avatars.githubusercontent.com/u/139597579?v=4","primary_language":"Python","stars":5395,"forks":919,"topics":["benchmark","language-model","software-engineering"],"archived":false,"github_pushed_at":"2026-04-01T05:16:30+00:00","maintenance_label":"Slowing","url":"https://www.graphcanon.com/tools/swe-bench-swe-bench","markdown_url":"https://www.graphcanon.com/tools/swe-bench-swe-bench.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/swe-bench-swe-bench","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=swe-bench-swe-bench","description":"SWE-bench: Can Language Models Resolve Real-world Github Issues?","homepage_url":"https://www.swebench.com","license":"MIT","open_issues":127,"watchers":37,"ai_summary":null,"readme_excerpt":"## ✍️ Citation & license\nMIT license. Check `LICENSE.md`.\n\nIf you find our work helpful, please use the following citations.\n\nFor SWE-bench (Verified):\n```bibtex\n@inproceedings{\n    jimenez2024swebench,\n    title={{SWE}-bench: Can Language Models Resolve Real-world Github Issues?},\n    author={Carlos E Jimenez and John Yang and Alexander Wettig and Shunyu Yao and Kexin Pei and Ofir Press and Karthik R Narasimhan},\n    booktitle={The Twelfth International Conference on Learning Representations},\n    year={2024},\n    url={https://openreview.net/forum?id=VTF8yNQM66}\n}\n```\n\nFor SWE-bench Multimodal\n```bibtex\n@inproceedings{\n    yang2024swebenchmultimodal,\n    title={{SWE}-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?},\n    author={John Yang and Carlos E. Jimenez and Alex L. Zhang and Kilian Lieret and Joyce Yang and Xindi Wu and Ori Press and Niklas Muennighoff and Gabriel Synnaeve and Karthik R. Narasimhan and Diyi Yang and Sida I. Wang and Ofir Press},\n    booktitle={The Thirteenth International Conference on Learning Representations},\n    year={2025},\n    url={https://openreview.net/forum?id=riTiq3i21b}\n}\n```\n\nFor SWE-bench Multilingual\n```bibtex\n@misc{yang2025swesmith,\n    title={SWE-smith: Scaling Data for Software Engineering Agents},\n    author={John Yang and Kilian Lieret and Carlos E. Jimenez and Alexander Wettig and Kabir Khandpur and Yanzhe Zhang and Binyuan Hui and Ofir Press and Ludwig Schmidt and Diyi Yang},\n    year={2025},\n    eprint={2504.21798},\n    archivePrefix={arXiv},\n    primaryClass={cs.SE},\n    url={https://arxiv.org/abs/2504.21798},\n}\n```","github_created_at":"2023-10-04T01:22:46+00:00","created_at":"2026-07-11T23:46:00.597809+00:00","updated_at":"2026-07-11T23:46:04.713951+00:00","categories":[{"slug":"ai-agents","name":"AI Agents","url":"https://www.graphcanon.com/categories/ai-agents","markdown_url":"https://www.graphcanon.com/categories/ai-agents.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/ai-agents"},{"slug":"llm-frameworks","name":"LLM Frameworks","url":"https://www.graphcanon.com/categories/llm-frameworks","markdown_url":"https://www.graphcanon.com/categories/llm-frameworks.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/llm-frameworks"},{"slug":"evaluation-observability","name":"Evaluation & Observability","url":"https://www.graphcanon.com/categories/evaluation-observability","markdown_url":"https://www.graphcanon.com/categories/evaluation-observability.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/evaluation-observability"}],"tags":[{"slug":"benchmark","name":"benchmark"},{"slug":"python","name":"python"},{"slug":"language-model","name":"language-model"},{"slug":"software-engineering","name":"software-engineering"}],"trust":{"provenance":{"is_fork":false,"github_id":700117650,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-07-11T23:46:02.357Z","maintenance":{"label":"Slowing","score":36,"methodology":"github_public_v1","releases_90d":0,"days_since_push":101,"last_release_at":null},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T23:46:02.735Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-07-11T23:46:02.099Z"},"languages":{"value":["python"],"source":"github.language+pyproject.toml","observed_at":"2026-07-11T23:46:02.099Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-07-11T23:46:02.099Z"}}}}