{"data":{"slug":"imeanai-webcanvas","name":"WebCanvas","tagline":"All-in-one Web Agent framework for post-training","github_url":"https://github.com/iMeanAI/WebCanvas","owner":"iMeanAI","repo":"WebCanvas","owner_avatar_url":"https://avatars.githubusercontent.com/u/171883857?v=4","primary_language":"Python","stars":281,"forks":21,"topics":["agent","benchmark-framework","llm-agent","llm-evaluation"],"archived":false,"github_pushed_at":"2025-07-07T10:55:58+00:00","maintenance_label":"Dormant","stars_delta_30d":1,"url":"https://www.graphcanon.com/tools/imeanai-webcanvas","markdown_url":"https://www.graphcanon.com/tools/imeanai-webcanvas.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/imeanai-webcanvas","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=imeanai-webcanvas","description":"All-in-one Web Agent framework for post-training. Start building with a few clicks!","homepage_url":"https://www.imean.ai/web-canvas","license":"MIT","open_issues":5,"watchers":3,"ai_summary":"WebCanvas is an open-source framework to build, train and evaluate web agents.","readme_excerpt":"

WebCanvas: All-in-one Open-Source Framework for Building, Training, and Evaluating Web Agents

\n\n\n

\n \"License\n \"Python\n \"GitHub\n \"PRs\n \"GitHub\n \"GitHub\n\n

\n\n

\n \"Platform\" Platform • \n \"Paper\" Paper • \n \"Dataset\" Dataset • \n \"Discord\" Discord • \n \"Twitter\" Twitter • \n \"WeChat\" WeChat\n

\n\nExisting frameworks for web agent development are either offline and static, or operate within a fully reproducible environment with limited Internet dynamics. The WebCanvas project aims to pioneer the online development, training and evaluation of web agents. We offer a suite of toolkits for scaling and maintaining a **KEY-NODE** based web trajectories for web agents to support this endeavor. We welcome any constructive feedback on the project and look forward to partnering with you in developing agents for web tasks!\n\n\n\n## 🔥 News\n- **[2024, December 26]** v0.0.4 released! Major updates include:\n - Introduced a new JavaScript event listener-based evaluation system that decouples evaluation methods from action space, enabling assessment of purely visually-grounded agents\n - Integrated with [Browserbase](https://www.browserbase.com/) cloud browser environment for more stable and consistent evaluation\n - Published and maintaining an up-to-date [leaderboard](Mind2web-live_Leaderboard.md) for Mind2Web-Live benchmark, still far from saturation!\n- **[2024, September 9]** Support evaluation for OpenAI new o1 models, includes o1-preview and o1-mini. Just set the 'planning_text_model' parameter to 'o1-preview' or 'o1-mini'.\n- **[2024, August 9]** We're excited to announce the release of v0.0.3 of WebCanvas! This update introduces support for evaluation of data operations, such as caching data in process and outputting the final answer. You can now define and evaluate a broader range of web tasks using iMean Builder and WebCanvas. Additionally, we've introduced a new metric: ***US dollar consumption / key node completion(usd_efficiency_score)***, detailed in [this section]","github_created_at":"2024-06-06T06:37:41+00:00","created_at":"2026-07-11T12:00:47.013317+00:00","updated_at":"2026-09-20T06:59:32.290984+00:00","categories":[{"slug":"ai-agents","name":"AI Agents","url":"https://www.graphcanon.com/categories/ai-agents","markdown_url":"https://www.graphcanon.com/categories/ai-agents.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/ai-agents"},{"slug":"evaluation-observability","name":"Evaluation & Observability","url":"https://www.graphcanon.com/categories/evaluation-observability","markdown_url":"https://www.graphcanon.com/categories/evaluation-observability.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/evaluation-observability"}],"tags":[{"slug":"agent","name":"agent"},{"slug":"benchmark-framework","name":"benchmark-framework"},{"slug":"llm-agent","name":"llm-agent"},{"slug":"llm-evaluation","name":"llm-evaluation"}],"trust":{"provenance":{"is_fork":false,"github_id":811207186,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-09-20T06:59:29.950Z","maintenance":{"label":"Dormant","score":18,"methodology":"github_public_v1","releases_90d":0,"days_since_push":439,"last_release_at":null,"stars_delta_30d":1,"open_issues_delta_30d":-1},"security_summary":{"status":"findings","scanner":"osv@v1","low_count":54,"high_count":0,"last_scan_at":"2026-07-11T12:01:04.222Z","medium_count":0,"scan_profile":"deps","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-09-20T06:59:30.970Z"},"languages":{"value":["python"],"source":"github.language","observed_at":"2026-09-20T06:59:30.970Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-09-20T06:59:30.970Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":{"notes":["Requires Python 3.11 for compatibility."],"min_ram_gb":null,"requires_docker":false},"constraints":{"min_ram_gb":null,"requires_docker":false},"when_to_use":["When you need to develop web agents capable of interacting in dynamic online environments rather than static or offline ones.","For integrating a JavaScript event listener-based evaluation system that decouples assessment from the action space.","To leverage cloud browser environments for more stable and consistent evaluation through integration with Browserbase."],"when_not_to_use":["If you are working within fully reproducible environments where Internet dynamics do not influence your project's outcomes.","When your evaluation needs cannot be addressed by a purely visually-grounded assessment, as WebCanvas decouples its methods from the action space.","For projects that require frameworks focusing on offline or static web agent development exclusively."],"source":"enrich:decision_facts","observed_at":"2026-07-17T01:15:42.325Z"},"constraint_facets":{"min_ram_gb":null,"requires_docker":false},"decision_summary":[{"label":"Requirements","value":"Requires Python 3.11 for compatibility."},{"label":"Adopt for","value":"WebCanvas provides an open-source framework for building, training, and evaluating web agents with real-time interactions."},{"label":"License detail","value":"MIT"}]}}