--- title: "HPOBench vs autoai" type: "comparison" canonical_url: "https://www.graphcanon.com/compare/automl-hpobench-vs-blobcity-autoai" tools: ["automl-hpobench", "blobcity-autoai"] --- # HPOBench vs autoai *GraphCanon updated Aug 4, 2026* ## Verdict Pick HPOBench if hPOBench is useful for researchers and developers working on hyperparameter optimization techniques in automated machine learning scenarios; pick autoai if python based framework for automated machine learning focused on numerical data, providing model search, hyper-parameter tuning, and Jupyter Notebook code generation. [HPOBench](https://github.com/automl/HPOBench) reports 170 GitHub stars, 36 forks, and 34 open issues, last pushed May 21, 2025. [autoai](https://github.com/blobcity/autoai) has 186 stars, 46 forks, and 9 open issues, last pushed Mar 25, 2025. Figures are from public GitHub metadata via [HPOBench's repository](https://github.com/automl/HPOBench) and [autoai's repository](https://github.com/blobcity/autoai). | | [HPOBench](/tools/automl-hpobench.md) | [autoai](/tools/blobcity-autoai.md) | | --- | --- | --- | | Tagline | A collection of hyperparameter optimization benchmark problems | Python based framework for Automatic AI enabling model search, hyper-parameter tuning and Jupyter Notebook code generation | | Stars | 170 | 186 | | Forks | 36 | 46 | | Open issues | 34 | 9 | | Language | Python | Python | | Adopt for | HPOBench is useful for researchers and developers working on hyperparameter optimization techniques in automated machine learning scenarios. | Python based framework for automated machine learning focused on numerical data, providing model search, hyper-parameter tuning, and Jupyter Notebook code generation. | | Persona | - | - | | Runtime | - | - | | License | HPOBench is open source under the Apache-2.0 license. | Apache-2.0 | | Categories | Model Training | Model Training | ## Trust and health _Sourced signals - not a safety guarantee. No winner column._ | | [HPOBench](/tools/automl-hpobench.md) | [autoai](/tools/blobcity-autoai.md) | | --- | --- | --- | | Days since push | 439d | 496d | | Open issues (now) | 34 | 9 | | Full report | [trust report](/tools/automl-hpobench/trust.md) | [trust report](/tools/blobcity-autoai/trust.md) | ## Shared compatibility - **Python**: [HPOBench](/tools/automl-hpobench.md) - Python runtime; [autoai](/tools/blobcity-autoai.md) - Python runtime ## Decision facts: HPOBench - **Pricing:** freemium - **Requirements:** The installation recommends, but does not strictly require singularity version 3.6, which can be an additional setup step. - **Adopt for:** HPOBench is useful for researchers and developers working on hyperparameter optimization techniques in automated machine learning scenarios. - **License detail:** HPOBench is open source under the Apache-2.0 license. ## Decision facts: autoai - **Adopt for:** Python based framework for automated machine learning focused on numerical data, providing model search, hyper-parameter tuning, and Jupyter Notebook code generation. ## Choose when ### Choose HPOBench if… - Requirements: The installation recommends, but does not strictly require singularity version 3.6, which can be an additional setup step.. - Tags unique to HPOBench: bayesian-optimization, benchmark, hyperparameter-optimization. - When you are specifically interested in benchmarking hyperparameter optimization problems that include containerized benchmarks to ensure consistency across environments. ### Choose autoai if… - Tags unique to autoai: ai, autoai, codegen, deep-learning. - Use AutoAI when you need a tool that can handle both regression and classification tasks specifically over numerical datasets. - More GitHub stars (186 vs 170) - visibility, not fit. ## When NOT to use HPOBench - Avoid HPOBench if your project does not require Python or you are looking for a platform that exclusively focuses on the automation of model selection without hyperparameter optimization. - If you prefer tools with built-in support for multiple programming languages, rather than focusing solely on Python as is the case with HPOBench. ## When NOT to use autoai - Avoid using AutoAI if your dataset includes non-numerical data exclusively as the framework is tailored for numerical data processing. - Do not use if generating model training scripts in formats other than Jupyter Notebooks is required, as this tool only supports Python code output within a Jupyter format. ## Common questions ### What is the difference between HPOBench and autoai? HPOBench: A collection of hyperparameter optimization benchmark problems. autoai: Python based framework for Automatic AI enabling model search, hyper-parameter tuning and Jupyter Notebook code generation. See the comparison table for live GitHub stats and shared categories. ### When should I choose HPOBench over autoai? Choose HPOBench over autoai when Requirements: The installation recommends, but does not strictly require singularity version 3.6, which can be an additional setup step.; Tags unique to HPOBench: bayesian-optimization, benchmark, hyperparameter-optimization; When you are specifically interested in benchmarking hyperparameter optimization problems that include containerized benchmarks to ensure consistency across environments. ### When should I choose autoai over HPOBench? Choose autoai over HPOBench when Tags unique to autoai: ai, autoai, codegen, deep-learning; Use AutoAI when you need a tool that can handle both regression and classification tasks specifically over numerical datasets; More GitHub stars (186 vs 170) - visibility, not fit. ### When should I avoid HPOBench? Avoid HPOBench if your project does not require Python or you are looking for a platform that exclusively focuses on the automation of model selection without hyperparameter optimization. If you prefer tools with built-in support for multiple programming languages, rather than focusing solely on Python as is the case with HPOBench. ### When should I avoid autoai? Avoid using AutoAI if your dataset includes non-numerical data exclusively as the framework is tailored for numerical data processing. Do not use if generating model training scripts in formats other than Jupyter Notebooks is required, as this tool only supports Python code output within a Jupyter format. ### Is HPOBench or autoai more popular on GitHub? autoai has more GitHub stars (186 vs 170). Stars measure visibility, not whether either tool fits your constraints. ### Are HPOBench and autoai open source? Yes - both are open-source projects on GitHub (HPOBench: Apache-2.0, autoai: Apache-2.0). ### Where can I find alternatives to HPOBench or autoai? GraphCanon lists graph-backed alternatives at [HPOBench alternatives](/tools/automl-hpobench/alternatives) and [autoai alternatives](/tools/blobcity-autoai/alternatives) ([HPOBench markdown twin](/tools/automl-hpobench/alternatives.md), [autoai markdown twin](/tools/blobcity-autoai/alternatives.md)), ranked by typed relationship edges rather than popularity votes. ### Is there a machine-readable version of this comparison? Yes. The markdown twin at [this comparison](/compare/automl-hpobench-vs-blobcity-autoai.md) mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers. ### Which is better maintained, HPOBench or autoai? HPOBench: Dormant. autoai: Dormant. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance. ### Where are the full trust reports for HPOBench and autoai? GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: [HPOBench trust report](/tools/automl-hpobench/trust); [autoai trust report](/tools/blobcity-autoai/trust). --- **Machine-readable endpoints** - JSON: [`/api/graphcanon/graph?tool=automl-hpobench`](/api/graphcanon/graph?tool=automl-hpobench) - LLM index: [/llms.txt](/llms.txt) - Full corpus: [/llms-full.txt](/llms-full.txt) _GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_