BizFinBench
A Business-Driven Real-World Financial Benchmark for Evaluating LLMs
GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
77views this month
Decision brief
BizFinBench is a finance-specific benchmark for evaluating large language models in real-world business settings.
Good fit when
- For teams专注于金融行业，需要评估其模型在实际业务场景中的表现时。
- 如果需要使用具体的财务基准来衡量大型语言模型的性能，并且希望该基准能反映真实世界的商业情景，则适合采用BizFinBench。
Avoid when
- 不要在不需要针对财务管理特定挑战进行测试的情况下使用BizFinBench，例如，在评估通用自然语言处理任务时。
- 如果项目主要关注的是非金融行业的应用，并且所使用的场景与实际的商业交易无直接关联，则不宜采用BizFinBench进行测评。
- Requirements:
- 需要安装所需的Python库以运行评估：pip install -r requirements.txt; 环境变量设置包括模型路径、远程模型URL、模型名称以及其他相关参数，如使用API进行测试时的API key等。; 必须确保遵守相关的使用和许可政策，这可能涉及研究使用的限制及其他第三方协议条款。
Observed Jul 15, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Slowing (142d since push)
- As of Sep 20, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 20, 2026
- Security (OSV)
- 90 low (90 low)
- As of Jul 11, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
pip install BizFinBenchSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
BizFinBench is designed as a finance-oriented benchmark to evaluate the performance of large language models in real-world business scenarios.
Capability facts
- Languages
- python
Source: github.language · Sep 20, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (regex_v1, Sep 20, 2026)
pip install -r requirements.txtSource link
Source: README excerpt (regex_v1, Sep 20, 2026)
### Quick Start – Evaluate external apis (e.g., chatgpt)Source link
Tags
README
Install requirements Quick Start – Evaluate a Local Model sh export MODEL PATH=model/Qwen2.5 0.5B Path to the model to be evaluated export REMOTE MODEL PORT=16668 export REMOTE MODEL URL=http://127.0.0.1:${REMOTE MODEL PORT}/model export MODEL NAME=Qwen2.5 0.5B export PROMPT TYPE...
For agents
This page has a .md twin and JSON over the API.