BizFinBench
Enrichment pendingA Business-Driven Real-World Financial Benchmark for Evaluating LLMs
GraphCanon updated today · GitHub synced today
167
Stars
12
Forks
0
Open issues
2
Watchers
2mo
Last push
PythonCreated May 7, 2025
Trust & integrity
Full report- Maintenance
- Steady (71d since push)
- As of today · Source: github_public_v1
- Provenance
- Not a fork · Organization account
- As of today · Source: github_public_v1
- Security (OSV)
- 90 low (90 low)
- As of today · Source: osv@v1
Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.
Overview
A Business-Driven Real-World Financial Benchmark for Evaluating LLMs
Capability facts
- Languages
- python
Source: github.language · Jul 11, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Python runtimePython
Source: README excerpt (regex_v1, Jul 11, 2026)
pip install -r requirements.txtSource link
Works with ChatGPTChatGPT
Source: README excerpt (regex_v1, Jul 11, 2026)
### Quick Start – Evaluate external apis (e.g., chatgpt)Source link
Tags
README
Install requirements
pip install -r requirements.txt
Quick Start – Evaluate a Local Model
export MODEL_PATH=model/Qwen2.5-0.5B # Path to the model to be evaluated
export REMOTE_MODEL_PORT=16668
export REMOTE_MODEL_URL=http://127.0.0.1:${REMOTE_MODEL_PORT}/model
export MODEL_NAME=Qwen2.5-0.5B
export PROMPT_TYPE=chat_template # Hithink llama3 llama2 none qwen chat_template; chat_template is recommended
---
### Quick Start – Evaluate a Local Model and Score with a Judge Model
```sh
export MODEL_PATH=model/Qwen2.5-0.5B # Path to the model to be evaluated
export REMOTE_MODEL_PORT=16668
export REMOTE_MODEL_URL=http://127.0.0.1:${REMOTE_MODEL_PORT}/model
export MODEL_NAME=Qwen2.5-0.5B
export PROMPT_TYPE=chat_template # llama3 llama2 none qwen chat_template; chat_template is recommended
---
### Quick Start – Evaluate external apis (e.g., chatgpt)
```sh
export API_NAME=chatgpt # The api name, currently support chatgpt
export API_KEY=xxx # Your api key
export MODEL_NAME=gpt-4.1
---
## 📄 License
**Usage and License Notices**: The data and code are intended and licensed for research use only.
License: Attribution-NonCommercial 4.0 International It should abide by the policy of OpenAI: https://openai.com/policies/terms-of-use