Leaderboard

BizFinBench

Chinese business-finance queries drawn from real use, in five areas: numerical calculation, reasoning, information extraction, prediction recognition and knowledge QA (nine categories).

Best reported

73.9

ChatGPT-o3OpenAI

average score across 9 tasks

26 May 2025

BizFinBench v1 (paper 2025-05-26), marked outdated by the maker; BizFinBench.v2 released 2026-01-09 (29,578 questions, ICML 2026)

average score across 9 tasks, higher is better. 10 models.

Updated 26 May 2025

  1. ChatGPT-o373.9
  2. DeepSeek-R1 (671B)73.0
  3. GPT-4o71.8
  4. DeepSeek-V3 (671B)71.6
  5. ChatGPT-o4-mini71.3
  6. Gemini-2.0-Flash69.8
  7. Qwen2.5-VL-32B68.6
  8. Qwen3-32B68.3
  9. Qwen2.5-72B-Instruct67.7
  10. Qwen2.5-VL-72B67.5

BizFinBench v1 (paper 2025-05-26), marked outdated by the maker; BizFinBench.v2 released 2026-01-09 (29,578 questions, ICML 2026)

average score across 9 tasks, higher is better. 10 models.

Updated 26 May 2025

  1. 1ChatGPT-o373.9
  2. 2DeepSeek-R1 (671B)73.0
  3. 3GPT-4o71.8
  4. 4DeepSeek-V3 (671B)71.6
  5. 5ChatGPT-o4-mini71.3
  6. 6Gemini-2.0-Flash69.8
  7. 7Qwen2.5-VL-32B68.6
  8. 8Qwen3-32B68.3
  9. 9Qwen2.5-72B-Instruct67.7
  10. 10Qwen2.5-VL-72B67.5
BizFinBench leaderboard (average score across 9 tasks, higher is better)
1ChatGPT-o3OpenAI73.9DefaultPaper Table 3
Reported by the authors, 26 May 2025
2DeepSeek-R1 (671B)DeepSeek73.0DefaultPaper Table 3
Reported by the authors, 26 May 2025
3GPT-4oOpenAI71.8DefaultPaper Table 3
Reported by the authors, 26 May 2025
4DeepSeek-V3 (671B)DeepSeek71.6DefaultPaper Table 3
Reported by the authors, 26 May 2025
5ChatGPT-o4-miniOpenAI71.3DefaultPaper Table 3
Reported by the authors, 26 May 2025
6Gemini-2.0-FlashGoogle69.8DefaultPaper Table 3
Reported by the authors, 26 May 2025
7Qwen2.5-VL-32BQwen68.6DefaultPaper Table 3
Reported by the authors, 26 May 2025
8Qwen3-32BQwen68.3DefaultPaper Table 3
Reported by the authors, 26 May 2025
9Qwen2.5-72B-InstructQwen67.7DefaultPaper Table 3
Reported by the authors, 26 May 2025
10Qwen2.5-VL-72BQwen67.5DefaultPaper Table 3
Reported by the authors, 26 May 2025

Full details for BizFinBench