Leaderboard
FinanceBench
Open-book questions about US public-company filings (10-Ks, 10-Qs, 8-Ks, earnings reports). The model must find and compute answers from the filing, usually through retrieval or long context.
Best value: Numa 1, 67 at $0.041 per question (cheapest within 5% of the top score)
FinanceBench: score vs cost
Score against cost per test. Up and to the left is better.
Updated 2 Nov 2026
FinanceBench arXiv v1 (2023-11-20); HF dataset last modified 2024-11-17
% correct, no filing given (150-question sample), higher is better. 5 models.
Updated 2 Nov 2026
- Numa 167
- GPT-5.463.7
- Claude Opus 5.560.3
- GPT-4-Turbo19
- Llama219
FinanceBench: cost
cost per test item (USD), lower is better. 3 models.
Updated 2 Nov 2026
- Numa 10.041
- GPT-5.40.044
- Claude Opus 5.50.156
FinanceBench arXiv v1 (2023-11-20); HF dataset last modified 2024-11-17
% correct, no filing given (150-question sample), higher is better. 5 models.
Updated 2 Nov 2026
- 1Numa 167
- 2GPT-5.463.7
- 3Claude Opus 5.560.3
- 4GPT-4-Turbo19
- 4Llama219
| 1 | Numa 1 | Moneda | 67 | Finds its own filings, no documents given; graded by a two-judge panel (partly right counts half) | Moneda run, 2026-11-02 Run by Moneda, 2 Nov 2026 |
|---|---|---|---|---|---|
| 2 | GPT-5.4 | OpenAI | 63.7 | Built-in web search, no documents given; same 150 questions and two-judge panel as Numa 1 (partly right counts half) | Moneda run, 2026-11-02 Run by Moneda, 2 Nov 2026 |
| 3 | Claude Opus 5.5 | Anthropic | 60.3 | Built-in web search, no documents given; same 150 questions and two-judge panel as Numa 1 (partly right counts half) | Moneda run, 2026-11-02 Run by Moneda, 2 Nov 2026 |
| 4 | GPT-4-Turbo | OpenAI | 19 | Shared vector store (all filings) | Paper Table 2 Reported by the authors, 20 Nov 2023 |
| 4 | Llama2 | Meta | 19 | Shared vector store (all filings) | Paper Table 2 Reported by the authors, 20 Nov 2023 |
FinanceBench arXiv v1 (2023-11-20); HF dataset last modified 2024-11-17
% correct, the right filing given (150-question sample), higher is better. 3 models.
Updated 20 Nov 2023
- GPT-4-Turbo85
- Claude276
- Llama241
FinanceBench arXiv v1 (2023-11-20); HF dataset last modified 2024-11-17
% correct, the right filing given (150-question sample), higher is better. 3 models.
Updated 20 Nov 2023
- 1GPT-4-Turbo85
- 2Claude276
- 3Llama241
| 1 | GPT-4-Turbo | OpenAI | 85 | Oracle (evidence pages given) | Paper Table 2 Reported by the authors, 20 Nov 2023 |
|---|---|---|---|---|---|
| 2 | Claude2 | Anthropic | 76 | Long context (filing in context) | Paper Table 2 Reported by the authors, 20 Nov 2023 |
| 3 | Llama2 | Meta | 41 | Single vector store (one per filing) | Paper Table 2 Reported by the authors, 20 Nov 2023 |