Leaderboard
FinanceQA
Analyst-style numerical tasks based on 10-K data: hand-spreading metrics, applying accounting and valuation conventions, and working from incomplete information that needs assumptions. Also includes conceptual questions.
Best reported
0.487
o1
accuracy (total, 0-1)
30 Jan 2025
FinanceQA v1 (2025-01-30)
accuracy (total, 0-1), higher is better. 4 models.
Updated 30 Jan 2025
- o10.487
- Claude-3-5-sonnet-202410220.399
- GPT-4o0.392
- Llama-3.3-70B-Instruct0.311
FinanceQA v1 (2025-01-30)
accuracy (total, 0-1), higher is better. 4 models.
Updated 30 Jan 2025
- 1o10.487
- 2Claude-3-5-sonnet-202410220.399
- 3GPT-4o0.392
- 4Llama-3.3-70B-Instruct0.311
| 1 | o1 | OpenAI | 0.487 | Default | Paper Table 1 Reported by the authors, 30 Jan 2025 |
|---|---|---|---|---|---|
| 2 | Claude-3-5-sonnet-20241022 | Anthropic | 0.399 | Default | Paper Table 1 Reported by the authors, 30 Jan 2025 |
| 3 | GPT-4o | OpenAI | 0.392 | Default | Paper Table 1 Reported by the authors, 30 Jan 2025 |
| 4 | Llama-3.3-70B-Instruct | Meta | 0.311 | Default | Paper Table 1 Reported by the authors, 30 Jan 2025 |