# FinanceQA leaderboard

Analyst-style numerical tasks based on 10-K data: hand-spreading metrics, applying accounting and valuation conventions, and working from incomplete information that needs assumptions. Also includes conceptual questions.

## FinanceQA: accuracy (total, 0-1) (higher is better, 5 models)

| Rank | Model | Maker | Score | Metric | Setting | Reported by | Source | URL | Date |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | o1 | OpenAI | 0.487 | accuracy (total, 0-1) |  | Reported by the authors | Paper Table 1 | https://arxiv.org/abs/2501.18062 | 30 Jan 2025 |
| 2 | Claude-3-5-sonnet-20241022 | Anthropic | 0.399 | accuracy (total, 0-1) |  | Reported by the authors | Paper Table 1 | https://arxiv.org/abs/2501.18062 | 30 Jan 2025 |
| 3 | GPT-4o | OpenAI | 0.392 | accuracy (total, 0-1) |  | Reported by the authors | Paper Table 1 | https://arxiv.org/abs/2501.18062 | 30 Jan 2025 |
| 4 | Numa 1 | Moneda | 0.355 | accuracy (total, 0-1) | Product with tools; 148-question test split; graded by a two-judge panel, not the authors' grader | Run by Moneda | Moneda run, 2026-11-01 | https://benchmarks.finance/method/ | 1 Nov 2026 |
| 5 | Llama-3.3-70B-Instruct | Meta | 0.311 | accuracy (total, 0-1) |  | Reported by the authors | Paper Table 1 | https://arxiv.org/abs/2501.18062 | 30 Jan 2025 |

Scores are never combined across benchmarks. Each row names its metric, source and date.

## About this benchmark

- Maker: AfterQuery
- Year: 2025
- Use case: Financial filings Q&A
- Size: 148 questions (HF test split; types: basic, assumption, conceptual)
- Public split: 148-row test split on Hugging Face
- Grading: Exact correct match, scored 1 or 0 with no partial credit
- Licence: Apache-2.0 (data)
- Submission: none
- Products allowed: Not stated
- Latest version: v1 (2025-01-30)
- What it does not cover: No agentic retrieval, multi-document research or market data.
- Last checked: 1 Nov 2026
- Links: paper https://arxiv.org/abs/2501.18062, data https://huggingface.co/datasets/AfterQuery/FinanceQA
- Directory page: https://benchmarks.finance/benchmarks/afterquery-financeqa/
- Leaderboard: https://benchmarks.finance/leaderboards/afterquery-financeqa/

Source: https://benchmarks.finance/leaderboards/afterquery-financeqa/

Created and maintained by Moneda.
