Vals AI
CorpFin v2
Question answering over long credit agreements (often more than 200 pages). The same questions are asked with exact pages, about 80 pages of shared context, or the most context that fits.
About this benchmark
- Size
- 1,218 questions from 61 documents (20 public validation, 340 private validation, 858 test)
- Public split
- 20 questions from 1 document, available on request
- Grading
- LLM-as-judge (Claude Sonnet 4.5 at temperature 0, which replaced Sonnet 3.5 on 2025-11-17)
- Licence
- proprietary
- Submission
- none
- Products allowed
- Not stated
- Latest version
- v2 (archived; last updated 2026-08-12)
- What it does not cover
- Archived as saturated. Reading comprehension only: no tools, calculation workflows or market data.
Results
10 modelsEach score shows who reported it: the benchmark's authors (quoted from their paper), the benchmark's official board, or Moneda (run with the benchmark's own grader and rules). We do not copy other aggregators.
CorpFin v2 v2 (archived; last updated 2026-08-12)
accuracy %, higher is better. 10 models.
Updated 12 Aug 2026
- Claude Opus 573.2
- Claude Fable 571.8
- Kimi K371.6
- Muse Spark 1.171.3
- Muse Spark 1.270.9
- Inkling Small69.6
- Inkling68.6
- Grok 4.368.5
- GPT-5.568.4
- Kimi K2.568.3
CorpFin v2 v2 (archived; last updated 2026-08-12)
accuracy %, higher is better. 10 models.
Updated 12 Aug 2026
- 1Claude Opus 573.2
- 2Claude Fable 571.8
- 3Kimi K371.6
- 4Muse Spark 1.171.3
- 5Muse Spark 1.270.9
- 6Inkling Small69.6
- 7Inkling68.6
- 8Grok 4.368.5
- 9GPT-5.568.4
- 10Kimi K2.568.3
| 1 | Claude Opus 5 | Anthropic | 73.2 | Default | Vals.ai leaderboard (archived) Official board, reported 12 Aug 2026 · checked 1 Nov 2026 |
|---|---|---|---|---|---|
| 2 | Claude Fable 5 | Anthropic | 71.8 | Default | Vals.ai leaderboard (archived) Official board, reported 12 Aug 2026 · checked 1 Nov 2026 |
| 3 | Kimi K3 | Moonshot AI | 71.6 | Default | Vals.ai leaderboard (archived) Official board, reported 12 Aug 2026 · checked 1 Nov 2026 |
| 4 | Muse Spark 1.1 | Meta | 71.3 | Default | Vals.ai leaderboard (archived) Official board, reported 12 Aug 2026 · checked 1 Nov 2026 |
| 5 | Muse Spark 1.2 | Meta | 70.9 | Default | Vals.ai leaderboard (archived) Official board, reported 12 Aug 2026 · checked 1 Nov 2026 |
| 6 | Inkling Small | Not stated | 69.6 | Default | Vals.ai leaderboard (archived) Official board, reported 12 Aug 2026 · checked 1 Nov 2026 |
| 7 | Inkling | Not stated | 68.6 | Default | Vals.ai leaderboard (archived) Official board, reported 12 Aug 2026 · checked 1 Nov 2026 |
| 8 | Grok 4.3 | xAI | 68.5 | Default | Vals.ai leaderboard (archived) Official board, reported 12 Aug 2026 · checked 1 Nov 2026 |
| 9 | GPT-5.5 | OpenAI | 68.4 | Default | Vals.ai leaderboard (archived) Official board, reported 12 Aug 2026 · checked 1 Nov 2026 |
| 10 | Kimi K2.5 | Moonshot AI | 68.3 | Default | Vals.ai leaderboard (archived) Official board, reported 12 Aug 2026 · checked 1 Nov 2026 |
Papers and links
Last checked 1 Nov 2026. Something out of date or wrong? Send a correction.