# MortgageTax leaderboard

Extracts information from mortgage tax certificates supplied as images: semantic fields (tax year, county, parcel number) and a numerical field (annualised amount due). The dataset is provided by Vontive.

## MortgageTax: accuracy % (higher is better, 5 models)

| Rank | Model | Provider | Score | Metric | Setting | Reported by | Source | URL | Date |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | Claude Opus 5 | Anthropic | 72.1 | accuracy % | test set (938 documents), archived board | Official board | Vals.ai MortgageTax leaderboard | https://www.vals.ai/benchmarks/mortgage_tax | 1 Sept 2026 (checked 2 Nov 2026) |
| 2 | Claude Fable 5.1 | Anthropic | 70.8 | accuracy % | test set (938 documents), archived board | Official board | Vals.ai MortgageTax leaderboard | https://www.vals.ai/benchmarks/mortgage_tax | 1 Sept 2026 (checked 2 Nov 2026) |
| 3 | Claude Opus 4.7 | Anthropic | 70.3 | accuracy % | test set (938 documents), archived board | Official board | Vals.ai MortgageTax leaderboard | https://www.vals.ai/benchmarks/mortgage_tax | 1 Sept 2026 (checked 2 Nov 2026) |
| 4 | Claude Sonnet 5 | Anthropic | 70.0 | accuracy % | test set (938 documents), archived board | Official board | Vals.ai MortgageTax leaderboard | https://www.vals.ai/benchmarks/mortgage_tax | 1 Sept 2026 (checked 2 Nov 2026) |
| 5 | Claude Opus 4.8 | Anthropic | 69.9 | accuracy % | test set (938 documents), archived board | Official board | Vals.ai MortgageTax leaderboard | https://www.vals.ai/benchmarks/mortgage_tax | 1 Sept 2026 (checked 2 Nov 2026) |

Scores are never combined across benchmarks. Each row names its metric, source and date.

## About this benchmark

- Maker: Vals AI (United States)
- Year: Not stated
- Use case: Financial filings Q&A
- Size: 1,258 documents (20 public validation, 300 private validation, 938 test); reported scores use the test set
- Public split: No public download; validation sets are available on request or for purchase, the test set is never shared
- Grading: Accuracy. Models answer in JSON; regex is used when the format is not followed.
- Licence: proprietary
- Submission: Not stated
- Products allowed: Not stated
- What it does not cover: Archived as saturated: no longer run on new models. Document extraction only: no reasoning over filings, tools or market data.
- Last checked: 2 Nov 2026
- Links: site https://www.vals.ai/benchmarks/mortgage_tax, leaderboard https://www.vals.ai/benchmarks/mortgage_tax
- Directory page: https://benchmarks.finance/benchmarks/vals-mortgage-tax/
- Leaderboard: https://benchmarks.finance/leaderboards/vals-mortgage-tax/

Source: https://benchmarks.finance/leaderboards/vals-mortgage-tax/

Created and maintained by Moneda.