# Open FinLLM Leaderboard

A public leaderboard of LLMs on financial tasks. The original Space covered seven FinBen-style categories. The current TheFinAI board shows MultiFinBen results across five languages and text, vision and audio.

## Facts

- Maker: FinAI / SecureFinAI Lab (Columbia) with the Linux Foundation, FINOS and Hugging Face
- Year: 2025
- Use case: Finance knowledge
- Size: Current board: 21 models on 36 datasets. The paper says 42 datasets in 7 categories.
- Public split: Scores (scores.json) and the Space source are public. Datasets are on Hugging Face under their own cards.
- Grading: Zero-shot automatic metrics per dataset (accuracy, F1, ROUGE, MCC). The current board ranks by a balanced score: the mean of the text, vision and audio averages.
- Licence: Apache-2.0 (Space code); the paper says the project follows the OpenMDW License
- Submission: via-maker
- Products allowed: No
- Latest version: Board data updated 2026-04-16 (MultiFinBen arXiv 2506.14028v3, Table 3)
- What it does not cover: No agents or tools, no live retrieval, and few frontier closed models (GPT-4o is the only closed model in the top 10).
- Last checked: 1 Nov 2026
- Links: paper https://arxiv.org/abs/2501.10963, site https://huggingface.co/spaces/finosfoundation/Open-Financial-LLM-Leaderboard, leaderboard https://huggingface.co/spaces/TheFinAI/Open-FinLLM-Leaderboard
- Directory page: https://benchmarks.finance/benchmarks/open-finllm-leaderboard/
- Leaderboard: https://benchmarks.finance/leaderboards/open-finllm-leaderboard/

## Results

### Open FinLLM Leaderboard: balanced score (mean of text/vision/audio averages) (higher is better, 10 models)

| Rank | Model | Provider | Score | Metric | Setting | Reported by | Source | URL | Date |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | GPT-4o | OpenAI | 46.0 | balanced score (mean of text/vision/audio averages) | MultiFinBen Table 3 data | Official board | Open FinLLM Leaderboard (scores.json) | https://huggingface.co/spaces/TheFinAI/Open-FinLLM-Leaderboard | 16 Apr 2026 (checked 1 Nov 2026) |
| 2 | Qwen2.5-Omni-7B | Qwen | 33.5 | balanced score (mean of text/vision/audio averages) | MultiFinBen Table 3 data | Official board | Open FinLLM Leaderboard (scores.json) | https://huggingface.co/spaces/TheFinAI/Open-FinLLM-Leaderboard | 16 Apr 2026 (checked 1 Nov 2026) |
| 3 | Llama-4-Scout-17B-16E | Meta | 20.9 | balanced score (mean of text/vision/audio averages) | MultiFinBen Table 3 data | Official board | Open FinLLM Leaderboard (scores.json) | https://huggingface.co/spaces/TheFinAI/Open-FinLLM-Leaderboard | 16 Apr 2026 (checked 1 Nov 2026) |
| 4 | Whisper-V3 | OpenAI | 17.2 | balanced score (mean of text/vision/audio averages) | MultiFinBen Table 3 data | Official board | Open FinLLM Leaderboard (scores.json) | https://huggingface.co/spaces/TheFinAI/Open-FinLLM-Leaderboard | 16 Apr 2026 (checked 1 Nov 2026) |
| 5 | Qwen2-Audio-7B-Instruct | Qwen | 16.7 | balanced score (mean of text/vision/audio averages) | MultiFinBen Table 3 data | Official board | Open FinLLM Leaderboard (scores.json) | https://huggingface.co/spaces/TheFinAI/Open-FinLLM-Leaderboard | 16 Apr 2026 (checked 1 Nov 2026) |
| 6 | Qwen2-Audio-7B | Qwen | 16.0 | balanced score (mean of text/vision/audio averages) | MultiFinBen Table 3 data | Official board | Open FinLLM Leaderboard (scores.json) | https://huggingface.co/spaces/TheFinAI/Open-FinLLM-Leaderboard | 16 Apr 2026 (checked 1 Nov 2026) |
| 7 | Gemma-3-27B | Google | 15.7 | balanced score (mean of text/vision/audio averages) | MultiFinBen Table 3 data | Official board | Open FinLLM Leaderboard (scores.json) | https://huggingface.co/spaces/TheFinAI/Open-FinLLM-Leaderboard | 16 Apr 2026 (checked 1 Nov 2026) |
| 8 | Llama-3.1-70B | Meta | 14.1 | balanced score (mean of text/vision/audio averages) | MultiFinBen Table 3 data | Official board | Open FinLLM Leaderboard (scores.json) | https://huggingface.co/spaces/TheFinAI/Open-FinLLM-Leaderboard | 16 Apr 2026 (checked 1 Nov 2026) |
| 9 | Gemma-3-4B | Google | 12.7 | balanced score (mean of text/vision/audio averages) | MultiFinBen Table 3 data | Official board | Open FinLLM Leaderboard (scores.json) | https://huggingface.co/spaces/TheFinAI/Open-FinLLM-Leaderboard | 16 Apr 2026 (checked 1 Nov 2026) |
| 10 | Qwen2.5-32B | Qwen | 12.7 | balanced score (mean of text/vision/audio averages) | MultiFinBen Table 3 data | Official board | Open FinLLM Leaderboard (scores.json) | https://huggingface.co/spaces/TheFinAI/Open-FinLLM-Leaderboard | 16 Apr 2026 (checked 1 Nov 2026) |


Source: https://benchmarks.finance/benchmarks/open-finllm-leaderboard/

Created and maintained by Moneda.