Gemini 2.5 Pro vs Llama-3.1-8B in finance

Every finance benchmark where both have a score (Google and Meta). Data refreshed 2 Nov 2026.

Shared benchmarks
2
Gemini 2.5 Pro only
4
Llama-3.1-8B only
0

Shared benchmarks, side by side

Each benchmark is drawn on its own scale. Bars are not comparable across rows.

  • Gemini 2.5 Pro
  • Llama-3.1-8B

  • FAITH overall accuracy %, higher is better

    Gemini 2.5 Pro:91.9 (better)
    Llama-3.1-8B:47.5

  • K-FinHallu binary detection F1, higher is better

    Gemini 2.5 Pro:0.849 (better)
    Llama-3.1-8B:0.674
Benchmark
Gemini 2.5 Pro
Llama-3.1-8B

7 benchmarks, 2 scored for both. Bold marks the better score where both have one.

FAITHoverall accuracy %, higher is better
91.9
Paper Table 3 (Reported by the authors, 24 Oct 2025)
47.5
Paper Table 3 (Reported by the authors, 24 Oct 2025)
K-FinHallubinary detection F1, higher is better
0.849
Paper Table 3 (Reported by the authors, 28 May 2026)
0.674
Paper Table 3 (Reported by the authors, 28 May 2026)
Advanced Financial Reasoning at Scale (CFA Level III evaluation)overall % (mean of MCQ and essay), higher is better
75.9
Paper Table 1 (Reported by the authors, 22 Sept 2025)
Not scored
Reasoning Models Ace the CFA Exams (CFA mock-exam evaluation)Level I accuracy %, higher is better
95.7
Paper Table 5 (Reported by the authors, 9 Dec 2025)
Not scored
Reasoning Models Ace the CFA Exams (CFA mock-exam evaluation)Level III constructed-response score %, higher is better
78.2
Paper Table 5 (Reported by the authors, 9 Dec 2025)
Not scored
FinDeepResearchoverall accuracy score (0-100), higher is better
36.2
OpenFinArena leaderboard (Official board, 15 Oct 2025)
Not scored
FinSearchCompGlobal subset average accuracy %, higher is better
42.6
Paper Table 5 (Reported by the authors, 16 Sept 2025)
Not scored

Scores from different benchmarks use different scales and are not added up. Settings can differ between sources; see each leaderboard for details.