Gemini 2.5 Flash vs Llama-3.1-8B in finance

Every finance benchmark where both have a score (Google and Meta). Data refreshed 2 Nov 2026.

Shared benchmarks
2
Gemini 2.5 Flash only
3
Llama-3.1-8B only
0

Shared benchmarks, side by side

Each benchmark is drawn on its own scale. Bars are not comparable across rows.

  • Gemini 2.5 Flash
  • Llama-3.1-8B

  • FAITH overall accuracy %, higher is better

    Gemini 2.5 Flash:88.7 (better)
    Llama-3.1-8B:47.5

  • K-FinHallu binary detection F1, higher is better

    Gemini 2.5 Flash:0.860 (better)
    Llama-3.1-8B:0.674
Benchmark
Gemini 2.5 Flash
Llama-3.1-8B

5 benchmarks, 2 scored for both. Bold marks the better score where both have one.

FAITHoverall accuracy %, higher is better
88.7
Paper Table 3 (Reported by the authors, 24 Oct 2025)
47.5
Paper Table 3 (Reported by the authors, 24 Oct 2025)
K-FinHallubinary detection F1, higher is better
0.860
Paper Table 3 (Reported by the authors, 28 May 2026)
0.674
Paper Table 3 (Reported by the authors, 28 May 2026)
AI-Tradercumulative return %, higher is better
-0.060
Paper Table 1 (Reported by the authors, 1 Dec 2025)
Not scored
Advanced Financial Reasoning at Scale (CFA Level III evaluation)overall % (mean of MCQ and essay), higher is better
77.3
Paper Table 1 (Reported by the authors, 22 Sept 2025)
Not scored
FinTrustsafety harmfulness score (1-10, GPT-4.1 mini judge), lower is better
6.2
Paper Table 7 (App. A.2) (Reported by the authors, 17 Oct 2025)
Not scored

Scores from different benchmarks use different scales and are not added up. Settings can differ between sources; see each leaderboard for details.