Clinical Benchmarks

Gemini 2.5 Flash (7/17)

Also written as google/gemini-2.5-flash-thinking, Gemini 2.5 Flash (7/17) (Thinking), google/gemini-2.5-flash, Gemini 2.5 Flash (7/17) (Nonthinking)

2 results on 1 of 14 boards, latest measured Sep 2026. Compare with other models

Clinical Benchmarks Index44.0Rank 69 of 1281 of 12 boardsThis site’s own calculation. Show the working How it is computed

On the Clinical Benchmarks Index

The top 15 on the index, then Gemini 2.5 Flash (7/17) at rank 69. Select a column to open that model.

Board by board

Gemini 2.5 Flash (7/17) against the top 10 on each board it has a result on, on that board's own scale. Its own column is in colour.

Every result, with its source

Each line sits on its own board's scale. Tall tick: the board leader.

Documentation and coding

  1. MedCode (Vals AI)
    model ID google/gemini-2.5-flash-thinking; temperature=1; max_output_tokens=30000
    40.36
    Rank 63 of 104 here, 103 models on the boardLeader Claude Opus 5 63.57
    Official leaderboard
    Measured Sep 2026
  2. MedCode (Vals AI)
    model ID google/gemini-2.5-flash; temperature=1; max_output_tokens=30000
    38.42
    Rank 69 of 104 here, 103 models on the boardLeader Claude Opus 5 63.57
    Official leaderboard
    Measured Sep 2026

Index working

Show the working: each board’s result, how hard the board runs and the field average

The Clinical Benchmarks Index is this site's own calculation from 12 boards. How it is computed

  • MedCode (Vals AI)40.3640.4−3.3 hard board43.70.319 weightmodel ID google/gemini-2.5-flash-thinking; temperature=1; max_output_tokens=30000
Adjusted result, one board
43.7
Field average, counts for 60% with 1 of 12 boards
44.2
Index
= 44.0

Score: the result on the board’s own 0 to 100 scale (dot; tick: the board’s leader). Board runs: how far the board’s scores sit above or below the same models’ scores on the other boards. Adjusted: the score minus that offset. The index is the adjusted average with the field average mixed in, more of it the fewer boards a model has. Each result links to its quote and page; the line under it is the setting it was measured with.

Sources

The quote, page and document for each of the 2 results
  1. 63MedCode (Vals AI) gemini-2.5-flash-thinking 40.36
    Printed as 40.36%Official leaderboard, measured Sep 2026Configuration: model ID google/gemini-2.5-flash-thinking; temperature=1; max_output_tokens=30000
    Vals AI MedCode leaderboard official leaderboard, Vals AI, 29 Sep 2026. MedCode leaderboard, Overall task, All Models expanded, rank 62 of 103; Accuracy column; board Updated 9/29/2026. Rendered table row; configuration from embedded BenchmarkView props benchmarkView.default.tasks.overall["google/gemini-2.5-flash-thinking"].
    62 | Gemini 2.5 Flash (7/17) (Thinking) | 40.36%±1.95 | $0.3/$2.5 | 22.83s
    Every result from this document
  2. 69MedCode (Vals AI) gemini-2.5-flash 38.42
    Printed as 38.42%Official leaderboard, measured Sep 2026Configuration: model ID google/gemini-2.5-flash; temperature=1; max_output_tokens=30000
    Vals AI MedCode leaderboard official leaderboard, Vals AI, 29 Sep 2026. MedCode leaderboard, Overall task, All Models expanded, rank 68 of 103; Accuracy column; board Updated 9/29/2026. Rendered table row; configuration from embedded BenchmarkView props benchmarkView.default.tasks.overall["google/gemini-2.5-flash"].
    68 | Gemini 2.5 Flash (7/17) (Nonthinking) | 38.42%±1.92 | $0.3/$2.5 | 22.14s
    Every result from this document

Other Google models: Gemini 2.5 Flash, Gemini 2.5 Flash Lite, Gemini 2.5 Flash Lite (9/25), Gemini 2.5 Flash Preview (9/25), Gemini 2.5 Pro, Gemini 3.1 Flash Lite Preview, Gemini 3.1 Pro, Gemini 3.5 Flash, Gemini 3.5 Flash Lite, Gemini 3.6 Flash, Gemini 3.7 Flash, Gemini 3.8 Flash, Gemini 3 Flash, Gemini 3 Pro, Gemini 3 Pro (11/25), Gemini 4 Argon, Gemma 4 12B, Gemma 4 26B A4B, Gemma 4 31B, Gemma 4 E2B, Gemma 4 E4B