Claude Sonnet 4
Released 22 May 2025proprietaryAlso written as claude-sonnet-4-20250514-thinking, anthropic/claude-sonnet-4-20250514-thinking, claude-sonnet-4-20250514, Claude Sonnet 4 (Thinking), Claude Sonnet 4 (Nonthinking), anthropic/claude-sonnet-4-20250514
4 results on 2 of 14 boards, latest measured Sep 2026. Compare with other models
On the Clinical Benchmarks Index
The top 15 on the index, then Claude Sonnet 4 at rank 95. Select a column to open that model.
Board by board
Claude Sonnet 4 against the top 10 on each board it has a result on, on that board's own scale. Its own column is in colour.
MedScribe (Vals AI)rank 85 of 106
- 91.43Claude Opus 5.5
- 91.29Claude Fable 5.1
- 91.10Claude Sonnet 5.5
- 90.98Claude Opus 5
- 90.06Muse Spark 1.2
- 89.38Grok 4.7
- 88.94GLM 5.3 Flash
- 88.89Muse Spark 1.1
- 88.81GLM 5.3
- 72.41Claude Sonnet 4 (Nonthinking)
95 modelsFull board
MedCode (Vals AI)rank 76 of 104
- 63.57Claude Opus 5
- 59.06Gemini 3.1 Pro Preview (02/26)
- 58.80Gemini 4 Argon
- 56.07Claude Fable 5
- 55.92Gemini 3 Flash (12/25)
- 55.83Gemini 3.5 Flash
- 54.86Claude Opus 4.7
- 53.51Claude Fable 5.1
- 53.39Gemini 3.7 Flash
- 34.96Claude Sonnet 4 (Thinking)
95 modelsFull board
Every result, with its source
Each line sits on its own board's scale. Tall tick: the board leader.
Documentation and coding
- MedScribe (Vals AI)model ID anthropic/claude-sonnet-4-20250514; temperature=1; max_output_tokens=3000072.41Rank 85 of 106 here, 105 models on the boardLeader Claude Opus 5.5 91.43
- MedScribe (Vals AI)model ID anthropic/claude-sonnet-4-20250514-thinking; max_output_tokens=3000069.35Rank 93 of 106 here, 105 models on the boardLeader Claude Opus 5.5 91.43
- MedCode (Vals AI)model ID anthropic/claude-sonnet-4-20250514-thinking; max_output_tokens=3000034.96Rank 76 of 104 here, 103 models on the boardLeader Claude Opus 5 63.57
- MedCode (Vals AI)model ID anthropic/claude-sonnet-4-20250514; temperature=1; max_output_tokens=3000033.94Rank 80 of 104 here, 103 models on the boardLeader Claude Opus 5 63.57
Index working
Show the working: each board’s result, how hard the board runs and the field average
The Clinical Benchmarks Index is this site's own calculation from 12 boards. How it is computed
- MedScribe (Vals AI)72.4172.4+33.8 easy board38.60.15 weight, near its ceilingNear its ceiling: leader 91.4, weight 0.15model ID anthropic/claude-sonnet-4-20250514; temperature=1; max_output_tokens=30000
- MedCode (Vals AI)34.9635.0−3.3 hard board38.30.319 weightmodel ID anthropic/claude-sonnet-4-20250514-thinking; max_output_tokens=30000
- Adjusted average of 2 boards, by weight
- 38.4
- Field average, counts for 42.9% with 2 of 12 boards
- 44.2
- Index
- = 40.9
Score: the result on the board’s own 0 to 100 scale (dot; tick: the board’s leader). Board runs: how far the board’s scores sit above or below the same models’ scores on the other boards. Adjusted: the score minus that offset. The index is the adjusted average with the field average mixed in, more of it the fewer boards a model has. Each result links to its quote and page; the line under it is the setting it was measured with.
Sources
The quote, page and document for each of the 4 results
85MedScribe (Vals AI) claude-sonnet-4-20250514 72.41
Printed as 72.41%Official leaderboard, measured Sep 2026Configuration: model ID anthropic/claude-sonnet-4-20250514; temperature=1; max_output_tokens=30000Vals AI MedScribe leaderboard official leaderboard, Vals AI, 3 Sep 2026. Vals AI MedScribe leaderboard, View: All Models, Task: Overall, row 84 of 105 (Claude Sonnet 4 (Nonthinking)), Accuracy column; Updated 9/29/2026. Rendered BenchmarkView table; configuration from embedded astro-island BenchmarkView props, benchmarkView.default.tasks.overall["anthropic/claude-sonnet-4-20250514"].84 | Claude Sonnet 4 (Nonthinking) | 72.41%±1.93 | $3/$15 | 25.67s
Every result from this document93MedScribe (Vals AI) claude-sonnet-4-20250514-thinking 69.35
Printed as 69.35%Official leaderboard, measured Sep 2026Configuration: model ID anthropic/claude-sonnet-4-20250514-thinking; max_output_tokens=30000Vals AI MedScribe leaderboard official leaderboard, Vals AI, 3 Sep 2026. Vals AI MedScribe leaderboard, View: All Models, Task: Overall, row 92 of 105 (Claude Sonnet 4 (Thinking)), Accuracy column; Updated 9/29/2026. Rendered BenchmarkView table; configuration from embedded astro-island BenchmarkView props, benchmarkView.default.tasks.overall["anthropic/claude-sonnet-4-20250514-thinking"].92 | Claude Sonnet 4 (Thinking) | 69.35%±2.21 | $3/$15 | 39.57s
Every result from this document76MedCode (Vals AI) claude-sonnet-4-20250514-thinking 34.96
Printed as 34.96%Official leaderboard, measured Sep 2026Configuration: model ID anthropic/claude-sonnet-4-20250514-thinking; max_output_tokens=30000Vals AI MedCode leaderboard official leaderboard, Vals AI, 29 Sep 2026. MedCode leaderboard, Overall task, All Models expanded, rank 75 of 103; Accuracy column; board Updated 9/29/2026. Rendered table row; configuration from embedded BenchmarkView props benchmarkView.default.tasks.overall["anthropic/claude-sonnet-4-20250514-thinking"].75 | Claude Sonnet 4 (Thinking) | 34.96%±1.94 | $3/$15 | 39.80s
Every result from this document80MedCode (Vals AI) claude-sonnet-4-20250514 33.94
Printed as 33.94%Official leaderboard, measured Sep 2026Configuration: model ID anthropic/claude-sonnet-4-20250514; temperature=1; max_output_tokens=30000Vals AI MedCode leaderboard official leaderboard, Vals AI, 29 Sep 2026. MedCode leaderboard, Overall task, All Models expanded, rank 79 of 103; Accuracy column; board Updated 9/29/2026. Rendered table row; configuration from embedded BenchmarkView props benchmarkView.default.tasks.overall["anthropic/claude-sonnet-4-20250514"].79 | Claude Sonnet 4 (Nonthinking) | 33.94%±1.91 | $3/$15 | 7.30s
Every result from this document
Other Anthropic models: Claude Fable 5, Claude Fable 5.1, Claude Haiku 4.5, Claude Haiku 5.5, Claude Opus 4.1, Claude Opus 4.5, Claude Opus 4.6, Claude Opus 4.7, Claude Opus 4.8, Claude Opus 5, Claude Opus 5.5, Claude Sonnet 4.5, Claude Sonnet 4.6, Claude Sonnet 5, Claude Sonnet 5.5