Clinical Benchmarks

Coverage

Which models have results on which boards. A cell is a rank within that one board; do not read across columns.

When a model has several rows on one board (different configurations), the cell shows its highest-placed row.

Rank of each model within each board. Empty cells mean no result.
ModelHealthBench ProfessionalMedXpertQA (MM)MAST (Medical AI Superintelligence Test)MedHELMMedScribe (Vals AI)MedCode (Vals AI)PhysicianBenchEHR-ComplexHealthAgentBenchCHI-BenchHealthAdminBenchMedPICFirst, Do NOHARM (v2)Boards
Gemini 3.1 ProNo result2/224/81/1073/1052/10320/212/18No resultNo result6/71/2812/1710
GPT-5.424/316/22No result5/1065/10552/10312/211/187/1220/432/7No resultNo result10
Claude Opus 4.6No result15/22No result8/1018/10522/1039/21No result10/125/431/7No resultNo result8
Claude Opus 511/31No result6/8No result4/1051/1034/21No result1/121/43No resultNo result6/178
GPT-5.6 Sol10/311/221/8No result28/10540/103No resultNo result2/127/43No resultNo result8/178
GPT-5.522/31No resultNo resultNo result17/10523/1037/21No result3/1212/43No resultNo result9/177
Claude Fable 53/314/22No resultNo result10/1053/103No resultNo resultNo result10/43No resultNo result11/176
Claude Opus 4.721/31No resultNo resultNo result46/1056/10311/21No result8/129/43No resultNo resultNo result6
Claude Opus 4.815/319/22No resultNo result23/1059/103No resultNo result4/122/43No resultNo resultNo result6
Claude Sonnet 4.627/31No resultNo resultNo resultNo resultNo result14/2113/1811/126/43No result9/28No result6
Claude Sonnet 513/31No result7/8No result74/10530/1038/21No resultNo result13/43No resultNo resultNo result6
Gemini 2.5 ProNo resultNo resultNo result6/1080/10515/103No result15/18No resultNo resultNo result17/2813/176
DeepSeek V4 ProNo resultNo resultNo resultNo result55/10547/10315/21No resultNo result24/43No result4/28No result5
GPT-525/31No resultNo resultNo result41/10518/103No resultNo resultNo resultNo resultNo result2/2810/175
GPT-5.226/318/22No resultNo result33/10517/103No resultNo resultNo resultNo resultNo result8/28No result5
Kimi K2.5No result14/22No resultNo result72/10565/103No result3/18No resultNo result3/7No resultNo result5
Kimi K2.6No resultNo resultNo resultNo result62/10564/10316/21No resultNo result21/43No resultNo result15/175
Kimi K3No resultNo result2/8No result13/10524/103No resultNo resultNo result7/43No resultNo result7/175
Muse Spark19/315/22No result3/1022/10514/103No resultNo resultNo resultNo resultNo resultNo resultNo result5
Claude Fable 5.17/31No resultNo resultNo result2/1057/1033/21No resultNo resultNo resultNo resultNo resultNo result4
Claude Opus 5.54/31No resultNo resultNo result1/10516/1031/21No resultNo resultNo resultNo resultNo resultNo result4
Claude Sonnet 5.52/31No resultNo resultNo result3/10511/1032/21No resultNo resultNo resultNo resultNo resultNo result4
GLM 5.1No resultNo resultNo resultNo result85/10549/103No resultNo resultNo result14/43No resultNo result16/174
GPT-5.6 Luna18/31No resultNo resultNo result33/10548/103No resultNo resultNo result26/43No resultNo resultNo result4
GPT-5.6 Terra14/31No resultNo resultNo result47/10542/103No resultNo resultNo result26/43No resultNo resultNo result4
Grok 4.20No result13/22No resultNo result99/10587/10321/21No resultNo resultNo resultNo resultNo resultNo result4
Grok 4.3No resultNo result8/8No result78/10570/103No resultNo resultNo result37/43No resultNo resultNo result4
Qwen3.5 397B A17BNo result11/225/8No resultNo resultNo resultNo result3/18No resultNo resultNo resultNo result14/174
Qwen3.6 PlusNo result12/22No resultNo result69/10573/10318/21No resultNo resultNo resultNo resultNo resultNo result4
Claude Haiku 4.5No resultNo resultNo resultNo result28/10584/103No resultNo resultNo result36/43No resultNo resultNo result3
Claude Opus 4.5No result16/22No resultNo result26/10521/103No resultNo resultNo resultNo resultNo resultNo resultNo result3
Gemini 3 FlashNo resultNo resultNo resultNo result91/1054/103No resultNo resultNo result28/43No resultNo resultNo result3
Gemini 3.5 FlashNo resultNo resultNo result2/1071/1055/103No resultNo resultNo resultNo resultNo resultNo resultNo result3
Gemini 3.6 FlashNo resultNo result3/8No result58/10510/103No resultNo resultNo resultNo resultNo resultNo resultNo result3
GLM 5.2No resultNo resultNo resultNo result43/10557/103No resultNo resultNo result14/43No resultNo resultNo result3
GPT-5.129/31No resultNo resultNo result12/10512/103No resultNo resultNo resultNo resultNo resultNo resultNo result3
GPT-5.4 miniNo resultNo resultNo result4/10No resultNo resultNo resultNo result12/1234/43No resultNo resultNo result3
GPT-6 Astra1/31No resultNo resultNo result14/10526/103No resultNo resultNo resultNo resultNo resultNo resultNo result3
GPT-6 Luna8/31No resultNo resultNo result40/10538/103No resultNo resultNo resultNo resultNo resultNo resultNo result3
GPT-6 Sol8/31No resultNo resultNo result49/10533/103No resultNo resultNo resultNo resultNo resultNo resultNo result3
Grok 4.623/31No resultNo resultNo result19/10537/103No resultNo resultNo resultNo resultNo resultNo resultNo result3
Grok 4.716/31No resultNo resultNo result6/10519/103No resultNo resultNo resultNo resultNo resultNo resultNo result3
InklingNo resultNo resultNo resultNo result25/10553/103No resultNo resultNo result35/43No resultNo resultNo result3
MiMo V2.5 ProNo resultNo resultNo resultNo result39/10585/10317/21No resultNo resultNo resultNo resultNo resultNo result3
MiniMax-M2.7No resultNo resultNo resultNo result56/10576/10319/21No resultNo resultNo resultNo resultNo resultNo result3
Muse Spark 1.112/31No resultNo resultNo result8/105No resultNo resultNo resultNo resultNo resultNo resultNo result4/173
Qwen3.8 MaxNo result3/22No resultNo result30/10558/103No resultNo resultNo resultNo resultNo resultNo resultNo result3
Claude Opus 4.1No resultNo resultNo resultNo result79/10532/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Claude Sonnet 4No resultNo resultNo resultNo result84/10575/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Claude Sonnet 4.5No resultNo resultNo resultNo result31/10539/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Command A+No resultNo resultNo resultNo result101/105103/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
DeepSeek R1No resultNo resultNo result7/10No resultNo resultNo resultNo resultNo resultNo resultNo resultNo result17/172
DeepSeek V4.1 FlashNo resultNo resultNo resultNo result24/10554/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Gemini 2.5 Flash LiteNo resultNo resultNo resultNo result75/10598/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Gemini 3 ProNo result7/22No resultNo result87/105No resultNo resultNo resultNo resultNo resultNo resultNo resultNo result2
Gemini 3.1 Flash Lite PreviewNo resultNo resultNo resultNo result98/10529/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Gemini 3.5 Flash LiteNo resultNo resultNo resultNo result89/10541/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Gemini 3.7 FlashNo resultNo resultNo resultNo result37/1058/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Gemini 3.8 FlashNo resultNo resultNo resultNo result32/10528/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
GLM 4.7No resultNo resultNo resultNo result94/10583/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
GLM 5.3No resultNo resultNo resultNo result9/10546/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
GPT-5 miniNo resultNo resultNo resultNo result53/10545/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
GPT-5 nanoNo resultNo resultNo resultNo result81/10592/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
GPT-5.4 nanoNo resultNo resultNo resultNo result68/10556/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
GPT-6.1 SolNo resultNo resultNo resultNo result20/10525/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Grok 4No resultNo resultNo resultNo result62/10569/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Grok 4 Fast (Non-Reasoning)No resultNo resultNo resultNo result57/10593/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Grok 4 Fast (Reasoning)No resultNo resultNo resultNo result50/10572/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Grok 4.1 Fast (Reasoning)No resultNo resultNo resultNo result60/10597/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Grok 4.1 Fast Non-ReasoningNo resultNo resultNo resultNo result66/10596/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Grok 4.5No resultNo resultNo resultNo result16/10543/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Hy4 PreviewNo resultNo resultNo resultNo result42/10544/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Inkling SmallNo resultNo resultNo resultNo result35/10571/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Laguna M.1No resultNo resultNo resultNo result97/105101/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Laguna XS.2No resultNo resultNo resultNo result100/105102/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Ling 3.0 FlashNo resultNo resultNo resultNo result51/10586/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Ling 3.0 Flash FinNo resultNo resultNo resultNo result76/10594/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Llama 4 MaverickNo resultNo resultNo resultNo result103/10574/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Llama 4 ScoutNo resultNo resultNo resultNo result104/105100/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Mercury 2.5No resultNo resultNo resultNo result102/10591/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
MiMo V2.5No resultNo resultNo resultNo result86/10588/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
MiMo V2.6 FlashNo resultNo resultNo resultNo result27/10555/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
MiMo V2.6 ProNo resultNo resultNo resultNo result11/10536/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
MiniMax M3No resultNo resultNo resultNo result15/10534/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
MiniMax-M2.1No resultNo resultNo resultNo result52/10578/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Mistral Medium 3.5No resultNo resultNo resultNo result95/10581/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Muse Spark 1.2No resultNo resultNo resultNo result5/10520/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
o3No resultNo resultNo resultNo result70/10531/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
o4-miniNo resultNo resultNo resultNo result93/10580/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Qwen 3 Max ThinkingNo resultNo resultNo resultNo result83/10590/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Qwen 3 VL PlusNo resultNo resultNo resultNo result67/10589/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Qwen 3.5 FlashNo resultNo resultNo resultNo result90/10582/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Qwen 3.7 MaxNo resultNo resultNo resultNo result59/10566/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Qwen 3.8 27BNo resultNo resultNo resultNo result38/10595/103No resultNo resultNo resultNo resultNo resultNo resultNo result2
Baichuan-M2-32BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result19/28No result1
Claude 3.7 SonnetNo resultNo resultNo result9/10No resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result1
DeepSeek V4 FlashNo resultNo resultNo resultNo result54/105No resultNo resultNo resultNo resultNo resultNo resultNo resultNo result1
DeepSeek V4 Flash 0731No resultNo resultNo resultNo resultNo result50/103No resultNo resultNo resultNo resultNo resultNo resultNo result1
DeepSeek-V3.1No resultNo resultNo resultNo resultNo resultNo resultNo result7/18No resultNo resultNo resultNo resultNo result1
DeepSeek-V3.2-ExpNo resultNo resultNo resultNo resultNo resultNo resultNo result5/18No resultNo resultNo resultNo resultNo result1
Doximity Ask 6.1No resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result2/171
Fleming-R1-32BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result12/28No result1
Fleming-R1-7BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result18/28No result1
Gemini 2.0 FlashNo resultNo resultNo result10/10No resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result1
Gemini 2.5 FlashNo resultNo resultNo resultNo result45/105No resultNo resultNo resultNo resultNo resultNo resultNo resultNo result1
Gemini 2.5 Flash (7/17)No resultNo resultNo resultNo resultNo result62/103No resultNo resultNo resultNo resultNo resultNo resultNo result1
Gemini 2.5 Flash Lite (9/25)No resultNo resultNo resultNo resultNo result77/103No resultNo resultNo resultNo resultNo resultNo resultNo result1
Gemini 2.5 Flash Preview (9/25)No resultNo resultNo resultNo resultNo result60/103No resultNo resultNo resultNo resultNo resultNo resultNo result1
Gemini 3 Pro (11/25)No resultNo resultNo resultNo resultNo result13/103No resultNo resultNo resultNo resultNo resultNo resultNo result1
Gemma 3 12BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result26/28No result1
Gemma 3 27BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result24/28No result1
Gemma 4 12BNo result19/22No resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result1
Gemma 4 26B A4BNo result18/22No resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result1
Gemma 4 31BNo result17/22No resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result1
Gemma 4 E2BNo result22/22No resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result1
Gemma 4 E4BNo result21/22No resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result1
Glass 5.6 MaxNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result4/171
GLM 5.3 FlashNo resultNo resultNo resultNo result7/105No resultNo resultNo resultNo resultNo resultNo resultNo resultNo result1
GPT OSS 120BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result5/28No result1
GPT OSS 20BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result14/28No result1
GPT-4.1No resultNo resultNo resultNo resultNo resultNo resultNo result11/18No resultNo resultNo resultNo resultNo result1
GPT-4.1 miniNo resultNo resultNo resultNo resultNo resultNo resultNo result10/18No resultNo resultNo resultNo resultNo result1
GPT-4oNo resultNo resultNo resultNo resultNo resultNo resultNo result15/18No resultNo resultNo resultNo resultNo result1
GPT-5.3-CodexNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result9/12No resultNo resultNo resultNo result1
GPT-5.5 Instant30/31No resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result1
HealthGPT-Pro-4BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result28/28No result1
HealthGPT-Pro-8BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result22/28No result1
HuatuoGPT-o1-70BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result16/28No result1
HuatuoGPT-o1-8BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result20/28No result1
Hulu-Med-7BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result23/28No result1
Lingshu-32BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result13/28No result1
Lingshu-7BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result21/28No result1
LiSA 2.5No resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result1/171
Llama 3.1 70BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result15/28No result1
Llama 3.1 8BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result25/28No result1
MAI-Thinking-131/31No resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result1
MedGemma 27B TextNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result11/28No result1
MedGemma 4BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result26/28No result1
MedGuardNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result11/43No resultNo resultNo result1
Nemotron 3 UltraNo resultNo resultNo resultNo resultNo result67/103No resultNo resultNo resultNo resultNo resultNo resultNo result1
Nemotron 3.5 LightningNo resultNo resultNo resultNo result105/105No resultNo resultNo resultNo resultNo resultNo resultNo resultNo result1
NVIDIA Nemotron 3 Ultra 550B A55BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result43/43No resultNo resultNo result1
OpenEvidenceNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result3/171
Qwen 3.5No resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result5/7No resultNo result1
Qwen3-14BNo resultNo resultNo resultNo resultNo resultNo resultNo result17/18No resultNo resultNo resultNo resultNo result1
Qwen3-14B-SFTNo resultNo resultNo resultNo resultNo resultNo resultNo result12/18No resultNo resultNo resultNo resultNo result1
Qwen3-235B-A22B-Instruct-2507No resultNo resultNo resultNo resultNo resultNo resultNo result9/18No resultNo resultNo resultNo resultNo result1
Qwen3-32BNo resultNo resultNo resultNo resultNo resultNo resultNo result13/18No resultNo resultNo resultNo resultNo result1
Qwen3-32B-SFTNo resultNo resultNo resultNo resultNo resultNo resultNo result8/18No resultNo resultNo resultNo resultNo result1
Qwen3-4BNo resultNo resultNo resultNo resultNo resultNo resultNo result18/18No resultNo resultNo resultNo resultNo result1
Qwen3-VL-235B-A22BNo result20/22No resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result1
Qwen3.5-27BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result6/28No result1
Qwen3.5-35B-A3BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result7/28No result1
Qwen3.5-9BNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result10/28No result1
Qwen3.5-PlusNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result3/28No result1
Qwen3.6-MaxNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result19/43No resultNo resultNo result1
Qwen3.7 PlusNo result10/22No resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo resultNo result1