Clinical Benchmarks

Models

Every model with a sourced result here. The board count shows how widely it has been tested, not how well.

157 of 157 models

Models with results on this site
ModelLabKindReleasedIndexBoardsBoards it appears on
Claude Sonnet 5.5AnthropicModel28 Sep 202691.04 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI), PhysicianBench
Claude Opus 5.5AnthropicModel22 Sep 202688.84 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI), PhysicianBench
Muse Spark 1.1MetaModel9 Jul 202688.63 / 13HealthBench Professional, MedScribe (Vals AI), First, Do NOHARM (v2)
Gemini 3.5 FlashGoogleModel19 May 202687.43 / 13MedScribe (Vals AI), MedCode (Vals AI), MedHELM
GPT-6 AstraOpenAIModel3 Sep 202687.23 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI)
Claude Fable 5.1AnthropicModel1 Sep 202685.54 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI), PhysicianBench
Kimi K3Moonshot AIModel16 Jul 202684.35 / 13MedScribe (Vals AI), MedCode (Vals AI), MAST (Medical AI Superintelligence Test), First, Do NOHARM (v2), CHI-Bench
Gemini 3.6 FlashGoogleModel21 Jul 202683.03 / 13MedScribe (Vals AI), MedCode (Vals AI), MAST (Medical AI Superintelligence Test)
Muse SparkMetaModel8 Apr 202680.95 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI), MedXpertQA (MM), MedHELM
Claude Fable 5AnthropicModel9 Jun 202680.76 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI), MedXpertQA (MM), First, Do NOHARM (v2), CHI-Bench
Claude Opus 5AnthropicModel24 Jul 202680.68 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI), MAST (Medical AI Superintelligence Test), First, Do NOHARM (v2), PhysicianBench, HealthAgentBench, CHI-Bench
GPT-5.6 SolOpenAIModel9 Jul 202680.08 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI), MedXpertQA (MM), MAST (Medical AI Superintelligence Test), First, Do NOHARM (v2), HealthAgentBench, CHI-Bench
Qwen3.8 MaxAlibabaModel3 Aug 202679.53 / 13MedScribe (Vals AI), MedCode (Vals AI), MedXpertQA (MM)
Claude Opus 4.8AnthropicModel28 May 202679.16 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI), MedXpertQA (MM), HealthAgentBench, CHI-Bench
Claude Opus 4.5AnthropicModel24 Nov 202576.43 / 13MedScribe (Vals AI), MedCode (Vals AI), MedXpertQA (MM)
Grok 4.7SpaceX AIModel21 Sep 202675.73 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI)
Gemini 3.1 ProGoogleModel19 Feb 202675.310 / 13MedScribe (Vals AI), MedCode (Vals AI), MedPIC, MedXpertQA (MM), MAST (Medical AI Superintelligence Test), MedHELM, First, Do NOHARM (v2), PhysicianBench, EHR-Complex, HealthAdminBench
GPT-6 SolOpenAIModel22 Sep 202674.93 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI)
GPT-6 LunaOpenAIModel22 Sep 202673.73 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI)
Kimi K2.5Moonshot AIModel27 Jan 202673.45 / 13MedScribe (Vals AI), MedCode (Vals AI), MedXpertQA (MM), EHR-Complex, HealthAdminBench
GPT-5.2OpenAIModel11 Dec 202569.85 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI), MedPIC, MedXpertQA (MM)
GPT-5.6 TerraOpenAIModel9 Jul 202669.54 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI), CHI-Bench
Gemini 3 ProGoogleModel18 Nov 202568.72 / 13MedScribe (Vals AI), MedXpertQA (MM)
Gemini 3.7 FlashGoogleModel13 Aug 202668.62 / 13MedScribe (Vals AI), MedCode (Vals AI)
Muse Spark 1.2MetaModel5 Aug 202667.72 / 13MedScribe (Vals AI), MedCode (Vals AI)
GPT-5.6 LunaOpenAIModel9 Jul 202667.44 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI), CHI-Bench
GPT-5.5OpenAIModel23 Apr 202666.87 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI), First, Do NOHARM (v2), PhysicianBench, HealthAgentBench, CHI-Bench
GPT-5OpenAIModel7 Aug 202566.65 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI), MedPIC, First, Do NOHARM (v2)
GPT-5.4OpenAIModel5 Mar 202665.910 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI), MedXpertQA (MM), MedHELM, PhysicianBench, EHR-Complex, HealthAgentBench, CHI-Bench, HealthAdminBench
GPT-6.1 SolOpenAIModel29 Sep 202665.62 / 13MedScribe (Vals AI), MedCode (Vals AI)
Qwen3.5 397B A17BAlibabaModel16 Feb 202665.24 / 13MedXpertQA (MM), MAST (Medical AI Superintelligence Test), First, Do NOHARM (v2), EHR-Complex
Gemini 3 FlashGoogleModel17 Dec 202564.43 / 13MedScribe (Vals AI), MedCode (Vals AI), CHI-Bench
Claude Opus 4.7AnthropicModel16 Apr 202664.16 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI), PhysicianBench, HealthAgentBench, CHI-Bench
Gemini 3.8 FlashGoogleModel2 Sep 202664.02 / 13MedScribe (Vals AI), MedCode (Vals AI)
MiniMax M3MiniMaxModel1 Jun 202663.62 / 13MedScribe (Vals AI), MedCode (Vals AI)
Grok 4.6SpaceX AIModel12 Aug 202663.23 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI)
MiMo V2.6 ProXiaomiModel22 Sep 202662.82 / 13MedScribe (Vals AI), MedCode (Vals AI)
Claude Opus 4.6AnthropicModel5 Feb 202662.38 / 13MedScribe (Vals AI), MedCode (Vals AI), MedXpertQA (MM), MedHELM, PhysicianBench, HealthAgentBench, CHI-Bench, HealthAdminBench
GPT-5.1OpenAIModel12 Nov 202561.53 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI)
Claude Sonnet 5AnthropicModel30 Jun 202661.26 / 13HealthBench Professional, MedScribe (Vals AI), MedCode (Vals AI), MAST (Medical AI Superintelligence Test), PhysicianBench, CHI-Bench
GLM 5.3ZhipuModel18 Aug 202661.12 / 13MedScribe (Vals AI), MedCode (Vals AI)
Grok 4.5SpaceX AIModel8 Jul 202660.62 / 13MedScribe (Vals AI), MedCode (Vals AI)
Claude Sonnet 4.5AnthropicModel29 Sep 202560.32 / 13MedScribe (Vals AI), MedCode (Vals AI)
DeepSeek V4 ProDeepSeekModel24 Apr 202660.05 / 13MedScribe (Vals AI), MedCode (Vals AI), MedPIC, PhysicianBench, CHI-Bench
o3OpenAIModel16 Apr 202559.62 / 13MedScribe (Vals AI), MedCode (Vals AI)
Hy4 PreviewTencentModel28 Aug 202659.12 / 13MedScribe (Vals AI), MedCode (Vals AI)
Claude Opus 4.1AnthropicModel5 Aug 202558.22 / 13MedScribe (Vals AI), MedCode (Vals AI)
DeepSeek V4.1 FlashDeepSeekModel10 Sep 202658.02 / 13MedScribe (Vals AI), MedCode (Vals AI)
InklingThinking MachinesModel15 Jul 202658.03 / 13MedScribe (Vals AI), MedCode (Vals AI), CHI-Bench
MiMo V2.6 FlashXiaomiModel22 Sep 202657.82 / 13MedScribe (Vals AI), MedCode (Vals AI)
GPT-5 miniOpenAIModel7 Aug 202557.42 / 13MedScribe (Vals AI), MedCode (Vals AI)
GLM 5.2ZhipuModel16 Jun 202656.73 / 13MedScribe (Vals AI), MedCode (Vals AI), CHI-Bench
GLM 5.3 FlashZhipuModel26 Aug 202656.01 / 13MedScribe (Vals AI)
Inkling SmallThinking MachinesModel30 Jul 202654.32 / 13MedScribe (Vals AI), MedCode (Vals AI)
Gemini 3.1 Flash Lite PreviewGoogleModel3 Mar 202653.92 / 13MedScribe (Vals AI), MedCode (Vals AI)
GPT-5.4 nanoOpenAIModel17 Mar 202653.92 / 13MedScribe (Vals AI), MedCode (Vals AI)
Qwen3.6 PlusAlibabaModel1 Apr 202653.54 / 13MedScribe (Vals AI), MedCode (Vals AI), MedXpertQA (MM), PhysicianBench
Gemini 3.5 Flash LiteGoogleModel21 Jul 202653.32 / 13MedScribe (Vals AI), MedCode (Vals AI)
Qwen 3.7 MaxAlibabaModelNot stated52.92 / 13MedScribe (Vals AI), MedCode (Vals AI)
Grok 4 Fast (Reasoning)SpaceX AIModel19 Sep 202552.72 / 13MedScribe (Vals AI), MedCode (Vals AI)
Gemini 2.5 FlashGoogleModel17 Jun 202552.11 / 13MedScribe (Vals AI)
Grok 4SpaceX AIModel9 Jul 202551.72 / 13MedScribe (Vals AI), MedCode (Vals AI)
Gemini 2.5 ProGoogleModel17 Jun 202551.36 / 13MedScribe (Vals AI), MedCode (Vals AI), MedPIC, MedHELM, First, Do NOHARM (v2), EHR-Complex
DeepSeek-V3.2-ExpDeepSeekModel29 Sep 202550.71 / 13EHR-Complex
DeepSeek V4 FlashDeepSeekModel24 Apr 202650.41 / 13MedScribe (Vals AI)
Claude Haiku 4.5AnthropicModel15 Oct 202550.03 / 13MedScribe (Vals AI), MedCode (Vals AI), CHI-Bench
MiniMax-M2.1MiniMaxModelNot stated49.22 / 13MedScribe (Vals AI), MedCode (Vals AI)
Ling 3.0 FlashAnt GroupModelNot stated47.62 / 13MedScribe (Vals AI), MedCode (Vals AI)
Qwen3.7 PlusAlibabaModel31 May 202647.31 / 13MedXpertQA (MM)
DeepSeek-V3.1DeepSeekModel21 Aug 202547.11 / 13EHR-Complex
Qwen3.5-PlusAlibabaModelNot stated47.01 / 13MedPIC
MiMo V2.5 ProXiaomiModelNot stated46.13 / 13MedScribe (Vals AI), MedCode (Vals AI), PhysicianBench
Claude Sonnet 4AnthropicModel22 May 202546.12 / 13MedScribe (Vals AI), MedCode (Vals AI)
Qwen3-32B-SFTAnt GroupModelNot stated45.91 / 13EHR-Complex
GLM 5.1ZhipuModel7 Apr 202645.64 / 13MedScribe (Vals AI), MedCode (Vals AI), First, Do NOHARM (v2), CHI-Bench
Qwen 3.8 27BAlibabaModelNot stated45.62 / 13MedScribe (Vals AI), MedCode (Vals AI)
Qwen 3 VL PlusAlibabaModelNot stated45.22 / 13MedScribe (Vals AI), MedCode (Vals AI)
Grok 4 Fast (Non-Reasoning)SpaceX AIModel19 Sep 202545.02 / 13MedScribe (Vals AI), MedCode (Vals AI)
GPT OSS 120BOpenAIModel5 Aug 202544.81 / 13MedPIC
Qwen3-235B-A22B-Instruct-2507AlibabaModelNot stated43.61 / 13EHR-Complex
o4-miniOpenAIModel16 Apr 202543.52 / 13MedScribe (Vals AI), MedCode (Vals AI)
Qwen 3.5 FlashAlibabaModelNot stated43.42 / 13MedScribe (Vals AI), MedCode (Vals AI)
MiMo V2.5XiaomiModelNot stated43.22 / 13MedScribe (Vals AI), MedCode (Vals AI)
Qwen3.5-27BAlibabaModelNot stated43.11 / 13MedPIC
Qwen 3 Max ThinkingAlibabaModelNot stated42.92 / 13MedScribe (Vals AI), MedCode (Vals AI)
Mistral Medium 3.5MistralModel28 Apr 202642.82 / 13MedScribe (Vals AI), MedCode (Vals AI)
Gemini 3 Pro (11/25)GoogleModelNot stated42.81 / 13MedCode (Vals AI)
Grok 4.1 Fast (Reasoning)SpaceX AIModel19 Nov 202542.72 / 13MedScribe (Vals AI), MedCode (Vals AI)
Grok 4.1 Fast Non-ReasoningSpaceX AIModel19 Nov 202542.42 / 13MedScribe (Vals AI), MedCode (Vals AI)
Grok 4.20SpaceX AIModel10 Mar 202642.34 / 13MedScribe (Vals AI), MedCode (Vals AI), MedXpertQA (MM), PhysicianBench
GLM 4.7ZhipuModel22 Dec 202542.32 / 13MedScribe (Vals AI), MedCode (Vals AI)
Ling 3.0 Flash FinAnt GroupModelNot stated42.32 / 13MedScribe (Vals AI), MedCode (Vals AI)
GPT-5 nanoOpenAIModel7 Aug 202542.12 / 13MedScribe (Vals AI), MedCode (Vals AI)
MiniMax-M2.7MiniMaxModel18 Mar 202641.93 / 13MedScribe (Vals AI), MedCode (Vals AI), PhysicianBench
Qwen3.5-35B-A3BAlibabaModelNot stated41.91 / 13MedPIC
Kimi K2.6Moonshot AIModel20 Apr 202640.95 / 13MedScribe (Vals AI), MedCode (Vals AI), First, Do NOHARM (v2), PhysicianBench, CHI-Bench
Grok 4.3SpaceX AIModelNot stated40.84 / 13MedScribe (Vals AI), MedCode (Vals AI), MAST (Medical AI Superintelligence Test), CHI-Bench
Gemini 2.5 Flash LiteGoogleModel22 Jul 202540.42 / 13MedScribe (Vals AI), MedCode (Vals AI)
Claude Sonnet 4.6AnthropicModel17 Feb 202639.56 / 13HealthBench Professional, MedPIC, PhysicianBench, EHR-Complex, HealthAgentBench, CHI-Bench
GPT-5.4 miniOpenAIModel17 Mar 202639.13 / 13MedHELM, HealthAgentBench, CHI-Bench
Llama 4 MaverickMetaModel5 Apr 202539.02 / 13MedScribe (Vals AI), MedCode (Vals AI)
GPT-4.1 miniOpenAIModel14 Apr 202538.81 / 13EHR-Complex
Gemma 4 31BGoogleModel2 Apr 202637.61 / 13MedXpertQA (MM)
GPT-4.1OpenAIModel14 Apr 202536.51 / 13EHR-Complex
Qwen3.5-9BAlibabaModelNot stated35.91 / 13MedPIC
Mercury 2.5InceptionModel8 Sep 202634.62 / 13MedScribe (Vals AI), MedCode (Vals AI)
Gemma 4 26B A4BGoogleModel2 Apr 202634.41 / 13MedXpertQA (MM)
Qwen3-14B-SFTAnt GroupModelNot stated34.21 / 13EHR-Complex
MedGemma 27B TextGoogleModelNot stated32.51 / 13MedPIC
Laguna M.1PoolsideModel28 Apr 202632.02 / 13MedScribe (Vals AI), MedCode (Vals AI)
Fleming-R1-32BUbiquantModelNot stated31.71 / 13MedPIC
Lingshu-32BAlibabaModelNot stated30.41 / 13MedPIC
GPT OSS 20BOpenAIModel5 Aug 202529.81 / 13MedPIC
DeepSeek V4 Flash 0731DeepSeekModel31 Jul 202628.61 / 13MedCode (Vals AI)
Laguna XS.2PoolsideModel28 Apr 202628.22 / 13MedScribe (Vals AI), MedCode (Vals AI)
Gemini 2.5 Flash Preview (9/25)GoogleModel25 Sep 202527.41 / 13MedCode (Vals AI)
Gemini 2.5 Flash (7/17)GoogleModelNot stated27.21 / 13MedCode (Vals AI)
Llama 3.1 70BMetaModel23 Jul 202425.41 / 13MedPIC
Llama 4 ScoutMetaModel5 Apr 202525.12 / 13MedScribe (Vals AI), MedCode (Vals AI)
Gemma 4 12BGoogleModel3 Jun 202625.01 / 13MedXpertQA (MM)
Nemotron 3 UltraNVIDIAModel4 Jun 202624.91 / 13MedCode (Vals AI)
HuatuoGPT-o1-70BFreedomIntelligenceModelNot stated24.81 / 13MedPIC
Command A+CohereModel20 May 202624.12 / 13MedScribe (Vals AI), MedCode (Vals AI)
Qwen3-VL-235B-A22BAlibabaModelNot stated24.01 / 13MedXpertQA (MM)
Qwen3-32BAlibabaModel29 Apr 202523.51 / 13EHR-Complex
Claude 3.7 SonnetAnthropicModel24 Feb 202520.11 / 13MedHELM
Fleming-R1-7BUbiquantModelNot stated19.01 / 13MedPIC
Gemini 2.5 Flash Lite (9/25)GoogleModel25 Sep 202519.01 / 13MedCode (Vals AI)
DeepSeek R1DeepSeekModel20 Jan 202518.82 / 13MedHELM, First, Do NOHARM (v2)
GPT-4oOpenAIModel13 May 202417.71 / 13EHR-Complex
Qwen3-14BAlibabaModel29 Apr 202516.51 / 13EHR-Complex
Baichuan-M2-32BBaichuanModelNot stated15.21 / 13MedPIC
HuatuoGPT-o1-8BFreedomIntelligenceModelNot stated10.71 / 13MedPIC
Lingshu-7BAlibabaModelNot stated9.41 / 13MedPIC
HealthGPT-Pro-8BZJU4HealthCareModelNot stated8.51 / 13MedPIC
Hulu-Med-7BZJU-AI4HModel8 Oct 20257.71 / 13MedPIC
Gemma 3 27BGoogleModel12 Mar 20255.51 / 13MedPIC
GPT-5.5 InstantOpenAIModel5 May 20265.51 / 13HealthBench Professional
Gemma 4 E4BGoogleModel2 Apr 20265.21 / 13MedXpertQA (MM)
Llama 3.1 8BMetaModel23 Jul 20245.11 / 13MedPIC
Gemma 3 12BGoogleModel12 Mar 20254.71 / 13MedPIC
MedGemma 4BGoogleModelNot stated4.71 / 13MedPIC
Gemini 2.0 FlashGoogleModel5 Feb 20250.01 / 13MedHELM
Gemma 4 E2BGoogleModel2 Apr 20260.01 / 13MedXpertQA (MM)
HealthGPT-Pro-4BZJU4HealthCareModelNot stated0.01 / 13MedPIC
MAI-Thinking-1MicrosoftModel12 Aug 20260.01 / 13HealthBench Professional
Nemotron 3.5 LightningNVIDIAModel11 Aug 20260.01 / 13MedScribe (Vals AI)
Qwen3-4BAlibabaModel29 Apr 20250.01 / 13EHR-Complex
Doximity Ask 6.1DoximityProductNot stated–1 / 13First, Do NOHARM (v2)
Glass 5.6 MaxGlass HealthProductNot stated–1 / 13First, Do NOHARM (v2)
GPT-5.3-CodexOpenAIModel5 Feb 2026–1 / 13HealthAgentBench
LiSA 2.5AMBOSSProductNot stated–1 / 13First, Do NOHARM (v2)
MedGuardMedGuardProductNot stated–1 / 13CHI-Bench
NVIDIA Nemotron 3 Ultra 550B A55BNVIDIAModel4 Jun 2026–1 / 13CHI-Bench
OpenEvidenceOpenEvidenceProductNot stated–1 / 13First, Do NOHARM (v2)
Qwen 3.5AlibabaModelNot stated–1 / 13HealthAdminBench
Qwen3.6-MaxAlibabaModelNot stated–1 / 13CHI-Bench