Clinical Benchmarks

APEX-1: General Practitioner

Primary-care consults graded by practising GPs on diagnosis, workup and safe escalation.

More about this boardLess

Primary-care consultations graded by practising general practitioners on diagnosis, workup and safe escalation, scored against the plan a GP would defend to a colleague.

Published by Mercor, released Sep 2026. 100 primary-care consults graded by practising GPs. Mean score % (avg@4), higher better.

Run by
Mercor runs it; Fireworks publishes the provider's results
Headline metric
Score (avg@4)
Task count
100
Board last updated
26 Oct 2026
Publisher
Mercor
Rows
12
Models
12 on the board
Released
Sep 2026
Measured to
Oct 2026
Unit
100 GP consults
Documents cited
1

Every result on APEX-1 GP, on the board's own scale

12 results, one column each, highest first. Mean score % (avg@4), higher better.

Column colour is the model's lab. The table below says who ran each result.

Every published result, ranked on this board alone

12 rows. Higher is better. Bars run from 0 to 100; whiskers show a published interval. Select a row for its quote, page and document.

1Claude Opus 5.5Anthropic · Score73.04Board publisherOct 2026[1]
Claude Opus 5.5 73.04 (Score (avg@4)), rank 1
As printed
73.04
Where
https://fireworks.ai/specialized-intelligence-index/benchmarks/healthcare/apex-1-general-practitioner (feed: benchmarks[id=healthcare/apex-1-general-practitioner].results)
Setting
Score (avg@4), reasoning max
Reported by
official leaderboard
Document
[1] APEX-1: General Practitioner on the Fireworks Specialized Intelligence Index
2Claude Opus 5Anthropic · Score72.12Board publisherOct 2026[1]
Claude Opus 5 72.12 (Score (avg@4)), rank 2
As printed
72.12
Where
https://fireworks.ai/specialized-intelligence-index/benchmarks/healthcare/apex-1-general-practitioner (feed: benchmarks[id=healthcare/apex-1-general-practitioner].results)
Setting
Score (avg@4), reasoning max
Reported by
official leaderboard
Document
[1] APEX-1: General Practitioner on the Fireworks Specialized Intelligence Index
3Gemini 3.8 FlashGoogle · Score68.36Board publisherOct 2026[1]
Gemini 3.8 Flash 68.36 (Score (avg@4)), rank 3
As printed
68.36
Where
https://fireworks.ai/specialized-intelligence-index/benchmarks/healthcare/apex-1-general-practitioner (feed: benchmarks[id=healthcare/apex-1-general-practitioner].results)
Setting
Score (avg@4), reasoning high
Reported by
official leaderboard
Document
[1] APEX-1: General Practitioner on the Fireworks Specialized Intelligence Index
4Kimi K3Moonshot AI · Score64.35Board publisherOct 2026[1]
Kimi K3 64.35 (Score (avg@4)), rank 4
As printed
64.35
Where
https://fireworks.ai/specialized-intelligence-index/benchmarks/healthcare/apex-1-general-practitioner (feed: benchmarks[id=healthcare/apex-1-general-practitioner].results)
Setting
Score (avg@4), reasoning max
Reported by
official leaderboard
Document
[1] APEX-1: General Practitioner on the Fireworks Specialized Intelligence Index
5GPT-5.6 SolOpenAI · Score63.75Board publisherOct 2026[1]
GPT-5.6 Sol 63.75 (Score (avg@4)), rank 5
As printed
63.75
Where
https://fireworks.ai/specialized-intelligence-index/benchmarks/healthcare/apex-1-general-practitioner (feed: benchmarks[id=healthcare/apex-1-general-practitioner].results)
Setting
Score (avg@4), reasoning max
Reported by
official leaderboard
Document
[1] APEX-1: General Practitioner on the Fireworks Specialized Intelligence Index
6GLM 5.3Zhipu · Score63.2Board publisherOct 2026[1]
GLM 5.3 63.2 (Score (avg@4)), rank 6
As printed
63.2
Where
https://fireworks.ai/specialized-intelligence-index/benchmarks/healthcare/apex-1-general-practitioner (feed: benchmarks[id=healthcare/apex-1-general-practitioner].results)
Setting
Score (avg@4), reasoning max
Reported by
official leaderboard
Document
[1] APEX-1: General Practitioner on the Fireworks Specialized Intelligence Index
7GPT-6 AstraOpenAI · Score61.03Board publisherOct 2026[1]
GPT-6 Astra 61.03 (Score (avg@4)), rank 7
As printed
61.03
Where
https://fireworks.ai/specialized-intelligence-index/benchmarks/healthcare/apex-1-general-practitioner (feed: benchmarks[id=healthcare/apex-1-general-practitioner].results)
Setting
Score (avg@4), reasoning max
Reported by
official leaderboard
Document
[1] APEX-1: General Practitioner on the Fireworks Specialized Intelligence Index
8GPT-6.1 SolOpenAI · Score60.61Board publisherOct 2026[1]
GPT-6.1 Sol 60.61 (Score (avg@4)), rank 8
As printed
60.61
Where
https://fireworks.ai/specialized-intelligence-index/benchmarks/healthcare/apex-1-general-practitioner (feed: benchmarks[id=healthcare/apex-1-general-practitioner].results)
Setting
Score (avg@4), reasoning max
Reported by
official leaderboard
Document
[1] APEX-1: General Practitioner on the Fireworks Specialized Intelligence Index
9Grok 4.6SpaceX AI · Score59.38Board publisherOct 2026[1]
Grok 4.6 59.38 (Score (avg@4)), rank 9
As printed
59.38
Where
https://fireworks.ai/specialized-intelligence-index/benchmarks/healthcare/apex-1-general-practitioner (feed: benchmarks[id=healthcare/apex-1-general-practitioner].results)
Setting
Score (avg@4), reasoning xhigh
Reported by
official leaderboard
Document
[1] APEX-1: General Practitioner on the Fireworks Specialized Intelligence Index
10Grok 4.7SpaceX AI · Score59.16Board publisherOct 2026[1]
Grok 4.7 59.16 (Score (avg@4)), rank 10
As printed
59.16
Where
https://fireworks.ai/specialized-intelligence-index/benchmarks/healthcare/apex-1-general-practitioner (feed: benchmarks[id=healthcare/apex-1-general-practitioner].results)
Setting
Score (avg@4), reasoning xhigh
Reported by
official leaderboard
Document
[1] APEX-1: General Practitioner on the Fireworks Specialized Intelligence Index
11DeepSeek V4 Pro 0813DeepSeek · Score56.53Board publisherOct 2026[1]
DeepSeek V4 Pro 0813 56.53 (Score (avg@4)), rank 11
As printed
56.53
Where
https://fireworks.ai/specialized-intelligence-index/benchmarks/healthcare/apex-1-general-practitioner (feed: benchmarks[id=healthcare/apex-1-general-practitioner].results)
Setting
Score (avg@4), reasoning max
Reported by
official leaderboard
Document
[1] APEX-1: General Practitioner on the Fireworks Specialized Intelligence Index
12DeepSeek V4.1 FlashDeepSeek · Score56.18Board publisherOct 2026[1]
DeepSeek V4.1 Flash 56.18 (Score (avg@4)), rank 12
As printed
56.18
Where
https://fireworks.ai/specialized-intelligence-index/benchmarks/healthcare/apex-1-general-practitioner (feed: benchmarks[id=healthcare/apex-1-general-practitioner].results)
Setting
Score (avg@4), reasoning max
Reported by
official leaderboard
Document
[1] APEX-1: General Practitioner on the Fireworks Specialized Intelligence Index
References

1 document supports this board

  1. 1.APEX-1: General Practitioner on the Fireworks Specialized Intelligence Indexofficial leaderboard, Fireworks AI, 26 Oct 2026. Every result it supports