Clinical Benchmarks

NVIDIA

NVIDIA models with results here, each shown on its own board.

Models
4
Results
4
Boards
4 of 14

www.nvidia.com

Models

ModelKindReleasedBoards
Nemotron 3.5 Super VLModel15 Oct 20261
Nemotron 3.5 LightningModel11 Aug 20261
Nemotron 3 UltraModel4 Jun 20261
NVIDIA Nemotron 3 Ultra 550B A55BModel4 Jun 20261

Results

One line per result. Tall tick: the board leader.

Documentation and coding

  1. MedScribe (Vals AI)
    model ID fireworks/nemotron-lightning-3p5-30b-a3b; temperature=1; top_p=0.95; max_output_tokens=30000
    4.27
    Rank 106 of 106 here, 105 models on the boardLeader Claude Opus 5.5 91.43
    Official leaderboard
    Measured Sep 2026
  2. MedCode (Vals AI)
    model ID nvidia/nemotron-3-ultra-550b-a55b; temperature=1; top_p=0.95; max_output_tokens=30000
    38.62
    Rank 68 of 104 here, 103 models on the boardLeader Claude Opus 5 63.57
    Official leaderboard
    Measured Sep 2026
  3. 13.3
    Rank 22 of 27Leader Claude Sonnet 5.5 (Max, Default Fallback) 41.7
    Independent run
    Measured Nov 2026

EHR and workflow agents

  1. CHI-Bench
    All Domains pass@1; openai-agents; Tinker 256K
    0.0
    Rank 43 of 43 here, 45 models on the boardLeader erius + claude-opus-5 54.7
    Official leaderboard
    Measured Jul 2026