Clinical Benchmarks

NVIDIA Nemotron 3 Ultra 550B A55B

Released 4 Jun 20261M context550B A55BopenAlso written as Nemotron 3 Ultra 256K, NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16Compare with other models

Boards
1 of 13
Results
1
Latest measurement
Jul 2026

Results

Each line is placed on its own board. Dark tick: the board leader.

EHR and workflow agents

  1. CHI-Bench
    Listed as openai-agents + Nemotron 3 Ultra 256K
    All Domains pass@1; openai-agents; Tinker 256K
    0.0
    Rank 43 of 43 here, 45 models on the boardLeader erius + claude-opus-5 54.7
    Official leaderboard
    Measured Jul 2026

Sources

Open a line for the quote and page.

  1. 43CHI-Bench All Domains pass@1; openai-agents; Tinker 256K 0.0
    Printed as 0.0%Official leaderboard, measured Jul 2026Configuration: All Domains pass@1; openai-agents; Tinker 256K
    CHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 44, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-07-24; accessed 2026-09-30. Linked submission provenance: run 2026-07-22T22:31:29.302007Z to 2026-07-22T23:37:41.111758Z; submitted_at 2026-08-12T20:20:00Z.
    44 | openai-agents | Nemotron 3 Ultra 256K | Open-source | 0.0% | 0.0% | 0.0% | 0.0% | 2026-07-24
    Every result from this document

Other NVIDIA models: Nemotron 3.5 Lightning, Nemotron 3 Ultra