Clinical Benchmarks

Llama 4 Scout

Released 5 Apr 202510M context109B A17BopenAlso written as meta-llama/Llama-4-Scout-17B-16E-Instruct, together/meta-llama/Llama-4-Scout-17B-16E-Instruct

2 results on 2 of 14 boards, latest measured Sep 2026. Compare with other models

Clinical Benchmarks Index32.4Rank 123 of 1282 of 12 boardsThis site’s own calculation. Show the working How it is computed

On the Clinical Benchmarks Index

The top 15 on the index, then Llama 4 Scout at rank 123. Select a column to open that model.

Board by board

Llama 4 Scout against the top 10 on each board it has a result on, on that board's own scale. Its own column is in colour.

Every result, with its source

Each line sits on its own board's scale. Tall tick: the board leader.

Documentation and coding

  1. MedScribe (Vals AI)
    model ID together/meta-llama/Llama-4-Scout-17B-16E-Instruct; temperature=1; max_output_tokens=30000
    50.59
    Rank 105 of 106 here, 105 models on the boardLeader Claude Opus 5.5 91.43
    Official leaderboard
    Measured Sep 2026
  2. MedCode (Vals AI)
    model ID together/meta-llama/Llama-4-Scout-17B-16E-Instruct; temperature=1; max_output_tokens=30000
    23.31
    Rank 101 of 104 here, 103 models on the boardLeader Claude Opus 5 63.57
    Official leaderboard
    Measured Sep 2026

Index working

Show the working: each board’s result, how hard the board runs and the field average

The Clinical Benchmarks Index is this site's own calculation from 12 boards. How it is computed

  • MedScribe (Vals AI)50.5950.6+33.8 easy board16.80.15 weight, near its ceilingNear its ceiling: leader 91.4, weight 0.15model ID together/meta-llama/Llama-4-Scout-17B-16E-Instruct; temperature=1; max_output_tokens=30000
  • MedCode (Vals AI)23.3123.3−3.3 hard board26.60.319 weightmodel ID together/meta-llama/Llama-4-Scout-17B-16E-Instruct; temperature=1; max_output_tokens=30000
Adjusted average of 2 boards, by weight
23.5
Field average, counts for 42.9% with 2 of 12 boards
44.2
Index
= 32.4

Score: the result on the board’s own 0 to 100 scale (dot; tick: the board’s leader). Board runs: how far the board’s scores sit above or below the same models’ scores on the other boards. Adjusted: the score minus that offset. The index is the adjusted average with the field average mixed in, more of it the fewer boards a model has. Each result links to its quote and page; the line under it is the setting it was measured with.

Sources

The quote, page and document for each of the 2 results
  1. 105MedScribe (Vals AI) Llama-4-Scout-17B-16E-Instruct 50.59
    Printed as 50.59%Official leaderboard, measured Sep 2026Configuration: model ID together/meta-llama/Llama-4-Scout-17B-16E-Instruct; temperature=1; max_output_tokens=30000
    Vals AI MedScribe leaderboard official leaderboard, Vals AI, 3 Sep 2026. Vals AI MedScribe leaderboard, View: All Models, Task: Overall, row 104 of 105 (Llama 4 Scout), Accuracy column; Updated 9/29/2026. Rendered BenchmarkView table; configuration from embedded astro-island BenchmarkView props, benchmarkView.default.tasks.overall["together/meta-llama/Llama-4-Scout-17B-16E-Instruct"].
    104 | Llama 4 Scout | 50.59%±1.90 | $0.18/$0.59 | 11.32s
    Every result from this document
  2. 101MedCode (Vals AI) Llama-4-Scout-17B-16E-Instruct 23.31
    Printed as 23.31%Official leaderboard, measured Sep 2026Configuration: model ID together/meta-llama/Llama-4-Scout-17B-16E-Instruct; temperature=1; max_output_tokens=30000
    Vals AI MedCode leaderboard official leaderboard, Vals AI, 29 Sep 2026. MedCode leaderboard, Overall task, All Models expanded, rank 100 of 103; Accuracy column; board Updated 9/29/2026. Rendered table row; configuration from embedded BenchmarkView props benchmarkView.default.tasks.overall["together/meta-llama/Llama-4-Scout-17B-16E-Instruct"].
    100 | Llama 4 Scout | 23.31%±1.75 | $0.18/$0.59 | 10.74s
    Every result from this document

Other Meta models: Llama 4 Maverick, Muse Spark, Muse Spark 1.1, Muse Spark 1.2, Muse Spark 1.3, Muse Spark Open, Muse Wonder, Muse Wonder Full