Clinical Benchmarks

Qwen3.5 397B A17B

Released 16 Feb 2026256K context397B total / 17B activeapache-2.0Also written as Qwen3.5-397B

3 results on 3 of 14 boards, latest measured Aug 2026. Compare with other models

Clinical Benchmarks Index45.7Rank 52 of 1283 of 12 boardsThis site’s own calculation. Show the working How it is computed

On the Clinical Benchmarks Index

The top 15 on the index, then Qwen3.5 397B A17B at rank 52. Select a column to open that model.

Board by board

Qwen3.5 397B A17B against the top 10 on each board it has a result on, on that board's own scale. Its own column is in colour.

Every result, with its source

Each line sits on its own board's scale. Tall tick: the board leader.

Clinical reasoning and knowledge

  1. MedXpertQA (MM)
    self-reported in the Qwen3.5-397B-A17B model card
    70.0
    Rank 11 of 22 here, 5 models on the boardLeader GPT-5.6 Sol 81.5
    Vendor-reported
  2. 57.9
    Rank 5 of 8 here, 11 models on the boardLeader GPT-5.6 Sol 60.2
    Official leaderboard
    Measured Aug 2026

Safety

  1. 61.1
    Rank 14 of 17 here, 19 models on the boardLeader LiSA 2.5 86.2
    Official leaderboard
    Measured Aug 2026

Index working

Show the working: each board’s result, how hard the board runs and the field average

The Clinical Benchmarks Index is this site's own calculation from 12 boards. How it is computed

  • MedXpertQA (MM)70.070.0+22.0 easy board48.00.162 weight, near its ceilingNear its ceiling: leader 81.5, weight 0.162self-reported in the Qwen3.5-397B-A17B model card
  • MAST (Medical AI Superintelligence Test)57.957.9+8.8 easy board49.10.597 weight
  • First, Do NOHARM (v2)61.161.1+18.2 easy board42.90.507 weight
Adjusted average of 3 boards, by weight
46.5
Field average, counts for 33.3% with 3 of 12 boards
44.2
Index
= 45.7

Score: the result on the board’s own 0 to 100 scale (dot; tick: the board’s leader). Board runs: how far the board’s scores sit above or below the same models’ scores on the other boards. Adjusted: the score minus that offset. The index is the adjusted average with the field average mixed in, more of it the fewer boards a model has. Each result links to its quote and page; the line under it is the setting it was measured with.

Sources

The quote, page and document for each of the 3 results
  1. 11MedXpertQA (MM) self-reported… 70.0
    Printed as 70.0Vendor-reportedConfiguration: self-reported in the Qwen3.5-397B-A17B model card
    Qwen/Qwen3.5-397B-A17B model card model card, Alibaba / Qwen, 16 Feb 2026. Benchmark Results > Vision Language > Medical VQA, row MedXpertQA-MM; columns GPT5.2 / Claude 4.5 Opus / Gemini-3 Pro / Qwen3-VL-235B-A22B / K2.5-1T-A32B / Qwen3.5-397B-A17B
    MedXpertQA-MM 73.3 63.6 76.0 47.6 65.3 70.0
    Every result from this document
  2. 5MAST (Medical AI Superintelligence Test) 57.9
    Printed as 57.9%Official leaderboard, measured Aug 2026
    MAST: Medical AI Superintelligence Test leaderboard (General board) official leaderboard, ARISE AI Research Network, 15 Aug 2026. arise-ai.org/mast, 'Which AI can you trust for medical questions?' General tab, composite score table (8 of 11 models shown; 'Last updated August 15, 2026')
    5 Qwen3.5 397B A17B Alibaba 57.9%
    Every result from this document
  3. 14First, Do NOHARM (v2) 61.1
    Printed as 61.1%Official leaderboard, measured Aug 2026
    MAST technical leaderboard (First Do NOHARM v2 and per-benchmark results) official leaderboard, ARISE AI Research Network, 15 Aug 2026. arise-ai.org/mast/technical, 'First Do NOHARM v2 overall metric across 19 models' ranking (Latest Flagships view)
    13Qwen3.5 397B A17BOSSAlibaba 61.1%
    Every result from this document

Other Alibaba models: Qwen 3.5 Flash, Qwen3.6-Max, Qwen3.6 Plus, Qwen 3.7 Max, Qwen3.7 Plus, Qwen 3.8 27B, Qwen3.8 27B, Qwen3.8 Max, Qwen 3 Max Thinking, Qwen3-VL-235B-A22B, Qwen 3 VL Plus