Skip to main content
Evaluation sources/Terminal-Bench 4.0 (AA rerun)
ParticipatingCoding

Terminal-Bench 4.0 (AA rerun)

Artificial Analysis · Public model evaluation results from Terminal-Bench 4.0 (AA rerun).

Official evaluation
Source description

This source measures concrete delivery performance in Coding; raw scores are shown separately from the normalized capability score.

Limitation: Different versions, reasoning settings, and test sets may change scores; read them with the data date.

How it is used

Participating sources affect capability scores; reference, cross-reference, and observing sources are for comparison and verification only.

Model results from this source

Gemini 4 Carbon0.6515151587.62026-11-11
Claude Sonnet 5.50.6363636486.42026-11-05
Claude Fable 5.20.6161616284.92026-11-10
GPT-6 Astra0.595959683.42026-11-05
Claude Opus 5.50.595959683.42026-11-05
Gemini 4 Argon0.5707070781.52026-11-05
Muse Wonder Full0.5707070781.52026-10-17
Muse Wonder Full0.5707070781.52026-10-18
Muse Wonder Full0.5707070781.52026-11-05
GPT-6.1 Sol0.5606060680.82026-11-05
GPT-6.1 Terra0.5555555680.42026-11-05
Claude Fable 5.10.5505050580.02026-11-05
Muse Wonder0.5202020277.72026-10-17
Muse Wonder0.5202020277.72026-11-05
Muse Wonder0.5202020277.72026-10-18
Claude Opus 50.4898989975.52026-11-05
GPT-6 Sol0.4393939471.72026-11-05
Claude Fable 50.4242424270.52026-11-05
GLM 5.30.4191919270.22026-11-05
GPT-5.6 Sol0.398989968.62026-11-05
GPT-5.6 Terra0.3535353565.22026-11-05
MiMo V2.6 Pro0.3484848564.92026-11-05
DeepSeek V4.1 Flash 10170.3383838464.12026-11-05
Muse Spark 1.30.3333333363.72026-11-05
Step 5 Preview0.3333333363.72026-11-05
Ling-3.1-flash0.3333333363.72026-10-18
Ling-3.1-flash0.3333333363.72026-11-05
Ling-3.1-flash0.3333333363.72026-10-17
Claude Haiku 5.50.3282828363.32026-11-05
GLM-5.3 Flash0.3282828363.32026-10-17
GLM-5.3 Flash0.3282828363.32026-11-05
GLM-5.3 Flash0.3282828363.32026-10-18
Ling-3.1-flash-10190.3282828363.32026-11-05
Mistral Large 40.2676767758.82026-10-28
DeepSeek V4.1 Flash0.2676767758.82026-11-05
Grok 4.70.2575757658.02026-11-05
MiniMax M3.1 Flash0.2575757658.02026-11-05
Mistral Large 40.2474747557.32026-11-05
MiMo V2.6 Flash0.2272727355.82026-10-17
MiMo V2.6 Flash0.2272727355.82026-11-05
MiMo V2.6 Flash0.2272727355.82026-10-18
Claude Opus 4.80.2171717255.02026-11-05
Grok 4.60.2121212154.62026-11-05
Gemini 3.8 Flash0.196969753.52026-11-05
Qwen3.8 Max0.1868686952.72026-11-05
DeepSeek V4 Pro0.1464646549.72026-11-05
GPT-5.50.1464646549.72026-11-05
Claude Sonnet 50.1414141449.32026-11-05
DeepSeek V4 Pro 08130.1414141449.32026-11-05
Kimi K30.1262626348.22026-11-05
Kimi K30.1262626348.22026-10-27
GPT-6 Luna0.1262626348.22026-11-05
DeepSeek V4 Flash 07310.1212121247.82026-11-05
GPT-5.6 Luna0.1161616247.52026-11-05
Grok 4.50.1060606146.72026-11-05
Gemini 3.6 Flash0.0707070744.02026-11-05
Muse Spark 1.20.0707070744.02026-11-05
Muse Spark 1.10.0606060643.32026-11-05
Gemini 3.1 Pro Preview0.0404040441.82026-11-05
Claude Sonnet 4.60.0303030341.02026-11-05
MiniMax-M30.0202020240.32026-11-05
GPT-5.4 mini0.0202020240.32026-11-05
GLM-5.10.0202020240.32026-11-05
Qwen3.7 Max0.0151515239.92026-11-05
Qwen3.7 Plus0.0101010139.52026-11-05
Gemini 3.5 Flash Lite0.0101010139.52026-11-05
Kimi K2.7 Code0.0101010139.52026-11-05
Inkling0.0101010139.52026-11-05
Inkling Small0.0101010139.52026-11-05
GLM-5.20.0101010139.52026-11-05
Qwen3.5 9B0.0050505139.12026-11-05
Command A Plus0.0050505139.12026-11-05
North Mini Code0.0050505139.12026-11-05
Gemini 3.1 Flash Lite0.0050505139.12026-11-05
Kimi K2.60.0050505139.12026-11-05
Nemotron 3 Ultra 550B A55B0.0050505139.12026-11-05
Hy30.0050505139.12026-11-05
Ring-2.6-1T0.0050505139.12026-11-05
Trinity Large Thinking0.0050505139.12026-11-05
Qwen3 32B038.72026-11-05
Qwen3.5 122B-A10B038.72026-11-05
Qwen3.5 397B-A17B038.72026-11-05
Qwen3.6 27B038.72026-11-05
Qwen3.6 35B-A3B038.72026-11-05
Claude Haiku 4.5038.72026-11-05
Claude Sonnet 4.5038.72026-11-05
DeepSeek-R1038.72026-11-05
Gemini 2.5 Pro038.72026-11-05
LongCat-2.0038.72026-11-05
MiniMax-M2.7038.72026-11-05
Mistral Large 3038.72026-11-05
Nemotron 3 Nano 30B A3B038.72026-11-05
Nemotron 3 Super 120B A12B038.72026-11-05
GPT-5 mini038.72026-11-05
gpt-oss-120b038.72026-11-05
gpt-oss-20b038.72026-11-05
o3-mini038.72026-10-11
Grok 4.3038.72026-11-05
Grok 4.3038.72026-10-27
MiMo-V2.5038.72026-11-05
MiMo-V2.5-Pro038.72026-11-05
Ling-3.0-flash (free)038.72026-11-05
Mistral Medium 3.5038.72026-11-05
Mercury 2038.72026-11-05
Qwen3 Coder Next038.72026-11-05
Solar Pro 3038.72026-11-05
Ministral 3 14B038.72026-11-05
Ministral 3 8B038.72026-11-05
Ministral 3 3B038.72026-11-05
DeepSeek V3.1 Terminus038.72026-11-05
Qwen3 8B038.72026-11-05
Qwen3 14B038.72026-11-05
Llama 4 Maverick038.72026-11-05
Llama 4 Scout038.72026-11-05
DeepSeek V3 0324038.72026-11-05
o3 Mini High038.72026-11-05

Frequently asked questions