Skip to main content
Evaluation sources/SciCode
ParticipatingCoding

SciCode

Artificial Analysis · Public model evaluation results from SciCode.

Official evaluation
Source description

This source measures concrete delivery performance in Coding; raw scores are shown separately from the normalized capability score.

Limitation: Different versions, reasoning settings, and test sets may change scores; read them with the data date.

How it is used

Participating sources affect capability scores; reference, cross-reference, and observing sources are for comparison and verification only.

Model results from this source

Claude Fable 5.20.6770833378.32026-11-10
Claude Opus 5.50.6689814877.22026-11-05
Claude Fable 5.10.6307870471.82026-11-05
Muse Wonder Full0.6261574171.22026-10-18
Muse Wonder Full0.6261574171.22026-10-17
Muse Wonder Full0.6261574171.22026-11-05
Gemini 4 Argon0.6180555670.12026-11-05
Claude Fable 50.609953768.92026-11-05
Claude Sonnet 5.50.609953768.92026-11-05
MiMo V2.6 Pro0.608796368.82026-11-05
Muse Wonder0.6030092668.02026-10-18
Muse Wonder0.6030092668.02026-10-17
Muse Wonder0.6030092668.02026-11-05
Muse Spark 1.30.5972222267.22026-11-05
Kimi K30.5949074166.82026-11-05
GLM 5.30.5902777866.22026-11-05
Step 5 Preview0.5891203766.02026-11-05
Muse Spark 1.10.5879629665.92026-11-05
Gemini 3.1 Pro Preview0.5868055665.72026-11-05
GPT-5.6 Sol0.577546364.42026-11-05
Grok 4.70.577546364.42026-11-05
GPT-6 Sol0.5763888964.22026-11-05
Muse Spark 1.20.5740740763.92026-11-05
Ling-3.1-flash-10190.5682870463.12026-11-05
Gemini 3.8 Flash0.5659722262.82026-11-05
GPT-6 Astra0.5648148162.62026-11-05
Grok 4.60.5648148162.62026-11-05
Claude Opus 50.5636574162.52026-11-05
GPT-5.50.5613425962.12026-11-05
DeepSeek V4.1 Flash 10170.5590277861.82026-11-05
GPT-6.1 Sol0.5578703761.72026-11-05
GPT-6.1 Terra0.5509259360.72026-11-05
GPT-5.6 Terra0.5497685260.52026-11-05
Grok 4.50.5497685260.52026-11-05
Claude Haiku 5.50.5497685260.52026-11-05
GPT-6 Luna0.546296360.02026-11-05
Claude Opus 4.80.5439814859.72026-11-05
Claude Sonnet 50.5428240759.62026-11-05
Mistral Large 40.5416666759.42026-10-28
Ling-3.1-flash0.5405092659.22026-11-05
Ling-3.1-flash0.5405092659.22026-10-18
Ling-3.1-flash0.5405092659.22026-10-17
GPT-5.6 Luna0.5358796358.62026-11-05
Gemini 3.6 Flash0.5335648158.32026-11-05
MiniMax M3.1 Flash0.5335648158.32026-11-05
Qwen3.8 Max0.5324074158.12026-11-05
GPT-5.4 mini0.5208333356.52026-11-05
DeepSeek V4.1 Flash0.5185185256.22026-11-05
GLM-5.3 Flash0.516203755.82026-11-05
GLM-5.3 Flash0.516203755.82026-10-17
GLM-5.3 Flash0.516203755.82026-10-18
Kimi K2.60.515046355.72026-11-05
MiMo V2.6 Flash0.5127314855.42026-10-18
MiMo V2.6 Flash0.5127314855.42026-10-17
MiMo V2.6 Flash0.5127314855.42026-11-05
GLM-5.20.5115740755.22026-11-05
DeepSeek V4 Pro 08130.5104166755.02026-11-05
DeepSeek V4 Pro0.5081018554.72026-11-05
MiMo-V2.5-Pro0.5057870454.42026-11-05
DeepSeek V4 Flash 07310.5034722254.12026-11-05
Claude Sonnet 4.60.5011574153.72026-11-05
MiniMax-M2.70.5011574153.72026-11-05
Inkling Small0.4965277853.12026-11-05
Qwen3.7 Max0.4953703752.92026-11-05
Hy30.4861111151.62026-11-05
Grok 4.30.4826388951.22026-11-05
Kimi K2.7 Code0.4780092650.52026-11-05
MiniMax-M30.4710648149.52026-11-05
Inkling0.4699074149.42026-11-05
Gemini 2.5 Pro0.4629629648.42026-11-05
Qwen3.7 Plus0.4606481548.12026-11-05
Claude Sonnet 4.50.4571759347.62026-11-05
Ring-2.6-1T0.4502314846.62026-11-05
Qwen3.5 397B-A17B0.4479166746.32026-11-05
GLM-5.10.4479166746.32026-11-05
Step 3.7 Flash0.4386574145.02026-11-05
MiMo-V2.50.4386574145.02026-11-05
Gemini 3.1 Flash Lite0.4340277844.42026-11-05
Nex-N2-Pro0.4328703744.22026-11-05
Qwen3.6 27B0.4282407443.62026-11-05
o3-mini0.4282407443.62026-10-11
o3 Mini High0.4282407443.62026-11-05
Claude Haiku 4.50.422453742.72026-11-05
Ling-3.0-flash (free)0.4201388942.42026-11-05
Gemini 3.5 Flash Lite0.4131944441.52026-11-05
Trinity Large Thinking0.4062540.52026-11-05
Nemotron 3 Ultra 550B A55B0.4027777840.02026-11-05
Mistral Medium 3.50.4016203739.82026-11-05
Qwen3.5 122B-A10B0.3969907439.22026-11-05
GPT-5 mini0.390046338.22026-11-05
DeepSeek V3 03240.390046338.22026-11-05
gpt-oss-20b0.3888888938.12026-11-05
North Mini Code0.3877314837.92026-11-05
Command A Plus0.3854166737.62026-11-05
DeepSeek-R10.3831018537.32026-11-05
DeepSeek V3.1 Terminus0.3796296336.82026-11-05
Mercury 20.3773148136.42026-11-05
Qwen3.6 35B-A3B0.3657407434.82026-11-05
Mistral Large 30.3657407434.82026-11-05
LongCat-2.00.3634259334.52026-11-05
Nemotron 3 Super 120B A12B0.3622685234.32026-11-05
Qwen3 Coder Next0.3622685234.32026-11-05
Qwen3 32B0.359953734.02026-11-05
gpt-oss-120b0.3402777831.32026-11-05
Llama 4 Maverick0.3171296328.02026-11-05
Qwen3 14B0.3067129626.62026-11-05
Nemotron 3 Nano 30B A3B0.3055555626.42026-11-05
Qwen3.5 9B0.2951388925.02026-11-05
Qwen3 8B0.2789351922.72026-11-05
Solar Pro 30.2546296319.32026-11-05
Ministral 3 14B0.2384259317.02026-11-05
Llama 4 Scout0.2129629613.52026-11-05
Ministral 3 8B0.2071759312.72026-11-05
Ministral 3 3B0.152777785.12026-11-05

Frequently asked questions