LLM Benchmarks
Source-backed measurements
Compare 100 AI models across overall capability, knowledge, coding and agents—with sources, test dates and transparent comparison rules.
| Overview | Knowledge and reasoning | Coding | Agents and tools | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ECI rank ↓ · Model | ECI, Overview, Epoch Capabilities Index: 84/100 measured models; 84 comparable, 2 sharing a place. Canonical protocol: Epoch ECI snapshot 2026-10-16 · official-composite-fit · Epoch Capabilities Index. Best comparable first.Info | AA Index, Overview, Artificial Analysis Intelligence Index: 38/100 measured models; 38 comparable. Canonical protocol: Artificial Analysis Intelligence Index v4.3.2 · intelligence-index-v4-3-2 · Artificial Analysis · Intelligence Index evaluations. Sort.Info | Arena, Overview, Arena Text: 80/100 measured models; 80 comparable, 26 sharing a place. Canonical protocol: 2026-10-13 · overall-style-control · Arena Text. Sort.Info | LiveBench, Overview, LiveBench: 57/100 measured models; 57 comparable. Canonical protocol: 2026-06-25 · overall-seven-category · LiveBench. Sort.Info | HLE Full, Knowledge and reasoning, Humanity's Last Exam · Full multimodal: 53/100 measured models; 15 comparable, 38 with a different protocol, 1 sharing a place. Canonical protocol: HLE finalized 2,500 · Scale protocol 2025-04-03 · full-multimodal-2500-no-tools · Scale AI Labs · Humanity's Last Exam Full. Sort.Info | GPQA, Knowledge and reasoning, GPQA Diamond: 89/100 measured models; 53 comparable, 36 with a different protocol, 26 sharing a place. Canonical protocol: GPQA Diamond v1 · Vals dual-prompt · diamond-198-zero-and-five-shot-cot · Vals AI GPQA Diamond. Sort.Info | MMLU-Pro, Knowledge and reasoning, MMLU-Pro: 63/100 measured models; 54 comparable, 9 with a different protocol, 13 sharing a place. Canonical protocol: Vals MMLU-Pro v1 · vals-mmlu-pro-overall · Vals AI · MMLU-Pro. Sort.Info | FrontierMath T1–3, Knowledge and reasoning, FrontierMath T1–3: 66/100 measured models; 66 comparable, 19 sharing a place. Canonical protocol: 2.0.0 · private-285-of-295-problem-tiers-1-3-set · Epoch AI · FrontierMath Tiers 1–3 v2. Sort.Info | SWE-bench, Coding, SWE-bench Verified: 56/100 measured models; 56 comparable, 18 sharing a place. Canonical protocol: SWE-bench Verified v1 · verified-500-vals-mini-swe-agent · Vals AI SWE-bench Verified. Shows only Vals AI's uniform 500-task mini-swe-agent/Bash evaluation. This is the default directly comparable view. Sort.Info | SWE-rebench, Coding, SWE-rebench v2: 36/100 measured models; 13 comparable, 8 directly comparable with a contamination warning, 23 with a different protocol. Canonical protocol: rolling-v2 · 2026-05-15/2026-07-01 · SWE-rebench. Shows the latest shared SWE-rebench task window. Contamination warnings remain visible and do not change the task-window match. 2026-05-15/2026-07-01 Sort.Info | LiveCodeBench, Coding, LiveCodeBench: 61/100 measured models; 53 comparable, 8 with a different protocol, 7 sharing a place. Canonical protocol: Vals LiveCodeBench v1 · vals-livecodebench-overall · Vals AI · LiveCodeBench. Sort.Info | SciCode, Coding, SciCode: 79/100 measured models; 73 comparable, 6 with a different protocol, 9 sharing a place. Canonical protocol: SciCode current leaderboard · scientific-research-coding-subproblems · Epoch AI mirror · SciCode. Sort.Info | Terminal 2.1, Agents and tools, Terminal-Bench 2.1: 65/100 measured models; 56 comparable, 9 with a different protocol, 12 sharing a place. Canonical protocol: Vals Terminal-Bench 2.1 v2.1 · vals-terminal-bench-2-1-overall · Vals AI · Terminal-Bench 2.1. Sort.Info | MCP-Atlas, Agents and tools, MCP-Atlas · Scale: 23/100 measured models; 22 comparable, 1 with a different protocol, 2 sharing a place. Canonical protocol: MCP-Atlas April 2026 rescored protocol · all-1000-public-500-private-500 · Scale AI Labs · MCP-Atlas. Sort.Info | APEX, Agents and tools, APEX-Agents: 59/100 measured models; 59 comparable, 7 sharing a place. Canonical protocol: APEX-Agents current leaderboard · 480-professional-tasks-33-worlds · Epoch AI mirror · APEX-Agents. Sort.Info | GDPval-AA v2.1, Agents and tools, GDPval-AA v2.1: 75/100 measured models; 75 comparable, 2 sharing a place. Canonical protocol: GDPval-AA v2.1 (Crowd-BT Elo, DeepSeek V4.1 Flash (max) at 1600) · 220-tasks-elo-v2-1 · Artificial Analysis · Intelligence Index evaluations. Sort.Info |
| Rank 1Claude Opus 5.510/16 measured · 9 comparable | ||||||||||||||||
| Rank 2GPT 6 astra11/16 measured · 10 comparable | ||||||||||||||||
| Rank 3GPT 6.1 Sol9/16 measured · 8 comparable | ||||||||||||||||
| Rank 4Claude Fable 5.113/16 measured · 12 comparable | ||||||||||||||||
| Rank 5Gemini 4 argon8/16 measured · 7 comparable | ||||||||||||||||
| Rank 6Claude Sonnet 5.510/16 measured · 9 comparable | ||||||||||||||||
| Rank 7Claude Opus 515/16 measured · 14 comparable | ||||||||||||||||
| Rank 8GPT 6 Sol9/16 measured · 8 comparable | ||||||||||||||||
| Rank 9Claude Fable 514/16 measured · 14 comparable | ||||||||||||||||
| Rank 10GPT 5.5 Pro3/16 measured · 2 comparable | ||||||||||||||||
| Rank 11GPT 5.6 Sol14/16 measured · 14 comparable | ||||||||||||||||
| Rank 12GPT 5.6 Terra13/16 measured · 13 comparable | ||||||||||||||||
| Rank 13GPT 5.4 Pro4/16 measured · 3 comparable | ||||||||||||||||
| Rank 14Claude haiku 5.59/16 measured · 8 comparable | ||||||||||||||||
| Rank 15GPT 5.515/16 measured · 13 comparable | ||||||||||||||||
| Rank 16Claude Opus 4.815/16 measured · 13 comparable | ||||||||||||||||
| Rank 17Kimi K315/16 measured · 14 comparable | ||||||||||||||||
| Rank 18Gemini 3.7 Flash12/16 measured · 12 comparable | ||||||||||||||||
| Rank 19Gemini 3.8 Flash14/16 measured · 14 comparable | ||||||||||||||||
| Rank 20Qwen 3.8 Max12/16 measured · 12 comparable | ||||||||||||||||
| Rank 21Muse Spark 1 310/16 measured · 9 comparable | ||||||||||||||||
| Rank 21GPT 5.3 Codex7/16 measured · 5 comparable | ||||||||||||||||
| Rank 23GPT 5.414/16 measured · 13 comparable | ||||||||||||||||
| Rank 24Claude Sonnet 514/16 measured · 13 comparable | ||||||||||||||||
| Rank 25GPT 5.6 Luna12/16 measured · 12 comparable | ||||||||||||||||
| Rank 26Claude Opus 4.715/16 measured · 14 comparable | ||||||||||||||||
| Rank 27GPT 6 Luna10/16 measured · 9 comparable | ||||||||||||||||
| Rank 27Grok 4.612/16 measured · 12 comparable | ||||||||||||||||
| Rank 29GPT 5.2 Pro2/16 measured · 2 comparable | ||||||||||||||||
| Rank 30GLM 5.314/16 measured · 13 comparable | ||||||||||||||||
| Rank 31DeepSeek V4.1 Flash11/16 measured · 9 comparable | ||||||||||||||||
| Rank 32DeepSeek V4 Pro (2026-08-13)14/16 measured · 13 comparable | ||||||||||||||||
| Rank 33Claude Opus 4.612/16 measured · 11 comparable | ||||||||||||||||
| Rank 34Qwen 3.8 Max (0902)6/16 measured · 5 comparable | ||||||||||||||||
| Rank 35Muse Spark 1.210/16 measured · 9 comparable | ||||||||||||||||
| Rank 36Gemini 3.1 Pro16/16 measured · 15 comparable | ||||||||||||||||
| Rank 37DeepSeek V4 Flash (0731)11/16 measured · 10 comparable | ||||||||||||||||
| Rank 38Gemini 3.5 Flash15/16 measured · 13 comparable | ||||||||||||||||
| Rank 39Grok 4.710/16 measured · 9 comparable | ||||||||||||||||
| Rank 40Gemini 3.6 Flash12/16 measured · 12 comparable | ||||||||||||||||
| Rank 41Muse Spark 1.113/16 measured · 12 comparable | ||||||||||||||||
| Rank 42Grok 4.513/16 measured · 13 comparable | ||||||||||||||||
| Rank 43Qwen 3.7 Max11/16 measured · 11 comparable | ||||||||||||||||
| Rank 44GPT 5.211/16 measured · 10 comparable | ||||||||||||||||
| Rank 45GLM 5.3 Flash14/16 measured · 13 comparable | ||||||||||||||||
| Rank 46Gemini 3 Pro10/16 measured · 9 comparable | ||||||||||||||||
| Rank 47Claude Sonnet 4.614/16 measured · 12 comparable | ||||||||||||||||
| Rank 48Muse Spark9/16 measured · 9 comparable | ||||||||||||||||
| Rank 49Grok 4.208/16 measured · 8 comparable | ||||||||||||||||
| Rank 50GLM 5.215/16 measured · 14 comparable | ||||||||||||||||
| Rank 51Gemini 3 Flash11/16 measured · 9 comparable | ||||||||||||||||
| Rank 52Qwen 3.8 27B13/16 measured · 12 comparable | ||||||||||||||||
| Rank 53Kimi K2.614/16 measured · 12 comparable | ||||||||||||||||
| Rank 54GPT 5 Pro3/16 measured · 3 comparable | ||||||||||||||||
| Rank 55Inkling Small13/16 measured · 12 comparable | ||||||||||||||||
| Rank 56Claude Opus 4.511/16 measured · 10 comparable | ||||||||||||||||
| Rank 57GLM 5.114/16 measured · 12 comparable | ||||||||||||||||
| Rank 58Kimi K2.7 Code11/16 measured · 10 comparable | ||||||||||||||||
| Rank 59GPT 5.110/16 measured · 10 comparable | ||||||||||||||||
| Rank 60Qwen 3.6 Max Preview4/16 measured · 3 comparable | ||||||||||||||||
| Rank 61DeepSeek V4 Pro (2026-04-22)13/16 measured · 12 comparable | ||||||||||||||||
| Rank 62Grok 4.312/16 measured · 11 comparable | ||||||||||||||||
| Rank 63GPT 5.4 Mini12/16 measured · 12 comparable | ||||||||||||||||
| Rank 64Inkling15/16 measured · 14 comparable | ||||||||||||||||
| Rank 65Kimi K2.512/16 measured · 11 comparable | ||||||||||||||||
| Rank 66Qwen 3.6 Plus11/16 measured · 11 comparable | ||||||||||||||||
| Rank 67Qwen 3.7 Plus9/16 measured · 7 comparable | ||||||||||||||||
| Rank 68MiniMax M314/16 measured · 13 comparable | ||||||||||||||||
| Rank 69mistral large 42/16 measured · 2 comparable | ||||||||||||||||
| Rank 70Claude Sonnet 4.511/16 measured · 10 comparable | ||||||||||||||||
| Rank 71Qwen 3.5 397B-A17B12/16 measured · 6 comparable | ||||||||||||||||
| Rank 72Qwen 3.6 27B12/16 measured · 7 comparable | ||||||||||||||||
| Rank 73GPT 5.4 Nano12/16 measured · 12 comparable | ||||||||||||||||
| Rank 74DeepSeek V4 Flash (2026-04-22)8/16 measured · 4 comparable | ||||||||||||||||
| Rank 75GLM 59/16 measured · 7 comparable | ||||||||||||||||
| Rank 76Gemini 3.5 Flash Lite13/16 measured · 13 comparable | ||||||||||||||||
| Rank 77Qwen 3.6 35B-A3B11/16 measured · 6 comparable | ||||||||||||||||
| Rank 78Claude Opus 4.17/16 measured · 6 comparable | ||||||||||||||||
| Rank 79Gemma 4 31B IT6/16 measured · 2 comparable | ||||||||||||||||
| Rank 80Qwen 3.5 35B-A3B10/16 measured · 5 comparable | ||||||||||||||||
| Rank 81GPT 5.5 Instant5/16 measured · 4 comparable | ||||||||||||||||
| Rank 82Qwen 3.5 9B8/16 measured · 4 comparable | ||||||||||||||||
| Rank 83Qwen 3 32B5/16 measured · 4 comparable | ||||||||||||||||
| Rank 84Qwen 3 14B4/16 measured · 3 comparable | ||||||||||||||||
| 16 models without a directly comparable ECI score | ||||||||||||||||
| No rankMuse wonder4/16 measured · 3 comparable | ||||||||||||||||
| No rankMiMo V2.6 Pro6/16 measured · 6 comparable | ||||||||||||||||
| No rankGLM 5.3 Max1/16 measured · 1 comparable | ||||||||||||||||
| No rankGPT 5.2 Chat Latest (2026-02-10)1/16 measured · 1 comparable | ||||||||||||||||
| No rankMiMo V2.5 Pro10/16 measured · 9 comparable | ||||||||||||||||
| No rankMiMo V2.6 Flash5/16 measured · 5 comparable | ||||||||||||||||
| No rankGrok 4.12/16 measured · 2 comparable | ||||||||||||||||
| No rankHY37/16 measured · 3 comparable | ||||||||||||||||
| No rankstep 5 Preview4/16 measured · 4 comparable | ||||||||||||||||
| No rankQwen 3.5 27B6/16 measured · 1 comparable | ||||||||||||||||
| No rankQwen 3.8 Flash Next7/16 measured · 3 comparable | ||||||||||||||||
| No rankGemma 4 12B IT4/16 measured · 0 comparable | ||||||||||||||||
| No rankGemma 4 26B-A4B IT4/16 measured · 0 comparable | ||||||||||||||||
| No rankQwen 3.8 2.4T-A95B6/16 measured · 3 comparable | ||||||||||||||||
| No rankMuse wonder 1.03/16 measured · 3 comparable | ||||||||||||||||
| No rankGemma 4 31B7/16 measured · 3 comparable | ||||||||||||||||