官方博客：Introducing Inkling-Small - Thinking Machines Lab
评分指标:
| Open weights | Closed weights | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Inkling-Small | Qwen3.5397B-A17B | MiMo V2.5 | Minimax M2.7 | DeepSeek V4Flash | Nemotron 3Ultra | Inkling | Claude 4.5Haiku | Gemini 3.5Flash-Lite | GPT 5.6Luna | |
| Model Info | ||||||||||
| AA Indexv4.1 | 40.0% | 34.0% | 37.0% | 38.0% | 40.0% | 38.0% | 41.0% | 30.0% | 36.0% | 49.0% |
| Params (B)activated / total | 12 / 276 | 17 / 397 | 15 / 310 | 10 / 230 | 13 / 284 | 55 / 550 | 41 / 975 | – | – | – |
| Agentic (coding) | ||||||||||
| SWEBench Verified* | 80.2% | 76.4% | 71.0% | 79.9% | 79.0% | 70.7% | 77.6% | 73.3% | 75.0% | 93.0% |
| SWEBench Propublic | 55.9% | 50.9% | 56.1% | 56.2% | 52.6% | 46.4% | 54.3% | 39.5% | 54.2% | 62.7% |
| Terminal Bench 2.1*best harness | 64.7% | 51.3% | 63.7% | 55.4% | 61.8% | 56.4% | 63.8% | 44.2% | 54.0% | 82.5% |
| SciCode | 48.7% | 42.0% | 43.1% | 47.0% | 44.9% | 39.9% | 46.1% | 43.3% | 40.9% | 50.0% |
| Agentic (general) | ||||||||||
| GDPval-AA v2 | 1269 | 962 | 1145 | 1159 | 1189 | 1164 | 1238 | 911 | 1139 | 1530 |
| MCP Atlaspublic / all | 79.6/79.2% | 74.2%/– | – | 49.4%/– | 69.0%/– | 47.4/44.7% | 78.8/76.0% | 41.2/40.2% | 79.8/76.8% | 77.0/75.0% |
| Tau 3 Banking | 15.5% | 13.4% | 6.6% | 8.9% | 22.9% | 13.8% | 23.7% | 9.1% | 16.5% | 24.3% |
| BrowseCompwith context management | 77.4% | 78.6% | – | 76.3% | 73.2% | 63.0% | 77.1% | – | – | 84.0% |
| Toolathlon Verified | 54.4% | 40.7% | 49.1% | 47.5% | 50.9% | 34.3% | 45.5% | 26.9% | 57.1% | 67.9% |
| AA-Briefcase | 917 | – | – | – | 833 | 870 | 839 | 612 | – | – |
| Reasoning (general) | ||||||||||
| GPQA Diamond | 89.5% | 89.3% | 84.9% | 87.4% | 89.4% | 86.7% | 87.2% | 67.2% | 83.8% | 89.5% |
| HLEtext only | 31.6% | 27.3% | 25.2% | 28.1% | 32.1% | 26.6% | 29.7% | 9.7% | 17.5% | 35.6% |
| HLE†with tools | 47.8% | 48.3% | 40.0% | 40.3% | 45.1% | 37.4% | 46.0% | 17.8% | 42.5% | 48.9% |
| AIME 2026 | 95.5% | 93.3% | 93.6% | 87.7% | 95.8% | 94.2% | 97.1% | 85.1% | 82.2% | 97.6% |
| HMMT Feb 2026 | 90.2% | 87.9% | 82.6% | 71.2% | 93.9% | 78.8% | 86.3% | 66.7% | 63.6% | 98.5% |
| CritPt | 8.3% | 1.7% | 3.7% | 0.6% | 7.1% | 3.1% | 5.4% | 0.0% | 0.0% | 20.6% |
| Reasoning (abstract) | ||||||||||
| ARC-AGI-1 | 84.0% | – | – | – | – | – | 79.5% | 47.7% | – | 87.7% |
| ARC-AGI-2 | 40.1% | – | – | – | – | – | 36.5% | 4.0% | – | 47.6% |
| Factuality | ||||||||||
| SimpleQA Verified | 20.6% | 26.0% | 16.1% | 13.5% | 34.1% | 32.4% | 43.9% | 5.9% | 44.1% | 41.7% |
| AA Omniscienceindex | -9.0 | -29.8 | -9.3 | 0.7 | -22.9 | -1.0 | 2.1 | -4.2 | 6.9 | -11.6 |
| Chat | ||||||||||
| IFBench | 82.2% | 78.8% | 67.1% | 75.7% | 79.2% | 81.4% | 79.8% | 54.3% | 78.6% | 67.3% |
| Global-MMLU-Lite | 86.7% | 90.0% | 83.5% | 83.9% | 88.4% | 85.6% | 88.7% | 83.4% | 89.4% | 88.7% |
| Safety | ||||||||||
| StrongREJECT | 98.4% | 99.4% | 99.3% | 99.4% | 97.4% | 98.7% | 98.6% | 98.6% | 97.6% | 98.7% |
| FORTRESSadversarial | 71.6% | 77.3% | 64.8% | 86.3% | 32.0% | 77.6% | 78.0% | 91.3% | 70.7% | 83.8% |
| FORTRESSbenign | 96.9% | 95.4% | 94.6% | 90.1% | 99.2% | 90.6% | 95.9% | 94.1% | 95.5% | 97.8% |
| Vision | ||||||||||
| MMMU ProStandard 10 | 74.0% | 77.3% | 75.4% | – | – | – | 73.5% | 58.6% | 79.0% | 78.6% |
| Charxiv RQoriginal / with python | 77.4/81.3% | 80.8%/– | 81.0%/– | – | – | – | 78.1/82.0% | 57.4%/– | 70.0%/– | 81.4%/– |
| Audio | ||||||||||
| Audio MC† | 54.9% | – | 30.4% | – | – | – | 56.6% | – | 33.6% | – |
| MMAU | 77.0% | – | 73.6% | – | – | – | 77.2% | – | 75.2% | – |
| VoiceBench† | 90.1% | – | 86.4% | – | – | – | 91.4% | – | 85.9% | – |
个人碎碎念：
感觉国模的优势越来越小了
美国开源也在追赶，OAI还大降价，算力充沛的优势还是很明显的
