API cost
- Average per model, all 8 tasks
- $384
- Highest / lowest per task
- GPT-6 Astrasuspected nerf/DeepSeek V4.1 Flash-1017
§ 02Per task
| Task | Opus 5.5 | Sonnet 5.5 | Haiku 5.5 | GPT-6.2 Astra | GPT-6.2 Sol | GPT-6 Astrasuspected nerf | GLM-5.3 | Kimi k3.1 | DeepSeek V4.1 Flash-1017 | MiniMax M3.1 Flash |
|---|---|---|---|---|---|---|---|---|---|---|
| LLaVA | $90.4 | $39.7 | $43.8 | $114 | $22.5 | $187 | $80.8 | $28.9 | $2.58 | $5.89 |
| R3 | $129 | $37.9 | $12.6 | $50.0 | $12.4 | $89.3 | $31.1 | $15.4 | $1.93 | $4.84 |
| 3DGS | $65.4 | $56.5 | $58.8 | $97.4 | $22.3 | $97.5 | $55.2 | $39.6 | $4.06 | $5.47 |
| BAGEL SFT | $48.9 | $46.7 | $20.0 | $45.2 | $8.83 | $78.9 | $39.2 | $18.8 | $2.06 | $4.50 |
| NanoChat | $78.1 | $48.4 | $30.0 | $72.3 | $13.0 | $143 | $58.2 | $24.4 | $2.74 | $6.56 |
| YOCO | $57.6 | $43.8 | $27.4 | $81.4 | $20.8 | $99.7 | $37.2 | $33.5 | $3.16 | $6.03 |
| Slime GRPO | $87.7 | $58.3 | $16.8 | $59.1 | $13.9 | $217 | $61.8 | $14.7 | $1.41 | $5.73 |
| Slime OPD | $86.8 | $75.2 | $12.8 | $54.3 | $16.9 | $245 | $80.6 | $22.4 | $2.06 | $4.92 |
| Total | $644 | $406 | $222 | $573 | $131 | $1158 | $444 | $198 | $20.0 | $43.9 |
| Input tokens | 1931 M | 2494 M | 3704 M | 705 M | 635 M | 776 M | 1550 M | 806 M | 2025 M | 1785 M |
| Cache hit | 99.4% | 99.4% | 99.6% | 97.3% | 97.4% | 97.4% | 99.6% | 99.0% | 99.6% | 96.9% |
| Output tokens | 8.0 M | 9.8 M | 10 M | 3.7 M | 3.6 M | 3.4 M | 7.6 M | 2.2 M | 4.7 M | 16 M |
| All runs | $149121 runs | $81015 runs | $35316 runs | $5738 runs | $1318 runs | $184716 runs | $78914 runs | $34714 runs | $35.314 runs | $83.915 runs |
§ 03Prices, USD per 1M tokens
| Model | Input | Cache hit | Cache write (short / long TTL) | Output | Source |
|---|---|---|---|---|---|
| Claude Opus 5.5 | $4 | $0.20 | $5 / $8 | $20 | Anthropic |
| Claude Sonnet 5.5 | $2 | $0.10 | $2.50 / $4 | $10 | Anthropic |
| Claude Haiku 5.5 | $0.10 (>100K: $0.50) | $0.01 ($0.05) | $0.125 / $0.20 ($0.625 / $1) | $0.50 ($2.50) | Anthropic two tiers by prompt length |
| GPT-6.2 Astra | $8 (>272K: $16) | $0.40 ($0.80) | $10 / — | $40 ($60) | OpenAI |
| GPT-6.2 Sol | $2 (>272K: $4) | $0.10 ($0.20) | $2.50 / — | $10 ($15) | OpenAI |
| GPT-6 Astrasuspected nerf | $10 (>272K: $20) | $1 ($2) | $12.50 / — | $50 ($75) | OpenAI |
| GLM-5.3 | $1.40 | $0.26 | not charged | $4.40 | Z.ai |
| Kimi k3.1-pro | $2 | $0.20 | $2 / $4 | $10 | Kimi |
| DeepSeek V4.1 Flash-1017 | $0.30 | $0.006 | — | $1.20 | DeepSeek peak-hour price |
| MiniMax M3.1 Flash | $0.15 | $0.015 | — | $0.60 | MiniMax |