# Source-Audit Verifies 39 OpenCode GO Models

**October 10, 2026** — The OpenCode GO benchmark matrix can now be rebuilt on primary evidence: across **39 models** (the 33 rows in the user's sheet plus 6 GO models that were missing from it), every trackable score, price and availability datum has been traced to a named source with a date. The headline structural finding is that **7 sheet rows are no longer in the 32-model GO lineup** (GPT-6 Astra, GPT-6 Sol, Gemini 3.8 Flash — all three Zen pay-per-use only — plus Qwen3.7 Max, Qwen3.6 Plus, GLM-5.1 and Union Alpha Free), while **6 GO models were absent from the sheet** and are documented here: Grok 4.7, Claude Haiku 5.5, GPT 6 Luna, Space Bunny, LongCat 2.5 Preview Free and Step 5 Preview Free ([opencode.ai/docs/go](https://opencode.ai/docs/go), page last updated 2026-10-10). The second key finding is that vendor and independent harnesses **systematically disagree on Terminal-Bench 2.1** — for example MiMo-V2.6-Pro is 89.9 vendor vs 67.79 Vals AI (Terminus 2), and GLM-5.3 is 88.2 vendor vs 71.5 Vals — so this report selects Vals AI's uniform Terminus 2 runs wherever they exist and records every vendor number as an alternative, exactly as the policy below requires. Coverage is complete except for a short, enumerated list of gaps: Claude Haiku 5.5, Space Bunny and LongCat 2.5 Preview Free have **no scores on the five tracked benchmarks**, and a handful of other model/benchmark cells are genuinely unpublished. This report is the evidence base for updating the spreadsheet's "selected value" column: it contains the selected value per policy, the full alternative/conflict record, GO pricing and availability as of 2026-10-10, and the source URL and date for every number.

## Methodology and the selected-value policy

**Benchmark definitions.** *DeepSWE* is Datacurve's long-horizon software-engineering benchmark; the public **v1.1** leaderboard (113 tasks, 91 repos, 5 languages, updated 2026-09-22) runs every entry on the uniform **mini-swe-agent** harness at [deepswe.datacurve.ai](https://deepswe.datacurve.ai). *Terminal-Bench 2.1* is a terminal-agent benchmark; because [tbench.ai](https://www.tbench.ai/leaderboard) now fronts Terminal-Bench **4.0** and its 2.1 table is not readable as a static page, **Vals AI's archived Terminus 2 leaderboard** (the official harness; archived 2026-09-27, last updated 2026-09-28) is used as the uniform independent comparator. *SciCode*, *AA-LCR* (AA Long Context Reasoning v1.1: 100 questions over 10k–100k-token long-form documents, LLM-judged pass/fail) and *GPQA Diamond* are **Artificial Analysis** evaluations; where AA charts are client-rendered and unreadable, values were retrieved from AA leaderboards via BenchLM.ai's citation tables and are attributed as such.

**Selected-value policy.** For each model and benchmark, the report selects, in order: (1) the **uniform independent source** — Datacurve for DeepSWE, Vals AI (Terminus 2) for Terminal-Bench 2.1, Artificial Analysis for SciCode/AA-LCR/GPQA, with **Epoch AI accepted for GPQA Diamond where AA is absent**; (2) else the **vendor's official reported number**; (3) else **another independent aggregator** (BenchLM, evals.report, Mercor snapshot, Atlas, etc.). Every alternative and conflict is recorded in the last column of each table with its own value, source type and date, so any discrepancy can be audited. "**not found**" means no credible evidence was located as of 2026-10-10 — nothing is estimated. Two boundary rules apply throughout: **vendor-reported TB 2.1 values and independent Terminus 2 values differ systematically (harness difference) and must not be compared across that boundary**; and benchmark-version labels (TB 2.0/3.0/4.0 vs 2.1; DeepSWE v1 vs v1.1) are preserved on every number that carries one. Pricing and lineup data are taken from [opencode.ai/docs/go](https://opencode.ai/docs/go) ("Last updated: Oct 10, 2026"); AA's SciCode is marked *under review* after a dataset audit ([arXiv:2608.04975](https://arxiv.org/abs/2608.04975)), so all SciCode values may be revised.

## Roster changes vs the user's sheet

**(a) In the sheet but not in the 2026-10-10 GO lineup (7 models).** **GPT-6 Astra**, **GPT-6 Sol** and **Gemini 3.8 Flash** are absent from the GO model list but are available **pay-per-use on OpenCode Zen** at $10/$50/$1.00, $2/$10/$0.20 and $1.50/$7.50/$0.15 per 1M respectively ([opencode.ai/docs/go](https://opencode.ai/docs/go); [opencode.ai/docs/zen](https://opencode.ai/docs/zen), 2026-10-10). **Qwen3.7 Max** and **Qwen3.6 Plus** appear in neither the GO model list, endpoint table nor privacy table ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10). **GLM-5.1** is likewise not in the lineup; Z.ai's list price was $1.40/$4.40 per 1M ([morphllm.com/glm-5-1](https://www.morphllm.com/glm-5-1), 2026-07-17). **Union Alpha Free** was not a normal model at all: it was a limited-time free stealth listing (OpenRouter `stealth/union-alpha`, OpenCode Zen "Union Alpha Free") created 2026-09-16, **revealed one day later as Pareto 26.9** — the blended multi-model system by **Circuit & Chisel, sold via Unbiased** — and removed after a ~32-hour free preview; it does not correspond to a single set of weights and is out of the lineup ([progressive robot](https://www.progressiverobot.com/2026/09/16/union-alpha-stealth-coding-model-free-opencode-openrouter), 2026-09-16; [GizChina.it](https://en.gizchina.it/2026/09/union-alpha-pareto-26-9-cosa-sapere), 2026-09-18; [circuitandchisel.com](https://circuitandchisel.com/), 2026-09-17).

**(b) In the current GO lineup but missing from the sheet, researched here (6 models).** **Grok 4.7** (xAI, 2026-09-21), **Claude Haiku 5.5** (Anthropic, 2026-10-07), **GPT 6 Luna** (OpenAI, 2026-09-22), **Space Bunny** (anonymous stealth, listed on GO since 2026-09-23), **LongCat 2.5 Preview Free** (Meituan, 2026-09-25) and **Step 5 Preview Free** (StepFun, 2026-09-20) — full evidence below.

## Master matrix (selected values only, per policy)

Legend: **D** = Datacurve DeepSWE | **V** = Vals AI Terminus 2 TB 2.1 | **AA** = Artificial Analysis | **E** = Epoch AI (GPQA only) | **v** = vendor | **agg** = other independent aggregator | **nf** = not found | GO price = input/output/cached-read per 1M tokens (DeepSeek: off-peak).

| Model | GO status | GO price (in/out/cache) | DeepSWE | TB 2.1 | SciCode | AA-LCR | GPQA-D |
|---|---|---|---|---|---|---|---|
| DeepSeek V4.1 Flash | In ($60) | 0.15/0.60/0.003 | 74.2 v | 74.5 V | 51.9 AA | 84.0 AA | 90.9 v |
| DeepSeek V4 Pro | In ($15) | 0.66/1.98/0.022 | 63 D | 54.7 V | 51.0 AA | 80.3 AA | 92.8 AA |
| DeepSeek V4 Flash | In ($30) | 0.15/0.60/0.003 | 53 D | 67.0 V | 50.3 AA | 79.7 AA | 90.8 AA |
| DeepSeek V4 Flash Vision Exp | In ($15) | 0.15/0.60/0.003 | 59.3 v | 83.9 v | nf | nf | nf |
| MiMo-V2.6-Pro | In ($15) | 0.435/0.87/0.003625 | 71.9 v | 67.79 V | 60.9 AA | 86.3 AA | nf |
| MiMo-V2.6-Flash | In ($60) | 0.14/0.28/0.0028 | 67.9 v | 76.40 V | 51.3 AA | 74.3 AA | nf |
| MiMo-V2.5-Pro | In ($15) | 0.435/0.87/0.003625 | 19±2 D (v1) | 57.30 V | 50.6 AA | 79.7 AA | 86.6 AA |
| MiMo-V2.5 | In ($60) | 0.14/0.28/0.0028 | nf | 60.67 V | 44 AA | 73 AA | 81.6 V |
| Kimi K3 | In ($15) | 3.00/15.00/0.30 | 69 D | 80.9 V | 59.5 AA | 88.7 AA | 93.5 AA |
| Kimi K2.7 Code | In ($60) | 0.95/4.00/0.19 | 30.5 agg (D mirror) | 67.0 V | 47.8 AA | 79.3 AA | 89.6 AA |
| Kimi K2.6 | In ($60) | 0.95/4.00/0.16 | 23.89 agg (v1) | 53.6 V | 51.5 AA | 81.0 AA | 91.1 AA |
| GLM-5.3 | In ($15) | 1.40/4.40/0.26 | 69 D | 71.5 V | 59.0 AA | 79.7 AA | 91.7 AA |
| GLM-5.3-Flash | In ($60) | 0.15/0.50/0.03 | 63 D | 62.9 V | 51.6 AA | 80.0 AA | 91.2 AA |
| GLM-5.2 | In ($60) | 1.40/4.40/0.26 | 44 D | 67.8 V | 51.2 AA | 78.3 AA | 89.5 AA |
| GLM-5.1 | Out | (Z.ai list 1.40/4.40) | 18.90 agg (v1.1) | 56.9 V | 44.8 AA | 73.7 AA | 86.8 AA |
| Qwen3.8 Max | In ($15) | 2.00/6.00/0.25 | 57.5 D | 67.4 V | 52 AA | 80 AA | 92.6 v |
| Qwen3.8 Flash | In ($30) | 0.15/0.47/0.016 | 58.7 v | 86.1 agg | 50.6 AA | 79.7 AA | 92.3 AA |
| Qwen3.7 Plus | In ($60) | 0.40/1.60/0.04 | 16.5 v | 52.81 V | 46.1 AA | 73.0 AA | 90.0 AA |
| Qwen3.7 Max | Out | (Vals 2.50/7.50) | 21.6 v | 61.05 V | 49.5 AA | 79.0 AA | 92.3 AA |
| Qwen3.6 Plus | Out | (0.50/3.00/0.05) | 2.65 agg (v1) | 53.18 V | nf | 78.3 AA | 88.2 AA |
| GPT-6 Astra | Zen only | (Zen 10/50/1.00) | 74±3 D | 87.27 V | 56.5 AA | 80.7 AA | 96.1 AA |
| GPT-6 Sol | Zen only | (Zen 2/10/0.20) | 68.8 v | 83.15 V | 57.6 AA | 83.7 AA | 94.3 E |
| GPT-6 Luna | In ($15) | 0.10/0.50/0.01 | 66.6 v | 73.03 V | 54.6 AA | 83.3 AA | 90.5 E |
| GPT-5.6 Luna | In ($15) | 0.20/1.20/0.02 | 67±4 D | 79.03 V | 53.6 AA | 83.7 AA | 91.1 AA |
| Claude Haiku 5.5 | In ($15) | 0.10/0.50/0.01 | nf | nf | 55.0 AA | 82.7 AA | nf |
| Gemini 3.8 Flash | Zen only | (Zen 1.50/7.50/0.15) | 74±1 D | 81.27 V | 56.6 AA | 81.3 AA | 95.3 AA |
| Grok 4.6 | In ($15) | 2.00/6.00/0.50 | 67±2 D | 78.28 V | 56.5 AA | 80.3 AA | 94.9 AA |
| Grok 4.7 | In ($15) | 2.00/6.00/0.50 | 71.0 v | 73.41 V | 57.4 AA | 76.7 AA | 92.7 E |
| MiniMax M3 | In ($60) | 0.30/1.20/0.06 | 13.3 agg (unofficial) | 53.56 V | 47.1 AA | 83.0 AA | 92.9 AA |
| MiniMax M2.7 | In ($60) | 0.30/1.20/0.06 | nf | 48.69 V | 50.1 AA | 78.3 AA | 87.4 AA |
| Hy3 | In ($60) | 0.14/0.58/0.035 | 28.0 v (internal) | 71.7 v | 48.6 AA | 79.0 AA | 89.7 AA |
| Hy4 preview | In ($30) | 0.834/2.501/0.042 | 64.3 v (internal) | 85.4 v | nf | nf | 92.3 v |
| LongCat-2.0 | In ($60) | 0.30/1.20/0.006 | nf | 50.19 V | 36.3 AA | 65.0 AA | 78.0 AA |
| LongCat 2.5 Preview Free | In (free) | Free/Free/Free | nf | nf | nf | nf | nf |
| Step 5 Preview Free | In (free) | Free/Free/Free | 67.7 v | 85.0 v | 58.9 AA | 88.3 AA | 93.5 v |
| Space Bunny | In ($30) | 0.15/0.60/0.03 | nf | nf | nf | nf | nf |
| Union Alpha Free | Out | (free preview; over) | 70.0 v (v1.1) | nf | nf | nf | nf |
| Muse Spark 1.3 Contributor | In ($60) | 0.10/0.20/0.002 | 75.4 v | 72.3 V | 58.8 AA | 83.0 AA | 93.5 AA |
| Muse Spark 1.2 Contributor | In ($60) | 0.10/0.20/0.002 | 55.0±2 D | 69.7 V | 57.4 AA | 79.0 AA | 90.4 AA |

## Per-model evidence

### DeepSeek — four GO slots, two of them retired upstream

Cross-cutting facts: all four DeepSeek models are listed in the current GO lineup; GO token prices match DeepSeek's official API prices (peak hours 01:00–04:00 and 06:00–10:00 UTC Mon–Fri; all other hours off-peak at half the peak rate); privacy "Not used" for training, 0-day retention under a ZDR agreement valid through 2026-10-31 ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10; [api-docs.deepseek.com/quick_start/pricing](https://api-docs.deepseek.com/quick_start/pricing/), accessed 2026-10-10). DeepSeek Harness is listed as a "Known Problematic Client" (session headers incomplete).

#### DeepSeek V4.1 Flash
**Identity:** DeepSeek; released **2026-09-10**; announcement [api-docs.deepseek.com/news/news260910](https://api-docs.deepseek.com/news/news260910). 552B-parameter MoE (8B active input / 16B output), 1M context, native multimodal, MIT; API name `deepseek-flash`; [HF model card](https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash).
**GO status & pricing:** In lineup (`deepseek-v4.1-flash`), monthly limit **$60**; off-peak **$0.15 / $0.60 / $0.003**, peak **$0.30 / $1.20 / $0.006** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 74.2 | vendor | https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash | 2026-09-10 | v1.1 Resolved, max effort; harness table: DSH Minimal 72.6, DSH Standard 70.5, DSH PTC 67.6, Pi 66.2, Claude Code 69.8, Codex 65.6, OpenCode 65.5. Not on the Datacurve leaderboard (2026-09-22) — vendor-only; 74.2 would top the published board if reproduced |
| Terminal-Bench 2.1 | 74.5 | independent (Vals AI) | https://www.vals.ai/models/deepseek_deepseek-v4.1-flash | 2026-10-10 (retrieved via BenchLM) | Vendor 90.6 (DSH Minimal, N=3/task, no network; [HF card](https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash), 2026-09-10); vendor harness table: mini-SWE 90.3, Claude Code 88.0, Pi 86.1, DSH Std/PTC 85.8, OpenCode 85.0, Codex 84.1; BenchLM mirror #3 90.6 (provider-reported). Version-labeled extras: TB 3.0 = 30.0, TB 4.0 = 31.2 vendor; TB 4.0 = 26.8 AA |
| SciCode | 51.9 | independent (AA) | https://artificialanalysis.ai/evaluations/scicode | 2026-10-10 (retrieved via BenchLM) | No vendor score. AA SciCode "under review" after dataset audit |
| AA-LCR | 84.0 | independent (AA) | https://artificialanalysis.ai/evaluations/artificial-analysis-long-context-reasoning | 2026-10-10 (retrieved via BenchLM) | No vendor score |
| GPQA Diamond | 90.9 | vendor | https://api-docs.deepseek.com/updates/ | 2026-09-10 | No AA or Epoch value found; mirrored on HF eval-results at 90.9; Pass@1 max effort |

#### DeepSeek V4 Pro
**Identity:** DeepSeek; V4 preview 2026-04-24, **GA 2026-08-13** (`DeepSeek-V4-Pro-0813`); announcement [api-docs.deepseek.com/news/news260813](https://api-docs.deepseek.com/news/news260813). 1.6T MoE / 49B active, 1M context, text-only, MIT.
**GO status & pricing:** In lineup (`deepseek-v4-pro`), monthly limit **$15**; off-peak **$0.66 / $1.98 / $0.022**, peak **$1.32 / $3.96 / $0.044** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10). Caveat: phase-out announced 2026-09-10, then reversed the same day (see Key caveats).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 63 ±6 | independent (Datacurve) | https://deepswe.datacurve.ai | 2026-09-22 | v1.1 Pass@1 `deepseek-v4-pro [max]`, mini-swe-agent, $1.67/task; vendor 62.7 (DSH minimal, GA entry, 2026-08-13); a low-credibility Reddit "8%" claim refers to a different setting (recorded, not used) |
| Terminal-Bench 2.1 | 54.7 | independent (Vals AI) | https://www.vals.ai/models/deepseek_deepseek-v4-pro-0813 | 2026-10-10 (retrieved via BenchLM) | Vendor 87.9 (Pass@1, harness not stated in the GA entry; [API changelog](https://api-docs.deepseek.com/updates/), 2026-08-13); BenchLM mirror #10 87.9 (provider-reported); TB 2.0 = 67.9 (technical report, different version) |
| SciCode | 51.0 | independent (AA) | https://artificialanalysis.ai/evaluations/scicode | 2026-10-10 (retrieved via BenchLM) | No vendor score; AA "under review" caveat |
| AA-LCR | 80.3 | independent (AA) | https://artificialanalysis.ai/evaluations/artificial-analysis-long-context-reasoning | 2026-10-10 (retrieved via BenchLM) | No vendor score |
| GPQA Diamond | 92.8 | independent (AA) | https://artificialanalysis.ai/models/deepseek-v4-pro | 2026-10-10 (retrieved via BenchLM) | Vendor/Vals 92.4 (GA-era model-card table, max effort, 2026-09-10; Vals independently reports 92.4); technical report 90.1 (earlier checkpoint); three-way conflict 90.1 / 92.4 / 92.8 |

#### DeepSeek V4 Flash
**Identity:** DeepSeek; last checkpoint **DeepSeek-V4-Flash-0731**, public beta 2026-07-31; [change log](https://api-docs.deepseek.com/updates/) (entry 2026-07-31). 284B MoE / 13B active, 1M context, text-only, MIT. **Retired 2026-09-10** — legacy name `deepseek-v4-flash` routes to V4.1 Flash on DeepSeek's API.
**GO status & pricing:** Still listed (`deepseek-v4-flash`), monthly limit **$30**; off-peak **$0.15 / $0.60 / $0.003**, peak **$0.30 / $1.20 / $0.006** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10). What is actually served under this GO entry is not stated in the GO docs (see Key caveats).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 53 ±4 | independent (Datacurve) | https://deepswe.datacurve.ai | 2026-09-22 | v1.1 `deepseek-v4-flash [max]`, mini-swe-agent, $0.46/task; vendor 54.4 (DSH minimal, 0731 entry, 2026-07-31); leaderboard does not print the checkpoint date |
| Terminal-Bench 2.1 | 67.0 | independent (Vals AI) | https://www.vals.ai/models/deepseek_deepseek-v4-flash-0731 | 2026-10-10 (retrieved via BenchLM) | Vendor 82.7 (DSH minimal, max effort, temp 1.0/top_p 0.95; [change log](https://api-docs.deepseek.com/updates/), 2026-07-31); BenchLM mirror #23 82.7; TB 2.0 = 56.9 (technical report, different version) |
| SciCode | 50.3 | independent (AA) | https://artificialanalysis.ai/evaluations/scicode | 2026-10-10 (retrieved via BenchLM) | No vendor score; AA "under review" caveat |
| AA-LCR | 79.7 | independent (AA) | https://artificialanalysis.ai/evaluations/artificial-analysis-long-context-reasoning | 2026-10-10 (retrieved via BenchLM) | No vendor score |
| GPQA Diamond | 90.8 | independent (AA) | https://artificialanalysis.ai/models/deepseek-v4-flash | 2026-10-10 (retrieved via BenchLM) | Vendor and Vals 89.9 (GA-era table / Vals page); technical report 88.1 (original V4 checkpoint); conflict 88.1 / 89.9 / 90.8 |

#### DeepSeek V4 Flash Vision Exp
**Identity:** DeepSeek; released **2026-08-21**; announcement [api-docs.deepseek.com/news/news260821](https://api-docs.deepseek.com/news/news260821). Experimental multimodal V4 model; images billed as input tokens at Flash pricing. **Retired 2026-09-10** (legacy name routes to V4.1 Flash).
**GO status & pricing:** Still listed (`deepseek-v4-flash-vision-exp`), monthly limit **$15**; off-peak **$0.15 / $0.60 / $0.003**, peak **$0.30 / $1.20 / $0.006** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 59.3 | vendor | https://api-docs.deepseek.com/updates/ | 2026-08-21 | Benchmark version not stated in the announcement (likely v1.1 era); DSH minimal, max effort; no independent confirmation found (not on Datacurve 2026-09-22, no Vals entry) |
| Terminal-Bench 2.1 | 83.9 | vendor | https://api-docs.deepseek.com/updates/ | 2026-08-21 | DSH minimal, max effort; not on BenchLM's TB 2.1 mirror or at Vals AI — vendor-only |
| SciCode | not found | n/a | https://artificialanalysis.ai/evaluations/scicode (checked; no row) | 2026-10-10 | No vendor or independent score found |
| AA-LCR | not found | n/a | https://artificialanalysis.ai/evaluations/artificial-analysis-long-context-reasoning (checked; no row) | 2026-10-10 | No score found |
| GPQA Diamond | not found | n/a | https://artificialanalysis.ai/evaluations/gpqa-diamond (checked; no row) | 2026-10-10 | No score found; vendor only claims text parity with V4 Flash (not a GPQA number) |

### Xiaomi MiMo — two generations, GPQA only on V2.5

#### MiMo-V2.6-Pro
**Identity:** Xiaomi (Xiaomi MiMo team); released **2026-09-22** per Xiaomi's update log (AA/Vals list 2026-09-21); [launch news](https://mimo.mi.com/docs/en-US/news/latest/v2-6). 1.02T MoE / 42B active, 1M context, omnimodal, MIT; [HF card](https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Pro-RL), tech report [arXiv:2610.11959](https://arxiv.org/html/2610.11959).
**GO status & pricing:** In lineup (`mimo-v2.6-pro`), monthly limit **$15**; **$0.435 / $0.87 / $0.003625** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10) — equals Xiaomi's API list price.

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 71.9 | vendor (Datacurve gated dataset card / Benchgen mirror cite the same 71.9) | https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Pro-RL | 2026-09-22 | v1.1; harness not specified in the vendor table; not displayed on the live Datacurve top-21 view (fetched 2026-10-10) but listed on Datacurve's gated HF dataset card and [Benchgen](https://benchgen.com/benchmarks/datacurve/deepswe) (rank 5); RL ablation "average@3" 58.4→72.6 is a different metric |
| Terminal-Bench 2.1 | 67.79 | independent (Vals AI) | https://www.vals.ai/benchmarks/terminal-bench-2-1 | 2026-09-28 | Vendor 89.9 (harness unstated); Terminus 2 run: reasoning on, temp 1.0, $0.07/test, 15m39s, rank 34/76; BenchmarkList mirrors vendor 89.9; TB 4.0 (context): 34.9 vendor / 31.31 Vals / 34.8 AA |
| SciCode | 60.9 | independent (AA) | https://benchlm.ai/models/mimo-v2-6-pro | 2026-10-10 | AA run; AA view rounds to 61%; BenchmarkList 60.9 (2026-10-03); BenchLeader 60.9 |
| AA-LCR | 86.3 | independent (AA) | https://benchlm.ai/models/mimo-v2-6-pro | 2026-10-10 | AA-LCR v1.1; AA comparison view shows 86% rounded |
| GPQA Diamond | not found | n/a | https://artificialanalysis.ai/models/mimo-v2-6-pro (checked; no row) | 2026-10-10 | No vendor or AA GPQA; AA index v4.3.2 does not include GPQA; community quant card 56.2% on 64 items with 8K budget is explicitly not comparable — excluded |

#### MiMo-V2.6-Flash
**Identity:** Xiaomi; released **2026-09-22** (AA/Vals 2026-09-21); [launch news](https://mimo.mi.com/docs/en-US/news/latest/v2-6). 310B MoE / 15B active, 1M context, MIT; [HF card](https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Flash-RL).
**GO status & pricing:** In lineup (`mimo-v2.6-flash`), monthly limit **$60**; **$0.14 / $0.28 / $0.0028** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 67.9 | vendor (Datacurve gated dataset card cites the same) | https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Flash-RL | 2026-09-22 | v1.1; harness not specified; [Benchgen](https://benchgen.com/benchmarks/datacurve/deepswe) rank 8 |
| Terminal-Bench 2.1 | 76.40 | independent (Vals AI) | https://www.vals.ai/benchmarks/terminal-bench-2-1 | 2026-09-28 | Vendor 87.6 (harness unstated); Terminus 2 $0.02/test, 13m30s, rank 17/76; Vals notes Flash beats Pro on TB 2.1 (76.40 vs 67.79); TB 4.0 context: 28.8 vendor / 22.73 AA |
| SciCode | 51.3 | independent (AA) | https://benchlm.ai/models/mimo-v2-6-flash | 2026-10-10 | AA run; AI IQ 51.2731; BenchmarkList 51.3 (2026-10-03) |
| AA-LCR | 74.3 | independent (AA) | https://benchlm.ai/models/mimo-v2-6-flash | 2026-10-10 | AA-LCR v1.1; AI IQ 74.3333 |
| GPQA Diamond | not found | n/a | https://artificialanalysis.ai/models/mimo-v2-6-flash (checked; no row) | 2026-10-10 | No vendor or AA GPQA; tech report has no classic academic table |

#### MiMo-V2.5-Pro
**Identity:** Xiaomi; public beta **2026-04-23** (blog dated 2026-04-27; AA lists 2026-04-22); [HF card](https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro), [blog](https://mimo.xiaomi.com/mimo-v2-5-pro). 1.02T MoE / 42B active, 1M context, text-only, MIT. AA now marks it deprecated.
**GO status & pricing:** In lineup (`mimo-v2.5-pro`), monthly limit **$15**; **$0.435 / $0.87 / $0.003625** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 19 ±2 (v1 board) | independent (Datacurve blog snapshot) | https://deepswe.datacurve.ai/blog/deepswe | 2026-05-26 | mini-swe-agent at publication; vendor v1.1 table value 19.0 ([v2.6 tech report table](https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Pro-RL), 2026-09-22); consistent scale across v1/v1.1 |
| Terminal-Bench 2.1 | 57.30 | independent (Vals AI) | https://www.vals.ai/benchmarks/terminal-bench-2-1 | 2026-09-28 | Vendor 65.2 (harness unstated); Terminus 2 $0.04/test, 14m26s, rank 47/76; Vals notes plain MiMo-V2.5 (60.67) beat V2.5-Pro; TB 2.0 = 68.4 vendor (different version) |
| SciCode | 50.6 | independent (AA) | https://benchlm.ai/models/mimo-v2-5-pro | 2026-10-10 | AA (comparison view rounds to 51%; aggregators list 50.58) |
| AA-LCR | 79.7 | independent (AA) | https://benchlm.ai/models/mimo-v2-5-pro | 2026-10-10 | AA (view shows 80%; aggregators list 79.67) |
| GPQA Diamond | 86.6 | independent (AA, legacy eval) | https://benchlm.ai/models/mimo-v2-5-pro | 2026-10-10 | Vals 82.6; AA's current index v4.3.2 no longer includes GPQA (legacy value); Base (pretrained) checkpoint 66.7 not comparable |

#### MiMo-V2.5
**Identity:** Xiaomi; public beta **2026-04-23** (blog dated 2026-04-22); [HF card](https://huggingface.co/XiaomiMiMo/MiMo-V2.5). 310B MoE / 15B active, 1M context, omnimodal, MIT.
**GO status & pricing:** In lineup (`mimo-v2.5`), monthly limit **$60**; **$0.14 / $0.28 / $0.0028** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | not found | n/a | https://deepswe.datacurve.ai and [BenchLM](https://benchlm.ai/models/mimo-v2-5) (checked; no row) | 2026-10-10 | No DeepSWE from vendor, Datacurve or mirrors; the "19.0" circulating for MiMo-V2.5 actually belongs to MiMo-V2.5-Pro (v2.6 tech-report table) — do not reuse |
| Terminal-Bench 2.1 | 60.67 | independent (Vals AI) | https://www.vals.ai/benchmarks/terminal-bench-2-1 | 2026-09-28 | Terminus 2, $0.02/test, 12m55s, rank 40/76; BenchLM mirrors 60.7; vendor TB **2.0** = 65.8 (different version) |
| SciCode | 44 | independent (AA) | https://artificialanalysis.ai/models/comparisons/mimo-v2-5-pro-vs-mimo-v2-5-0424 | 2026-10-10 | Rounded integer on AA comparison view |
| AA-LCR | 73 | independent (AA) | https://artificialanalysis.ai/models/comparisons/mimo-v2-5-pro-vs-mimo-v2-5-0424 | 2026-10-10 | Rounded integer on AA comparison view |
| GPQA Diamond | 81.6 | independent (Vals AI) | https://www.vals.ai/models/xiaomi_mimo-v2.5 | 2026-10-10 | AA has no current GPQA (index excludes it); vendor Base checkpoint 58.1 not comparable |

### Moonshot Kimi — the K-series on the live Datacurve board

#### Kimi K3
**Identity:** Moonshot AI; released **2026-07-16**; [launch blog](https://www.kimi.com/blog/kimi-k3). 2.8T MoE / 104B active, 1M context, native vision, "Kimi K3 License"; [HF weights](https://huggingface.co/moonshotai/Kimi-K3).
**GO status & pricing:** In lineup (`kimi-k3`), monthly limit **$15**; **$3.00 / $15.00 / $0.30** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 69 ±5 | independent (Datacurve) | https://deepswe.datacurve.ai | 2026-09-22 | v1.1, mini-swe-agent [max], $4.65/task; vendor 67.5 (launch blog); BenchLM mirror 68.5 (2026-09-01) |
| Terminal-Bench 2.1 | 80.9 | independent (Vals AI) | https://www.vals.ai/models/kimi_kimi-k3 | 2026-10-10 | Vendor 88.3 (harness not detailed); AA 85 (aaTerminalBench21); BenchLM mirror #7 88.3 (provider-reported) |
| SciCode | 59.5 | independent (AA) | https://artificialanalysis.ai/evaluations/scicode | 2026-10-10 (via BenchLM) | No vendor score; AA "under review" caveat; Kilo lists 59.5 from AA |
| AA-LCR | 88.7 | independent (AA) | https://artificialanalysis.ai/evaluations/artificial-analysis-long-context-reasoning | 2026-10-10 (via BenchLM) | Same value on Kilo ("LCR 88.7%" from AA) |
| GPQA Diamond | 93.5 | independent (AA) | https://artificialanalysis.ai/evaluations/gpqa-diamond | 2026-10-10 (via BenchLM) | Vendor also 93.5 (launch blog); Vals 92.9 |

#### Kimi K2.7 Code
**Identity:** Moonshot AI; released **2026-06-12** ([Cloudflare day-one post](https://developers.cloudflare.com/changelog/post/2026-06-12-kimi-k2-7-code-workers-ai); forum post 2026-06-16). 1T MoE / 32B active, 256K context, Modified MIT; [HF card](https://huggingface.co/moonshotai/Kimi-K2.7-Code).
**GO status & pricing:** In lineup (`kimi-k2.7-code`), monthly limit **$60**; **$0.95 / $4.00 / $0.19** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 30.5 | independent (BenchLM mirror of the Datacurve leaderboard JSON) | https://benchlm.ai/benchmarks/deepswe | 2026-09-01 | mini-swe-agent, effort not noted; not visible in the displayed top-21 of the live v1.1 page (2026-09-22); Surge AI independent study: base K2.7 (Max) 31.0, post-RL variant 43.4 (not the released model) |
| Terminal-Bench 2.1 | 67.0 | independent (Vals AI) | https://www.vals.ai/models/kimi_kimi-k2.7-code | 2026-10-10 | Surge AI reports the same 67.0 for base K2.7 (post-trained variant 82.0) |
| SciCode | 47.8 | independent (AA) | https://artificialanalysis.ai/evaluations/scicode | 2026-10-10 (via BenchLM) | No vendor SciCode found |
| AA-LCR | 79.3 | independent (AA) | https://artificialanalysis.ai/models/kimi-k2-7-code | 2026-10-10 (via BenchLM) | No vendor score |
| GPQA Diamond | 89.6 | independent (AA) | https://artificialanalysis.ai/models/kimi-k2-7-code | 2026-10-10 (via BenchLM) | No vendor GPQA; aggregator BenchGecko lists 86.0 (lower credibility) |

#### Kimi K2.6
**Identity:** Moonshot AI; released **2026-04-20** ([RITS/NYU Shanghai](https://rits.shanghai.nyu.edu/ai/moonshot-ai-releases-kimi-k2-6-with-256k-context-and-300-agent-swarms), 2026-04-21). 1T MoE, 256K context, Modified MIT; [HF card](https://huggingface.co/moonshotai/Kimi-K2.6).
**GO status & pricing:** In lineup (`kimi-k2.6`), monthly limit **$60**; **$0.95 / $4.00 / $0.16** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 23.89 | independent (aggregator; launch-era "Official" record) | https://evals.report/benchmarks/deep-swe | 2026-10-10 (row dated 2026-04-20) | v1-era (pre-v1.1); not on the Datacurve v1.1 board (2026-10-10); corroborated at 23.9 by anotherwrapper.com; original first-party URL not identified |
| Terminal-Bench 2.1 | 53.6 | independent (Vals AI) | https://www.vals.ai/models/kimi_kimi-k2.6 | 2026-10-10 | Only TB 2.1 value found; vendor published TB **2.0** = 66.7 (different version; [blog](https://www.kimi.com/blog/kimi-k2-6), 2026-04-20) |
| SciCode | 51.5 | independent (AA) | https://artificialanalysis.ai/evaluations/scicode | 2026-10-10 (via BenchLM) | Vendor 52.2 (HF card, 2026-04-20) |
| AA-LCR | 81.0 | independent (AA) | https://artificialanalysis.ai/models/kimi-k2-6 | 2026-10-10 (via BenchLM) | No vendor score |
| GPQA Diamond | 91.1 | independent (AA) | https://artificialanalysis.ai/models/kimi-k2-6 | 2026-10-10 (via BenchLM) | Vendor 90.5 (HF card, 2026-04-20); Vals 89.1 |

### Z.ai GLM — 5.3 generation on the board, 5.1 out of GO

#### GLM-5.3
**Identity:** Z.ai; released **2026-08-18** (aireleasetracker says Aug 14 — minority); [z.ai blog](https://z.ai/blog/glm-5.3). Same base as GLM-5.2, gains from post-training; 1M context; [HF card](https://huggingface.co/zai-org/GLM-5.3).
**GO status & pricing:** In lineup (`glm-5.3`), monthly limit **$15**; **$1.40 / $4.40 / $0.26** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 69 ±3 | independent (Datacurve) | https://deepswe.datacurve.ai | 2026-09-22 | v1.1, mini-swe-agent [max], $3.99/task; vendor 66.9 (HF card); BenchLM mirror 69.0 |
| Terminal-Bench 2.1 | 71.5 | independent (Vals AI) | https://www.vals.ai/models/zai_glm-5.3 | 2026-10-10 | Vendor 88.2 (HF card); AA 83.9; BenchLM mirror #8 88.2; vendor TB 3.0 = 28.3 (different version) |
| SciCode | 59.0 | independent (AA) | https://artificialanalysis.ai/evaluations/scicode | 2026-10-10 (via BenchLM) | No vendor SciCode |
| AA-LCR | 79.7 | independent (AA) | https://artificialanalysis.ai/evaluations/artificial-analysis-long-context-reasoning | 2026-10-10 (via BenchLM) | No vendor score |
| GPQA Diamond | 91.7 | independent (AA) | https://artificialanalysis.ai/evaluations/gpqa-diamond | 2026-10-10 (via BenchLM) | Vals 88.1; no vendor GPQA (vendor card lists HLE/GDPval instead) |

#### GLM-5.3-Flash
**Identity:** Z.ai; released **2026-08-26** (moderate confidence; LMC + page metadata); [z.ai post](https://z.ai/blog/glm-5.3-flash). First natively multimodal GLM-5; 320B / 18B active, 1M context; pre-release stealth name "ox-alpha"; [HF card](https://huggingface.co/zai-org/GLM-5.3-Flash).
**GO status & pricing:** In lineup (`glm-5.3-flash`), monthly limit **$60**; **$0.15 / $0.50 / $0.03** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 63 ±4 | independent (Datacurve) | https://deepswe.datacurve.ai | 2026-09-22 | v1.1, mini-swe-agent [max], $0.24/task — cheapest in the top group; vendor 63.4 (launch post, vs Opus 4.8 58.0) |
| Terminal-Bench 2.1 | 62.9 | independent (Vals AI) | https://www.vals.ai/models/zai_glm-5.3-flash | 2026-10-10 | Vendor 84.3; AA 84.3; BenchLM mirror #20 84.3 — the widest vendor/Vals gap in the GLM set |
| SciCode | 51.6 | independent (AA) | https://artificialanalysis.ai/evaluations/scicode | 2026-10-10 (via BenchLM) | No vendor SciCode |
| AA-LCR | 80.0 | independent (AA) | https://artificialanalysis.ai/evaluations/artificial-analysis-long-context-reasoning | 2026-10-10 (via BenchLM) | No vendor score |
| GPQA Diamond | 91.2 | independent (AA) | https://artificialanalysis.ai/evaluations/gpqa-diamond | 2026-10-10 (via BenchLM) | Vals 86.4; no vendor GPQA |

#### GLM-5.2
**Identity:** Z.ai; open-weights release **2026-06-16** ([NIST CAISI](https://www.nist.gov/news-events/news/2026/07/caisi-assessment-zais-glm-52), July 2026); [HF blog](https://huggingface.co/blog/zai-org/glm-52-blog), published 2026-06-17. 744B / 40B active, 1M context, MIT.
**GO status & pricing:** In lineup (`glm-5.2`), monthly limit **$60**; **$1.40 / $4.40 / $0.26** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 44 ±2 | independent (Datacurve) | https://deepswe.datacurve.ai | 2026-09-22 | v1.1, mini-swe-agent [max], $3.92/task; conflict: DeepInfra table lists 46.2 (2026-09-28); BenchLM mirror 43.8 |
| Terminal-Bench 2.1 | 67.8 | independent (Vals AI) | https://www.vals.ai/models/zai_glm-5.2 | 2026-10-10 | Vendor 81.0 (HF blog / NVIDIA reference data); BenchLM mirror #27 81.0; claimed "first open-weight model to break 80% on TB 2.1" (0G, 2026-06-18); no AA TB 2.1 |
| SciCode | 51.2 | independent (AA) | https://artificialanalysis.ai/evaluations/scicode | 2026-10-10 (via BenchLM) | No vendor SciCode |
| AA-LCR | 78.3 | independent (AA) | https://artificialanalysis.ai/models/glm-5-2 | 2026-10-10 (via BenchLM) | No vendor score |
| GPQA Diamond | 89.5 | independent (AA) | https://artificialanalysis.ai/models/glm-5-2 | 2026-10-10 (via BenchLM) | Vendor 91.2 (HF blog table); Vals 85.6; three-way spread 85.6–91.2 |

#### GLM-5.1 (not in GO)
**Identity:** Z.ai; released **2026-04-07** (Vals metadata says Apr 1 — minority); [z.ai blog](https://z.ai/blog/glm-5.1). 744B / 40B active, 200K context, MIT.
**GO status & pricing:** **Not in the 2026-10-10 GO lineup** (does not appear anywhere on the GO page); Z.ai list price $1.40 / $4.40 per 1M ([morphllm.com/glm-5-1](https://www.morphllm.com/glm-5-1), 2026-07-17); no GO price exists.

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 18.90 | independent (Mercor DeepSWE v1.1 snapshot) | https://benchlm.ai/benchmarks/mercordeepswe11 | 2026-10-06 | v1.1, mini-swe-agent (500 max steps, 2 h limit), ±5.5, 339 samples, rank 40; alternative: evals.report "Official" v1-era record 17.48 (row dated 2026-04-07; original first-party URL not identified); not on Datacurve v1.1 board |
| Terminal-Bench 2.1 | 56.9 | independent (Vals AI) | https://www.vals.ai/models/zai_glm-5.1 | 2026-10-10 | Only TB 2.1 value found; vendor TB **2.0** = 63.5 (different version; [z.ai blog](https://z.ai/blog/glm-5.1)) |
| SciCode | 44.8 | independent (AA) | https://artificialanalysis.ai/evaluations/scicode | 2026-10-10 (via BenchLM) | No vendor SciCode |
| AA-LCR | 73.7 | independent (AA) | https://artificialanalysis.ai/models/glm-5-1 | 2026-10-10 (via BenchLM) | No vendor score |
| GPQA Diamond | 86.8 | independent (AA) | https://artificialanalysis.ai/models/glm-5-1 | 2026-10-10 (via BenchLM) | Vendor 86.2 (z.ai blog / tech report); Vals 84.5 |

### Alibaba Qwen — the 3.8 generation in GO; 3.7 Max and 3.6 Plus removed

#### Qwen3.8 Max
**Identity:** Alibaba/Qwen; announced **2026-08-02**; [qwen.ai blog](https://qwen.ai/blog?id=qwen3.8). 2.4T MoE flagship, 1M context; open weights Qwen3.8-2.4T-A95B (2026-08-12); served snapshot `qwen3.8-max-0902` (2026-09-02).
**GO status & pricing:** In lineup (`qwen3.8-max`), monthly limit **$15**; **$2.00 / $6.00 / $0.25**, cached write $2.50 ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 57.5 | independent (Datacurve; relayed by UnifyBench; board renders 57% ±3) | https://deepswe.datacurve.ai | 2026-09-22 | `qwen3.8-max [xhigh]`, $3.73/task, 111 steps; vendor (Aug 2 launch) 56.6, best of Claude Code/mini-SWE-agent harnesses at 256K; vendor 0902-refresh value 69.3 (lab-reported via AI Release Tracker, 2026-09-02 — pin the snapshot when citing) |
| Terminal-Bench 2.1 | 67.4 | independent (Vals AI) | https://benchlm.ai/models/qwen3-8-max (citing vals.ai) | 2026-10-10 | Vendor 86.6 (harness not specified; Qwen blog / HF card); Atlas aggregator rows: 88.8 (0902), 82.0, 81.3 (harness unclear); Vals archived TB 2.1 on 2026-09-27 and its live page now shows TB 4.0 = 34.34 |
| SciCode | 52 | independent (AA) | https://artificialanalysis.ai/models/qwen3-8-max | 2026-10-10 | AA percent on comparison tables; no vendor SciCode |
| AA-LCR | 80 | independent (AA) | https://artificialanalysis.ai/models/qwen3-8-max | 2026-10-10 | AA-LCR v1.1 |
| GPQA Diamond | 92.6 | vendor | https://qwen.ai/blog?id=qwen3.8 | 2026-08-02 | AA has no GPQA value found; Vals 93.69 ±1.22 (rank 6/138, 2026-09-27) is the independent alternative; vendor precedes "other independent" per policy |

#### Qwen3.8 Flash
**Identity:** Alibaba/Qwen; hosted product built on the open-weight **Qwen3.8-Flash-Next** checkpoint (released 2026-08-26); [HF Flash-Next](https://huggingface.co/Qwen/Qwen3.8-Flash-Next). 180B / 6B active, 256K native (1M hosted), Qwen Community License 1.0.
**GO status & pricing:** In lineup (`qwen3.8-flash`), monthly limit **$30**; **$0.15 / $0.47 / $0.016**, cached write $0.20 ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 58.7 | vendor | https://huggingface.co/Qwen/Qwen3.8-Flash-Next | 2026-08-26 | DeepSWE v1.1, best of Claude Code / mini-SWE-agent at 256K; the hosted `qwen3.8-flash` has no separate benchmark table (B.AI); not on the Datacurve board |
| Terminal-Bench 2.1 | 86.1 | independent (aggregator — Benchmark Atlas) | https://atlas.kevinhu.io/benchmarks/terminal-bench-2-1 | 2026-10-10 | "Qwen3.8-Flash-Next"; harness not specified; no vendor/Vals/BenchLM corroboration (BenchLM shows "Coming soon") — low-confidence cell recorded as-is |
| SciCode | 50.6 | independent (AA) | https://benchlm.ai/models/qwen3-8-flash-next | 2026-10-10 | No vendor SciCode |
| AA-LCR | 79.7 | independent (AA) | https://benchlm.ai/models/qwen3-8-flash-next | 2026-10-10 | AA-LCR v1.1 |
| GPQA Diamond | 92.3 | independent (AA) | https://benchlm.ai/models/qwen3-8-flash-next | 2026-10-10 | Vendor (Flash-Next) 91.7 |

#### Qwen3.7 Plus
**Identity:** Alibaba/Qwen; snapshot `qwen3.7-plus-2026-05-26`; Vals lists release 2026-06-01; [Alibaba Cloud Model Studio docs](https://help.aliyun.com/en/model-studio/qwen3-7-plus) (updated 2026-07-23). 1M context, multimodal Plus tier.
**GO status & pricing:** In lineup (`qwen3.7-plus`), monthly limit **$60**; **$0.40 / $1.60 / $0.04** (≤256K) and **$1.20 / $4.80 / $0.12** (>256K); cached write $0.50/$1.50 ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 16.5 | vendor | https://huggingface.co/Qwen/Qwen3.8-Flash-Next | 2026-08-26 | v1.1 comparison table; not on Datacurve board |
| Terminal-Bench 2.1 | 52.81 ±0.65 | independent (Vals AI) | https://www.vals.ai/models/alibaba_qwen3.7-plus | 2026-06-02 | Run via Alibaba API, temp 0.7, preserve_thinking, 1M ctx, 65,536 max output, rank 56/75; vendor TB **2.0** = 70.3 (different version) |
| SciCode | 46.1 | independent (AA) | https://benchlm.ai/models/qwen3-7-plus | 2026-10-10 | Vendor 51.3 (Alibaba Cloud launch benchmarks) |
| AA-LCR | 73.0 | independent (AA) | https://benchlm.ai/models/qwen3-7-plus | 2026-10-10 | No vendor score |
| GPQA Diamond | 90.0 | independent (AA) | https://benchlm.ai/models/qwen3-7-plus | 2026-10-10 | Vendor 90.3 (Alibaba Cloud launch benchmarks) |

#### Qwen3.7 Max (not in GO)
**Identity:** Alibaba/Qwen; snapshots 2026-05-20 and 2026-06-08 (adds vision); Vals lists release 2026-05-20; closed weights.
**GO status & pricing:** **Not in the 2026-10-10 GO lineup**; vendor list price not found; Vals reports token costs $2.50 / $7.50 per 1M ([Vals](https://www.vals.ai/models/alibaba_qwen3.7-max), 2026-05-22).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 21.6 | vendor | https://qwen.ai/blog?id=qwen3.8 | 2026-08-02 | v1.1 comparison table (also on HF Qwen3.8-2.4T-A95B card); not on Datacurve board |
| Terminal-Bench 2.1 | 61.05 ±0.38 | independent (Vals AI) | https://www.vals.ai/models/alibaba_qwen3.7-max | 2026-05-22 | Rank 39/75; vendor 74.5 (harness not specified, 2026-08-02); vendor TB **2.0** = 69.7 (different version) |
| SciCode | 49.5 | independent (AA) | https://benchlm.ai/models/qwen3-7-max | 2026-10-10 | Vendor 53.5 (qwen3.7 blog) |
| AA-LCR | 79.0 | independent (AA) | https://benchlm.ai/models/qwen3-7-max | 2026-10-10 | No vendor score |
| GPQA Diamond | 92.3 | independent (AA) | https://benchlm.ai/models/qwen3-7-max | 2026-10-10 | Vendor 92.4; Vals 90.15 ±1.50 (rank 25/138) |

#### Qwen3.6 Plus (not in GO)
**Identity:** Alibaba/Qwen; snapshot `qwen3.6-plus-2026-04-02`; Vals lists release 2026-04-02; closed weights.
**GO status & pricing:** **Not in the 2026-10-10 GO lineup**; vendor price $0.50 / $3.00 per 1M (≤256K), explicit cache read $0.05 ([QwenCloud](https://www.qwencloud.com/models/qwen3.6-plus); conflict: Command Code lists cache read $0.10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 2.65 | independent (aggregator; launch-era "Official" record) | https://evals.report/benchmarks/deep-swe | 2026-10-10 (row dated 2026-04-02) | v1-era; RankedAGI lists 3.0% (#16); conflict: Continuum (2026-08-13) asserts no official mini-swe-agent row on the board it fetched — unresolved, but the ~2.6–3.0 order of magnitude is consistent |
| Terminal-Bench 2.1 | 53.18 ±1.63 | independent (Vals AI) | https://www.vals.ai/models/alibaba_qwen3.6-plus | 2026-04-10 | Rank 55/75; vendor TB **2.0** = 61.6 (different version) |
| SciCode | not found | n/a | https://benchlm.ai/models/qwen3-6-plus (checked; "Coming soon") | 2026-10-10 | No vendor or independent SciCode |
| AA-LCR | 78.3 | independent (AA) | https://benchlm.ai/models/qwen3-6-plus | 2026-10-10 | Also listed by Kilo Code from AA |
| GPQA Diamond | 88.2 | independent (AA) | https://benchlm.ai/models/qwen3-6-plus | 2026-10-10 | Vendor 90.4 (labeled "GPQA" on the vendor table; Diamond attribution probable but unconfirmed); Vals 87.37 ±1.67 (rank 39/138) |

### OpenAI — the GPT-6 family, split across GO and Zen

#### GPT-6 Astra (not in GO)
**Identity:** OpenAI; released **2026-09-03**; [openai.com/index/gpt-6-astra](https://openai.com/index/gpt-6-astra/). 1M context; knowledge cutoff 2026-04-30.
**GO status & pricing:** **Not in the GO lineup**; Zen pay-per-use `gpt-6-astra` at **$10 / $50 / $1.00** (≤272K), $20/$75/$2.00 (>272K) ([opencode.ai/docs/zen](https://opencode.ai/docs/zen), 2026-10-10) — matches OpenAI standard pricing.

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 74 ±3 | independent (Datacurve) | https://deepswe.datacurve.ai/ | 2026-09-22 | mini-swe-agent, xhigh; vendor 74.1 (max at any effort); older BenchLM mirror 73.2 (2026-09-01, max) |
| Terminal-Bench 2.1 | 87.27 | independent (Vals AI) | https://www.vals.ai/benchmarks/terminal-bench-2-1 | 2026-09-28 | Terminus 2, pass@1, rank 2/76; AA-run value 88.4 (mirrored by BenchLM); TB 4.0 = 57.9 vendor (different version) |
| SciCode | 56.5 | independent (AA) | https://benchlm.ai/models/gpt-6-astra | 2026-10-10 | Underlying AA SciCode leaderboard; AA "under review" caveat |
| AA-LCR | 80.7 | independent (AA) | https://benchlm.ai/models/gpt-6-astra | 2026-10-10 | AA-LCR v1.1 |
| GPQA Diamond | 96.1 | independent (AA) | https://benchlm.ai/models/gpt-6-astra | 2026-10-10 | Vendor 96.0; same 96.1 also appears on the OpenAI comparison table for Gemini; AA index version note: 61.2 on v4.1.1 (OpenAI) vs 53 on v4.3.2 (AA) — do not compare across index versions |

#### GPT-6 Sol (not in GO)
**Identity:** OpenAI; announced **2026-09-22**; [openai.com/index/introducing-gpt-6-sol-and-luna](https://openai.com/index/introducing-gpt-6-sol-and-luna/). 1M context.
**GO status & pricing:** **Not in the GO lineup**; Zen pay-per-use `gpt-6-sol` at **$2 / $10 / $0.20** (≤272K), $4/$15/$0.40 (>272K) ([opencode.ai/docs/zen](https://opencode.ai/docs/zen), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 68.8 | vendor | https://openai.com/index/introducing-gpt-6-sol-and-luna/ | 2026-09-22 | Max effort; "within 1.1 points of Claude Fable 5's 69.9% at ~80% lower cost per task"; not on the Datacurve v1.1 board (2026-10-10) — no independent replica |
| Terminal-Bench 2.1 | 83.15 | independent (Vals AI) | https://www.vals.ai/benchmarks/terminal-bench-2-1 | 2026-09-28 | Terminus 2, rank 6, tied with Claude Sonnet 5.5 |
| SciCode | 57.6 | independent (AA) | https://benchlm.ai/models/gpt-6-sol | 2026-10-10 | Confirmed by 4+ mirrors (The Latent AA payload 57.6389, retrieved 2026-09-22; VerdictPal; LLMLearner; AA compare low 50 / max 58) |
| AA-LCR | 83.7 | independent (AA) | https://benchlm.ai/models/gpt-6-sol | 2026-10-10 | Confirmed by The Latent (83.6667), VerdictPal (83.67, #9/184, 2026-09-28), LLMLearner; AA compare low 79 / max 84 |
| GPQA Diamond | 94.3 | independent (Epoch AI, relayed) | https://www.benchleader.com/benchmarks/gpqa_diamond | 2026-09-22 (publish; retrieved 2026-10-10) | Max effort; also models.fru.dev (`gpt-6-sol_max` 94.3, #8/100); outlier to ignore: gpqa.ai "Clean score" 98.4 is a contamination-adjusted metric, not standard Diamond |

#### GPT-6 Luna (in GO)
**Identity:** OpenAI; announced **2026-09-22** (listed in GO docs as "GPT 6 Luna"); [openai.com/index/introducing-gpt-6-sol-and-luna](https://openai.com/index/introducing-gpt-6-sol-and-luna/). 1M context.
**GO status & pricing:** In lineup (`gpt-6-luna`), monthly limit **$15**; **$0.10 / $0.50 / $0.01** (≤272K), $0.20/$0.75/$0.02 (>272K); same prices on Zen ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 66.6 | vendor | https://openai.com/index/introducing-gpt-6-sol-and-luna/ | 2026-09-22 | Max effort; "comparable to Claude Opus 5 and Fable 5 at medium effort"; not on the Datacurve board (2026-10-10) |
| Terminal-Bench 2.1 | 73.03 | independent (Vals AI) | https://www.vals.ai/benchmarks/terminal-bench-2-1 | 2026-09-28 | Terminus 2, rank 23 |
| SciCode | 54.6 | independent (AA) | https://benchlm.ai/models/gpt-6-luna | 2026-10-10 | AA SciCode; no vendor score |
| AA-LCR | 83.3 | independent (AA) | https://benchlm.ai/models/gpt-6-luna | 2026-10-10 | AA-LCR v1.1 |
| GPQA Diamond | 90.5 | independent (Epoch AI, relayed) | https://www.benchleader.com/benchmarks/gpqa_diamond | 2026-09-22 (publish; retrieved 2026-10-09/10) | Max effort; also SuperIndex (retrieved 2026-10-09), Benchmark Registry (evaluated 2026-09-22; Mercor single-shot 89.9), LLMs Tiger (#34/276); Epoch's own page rounds to 90%; outlier 96.0 (no source) unreliable; warpcode 87.8 explicitly an estimate |

#### GPT-5.6 Luna (in GO)
**Identity:** OpenAI; public launch **2026-07-09** (GPT-5.6 family), Luna price cut 2026-07-30; [openai.com/index/gpt-5-6](https://openai.com/index/gpt-5-6/). 1M context.
**GO status & pricing:** In lineup (`gpt-5.6-luna`), monthly limit **$15**; **$0.20 / $1.20 / $0.02** (≤272K), $0.40/$1.80/$0.04 (>272K); same on Zen ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 67 ±4 | independent (Datacurve) | https://deepswe.datacurve.ai/ | 2026-09-22 | mini-swe-agent, max effort; vendor 67.2 (OpenAI GPT-5.6 post, mirrored by BenchLM) |
| Terminal-Bench 2.1 | 79.03 | independent (Vals AI) | https://www.vals.ai/benchmarks/terminal-bench-2-1 | 2026-09-28 | Terminus 2, rank 11; vendor 84.7 (harness unspecified) — ~5.7-pt spread |
| SciCode | 53.6 | independent (AA) | https://benchlm.ai/models/gpt-5-6-luna | 2026-10-10 | AA SciCode |
| AA-LCR | 83.7 | independent (AA) | https://benchlm.ai/models/gpt-5-6-luna | 2026-10-10 | AA-LCR v1.1 |
| GPQA Diamond | 91.1 | independent (AA) | https://benchlm.ai/models/gpt-5-6-luna | 2026-10-10 | Vendor 92.3; Vals 91.7 ([Vals](https://www.vals.ai/models/openai_gpt-5.6-luna), 2026-09-28) |

### Anthropic — Claude Haiku 5.5 (new to the sheet)

#### Claude Haiku 5.5
**Identity:** Anthropic; announced/released **2026-10-07**; [anthropic.com/claude-haiku-5-5](https://www.anthropic.com/claude-haiku-5-5); [system card PDF](https://www-cdn.anthropic.com/e1080d6bf5ae2018ea3c2f414064be03232f5be5/Claude%20Haiku%205.5%20System%20Card.pdf). 1M context, 128K max output (300K Batch beta), first Haiku with effort settings; knowledge cutoff Jun 2026.
**GO status & pricing:** In lineup (`claude-haiku-5-5`), monthly limit **$15**; **$0.10 / $0.50 / $0.01** (≤100K), $0.50/$2.50/$0.05 (>100K) ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10) — matches Anthropic list pricing (cache writes $0.125/$0.625).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | not found | n/a | https://deepswe.datacurve.ai/ and https://themodelgap.com/models/claude-haiku-5-5 (checked; "no row") | 2026-10-10 (no-row check 2026-10-08) | Confirmed absent (not just unfound): Datacurve v1.1 board has no row; evals.report shows only Haiku 4.5 (0.22%); warpcode "~63.2" is explicitly labeled an estimate and excluded; Anthropic instead reports FrontierCode 1.1 Main 46.4% |
| Terminal-Bench 2.1 | not found | n/a | https://www.vals.ai/benchmarks/terminal-bench-2-1 (archived; no Haiku 5.5 row) | 2026-09-28 (archive) / 2026-10-08 (no-row check) | Vals archived its TB 2.1 board and has no Haiku 5.5 row (only Haiku 4.5 43.82%); CodingFleet's TB 2.1 leaderboard (2026-10-09) also has none; Anthropic reports TB **4.0** = 39.2% (max), Vals TB 4.0 35.35 ±2.20 — different version |
| SciCode | 55.0 | independent (AA) | https://benchlm.ai/models/claude-haiku-5-5 | 2026-10-10 | AA SciCode "under review" after dataset audit; harness/effort for the run not published |
| AA-LCR | 82.7 | independent (AA) | https://benchlm.ai/models/claude-haiku-5-5 | 2026-10-10 | AA-LCR v1.1; a component of AA index v4.3.2 (Haiku 5.5 scores 43.4 there; AA article says 43 at max effort) |
| GPQA Diamond | not found | n/a | https://benchlm.ai/models/claude-haiku-5-5 and https://themodelgap.com/models/claude-haiku-5-5 (checked) | 2026-10-08/10 | Confirmed absent: AA index v4.3.2 does not include GPQA; BenchLM shows "GPQA: Coming soon"; no vendor GPQA |

### Google — Gemini 3.8 Flash (Zen, not GO)

#### Gemini 3.8 Flash
**Identity:** Google DeepMind; announced **2026-09-02**; [blog](https://blog.google/innovation-and-ai/models-and-research/gemini-models/3-8-flash-and-3-8-flash-cyber/); [model card](https://deepmind.google/models/model-cards/gemini-3-8-flash/). 1M context.
**GO status & pricing:** **Not in the GO lineup**; Zen pay-per-use `gemini-3.8-flash` at **$1.50 / $7.50 / $0.15** ([opencode.ai/docs/zen](https://opencode.ai/docs/zen), 2026-10-10); Google's introductory price is $0.75/$3.75 through 2026-12-31, regular $1.50/$7.50 from 2027-01-01.

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 74 ±1 | independent (Datacurve) | https://deepswe.datacurve.ai/ | 2026-09-22 | mini-swe-agent, high effort; vendor 73.7 (model card); BenchLM and OpenAI comparison tables cite 73.8 |
| Terminal-Bench 2.1 | 81.27 | independent (Vals AI) | https://www.vals.ai/benchmarks/terminal-bench-2-1 | 2026-09-28 | Terminus 2, rank 8; vendor 89.4 (Google internal agentic run, harness unspecified); AA 87.6; aggregator claim of 90.8 (DataCamp, from Google developer docs) unverified and conflicts with the card's 89.4; TB 4.0 = 19.1 vendor (different version) |
| SciCode | 56.6 | independent (AA) | https://benchlm.ai/models/gemini-3-8-flash | 2026-10-10 | AA SciCode |
| AA-LCR | 81.3 | independent (AA) | https://benchlm.ai/models/gemini-3-8-flash | 2026-10-10 | AA-LCR v1.1 |
| GPQA Diamond | 95.3 | independent (AA) | https://benchlm.ai/models/gemini-3-8-flash | 2026-10-10 | Vals 94.4; OpenAI's comparison table also lists 95.3 |

### xAI — two Groks, both in GO

#### Grok 4.6
**Identity:** xAI (branded SpaceXAI on x.ai); announced **2026-08-12**; [x.ai/news/grok-4-6](https://x.ai/news/grok-4-6). 500K context.
**GO status & pricing:** In lineup (`grok-4.6`), monthly limit **$15**; **$2.00 / $6.00 / $0.50** (≤200K), $4/$12/$1.00 (>200K) ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 67 ±2 | independent (Datacurve) | https://deepswe.datacurve.ai/ | 2026-09-22 | Fetched table displayed effort label "[medium]" while the site's chart labels grok-4.6 XHIGH — label inconsistency noted; BenchLM mirror 66.7 (xhigh); vendor 65.9 (launch post, "High") conflicts with vendor 65.2 in the Grok 4.7 table |
| Terminal-Bench 2.1 | 78.28 | independent (Vals AI) | https://www.vals.ai/benchmarks/terminal-bench-2-1 | 2026-09-28 | Terminus 2, rank 13; no vendor TB 2.1 number |
| SciCode | 56.5 | independent (AA) | https://benchlm.ai/models/grok-4-6 | 2026-10-10 | AA SciCode |
| AA-LCR | 80.3 | independent (AA) | https://benchlm.ai/models/grok-4-6 | 2026-10-10 | AA-LCR v1.1 |
| GPQA Diamond | 94.9 | independent (AA) | https://benchlm.ai/models/grok-4-6 | 2026-10-10 | Vals 94.7 |

#### Grok 4.7 (new to the sheet)
**Identity:** xAI (branded SpaceXAI on x.ai); announced **2026-09-21**; [x.ai/news/grok-4-7](https://x.ai/news/grok-4-7). 500K context; "twice as fast, at half the price of comparable models".
**GO status & pricing:** In lineup (`grok-4.7`), monthly limit **$15**; **$2.00 / $6.00 / $0.50** (≤200K), $4/$12/$1.00 (>200K) ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 71.0 | vendor | https://x.ai/news/grok-4-7 | 2026-09-21 | v1.1, high effort (asterisked in xAI's table); not on the Datacurve leaderboard (2026-10-10) — vendor-only |
| Terminal-Bench 2.1 | 73.41 | independent (Vals AI) | https://www.vals.ai/benchmarks/terminal-bench-2-1 | 2026-09-28 | Terminus 2, rank 22; xAI's own post reports TB 4.0 = 37.6 (different version, not comparable) |
| SciCode | 57.4 | independent (AA) | https://benchlm.ai/models/grok-4-7 | 2026-10-10 | AA SciCode |
| AA-LCR | 76.7 | independent (AA) | https://benchlm.ai/models/grok-4-7 | 2026-10-10 | AA-LCR v1.1 |
| GPQA Diamond | 92.7 | independent (Epoch AI, relayed) | https://llmstiger.com/models/grok-4-7-xhigh | 2026-10-10 (retrieved) | Xhigh effort; also models.fru.dev (`grok-4.7_xhigh` 92.7, #20/100) and ai.gotry.io (92.7, #18/148, ±1.55); Epoch's page rounds to 93%; low-confidence outlier armes.ai 94.9 excluded (its block text describes other releases) |

### MiniMax — M3 and M2.7, thin DeepSWE coverage

#### MiniMax M3
**Identity:** MiniMax; released **2026-06-01**; [minimax.io/blog/minimax-m3](https://www.minimax.io/blog/minimax-m3). ~428B MoE / ~23B active, 1M context, multimodal; open weights; tech report arXiv:2606.13392.
**GO status & pricing:** In lineup (`minimax-m3`), monthly limit **$60**; **$0.30 / $1.20 / $0.06** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 13.3 | independent (unofficial community run — AiBattle) | https://x.com/AiBattle_/status/2061412711657857253 | 2026-06-01 | 15/113 tasks (19/113 with 1.5× overtime); NOT on the official Datacurve leaderboard (checked 2026-10-10) — use with caution; no official alternative |
| Terminal-Bench 2.1 | 53.56 ±0.75 | independent (Vals AI) | https://www.vals.ai/models/minimax_MiniMax-M3 | 2026-10-10 | Vendor 66.0 — MiniMax says **Terminus 2** scaffolding, 8C16G sandbox, 2h timeout, 128K max output ([blog](https://www.minimax.io/blog/minimax-m3)); rank 54/75 |
| SciCode | 47.1 | independent (AA) | https://openrouter.ai/minimax/minimax-m3 | 2026-10-10 | AA SciCode aggregated on OpenRouter; no vendor SciCode |
| AA-LCR | 83.0 | independent (AA) | https://openrouter.ai/minimax/minimax-m3 | 2026-10-10 | No vendor score |
| GPQA Diamond | 92.9 | independent (AA) | https://openrouter.ai/minimax/minimax-m3 | 2026-10-10 | Vals 92.68 ±1.44 corroborates; no vendor GPQA |

#### MiniMax M2.7
**Identity:** MiniMax; released **2026-03-18** (Vals lists Mar 17); [minimax.io/news/minimax-m27-en](https://www.minimax.io/news/minimax-m27-en). ~205K context; open weights.
**GO status & pricing:** In lineup (`minimax-m2.7`), monthly limit **$60**; **$0.30 / $1.20 / $0.06**, cached write **$0.375** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | not found | n/a | https://deepswe.datacurve.ai (checked; no row) | 2026-09-22 | No credible published DeepSWE; a community tweet claiming 0% is unverified and implausible (model scores 78% SWE-bench Verified vendor) — excluded |
| Terminal-Bench 2.1 | 48.69 ±3.07 | independent (Vals AI) | https://www.vals.ai/models/minimax_MiniMax-M2.7 | 2026-10-10 | Rank 62/75; AA via OpenRouter 55.4 (different harness); vendor TB **2.0** = 57.0 (different version) |
| SciCode | 50.1 | independent (AA) | https://openrouter.ai/minimax/minimax-m2.7 | 2026-10-10 | No vendor SciCode |
| AA-LCR | 78.3 | independent (AA) | https://openrouter.ai/minimax/minimax-m2.7 | 2026-10-10 | No vendor score |
| GPQA Diamond | 87.4 | independent (AA) | https://openrouter.ai/minimax/minimax-m2.7 | 2026-10-10 | BenchLM 87.0 secondary (2026-09-24) |

### Tencent Hy — Hy3 fully released, Hy4 in preview

#### Hy3
**Identity:** Tencent (Tencent Hy team, formerly Hunyuan); officially released **2026-07-06** ([tencent.com](https://www.tencent.com/tencent-hy3-now-available-globally-extending-practical-ai-across-products-workflows-and-cloud-services); preview open-sourced 2026-04-23). 295B MoE / 21B active, 256K context, Apache 2.0.
**GO status & pricing:** In lineup (`hy3`), monthly limit **$60**; **$0.14 / $0.58 / $0.035** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 28.0 | vendor (internal figure, via press) | https://www.thelec.net/news/articleView.html?idxno=13501 | 2026-08 | Tencent internal (model card), relayed by The Elec/SCMP/BigGo; NOT on the official Datacurve leaderboard; no independent confirmation |
| Terminal-Bench 2.1 | 71.7 | vendor | https://benchmarklist.com/models/tencent-hy3 | 2026-07-06 | From Hy3 model card; conflict: The Elec's Hy4 comparison table reports 70.8 — unresolved; no independent TB 2.1 run found; harness not specified |
| SciCode | 48.6 | independent (AA) | https://openrouter.ai/tencent/hy3 | 2026-10-10 | Corroborated by BenchmarkList (2026-10-03) and Command Code |
| AA-LCR | 79.0 | independent (AA) | https://openrouter.ai/tencent/hy3 | 2026-10-10 | Conflict: llm-stats lists 73.4 (73.4/0.734) as of 2026-10-08 — possible AA-LCR version discrepancy |
| GPQA Diamond | 89.7 | independent (AA) | https://openrouter.ai/tencent/hy3 | 2026-10-10 | Vendor 90.4 (model card); Hy3 **preview** GPQA 87.2 — do not mix preview with full Hy3 |

#### Hy4 preview
**Identity:** Tencent; released and open-sourced **2026-08-28** (preview; final Hy4 pending); [tencent.com](https://www.tencent.com/tencent-releases-and-open-sources-tencent-hy4-preview). 770B MoE / 49B active, 1M+ context, Apache 2.0.
**GO status & pricing:** In lineup (`hy4-preview`), monthly limit **$30**; **$0.834 / $2.501 / $0.042** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 64.3 | vendor (internal, via press) | https://www.thelec.net/news/articleView.html?idxno=13501 | 2026-08 | Tencent internal 12-benchmark set (from Hy3's 28.0), relayed by The Elec/SCMP/BigGo; NOT on the Datacurve board; SCMP compares it to Qwen3.8 Max 56.6 / DeepSeek V4 Pro 62.7; TechTimes: no independent reproduction |
| Terminal-Bench 2.1 | 85.4 | vendor | https://benchmarklist.com/models/tencent-hy4-preview | 2026-08-28 | Tencent benchmark appendix (thinking mode: highest available); no independent confirmation (AA had not tested Hy4 as of late Aug 2026) |
| SciCode | not found | n/a | https://artificialanalysis.ai (checked) | 2026-10-10 | No SciCode from vendor or independent trackers |
| AA-LCR | not found | n/a | https://artificialanalysis.ai/evaluations/artificial-analysis-long-context-reasoning (checked) | 2026-10-10 | No AA-LCR found on AA/llm-stats/BenchLM |
| GPQA Diamond | 92.3 | vendor | https://benchmarklist.com/models/tencent-hy4-preview | 2026-08-28 | Tencent benchmark appendix; no independent AA/Vals GPQA run found — vendor-only |

### Meituan LongCat — one on the board, one completely unscored

#### LongCat-2.0
**Identity:** Meituan (LongCat team); announced **2026-06-30** ([@Meituan_LongCat on X](https://x.com/Meituan_LongCat); OpenRouter lists Jul 20 — marketplace date). 1.6T MoE / ~48B active, native 1M context, open weights; was the stealth model "Owl Alpha".
**GO status & pricing:** In lineup (`longcat-2.0`), monthly limit **$60**; **$0.30 / $1.20 / $0.006** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | not found | n/a | https://deepswe.datacurve.ai (checked; no row) | 2026-09-22 | No DeepSWE from any source (vendor or independent) |
| Terminal-Bench 2.1 | 50.19 | independent (Vals AI; imported by BenchmarkList) | https://benchmarklist.com/benchmarks/vals_terminal_bench_2_1 | 2026-09-02 (imported) | tokencost.app corroborates ~50.2 ("Independent"); vendor 70.8 (HF model card) — major 20-pt conflict; prefer Vals for cross-model comparison |
| SciCode | 36.3 | independent (AA) | https://openrouter.ai/meituan/longcat-2.0 | 2026-10-10 | Command Code cites AA v4.3 same value |
| AA-LCR | 65.0 | independent (AA) | https://openrouter.ai/meituan/longcat-2.0 | 2026-10-10 | No vendor score |
| GPQA Diamond | 78.0 | independent (AA) | https://openrouter.ai/meituan/longcat-2.0 | 2026-10-10 | Vendor model card 88.9 — a 10.9-pt conflict (vendor's own harness); AA preferred for comparison |

#### LongCat 2.5 Preview Free (new to the sheet)
**Identity:** Meituan; released **2026-09-25** ([@Meituan_LongCat on X](https://x.com/Meituan_LongCat)); [TechNode](https://technode.com/2026/09/30/meituan-releases-longcat-2-5-preview-with-image-understanding). 1.6T / ~48B active, 1M context, multimodal; API-only (no open weights). GO name "LongCat 2.5 Preview Free" (`longcat-2.5-preview-free`) — "Free" is the GO promo, not the model name.
**GO status & pricing:** In lineup, **Free / Free / Free, unlimited (limited time)**; the two-week free window ran roughly 2026-09-26 to 2026-10-10 — re-verify timing if publishing later ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10; promo posts by @opencode/@Meituan_LongCat, 2026-09-26). Standard API price (non-GO): $0.30 / $1.20 / $0.006 per 1M ([BenchmarkList](https://benchmarklist.com/models/meituan-longcat-2.5-preview)).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | not found | n/a | https://benchmarklist.com/models/meituan-longcat-2.5-preview (checked; 0 score rows) | 2026-10-10 | Meituan published no benchmarks for this preview; not on Datacurve |
| Terminal-Bench 2.1 | not found | n/a | https://www.tbench.ai/leaderboard and https://benchmarklist.com/models/meituan-longcat-2.5-preview (checked) | 2026-10-10 | No TB (any version) published; no independent evaluation confirmed |
| SciCode | not found | n/a | https://benchmarklist.com/models/meituan-longcat-2.5-preview (checked) | 2026-10-10 | No vendor or independent SciCode |
| AA-LCR | not found | n/a | https://benchmarklist.com/models/meituan-longcat-2.5-preview (checked) | 2026-10-10 | Not on AA/llm-stats/BenchLM leaderboards |
| GPQA Diamond | not found | n/a | https://benchmarklist.com/models/meituan-longcat-2.5-preview (checked) | 2026-10-10 | No score anywhere; do NOT substitute LongCat-2.0's values |

Context (not one of the five tracked benchmarks): AI Coding Daily ran a third-party coding evaluation with OpenCode — **46.65 points**, last evaluated 2026-10-02 ([aicodingdaily.com/model/longcat-2-5-preview](https://aicodingdaily.com/model/longcat-2-5-preview)); OpenCode's own comparison page rates it "50/100 — No data; neutral placeholder". Do not map 46.65 to any of the five metrics.

### StepFun — Step 5 Preview Free (new to the sheet)

#### Step 5 Preview Free
**Identity:** StepFun flagship "Step 5 Preview"; announced **2026-09-20**; [stepfun.com/step-5-preview](https://www.stepfun.com/step-5-preview). 600B sparse MoE / 27B active, 1M context, text/image/video input; weights promised 2026-10-15. GO name "Step 5 Preview Free" (`step-5-preview-free`).
**GO status & pricing:** In lineup, **Free / Free / Free, unlimited (limited time)** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10). StepFun API list price: $1.00 / $2.70 / $0.05 per 1M ([NanoGPT mirror](https://nano-gpt.com/models/text/stepfun/step-5-preview), 2026-09-20).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 67.7 | vendor | https://cellcog.ai/blog/step-5-preview/ (reprint; vendor page [stepfun.com/step-5-preview](https://www.stepfun.com/step-5-preview)) | 2026-09-20 | v1.1, "High" reasoning (rivals' "Max" modes in the same table); mirrored with attribution by [BenchLM](https://benchlm.ai/models/step-5-preview) (2026-10-10); no Datacurve row |
| Terminal-Bench 2.1 | 85.0 | vendor | https://www.stepfun.com/step-5-preview | 2026-09-20 (vendor page fetched 2026-10-10) | Vendor harness, "high" reasoning; second sources: BenchmarkList 85.0 (rank 21/194, 90th pct), Toolbit/AgentBreaking/RankLLMs mirrors; not on the tbench.ai public board — no independent run; vendor TB **4.0** = 33.3 (different version) |
| SciCode | 58.9 | independent (AA) | https://benchlm.ai/models/step-5-preview | 2026-10-10 | Vendor table also lists 58.9 — vendor and AA agree |
| AA-LCR | 88.3 | independent (AA) | https://benchlm.ai/models/step-5-preview | 2026-10-10 | AA-LCR v1.1; also present at 88.3 in StepFun's own table |
| GPQA Diamond | 93.5 | vendor | https://benchlm.ai/models/step-5-preview | 2026-10-10 (StepFun table dated 2026-09-20) | StepFun self-reported (High setting); matches CellCog reprint; no AA/Vals run found |

### Meta Muse Spark — Contributor tiers in GO

#### Muse Spark 1.3 Contributor
**Identity:** Meta; released **2026-09-02**; [research.meta.ai/blog/introducing-muse-spark-1-3](https://research.meta.ai/blog/introducing-muse-spark-1-3). 1M context, text/image/video input; contributor tier = discounted pricing in exchange for training rights on prompts/completions; availability limited to regions permitted by Meta's Geographic Use Policy.
**GO status & pricing:** In lineup (`muse-spark-1.3-contributor`), monthly limit **$60**; **$0.10 / $0.20 / $0.002** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10); standard tier is $1.25 / $4.25 / $0.15 ([dev.meta.ai](https://dev.meta.ai/docs/pricing-rate-limits), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 75.4 | vendor | https://research.meta.ai/blog/introducing-muse-spark-1-3 | 2026-09-02 | v1.1 at the not-yet-GA "max" reasoning level (xhigh was the GA level); Meta Model API; no independent Datacurve row (board shows only muse-spark-1.2 at 55) — self-reported |
| Terminal-Bench 2.1 | 72.3 | independent (Vals AI) | https://www.vals.ai/models/meta_muse_spark_1_3 | 2026-10-10 (via BenchLM) | Vendor 88.8 (max reasoning, self-reported); AA 84.3; AA TB **4.0** = 33.3 (different version) |
| SciCode | 58.8 | independent (AA) | https://benchlm.ai/models/muse-spark-1-3 | 2026-10-10 | AA SciCode |
| AA-LCR | 83.0 | independent (AA) | https://benchlm.ai/models/muse-spark-1-3 | 2026-10-10 | AA-LCR v1.1 |
| GPQA Diamond | 93.5 | independent (AA) | https://benchlm.ai/models/muse-spark-1-3 | 2026-10-10 | AA GPQA-Diamond; no vendor GPQA |

#### Muse Spark 1.2 Contributor
**Identity:** Meta; released **2026-08-05** with Muse Code beta; [research.meta.ai/blog/introducing-muse-code-and-muse-spark-1-2](https://research.meta.ai/blog/introducing-muse-code-and-muse-spark-1-2). Same contributor terms/region limits as 1.3.
**GO status & pricing:** In lineup (`muse-spark-1.2-contributor`), monthly limit **$60**; **$0.10 / $0.20 / $0.002** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 55.0 ±2 | independent (Datacurve) | https://deepswe.datacurve.ai | 2026-09-22 | v1.1 `muse-spark-1.2 [xhigh]`, mini-swe-agent, $3.70/task; vendor 59.3 (model page via BenchLM; effort/config not stated) |
| Terminal-Bench 2.1 | 69.7 | independent (Vals AI) | https://www.vals.ai/models/meta_muse_spark_1_2 | 2026-10-10 (via BenchLM) | Vendor 82.9 (model page, self-reported); no AA TB 2.1 value found for 1.2 beyond Vals |
| SciCode | 57.4 | independent (AA) | https://benchlm.ai/models/muse-spark-1-2 | 2026-10-10 | AA SciCode |
| AA-LCR | 79.0 | independent (AA) | https://benchlm.ai/models/muse-spark-1-2 | 2026-10-10 | AA-LCR v1.1 |
| GPQA Diamond | 90.4 | independent (AA) | https://benchlm.ai/models/muse-spark-1-2 | 2026-10-10 | AA GPQA-Diamond; no vendor GPQA |

### Stealth models — Space Bunny and Union Alpha

#### Space Bunny (in GO, new to the sheet)
**Identity:** Anonymous stealth model; OpenRouter id `stealth/space-bunny-alpha` released **2026-09-23**; OpenCode lists it as "Space Bunny" (`space-bunny`). 1M-token context, 524,288 max output, text/image/audio/video input, adjustable reasoning. **Identity unconfirmed as of 2026-10-10**; leading hypothesis: MiniMax family, possibly an M3.1-era checkpoint (tokenizer tests: 24/24 via [The Neuron](https://www.theneuron.ai/blog/who-made-space-bunny-minimax-clue), 2026-09-24; 36/36 via [MarMar Labs](https://x.com/MarMarLabs/status/2102804031819387032), 2026-09-23; 50/50 via [YFarmX](https://x.com/YFarmX/status/2102818396102344979), 2026-09-23; Kimi hypothesis refuted; ≥1M verified context rules out the M2.5 generation). OpenCode says the model "is currently being tuned before its official reveal" (2026-10-06) ([didcodexreset](https://didcodexreset.com/news/d544e395986844b3b8085202.html)).
**GO status & pricing:** In lineup (`space-bunny`), monthly limit **$30**; **$0.15 / $0.60 / $0.03** ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10). The free preview period ended **2026-10-05**; Zen still lists "Space Bunny Free" at $0 as of 2026-10-10; the OpenRouter listing was delisted by 2026-10-09 while OpenCode still serves it ([Hunter Alpha Hub](https://www.hunteralphahub.com/space-bunny-alpha-opencode), 2026-10-09).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | not found | n/a | https://deepswe.datacurve.ai (checked; no row) | 2026-10-10 | No Space Bunny row on the Datacurve v1.1 board or data browser. Third-party coding eval exists but is NOT DeepSWE: AI Coding Daily 57.19 (max-80 scale; last evaluated 2026-09-30); earlier snapshot 52.61/60 — do not map to tracked metrics |
| Terminal-Bench 2.1 | not found | n/a | https://www.tbench.ai/leaderboard (checked; no row) | 2026-10-10 | Not on tbench.ai (now TB 4.0) or BenchLM's TB 2.1 mirror |
| SciCode | not found | n/a | https://runfreetools.com/models/space-bunny-alpha (checked) | 2026-10-10 | No verified public score; only unofficial community subset runs (82% on 60 GPQA questions etc.), which are not official scores; community refs warn against "official Space Bunny benchmarks" ([awesome-space-bunny](https://github.com/codaaiteam/awesome-space-bunny)) |
| AA-LCR | not found | n/a | https://runfreetools.com/models/space-bunny-alpha (checked) | 2026-10-10 | Not tracked by AA; no verified score |
| GPQA Diamond | not found | n/a | https://runfreetools.com/models/space-bunny-alpha (checked) | 2026-10-10 | No verified GPQA; the unofficial 82% on a 60-question subset is not a full-benchmark score; OpenRouter's delisted page carries no benchmark rows |

#### Union Alpha Free (not in GO)
**Identity:** Stealth listing `stealth/union-alpha` appeared **2026-09-16**; **revealed 2026-09-17 as Pareto 26.9**, the blended multi-model system by **Circuit & Chisel**, sold via **Unbiased** — not a single model or a set of weights; "Pareto… runs multiple LLMs in parallel on each request, dynamically synthesizing results" ([GizChina.it](https://en.gizchina.it/2026/09/union-alpha-pareto-26-9-cosa-sapere), 2026-09-18; [unbiased.ai model card](https://unbiased.ai/model-card/), accessed 2026-10-10). **Provenance caveat:** union-alpha.* websites were squatted within 30 minutes of the OpenRouter listing ([r/opencode retraction](https://www.reddit.com/r/opencode/comments/1wj6x97/sorry_i_was_wrong_unionalpha_is_pareto_269_from/), Sep 2026) — treat all union-alpha.com/org content as unverified.
**GO status & pricing:** **Not in the 2026-10-10 GO lineup** (nor on current Zen listings). Free during the ~32-hour preview; paid successor Pareto 26.9 was $2.50/$7.50/$0.25 and current Pareto 26.10 Preview is $0.80/$3.20/$0.03 ([progressive robot](https://www.progressiverobot.com/2026/09/16/union-alpha-stealth-coding-model-free-opencode-openrouter), 2026-09-16; [circuitandchisel.com](https://circuitandchisel.com/), Sep 2026; [unbiased.ai](https://unbiased.ai/model-card/), 2026-10-10).

| Benchmark | Selected value | Source type | Source URL | Date | Alternatives & conflicts |
|---|---|---|---|---|---|
| DeepSWE | 70.0 | vendor | https://unbiased.ai/model-card/ | chart dated 2026-09-20 (accessed 2026-10-10) | Explicitly v1.1 at $0.29/task — the most current version-labeled figure; conflicting vendor headline 74 on the homepage ("ties GPT 6 Astra") likely an earlier/v1 config, unresolved ([circuitandchisel.com](https://circuitandchisel.com/), 2026-09-17); no Datacurve row |
| Terminal-Bench 2.1 | not found | n/a | https://unbiased.ai/model-card/ (checked; no 2.1 row) | 2026-10-10 | No TB 2.1 score published; portal-only Terminal-Bench **4.0** = 51 (union-alpha.com, 2026-09-18) is unverified and a different version |
| SciCode | not found | n/a | https://unbiased.ai/model-card/ (checked; no row) | 2026-10-10 | No vendor or independent SciCode |
| AA-LCR | not found | n/a | https://artificialanalysis.ai (checked; not tracked) | 2026-10-10 | Not tracked under Union Alpha or Pareto |
| GPQA Diamond | not found | n/a | https://unbiased.ai/model-card/ (checked; no row) | 2026-10-10 | Portal-only value 90.9 ("AutoExacto", recorded 2026-09-17 on the disputed-provenance union-alpha.com, 2026-09-18) — unverified, not on the vendor card; excluded from selection |

## Evidence gaps summary

Model + benchmark combinations with **no evidence found** as of 2026-10-10 (all verified as absent, not merely unsearched, where noted):

| Model | Missing benchmark evidence |
|---|---|
| DeepSeek V4 Flash Vision Exp | SciCode, AA-LCR, GPQA Diamond (all three: no vendor or independent value) |
| MiMo-V2.6-Pro | GPQA Diamond |
| MiMo-V2.6-Flash | GPQA Diamond |
| MiMo-V2.5 | DeepSWE |
| Qwen3.6 Plus | SciCode |
| Claude Haiku 5.5 | DeepSWE, Terminal-Bench 2.1, GPQA Diamond (all three confirmed absent on 2026-10-08/10 by direct no-row checks) |
| MiniMax M2.7 | DeepSWE |
| Hy4 preview | SciCode, AA-LCR |
| LongCat-2.0 | DeepSWE |
| LongCat 2.5 Preview Free | all five: DeepSWE, Terminal-Bench 2.1, SciCode, AA-LCR, GPQA Diamond |
| Space Bunny | all five: DeepSWE, Terminal-Bench 2.1, SciCode, AA-LCR, GPQA Diamond |
| Union Alpha Free | Terminal-Bench 2.1, SciCode, AA-LCR, GPQA Diamond (no credible source; only unverified portal numbers exist) |

Quasi-gaps recorded as warnings rather than gaps: MiMo-V2.6 Pro/Flash DeepSWE values are vendor-run and are not displayed on the live Datacurve leaderboard (only gated dataset card/Benchgen mirrors); Kimi K2.7 Code, Kimi K2.6, GLM-5.1, Qwen3.6 Plus and MiniMax M3 DeepSWE values are aggregator or unofficial-community records rather than fresh Datacurve runs; Step 5 Preview's TB 2.1 = 85.0 and DeepSWE = 67.7 are vendor-reported with no independent replication; Qwen3.8 Max's 0902-refresh DeepSWE = 69.3 is lab-reported only.

## Key caveats

1. **DeepSeek V4 Flash and V4 Flash Vision Exp were retired on 2026-09-10**; the legacy API names "are temporarily routed to V4.1 Flash" (billed at Flash price) yet GO still lists both as separate entries, and what GO actually serves under them is not stated ([change log](https://api-docs.deepseek.com/updates/), 2026-09-10; [pricing page](https://api-docs.deepseek.com/quick_start/pricing/), accessed 2026-10-10; [opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).
2. **DeepSeek V4 Pro's phase-out was announced then reversed the same day** — the 2026-09-10 news post said requests would route to V4.1 Flash from Sep 14, while the same-day changelog says API service continues with unchanged billing; the pricing page and GO both still list V4 Pro with its own prices (accessed 2026-10-10). Routing behavior for `deepseek-v4-pro` could not be tested directly ([news260910](https://api-docs.deepseek.com/news/news260910); [updates](https://api-docs.deepseek.com/updates/)).
3. **Space Bunny's identity remains unconfirmed**; the MiniMax-family (M3.1-candidate) hypothesis rests on tokenizer fingerprinting (24/24, 36/36, 50/50 matches) and trait overlap with MiniMax "M3.1-Flash-Preview", but neither MiniMax nor OpenRouter/OpenCode has named the provider, and no model card, weights or paper exist ([CellCog](https://cellcog.ai/blog/what-is-space-bunny-alpha/), 2026-09-27; [Toolbit](https://www.toolbit.ai/blog/space-bunny-alpha-minimax-m3-1-flash), 2026-09-28; [didcodexreset](https://didcodexreset.com/news/d544e395986844b3b8085202.html), 2026-10-06). Expect a first-party reveal with a new codename-to-name mapping.
4. **Muse Spark Contributor models train on your prompts and completions** — "heavily discounted token pricing in exchange for permission to use your prompts and completions to train future Meta models" — and availability is limited to regions permitted by Meta's Geographic Use Policy; GO retains these restrictions ([dev.meta.ai pricing](https://dev.meta.ai/docs/pricing-rate-limits), accessed 2026-10-10; [opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).
5. **Claude Haiku 5.5 has no DeepSWE, Terminal-Bench 2.1 or GPQA Diamond result published anywhere as of 2026-10-10** — a systematic absence: it launched Oct 7, after Vals archived its TB 2.1 boards and after AA stopped including GPQA on new models (its AA index value is 43; Vals reports TB 4.0 = 35.35 and Anthropic reports TB 4.0 = 39.2, both different versions) ([The Model Gap](https://themodelgap.com/models/claude-haiku-5-5), 2026-10-08; [AA article](https://artificialanalysis.ai/articles/claude-haiku-5-5), 2026-10-07).
6. **LongCat 2.5 Preview Free and Space Bunny have no scores on any of the five tracked benchmarks.** LongCat 2.5 does have a third-party coding evaluation (AI Coding Daily 46.65, OpenCode harness) and Space Bunny 57.19 — neither maps to DeepSWE/TB 2.1/SciCode/AA-LCR/GPQA, and LongCat-2.0's scores must not be substituted for LongCat 2.5 ([aicodingdaily.com](https://aicodingdaily.com/model/longcat-2-5-preview); [BenchmarkList](https://benchmarklist.com/models/meituan-longcat-2.5-preview), 2026-10-10).
7. **Never compare vendor TB 2.1 with independent Terminus 2 TB 2.1 across the boundary** — the gaps are systematic and large (MiMo-V2.6-Pro 89.9 vs 67.79; GLM-5.3 88.2 vs 71.5; Qwen3.8 Max 86.6 vs 67.4; MiniMax M3 66.0 vs 53.56; LongCat-2.0 70.8 vs 50.19). Pick one column and stay in it; this report's selected values are uniform-independents where they exist ([Vals AI](https://www.vals.ai/benchmarks/terminal-bench-2-1), 2026-09-28; vendor cards as listed per model).
8. **AA SciCode is "under review"** after an independent audit flagged possible dataset errors (SciCode-Verified, [arXiv:2608.04975](https://arxiv.org/abs/2608.04975)), so **every selected SciCode value in this report may be revised** ([AA SciCode](https://artificialanalysis.ai/evaluations/scicode), accessed 2026-10-10).
9. **Many AA values were retrieved via BenchLM.ai citation tables** because AA's own charts are client-rendered and did not yield per-model values in fetched pages; treat the AA attribution as reliable but re-verify in a browser before publishing where precision matters ([BenchLM](https://benchlm.ai), 2026-10-10).
10. **Benchmark-version labels matter**: TB 2.0/3.0/4.0 values (e.g., DeepSeek V4 Pro TB 2.0 67.9; Kimi K2.6 TB 2.0 66.7; GLM-5.1 TB 2.0 63.5; Qwen3.7 Max TB 2.0 69.7; MiMo-V2.5 TB 2.0 65.8) are not TB 2.1; DeepSWE v1-era aggregator rows (Kimi K2.6 23.89; GLM-5.1 17.48; Qwen3.6 Plus 2.65; MiMo-V2.5-Pro 19) are only roughly comparable to v1.1 board values; AA Intelligence Index versions churn (e.g., GPT-6 Astra 61.2 on v4.1.1 vs 53 on v4.3.2; MiniMax M3 55/45/29.2 across snapshots) and must not be compared across versions.
11. **Grok 4.6's DeepSWE configuration labels conflict** (vendor 65.9 "High" vs 65.2 in a later xAI table; Datacurve fetched row labeled "[medium]" while its chart says XHIGH; BenchLM mirror 66.7 xhigh) — all recorded; no single authoritative config label ([deepswe.datacurve.ai](https://deepswe.datacurve.ai), 2026-09-22).
12. **Epoch AI GPQA values for GPT-6 Sol (94.3), GPT-6 Luna (90.5) and Grok 4.7 (92.7) are relayed by aggregators** (BenchLeader, SuperIndex, LLMs Tiger, models.fru.dev) because Epoch's own per-model pages show a rounded best score; the dates shown are publish dates (2026-09-22 for Sol/Luna), and low-confidence outliers (gpqa.ai's contamination-adjusted 98.4; armes.ai 94.9; an unsourced 96.0 for Luna) are excluded ([BenchLeader](https://www.benchleader.com/benchmarks/gpqa_diamond), 2026-10-10).
13. **Limited-time rows must be re-verified before publishing**: LongCat 2.5 Preview Free and Step 5 Preview Free are "Free… limited time" with unlimited usage, and the LongCat free window (announced as two weeks from ~2026-09-26) was ending around 2026-10-10; Space Bunny's GO entry is priced but Zen still shows a free route ([opencode.ai/docs/go](https://opencode.ai/docs/go), 2026-10-10).

## Bottom line for the spreadsheet update

Adopting the selected-value policy changes the sheet in three ways beyond the roster edits. First, **15 of the selected values now come from sources that did not exist when the original sheet was built**: fresh Datacurve board entries (Kimi K3 69, GLM-5.3 69, GLM-5.3-Flash 63, GLM-5.2 44, DeepSeek V4 Pro 63, DeepSeek V4 Flash 53, Muse Spark 1.2 55.0, GPT-5.6 Luna 67, GPT-6 Astra 74, Gemini 3.8 Flash 74, Grok 4.6 67, Qwen3.8 Max 57.5) and first-ever Epoch AI GPQA rows (GPT-6 Sol 94.3, GPT-6 Luna 90.5, Grok 4.7 92.7). Second, **several widely-quoted vendor numbers drop out of the headline column** — every vendor TB 2.1 figure is preserved as an alternative but replaced by the Terminus 2 comparator, which cuts typical vendor claims by 10–20 points. Third, six previously untracked models gain rows, but two of them (Space Bunny, LongCat 2.5 Preview Free) enter as documented blanks rather than as zeroes or proxy values — the sheet should mark them "not found", not empty, so the absence is itself evidenced. The models with the widest coverage gaps (DeepSeek V4 Flash Vision Exp; Claude Haiku 5.5; and the all-blank Space Bunny and LongCat 2.5 Preview Free) are the cells a future update should re-check first; everything else is already traceable to a dated URL in the tables above.

---
## Extended benchmarks (added 2026-10-10)
A second research pass added six data points to the matrix: **SWE-bench Pro**, **Terminal-Bench 4.0**, **MMLU-Pro**, published **math** scores, the two composite indices (**Artificial Analysis Coding Agent Index**, **Vals Index**), and the Datacurve **DeepSWE run metadata** (± confidence interval, steps, output tokens). The spreadsheet's Score now averages benchmark ranks over the 8 scored benchmarks (DeepSWE · TB 2.1 · SciCode · AA-LCR · GPQA · SWE-bench Pro · TB 4.0 · MMLU-Pro); the composites and Math are informational only (a Math column mixes different benchmarks per vendor, and composites are aggregates of other columns). Selection policy is unchanged: uniform independent source first, then vendor, then other independent aggregators. Full candidate values with URLs and dates: the 'Sources' tab of the updated workbook.
| Model | GO | SWE-bench Pro | TB 4.0 | MMLU-Pro | Math | AA CI Index | Vals Index | DeepSWE ±CI | steps | out-tok ||---|---|---|---|---|---|---|---|---|---|---|| Grok 4.7 | In | nf | 37.58 [vals] | nf | nf | 56.3 [agg] | 54.95 [official] | nf | nf | nf || Grok 4.6 | In | nf | 20.3 [vals] | 89.4 [agg] | nf | 47 [agg] | 52.09 [official] | 2 [datacurve] | 70 [datacurve] | 50 [datacurve] || GLM-5.3-Flash | In | nf | 32.8 [aa] | 86.1 [agg] | 93.9 [agg] | 71.5 [agg] | nf | 4 [datacurve] | 123 [datacurve] | 73 [datacurve] || GLM-5.3 | In | 64.6 [vendor] | 41.9 [aa] | nf | 68.8 [agg] | 74.8 [official] | 53.51 [official] | 3 [datacurve] | 124 [datacurve] | 80 [datacurve] || GLM-5.2 | In | 62.1 [vendor] | 1 [aa] | 86.7 [agg] | 99.2 [vendor] | 68.8 [official] | 65.02 [official] | 2 [datacurve] | 129 [datacurve] | 78 [datacurve] || GPT 6 Luna | In | nf | 16.36 [vals] | nf | nf | 41.1 [agg] | 51.22 [official] | nf | nf | nf || GPT 5.6 Luna | In | 62.7 [vendor] | 17.27 [vals] | 86.04 [agg] | 78.6 [vendor] | 43.2 [agg] | 51.69 [official] | 4 [datacurve] | 102 [datacurve] | 73 [datacurve] || Claude Haiku 5.5 | In | 64.8 [indep] | 39.2 [vendor] | nf | nf | nf | 54.31 [official] | nf | nf | nf || Kimi K3 | In | 63.3 [indep] | 12.6 [aa] | 88 [agg] | 65.6 [agg] | 76.2 [official] | 50.3 [official] | 5 [datacurve] | 98 [datacurve] | 81 [datacurve] || Kimi K2.7 Code | In | nf | 1 [agg] | nf | nf | 60.8 [agg] | nf | nf | nf | nf || Kimi K2.6 | In | 58.6 [vendor] | nf | 87.6 [agg] | 96.4 [vendor] | 61.8 [official] | 55.17 [official] | nf | nf | nf || LongCat-2.0 | In | 59.5 [vendor] | nf | nf | 81.8 [vendor] | nf | nf | nf | nf | nf || LongCat 2.5 Preview Free | In | nf | nf | nf | nf | nf | nf | nf | nf | nf || Step 5 Preview Free | In | nf | 31.82 [vals] | nf | 42 [agg] | 51.2 [official] | 49.35 [official] | nf | nf | nf || MiMo-V2.6-Flash | In | nf | 24.24 [vals] | nf | nf | nf | 53.23 [official] | nf | nf | nf || MiMo-V2.6-Pro | In | 47.6 [vendor] | 31.31 [vals] | nf | nf | nf | 55.2 [official] | nf | nf | nf || MiMo-V2.5 | In | 56.1 [vendor] | nf | 82.93 [agg] | nf | nf | 49.89 [official] | nf | nf | nf || MiMo-V2.5-Pro | In | 57.2 [vendor] | 0.51 [vals] | 84.59 [agg] | nf | nf | 33.84 [official] | 2 [datacurve] | nf | nf || MiniMax M3 | In | 59 [vendor] | 1.01 [vals] | 84.22 [agg] | nf | nf | 36.53 [official] | nf | nf | nf || MiniMax M2.7 | In | 56.2 [vendor] | nf | 80.43 [agg] | 94.2 [vendor] | nf | 60.14 [official] | nf | nf | nf || Muse Spark 1.3 Contributor | In | nf | 10.61 [vals] | nf | 55 [agg] | 54.3 [official] | 58.16 [official] | nf | nf | nf || Muse Spark 1.2 Contributor | In | nf | 6.06 [vals] | 88.28 [agg] | 43 [agg] | nf | 49.29 [official] | 2 [datacurve] | 101 [datacurve] | 99 [datacurve] || Qwen3.8 Max | In | 67.7 [vendor] | 34.34 [vals] | 88.6 [agg] | 75 [agg] | 43.3 [agg] | 48.27 [official] | 3 [datacurve] | 111 [datacurve] | 95 [datacurve] || Qwen3.8 Flash | In | 62.5 [vendor] | 25 [vals] | nf | nf | 73 [agg] | nf | nf | nf | nf || Qwen3.7 Plus | In | 57.6 [vendor] | nf | 88.5 [vendor] | 92.9 [vendor] | 55.9 [agg] | nf | nf | nf | nf || DeepSeek V4.1 Flash | In | nf | 26.77 [vals] | 81.2 [aa] | 65.6 [vendor] | nf | 51.32 [official] | nf | nf | nf || DeepSeek V4 Pro | In | 55.4 [vendor] | 14.14 [vals] | 86.97 [agg] | 65.3 [vendor] | 43.1 [agg] | 47.63 [official] | 6 [datacurve] | 155 [datacurve] | 106 [datacurve] || DeepSeek V4 Flash | In | nf | 18.69 [vals] | 86.21 [agg] | 58.6 [vendor] | 38.7 [agg] | 47.96 [official] | 4 [datacurve] | 153 [datacurve] | 108 [datacurve] || DeepSeek V4 Flash Vision Exp | In | nf | 12.1 [aa] | nf | 36.5 [other] | nf | nf | nf | nf | nf || Hy4 preview | In | 65.7 [vendor] | 8.08 [vals] | nf | nf | nf | 49.94 [official] | nf | nf | nf || Hy3 | In | nf | nf | nf | nf | nf | nf | nf | nf | nf || Space Bunny | In | nf | nf | nf | nf | nf | nf | nf | nf | nf || GPT-6 Astra | Out | nf | 58.18 [vals] | nf | 97.6 [vendor] | 61.6 [official] | 63.13 [official] | 3 [datacurve] | 29 [datacurve] | 30 [datacurve] || Gemini 3.8 Flash | Out | nf | 19.09 [agg] | 90.22 [agg] | nf | 41.9 [agg] | 54.83 [official] | 1 [datacurve] | 166 [datacurve] | 143 [datacurve] || GPT-6 Sol | Out | nf | 49.39 [vals] | nf | nf | 56.7 [agg] | 57.54 [official] | nf | nf | nf || Qwen3.7 Max | Out | 60.6 [vendor] | nf | 89.31 [agg] | 65 [agg] | 66 [agg] | nf | nf | nf | nf || Qwen3.6 Plus | Out | 56.6 [vendor] | nf | 87.67 [agg] | 26.207 [agg] | 54.5 [agg] | nf | nf | nf | nf || GLM-5.1 | Out | 58.4 [vendor] | nf | 86.9 [aa] | 95.3 [vendor] | 55.8 [official] | 52.45 [official] | nf | nf | nf || Union Alpha Free | Out | nf | 51 [vendor] | nf | 88 [vendor] | nf | nf | nf | nf | nf |
Legend: `[vendor]` self-reported · `[indep]`/`[agg]`/`[official-board]`/`[vals]`/`[aa]`/`[datacurve]` independent · `[official]` composite from its own publisher. NF = no published value found as of 2026-10-10.
**Gaps (no evidence found):** Claude Haiku 5.5 — aa_coding_index; Claude Haiku 5.5 — deepswe_ci; Claude Haiku 5.5 — deepswe_outtok; Claude Haiku 5.5 — deepswe_steps; Claude Haiku 5.5 — math; Claude Haiku 5.5 — mmlu_pro; DeepSeek V4 Flash — swebench_pro; DeepSeek V4 Flash Vision Exp — aa_coding_index; DeepSeek V4 Flash Vision Exp — deepswe_ci; DeepSeek V4 Flash Vision Exp — deepswe_outtok; DeepSeek V4 Flash Vision Exp — deepswe_steps; DeepSeek V4 Flash Vision Exp — mmlu_pro; DeepSeek V4 Flash Vision Exp — swebench_pro; DeepSeek V4 Flash Vision Exp — vals_index; DeepSeek V4.1 Flash — aa_coding_index; DeepSeek V4.1 Flash — deepswe_ci; DeepSeek V4.1 Flash — deepswe_outtok; DeepSeek V4.1 Flash — deepswe_steps; DeepSeek V4.1 Flash — swebench_pro; GLM-5.1 — deepswe_ci; GLM-5.1 — deepswe_outtok; GLM-5.1 — deepswe_steps; GLM-5.1 — tb40; GLM-5.3 — mmlu_pro; GLM-5.3-Flash — swebench_pro; GLM-5.3-Flash — vals_index; GPT 6 Luna — deepswe_ci; GPT 6 Luna — deepswe_outtok; GPT 6 Luna — deepswe_steps; GPT 6 Luna — math; GPT 6 Luna — mmlu_pro; GPT 6 Luna — swebench_pro; GPT-6 Astra — mmlu_pro; GPT-6 Astra — swebench_pro; GPT-6 Sol — deepswe_ci; GPT-6 Sol — deepswe_outtok; GPT-6 Sol — deepswe_steps; GPT-6 Sol — math; GPT-6 Sol — mmlu_pro; GPT-6 Sol — swebench_pro; Gemini 3.8 Flash — math; Gemini 3.8 Flash — swebench_pro; Grok 4.6 — math; Grok 4.6 — swebench_pro; Grok 4.7 — deepswe_ci; Grok 4.7 — deepswe_outtok; Grok 4.7 — deepswe_steps; Grok 4.7 — math; Grok 4.7 — mmlu_pro; Grok 4.7 — swebench_pro; Hy3 — aa_coding_index; Hy3 — deepswe_ci; Hy3 — deepswe_outtok; Hy3 — deepswe_steps; Hy3 — math; Hy3 — mmlu_pro; Hy3 — swebench_pro; Hy3 — tb40; Hy3 — vals_index; Hy4 preview — aa_coding_index; Hy4 preview — deepswe_ci; Hy4 preview — deepswe_outtok; Hy4 preview — deepswe_steps; Hy4 preview — math; Hy4 preview — mmlu_pro; Kimi K2.6 — deepswe_ci; Kimi K2.6 — deepswe_outtok; Kimi K2.6 — deepswe_steps; Kimi K2.6 — tb40; Kimi K2.7 Code — deepswe_ci; Kimi K2.7 Code — deepswe_outtok; Kimi K2.7 Code — deepswe_steps; Kimi K2.7 Code — math; Kimi K2.7 Code — mmlu_pro; Kimi K2.7 Code — swebench_pro; Kimi K2.7 Code — vals_index; LongCat 2.5 Preview Free — aa_coding_index; LongCat 2.5 Preview Free — deepswe_ci; LongCat 2.5 Preview Free — deepswe_outtok; LongCat 2.5 Preview Free — deepswe_steps; LongCat 2.5 Preview Free — math; LongCat 2.5 Preview Free — mmlu_pro; LongCat 2.5 Preview Free — swebench_pro; LongCat 2.5 Preview Free — tb40; LongCat 2.5 Preview Free — vals_index; LongCat-2.0 — aa_coding_index; LongCat-2.0 — deepswe_ci; LongCat-2.0 — deepswe_outtok; LongCat-2.0 — deepswe_steps; LongCat-2.0 — mmlu_pro; LongCat-2.0 — tb40; LongCat-2.0 — vals_index; MiMo-V2.5 — aa_coding_index; MiMo-V2.5 — deepswe_ci; MiMo-V2.5 — deepswe_outtok; MiMo-V2.5 — deepswe_steps; MiMo-V2.5 — math; MiMo-V2.5 — tb40; MiMo-V2.5-Pro — aa_coding_index; MiMo-V2.5-Pro — deepswe_outtok; MiMo-V2.5-Pro — deepswe_steps; MiMo-V2.5-Pro — math; MiMo-V2.6-Flash — aa_coding_index; MiMo-V2.6-Flash — deepswe_ci; MiMo-V2.6-Flash — deepswe_outtok; MiMo-V2.6-Flash — deepswe_steps; MiMo-V2.6-Flash — math; MiMo-V2.6-Flash — mmlu_pro; MiMo-V2.6-Flash — swebench_pro; MiMo-V2.6-Pro — aa_coding_index; MiMo-V2.6-Pro — deepswe_ci; MiMo-V2.6-Pro — deepswe_outtok; MiMo-V2.6-Pro — deepswe_steps; MiMo-V2.6-Pro — math; MiMo-V2.6-Pro — mmlu_pro; MiMo-V2.6-Pro — swebench_pro; MiniMax M2.7 — aa_coding_index; MiniMax M2.7 — deepswe_ci; MiniMax M2.7 — deepswe_outtok; MiniMax M2.7 — deepswe_steps; MiniMax M2.7 — tb40; MiniMax M3 — aa_coding_index; MiniMax M3 — deepswe_ci; MiniMax M3 — deepswe_outtok; MiniMax M3 — deepswe_steps; MiniMax M3 — math; Muse Spark 1.2 Contributor — aa_coding_index; Muse Spark 1.2 Contributor — swebench_pro; Muse Spark 1.3 Contributor — deepswe_ci; Muse Spark 1.3 Contributor — deepswe_outtok; Muse Spark 1.3 Contributor — deepswe_steps; Muse Spark 1.3 Contributor — mmlu_pro; Muse Spark 1.3 Contributor — swebench_pro; Qwen3.6 Plus — aa_coding_index; Qwen3.6 Plus — deepswe_ci; Qwen3.6 Plus — deepswe_outtok; Qwen3.6 Plus — deepswe_steps; Qwen3.6 Plus — tb40; Qwen3.7 Max — aa_coding_index; Qwen3.7 Max — deepswe_ci; Qwen3.7 Max — deepswe_outtok; Qwen3.7 Max — deepswe_steps; Qwen3.7 Max — tb40; Qwen3.7 Plus — aa_coding_index; Qwen3.7 Plus — deepswe_ci; Qwen3.7 Plus — deepswe_outtok; Qwen3.7 Plus — deepswe_steps; Qwen3.7 Plus — tb40; Qwen3.8 Flash — aa_coding_index; Qwen3.8 Flash — deepswe_ci; Qwen3.8 Flash — deepswe_outtok; Qwen3.8 Flash — deepswe_steps; Qwen3.8 Flash — math; Qwen3.8 Flash — mmlu_pro; Qwen3.8 Flash — vals_index; Qwen3.8 Max — aa_coding_index; Space Bunny — aa_coding_index; Space Bunny — deepswe_ci; Space Bunny — deepswe_outtok; Space Bunny — deepswe_steps; Space Bunny — math; Space Bunny — mmlu_pro; Space Bunny — swebench_pro; Space Bunny — tb40; Space Bunny — vals_index; Step 5 Preview Free — deepswe_ci; Step 5 Preview Free — deepswe_outtok; Step 5 Preview Free — deepswe_steps; Step 5 Preview Free — mmlu_pro; Step 5 Preview Free — swebench_pro; Union Alpha Free — aa_coding_index; Union Alpha Free — deepswe_ci; Union Alpha Free — deepswe_outtok; Union Alpha Free — deepswe_steps; Union Alpha Free — mmlu_pro; Union Alpha Free — swebench_pro; Union Alpha Free — vals_index
**Recurring caveats for this pass:** (1) SWE-bench Pro was almost entirely *vendor-sourced* — Scale's own leaderboard did not resolve for most models, so treat cross-model gaps cautiously; (2) TB 4.0 runs split sharply by harness (vendor vs mini-swe-agent/Terminus 2 — MiniMax M3: 1.01 vs 66.0 on *different* TB versions; only like-for-like comparisons count); (3) the Vals Index methodology changed (v2.0→v2.1 on 2026-09-25, TB 4.0 replacing TB 2.1 etc.), so older notes/trajectory values differ from current page values; (4) the public AA Coding Agent Index v1.5 page is gated for many rows — per-model AA composite values from AA model pages were used as proxy; (5) MMLU-Pro values come from Vals/AA where possible, vendors otherwise; (6) math benchmarks differ per vendor (AIME 2026, MathArena Apex, FrontierMath, HMMT, IMO-AnswerBench) — cross-model comparability is weak.
**DeepSWE run metadata (Datacurve board rows only):** present for models with a Datacurve row (Kimi K3, GLM-5.3/5.3-Flash/5.2, DeepSeek V4 Pro/V4 Flash, GPT-6 Astra/Sol, Grok 4.6/4.7, Muse Spark 1.2, etc. where found); it is not part of any score.