Independent unofficial site. Not affiliated with Google, Google DeepMind, or Alphabet. Gemini is a trademark of Google.
The Hydrogen Brief An independent, unofficial guide EN · 中文

Gemini 4 Hydrogen benchmarks

Every row below is a published figure, not a test run by this site. Google’s model card (results as of November 2026) is one table; the 12 November 2026 announcement blog adds Artificial Analysis 51 / 54, Agent Arena #5, and named Vals scores; Vals AI and OpenRouter publish their own numbers. Do not mix benchmark editions.

Do not mix benchmark editions. Google’s Hydrogen table uses Terminal-Bench 4.1 (57.0%). Vals AI’s model page, retrieved 13 November 2026, reports Terminal-Bench 4.0 (54.04%). Anthropic’s Sonnet 5.5 announcement uses Terminal-Bench 4.0 for a different model. Those are not one ranking. Vals Legal Research Bench is 55.8% (tied #1) in Google’s blog and 53.85% (#6 of 94) on Vals’s own page when we retrieved it; we keep both attributions rather than picking one.

Source: Google DeepMind, 12 November 2026 · Source: Google Blog, 12 November 2026 · Source: Vals AI (independent), Retrieved 13 November 2026 · Source: OpenRouter (independent), Retrieved 13 November 2026

Published Gemini 4 Hydrogen scores only. This site has not rerun any evaluation.
BenchmarkEdition / notesHydrogen scoreSettingWho measuredDateLink
SWE-sweepas published13.5%—Google DeepMind model cardResults as of November 2026Source
Terminal-Bench 4.1cheating-adjusted57.0%—Google DeepMind model cardResults as of November 2026Source
Terminal-Bench 4.1vs Gemini 3.8 Flash (18.2%)57%high default (blog wording)Google announcement blog12 November 2026Source
Agents’ Last Exam v1.1score71.6%—Google DeepMind model cardResults as of November 2026Source
AutomationBench-AAas published76.1%—Google DeepMind model cardResults as of November 2026Source
Vending-Bench 2bank balance ($)$14,549—Google DeepMind model cardResults as of November 2026Source
OSWorld-2.1offline subset77.6%—Google DeepMind model cardResults as of November 2026Source
MKAClimb WSR accuracy53.4%—Google DeepMind model cardResults as of November 2026Source
Chartographyas published66.6%—Google DeepMind model cardResults as of November 2026Source
Terminal-Bench-Science 0.1as published51.4%—Google DeepMind model cardResults as of November 2026Source
HLE-Diamondas published58.8%—Google DeepMind model card; also named on the announcement blogResults as of November 2026 / 12 November 2026Source
Artificial Analysis Intelligence Indexas published by Google51default high thinkingGoogle announcement blog12 November 2026Source
Artificial Analysis Intelligence Indexas published by Google54xhigh thinkingGoogle announcement blog12 November 2026Source
Agent Arenalive benchmark, arena.ai (Google’s report)#5—Google announcement blog12 November 2026Source
Vals Tax Agent BenchGoogle’s report of a Vals figure52.3% (#1 overall)—Google announcement blog12 November 2026Source
Vals Legal Research BenchGoogle’s report of a Vals figure55.8% (tied #1)—Google announcement blog12 November 2026Source
Vals IndexVals Index (Vals’s page lists v2.2 in its write-up)68.49% ± 0.99 (#6 of 37)default (Vals page)Vals AI (independent)Retrieved 13 November 2026Source
Tax Agent BenchVals’s own page52.30% ± 3.60 (#1 of 85)default (Vals page)Vals AI (independent)Retrieved 13 November 2026Source
Terminal-Bench 4.0Vals’s own page; not the same edition as Google’s 4.154.04% ± 3.31 (#11 of 64)default (Vals page)Vals AI (independent)Retrieved 13 November 2026Source
Vibe Code Bench v1.1Vals’s own page87.78% ± 2.29 (#13 of 128)default (Vals page)Vals AI (independent)Retrieved 13 November 2026Source
Models Arena Game Development EloOpenRouter summary table, source column “Design Arena”1357—OpenRouter (independent)Retrieved 13 November 2026Source

Google’s model-card table also reports Claude Sonnet 5.5 and GPT-6.1 Terra in the same cells; those comparison columns are on the compare page. We do not invent a Hydrogen-versus-Sol official table. A separate Anthropic Terminal-Bench 4.0 number for Sonnet 5.5 is noted there and is not copied into this Hydrogen score list.