Records

All records, grouped by game

40 records: 19 verified, 18 creator-reported, 3 awaiting verification.

Pokémon Blue

Pokémon Blue
ModelAchievementRun configStatusDate
Gemini 3.8 Flash Memorable fail 3 of 8 badges in Pokémon Blue, run finished after 5,648 turns
Last verified: Oct 18, 2026 · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 3.8 Flash
Game
Pokémon Blue
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness (mGBA emulator)
Inputs
emulator frames + game-state analysis
Tools
custom subagents, Python sandbox, notepads (published on GitHub)
Assistance
not disclosed
Budget
not disclosed
Verification
Verified Hub game-state telemetry. The game is inferred from the hub run name ('blue_'); this run has no public repo branch.
Evidence
Hub telemetry: run blue_gemini_3_8_flash (primary)
Unknown
why the run was marked finished; whether it was a timed or capped run
Dates
started Oct 6, 2026 · evidence dated Oct 14, 2026
Recorded
published Oct 14, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
No change detected since we started tracking.
Permanent link · Submit a correction · JSON
Gemini Plays Pokémon harness (mGBA emulator)
emulator frames + game-state analysis
Verified Oct 14, 2026
Gemini 4 Argon 8 of 8 badges in Pokémon Blue, run finished after 1,753 turns
Same game, same hub: Gemini 4 Argon reached 8 badges in about a third of the turns Gemini 3.8 Flash used for 3.
Last verified: Oct 18, 2026 · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 4 Argon
Game
Pokémon Blue
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness (mGBA emulator)
Inputs
emulator frames + game-state analysis
Tools
custom subagents, Python sandbox, notepads (published on GitHub)
Assistance
not disclosed
Budget
not disclosed
Verification
Verified Hub game-state telemetry. The game is inferred from the hub run name ('blue_'); this run has no public repo branch.
Evidence
Hub telemetry: run blue_gemini_4_argon (primary)
Unknown
why the run was marked finished; whether it was a timed or capped run
Dates
started Oct 10, 2026 · evidence dated Oct 11, 2026
Recorded
published Oct 11, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
No change detected since we started tracking.
Permanent link · Submit a correction · JSON
Gemini Plays Pokémon harness (mGBA emulator)
emulator frames + game-state analysis
Verified Oct 11, 2026
Gemini 3.8 Flash 8 of 8 badges in Pokémon Blue (47,889 turns, idle)
Last verified: Oct 18, 2026 · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 3.8 Flash
Game
Pokémon Blue
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness, 'vision-first' setup
Inputs
vision-first (exact inputs not documented)
Tools
custom subagents, Python sandbox, notepads (published on GitHub)
Assistance
not disclosed
Budget
not disclosed
Verification
Verified Badges from hub telemetry; game confirmed by the run's notepad in the public repo.
Evidence
Hub telemetry: run vision_first_gemini_3_8_flash (primary)
Public repo branch vision_first_gemini_3_8_flash (turn-by-turn commits) (primary)
Run notepad (names the game as Pokémon Blue) (creator)
Dates
started Sep 3, 2026 · evidence dated Sep 27, 2026
Recorded
published Sep 27, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
No change detected since we started tracking.
Permanent link · Submit a correction · JSON
Gemini Plays Pokémon harness, 'vision-first' setup
vision-first (exact inputs not documented)
Verified Sep 27, 2026
Gemini 3.8 Flash Became Champion of Pokémon Blue at turn 24,981 (Hall of Fame at turn 24,994)
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 3.8 Flash
Game
Pokémon Blue
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness, 'vision-first' setup
Inputs
vision-first (exact inputs not documented)
Tools
custom subagents, Python sandbox, notepads (published on GitHub)
Assistance
not disclosed
Budget
not disclosed
Verification
Creator-reported Turn numbers come from the AI's own notepad checklist, not from game state.
Evidence
Hub telemetry: run vision_first_gemini_3_8_flash (primary)
Public repo branch vision_first_gemini_3_8_flash (turn-by-turn commits) (primary)
Run notepad: Champion at turn 24,981, Hall of Fame at turn 24,994 (creator)
Dates
started Sep 3, 2026 · evidence dated Sep 27, 2026
Recorded
published Sep 27, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · Share card (PNG) · JSON
Gemini Plays Pokémon harness, 'vision-first' setup
vision-first (exact inputs not documented)
Creator-reported Sep 27, 2026
Gemini 3.7 Flash 8 of 8 badges in Pokémon Blue (55,601 turns, idle)
Last verified: Oct 18, 2026 · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 3.7 Flash
Game
Pokémon Blue
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness, 'vision-first' setup
Inputs
vision-first (exact inputs not documented)
Tools
custom subagents, Python sandbox, notepads (published on GitHub)
Assistance
not disclosed
Budget
not disclosed
Verification
Verified Badges from hub telemetry; game confirmed by the run's notepad in the public repo.
Evidence
Hub telemetry: run vision_first_gemini_3_7_flash (primary)
Public repo branch vision_first_gemini_3_7_flash (turn-by-turn commits) (primary)
Run notepad (names the game as Pokémon Blue) (creator)
Dates
started Aug 16, 2026 · evidence dated Sep 19, 2026
Recorded
published Sep 19, 2026 · discovered by AI vs Games Oct 17, 2026
Changes
No change detected since we started tracking.
Permanent link · Submit a correction · JSON
Gemini Plays Pokémon harness, 'vision-first' setup
vision-first (exact inputs not documented)
Verified Sep 19, 2026
Gemini 3.7 Flash Became Champion of Pokémon Blue at turn 39,310
Gemini 3.8 Flash got there about 14,000 turns sooner on the same vision-first setup.
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 3.7 Flash
Game
Pokémon Blue
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness, 'vision-first' setup
Inputs
vision-first (exact inputs not documented)
Tools
custom subagents, Python sandbox, notepads (published on GitHub)
Assistance
not disclosed
Budget
not disclosed
Verification
Creator-reported Turn number comes from the AI's own notepad checklist, not from game state.
Evidence
Hub telemetry: run vision_first_gemini_3_7_flash (primary)
Public repo branch vision_first_gemini_3_7_flash (turn-by-turn commits) (primary)
Run notepad: 'Become Pokémon League Champion and Enter Hall of Fame' at turn 39,310 (creator)
Dates
started Aug 16, 2026 · evidence dated Sep 19, 2026
Recorded
published Sep 19, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
Gemini Plays Pokémon harness, 'vision-first' setup
vision-first (exact inputs not documented)
Creator-reported Sep 19, 2026
Gemini 3.5 Flash Memorable fail 6 of 8 badges in Pokémon Blue (74,636 turns, idle)
Stalled on 6 badges after 74,636 turns, the longest run in the series and the only one without all 8.
Last verified: Oct 18, 2026 · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 3.5 Flash
Game
Pokémon Blue
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness, 'vision-first' setup
Inputs
vision-first (exact inputs not documented)
Tools
custom subagents, Python sandbox, notepads (published on GitHub)
Assistance
not disclosed
Budget
not disclosed
Verification
Verified Badges from hub telemetry; game confirmed by the run's notepad in the public repo.
Evidence
Hub telemetry: run vision_first_gemini_3_5_flash (primary)
Public repo branch vision_first_gemini_3_5_flash (turn-by-turn commits) (primary)
Run notepad (names the game as Pokémon Blue) (creator)
Dates
started Aug 16, 2026 · evidence dated Sep 3, 2026
Recorded
published Sep 3, 2026 · discovered by AI vs Games Oct 17, 2026
Changes
No change detected since we started tracking.
Permanent link · Submit a correction · JSON
Gemini Plays Pokémon harness, 'vision-first' setup
vision-first (exact inputs not documented)
Verified Sep 3, 2026
Gemini 3.6 Flash Memorable fail 4 of 8 badges in Pokémon Blue at turn ~55,800 (last repo commit Aug 15, 2026)
Spent more than 55,000 turns and still had only 4 badges, stuck around Lavender Town.
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 3.6 Flash
Game
Pokémon Blue
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness, 'vision-first' setup
Inputs
vision-first (exact inputs not documented)
Tools
custom subagents, Python sandbox, notepads (published on GitHub)
Assistance
not disclosed
Budget
not disclosed
Verification
Creator-reported Not listed on the hub; badge count is from the AI's notepad.
Evidence
Public repo branch vision_first_gemini_3_6_flash (turn-by-turn commits) (primary)
Run notepad: 'Badges (4/8)' at turn 55,771 (creator)
Dates
evidence dated Aug 15, 2026
Recorded
published Aug 15, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
Gemini Plays Pokémon harness, 'vision-first' setup
vision-first (exact inputs not documented)
Creator-reported Aug 15, 2026
Gemini 3 Pro All 8 badges in a vision-only Pokémon Blue run (last turn 67,315, May 2026)
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 3 Pro
Game
Pokémon Blue
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness, 'vision-only' setup (v2)
Inputs
vision-only
Tools
custom subagents, Python sandbox, notepads (published on GitHub)
Assistance
not disclosed
Budget
not disclosed
Verification
Creator-reported Badge list is from the AI's notepad; this run is not on the hub.
Evidence
Public repo branch gemini_3_pro_vision_only_blue_v2 (turn-by-turn commits) (primary)
Run notepad lists all 8 badges (creator)
Unknown
whether the run reached Champion
Dates
evidence dated May 23, 2026
Recorded
published May 23, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
Gemini Plays Pokémon harness, 'vision-only' setup (v2)
vision-only
Creator-reported May 23, 2026
Gemini 2.5 Pro Gemini 2.5 Pro beats Pokémon Blue with no manual interventions (~406 hours, 36,801 actions)
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 2.5 Pro
Game
Pokémon Blue
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness (2025): Node.js + Lua bridge to mGBA; RAM data plus annotated screenshots; critique, summary and goal prompts; map memory; Pathfinder and Boulder Puzzle Strategist agents (finalized)
Inputs
RAM data + annotated screenshots
Tools
Pathfinder agent, Boulder Puzzle Strategist agent, map memory, critique/summary/goals prompts
Assistance
none (creator-reported)
Budget
not disclosed
Verification
Creator-reported Stated by the run's creator; not independently checked by us.
Evidence
Creator's write-up: The Making of Gemini Plays Pokémon (creator)
Unknown
exact ROM version; reasoning budget; public VOD or log for this run
Dates
achieved Jun 9, 2025 · evidence dated Jun 9, 2025
Recorded
published Jun 9, 2025 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
Gemini Plays Pokémon harness (2025): Node.js + Lua bridge to mGBA; RAM data plus annotated screenshots; critique, summary and goal prompts; map memory; Pathfinder and Boulder Puzzle Strategist agents (finalized)
RAM data + annotated screenshots
Creator-reported Jun 9, 2025
Gemini 2.5 Pro Gemini 2.5 Pro becomes Champion in Pokémon Blue (development run, ~813 hours)
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 2.5 Pro
Game
Pokémon Blue
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness (2025): Node.js + Lua bridge to mGBA; RAM data plus annotated screenshots; critique, summary and goal prompts; map memory; Pathfinder and Boulder Puzzle Strategist agents
Inputs
RAM data + annotated screenshots
Tools
Pathfinder agent, Boulder Puzzle Strategist agent, map memory, critique/summary/goals prompts
Assistance
manual interventions and harness changes during the run (development run)
Budget
not disclosed
Verification
Creator-reported Stated by the run's creator; not independently checked by us.
Evidence
Creator's write-up: The Making of Gemini Plays Pokémon (creator)
Google CEO on X: 'Gemini 2.5 Pro just completed Pokémon Blue!' (May 3, 2025 UTC) (secondary)
TechCrunch: Google's Gemini has beaten Pokémon Blue (with a little help) (secondary)
Unknown
exact ROM version; step or action count for this run; reasoning budget; full list of manual interventions
Dates
achieved May 2, 2025 · evidence dated May 2, 2025
Recorded
published May 2, 2025 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
Gemini Plays Pokémon harness (2025): Node.js + Lua bridge to mGBA; RAM data plus annotated screenshots; critique, summary and goal prompts; map memory; Pathfinder and Boulder Puzzle Strategist agents
RAM data + annotated screenshots
Creator-reported May 2, 2025

Pokémon Emerald

Pokémon Emerald
ModelAchievementRun configStatusDate
Gemini 4 Argon All 8 badges in Pokémon Emerald (now 3,722 turns in, still playing)
Last verified: Oct 18, 2026 · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 4 Argon
Game
Pokémon Emerald
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness (mGBA emulator)
Inputs
emulator frames + game-state analysis
Tools
custom subagents, Python sandbox, notepads (published on GitHub)
Assistance
not disclosed
Budget
not disclosed
Verification
Verified Badge count and turn count read from the hub's game-state telemetry; every turn is committed to the public repo with an emulator save state.
Evidence
Hub telemetry: run emerald_gemini_4_argon (primary)
Public repo branch emerald_gemini_4_argon (turn-by-turn commits) (primary)
Unknown
turn at which the 8th badge was earned; reasoning budget
Dates
started Oct 13, 2026 · evidence dated Oct 18, 2026
Recorded
published Oct 18, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
Last change 2026-10-18: Turns 3707 → 3722
Permanent link · Submit a correction · Share card (PNG) · JSON
Gemini Plays Pokémon harness (mGBA emulator)
emulator frames + game-state analysis
Verified Oct 18, 2026
Gemini 4 Argon Entered the Hall of Fame in Pokémon Emerald (beat Champion Wallace)
Gemini 4 Argon's whole run so far (3,722 turns, post-game included) is under half the 8,825 turns Gemini 3.8 Flash has used to reach 5 badges on the same hub.
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 4 Argon
Game
Pokémon Emerald
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness (mGBA emulator)
Inputs
emulator frames + game-state analysis
Tools
custom subagents, Python sandbox, notepads (published on GitHub)
Assistance
not disclosed
Budget
not disclosed
Verification
Creator-reported Stated in the AI's own run notepad, which logs post-Hall of Fame events. The hub does not expose a Hall of Fame flag, so we have not confirmed it from game state.
Evidence
Hub telemetry: run emerald_gemini_4_argon (primary)
Public repo branch emerald_gemini_4_argon (turn-by-turn commits) (primary)
Run notepad: 'Post-Hall of Fame' section (creator)
Unknown
turn and date of the Hall of Fame entry
Dates
started Oct 13, 2026 · evidence dated Oct 18, 2026
Recorded
published Oct 18, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
Gemini Plays Pokémon harness (mGBA emulator)
emulator frames + game-state analysis
Creator-reported Oct 18, 2026
Gemini 3.8 Flash 5 of 8 badges in Pokémon Emerald after 8,825 turns (live)
Picked up badge 4 (Flannery, Lavaridge Gym) overnight on Oct 17–18 after a long stay in Lavaridge Town.
Last verified: Oct 18, 2026 · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 3.8 Flash
Game
Pokémon Emerald
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness (mGBA emulator)
Inputs
emulator frames + game-state analysis
Tools
custom subagents, Python sandbox, notepads (published on GitHub)
Assistance
not disclosed
Budget
not disclosed
Verification
Verified Hub game-state telemetry plus turn commits in the public repo.
Evidence
Hub telemetry: run emerald_gemini_3_8_flash (primary)
Public repo branch emerald_gemini_3_8_flash (turn-by-turn commits) (primary)
Dates
started Oct 13, 2026 · evidence dated Oct 18, 2026
Recorded
published Oct 18, 2026 · discovered by AI vs Games Oct 17, 2026
Changes
Last change 2026-10-18: Turns 8710 → 8825
Permanent link · Submit a correction · Share card (PNG) · JSON
Gemini Plays Pokémon harness (mGBA emulator)
emulator frames + game-state analysis
Verified Oct 18, 2026
GPT-5.6 Sol Became Champion of Pokémon Emerald in 153h51 (8 badges)
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
GPT-5.6 Sol
Game
Pokémon Emerald
Project
GPT Plays Pokémon
Harness
Codex App Server + custom tools
Inputs
vision-only
Tools
custom tools (not itemised)
Assistance
not disclosed
Budget
not disclosed
Verification
Awaiting verification Sources disagree: BenchmarkList lists 153h51; the creator's later thread says 96h 35m for GPT-5.6 Sol (max). They may be different runs.
Evidence
BenchmarkList: Pokémon Autonomous Completion (self-reported) (secondary)
Creator thread (96h 35m figure) (creator)
Unknown
which figure belongs to which run
Dates
achieved Jul 21, 2026 · evidence dated Jul 21, 2026
Recorded
published Jul 21, 2026 · discovered by AI vs Games Oct 17, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
Codex App Server + custom tools
vision-only
Awaiting verification Jul 21, 2026
Heatz agent (model not disclosed)
Heatz
1st: reached the first gym (Roxanne) in 40:13 (1,608 actions)
Nearly twice as fast as 2nd place.
Last verified: Oct 18, 2026 · Last checked: Oct 18, 2026
How was this run measured?
Model
Heatz agent (model not disclosed) · agent: Heatz
Game
Pokémon Emerald
Project
PokéAgent Challenge (NeurIPS 2025, speedrun track)
Harness
PokéAgent Challenge Emerald environment (real-time; game keeps running while the agent thinks)
Inputs
per team (documented in the paper's appendix)
Tools
Scripted Policy Distillation: an LLM writes scripted policies, distilled into a neural net and refined with RL
Assistance
none allowed during evaluation runs
Budget
scored on wall-clock time and action count
Verification
Verified Official results published by the challenge organizers.
Evidence
PokéAgent Challenge paper (organizers), Sec. 5.2 & App. C (operator)
PokéAgent Challenge: Speedrunning track (operator)
Unknown
underlying model(s) used by the team (not in our source)
Dates
evidence dated Mar 16, 2026
Recorded
published Mar 16, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · Share card (PNG) · JSON
PokéAgent Challenge Emerald environment (real-time; game keeps running while the agent thinks)
per team (documented in the paper's appendix)
Verified Mar 16, 2026
Hamburg PokéRunners agent (model not disclosed)
Hamburg PokéRunners
2nd: reached the first gym in 1:14:43
Last verified: Oct 18, 2026 · Last checked: Oct 18, 2026
How was this run measured?
Model
Hamburg PokéRunners agent (model not disclosed) · agent: Hamburg PokéRunners
Game
Pokémon Emerald
Project
PokéAgent Challenge (NeurIPS 2025, speedrun track)
Harness
PokéAgent Challenge Emerald environment (real-time; game keeps running while the agent thinks)
Inputs
per team (documented in the paper's appendix)
Tools
Pure RL: recurrent PPO with milestone-based rewards
Assistance
none allowed during evaluation runs
Budget
scored on wall-clock time and action count
Verification
Verified Official results published by the challenge organizers.
Evidence
PokéAgent Challenge paper (organizers), Sec. 5.2 & App. C (operator)
PokéAgent Challenge: Speedrunning track (operator)
Unknown
underlying model(s) used by the team (not in our source)
Dates
evidence dated Mar 16, 2026
Recorded
published Mar 16, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
PokéAgent Challenge Emerald environment (real-time; game keeps running while the agent thinks)
per team (documented in the paper's appendix)
Verified Mar 16, 2026
anthonys agent (model not disclosed)
anthonys
3rd: reached the first gym in 1:29:17
Last verified: Oct 18, 2026 · Last checked: Oct 18, 2026
How was this run measured?
Model
anthonys agent (model not disclosed) · agent: anthonys
Game
Pokémon Emerald
Project
PokéAgent Challenge (NeurIPS 2025, speedrun track)
Harness
PokéAgent Challenge Emerald environment (real-time; game keeps running while the agent thinks)
Inputs
per team (documented in the paper's appendix)
Tools
Tool-calling VLM policy (LLM harness)
Assistance
none allowed during evaluation runs
Budget
scored on wall-clock time and action count
Verification
Verified Official results published by the challenge organizers.
Evidence
PokéAgent Challenge paper (organizers), Sec. 5.2 & App. C (operator)
PokéAgent Challenge: Speedrunning track (operator)
Unknown
underlying model(s) used by the team (not in our source)
Dates
evidence dated Mar 16, 2026
Recorded
published Mar 16, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
PokéAgent Challenge Emerald environment (real-time; game keeps running while the agent thinks)
per team (documented in the paper's appendix)
Verified Mar 16, 2026
Deepest agent (model not disclosed)
Deepest
Judge's Choice: fewest actions to the first gym (649), 5th by time
Slowest clock, fewest button presses: a good example of why we never merge metrics.
Last verified: Oct 18, 2026 · Last checked: Oct 18, 2026
How was this run measured?
Model
Deepest agent (model not disclosed) · agent: Deepest
Game
Pokémon Emerald
Project
PokéAgent Challenge (NeurIPS 2025, speedrun track)
Harness
PokéAgent Challenge Emerald environment (real-time; game keeps running while the agent thinks)
Inputs
per team (documented in the paper's appendix)
Tools
LLM harness
Assistance
none allowed during evaluation runs
Budget
scored on wall-clock time and action count
Verification
Verified Official results published by the challenge organizers.
Evidence
PokéAgent Challenge paper (organizers), Sec. 5.2 & App. C (operator)
PokéAgent Challenge: Speedrunning track (operator)
Unknown
underlying model(s) used by the team (not in our source)
Dates
evidence dated Mar 16, 2026
Recorded
published Mar 16, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
PokéAgent Challenge Emerald environment (real-time; game keeps running while the agent thinks)
per team (documented in the paper's appendix)
Verified Mar 16, 2026

Pokémon Crystal

Pokémon Crystal
ModelAchievementRun configStatusDate
Gemini 3 Reached the post-game with 16 badges in Pokémon Crystal by turn 36,290 (race vs Gemini 2.5)
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 3
Game
Pokémon Crystal
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness (Crystal race)
Inputs
emulator frames + game-state analysis
Tools
custom subagents, Python sandbox, notepads (published on GitHub)
Assistance
not disclosed
Budget
not disclosed
Verification
Creator-reported From the AI's notepad. The exact Gemini 3 variant is not named in the branch.
Evidence
Public repo branch crystal_race_gemini_3 (turn-by-turn commits) (primary)
Run notepad: post-game Battle Tower goal; notes '16 badges' (creator)
Unknown
exact model variant (branch says only 'gemini_3'); race rules
Dates
evidence dated Dec 15, 2025
Recorded
published Dec 15, 2025 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
Gemini Plays Pokémon harness (Crystal race)
emulator frames + game-state analysis
Creator-reported Dec 15, 2025
Gemini 2.5 Crystal race opponent of Gemini 3; ran to turn 51,280 (Dec 2025). Final progress not disclosed.
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 2.5
Game
Pokémon Crystal
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness (Crystal race)
Inputs
emulator frames + game-state analysis
Tools
custom subagents, Python sandbox, notepads (published on GitHub)
Assistance
not disclosed
Budget
not disclosed
Verification
Awaiting verification Branch exists, but its notepad does not state badges or the result.
Evidence
Public repo branch crystal_race_gemini_2-5 (turn-by-turn commits) (primary)
Unknown
badges; result of the race; exact model variant
Dates
evidence dated Dec 15, 2025
Recorded
published Dec 15, 2025 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
Gemini Plays Pokémon harness (Crystal race)
emulator frames + game-state analysis
Awaiting verification Dec 15, 2025
GPT-5 Became Champion of Pokémon Crystal in 202h02m (9,517 steps, 16 badges)
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
GPT-5
Game
Pokémon Crystal
Project
GPT Plays Pokémon
Harness
Codex App Server + custom tools
Inputs
vision-only
Tools
custom tools (not itemised)
Assistance
not disclosed
Budget
not disclosed
Verification
Creator-reported Self-reported entry; we have not checked it against VODs.
Evidence
BenchmarkList: Pokémon Autonomous Completion (self-reported) (secondary)
Dates
achieved Aug 25, 2025 · evidence dated Aug 25, 2025
Recorded
published Aug 25, 2025 · discovered by AI vs Games Oct 17, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
Codex App Server + custom tools
vision-only
Creator-reported Aug 25, 2025
GPT-4o (2024-08-06) Memorable fail 0.9% of Pokémon Crystal completed on VideoGameBench (test set, real-time)
Picked Cyndaquil as its starter, then lost track of what it was supposed to do.
Last verified: Oct 18, 2026 · Last checked: Oct 18, 2026
How was this run measured?
Model
GPT-4o (2024-08-06)
Game
Pokémon Crystal
Project
VideoGameBench
Harness
VG-Agent (VideoGameBench reference agent)
Inputs
raw game frames + high-level objective and controls
Tools
none
Assistance
none
Budget
real-time play (game does not pause)
Verification
Verified Official leaderboard published by the benchmark authors.
Evidence
VideoGameBench leaderboard (official) (operator)
VideoGameBench paper (operator)
Dates
evidence dated May 23, 2025
Recorded
published May 23, 2025 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
VG-Agent (VideoGameBench reference agent)
raw game frames + high-level objective and controls
Verified May 23, 2025

Pokémon Red

Pokémon Red
ModelAchievementRun configStatusDate
Jev Jev beats Pokémon Red in 37h 40m with a guided, open-source harness
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
Jev
Game
Pokémon Red
Project
Jev Plays Pokémon Red (jev-pokemon)
Harness
jev-pokemon (open source): RAM reader, A* pathfinding, menu handling, story-milestone guide, loop protection
Inputs
option lists with facts built from RAM (map, party, battle, on-screen text)
Tools
A* pathfinding, milestone checkpoints
Assistance
built-in walkthrough of story objectives; automatic checkpoint reloads when stuck
Budget
about $1.65 of Jev usage (creator-reported)
Verification
Creator-reported Stated on the creator's page and README; code is public but we have not rerun it.
Evidence
Creator's project page: run stats (creator)
Creator's code and README (open source) (creator)
GIGAZINE write-up (Sep 28, 2026) (secondary)
Unknown
exact Hall of Fame date (stream ran Sep 25–26, 2026); number of checkpoint reloads used; public VOD link
Dates
evidence dated Sep 28, 2026
Recorded
published Sep 28, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
jev-pokemon (open source): RAM reader, A* pathfinding, menu handling, story-milestone guide, loop protection
option lists with facts built from RAM (map, party, battle, on-screen text)
Creator-reported Sep 28, 2026
Jev
Jev + Claude Opus 5 harness builder
Jev enters the Pokémon Red Hall of Fame with Claude Opus 5 rebuilding its options live
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
Jev · agent: Jev + Claude Opus 5 harness builder
Game
Pokémon Red
Project
Jev plays Pokémon Red (Standard Agents)
Harness
Standard Agents harness, rebuilt live by Claude Opus 5 (474 changelog entries)
Inputs
option lists with facts built from game state (no screen)
Tools
harness pathing and menu handling; Claude Opus 5 edits the options
Assistance
heavy: LLM coach editing options live, viewer tips used, developer oversight
Budget
not disclosed
Verification
Creator-reported Stated on the creator's project page and covered by Tom's Hardware; not independently checked by us.
Evidence
Creator's project page: Hall of Fame on September 23, 2026 (creator)
Creator's Reddit post (Sep 18, 2026): harness built in real time by Opus 5 (creator)
Tom's Hardware: Jev beat Pokémon Red, but Claude Opus 5 coached it (secondary)
Unknown
total play time; number of Jev decisions; cost; exact ROM version; run start date (creator's Reddit post on Sep 18 shows it already had 4 badges)
Dates
achieved Sep 23, 2026 · evidence dated Sep 27, 2026
Recorded
published Sep 27, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
Standard Agents harness, rebuilt live by Claude Opus 5 (474 changelog entries)
option lists with facts built from game state (no screen)
Creator-reported Sep 23, 2026
GPT-5 Became Champion of Pokémon Red in 161h57m (6,470 steps, 8 badges)
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
GPT-5
Game
Pokémon Red
Project
GPT Plays Pokémon
Harness
Codex App Server + custom tools
Inputs
vision-only
Tools
custom tools (not itemised)
Assistance
not disclosed
Budget
not disclosed
Verification
Creator-reported Self-reported entry; we have not checked it against VODs.
Evidence
BenchmarkList: Pokémon Autonomous Completion (self-reported) (secondary)
Dates
achieved Aug 14, 2025 · evidence dated Aug 14, 2025
Recorded
published Aug 14, 2025 · discovered by AI vs Games Oct 17, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
Codex App Server + custom tools
vision-only
Creator-reported Aug 14, 2025

Pokémon (game not stated)

Pokémon (game not stated)
ModelAchievementRun configStatusDate
GPT-6 Astra
reasoning effort: high
Became Champion in 18h 12m, the fastest claimed AI Champion time we know of
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
GPT-6 Astra (source label: “GPT-6 Astra (high)”)
Game
Pokémon (game not stated)
Project
GPT Plays Pokémon
Harness
GPT Plays Pokémon vision-only harness
Inputs
vision-only
Tools
custom tools (not itemised)
Assistance
not disclosed
Budget
reasoning effort: high
Verification
Creator-reported Creator's own thread. The game version is not stated there.
Evidence
Creator thread (unrolled) (creator)
GPT Plays Pokémon on Twitch (creator)
Unknown
which Pokémon game; date completed
Dates
evidence dated Sep 5, 2026
Recorded
published Sep 5, 2026 · discovered by AI vs Games Oct 17, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · Share card (PNG) · JSON
GPT Plays Pokémon vision-only harness
vision-only
Creator-reported Sep 5, 2026

Pokémon (undisclosed game / ROM hack)

Pokémon (undisclosed game / ROM hack)
ModelAchievementRun configStatusDate
Gemini 3.8 Flash 8 badges on run 'sors' (38,783 turns)
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 3.8 Flash
Game
Pokémon (undisclosed game / ROM hack)
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness (mGBA emulator)
Inputs
emulator frames + game-state analysis
Tools
custom subagents, Python sandbox, notepads (published on GitHub)
Assistance
not disclosed
Budget
not disclosed
Verification
Awaiting verification Badges come from hub telemetry, but the game is not named. The notepad mentions a non-canon region, so it is probably a ROM hack.
Evidence
Hub telemetry: run sors_gemini_3_8_flash (primary)
Public repo branch sors_gemini_3_8_flash (turn-by-turn commits) (primary)
Unknown
which game; badge maximum for this game
Dates
started Sep 27, 2026 · evidence dated Oct 13, 2026
Recorded
published Oct 13, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
No change detected since we started tracking.
Permanent link · Submit a correction · JSON
Gemini Plays Pokémon harness (mGBA emulator)
emulator frames + game-state analysis
Awaiting verification Oct 13, 2026

Chess

Chess
ModelAchievementRun configStatusDate
Gemini 3.8 Flash #1 on Kaggle Game Arena Chess: 1452 Elo
Last verified: – · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 3.8 Flash
Game
Chess
Project
Kaggle Game Arena
Harness
Kaggle Game Arena text harness (FEN/PGN)
Inputs
board as text
Tools
none (no chess engine)
Assistance
none
Budget
40 games per model pair; per-model reasoning settings not shown
Verification
Verified Read from the official leaderboard, which links replays of every game.
Evidence
Kaggle Game Arena: Chess leaderboard (official) (operator)
Dates
evidence dated Oct 15, 2026
Recorded
published Oct 15, 2026 · discovered by AI vs Games Oct 17, 2026
Changes
No change detected since we started tracking.
Permanent link · Submit a correction · Share card (PNG) · JSON
Kaggle Game Arena text harness (FEN/PGN)
board as text
Verified Oct 15, 2026

Go

Go
ModelAchievementRun configStatusDate
GPT-6 Astra #1 on Kaggle Game Arena Go: 1794 Elo
Last verified: – · Last checked: Oct 18, 2026
How was this run measured?
Model
GPT-6 Astra
Game
Go
Project
Kaggle Game Arena
Harness
Kaggle Game Arena harness
Inputs
board as text
Tools
none
Assistance
none
Budget
per-model settings not shown
Verification
Verified Read from the official leaderboard, which links replays of every game.
Evidence
Kaggle Game Arena: Go leaderboard (official) (operator)
Dates
evidence dated Oct 15, 2026
Recorded
published Oct 15, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
No change detected since we started tracking.
Permanent link · Submit a correction · Share card (PNG) · JSON
Kaggle Game Arena harness
board as text
Verified Oct 15, 2026

Heads-up Poker

Heads-up Poker
ModelAchievementRun configStatusDate
GPT-5.6 Sol #1 on Kaggle Game Arena Heads-up Poker: 30 Mean BB/100
Last verified: – · Last checked: Oct 18, 2026
How was this run measured?
Model
GPT-5.6 Sol
Game
Heads-up Poker
Project
Kaggle Game Arena
Harness
Kaggle Game Arena harness
Inputs
cards & betting history as text
Tools
none
Assistance
none
Budget
per-model settings not shown
Verification
Verified Read from the official leaderboard, which links replays of every game.
Evidence
Kaggle Game Arena: Heads-up Poker leaderboard (official) (operator)
Dates
evidence dated Oct 8, 2026
Recorded
published Oct 8, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
No change detected since we started tracking.
Permanent link · Submit a correction · Share card (PNG) · JSON
Kaggle Game Arena harness
cards & betting history as text
Verified Oct 8, 2026

Werewolf

Werewolf
ModelAchievementRun configStatusDate
GPT-5.4 #1 on Kaggle Game Arena Werewolf: 0.08% Equilibrium Rating
Last verified: – · Last checked: Oct 18, 2026
How was this run measured?
Model
GPT-5.4
Game
Werewolf
Project
Kaggle Game Arena
Harness
Kaggle Game Arena harness
Inputs
game chat & role info as text
Tools
none
Assistance
none
Budget
per-model settings not shown
Verification
Verified Read from the official leaderboard, which links replays of every game.
Evidence
Kaggle Game Arena: Werewolf leaderboard (official) (operator)
Dates
evidence dated Jun 12, 2026
Recorded
published Jun 12, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
No change detected since we started tracking.
Permanent link · Submit a correction · JSON
Kaggle Game Arena harness
game chat & role info as text
Verified Jun 12, 2026

Minecraft

Minecraft
ModelAchievementRun configStatusDate
Claude Opus 4.6
Echo-Sinclair (OpenClaw)
#1 agent on KradleVerse: 25% win rate over the last 30 days
Last verified: Oct 18, 2026 · Last checked: Oct 18, 2026
How was this run measured?
Model
Claude Opus 4.6 (source label: “claude-opus-4-6 (agent: Echo-Sinclair, OpenClaw)”) · agent: Echo-Sinclair (OpenClaw)
Game
Minecraft
Project
KradleVerse
Harness
OpenClaw agent framework
Inputs
not disclosed
Tools
not disclosed
Assistance
not disclosed
Budget
30-day window, 10+ runs to qualify
Verification
Verified Read from the live operator leaderboard.
Evidence
KradleVerse leaderboard (official, live) (operator)
Dates
evidence dated Oct 18, 2026
Recorded
published Oct 18, 2026 · discovered by AI vs Games Oct 17, 2026
Changes
Last change 2026-10-18: 30-day win % 24% → 25%
Permanent link · Submit a correction · Share card (PNG) · JSON
OpenClaw agent framework
not disclosed
Verified Oct 18, 2026
Gemini 4 Argon
Team of 4 Gemini 4 Argon agents
A team of 4 Gemini 4 Argon agents beat Minecraft: killed the Ender Dragon in 27h 14m, with 605 deaths and 2,783 programs written
The authors call it the first end-to-end autonomous completion of Minecraft by AI agents. They also list its limits: the agents read the world through an API, a plugin handled pathfinding, and they played on Easy.
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 4 Argon · agent: Team of 4 Gemini 4 Argon agents
Game
Minecraft
Project
Gemini 4 Argon agent team (research paper)
Harness
4 general-purpose Gemini 4 Argon coding agents controlling players through Mineflayer (+ pathfinding plugin); team chat + shared memory
Inputs
text API (position, health, inventory, nearby blocks and mobs), not pixels
Tools
self-written JavaScript programs (2,783); no human-written game logic, no pre-scouted seed
Assistance
none during the run (researchers could pause or stop it but did not intervene)
Budget
single run; Java Edition 1.20.4, survival, Easy difficulty, cheats off
Verification
Creator-reported Reported by the paper's authors (submitted Oct 15, 2026). We have checked the paper; we have not seen independent replays or logs.
Evidence
Paper: 'A team of Gemini 4 Argon agents beats Minecraft' (arXiv 2610.22319) (creator)
Full text (HTML) (creator)
Unknown
public replay or logs; compute cost
Dates
evidence dated Oct 15, 2026
Recorded
published Oct 15, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · Share card (PNG) · JSON
4 general-purpose Gemini 4 Argon coding agents controlling players through Mineflayer (+ pathfinding plugin); team chat + shared memory
text API (position, health, inventory, nearby blocks and mobs), not pixels
Creator-reported Oct 15, 2026
GPT-6 Astra
reasoning effort: medium
Top Mine Odyssey score: 85.6% of 180 navigation tasks in Minecraft rebuilds of real places
Claude Opus 5.5 (max) was second at 73.9%. The best open-weight model managed 23.9%.
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
GPT-6 Astra (source label: “GPT-6 Astra (medium)”)
Game
Minecraft
Project
Mine Odyssey
Harness
Mine Odyssey navigation harness
Inputs
not disclosed
Tools
not disclosed
Assistance
none
Budget
reasoning effort: medium
Verification
Creator-reported Paper authors' results; no public leaderboard yet.
Evidence
Mine Odyssey paper (arXiv 2610.11328), Table 1 (creator)
Dates
achieved Oct 8, 2026 · evidence dated Oct 8, 2026
Recorded
published Oct 8, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
Mine Odyssey navigation harness
not disclosed
Creator-reported Oct 8, 2026
GPT-6 Astra
Astra + Jev Minecraft agent
GPT-6 Astra + Jev kill the Ender Dragon in 8m 43s on a fixed seed with a pre-surveyed route (Peaceful)
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
GPT-6 Astra (source label: “GPT-6 Astra (planner) + Jev (typesafe/jev-1.13)”) · agent: Astra + Jev Minecraft agent
Game
Minecraft
Project
Astra and JEV Minecraft agent
Harness
minecraft-agent (Mineflayer, fixed Nether route, read-only dragon sensor)
Inputs
structured game state; known seed coordinates
Tools
Mineflayer pathfinding, bounded scripted actions (travel, mine, craft, bed attack)
Assistance
no live operator help (creator-reported); pre-surveyed route on a fixed seed; Peaceful difficulty
Budget
$0.97 total ($0.01 Jev, $0.96 Astra)
Verification
Creator-reported Creator's post and README; the video's verification files are kept locally by the creator, not published.
Evidence
Creator's post: Jev + Astra beats the Ender Dragon in 8 minutes 43 seconds (Sep 20, 2026) (creator)
Creator's code and README (run nether-final-08) (creator)
Unknown
number of attempts before nether-final-08; public full video link; Astra reasoning effort
Dates
achieved Sep 20, 2026 · evidence dated Sep 20, 2026
Recorded
published Sep 20, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
minecraft-agent (Mineflayer, fixed Nether route, read-only dragon sensor)
structured game state; known seed coordinates
Creator-reported Sep 20, 2026
Claude Opus 5
Mine AI MCP agent (Claude Code)
Claude Opus 5 kills the Ender Dragon in a fresh Minecraft world in one unbroken 3h 56m session
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
Claude Opus 5 (source label: “claude-opus-5[1m] (effort high)”) · agent: Mine AI MCP agent (Claude Code)
Game
Minecraft
Project
Mine AI MCP
Harness
Claude Code + Mine AI MCP server (tag beat-the-game)
Inputs
MCP tool observations of the game world (no screenshots)
Tools
Mine AI MCP tools (navigation, mining, crafting, combat, exploration)
Assistance
none after the opening prompt (prompt includes strategy tips)
Budget
effort high, 1M context; $93.17 API-equivalent cost
Verification
Creator-reported Creator-published artifacts: we read the vanilla server log ('Free the End' at 04:39:50 UTC, no commands that affect the bot, one death) and the result file (Opus 5, effort high, 389 turns). Labelled creator-reported until we replay it ourselves; can be upgraded to verified after our own replay.
Evidence
Published run artifacts: transcript, tool-call database, vanilla server log, prompt (Hugging Face) (creator)
Code: Mine AI MCP (tag beat-the-game) (creator)
Full recording (YouTube) (creator)
Unknown
development sessions before this one; whether the prompt's strategy tips count as hints under other leaderboards' rules
Dates
started Sep 15, 2026 · achieved Sep 15, 2026 · evidence dated Sep 16, 2026
Recorded
published Sep 16, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
Claude Code + Mine AI MCP server (tag beat-the-game)
MCP tool observations of the game world (no screenshots)
Creator-reported Sep 15, 2026
Claude Opus 4.6 Top MineExplorer score: 41.08 overall task success (open-world exploration)
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
Claude Opus 4.6 (source label: “Claude-Opus-4.6”)
Game
Minecraft
Project
MineExplorer
Harness
MineExplorer ReAct-style agent harness
Inputs
multimodal (screen + text)
Tools
not disclosed
Assistance
none
Budget
not disclosed
Verification
Creator-reported Paper authors' own results, listed as self-reported.
Evidence
BenchmarkList: MineExplorer (self-reported) (secondary)
MineExplorer paper (creator)
Dates
evidence dated Jun 28, 2026
Recorded
published Jun 28, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
MineExplorer ReAct-style agent harness
multimodal (screen + text)
Creator-reported Jun 28, 2026

NetHack

NetHack
ModelAchievementRun configStatusDate
GPT-6 Astra
reasoning effort: max
Memorable fail 13.2% progress on NetHack for the top overall BALROG entry. Nobody has beaten the game.
Last verified: Oct 18, 2026 · Last checked: Oct 18, 2026
How was this run measured?
Model
GPT-6 Astra (source label: “GPT-6-Astra-Max”)
Game
NetHack
Project
BALROG
Harness
BALROG agentic harness
Inputs
text / vision per track
Tools
none
Assistance
none
Budget
reasoning effort: max
Verification
Verified Read from the official leaderboard.
Evidence
BALROG leaderboard (official) (operator)
Dates
evidence dated Sep 18, 2026
Recorded
published Sep 18, 2026 · discovered by AI vs Games Oct 17, 2026
Changes
No change detected since we started tracking.
Permanent link · Submit a correction · JSON
BALROG agentic harness
text / vision per track
Verified Sep 18, 2026

Kirby's Dream Land

Kirby's Dream Land
ModelAchievementRun configStatusDate
Gemini 2.5 Pro (preview 03-25) Memorable fail 4.8% of Kirby's Dream Land (best single-game score on the VideoGameBench test set; 0.48% overall)
Last verified: Oct 18, 2026 · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 2.5 Pro (preview 03-25)
Game
Kirby's Dream Land
Project
VideoGameBench
Harness
VG-Agent (VideoGameBench reference agent)
Inputs
raw game frames + high-level objective and controls
Tools
none
Assistance
none
Budget
real-time play (game does not pause)
Verification
Verified Official leaderboard published by the benchmark authors.
Evidence
VideoGameBench leaderboard (official) (operator)
VideoGameBench paper (operator)
Dates
evidence dated May 23, 2025
Recorded
published May 23, 2025 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
VG-Agent (VideoGameBench reference agent)
raw game frames + high-level objective and controls
Verified May 23, 2025

Latest moves (automatic change log)

Our trackers write this log automatically. If a run hasn't moved, we say nothing rather than invent news.

This Week in AI vs Games

One short email every Sunday: new records, memorable failures and runs to watch. Free. Every claim is linked to its source.

Preview placeholder. The Beehiiv embed goes here.

Latest issue: Issue #1: The Ender Dragon is down