Community research board

Help us close the gaps

Runs we know are missing, records that conflict, and facts nobody has published. If you have evidence, submit it or send a correction.

Wanted

ClaudePlaysPokemon: Claude Opus 4.7's Pokémon Red result

We have: The creator posted on May 16, 2026 (UTC) that Claude was at the Elite Four and would likely become Champion that night. A LessWrong post and viewers report it did. A review item is queued.

Missing: Creator or Anthropic confirmation of the finish, plus a VOD timestamp or log, step count and exact finish time.

x.com · www.lesswrong.com · www.twitch.tv

GPT-6 Astra's 18h 12m Champion run: which game?

We have: The creator's thread gives the time. A viewer comment on LessWrong (Sep 12, 2026) says GPT-6 beat Pokémon FireRed in just over 18 hours; that is a lead, not a source.

Missing: Game/version, date, and a VOD or log.

www.unrollnow.com · www.lesswrong.com

GPT-5.6 Sol: 153h51 vs 96h 35m

We have: BenchmarkList lists 153h51 (Emerald); the creator's later thread says 96h 35m.

Missing: Whether these are two runs or one, and which number belongs to which.

benchmarklist.com · www.unrollnow.com

The 3.7 vs 3.5 Flash race post on Reddit

We have: Hub runs vision_first_gemini_3_7_flash / 3_5_flash in Pokémon Blue.

Missing: The announcement's rules and dates (Reddit blocked our fetch).

www.reddit.com

Gemini 4 Argon Minecraft team: public logs or replay

We have: The arXiv paper (2610.22319).

Missing: Public logs, replay or dashboard export, so the record can be marked verified.

arxiv.org

A dependable live NetHack source

We have: BALROG leaderboard (static, periodic).

Missing: A regularly updated NetHack AI run or ladder. NetHack becomes a primary game once one exists.

balrogai.com

PokéAgent post-NeurIPS speedrun submissions

We have: NeurIPS 2025 final standings (first gym).

Missing: Machine-readable live speedrun leaderboard and runs past the first gym.

pokeagentchallenge.com

Awaiting verification / conflicting

Awaiting
ModelGameAchievementRun configStatusDate
Gemini 2.5 Pokémon Crystal Crystal race opponent of Gemini 3; ran to turn 51,280 (Dec 2025). Final progress not disclosed.
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 2.5
Game
Pokémon Crystal
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness (Crystal race)
Inputs
emulator frames + game-state analysis
Tools
custom subagents, Python sandbox, notepads (published on GitHub)
Assistance
not disclosed
Budget
not disclosed
Verification
Awaiting verification Branch exists, but its notepad does not state badges or the result.
Evidence
Public repo branch crystal_race_gemini_2-5 (turn-by-turn commits) (primary)
Unknown
badges; result of the race; exact model variant
Dates
evidence dated Dec 15, 2025
Recorded
published Dec 15, 2025 · discovered by AI vs Games Oct 18, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
Gemini Plays Pokémon harness (Crystal race)
emulator frames + game-state analysis
Awaiting verification Dec 15, 2025
Gemini 3.8 Flash Pokémon (undisclosed game / ROM hack) 8 badges on run 'sors' (38,783 turns)
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 3.8 Flash
Game
Pokémon (undisclosed game / ROM hack)
Project
Gemini Plays Pokémon
Harness
Gemini Plays Pokémon harness (mGBA emulator)
Inputs
emulator frames + game-state analysis
Tools
custom subagents, Python sandbox, notepads (published on GitHub)
Assistance
not disclosed
Budget
not disclosed
Verification
Awaiting verification Badges come from hub telemetry, but the game is not named. The notepad mentions a non-canon region, so it is probably a ROM hack.
Evidence
Hub telemetry: run sors_gemini_3_8_flash (primary)
Public repo branch sors_gemini_3_8_flash (turn-by-turn commits) (primary)
Unknown
which game; badge maximum for this game
Dates
started Sep 27, 2026 · evidence dated Oct 13, 2026
Recorded
published Oct 13, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
No change detected since we started tracking.
Permanent link · Submit a correction · JSON
Gemini Plays Pokémon harness (mGBA emulator)
emulator frames + game-state analysis
Awaiting verification Oct 13, 2026
GPT-5.6 Sol Pokémon Emerald Became Champion of Pokémon Emerald in 153h51 (8 badges)
Last verified: not independently verified · Last checked: Oct 18, 2026
How was this run measured?
Model
GPT-5.6 Sol
Game
Pokémon Emerald
Project
GPT Plays Pokémon
Harness
Codex App Server + custom tools
Inputs
vision-only
Tools
custom tools (not itemised)
Assistance
not disclosed
Budget
not disclosed
Verification
Awaiting verification Sources disagree: BenchmarkList lists 153h51; the creator's later thread says 96h 35m for GPT-5.6 Sol (max). They may be different runs.
Evidence
BenchmarkList: Pokémon Autonomous Completion (self-reported) (secondary)
Creator thread (96h 35m figure) (creator)
Unknown
which figure belongs to which run
Dates
achieved Jul 21, 2026 · evidence dated Jul 21, 2026
Recorded
published Jul 21, 2026 · discovered by AI vs Games Oct 17, 2026
Changes
Historical record. Nothing to update unless the source changes.
Permanent link · Submit a correction · JSON
Codex App Server + custom tools
vision-only
Awaiting verification Jul 21, 2026

Open unknowns on existing records

RecordGameUnknown
Gemini 4 Argon: All 8 badges in Pokémon Emerald (now 3,722 turns in, still playing)Pokémon Emeraldturn at which the 8th badge was earned; reasoning budget
Gemini 4 Argon: Entered the Hall of Fame in Pokémon Emerald (beat Champion Wallace)Pokémon Emeraldturn and date of the Hall of Fame entry
Gemini 4 Argon: 8 of 8 badges in Pokémon Blue, run finished after 1,753 turnsPokémon Bluewhy the run was marked finished; whether it was a timed or capped run
Gemini 3.8 Flash: 3 of 8 badges in Pokémon Blue, run finished after 5,648 turnsPokémon Bluewhy the run was marked finished; whether it was a timed or capped run
Gemini 3 Pro: All 8 badges in a vision-only Pokémon Blue run (last turn 67,315, May 2026)Pokémon Bluewhether the run reached Champion
Gemini 3: Reached the post-game with 16 badges in Pokémon Crystal by turn 36,290 (race vs Gemini 2.5)Pokémon Crystalexact model variant (branch says only 'gemini_3'); race rules
Gemini 2.5: Crystal race opponent of Gemini 3; ran to turn 51,280 (Dec 2025). Final progress not disclosed.Pokémon Crystalbadges; result of the race; exact model variant
Gemini 3.8 Flash: 8 badges on run 'sors' (38,783 turns)Pokémon (undisclosed game / ROM hack)which game; badge maximum for this game
GPT-5.6 Sol: Became Champion of Pokémon Emerald in 153h51 (8 badges)Pokémon Emeraldwhich figure belongs to which run
GPT-6 Astra: Became Champion in 18h 12m, the fastest claimed AI Champion time we know ofPokémon (game not stated)which Pokémon game; date completed
Heatz agent (model not disclosed): 1st: reached the first gym (Roxanne) in 40:13 (1,608 actions)Pokémon Emeraldunderlying model(s) used by the team (not in our source)
Hamburg PokéRunners agent (model not disclosed): 2nd: reached the first gym in 1:14:43Pokémon Emeraldunderlying model(s) used by the team (not in our source)
anthonys agent (model not disclosed): 3rd: reached the first gym in 1:29:17Pokémon Emeraldunderlying model(s) used by the team (not in our source)
Deepest agent (model not disclosed): Judge's Choice: fewest actions to the first gym (649), 5th by timePokémon Emeraldunderlying model(s) used by the team (not in our source)
Gemini 4 Argon: A team of 4 Gemini 4 Argon agents beat Minecraft: killed the Ender Dragon in 27h 14m, with 605 deaths and 2,783 programs writtenMinecraftpublic replay or logs; compute cost
Gemini 2.5 Pro: Gemini 2.5 Pro becomes Champion in Pokémon Blue (development run, ~813 hours)Pokémon Blueexact ROM version; step or action count for this run; reasoning budget; full list of manual interventions
Gemini 2.5 Pro: Gemini 2.5 Pro beats Pokémon Blue with no manual interventions (~406 hours, 36,801 actions)Pokémon Blueexact ROM version; reasoning budget; public VOD or log for this run
Jev: Jev enters the Pokémon Red Hall of Fame with Claude Opus 5 rebuilding its options livePokémon Redtotal play time; number of Jev decisions; cost; exact ROM version; run start date (creator's Reddit post on Sep 18 shows it already had 4 badges)
Jev: Jev beats Pokémon Red in 37h 40m with a guided, open-source harnessPokémon Redexact Hall of Fame date (stream ran Sep 25–26, 2026); number of checkpoint reloads used; public VOD link
GPT-6 Astra: GPT-6 Astra + Jev kill the Ender Dragon in 8m 43s on a fixed seed with a pre-surveyed route (Peaceful)Minecraftnumber of attempts before nether-final-08; public full video link; Astra reasoning effort
Claude Opus 5: Claude Opus 5 kills the Ender Dragon in a fresh Minecraft world in one unbroken 3h 56m sessionMinecraftdevelopment sessions before this one; whether the prompt's strategy tips count as hints under other leaderboards' rules

Source warnings