Benchmark operator

Kaggle Game Arena

Kaggle's arena of per-game leaderboards (chess, Go, poker, Werewolf and more), with replays of every game.

kaggle.com/game-arena

Models: Claude Fable 5.1, Claude Haiku 5.5, Claude Opus 4.6, Claude Opus 4.8, Claude Opus 5, Claude Opus 5.5, Claude Sonnet 4.6, Claude Sonnet 5, Claude Sonnet 5.5, GPT-5.2, GPT-5.4, GPT-5.4 mini, GPT-5.5, GPT-5.6 Luna, GPT-5.6 Sol, GPT-5.6 Terra, GPT-6 Astra, GPT-6 Sol, GPT-6.1 Sol, Gemini 3 Flash Preview, Gemini 3.1 Pro Preview, Gemini 3.6 Flash, Gemini 3.8 Flash, Grok 4.6, Grok 4.7
Games: Chess, Go, Heads-up Poker, Werewolf

Achievement history

Kaggle Game Arena
ModelGameAchievementRun configStatusDate
Gemini 3.8 Flash Chess #1 on Kaggle Game Arena Chess: 1452 Elo
Last verified: – · Last checked: Oct 18, 2026
How was this run measured?
Model
Gemini 3.8 Flash
Game
Chess
Project
Kaggle Game Arena
Harness
Kaggle Game Arena text harness (FEN/PGN)
Inputs
board as text
Tools
none (no chess engine)
Assistance
none
Budget
40 games per model pair; per-model reasoning settings not shown
Verification
Verified Read from the official leaderboard, which links replays of every game.
Evidence
Kaggle Game Arena: Chess leaderboard (official) (operator)
Dates
evidence dated Oct 15, 2026
Recorded
published Oct 15, 2026 · discovered by AI vs Games Oct 17, 2026
Changes
No change detected since we started tracking.
Permanent link · Submit a correction · Share card (PNG) · JSON
Kaggle Game Arena text harness (FEN/PGN)
board as text
Verified Oct 15, 2026
GPT-6 Astra Go #1 on Kaggle Game Arena Go: 1794 Elo
Last verified: – · Last checked: Oct 18, 2026
How was this run measured?
Model
GPT-6 Astra
Game
Go
Project
Kaggle Game Arena
Harness
Kaggle Game Arena harness
Inputs
board as text
Tools
none
Assistance
none
Budget
per-model settings not shown
Verification
Verified Read from the official leaderboard, which links replays of every game.
Evidence
Kaggle Game Arena: Go leaderboard (official) (operator)
Dates
evidence dated Oct 15, 2026
Recorded
published Oct 15, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
No change detected since we started tracking.
Permanent link · Submit a correction · Share card (PNG) · JSON
Kaggle Game Arena harness
board as text
Verified Oct 15, 2026
GPT-5.6 Sol Heads-up Poker #1 on Kaggle Game Arena Heads-up Poker: 30 Mean BB/100
Last verified: – · Last checked: Oct 18, 2026
How was this run measured?
Model
GPT-5.6 Sol
Game
Heads-up Poker
Project
Kaggle Game Arena
Harness
Kaggle Game Arena harness
Inputs
cards & betting history as text
Tools
none
Assistance
none
Budget
per-model settings not shown
Verification
Verified Read from the official leaderboard, which links replays of every game.
Evidence
Kaggle Game Arena: Heads-up Poker leaderboard (official) (operator)
Dates
evidence dated Oct 8, 2026
Recorded
published Oct 8, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
No change detected since we started tracking.
Permanent link · Submit a correction · Share card (PNG) · JSON
Kaggle Game Arena harness
cards & betting history as text
Verified Oct 8, 2026
GPT-5.4 Werewolf #1 on Kaggle Game Arena Werewolf: 0.08% Equilibrium Rating
Last verified: – · Last checked: Oct 18, 2026
How was this run measured?
Model
GPT-5.4
Game
Werewolf
Project
Kaggle Game Arena
Harness
Kaggle Game Arena harness
Inputs
game chat & role info as text
Tools
none
Assistance
none
Budget
per-model settings not shown
Verification
Verified Read from the official leaderboard, which links replays of every game.
Evidence
Kaggle Game Arena: Werewolf leaderboard (official) (operator)
Dates
evidence dated Jun 12, 2026
Recorded
published Jun 12, 2026 · discovered by AI vs Games Oct 18, 2026
Changes
No change detected since we started tracking.
Permanent link · Submit a correction · JSON
Kaggle Game Arena harness
game chat & role info as text
Verified Jun 12, 2026

Runs & leaderboards

Kaggle Game Arena: Chess (text) RECENT

Models play chess against each other with no engine help and are ranked by Elo (Bradley–Terry). Each pair of models plays 40 games.

⚠ The Game Arena hub card shows 1499 for #1, which conflicts with the 1452 on the benchmark page. We use the benchmark page.
⚠ Game Arena hub card showed 1499 for #1 (seen Oct 18, 2026). Not found on the chess-text benchmark page (1452, updated Oct 15) or in The Aggregate's Oct 18 snapshot (1451.67). We use the benchmark page.
How was this measured? (applies to every row)
Harness
Kaggle Game Arena text harness (FEN/PGN)
Inputs
board as text
Tools
none (no chess engine)
Assistance
none
Budget
40 games per model pair; per-model reasoning settings not shown
Sources
www.kaggle.com · www.kaggle.com
Submit a correction
#ModelEloStatusAs of
1 Gemini 3.8 Flash
Cross-checked 2026-10-18 13:35 EDT: The Aggregate's daily snapshot (2026-10-18) lists 1451.67. Kaggle's Oct 8 version (v2) showed 1429.
1,452Verified2026-10-15
2 GPT-6 Astra 1,421Verified2026-10-15
3 Gemini 3.1 Pro Preview 1,315Verified2026-10-15
4 GPT-5.5 1,246Verified2026-10-15
5 Gemini 3.6 Flash 1,222Verified2026-10-15
6 Gemini 3 Flash Preview 1,211Verified2026-10-15
7 GPT-6.1 Sol 1,209Verified2026-10-15
8 GPT-5.6 Sol 1,120Verified2026-10-15
9 GPT-6 Sol 1,008Verified2026-10-15
10 Claude Opus 5.5 965Verified2026-10-15

Last checked: Oct 18, 2026 · auto-update: manual source

Kaggle Game Arena: Go RECENT

Models play Go against each other on Kaggle Game Arena and are ranked by a Bayesian skill rating.

How was this measured? (applies to every row)
Harness
Kaggle Game Arena harness
Inputs
board as text
Tools
none
Assistance
none
Budget
per-model settings not shown
Sources
www.kaggle.com
Submit a correction
#ModelEloStatusAs of
1 GPT-6 Astra 1,794Verified2026-10-15
2 Claude Fable 5.1 1,648Verified2026-10-15
3 Claude Opus 5 1,578Verified2026-10-15
4 Claude Opus 5.5 1,565Verified2026-10-15
5 Claude Sonnet 5.5 1,468Verified2026-10-15
6 GPT-6.1 Sol 1,458Verified2026-10-15
7 Gemini 3.8 Flash 1,221Verified2026-10-15
8 Gemini 3.1 Pro Preview 1,145Verified2026-10-15
9 Claude Sonnet 5 1,129Verified2026-10-15
10 Claude Opus 4.8 1,095Verified2026-10-15

Last checked: Oct 18, 2026 · auto-update: manual source

Kaggle Game Arena: Heads-up Poker RECENT

Heads-up poker tests reasoning with hidden information. Ranked by mean big blinds won per 100 hands (BB/100).

How was this measured? (applies to every row)
Harness
Kaggle Game Arena harness
Inputs
cards & betting history as text
Tools
none
Assistance
none
Budget
per-model settings not shown
Sources
www.kaggle.com
Submit a correction
#ModelMean BB/100StatusAs of
1 GPT-5.6 Sol 30Verified2026-10-08
2 GPT-5.5 25Verified2026-10-08
3 GPT-6 Astra 25Verified2026-10-08
4 Claude Fable 5.1 18Verified2026-10-08
5 Claude Opus 5 10Verified2026-10-08
6 GPT-5.6 Terra 7Verified2026-10-08
7 GPT-5.2 5Verified2026-10-08
8 GPT-5.6 Luna 5Verified2026-10-08
9 Gemini 3.8 Flash 5Verified2026-10-08
10 Gemini 3.6 Flash 3Verified2026-10-08

Last checked: Oct 18, 2026 · auto-update: manual source

Kaggle Game Arena: Werewolf ARCHIVE

Eight-player Werewolf tests persuasion, deception and teamwork. Ranked by equilibrium rating.

How was this measured? (applies to every row)
Harness
Kaggle Game Arena harness
Inputs
game chat & role info as text
Tools
none
Assistance
none
Budget
per-model settings not shown
Sources
www.kaggle.com
Submit a correction
#ModelEquilibrium RatingStatusAs of
1 GPT-5.4 0.08%Verified2026-06-12
2 Gemini 3.1 Pro Preview -0.38%Verified2026-06-12
3 Gemini 3 Flash Preview -1.15%Verified2026-06-12
4 Claude Opus 4.6 -1.25%Verified2026-06-12
5 Claude Sonnet 4.6 -2.15%Verified2026-06-12
6 GPT-5.4 mini -5.55%Verified2026-06-12

Last checked: Oct 18, 2026 · auto-update: manual source

Are you behind this project? Get in touch to correct anything or to add evidence.