Kaggle

ARC-AGI-3 moved beyond static puzzles: systems must adapt in unfamiliar interactive environments. The leaderboard includes reasoning systems at different thinking levels, base models, and competition submissions constrained to a $50 budget for 120 tasks.

HN readers welcomed the new benchmark while questioning how easily a leaderboard can be gamed, how models are prompted, and why a large score gap does not always show up in ordinary work.