Cursor's benchmark says its cheap model rivals the frontier. A rival benchmark says it scores 16 (cursor.com)
On Cursor's numbers, Composer 2.5 hits 63.2% accuracy at $0.55 a task — the cheapest in the field, and framed as near-frontier. The presentation even flipped the cost axis so cheapest sits on the right, which several readers found conveniently confusing.
The rebuttal came with citations. On the DeepSWE benchmark — 'probably the hardest to game' — GPT-5.5 gets 64, Opus 4.8 gets 56, and Composer 2.5 gets 16. A developer who's used both models heavily called the parity claim 'absolutely farcical': faster, yes; anywhere near as good, no.
Sign in to save