Published: 2026-10-08
Summary

Haiku 5.5 vs Sonnet 5.5 and Opus 5.5 on a dozen builds: what each cost, and where the gap was small

Chapters / key moments (click to jump — plays here on the page)

Nick Saraev spent over $700 giving Claude Haiku 5.5, Sonnet 5.5 and Opus 5.5 the same prompts: games, sites, an accounting-fraud audit and a finance app. Haiku cost a fraction (fifths to hundredths) and often looked close; Opus won the games. His routing advice: let a frontier model plan and use Haiku as the hands for summaries, classification and database queries.

Source video

"I Spent 24 Hours Testing Haiku 5.5: Here Are The Results" by Nick Saraev — Watch on YouTube →

The prices he starts from

Per million tokens, as he lists them: Fable 5.1 $10 in and $50 out; Opus 5.5 $4 and $20; Sonnet 5.5 $2 and $10; Haiku 4.5 $1 and $5; Haiku 5.5 $0.10 and $0.50. Anthropic's pricing page matches for Haiku 5.5 and adds the catch he explains at the end: those rates apply to prompts up to 100,000 tokens; above that a request pays $0.50 and $2.50. Our changelog entry has the full launch details.

What each build cost (as he states it)

TaskHaiku 5.5OthersHis verdict
3D MOBA in Three.jsunder $10, 3 h 46 min, about 90M tokensSonnet roughly 5x the costSonnet and Opus had far better graphics
Forensic-accounting fraud audit (planted fraud in large CSVs)8 of 8 foundSonnet and Opus also 8 of 8; Haiku to Sonnet about 20 cents apart, Haiku to Opus about 4 to 5xText analysis is 'saturated': no meaningful gap
Voxel sandbox (Minecraft-style)about $0.20, 13 min, 2.2M tokensOpus clearly best, with shadowsHaiku playable but plain
Personal-finance web app ('Ledgerly')about $0.50, 17 min, 7M tokensSonnet about 5x the cost with a better UI; the other two used 4M and 3.39M tokens (captions don't say which is which)Sonnet's app best; Opus not better
First-person shooter$5.70Sonnet $27, Opus about $20.78 (captions garble this figure)Opus top
Two-minute 'history of flight' video (SVG, in code)under $1Opus about $7; Sonnet cost more than bothHe would pick Sonnet's
Attack-on-Titan-style gameabout $5, 72M tokensSonnet about $4.50 to $5 with fewer tokensHaiku surprisingly good

All prompts are in a free page he links from the description. These are single one-shot runs, scored by his own eye.

His routing advice

  1. Have Opus 5.5 or another frontier model plan the work; Haiku is 'the fingers' that do it.
  2. Give Haiku summarisation of reports, classification of tickets, database queries and pulling one number from thousands (for example fraud analysis).
  3. Mind the 100K-token price cliff: prompts past it cost five times more. His idea: for sub-agent research, cut a sub-agent off near 100,000 tokens, compact its output and start a fresh one. Cache reads are a tenth of the input price (about 1 cent per million up to 100K), so follow-up prompts in the same thread are very cheap.
  4. Previously you would delegate research to a Haiku-class model at $1 and $5; the same job is now a tenth of that.

Gotchas & Caveats

  • Captions garble several dollar figures; the table keeps only the ones that read cleanly and flags the rest. Check his linked page for exact numbers.
  • One run per model per prompt: it shows typical cost and rough quality, not reliability. Games are judged by playing them for a minute.
  • Anthropic says code written for Haiku 4.5 can break on 5.5 (manual extended thinking returns a 400, adaptive thinking is on by default, and the same text counts as more tokens). The video does not cover migration.

Key Takeaways

  • On text-heavy analysis the three models tied, so default to the cheapest that passes your own check.
  • On games, UI polish and 3D, the premium models still win, but not in proportion to price.
  • Count tokens as well as dollars: Haiku used more tokens on several builds, which the lower price more than covers.
  • Test a model on your own top three jobs before routing by reputation.