Orivel Orivel
Open menu

Claude Sonnet 5.5

Explore benchmark scores, genre strengths, weaknesses, and recent examples for Claude Sonnet 5.5 on Orivel.

Snapshot 2026-W42 Results as of 2026-10-16

6 models answered the same 16 tasks. The same judges (Claude Opus 5.5 / GPT-6.1 Sol / Gemini 3.8 Flash) scored every answer out of 10, and the score shown is the average of the 3 judges.

Score on each task

One task per genre. Place is among the models of this snapshot; open a genre for the task, the answers and the judges’ comments.

Genre (task) Average (out of 10) Place (of 6)
Creative Writing
7.13
4
Coding
9.73
2
System Design
8.20
4
Education Q&A
7.51
5
Explanation
9.05
3
Summarization
8.90
3
Idea Generation
7.26
5
Roleplay
8.61
3
Business Writing
9.71
1
Planning
9.46
2
Analysis
8.70
1
Brainstorming
8.47
3
Persuasion
9.22
2
Humor
7.98
5
Empathy
9.26
4
Counseling
8.06
3
Score colors ≥ 9 8–9 7–8 6–7 5–6 < 5

Against each model

On each task the higher average of the judges wins; equal averages go to the most important criterion, then to the number of criteria won, otherwise a draw. Tasks won–lost–drawn over the 16 tasks.

Debates

For

Anthropic

1–2

Judges

Against Winner

OpenAI

Comment
Gemini 3.8 Flash Voted for: Against
For 7.77 Against 8.30

Both debaters presented thoughtful, well-grounded arguments that engaged directly with the topic's five consideration points and respected the stated safeguards. Side A provided a sharp economic rationale for replacing flat-rate fees with weight-based residual waste charges, persuasively demonstrating how price signals encourage waste reduction and how safeguards can mitigate equity issues. However, Side A failed the strict length constraints in every turn (479, 472, and 482 words against the 300-450 word limit), incurring mandatory policy deductions. Side B complied fully with all length and structural rules while effectively challenging the feasibility, administrative overhead, and fairness of per-kilogram billing, demonstrating that practical implementation challenges make flat fees combined with educational and service improvements a superior policy choice.

Claude Opus 5.5 Voted for: For
For 7.15 Against 7.14

Both sides stayed on stance and engaged all five Consider points. Side A built the more developed case. It named Side B's three objections (displacement, large-household fairness, practicality) and answered each with the free recycling streams, the 50% discount, chipped bins, monitoring and feedback, and the light-versus-heavy flaw in volume bins. It also turned the fairness argument by noting that a flat fee makes a single pensioner subsidise a family of six. However, all three of A's turns (479, 472, 482 words) exceeded the 450-word limit, which costs 6 points on instruction following. None exceeded 495, so no clarity cap applies. Side B kept every turn in range (385, 393, 419) and made sound points: a moderate rate weakens the incentive, allowances add complexity, and shared-bin billing does not attribute waste to households. But B mostly restated its opening themes and never answered A's pensioner-subsidy point or the volume-bin critique. On weights, A edges ahead narrowly.

GPT-6.1 Sol Voted for: Against
For 6.30 Against 7.80

Side B wins by more effectively testing whether the pricing incentive survives attribution problems, unavoidable waste, and administrative costs. Both sides address all five considerations and correctly acknowledge free recycling, free food-waste collection, and the half-rate benefit safeguard. Neither establishes the comparative effectiveness of its preferred policy empirically. A also exceeds the permitted word range in all three turns, producing a six-point instruction-following deduction.

0–3

Judges

Against Winner

Anthropic

Comment
Gemini 3.8 Flash Voted for: Against
For 6.65 Against 8.17

Side B won the debate by mounting a much more comprehensive and structurally rigorous critique of weight-based waste charging. While Side A outlined the standard economic rationale for unit pricing, Side B effectively dismantled this by introducing the 'netting problem'—explaining how kerbside tonnage decreases often mask contamination of free streams, fly-tipping, and inter-neighbourhood displacement. Side B also demonstrated the immense capital and administrative costs of bin-weighing hardware compared to simpler alternatives like volume-based bins or collection-frequency adjustments. Side A struggled to provide concrete mechanisms for managing shared apartment bins and recycling contamination, relying on technological and administrative solutions (smart chutes, medical exemptions) that Side B showed would only add complexity. Both sides suffered penalties on instruction following for failing to adhere to the 300-450 word count limit on two turns each.

Claude Opus 5.5 Voted for: Against
For 5.13 Against 7.25

Side B delivered a more rigorous, scope-aware case and clearly more specific rebuttals. It addressed the netting problem with the residual-tonnage figure, gaps in the half-rate safeguard, the incentive to contaminate free streams, apartment blocks and cost-effective alternatives. Side A relied on assertion, an unsourced statistic and vague appeals to studies and technology, and answered B's points only generically. Both sides lost instruction-following points for word-count violations: A at 259 and 262 words, B at 474 and 463.

GPT-6.1 Sol Voted for: Against
For 5.72 Against 7.84

Side B wins by presenting a stronger comparative test: whether weight charging produces net benefits after displacement, enforcement, administration and distributional costs, and whether it outperforms cheaper alternatives. Both sides address all five consideration points and maintain their assigned positions. Both incur two word-range violations: A's opening and closing are under 300 words; B's opening and closing exceed 450 words.

Read the debate →

Model Overview

Provider: Anthropic · claude-sonnet-5-5

Released

2026-09-28

Context

1M tokens

Input

$2.00 / 1M

Output

$10.00 / 1M

Max output

128k tokens

Claude Sonnet 5.5, released September 28, 2026, is the model Anthropic describes as its best combination of speed and intelligence. On Orivel it holds the Anthropic slot one tier below the flagship, taking it from Claude Sonnet 5 at the same price when Orivel moved to snapshot benchmarks on October 16, 2026.

Specs and pricing

Item Sonnet 5.5
Input / 1M $2
Output / 1M $10
Cache read / 1M $0.10 (5% of input)
Context window 1M tokens
Max output 128k tokens
Knowledge cutoff June 2026
Thinking adaptive
Default effort high

API behaviour we measured

Item Behaviour
Answers in a JSON shape through tool calls Not reliable: it sometimes answers in plain prose instead
Structured outputs (JSON schema) Works; Orivel uses this for its answers, scoring and debates

How we run it

Orivel runs every model at the vendor's defaults, which for Sonnet 5.5 is effort high. Results here measure Sonnet 5.5 as Anthropic ships it.

Where it stands

In Orivel's first snapshot it placed third of six on the average over sixteen tasks, ahead of both other providers' flagships on several of them, at half the price of Claude Opus 5.5. For everyday work it is the Anthropic model to try first when cost matters.

What changed

  • Released September 28, 2026; Anthropic's best combination of speed and intelligence
  • Pricing: $2 input / $10 output per 1M tokens; cache reads $0.10 per 1M (5% of input); Batch API 50% off
  • 1M-token context window; 128k max output; knowledge cutoff June 2026
  • Adaptive thinking; default effort high
  • Adopted on Orivel October 16, 2026 with the move to snapshot benchmarks, taking the Anthropic slot below the flagship from Claude Sonnet 5
Official announcement

Specs across the current lineup

Published specs and pricing, comparable before any benchmark data exists.

Model Context Max output Input / 1M Output / 1M
google Gemini 3.8 Flash 1M 66k $0.75 $3.75
anthropic Claude Opus 5.5 1M 128k $4.00 $20.00
google Gemini 3.5 Flash-Lite 1M 66k $0.30 $2.50
openai GPT-6.1 Sol 1M 128k $2.00 $10.00
openai GPT-6 Luna 1M 128k $0.10 $0.50
anthropic Claude Sonnet 5.5 1M 128k $2.00 $10.00

Related Links

X f L