evals
Run evals on Jetty
v2 · Sep 2026 · jettygrowthteam · auto-evolved runbook (weakest-axis targeting)

claude-code · Sonnet 5

claude-code driving anthropic/claude-sonnet-5 through OpenRouter, 5 hill-climb rounds from the v1 runbook.

agent claude-code · model anthropic/claude-sonnet-5

Judge, best round
25.3/40
round v4
Self-score, best round
36/40
inflation +10.7
Rounds
5
~$4.57 est. spend
claude-code · Sonnet 5 best round
best round v4 · 240351f2 ↗

Self-score vs judge, by axis

Best round v4, 0–10 per axis

agent self-scoreexternal judge

Judge: The pelican reads well, with a white body, a long neck, an orange throat pouch and orange legs reaching toward the pedals, though the gray arm-like wing looks odd. The bicycle frame is structurally confused: the front wheel has no fork connecting it to the frame, the handlebar area is a tangle, and the body floats above an unclear seat. The clean gradient sky and speed lines are nice, but these joins in the frame and wing look glitchy.

Score by round

Out of 40. Each round starts from the previous round's best SVG.

self-scorejudge

Every round

Click a drawing to open it in the head-to-head viewer. The outlined card is the agent's best round.

claude-code · Sonnet 5 round v1
v1judge 26.5 · self 28 ea416761 ↗runbook
claude-code · Sonnet 5 round v2
v2judge 27.3 · self 34 b77ea720 ↗runbook
claude-code · Sonnet 5 round v3
v3judge 27 · self 34 6e98127a ↗runbook
claude-code · Sonnet 5 round v4
v4 · bestjudge 25.3 · self 36 240351f2 ↗runbook
claude-code · Sonnet 5 round v5
v5judge 26.2 · self 36 1925c665 ↗runbook

Scores per round

RoundPelicanBicycleCompositionPolishSelf totalJudge totalJudge spreadMinutesTrajectory
v17self 76.2self 86.5self 76.8self 62826.515.7ea416761 ↗
v27.2self 86self 87self 97.2self 93427.315.9b77ea720 ↗
v37.3self 96self 86.8self 96.8self 834271.55.66e98127a ↗
v47.5self 95self 96.5self 86.3self 103625.316.4240351f2 ↗
v57.3self 95.3self 96.8self 96.7self 93626.20.511.81925c665 ↗

Want this kind of eval for your own agents?

Every run on this site is a Jetty runbook: versioned instructions, a pinned sandbox, and a trajectory you can inspect. Point Jetty at your task and get the same receipts.