evals
Run evals on Jetty
Leaderboard · 14 lineages · best round per agent

The climb, ranked by one judge

Each lineage's best round is the drawing the agent itself picked as its best. We rank by the external judge's score for that drawing, since self-scores aren't comparable across models. Each axis cell shows the judge score with the self-score underneath.

#Best roundJudge /40Self /40Agent · modelInflationPelicanBicycleCompositionPolishRoundMin/roundTrajectory
0132.838.5opencode · Gemini 3.8 Flash v2 · Sep 2026google/gemini-3.8-flash+5.78.7self 9.57.7self 9.58self 108.5self 9.5v1 of 111.7225e57cd ↗
0232.836claude-code · Opus 5.5 v2 · Sep 2026anthropic/claude-opus-5.5+3.28.5self 98self 98.3self 108self 8v3 of 54.635c47f4e ↗
0331.737hermes · Jev Router v2 · Sep 2026typesafe/jev-router+5.38self 97.7self 98.3self 107.7self 9v4 of 52.23ba61c00 ↗
0429.840gemini-cli · Gemini 3.5 Flash v1 · May 2026gemini-3.5-flash+10.27.3self 107self 107.5self 108self 10v1 of 103f5cd6a31 ↗
0529.340opencode · Gemini 3.5 Flash v1 · May 2026google/gemini-3.5-flash+10.78self 106.2self 107.5self 107.7self 10v2 of 104660d2a66 ↗
0628.834hermes · Fusion router v1 · May 2026openrouter/fusion+5.27.3self 86.7self 87.7self 107.2self 8v1 of 313.92d0c10c4 ↗
0728.736claude-code · Opus 4.7 v1 · May 2026claude-opus-4-7+7.37.5self 96.3self 97.7self 97.2self 9v3 of 105d4a107dc ↗
0828.336opencode · Fusion router v1 · May 2026openrouter/fusion+7.77self 96.8self 97.3self 97.2self 9v2 of 37.1bfa3612b ↗
0928.239.5hermes · Gemini 3.5 Flash v1 · May 2026openrouter/google/gemini-3.5-flash+11.36self 9.58self 106.8self 107.3self 10v9 of 104.3e6d4548b ↗
102838opencode · GPT-5.6 Terra v2 · Sep 2026openai/gpt-5.6-terra+107.2self 106.5self 97.2self 107.2self 9v1 of 51.5ccbdd583 ↗
1127.336.5hermes · GLM 5.1 v1 · May 2026openrouter/z-ai/glm-5.1+9.26.5self 9.57.3self 9.57self 8.56.5self 9v2 of 105.64b324d80 ↗
1226.237claude-code · Sonnet 4.6 v1 · May 2026claude-sonnet-4-6+10.85.8self 97self 97self 106.3self 9v5 of 116.97ddc3c19 ↗
1325.336claude-code · Sonnet 5 v2 · Sep 2026anthropic/claude-sonnet-5+10.77.5self 95self 96.5self 86.3self 10v4 of 55.9240351f2 ↗
142436hermes · Sonnet 4.6 v1 · May 2026openrouter/anthropic/claude-sonnet-4.6+127.2self 95.2self 95.7self 96self 9v5 of 105.18969a1a0 ↗

Min/round: median wall-clock minutes per v2 round; for v1 lineages, the published first-run duration. Inflation = self-score minus judge score. Trajectory links open the Jetty run that produced the best round.

Compare one agent against the field

Pick an agent to highlight it. Everyone else stays in gray, so you can see where an agent sits in the pack without fourteen overlapping colors.

Self-scores by axis

What each agent gave its own best round (0–10)

selected agent, self-scoreother agents

Judge scores by axis

The external judge on the same drawings (0–10)

selected agent, judgeother agents

The hill climb, round by round

Score out of 40 for each round's final drawing. The selected agent shows both its self-score and the judge's score; gray lines are the other agents' judge scores. Use ←/→ on the chart to step through rounds.

selected agent, self-scoreselected agent, judgeother agents, judge
Show as table
Agentv1v2v3v4v5v6v7v8v9v10v11
opencode · Gemini 3.8 Flash · self38.5––––––––––
opencode · Gemini 3.8 Flash · judge32.8––––––––––
claude-code · Opus 5.5 · self3535363635––––––
claude-code · Opus 5.5 · judge32.73332.83333.3––––––
hermes · Jev Router · self363534.53736––––––
hermes · Jev Router · judge29.831.530.731.730.8––––––
gemini-cli · Gemini 3.5 Flash · self4038.538.44039.539.538.74037.539.2–
gemini-cli · Gemini 3.5 Flash · judge29.83129.331.732.330.53131.73231.2–
opencode · Gemini 3.5 Flash · self39.540394038.638.740383940–
opencode · Gemini 3.5 Flash · judge28.229.328.7292930.230.231.531.526.8–
hermes · Fusion router · self343434––––––––
hermes · Fusion router · judge28.827.729––––––––
claude-code · Opus 4.7 · self3335363234.536333333.534–
claude-code · Opus 4.7 · judge2929.328.729.72827.327.5272827.7–
opencode · Fusion router · self343634––––––––
opencode · Fusion router · judge29.328.328––––––––
hermes · Gemini 3.5 Flash · self3938373938.83838.53839.538.5–
hermes · Gemini 3.5 Flash · judge28.528.226.528.73026.82726.328.226.5–
opencode · GPT-5.6 Terra · self3837.23837.538––––––
opencode · GPT-5.6 Terra · judge2827.527.227.329.8––––––
hermes · GLM 5.1 · self3236.536333334.536343336.5–
hermes · GLM 5.1 · judge28.727.328.828.727.725.72524.724.225.7–
claude-code · Sonnet 4.6 · self3132343637363434333535
claude-code · Sonnet 4.6 · judge26.525.224.524.526.226.527.726.325.82825.3
claude-code · Sonnet 5 · self2834343636––––––
claude-code · Sonnet 5 · judge26.527.32725.326.2––––––
hermes · Sonnet 4.6 · self32343434363636363636–
hermes · Sonnet 4.6 · judge26.52724252422.219.21818.719.8–

One radar per agent

Self-score against judge score on the four rubric axes, for each agent's best round. A big amber shape around a small violet one means the agent was generous with itself.

agent self-scoreexternal judge

opencode · Gemini 3.8 Flash

v2 · round v1 · judge 32.8 · self 38.5

claude-code · Opus 5.5

v2 · round v3 · judge 32.8 · self 36

hermes · Jev Router

v2 · round v4 · judge 31.7 · self 37

gemini-cli · Gemini 3.5 Flash

v1 · round v1 · judge 29.8 · self 40

opencode · Gemini 3.5 Flash

v1 · round v2 · judge 29.3 · self 40

hermes · Fusion router

v1 · round v1 · judge 28.8 · self 34

claude-code · Opus 4.7

v1 · round v3 · judge 28.7 · self 36

opencode · Fusion router

v1 · round v2 · judge 28.3 · self 36

hermes · Gemini 3.5 Flash

v1 · round v9 · judge 28.2 · self 39.5

opencode · GPT-5.6 Terra

v2 · round v1 · judge 28 · self 38

hermes · GLM 5.1

v1 · round v2 · judge 27.3 · self 36.5

claude-code · Sonnet 4.6

v1 · round v5 · judge 26.2 · self 37

claude-code · Sonnet 5

v2 · round v4 · judge 25.3 · self 36

hermes · Sonnet 4.6

v1 · round v5 · judge 24 · self 36

Show as table
AgentRoundPelican selfBicycle selfComposition selfPolish selfPelican judgeBicycle judgeComposition judgePolish judge
opencode · Gemini 3.8 Flashv19.59.5109.58.77.788.5
claude-code · Opus 5.5v3991088.588.38
hermes · Jev Routerv49910987.78.37.7
gemini-cli · Gemini 3.5 Flashv1101010107.377.58
opencode · Gemini 3.5 Flashv21010101086.27.57.7
hermes · Fusion routerv1881087.36.77.77.2
claude-code · Opus 4.7v399997.56.37.77.2
opencode · Fusion routerv2999976.87.37.2
hermes · Gemini 3.5 Flashv99.5101010686.87.3
opencode · GPT-5.6 Terrav11091097.26.57.27.2
hermes · GLM 5.1v29.59.58.596.57.376.5
claude-code · Sonnet 4.6v5991095.8776.3
claude-code · Sonnet 5v4998107.556.56.3
hermes · Sonnet 4.6v599997.25.25.76

Want this kind of eval for your own agents?

Every run on this site is a Jetty runbook: versioned instructions, a pinned sandbox, and a trajectory you can inspect. Point Jetty at your task and get the same receipts.