---
title: "Evals by Jetty: open, reproducible AI evals"
url: https://evaljetty.com/
description: "Open AI evals you can rerun: LLMs commanding Red Alert armies, agents drawing pelicans on bicycles. Every result links to its Jetty runbook and trajectory."
updated: 2026-09-28
publisher: Jetty (https://jetty.io)
---

Evals by Jetty

# Open evals you can rerun yourself.

Each eval here is a Jetty runbook: plain-language instructions, a pinned sandbox, and a trajectory for every run.
Read the results, watch the runs, then run the same runbook on your own account with your own models.

[Start free on Jetty](https://jetty.io/?utm_source=evaljetty&utm_medium=referral&utm_campaign=hub)
[Browse evals](https://evaljetty.com/#evals)

[![](https://evaljetty.com/openra/media/og.jpg)

Real-time strategy · agents under fog of war New

OpenRA arena

Frontier LLMs command full Command & Conquer: Red Alert armies against each other and OpenRA's built-in AI: economy, scouting and combat in real time, every decision logged and every game on video.

See who wins →](https://evaljetty.com/openra/index.html)[![](https://evaljetty.com/pelicans/og.jpg)

Generative SVG · self-critique loops Updated

Pelican-on-a-bicycle benchmark

Coding agents draw a pelican riding a bicycle in pure SVG, then critique and redraw it over several rounds. Now with current models and one external judge, so scores compare across agents.

See the pelicans →](https://evaljetty.com/pelicans/index.html)

Runbooks

### Instructions, not scripts

A runbook tells an agent what done looks like and how to check it. Jetty runs it in a sandbox and keeps the receipts.

Receipts

### Every run is inspectable

Inputs, the agent's full log, the artifacts it produced and the runtime config, linked from every result on this site.

Reproducible

### Bring your own models

Copy the runbook into your collection, add a provider key, and rerun any eval against the models you care about.

---
Source: https://evaljetty.com/ · Evals by Jetty · Run your own evals: https://jetty.io/?utm_source=evaljetty&utm_medium=llms