← all runs

Bench leaderboard

This table ranks models on markup, not on whether the output works.
26 of 139 graded runs pass every execution check (19%). see verified examples →

Auto-scored matrix across 198 runs · 2 models · 21 skill kinds. Scoring rubric: validity + fidelity + structure + depth + cleanliness (max 10/step).

Score over time

Dots = individual steps. Solid lines = rolling-3 average per model. As we swap models + skills the line tells the story of where we got better — or worse.

0 2 4 6 8 10 07/21 13:4007/28 08:2908/04 03:1708/10 22:0608/17 16:54
qwen-image (464) unknown (0)

Axis breakdown over time

Each rubric axis (max 2) plotted independently. Useful for diagnosing — e.g. fidelity climbs when subject-token recall improves, structure climbs when models start emitting proper semantic tags.

0 0.5 1 1.5 2 07/21 13:4007/28 08:2908/04 03:1708/10 22:0608/17 16:54
validity fidelity structure depth cleanliness

Model × skill (avg of 198 runs)

Model code-appcontent-piecedashboardemail-draftemail-sequenceimage-genlogo-svgmanifest-skillmarketing-planops-docproject-dnaresearchseo-metaslide-decksocial-cardstyle-guidetask-boardvideo-genweb-researchwebsitewidget overall
qwen-image 6.0 /10 (27) 0.0 /10 (3) 0.0 /10 (6) 10.0 /10 (6) 0.0 /10 (2) 7.5 /10 (215) 0.0 /10 (2) 0.0 /10 (31) 6.5 /10 (25) 0.0 /10 (4) 0.0 /10 (11) 10.0 /10 (16) 0.0 /10 (2) 10.0 /10 (2) 0.0 /10 (4) 0.0 /10 (2) 10.0 /10 (2) 2.0 /10 (6) 0.0 /10 (15) 8.4 /10 (80) 0.0 /10 (3) 6.2 /10
unknown — — — — — — — — — — — — — — — — — — — — — —

All graded runs

r-1786985666467-wm46r Design a vivid, color-saturated landing page for a holographic music festival — animated neon-ribbon hero, gla 25 / 30 qwen-image r-1786954949116-jks0t build a super mario game 11 / 20 qwen-image r-1786954729083-c6m4s create a business plan for a hyrox shoe business 20 / 40 qwen-image r-1786952331083-a7811 Generate an image of a mountain at sunset over a data centre 8 / 10 qwen-image r-1786952213541-4g68i Write a 4 email onboarding sequence for new Own1 owners 0 / 10 qwen-image r-1786952175346-mt3je Design a social share card announcing our product launch 0 / 10 qwen-image r-1786952147606-txees Generate SEO meta tags and titles for a solar installer homepage 0 / 10 qwen-image r-1786951615897-2hdrn Write a marketing plan for launching Own1 hardware in the Philippines 40 / 60 qwen-image r-1786951534321-hrvro Make a 10 slide investor pitch deck for a sovereign compute company called Own1 10 / 20 qwen-image r-1786941201716-yk2qr Build a risk register for a village hall roof replacement, with likelihood, impact, owner and mitigation for e 20 / 10 qwen-image r-1786941152635-t9xsf Write an investor one pager for a company selling refurbished laptops to schools, covering problem, solution, 20 / 10 qwen-image r-1786941106684-rmmse Produce a quote sheet for a landscaping job: turfing, fencing and a patio, with line items, quantities, unit p 20 / 10 qwen-image r-1786941046131-pphe2 Write a proposal and statement of work for rebuilding a dentist's website, with scope, deliverables, timeline 20 / 10 qwen-image r-1786940967479-o3xkq Create a downloadable checklist that a small accountancy firm can offer in exchange for an email address, cove 20 / 10 qwen-image r-1786940908795-leh42 Create a one page sell sheet for a stainless steel insulated water bottle aimed at independent outdoor retaile 20 / 10 qwen-image r-1786940876359-ob1hw Generate a five second clip of rain falling on a window at night. 2 / 10 qwen-image r-1786940813731-2635n Build a dashboard showing quarterly revenue, active customers, churn rate and support tickets for a small SaaS 20 / 10 qwen-image r-1786940735522-xu5sj Write one launch announcement email for a local bike repair shop opening its second branch, with a subject lin 10 / 10 qwen-image r-1786940600718-kue62 Research what nixos.org and nixos.wiki currently say about declaring systemd services, and write a cited repor 10 / 20 qwen-image r-1786940460821-pt40m Write a structured research report on the state of home energy storage in 2026: current battery chemistries, t 10 / 20 qwen-image r-1786921293615-qhtrd Build a risk register for a village hall roof replacement, with likelihood, impact, owner and mitigation for e 19 / 10 qwen-image r-1786921244237-xszjk Write an investor one pager for a company selling refurbished laptops to schools, covering problem, solution, 19 / 10 qwen-image r-1786921192726-fesrd Produce a quote sheet for a landscaping job: turfing, fencing and a patio, with line items, quantities, unit p 19 / 10 qwen-image r-1786921127633-xk50f Write a proposal and statement of work for rebuilding a dentist's website, with scope, deliverables, timeline 19 / 10 qwen-image r-1786921069276-enhx6 Create a downloadable checklist that a small accountancy firm can offer in exchange for an email address, cove 19 / 10 qwen-image r-1786920809522-ezho5 Create a one page sell sheet for a stainless steel insulated water bottle aimed at independent outdoor retaile 19 / 30 qwen-image r-1786920770384-p4y46 Generate a five second clip of rain falling on a window at night. 2 / 10 qwen-image r-1786920721048-64acl Build a dashboard showing quarterly revenue, active customers, churn rate and support tickets for a small SaaS 20 / 10 qwen-image r-1786920653240-sqb1m Write one launch announcement email for a local bike repair shop opening its second branch, with a subject lin 10 / 10 qwen-image r-1786920513056-jk057 Research what nixos.org and nixos.wiki currently say about declaring systemd services, and write a cited repor 10 / 20 qwen-image r-1786920323057-3kbc8 Write a structured research report on the state of home energy storage in 2026: current battery chemistries, t 10 / 20 qwen-image r-1786920237561-r826h Build a risk register for a village hall roof replacement, with likelihood, impact, owner and mitigation for e 19 / 10 qwen-image r-1786920188296-ymwce Write an investor one pager for a company selling refurbished laptops to schools, covering problem, solution, 19 / 10 qwen-image r-1786920145620-se01y Produce a quote sheet for a landscaping job: turfing, fencing and a patio, with line items, quantities, unit p 19 / 10 qwen-image r-1786919478210-v7k96 Write a proposal and statement of work for rebuilding a dentist's website, with scope, deliverables, timeline 19 / 10 qwen-image r-1786919420143-jyjig Create a downloadable checklist that a small accountancy firm can offer in exchange for an email address, cove 19 / 10 qwen-image r-1786919164713-zgjr8 Create a one page sell sheet for a stainless steel insulated water bottle aimed at independent outdoor retaile 19 / 30 qwen-image r-1786919123438-ray44 Generate a five second clip of rain falling on a window at night. 2 / 10 qwen-image r-1786919076529-4vd3e Build a dashboard showing quarterly revenue, active customers, churn rate and support tickets for a small SaaS 20 / 10 qwen-image r-1786919012029-xp66k Write one launch announcement email for a local bike repair shop opening its second branch, with a subject lin 10 / 10 qwen-image r-1786918882948-24mod Research what nixos.org and nixos.wiki currently say about declaring systemd services, and write a cited repor 10 / 20 qwen-image r-1786918748145-x08w7 Write a structured research report on the state of home energy storage in 2026: current battery chemistries, t 10 / 20 qwen-image r-1786918668805-1w9ro Build a risk register for a village hall roof replacement, with likelihood, impact, owner and mitigation for e 19 / 10 qwen-image r-1786918616467-gssqw Write an investor one pager for a company selling refurbished laptops to schools, covering problem, solution, 19 / 10 qwen-image r-1786918567777-4x3c4 Produce a quote sheet for a landscaping job: turfing, fencing and a patio, with line items, quantities, unit p 19 / 10 qwen-image r-1786918503337-yuv07 Write a proposal and statement of work for rebuilding a dentist's website, with scope, deliverables, timeline 19 / 10 qwen-image r-1786918456773-dwj8u Create a downloadable checklist that a small accountancy firm can offer in exchange for an email address, cove 19 / 10 qwen-image r-1786918176587-hzodi Create a one page sell sheet for a stainless steel insulated water bottle aimed at independent outdoor retaile 19 / 30 qwen-image r-1786918133539-my9o1 Generate a five second clip of rain falling on a window at night. 2 / 10 qwen-image r-1786918088176-kidoc Build a dashboard showing quarterly revenue, active customers, churn rate and support tickets for a small SaaS 20 / 10 qwen-image