Final benchmark · v1.020 Sep 2026

How well do agents
handle the real work?

Agentic Test & Validation. Explore the performance, cost, and speed of AI models across engineering workflows.

13models06workflowsInside the benchmark
Explore the benchmark

Find the right tradeoff.

Choose a workflow, then a measure.
Select any model to see its breakdown.

All workflows

The full benchmark, with validation scores averaged across all six engineering workflows.

Ranked by validation index

↑ Higher is better

Showing 7 of 13 models · All workflows · Validation index

Category-normalized validation index. Equal scores share the same performance; ordering does not break ties. How we measure ↗

Performance landscape

What does better performance cost?
Explore where each model lands.

All workflows
00.511.52455055606570758085
AnthropicDeepSeekMoonshotAINVIDIAOpenAIQwenZ.aiopencodeCost (lower is better)Performance (higher is better)Most attractive quadrant

Hover or tap a point for model details. Tap a provider in the legend to hide or show its models.

How to read this chart+

Each point is one model, colored by provider. Higher and further left is better. The dotted Pareto frontier connects models where no other model scores at least as well on both axes and strictly better on one. The shaded corner marks a strong combination of performance and cost. Cost and time are benchmark-wide averages; the workflow filter changes the validation index.

Understand the work behind the results.

Read the latest report Explore the methodology