Skip to content
Made with Jev
Submit

X post · by OpenRouter

OpenRouter’s Ori Eval

Jev judged a 30-way labelling task faster than every model tested.

OpenRouter

@OpenRouter

1/ Jev, a decision model by @typesafeai, sparked a burst of projects and discussion. We tested it using Ori Eval against popular LLMs on OpenRouter at judging. Jev was >5x faster than the next fastest model, and even its slowest requests beat every other model's median.

Bar chart of median latency per model. Jev 154 ms, GPT-5.6 Luna 860 ms, DeepSeek V4.1 Flash 911 ms, Qwen3.8 Flash 914 ms, GLM 5.3 Flash 1544 ms.

Sep 19, 2026 · 921 likesOpen on X

OpenRouter ran Jev against popular models on their platform at judging. They reported Jev more than five times faster than the next fastest, with its slowest requests still beating every other model’s median.

Open the source

More like this