Jev is not tricked by option order

More like this

• 

  Dan Shipper

  @danshipper

  we almost never test new foundation models but we've been testing this for ~a week @every and it's pretty wild. the kind of things that will be obviously indispensible in 6-12 months it doesn't produce words as output, it produces probabilities. so it can efficiently act as a judge in cases where you'd need a Fable-level model—but in our testing was 25x faster and 600x lower priced excellent vibe check by @hammer_mt on @every: https://every.to/also-true-for-humans/mini-vibe-check-typesafe-s-jev-judged-everything-i-ve-written-in-0-7-seconds?utm_cta_source=home_main_a_3

  

  Article·Benchmarks and evals

  Pick

  Every’s editorial vibe check

  Judgments

  1,709

  Total cost

  <$0.01

  Median per passage

  0.35 s

• 7xSpeed-up

  Article·Benchmarks and evals

  An agentic classification loop, 7x faster

  The loop replaced with a single Jev call, and the numbers published.

  Rr6i.it

• 

  Article·Benchmarks and evals

  JEV, por qué ha revolucionado todo

  A Spanish guide to what Jev is and how to try it.

  ADAlex dc

  193x