Article · by Mike Taylor
Every’s editorial vibe check
37 documents, 21 questions each, 1,709 judgments for under a cent.
Dan Shipper
@danshipper
we almost never test new foundation models but we've been testing this for ~a week @every and it's pretty wild. the kind of things that will be obviously indispensible in 6-12 months it doesn't produce words as output, it produces probabilities. so it can efficiently act as a judge in cases where you'd need a Fable-level model—but in our testing was 25x faster and 600x lower priced excellent vibe check by @hammer_mt on @every: https://every.to/also-true-for-humans/mini-vibe-check-typesafe-s-jev-judged-everything-i-ve-written-in-0-7-seconds?utm_cta_source=home_main_a_3
Sep 15, 2026 · 1.8K likesOpen on X
Mike Taylor ran Jev over everything he has written for Every: 37 documents, 21 questions each, 1,709 judgments in total, for under a cent. The median time per passage was 0.35 seconds, against 8.83 seconds for Fable 5.1. Jev found six of the seven defects he had planted. Only the larger model found the seventh.
Open the source