X · by AJ Asver
Decision outputs in Grep
Frontier models do the research. Jev makes the final call against your criteria.
AJ Asver
@_aj
Every day this week, we're launching a new feature @GrepdotAI to help you automate the work that's slowing down your business. 𝗗𝗮𝘆 𝟮: 𝗗𝗲𝗰𝗶𝘀𝗶𝗼𝗻 𝗼𝘂𝘁𝗽𝘂𝘁𝘀 𝗽𝗼𝘄𝗲𝗿𝗲𝗱 𝗯𝘆 𝗝𝗲𝘃 Customers often ask why our agents don't attach confidence levels to their recommendations. My answer has been that LLM confidence levels don't mean much. The model writes a number after the answer, predicting what a confident-sounding score looks like, with a bias toward making humans happy. RLHF pushes models overconfident. Decision models like Jev by @typesafeai change that. You declare the options up front. Jev returns a probability for each one in a single pass, plus a confidence score derived from how concentrated that distribution is. TypeSafe trained it with RLCD, which rewards calibration instead of rater approval, so decisions at 0.9 should be right about 90% of the time. In Grep, you can now build agents that use frontier models for the research and diligence, then hand their findings to Jev to make the final decision against your criteria. You set the threshold: above it the agent acts, below it a human reviews.
Oct 13, 2026 · 30 likesOpen on X
Grep added decision outputs powered by Jev. Agents in Grep use frontier models for research and diligence, then hand their findings to Jev to decide against your criteria. You set the threshold: above it the agent acts, below it a person reviews. AJ Asver’s reason: an LLM writes its confidence after the answer, while Jev returns a probability for each declared option.
Open the source
