Pick model and reasoning effort per task
Jev scores difficulty and precision, a table in code maps that to a model lane, and the model stays put while the task is the same, so the cache survives.
Pick the model and reasoning effort for each task in this project with Jev, instead of sending everything to the biggest model. If the goal is routing turns inside the Claude Code or Codex CLI, check https://github.com/gargpratyush/jev-router first (open source, MIT). It wraps the real CLI and lets Jev pick the model per turn. If it fits, set it up and stop here. If not, say why and continue. 1. List the models and effort levels this project can call, with prices from config or the provider's page. Define lanes, cheapest first, such as SMALL_LOW, SMALL_HIGH, LARGE_LOW, LARGE_HIGH. Use this project's real model names. 2. Before each task, ask Jev in one request, with only the state the task needs (see https://docs.typesafe.ai/primitives): - Score: How hard is this task? Write a 4-level rubric for this project's work, with one example per level. - Noul: Does this task need exact precision (code that must compile, money, legal text, writes to data)? - Noul: Is this a different task from the previous turn? Send the previous task too. 3. Map the answers to a lane in code, in one table. Needing precision raises the lane one step. Low confidence picks the higher lane. Describe each option by what it can do; a bare label carries nothing. 4. Keep the same model for the session while the task has not changed. Switching models loses the prompt cache, so switch only when the lane changes. 5. Set a deadline on the Jev call. A late answer counts as no answer, and the default lane takes the task. 6. Let the user force a lane. 7. Run it in shadow first: Jev picks a lane while the current setup still does the work. Log the disagreements and show them to me. 8. Then run 30 real tasks through the router and through the current setup. Report lane, cost, latency, and every task where the cheaper lane failed a check. Do not make it the default until I approve.
Source: Made with Jev · Same idea as Jev Router, for your own providers