GitHub · by ikermoel
Open Alternative to Jev
Typed, calibrated decisions from any open-weights model, on your own GPU.

A Python library that answers typed questions from the next-token distribution of an open-weights model, restricted to your options, in one forward pass. It runs on Hugging Face Transformers and vLLM, with a live demo on Hugging Face Spaces and benchmarks in the repository.
Open the source
