Skip to content
Made with Jev

GitHub · by ikermoel

Open Alternative to Jev

Typed, calibrated decisions from any open-weights model, on your own GPU.

Preview of Open Alternative to Jev, from its source

A Python library that answers typed questions from the next-token distribution of an open-weights model, restricted to your options, in one forward pass. It runs on Hugging Face Transformers and vLLM, with a live demo on Hugging Face Spaces and benchmarks in the repository.

Open the source

More like this