Skip to content
Made with Jev

GitHub · by David-Lolly

Jev-Compatible

Make an existing SGLang or vLLM deployment answer as a decision service.

Turn an existing SGLang or vLLM deployment into a Jev-compatible decision service. No training, no model changes: the serving layer supplies the typed answers.

Open the source

More like this