GitHub · by Eric Zhang
openjev-sglang
A public Jev-compatible API on an open model: 64 tasks in under a second.
Eric Zhang
@ekzhang1
Inspired by @typesafeai , here is a Jev-compatible public API to play with It runs a comparable open model (Qwen3.6-35B-A3B), and just uses SGLang radix cache to preserve the prefill reuse / really fast parallel systemone generation - 64 tasks in <1s. github.com/ekzhang/openje…
Sep 17, 2026 · 925 likesOpen on X
Eric Zhang published a Jev-compatible API to play with. It runs an open model, Qwen3.6-35B-A3B, and uses the SGLang radix cache to reuse the prefill across parallel questions. He reports 64 tasks in under a second.
Open the source
