X · by cruzex100
Jev against Laya, a smoke test
Accuracy, calibration, latency and cost per decision, side by side.
amVT
@cruzex100
This is pretty good.. My smoke test earlier: Accuracy: Jev 0.727 Soft accuracy: Jev 0.580 · Laya 0.471 Calibration (ECE, lower is better): Jev 0.144 · Laya 0.213 Latency: Jev ~710ms · Laya ~30-40ms Cost per decision: Jev ~$0.0004 (API) · Laya ~$0 (self-hosted)
Sep 22, 2026 · 1 likesOpen on X
A user ran a smoke test comparing Jev and Laya. For Jev they report accuracy 0.727, soft accuracy 0.580, ECE 0.144, latency about 710 ms and about $0.0004 per decision. The Laya figures are in the same post.
Open the source
