Open source alternatives to Jev

doofz

@reversedoofz

WAIT. An open-source decision model with 322M parameters that beats Jev on some benchmarks... Runs locally on a PHONE... And now has a FREE API?! Meet THX-01. Weights: huggingface.co/doofz/THX-01 API (Free): api.hal-x.ai/docs/thx-01 pip install thx01

Rhythm Garg

@rhythmrg

You can now train your own decision model in our platform AC2! Jev-like models, custom fit for your use case :) We implement decision models through a language-model backbone with a small learned output layer called a decision head. The backbone processes the input, question, and answer choices, and the head produces scores which are softmaxed to produce a probability distribution over answer choices. Our software interface makes it easy to add a variable-sized decision head to frontier open-weight models. Choose any open source model, and train it as a decision model using Brier loss or cross-entropy loss. Training updates both the decision head and the language backbone. We tried it on 50k sampled training datapoints from the Civil Comments dataset, starting from Perplexity’s pplx-decider-v1-27b, and F1 for detecting toxic comments increased from 0.482 to 0.677 on 20k sampled eval datapoints. The training job took less than an hour on four B300 GPUs. Reach out to get started with your own classification task: https://docs.appliedcompute.com/platform/training/decisions