Guide · nishtahir.com
Build your own decision model
Nish Tahir builds one from Qwen3-1.7B: constrain the output to a fixed set of options, read the probabilities in one pass, then fix the overconfidence with temperature scaling. It comes with a repository of scripts to build a dataset, evaluate, fine-tune and calibrate.
Open the source