← Back to the wire

Build your own decision model

AnnouncementModelOct 10, 2026

An article demonstrates how to build a "system one" decision model that selects from fixed options in a single pass, citing Jev as an example of such models. Using Qwen3-1.7B with constrained decoding, the approach achieved 59.38% accuracy on a CommonsenseQA holdout, improving to 62.41% after finetuning. The author shows output token probabilities are poorly calibrated: predictions with 0.9–1.0 confidence were correct only about 70% of the time.

Receipt № 23301 source · awaiting confirmation ◐

Evidence

1source· awaiting independent confirmation

No score is assigned. Sources and their independence are shown in the citation chain below.

Citation chain · 1 source

JevModel
Canonical: https://nishtahir.com/build-your-own-decision-model/