Softmax: how a network turns scores into a choice

Move three scores and the temperature: softmax turns them into probabilities that sum to one. Cool it and the top score takes almost everything; heat it and the choice evens out.

This page sets no cookie and sends nothing anywhere.

Where the numbers come from

gHashTag/t27 specs/ml/activation/softmax.t27 (t27 master 239b4b059): every value on the page is its fn bodies, compiled to wasm (logic.js)
Course 10 of t27.ai, neural-networks (gHashTag/trinity#1695): lesson 7 opens this widget

This widget's .t27 source · All widgets