Softmax Turns Scores into Leftover

Logits [1, 2, 0] become [0.2447, 0.6652, 0.0900]. Subtract the max before exponentiating. Dividing the raw scores by their sum is not softmax.

This Probability lesson is part of a paid plan. Sign in with a plan that includes this course to read it.