ELU: a negative side with a floor

Drag along ELU: x above zero, alpha (e^x - 1) below. The negative side never falls under -alpha, so outputs average closer to zero, and its slope never quite dies.

This page sets no cookie and sends nothing anywhere.

Where the numbers come from

gHashTag/t27 specs/ml/activation/elu_activation.t27 (t27 master 239b4b059): every value on the page is its fn bodies, compiled to wasm (logic.js)
Course 10 of t27.ai, neural-networks (gHashTag/trinity#1695): lesson 6 opens this widget

This widget's .t27 source · All widgets