Exponential LInear Unit - ReLU

Overview


{% ELU(x) = x %}
if {% x > 0 %}
{% ELU(x) = \alpha(e^x - 1) %}
if {% x \leq 0 %}

Hockey Stick Functions


Contents