Statements (23)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
activation function
|
| gptkbp:address |
gptkb:dying_ReLU_problem
|
| gptkbp:alphaTypicalValue |
0.01
|
| gptkbp:category |
nonlinear activation function
|
| gptkbp:contrastsWith |
gptkb:ELU
gptkb:ReLU gptkb:Sigmoid gptkb:Tanh gptkb:PReLU |
| gptkbp:differentiable |
yes
|
| gptkbp:form |
f(x) = x if x > 0, else alpha * x
|
| https://www.w3.org/2000/01/rdf-schema#label |
Leaky ReLU
|
| gptkbp:introduced |
gptkb:Andrew_L._Maas
|
| gptkbp:introducedIn |
2013
|
| gptkbp:outputForNegativeInput |
small non-zero value
|
| gptkbp:outputForPositiveInput |
gptkb:identity
|
| gptkbp:parameter |
negative slope
|
| gptkbp:usedIn |
gptkb:artificial_neural_networks
convolutional neural networks deep learning |
| gptkbp:variant |
gptkb:ReLU
|
| gptkbp:bfsParent |
gptkb:ReLU
|
| gptkbp:bfsLayer |
6
|