Statements (22)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:activation_function
|
| gptkbp:contrastsWith |
gptkb:ELU
gptkb:ReLU gptkb:Sigmoid gptkb:Tanh gptkb:PReLU |
| gptkbp:defaultAlpha |
0.01
|
| gptkbp:differentiable |
yes
|
| gptkbp:form |
f(x) = x if x > 0 else alpha * x
|
| gptkbp:introduced |
gptkb:Andrew_L._Maas
|
| gptkbp:introducedIn |
2013
|
| gptkbp:nonLinear |
yes
|
| gptkbp:parameter |
negative slope
|
| gptkbp:solvedBy |
gptkb:dying_ReLU_problem
|
| gptkbp:usedIn |
convolutional neural networks
deep learning neural networks feedforward neural networks |
| gptkbp:variant |
gptkb:ReLU
|
| gptkbp:bfsParent |
gptkb:DCGAN
|
| gptkbp:bfsLayer |
6
|
| https://www.w3.org/2000/01/rdf-schema#label |
LeakyReLU
|