Statements (22)
Predicate | Object |
---|---|
gptkbp:instanceOf |
activation function
|
gptkbp:contrastsWith |
gptkb:ELU
gptkb:ReLU gptkb:Sigmoid gptkb:Tanh gptkb:PReLU |
gptkbp:defaultAlpha |
0.01
|
gptkbp:differentiable |
yes
|
gptkbp:form |
f(x) = x if x > 0 else alpha * x
|
https://www.w3.org/2000/01/rdf-schema#label |
LeakyReLU
|
gptkbp:introduced |
gptkb:Andrew_L._Maas
|
gptkbp:introducedIn |
2013
|
gptkbp:nonLinear |
yes
|
gptkbp:parameter |
negative slope
|
gptkbp:solvedBy |
gptkb:dying_ReLU_problem
|
gptkbp:usedIn |
convolutional neural networks
deep learning neural networks feedforward neural networks |
gptkbp:variant |
gptkb:ReLU
|
gptkbp:bfsParent |
gptkb:DCGAN
|
gptkbp:bfsLayer |
6
|