Statements (23)
Predicate | Object |
---|---|
gptkbp:instanceOf |
activation function
|
gptkbp:alternativeTo |
gptkb:ELU
gptkb:Leaky_ReLU gptkb:Parametric_ReLU Softplus |
gptkbp:application |
speech recognition
image recognition |
gptkbp:codomain |
non-negative real numbers
|
gptkbp:domain |
real numbers
|
gptkbp:form |
f(x) = max(0, x)
|
gptkbp:fullName |
gptkb:Rectified_Linear_Unit
|
https://www.w3.org/2000/01/rdf-schema#label |
ReLU function
|
gptkbp:introduced |
gptkb:Hahnloser_et_al.
|
gptkbp:introducedIn |
2000
|
gptkbp:property |
computationally efficient
non-linear not differentiable at zero sparse activation |
gptkbp:type |
gptkb:dying_ReLU_problem
|
gptkbp:usedIn |
gptkb:artificial_neural_networks
deep learning |
gptkbp:bfsParent |
gptkb:Multilayer_Perceptron
|
gptkbp:bfsLayer |
6
|