Statements (23)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
activation function
|
| gptkbp:application |
convolutional neural networks
feedforward neural networks |
| gptkbp:contrastsWith |
gptkb:ReLU
gptkb:Leaky_ReLU SELU |
| gptkbp:form |
f(x) = x if x > 0, alpha*(exp(x)-1) if x <= 0
|
| https://www.w3.org/2000/01/rdf-schema#label |
ELU
|
| gptkbp:introduced |
gptkb:Djork-Arné_Clevert
|
| gptkbp:introducedIn |
2015
|
| gptkbp:parameter |
alpha
|
| gptkbp:property |
reduces vanishing gradient
smooth nonlinearity |
| gptkbp:publishedIn |
gptkb:arXiv:1511.07289
|
| gptkbp:standsFor |
gptkb:Exponential_Linear_Unit
|
| gptkbp:usedIn |
deep learning
|
| gptkbp:bfsParent |
gptkb:Graph_Attention_Networks
gptkb:Exponential_Linear_Unit gptkb:Leaky_ReLU gptkb:Parametric_ReLU gptkb:LeakyReLU gptkb:ReLU_function |
| gptkbp:bfsLayer |
7
|