Statements (24)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
neural network layer
|
| gptkbp:appliesTo |
individual samples
|
| gptkbp:category |
normalization technique
|
| gptkbp:commonIn |
vision transformers
NLP models |
| gptkbp:dependsOn |
batch size
|
| gptkbp:distinctFrom |
BatchNorm
|
| gptkbp:field |
gptkb:machine_learning
deep learning |
| gptkbp:fullName |
Layer Normalization
|
| gptkbp:hasLearnableParameters |
beta
gamma |
| https://www.w3.org/2000/01/rdf-schema#label |
LayerNorm
|
| gptkbp:introduced |
gptkb:Geoffrey_E._Hinton
Jamie Ryan Kiros Jimmy Lei Ba |
| gptkbp:introducedIn |
2016
|
| gptkbp:publishedIn |
arXiv:1607.06450
|
| gptkbp:purpose |
normalize activations across features
|
| gptkbp:usedIn |
gptkb:BERT
gptkb:GPT transformer models |
| gptkbp:bfsParent |
gptkb:ViT-L
|
| gptkbp:bfsLayer |
7
|