Skip Connection

GPTKB entity

Statements (23)
Predicate Object
gptkbp:instanceOf Neural network architecture component
gptkbp:alsoKnownAs Residual connection
gptkbp:arXivID 1512.03385
gptkbp:describedBy gptkb:Deep_Residual_Learning_for_Image_Recognition
gptkbp:enables Identity mapping
Improved convergence
https://www.w3.org/2000/01/rdf-schema#label Skip Connection
gptkbp:introduced gptkb:Shaoqing_Ren
gptkb:Xiangyu_Zhang
gptkb:Jian_Sun
gptkb:Kaiming_He
gptkbp:introducedIn gptkb:ResNet
2015
gptkbp:operator Adds input to output of a layer
Bypasses one or more layers
gptkbp:purpose Enable training of deeper networks
Facilitate gradient flow
Mitigate vanishing gradient problem
gptkbp:usedIn Deep learning
Convolutional neural networks
Residual neural networks
gptkbp:bfsParent gptkb:Residual_Network
gptkbp:bfsLayer 7