Network-in-Network architecture

E472886

Network-in-Network architecture is a convolutional neural network design that replaces traditional linear convolution layers with micro multilayer perceptrons (MLPs) to enhance feature abstraction and model expressiveness.

All labels observed (2)

Label Occurrences
Network-in-Network architecture canonical 2
Network In Network 1

How this entity was disambiguated

Statements (45)

Predicate Object
instanceOf convolutional neural network architecture
deep learning model architecture
image classification architecture
aimsTo enhance feature abstraction
improve classification performance
increase model expressiveness
basedOn convolutional neural networks
characterizedBy end-to-end training with backpropagation
nonlinear feature mapping within receptive fields
parameter efficiency compared to large fully connected layers
citationTitle Network In Network
domain computer vision
deep learning research
evaluatedOn CIFAR-10
CIFAR-100
ImageNet (ILSVRC-2012 subset)
linked to: ImageNet

SVHN
hasKeyIdea perform classification with global average pooling instead of fully connected layers
replace linear filters with small neural networks
improvesUpon AlexNet-style CNNs
linked to: AlexNet
includesLayerType convolutional layers
global average pooling layers
mlpconv layers
pooling layers
influenced Inception architecture
design of fully convolutional networks
use of 1x1 convolutions in later CNNs
introduces global average pooling as a replacement for fully connected layers
mlpconv layers
optimizationMethod stochastic gradient descent
outputType class probabilities
proposedBy Min Lin
Qiang Chen
Shuicheng Yan
publicationYear 2013
publishedIn arXiv:1312.4400
reduces overfitting compared to large fully connected layers
replaces linear convolution layers with micro multilayer perceptrons
trainingDataType labeled images
uses 1x1 convolutions
global average pooling
micro multilayer perceptrons
usesActivationFunction ReLU
usesRegularization dropout
weight decay

How these facts were elicited

Referenced by (3)

Full triples — surface form annotated when it differs from this entity's canonical label.

Inception architecture inspiredBy Network-in-Network architecture
GoogLeNet influencedBy Network-in-Network architecture
Network-in-Network architecture citationTitle Network In Network
linked to: Network-in-Network architecture