Show, Attend and Tell

E899062

Show, Attend and Tell is a neural image captioning model that introduced visual attention mechanisms to dynamically focus on different parts of an image while generating descriptive text.

All labels observed (1)

Label Occurrences
Show, Attend and Tell canonical 2

How this entity was disambiguated

Statements (48)

Predicate Object
instanceOf attention-based model
deep learning model
neural image captioning model
affiliationContext University of Montreal
approach encoder-decoder architecture
citationImpact highly cited in vision-language research
demonstrates visualization of attention maps over image regions
domain computer vision
natural language processing
evaluationDataset Flickr30k
Flickr8k
MSCOCO
focusesOn different parts of an image during caption generation
goal generate descriptive natural language captions for images
hasAuthor Aaron Courville
Jimmy Ba
Kelvin Xu
Kyunghyun Cho
Richard Zemel
linked to: Richard C. Zemel

Ruslan Salakhutdinov
Ryan Kiros
Yoshua Bengio
hasFullName Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
improvesOver non-attention image captioning models
influenced transformer-based image captioning models
inspired later attention-based vision-language models
introduced visual attention mechanism for image captioning
language English captions
learningParadigm supervised learning
property dynamically attends to image regions at each word step
publicationType conference paper
publicationYear 2015
publishedIn International Conference on Machine Learning
linked to: ICML
publishedInShort ICML
task image caption generation
uses CNN features as image encoder
RNN language model
alignment model between image regions and words
hard attention
soft attention
visual attention
usesDecoder LSTM
linked to: LSTM networks

recurrent neural network
usesEncoder convolutional neural network
usesTrainingMethod REINFORCE for hard attention approximation
backpropagation through time
stochastic gradient descent
usesTrainingObjective maximum likelihood estimation

How these facts were elicited

Referenced by (2)

Full triples — surface form annotated when it differs from this entity's canonical label.

Show and Tell influenced Show, Attend and Tell