Deep contextualized word representations

E771674

Deep contextualized word representations is a seminal NLP paper that introduced ELMo, a deep bidirectional language model that produces context-sensitive word embeddings and significantly advanced performance on many language understanding tasks.

All labels observed (8)

How this entity was disambiguated

Statements (48)

Predicate Object
instanceOf natural language processing paper
scientific paper
abbreviation ELMo paper
approachType contextual word representation learning
author Christopher Clark
Kenton Lee
Luke Zettlemoyer
Mark Neumann
Matt Gardner
Matthew E. Peters
Mohit Iyyer
basedOn bidirectional language modeling
citationStatus highly cited
comparedTo GloVe
word2vec
demonstratesImprovementOn coreference resolution
named entity recognition
question answering
semantic role labeling
sentiment analysis
textual entailment
field computational linguistics
natural language processing
firstAuthor Matthew E. Peters
impact significantly advanced performance on many NLP benchmarks
improvesOver static word embeddings
influenced BERT
GPT contextual embeddings
contextualized language models
introduces ELMo
keyIdea represent each token as a function of the entire input sentence
use internal states of a deep bidirectional language model as word representations
language English
mainContribution context-sensitive word embeddings
deep bidirectional language model for word representations
deep contextualized word representations
proposesMethod ELMo embeddings
publicationYear 2018
publishedAt 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
linked to: NAACL 2018
publishedIn NAACL-HLT 2018
linked to: NAACL 2018
publisher Association for Computational Linguistics
shortTitle ELMo paper
taskCategory language understanding
title Deep contextualized word representations
usesArchitecture multi-layer bidirectional language model
usesModelType deep bidirectional LSTM
venue NAACL-HLT
linked to: NAACL 2018
year 2018

How these facts were elicited

Referenced by (22)

Full triples — surface form annotated when it differs from this entity's canonical label.

Elmo introducedInPaper Deep contextualized word representations
Deep contextualized word representations title Deep contextualized word representations
Deep contextualized word representations introduces ELMo
linked to: Deep contextualized word representations
Matt Gardner contributedTo ELMo language model
linked to: Deep contextualized word representations
Matt Gardner notableWork ELMo
linked to: Deep contextualized word representations
Kenton Lee knownFor ELMo contextual word embeddings
linked to: Deep contextualized word representations
Kenton Lee notableWork ELMo
linked to: Deep contextualized word representations
Kenton Lee notableWork Deep contextualized word representations
Kenton Lee hasCitation Deep contextualized word representations
NAACL 2018 notablePaper Deep contextualized word representations
NAACL 2018 introducedModel ELMo
linked to: Deep contextualized word representations
NAACL 2018 paperTitle Deep contextualized word representations
Embeddings from Language Models hasAbbreviation ELMo
linked to: Deep contextualized word representations
Embeddings from Language Models publicationTitle Deep contextualized word representations
Luke Zettlemoyer coDeveloperOf ELMo
linked to: Deep contextualized word representations
Luke Zettlemoyer notableWork ELMo: Deep contextualized word representations
linked to: Deep contextualized word representations
Matthew E. Peters knownFor ELMo
linked to: Deep contextualized word representations
Matthew E. Peters coDeveloperOf ELMo
linked to: Deep contextualized word representations
Matthew E. Peters coAuthorOf Deep contextualized word representations
Matthew E. Peters citationsForWork Deep contextualized word representations is highly cited in NLP research
linked to: Deep contextualized word representations
Matthew E. Peters impact ELMo became a standard baseline for contextual word embeddings
linked to: Deep contextualized word representations
Matthew E. Peters impact ELMo improved performance on multiple NLP benchmarks
linked to: Deep contextualized word representations