Embeddings from Language Models

URI: https://gptkb.org/entity/Embeddings_from_Language_Models

GPTKB entity

Statements (48)

Predicate	Object
gptkbp:instanceOf	gptkb:academic_journal
gptkbp:abbreviation	gptkb:ELMo
gptkbp:author	gptkb:Kenton_Lee gptkb:Luke_Zettlemoyer gptkb:Matthew_E._Peters gptkb:Mark_Neumann gptkb:Christopher_Clark gptkb:Matt_Gardner Mohit Iyyer
gptkbp:citation	gptkb:BERT:_Pre-training_of_Deep_Bidirectional_Transformers_for_Language_Understanding gptkb:GPT:_Improving_Language_Understanding_by_Generative_Pre-Training over 10000 ULMFiT: Universal Language Model Fine-tuning for Text Classification
gptkbp:field	gptkb:Natural_Language_Processing
https://www.w3.org/2000/01/rdf-schema#label	Embeddings from Language Models
gptkbp:impact	improved state-of-the-art on six NLP tasks
gptkbp:influenced	gptkb:BERT gptkb:GPT Transformer-based models ULMFiT
gptkbp:language	English
gptkbp:license	Apache 2.0
gptkbp:memiliki_tugas	question answering sentiment analysis coreference resolution named entity recognition semantic role labeling textual entailment
gptkbp:method	contextual word embeddings character-based word representations
gptkbp:openSource	yes
gptkbp:organization	gptkb:University_of_Washington gptkb:Allen_Institute_for_AI
gptkbp:proposedBy	ELMo embeddings deep contextualized word representations
gptkbp:publicationYear	2018
gptkbp:publishedIn	gptkb:NAACL_2018
gptkbp:repository	https://github.com/allenai/allennlp
gptkbp:trainer	gptkb:SQuAD gptkb:Stanford_Sentiment_Treebank gptkb:SNLI CoNLL 2003 OntoNotes 5.0 Semantic Role Labeling (SRL) dataset
gptkbp:url	https://arxiv.org/abs/1802.05365
gptkbp:uses	bidirectional LSTM
gptkbp:bfsParent	gptkb:ELMo
gptkbp:bfsLayer	7