Uni LM

GPTKB entity

Statements (57)
Predicate Object
gptkbp:instance_of gptkb:language
gptkbp:achieved_state_of_the_art various NLP tasks
gptkbp:applies_to machine translation
question answering
text summarization
gptkbp:architecture gptkb:Transformers
gptkbp:based_on gptkb:BERT
gptkb:GPT
gptkbp:developed_by gptkb:Microsoft_Research
gptkbp:has_applications_in sentiment analysis
chatbots
information retrieval
text classification
gptkbp:has_variants gptkb:Uni_LMv1
gptkb:Uni_LMv2
gptkb:Uni_LMv3
https://www.w3.org/2000/01/rdf-schema#label Uni LM
gptkbp:introduced_in gptkb:2019
gptkbp:is_adopted_by gptkb:academic_research
startups
industry applications
large tech companies
gptkbp:is_compatible_with gptkb:Tensor_Flow
gptkb:Py_Torch
gptkbp:is_documented_in gptkb:Git_Hub
research papers
tutorials
technical blogs
gptkbp:is_evaluated_by gptkb:MS_MARCO
gptkb:GLUE_benchmark
gptkb:SQu_AD
XNLI
gptkbp:is_influenced_by gptkb:Transformers
self-attention mechanism
gptkbp:is_open_source gptkb:true
gptkbp:is_optimized_for multi-task learning
gptkbp:is_part_of NLP research community
gptkbp:is_supported_by community contributions
gptkbp:is_trained_in large text corpora
gptkbp:is_used_for language translation
text generation
text completion
text rewriting
gptkbp:is_used_in dialog systems
content generation
gptkbp:performance F1 score
accuracy
BLEU score
ROUGE score
gptkbp:published_in gptkb:ar_Xiv
gptkbp:supports natural language understanding
natural language generation
gptkbp:uses unsupervised learning
masked language modeling
sequence-to-sequence learning
gptkbp:bfsParent gptkb:Super_GLUE_benchmark
gptkbp:bfsLayer 5