The T5 Text-to-Text Transfer Transformer

GPTKB entity

Statements (53)
Predicate Object
gptkbp:instance_of gptkb:Transformers
gptkbp:architecture encoder-decoder
gptkbp:based_on gptkb:Transformers
gptkbp:can_perform gptkb:translator
question answering
text generation
summarization
text classification
gptkbp:developed_by gptkb:Google_Research
gptkbp:has_achieved NLP tasks
gptkbp:has_applications_in gptkb:customer_support
language translation
content creation
sentiment analysis
chatbots
information retrieval
data extraction
virtual assistants
text summarization
gptkbp:has_variants gptkb:T5-large
gptkb:T5-small
gptkb:T5-base
gptkb:T5-11_B
gptkb:T5-3_B
https://www.w3.org/2000/01/rdf-schema#label The T5 Text-to-Text Transfer Transformer
gptkbp:introduced_in gptkb:2019
gptkbp:is_available_on gptkb:Hugging_Face_Model_Hub
gptkbp:is_compatible_with gptkb:Tensor_Flow
gptkb:Py_Torch
gptkbp:is_evaluated_by gptkb:MNLI_benchmark
gptkb:SQu_AD_benchmark
gptkb:GLUE_benchmark
gptkb:Super_GLUE_benchmark
gptkb:TREC_benchmark
gptkbp:is_influenced_by gptkb:GPT-2
gptkb:BERT
gptkb:Ro_BERTa
gptkb:XLNet
ALBERT
gptkbp:is_known_for flexibility in NLP tasks
gptkbp:is_open_source yes
gptkbp:is_part_of NLP toolkit
gptkbp:is_trained_in C4 dataset
supervised tasks
unsupervised tasks
gptkbp:is_used_in research papers
industry applications
gptkbp:supports multiple languages
gptkbp:uses transfer learning
self-attention mechanism
text-to-text framework
gptkbp:bfsParent gptkb:Noam_Shazeer
gptkbp:bfsLayer 6