Properties (53)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
Transformer model
|
| gptkbp:architecturalStyle |
Encoder-Decoder
|
| gptkbp:author |
gptkb:Ari_Holtzman
gptkb:Noam_Shazeer gptkb:Colin_Raffel gptkb:Shinji_Yamaguchi gptkb:Jennifer_Chayes gptkb:Adam_Roberts Graham Neubig Yuan_Zhang Katherine_Lee Michele_Banko |
| gptkbp:basedOn |
Text-to-Text Transfer Transformer
|
| gptkbp:developedBy |
gptkb:Google_Research
|
| gptkbp:hasPerformance |
ROUGE score
MNLI score SQuAD score SuperGLUE score BLEU_score GLUE_score |
| gptkbp:hasVariants |
gptkb:T5-large
gptkb:T5-small gptkb:T5-3B gptkb:T5-11B gptkb:T5-base |
| https://www.w3.org/2000/01/rdf-schema#label |
T5 (2019)
|
| gptkbp:introduced |
2019
|
| gptkbp:isAvailableIn |
Hugging Face Model Hub
|
| gptkbp:isInfluencedBy |
GPT-2
BERT Transformer architecture |
| gptkbp:isOptimizedFor |
Question answering
Summarization Text classification Translation Text generation |
| gptkbp:isTrainedIn |
Supervised tasks
Unsupervised tasks |
| gptkbp:isUsedIn |
Chatbots
Sentiment analysis Text classification Text summarization Information retrieval Virtual assistants Machine translation Content generation |
| gptkbp:providesTrainingFor |
C4 dataset
|
| gptkbp:publishedIn |
arXiv
|
| gptkbp:raisesAwarenessAbout |
NLP_benchmarks
|
| gptkbp:supports |
multiple languages
|
| gptkbp:usedFor |
Natural Language Processing
|
| gptkbp:uses |
transfer learning
|
| gptkbp:utilizes |
Self-attention
|