Properties (49)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
Transformer model
|
| gptkbp:application |
Chatbots
Sentiment analysis Named entity recognition Text generation Language translation Dialogue systems Text entailment |
| gptkbp:architect |
Encoder-Decoder
|
| gptkbp:basedOn |
Text-to-Text Transfer Transformer
|
| gptkbp:developedBy |
gptkb:Google_Research
|
| https://www.w3.org/2000/01/rdf-schema#label |
T5 family
|
| gptkbp:improves |
Task-specific datasets
|
| gptkbp:influencedBy |
GPT-2
BERT |
| gptkbp:introduced |
2019
|
| gptkbp:languageSpoken |
Multiple languages
|
| gptkbp:model |
Small, Base, Large, 3B, 11B
|
| gptkbp:performance |
gptkb:CNN/Daily_Mail
gptkb:GLUE SQuAD MNLI SuperGLUE CoNLL-2003 TREC XSum WikiSQL ROUGE score BLEU_score |
| gptkbp:providesTrainingFor |
C4 dataset
|
| gptkbp:raisesAwarenessAbout |
Question answering
Text classification Text summarization |
| gptkbp:releaseDate |
Open-source model
|
| gptkbp:supports |
Multi-task learning
|
| gptkbp:training |
gptkb:OpenSubtitles
Books Wikipedia Customer feedback Forums Product reviews News articles Scientific papers Social media posts GitHub repositories Common Crawl Self-supervised learning Web text |
| gptkbp:usedFor |
Natural Language Processing
|