Properties (48)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
model
|
| gptkbp:architect |
encoder-decoder
|
| gptkbp:developedBy |
gptkb:Google_Research
|
| gptkbp:hasAccreditation |
text
|
| gptkbp:hasCountry |
60 million
|
| https://www.w3.org/2000/01/rdf-schema#label |
T5-small
|
| gptkbp:isA |
transformer model
|
| gptkbp:isAvailableIn |
Hugging Face Model Hub
|
| gptkbp:isChallengedBy |
NLP_tasks
|
| gptkbp:isCompatibleWith |
gptkb:PyTorch
TensorFlow |
| gptkbp:isDocumentedIn |
research papers
online tutorials GitHub repositories |
| gptkbp:isEvaluatedBy |
gptkb:GLUE_benchmark
WMT SQuAD MNLI CoNLL-2003 SuperGLUE benchmark |
| gptkbp:isInfluencedBy |
transformer architecture
attention mechanisms sequence-to-sequence models |
| gptkbp:isOptimizedFor |
few-shot learning
|
| gptkbp:isPartOf |
gptkb:T5_family
GPT-2 BERT XLNet NLP_community |
| gptkbp:isTrainedIn |
multiple_NLP_tasks
|
| gptkbp:isUsedFor |
translation
question answering text generation summarization fine-tuning text classification |
| gptkbp:isUsedIn |
research papers
chatbots data augmentation language modeling virtual assistants content generation |
| gptkbp:providesTrainingFor |
several hours
C4 dataset |
| gptkbp:releasedIn |
2020
|
| gptkbp:requires |
GPU_for_training
|
| gptkbp:supports |
transfer learning
|
| gptkbp:uses |
text-to-text framework
|