Text-to-Text Transfer Transformer

GPTKB entity

Predicate	Object
gptkbp:instanceOf	gptkb:model large language model
gptkbp:abbreviation	gptkb:T5
gptkbp:architecture	gptkb:transformation
gptkbp:arXivID	1910.10683
gptkbp:author	gptkb:Adam_Roberts gptkb:Colin_Raffel gptkb:Katherine_Lee gptkb:Michael_Matena gptkb:Noam_Shazeer gptkb:Peter_J._Liu gptkb:Sharan_Narang gptkb:Wei_Li gptkb:Yanqi_Zhou
gptkbp:availableOn	gptkb:Hugging_Face gptkb:TensorFlow_Hub
gptkbp:developedBy	gptkb:Google_Research
https://www.w3.org/2000/01/rdf-schema#label	Text-to-Text Transfer Transformer
gptkbp:influenced	gptkb:mT5 gptkb:Flan-T5 gptkb:ByT5
gptkbp:input	gptkb:text
gptkbp:introducedIn	2019
gptkbp:language	English
gptkbp:license	Apache 2.0
gptkbp:memiliki_tugas	translator question answering summarization text generation sentence similarity text classification
gptkbp:notablePublication	gptkb:Exploring_the_Limits_of_Transfer_Learning_with_a_Unified_Text-to-Text_Transformer
gptkbp:notableVariant	gptkb:mT5 gptkb:Flan-T5 gptkb:ByT5 T5.1.1
gptkbp:openSource	yes
gptkbp:output	gptkb:text
gptkbp:parameter	up to 11 billion
gptkbp:pretrainingTask	span corruption
gptkbp:taskFormat	text-to-text
gptkbp:trainer	gptkb:WMT gptkb:Wikipedia gptkb:OpenWebText gptkb:Gigaword gptkb:Multi-News gptkb:Colossal_Clean_Crawled_Corpus gptkb:Common_Crawl gptkb:BooksCorpus
gptkbp:trainingObjective	maximum likelihood estimation
gptkbp:bfsParent	gptkb:T5:_Exploring_the_Limits_of_Transfer_Learning_with_a_Unified_Text-to-Text_Transformer
gptkbp:bfsLayer	7