T5 (Text-To-Text Transfer Transformer)

GPTKB entity

Predicate	Object
gptkbp:instanceOf	gptkb:model
gptkbp:application	translator question answering summarization text generation text classification
gptkbp:architecture	encoder-decoder
gptkbp:arXivID	1910.10683
gptkbp:author	gptkb:Adam_Roberts gptkb:Colin_Raffel gptkb:Katherine_Lee gptkb:Michael_Matena gptkb:Noam_Shazeer gptkb:Peter_J._Liu gptkb:Sharan_Narang gptkb:Wei_Li gptkb:Yanqi_Zhou
gptkbp:citation	over 5000
gptkbp:developedBy	gptkb:Google_Research
gptkbp:fineTuning	supported
gptkbp:format	gptkb:text
gptkbp:github	https://github.com/google-research/text-to-text-transfer-transformer
https://www.w3.org/2000/01/rdf-schema#label	T5 (Text-To-Text Transfer Transformer)
gptkbp:influenced	gptkb:mT5 gptkb:Flan-T5 gptkb:ByT5
gptkbp:introducedIn	2019
gptkbp:language	English
gptkbp:license	Apache 2.0
gptkbp:notableRelease	gptkb:T5-11B gptkb:T5-3B gptkb:T5-Base gptkb:T5-Large
gptkbp:openSource	true
gptkbp:parameter	up to 11 billion
gptkbp:platform	gptkb:TensorFlow gptkb:PyTorch
gptkbp:pretrainingTask	span corruption
gptkbp:publishedIn	gptkb:Exploring_the_Limits_of_Transfer_Learning_with_a_Unified_Text-to-Text_Transformer
gptkbp:trainer	gptkb:GLUE gptkb:SQuAD gptkb:SuperGLUE gptkb:WMT gptkb:Colossal_Clean_Crawled_Corpus_(C4) gptkb:CNN/Daily_Mail gptkb:XSum C4
gptkbp:trainingObjective	text-to-text
gptkbp:bfsParent	gptkb:Forrest_Raffel
gptkbp:bfsLayer	6