|
gptkbp:instance_of
|
gptkb:language
|
|
gptkbp:application
|
natural language processing
|
|
gptkbp:architecture
|
gptkb:Transformers
|
|
gptkbp:available_in
|
gptkb:Hugging_Face_Transformers
|
|
gptkbp:coat_of_arms
|
gptkb:24
|
|
gptkbp:community_support
|
active
|
|
gptkbp:developed_by
|
gptkb:Google_Research
|
|
gptkbp:drops
|
0.1
|
|
gptkbp:evaluates
|
gptkb:GLUE
gptkb:Super_GLUE
|
|
gptkbp:feed_forward_size
|
4096
|
|
gptkbp:focus_area
|
gptkb:true
|
|
gptkbp:hardware_used
|
gptkb:TPUs
|
|
gptkbp:has_achieved
|
state-of-the-art results
|
|
gptkbp:has_publications
|
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
|
|
gptkbp:hidden_size
|
1024
|
|
https://www.w3.org/2000/01/rdf-schema#label
|
T5-XXL
|
|
gptkbp:initiated_by
|
Re LU
|
|
gptkbp:input_output
|
gptkb:text
|
|
gptkbp:is_open_source
|
gptkb:true
|
|
gptkbp:is_tasked_with
|
text-to-text transfer
|
|
gptkbp:is_trained_in
|
C4 dataset
|
|
gptkbp:language_support
|
gptkb:French
gptkb:Spanish
gptkb:German
Chinese
English
|
|
gptkbp:mission
|
denoising autoencoder
|
|
gptkbp:orbital_period
|
11 billion
|
|
gptkbp:predecessor
|
gptkb:T5-Base
|
|
gptkbp:release_date
|
gptkb:2020
|
|
gptkbp:successor
|
gptkb:T5-3_B
|
|
gptkbp:supports
|
multiple languages
|
|
gptkbp:tokenization_method
|
gptkb:Sentence_Piece
|
|
gptkbp:training
|
weeks
|
|
gptkbp:tuning
|
possible
|
|
gptkbp:use_case
|
gptkb:translator
dialog systems
question answering
sentiment analysis
information retrieval
text generation
text summarization
text classification
text completion
named entity recognition
paraphrasing
|
|
gptkbp:uses
|
transfer learning
|
|
gptkbp:bfsParent
|
gptkb:T5-11_B-FT
|
|
gptkbp:bfsLayer
|
7
|