Statements (14)
| Predicate | Object |
|---|---|
| gptkbp:instance_of |
gptkb:language
|
| gptkbp:architecture |
gptkb:Transformers
|
| gptkbp:based_on |
gptkb:BERT
|
| gptkbp:developed_by |
gptkb:Facebook_AI
|
| https://www.w3.org/2000/01/rdf-schema#label |
Ro BERTa
|
| gptkbp:language |
English
|
| gptkbp:performance |
state-of-the-art on several NLP tasks
|
| gptkbp:pretraining_objective |
masked language modeling
|
| gptkbp:provides_information_on |
160 GB of text
|
| gptkbp:release_year |
gptkb:2019
|
| gptkbp:tuning |
possible for various tasks
|
| gptkbp:variant |
gptkb:BERT
|
| gptkbp:bfsParent |
gptkb:Model
|
| gptkbp:bfsLayer |
4
|