Statements (26)
| Predicate | Object |
|---|---|
| gptkbp:instance_of |
gptkb:Model
|
| gptkbp:bfsLayer |
5
|
| gptkbp:bfsParent |
gptkb:Tiny_BERT
|
| gptkbp:application |
question answering
sentiment analysis text classification |
| gptkbp:architectural_style |
gptkb:Transformers_character
|
| gptkbp:developed_by |
gptkb:Huawei
|
| https://www.w3.org/2000/01/rdf-schema#label |
Tiny BERT-6
|
| gptkbp:improves |
model efficiency
|
| gptkbp:is_compared_to |
gptkb:BERT
|
| gptkbp:is_evaluated_by |
gptkb:GLUE_benchmark
S Qu AD benchmark |
| gptkbp:is_tasked_with |
gptkb:software
|
| gptkbp:language |
English
|
| gptkbp:latest_version |
gptkb:Tiny_BERT-6
|
| gptkbp:orbital_period |
6 million
|
| gptkbp:performance |
F1 score
accuracy |
| gptkbp:provides_information_on |
gptkb:Wikipedia
gptkb:Book_Corpus |
| gptkbp:release_date |
gptkb:2020
|
| gptkbp:supports |
multi-task learning
|
| gptkbp:tuning |
possible
|
| gptkbp:uses |
knowledge distillation
self-supervised learning |