Statements (60)
| Predicate | Object |
|---|---|
| gptkbp:instance_of |
gptkb:Model
|
| gptkbp:application |
Question answering
Sentiment analysis Text classification Named entity recognition |
| gptkbp:architecture |
gptkb:Transformers
|
| gptkbp:community_support |
Active
|
| gptkbp:compression_technique |
Knowledge Distillation
|
| gptkbp:developed_by |
gptkb:Huawei
|
| gptkbp:evaluates |
Accuracy
F1 score |
| https://www.w3.org/2000/01/rdf-schema#label |
Tiny BERT-8
|
| gptkbp:input_output |
512 tokens
|
| gptkbp:is_a_framework_for |
gptkb:Tensor_Flow
gptkb:Py_Torch |
| gptkbp:language |
English
|
| gptkbp:mission |
Masked language modeling
|
| gptkbp:orbital_period |
14 million
|
| gptkbp:original_model |
gptkb:BERT
|
| gptkbp:performance |
Faster than BERT
|
| gptkbp:provides_information_on |
General English text
|
| gptkbp:purpose |
gptkb:Natural_Language_Processing
|
| gptkbp:release_date |
gptkb:2020
|
| gptkbp:release_type |
Open source
|
| gptkbp:resolution |
768 dimensions
|
| gptkbp:size |
8 layers
|
| gptkbp:tuning |
gptkb:Yes
|
| gptkbp:type |
gptkb:Flight
|
| gptkbp:use_case |
Chatbots
Data mining Speech recognition Voice assistants Market research Personalization Text summarization Academic research Search engines User behavior analysis Information retrieval Customer feedback analysis Text-to-speech Content moderation Recommendation systems Trend analysis Email filtering Language translation Semantic search Social media analysis Survey analysis Spam detection Dialogue systems Content generation Ad targeting Legal document analysis Medical text analysis E-commerce product analysis Financial report analysis Knowledge extraction |
| gptkbp:bfsParent |
gptkb:Tiny_BERT
|
| gptkbp:bfsLayer |
6
|