Tiny BERT-8

GPTKB entity

Statements (60)
Predicate Object
gptkbp:instance_of gptkb:Model
gptkbp:bfsLayer 5
gptkbp:bfsParent gptkb:Tiny_BERT
gptkbp:application Question answering
Sentiment analysis
Text classification
Named entity recognition
gptkbp:architectural_style gptkb:Transformers_character
gptkbp:community_support Active
gptkbp:compression_ratio Knowledge Distillation
gptkbp:developed_by gptkb:Huawei
https://www.w3.org/2000/01/rdf-schema#label Tiny BERT-8
gptkbp:input_output 512 tokens
gptkbp:is_a_framework_for gptkb:Graphics_Processing_Unit
gptkb:Py_Torch
gptkbp:is_evaluated_by Accuracy
F1 score
gptkbp:language English
gptkbp:mission Masked language modeling
gptkbp:notable_models gptkb:BERT
gptkbp:orbital_period 14 million
gptkbp:performance Faster than BERT
gptkbp:provides_information_on General English text
gptkbp:purpose gptkb:software
gptkbp:release_date gptkb:2020
gptkbp:release_format Open source
gptkbp:resolution 768 dimensions
gptkbp:size 8 layers
gptkbp:tuning gptkb:battle
gptkbp:type gptkb:railway_line
gptkbp:use_case Chatbots
Data mining
Speech recognition
Voice assistants
Market research
Personalization
Text summarization
Academic research
Search engines
User behavior analysis
Information retrieval
Customer feedback analysis
Text-to-speech
Content moderation
Recommendation systems
Trend analysis
Email filtering
Language translation
Semantic search
Social media analysis
Survey analysis
Spam detection
Dialogue systems
Content generation
Ad targeting
Legal document analysis
Medical text analysis
E-commerce product analysis
Financial report analysis
Knowledge extraction