|
gptkbp:instance_of
|
gptkb:software
|
|
gptkbp:bfsLayer
|
5
|
|
gptkbp:bfsParent
|
gptkb:Sci_BERT
|
|
gptkbp:based_on
|
Transformer architecture
|
|
gptkbp:developed_by
|
gptkb:Job_Search_Engine
NLP benchmarks
|
|
gptkbp:first_released
|
gptkb:2018
|
|
gptkbp:has_impact_on
|
AI ethics
Machine translation
Language understanding
|
|
gptkbp:has_variants
|
BERT-base
BERT-cased
BERT-large
BERT-multilingual
BERT-small
BERT-uncased
|
|
https://www.w3.org/2000/01/rdf-schema#label
|
BERT family
|
|
gptkbp:improves
|
Contextual word embeddings
|
|
gptkbp:includes
|
gptkb:BERT
gptkb:Distil_BERT
ALBERT
Ro BER Ta
|
|
gptkbp:influenced
|
Subsequent models
|
|
gptkbp:is_documented_in
|
gptkb:municipality
Online courses
Research papers
Technical blogs
Git Hub repositories
|
|
gptkbp:is_evaluated_by
|
gptkb:MNLI_benchmark
gptkb:GLUE_benchmark
gptkb:RACE_benchmark
S Qu AD benchmark
Co NLL-2003 benchmark
|
|
gptkbp:is_open_source
|
gptkb:battle
|
|
gptkbp:is_part_of
|
gptkb:technology
Deep learning models
Transformers family
|
|
gptkbp:is_popular_in
|
gptkb:Research_Institute
Industry applications
|
|
gptkbp:is_supported_by
|
gptkb:Graphics_Processing_Unit
gptkb:Py_Torch
gptkb:Hugging_Face
|
|
gptkbp:is_used_for
|
Question answering
Sentiment analysis
Text classification
|
|
gptkbp:is_used_in
|
Chatbots
Search engines
Recommendation systems
|
|
gptkbp:requires
|
Large datasets
High computational resources
|
|
gptkbp:supports
|
Bidirectional context
|
|
gptkbp:training
|
gptkb:Wikipedia
gptkb:Book_Corpus
|
|
gptkbp:tuning
|
Specific tasks
|
|
gptkbp:utilizes
|
Masked language modeling
Next sentence prediction
|