|
gptkbp:instance_of
|
gptkb:Natural_Language_Processing
|
|
gptkbp:achieved_state_of_the_art
|
NLP benchmarks
|
|
gptkbp:based_on
|
Transformer architecture
|
|
gptkbp:developed_by
|
gptkb:Google
|
|
gptkbp:first_released
|
gptkb:2018
|
|
gptkbp:has_impact_on
|
AI ethics
Machine translation
Language understanding
|
|
gptkbp:has_variants
|
BERT-base
BERT-cased
BERT-large
BERT-multilingual
BERT-small
BERT-uncased
|
|
https://www.w3.org/2000/01/rdf-schema#label
|
BERT family
|
|
gptkbp:improves
|
Contextual word embeddings
|
|
gptkbp:includes
|
gptkb:BERT
gptkb:Distil_BERT
gptkb:Ro_BERTa
ALBERT
|
|
gptkbp:influenced
|
Subsequent models
|
|
gptkbp:is_documented_in
|
gptkb:Tutorials
Online courses
Research papers
Technical blogs
Git Hub repositories
|
|
gptkbp:is_evaluated_by
|
gptkb:MNLI_benchmark
gptkb:SQu_AD_benchmark
gptkb:GLUE_benchmark
gptkb:RACE_benchmark
Co NLL-2003 benchmark
|
|
gptkbp:is_open_source
|
gptkb:Yes
|
|
gptkbp:is_part_of
|
gptkb:AI_technology
Deep learning models
Transformers family
|
|
gptkbp:is_popular_in
|
gptkb:scientific_community
Industry applications
|
|
gptkbp:is_supported_by
|
gptkb:Tensor_Flow
gptkb:Py_Torch
gptkb:Hugging_Face
|
|
gptkbp:is_trained_in
|
gptkb:Wikipedia
gptkb:Book_Corpus
|
|
gptkbp:is_used_in
|
Chatbots
Search engines
Recommendation systems
|
|
gptkbp:requires
|
Large datasets
High computational resources
|
|
gptkbp:supports
|
Bidirectional context
|
|
gptkbp:tuning
|
Specific tasks
|
|
gptkbp:used_for
|
Question answering
Sentiment analysis
Text classification
|
|
gptkbp:utilizes
|
Masked language modeling
Next sentence prediction
|
|
gptkbp:bfsParent
|
gptkb:Sci_BERT
|
|
gptkbp:bfsLayer
|
6
|