|
gptkbp:instance_of
|
gptkb:Natural_Language_Processing
|
|
gptkbp:application
|
gptkb:Biology
Question Answering
Sentiment Analysis
|
|
gptkbp:architecture
|
gptkb:Transformers
|
|
gptkbp:available_on
|
gptkb:Tensor_Flow
gptkb:Py_Torch
|
|
gptkbp:developed_by
|
gptkb:Google
|
|
gptkbp:focus_area
|
Self-Attention
Multi-Head Attention
|
|
gptkbp:has_impact_on
|
gptkb:stage_adaptation
Pretrained Models
NLP Benchmarks
|
|
gptkbp:has_variants
|
gptkb:Distil_BERT
gptkb:Tiny_BERT
gptkb:Ro_BERTa
gptkb:BERT-Base
gptkb:BERT-Large
ALBERT
|
|
https://www.w3.org/2000/01/rdf-schema#label
|
Google BERT
|
|
gptkbp:improves
|
Search Engine Results
|
|
gptkbp:influenced_by
|
gptkb:ELMo
gptkb:GPT
|
|
gptkbp:is_influential_in
|
gptkb:AI_Ethics
AI Development
Language Understanding
|
|
gptkbp:is_open_source
|
gptkb:True
|
|
gptkbp:is_part_of
|
gptkb:AI_Research
Deep Learning Frameworks
Machine Learning Community
|
|
gptkbp:is_trained_in
|
gptkb:Wikipedia
gptkb:Common_Crawl
gptkb:Book_Corpus
CC-News
Open Web Text
|
|
gptkbp:is_used_in
|
gptkb:Google
Chatbots
Information Retrieval
Text Summarization
Virtual Assistants
|
|
gptkbp:language
|
English
Multilingual
|
|
gptkbp:performance
|
Accuracy
F1 Score
Precision
Recall
|
|
gptkbp:pretraining_task
|
Masked Language Model
Next Sentence Prediction
|
|
gptkbp:release_date
|
gptkb:2018
|
|
gptkbp:uses
|
Bidirectional Context
|
|
gptkbp:bfsParent
|
gptkb:Open_AI_GPT-3
|
|
gptkbp:bfsLayer
|
5
|