|
gptkbp:instanceOf
|
Natural language processing task
|
|
gptkbp:approach
|
gptkb:Transformer_models
gptkb:Causal_language_modeling
gptkb:Masked_language_modeling
gptkb:N-gram_models
gptkb:Neural_language_modeling
gptkb:Recurrent_neural_networks
gptkb:Statistical_language_modeling
|
|
gptkbp:example
|
gptkb:Dolly
gptkb:OpenAI_GPT-4o
gptkb:BART
gptkb:OpenAI_GPT
gptkb:Chinchilla
gptkb:WizardLM
gptkb:Yi-34B
gptkb:T5
gptkb:Yi
gptkb:Falcon_LLM
gptkb:CTRL
gptkb:Turing-NLG
gptkb:Gemini
gptkb:ELMo
gptkb:UL2
gptkb:Gemini_1.5
gptkb:Groq_LPU
gptkb:Phi-2
gptkb:Gemini_1.5_Pro
gptkb:GPT-2
gptkb:GPT-3
gptkb:GPT-4
gptkb:MosaicML
gptkb:DeepSeek-V2
gptkb:DeepSpeed
gptkb:Fairseq
gptkb:Megatron-LM
gptkb:MiniGPT-4
gptkb:Claude
gptkb:LLaMA
gptkb:Mistral
gptkb:Vicuna
gptkb:OpenHermes
gptkb:Phi-3
gptkb:Qwen2
gptkb:Baidu_Wenxin
gptkb:ERNIE
gptkb:PaLM
gptkb:Gemma
gptkb:Anthropic_Claude
gptkb:BERT
gptkb:BLOOM
gptkb:Google_Bard
gptkb:MPT
gptkb:Meta_Llama
gptkb:Mistral_Large
gptkb:OPT
gptkb:RWKV
gptkb:RedPajama
gptkb:StableLM
gptkb:Llama_2
gptkb:Llama_3
gptkb:Pythia
gptkb:ALBERT
gptkb:Baichuan
gptkb:DistilBERT
gptkb:InternLM
gptkb:Mixtral
gptkb:Qwen
gptkb:RoBERTa
gptkb:Transformer-XL
gptkb:XLNet
gptkb:Baidu_ERNIE
gptkb:KenLM
Alpaca
LSTM language model
|
|
gptkbp:goal
|
Estimate probability of word sequences
|
|
https://www.w3.org/2000/01/rdf-schema#label
|
Language modeling
|
|
gptkbp:input
|
Text corpus
|
|
gptkbp:measures
|
Perplexity
Cross-entropy
|
|
gptkbp:output
|
Probability distribution over words
|
|
gptkbp:relatedTo
|
gptkb:Probability_theory
gptkb:Corpus_linguistics
Natural language processing
Deep learning
Text mining
|
|
gptkbp:usedIn
|
Speech recognition
Chatbots
Question answering
Machine translation
Information retrieval
Text summarization
Text generation
Optical character recognition
Spelling correction
|
|
gptkbp:bfsParent
|
gptkb:Transformational_grammar
|
|
gptkbp:bfsLayer
|
6
|