Llama 3 70B

GPTKB entity

Statements (48)
Predicate Object
gptkbp:instanceOf large language model
gptkbp:architecture gptkb:transformation
gptkbp:availableOn gptkb:Hugging_Face
gptkb:AWS
gptkb:Google_Cloud
gptkb:Azure
gptkbp:context 8,192 tokens
gptkbp:developedBy gptkb:Meta_AI
gptkbp:format gptkb:text
gptkbp:hasModel decoder-only transformer
https://www.w3.org/2000/01/rdf-schema#label Llama 3 70B
gptkbp:intendedUse research
commercial applications
gptkbp:language English
gptkbp:license custom commercial license
gptkbp:notableFeature better instruction following
improved reasoning
higher accuracy than Llama 2
gptkbp:notableUser gptkb:Google
gptkb:Microsoft
gptkb:Hugging_Face
gptkb:AWS
gptkb:Meta
gptkbp:openSource false
gptkbp:parameter 70 billion
gptkbp:partOf Llama 3 family
gptkbp:platform high-end GPUs
gptkbp:predecessor gptkb:Llama_2_70B
gptkbp:releaseDate 2024-04-18
gptkbp:supports gptkb:dictionary
translator
chat
code generation
question answering
summarization
text generation
reasoning tasks
extraction
multi-turn dialogue
gptkbp:tokenizer Byte-Pair Encoding (BPE)
gptkbp:trainer reinforcement learning from human feedback
supervised fine-tuning
gptkbp:trainingDataCutoff 2023-03
gptkbp:trainingDataSource publicly available data
Meta-licensed data
synthetic data
gptkbp:bfsParent gptkb:Llama_API
gptkbp:bfsLayer 7