Statements (22)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
large language model
|
| gptkbp:availableOn |
gptkb:Hugging_Face
|
| gptkbp:basedOn |
LLaMA architecture
|
| gptkbp:developedBy |
gptkb:Together_AI
|
| gptkbp:hasModel |
decoder-only transformer
|
| https://www.w3.org/2000/01/rdf-schema#label |
RedPajama-INCITE
|
| gptkbp:language |
English
|
| gptkbp:license |
Apache 2.0
|
| gptkbp:notableFor |
open reproduction of LLaMA training dataset
|
| gptkbp:openSource |
true
|
| gptkbp:parameter |
3B
13B 7B 30B |
| gptkbp:releaseYear |
2023
|
| gptkbp:supports |
chat
text generation instruction following |
| gptkbp:trainer |
gptkb:RedPajama_dataset
|
| gptkbp:trainingDataSize |
1.2 trillion tokens
|
| gptkbp:bfsParent |
gptkb:RedPajama
|
| gptkbp:bfsLayer |
6
|