Statements (29)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:large_language_model
|
| gptkbp:architecture |
gptkb:transformation
|
| gptkbp:availableOn |
gptkb:Hugging_Face
|
| gptkbp:developedBy |
gptkb:EleutherAI
|
| gptkbp:language |
English
|
| gptkbp:license |
Apache 2.0
|
| gptkbp:notableFor |
open weights
multiple checkpoints transparent training process |
| gptkbp:openSource |
true
|
| gptkbp:purpose |
gptkb:research
language modeling |
| gptkbp:relatedTo |
gptkb:GPT-J
gptkb:GPT-NeoX |
| gptkbp:releaseYear |
2023
|
| gptkbp:size |
1B
12B 70M 1.4B 160M 2.8B 410M 6.9B |
| gptkbp:tokenizer |
GPT-NeoX tokenizer
|
| gptkbp:trainer |
gptkb:The_Pile
autoregressive |
| gptkbp:bfsParent |
gptkb:Databricks_Dolly
|
| gptkbp:bfsLayer |
8
|
| https://www.w3.org/2000/01/rdf-schema#label |
EleutherAI Pythia
|