Statements (23)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
large language model
|
| gptkbp:basedOn |
transformer architecture
|
| gptkbp:contrastsWith |
gptkb:GPT-3
|
| gptkbp:developedBy |
gptkb:EleutherAI
|
| gptkbp:github |
https://github.com/kingoflolz/mesh-transformer-jax
|
| gptkbp:hardware |
GPU with at least 16GB VRAM
|
| https://www.w3.org/2000/01/rdf-schema#label |
GPT-J
|
| gptkbp:input |
gptkb:text
|
| gptkbp:language |
English
|
| gptkbp:license |
Apache 2.0
|
| gptkbp:notableFor |
open-source alternative to GPT-3
|
| gptkbp:openSource |
true
|
| gptkbp:output |
gptkb:text
|
| gptkbp:parameter |
6 billion
|
| gptkbp:pretrained |
true
|
| gptkbp:releaseYear |
2021
|
| gptkbp:supports |
question answering
text generation text completion text summarization |
| gptkbp:trainer |
gptkb:The_Pile
|
| gptkbp:bfsParent |
gptkb:transformation
|
| gptkbp:bfsLayer |
5
|