Statements (28)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
large language model
|
| gptkbp:architecture |
decoder-only transformer
|
| gptkbp:collaboratesWith |
gptkb:Microsoft
gptkb:NVIDIA |
| gptkbp:developedBy |
gptkb:Microsoft
gptkb:NVIDIA |
| gptkbp:hardware |
gptkb:NVIDIA_DGX_SuperPOD
|
| gptkbp:hasModel |
gptkb:transformation
|
| https://www.w3.org/2000/01/rdf-schema#label |
Megatron-Turing NLG
|
| gptkbp:language |
English
|
| gptkbp:notableFor |
one of the largest language models as of 2021
|
| gptkbp:parameter |
530 billion
|
| gptkbp:purpose |
translator
question answering summarization text completion natural language generation |
| gptkbp:relatedTo |
gptkb:Turing_NLG
gptkb:GPT-3 gptkb:Megatron-LM |
| gptkbp:releaseDate |
2021
|
| gptkbp:trainer |
gptkb:Wikipedia
books web text |
| gptkbp:trainingFramework |
gptkb:DeepSpeed
gptkb:Megatron-LM |
| gptkbp:bfsParent |
gptkb:GPT-3
|
| gptkbp:bfsLayer |
5
|