Statements (32)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
large language model
|
| gptkbp:developedBy |
gptkb:NVIDIA
|
| gptkbp:documentation |
https://docs.nvidia.com/deeplearning/nemo/user-guide/docs/en/stable/nlp/nemo_megatron.html
|
| gptkbp:firstReleased |
2021
|
| https://www.w3.org/2000/01/rdf-schema#label |
NeMo Megatron
|
| gptkbp:integratesWith |
gptkb:NVIDIA_Triton_Inference_Server
gptkb:NVIDIA_Megatron-LM gptkb:NVIDIA_NGC gptkb:NVIDIA_NeMo_Toolkit |
| gptkbp:license |
Apache 2.0
|
| gptkbp:openSource |
true
|
| gptkbp:optimizedFor |
gptkb:NVIDIA_GPUs
|
| gptkbp:partOf |
gptkb:NVIDIA_NeMo
|
| gptkbp:platform |
gptkb:PyTorch
|
| gptkbp:repository |
https://github.com/NVIDIA/NeMo
|
| gptkbp:scalableTo |
trillions of parameters
|
| gptkbp:supports |
gptkb:T5
gptkb:GPT-2 gptkb:GPT-3 gptkb:BERT distributed training data parallelism model parallelism pipeline parallelism |
| gptkbp:usedFor |
natural language processing
translator question answering summarization text generation language modeling |
| gptkbp:bfsParent |
gptkb:Nvidia_NeMo
|
| gptkbp:bfsLayer |
6
|