Statements (21)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:software
|
| gptkbp:developedBy |
gptkb:Microsoft
|
| gptkbp:documentation |
https://www.deepspeed.ai/docs/
|
| gptkbp:feature |
data parallelism
mixed precision training model parallelism offloading gradient accumulation zero redundancy optimizer |
| https://www.w3.org/2000/01/rdf-schema#label |
DeepSpeedStrategy
|
| gptkbp:integratesWith |
gptkb:PyTorch_Lightning
gptkb:Hugging_Face_Transformers right |
| gptkbp:license |
gptkb:MIT_License
|
| gptkbp:openSource |
true
|
| gptkbp:repository |
https://github.com/microsoft/DeepSpeed
|
| gptkbp:supports |
gptkb:PyTorch
|
| gptkbp:usedFor |
distributed training
large-scale deep learning |
| gptkbp:bfsParent |
gptkb:PyTorch_Lightning_Strategies
|
| gptkbp:bfsLayer |
6
|