Statements (14)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:software
|
| gptkbp:developedBy |
gptkb:Microsoft
|
| gptkbp:documentation |
https://pytorch-lightning.readthedocs.io/en/stable/advanced/model_parallel.html#deepspeed
|
| gptkbp:enables |
distributed training
mixed precision training model parallelism optimizer state sharding |
| https://www.w3.org/2000/01/rdf-schema#label |
DeepSpeedPlugin
|
| gptkbp:integratesWith |
gptkb:PyTorch_Lightning
|
| gptkbp:openSource |
true
|
| gptkbp:supports |
large language models
|
| gptkbp:usedFor |
accelerating deep learning training
|
| gptkbp:bfsParent |
gptkb:PyTorch_Lightning_Plugins
|
| gptkbp:bfsLayer |
6
|