Statements (14)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:software
|
| gptkbp:compatibleWith |
PyTorch FSDP
|
| gptkbp:developedBy |
gptkb:PyTorch_Lightning_Team
|
| gptkbp:enables |
Fully Sharded Data Parallel training
|
| gptkbp:handles |
model sharding
gradient sharding optimizer sharding |
| https://www.w3.org/2000/01/rdf-schema#label |
FSDPStrategy
|
| gptkbp:improves |
scalability
|
| gptkbp:reduces |
memory usage
|
| gptkbp:supports |
large model training
|
| gptkbp:usedIn |
gptkb:PyTorch_Lightning
|
| gptkbp:bfsParent |
gptkb:PyTorch_Lightning_Strategies
|
| gptkbp:bfsLayer |
6
|