The PyTorch Fully Sharded Data-Parallel (FSDP) API is Now Available
The PyTorch Fully Sharded Data-Parallel (FSDP) API is Now Available. They have included native support for Fully Sharded Data-Parallel (FSDP) in PyTorch 1.11

Source: MarkTechPost
The PyTorch Fully Sharded Data-Parallel (FSDP) API is Now Available. They have included native support for Fully Sharded Data-Parallel (FSDP) in PyTorch 1.11