Hugging Face Blog·· 2022-05-02AI 评分40
Hugging Face Accelerate 支持 PyTorch FSDP 训练大模型
Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel
AI 导读
Hugging Face Accelerate 库现已支持 PyTorch FullyShardedDataParallel (FSDP)，无需修改代码即可利用其特性。
来源：Hugging Face Blog · huggingface.co