Skip to content

feat(fsdp2): load model on meta device for non-rank0 ranks (0 CPU RAM per worker) - #9982

Open
cben484 wants to merge 2 commits into
modelscope:mainfrom
cben484:feat/fsdp2-meta-loading
Open

feat(fsdp2): load model on meta device for non-rank0 ranks (0 CPU RAM per worker)#9982
cben484 wants to merge 2 commits into
modelscope:mainfrom
cben484:feat/fsdp2-meta-loading

style: apply yapf formatting

3e7771b
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs