Skip to content

Fix NaN for full-parameter SFT with DeepSpeed ZeRO-1/2 on torch<2.9 (AdamW int32 flat-partition overflow) - #10023

Merged
tastelikefeet merged 1 commit into
modelscope:mainfrom
kiscad:main
Sep 3, 2026
Merged

Fix NaN for full-parameter SFT with DeepSpeed ZeRO-1/2 on torch<2.9 (AdamW int32 flat-partition overflow)#10023
tastelikefeet merged 1 commit into
modelscope:mainfrom
kiscad:main

Commits

Commits on Sep 2, 2026