Skip to content

perf(megatron): defer loss all-reduce to log time - #9966

Merged
tastelikefeet merged 2 commits into
modelscope:mainfrom
gakkiri:perf/megatron-defer-loss-allreduce
Sep 4, 2026
Merged

perf(megatron): defer loss all-reduce to log time#9966
tastelikefeet merged 2 commits into
modelscope:mainfrom
gakkiri:perf/megatron-defer-loss-allreduce

Commits

Commits on Aug 22, 2026