perf(checkpoint): reduce allocating grouped MoE load overhead - #3580

Open

yuhezhang-ai wants to merge 11 commits into

mainfrom

yuhez/perf/moe-checkpoint-direct-fill

Commits on Aug 20, 2026

perf(checkpoint): reduce grouped MoE fallback overhead
yuhezhang-ai
committed
17fbdfe
perf(checkpoint): avoid initialized load destination copies
yuhezhang-ai
committed
da03590
perf(checkpoint): load Gemma4 experts into final storage
yuhezhang-ai
committed
533fec2
perf(checkpoint): load Gemma4 EP shards directly
yuhezhang-ai
committed
74f3539
ci(gemma4): reduce robustness time limit
yuhezhang-ai
committed
dfe3ea5

Commits on Aug 21, 2026