fix(lora): persist distributed optimizer parameter state - #2516

Open

Arist12 wants to merge 4 commits into

radixark:mainfrom

Arist12:fix/lora-checkpoint-optimizer-parameter-state

Commits on Aug 21, 2026

fix(lora): persist distributed optimizer parameter state
Arist12
committed
12f7112

Commits on Aug 22, 2026

test(lora): drop the resume E2E from this PR
Arist12
committed
55dc933

Commits on Aug 26, 2026

refactor(lora): narrow the optimizer parameter-state fix to its own scope
Arist12
committed
267aea0
fix(lora): agree on the training state before entering the restore collectives
Arist12
committed
7c2dd2e