Skip to content

Make the parameter EMA's decay warm-up configurable: 9 for pretraining (Trainer), 1 for fine-tuning. - #223

Merged
copybara-service[bot] merged 1 commit into
mainfrom
test_993971503
Oct 6, 2026
Merged

copybara-service[bot] merged 1 commit into
mainfrom
test_993971503

Make the parameter EMA's decay warm-up configurable: 9 for pretrainin…

a3c7092
Select commit
Loading
Failed to load commit list.
Google CLA / cla/google succeeded Oct 6, 2026 in 14s

✅ All contributors are covered under a CLA with Google

See https://cla.developers.google.com/ for more info about Google's Contributor License Agreement (CLA).

ℹ️ Googlers: Go here to view more details and manage scans for this pull request.

Details

The following contributors were found for this pull request:

✅ a3c7092 PR Opener: @copybara-service[bot]
✅ a3c7092 Author: @xingyousong <xin******ng​@google.com>

(Only the first commit for a unique contributor is listed.)