[rl] Add Muse Glimmer renderer and Search-R1 RL config - #4145

Merged

HosseinKaviani-H merged 16 commits into

pytorch:mainfrom

HosseinKaviani-H:RL_config

Aug 31, 2026

Commits on Aug 31, 2026

Add a Muse Glimmer renderer so the model can run TorchTitan RL

HosseinKaviani-H
authored and
Hossein Kavianihamedani
committed
252deef
Muse Glimmer renderer: exclude template scaffolding from the loss mask

HosseinKaviani-H
authored and
Hossein Kavianihamedani
committed
8d7be36
Add a Search-R1 RL config for Muse Glimmer 30B

HosseinKaviani-H
authored and
Hossein Kavianihamedani
committed
485ba97
Fix lint: license headers, ufmt formatting, pyrefly optional import

HosseinKaviani-H
authored and
Hossein Kavianihamedani
committed
f420554
muse_glimmer renderer: classify config fields; document non-IB NCCL setup
Hossein Kavianihamedani
committed
d4af9d0
muse_glimmer renderer: require the chat template explicitly
Hossein Kavianihamedani
committed
f23052b
Move the muse_glimmer renderer under experiments/rl
Hossein Kavianihamedani
committed
1da7f21
Drop the NCCL env note from the RL README
Hossein Kavianihamedani
committed
5084138
Render Muse Glimmer natively in Python instead of via Jinja
Hossein Kavianihamedani
committed
07d8a1e
Point the Muse Glimmer config at the path download_hf_assets.py produces
Hossein Kavianihamedani
committed
915bcd2
Return RenderedTokens from bridge_to_next_turn, not a raw list
Hossein Kavianihamedani
committed
e64bd74
Mark the muse_glimmer renderer registration as a TODO
Hossein Kavianihamedani
committed
40e1a8e
Fix is_content semantics and honour thinking_retention in the bridge
Hossein Kavianihamedani
committed
230abb7
Register the muse_glimmer renderer where it is actually built
Hossein Kavianihamedani
committed
46987f8
Mark the muse_glimmer registration hook as an explicit TODO
Hossein Kavianihamedani
committed
d21c757
Move Muse Glimmer sequence-length config into TrainingConfig
Hossein Kavianihamedani
committed
54c2287

Navigation Menu

Uh oh!

[rl] Add Muse Glimmer renderer and Search-R1 RL config - #4145

[rl] Add Muse Glimmer renderer and Search-R1 RL config#4145
HosseinKaviani-H merged 16 commits into
pytorch:mainfrom
HosseinKaviani-H:RL_config

Commits on Aug 31, 2026

Add a Muse Glimmer renderer so the model can run TorchTitan RL

Muse Glimmer renderer: exclude template scaffolding from the loss mask

Add a Search-R1 RL config for Muse Glimmer 30B

Fix lint: license headers, ufmt formatting, pyrefly optional import

muse_glimmer renderer: classify config fields; document non-IB NCCL setup

muse_glimmer renderer: require the chat template explicitly

Move the muse_glimmer renderer under experiments/rl

Drop the NCCL env note from the RL README

Render Muse Glimmer natively in Python instead of via Jinja

Point the Muse Glimmer config at the path download_hf_assets.py produces

Return RenderedTokens from bridge_to_next_turn, not a raw list

Mark the muse_glimmer renderer registration as a TODO

Fix is_content semantics and honour thinking_retention in the bridge

Register the muse_glimmer renderer where it is actually built

Mark the muse_glimmer registration hook as an explicit TODO

Move Muse Glimmer sequence-length config into TrainingConfig