feat(iorails): add speculative streaming generation - #2133

Open

hazai wants to merge 7 commits into

feature/speculative-generation-m2

Commits on Jul 2, 2026

Commits on Jul 20, 2026

fix(iorails): log unexpected errors during speculative input-task cleanup
hazai
committed
fix(iorails): fail closed on unexpected errors in speculative input rails
hazai
committed
Added gt=0 to the speculative_max_buffered_tokens Field, so a non-positive value is now rejected at config-load time instead of silently degrading speculation.
hazai
committed

Commits on Jul 25, 2026