Skip to content

Generic prefill blocking support for all models - #1301

Open
kdulla wants to merge 5 commits into
quic:mainfrom
kdulla:qwen3_5_blocking_fix
Open

Generic prefill blocking support for all models#1301
kdulla wants to merge 5 commits into
quic:mainfrom
kdulla:qwen3_5_blocking_fix

Conversation

@kdulla

@kdulla kdulla commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

Removed a requirement for prefill blocking modes to manually be allowed in modeling file, now just accepts the users prefill blocking mode if passed via qaic_config. Required for qwen3.6 prefill testing but made generic for all models.

Signed-off-by: Kushal Dulla <kdulla@qti.qualcomm.com>
Signed-off-by: Kushal Dulla <kdulla@qti.qualcomm.com>
@kdulla kdulla self-assigned this Sep 1, 2026
@ochougul

ochougul commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

CI-Ready

@ochougul

Copy link
Copy Markdown
Contributor

CI-Ready

@ochougul

Copy link
Copy Markdown
Contributor

CI-Ready

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants