Skip to content

feat(quantization): add native FP8 inference (serve_fp8_weight) for DenseGeneral and GMM v2 - #5207

Open
Shuwen-Fang wants to merge 1 commit into
mainfrom
qwen3.5-serve-fp8-weight
Open

feat(quantization): add native FP8 inference (serve_fp8_weight) for DenseGeneral and GMM v2#5207
Shuwen-Fang wants to merge 1 commit into
mainfrom
qwen3.5-serve-fp8-weight

Commits

Commits on Sep 17, 2026