Skip to content

GB10 real-time serving: opt-in quantization + serve-path optimizations (2.2x: 101.7 -> 46.5 ms/frame) - #103

Open
jethac wants to merge 11 commits into
NVIDIA:mainfrom
jethac:pr-gb10-realtime
Open

GB10 real-time serving: opt-in quantization + serve-path optimizations (2.2x: 101.7 -> 46.5 ms/frame)#103
jethac wants to merge 11 commits into
NVIDIA:mainfrom
jethac:pr-gb10-realtime

server: guard other_mimi reset_streaming for --skip-other-mimi

b67851c
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs