Skip to content

feat(mac): add BACKEND={llamacpp|mlx} knob for native MLX inference - #4

Open
soobrosa wants to merge 2 commits into
hanxiao:mainfrom
soobrosa:feat/mlx-backend-knob
Open

feat(mac): add BACKEND={llamacpp|mlx} knob for native MLX inference#4
soobrosa wants to merge 2 commits into
hanxiao:mainfrom
soobrosa:feat/mlx-backend-knob

mac: auto-enable 4-bit KV on mlx backend when --kv-bits is supported

23e71bb
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs