Skip to content

feat: CPU reasoner bake-off for Qwen3.5-9B vs Bonsai - #25

Merged
eSlider merged 1 commit into
mainfrom
feat/reasoner-cpu-bakeoff
Aug 13, 2026
Merged

eSlider merged 1 commit into
mainfrom
feat/reasoner-cpu-bakeoff

Conversation

@eSlider

@eSlider eSlider commented Aug 13, 2026

Copy link
Copy Markdown
Owner

Summary

  • D18 bake-off runs on CPU (OLLAMA_NUM_GPU=0, 127.0.0.1:11435). PicoClaw and GPU are not required.
  • Same OpenAI tools PicoClaw would send (search / get / audit). Docs name real HF ids only; 2dph image does not bake weights.
  • Live CPU run (Ollama 0.32.9): both qwen3.5:9b and Bonsai-27B Q1_0 scored 3/3 tool_calls, 0 XML leak. 9B is smaller/faster; do not claim it is better at tools.

Test plan

  • go test ./internal/reasoner and published-docs contract
  • Live CPU bake-off against sidecar :11435 (host :11434 untouched)
  • CI green on this PR

Gitea: https://git.produktor.io/eSlider/2dph/issues/10

Measure OpenAI tool_calls (search/get/audit) on a CPU Ollama sidecar
instead of gating D18 on GPU or PicoClaw. Weights stay out of the image.
@cursor

cursor Bot commented Aug 13, 2026

Copy link
Copy Markdown

Bugbot is not enabled for your account, so this pull request was not reviewed.

Enable Bugbot in the Cursor dashboard to get automatic reviews on future PRs.

@eSlider
eSlider merged commit bb272d7 into main Aug 13, 2026
2 checks passed
@eSlider
eSlider deleted the feat/reasoner-cpu-bakeoff branch August 13, 2026 22:19
eSlider added a commit that referenced this pull request Aug 13, 2026
Measure OpenAI tool_calls (search/get/audit) on a CPU Ollama sidecar
instead of gating D18 on GPU or PicoClaw. Weights stay out of the image.
eSlider added a commit that referenced this pull request Aug 24, 2026
Measure OpenAI tool_calls (search/get/audit) on a CPU Ollama sidecar
instead of gating D18 on GPU or PicoClaw. Weights stay out of the image.
eSlider added a commit that referenced this pull request Sep 15, 2026
Measure OpenAI tool_calls (search/get/audit) on a CPU Ollama sidecar
instead of gating D18 on GPU or PicoClaw. Weights stay out of the image.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant