Skip to content

claude-agent-acp pin 0.73.0 bundles Claude Code 2.1.257; claude-opus-5-5 requires 2.1.280 (0.81.0) #1137

Open

Description

@Benjamin-eecs

Status 2026-10-26


bench eval run --agent claude-agent-acp --model claude-opus-5-5 fails on every turn with:

ACP error -32603: Internal error: API Error: 400 Claude Code 2.1.257 does not support this model; version 2.1.280 or newer is required. Run 'claude update', or update the Claude desktop app, then try again.

benchflow 0.7.8 pins @agentclientprotocol/claude-agent-acp@0.73.0 (benchflow/agents/registry.py, _CLAUDE_AGENT_ACP_PACKAGE), which bundles Claude Code 2.1.257 through @anthropic-ai/claude-agent-sdk@0.3.257. claude-agent-acp@0.81.0 bundles 2.1.280 (claude-agent-sdk@0.3.280) and runs claude-opus-5-5 (verified 2026-09-23, Daytona sandbox, agent/runtime.json sandbox.claude_code_version = 2.1.280).

  • raise _CLAUDE_AGENT_ACP_PACKAGE to @agentclientprotocol/claude-agent-acp@0.81.0 (or make the pin overridable, e.g. BENCHFLOW_CLAUDE_AGENT_ACP_VERSION) — benchflow
  • until then FrontierPhysics-Infra re-pins it per run through FPINFRA_CLAUDE_AGENT_ACP_VERSION (mirror of FPINFRA_CODEX_ACP_VERSION) — Bo

Activity

  1. shubham2345 commented on Oct 8, 2026

    @shubham2345

    @Benjamin-eecs I would like to take this issue, not sure why I can't assign it to myself.

  2. shubham2345 commented on Oct 16, 2026

    @shubham2345

    Hello @Benjamin-eecs, PR for #1137, which fixes the claude-opus-5-5 400 error by bumping the claude-agent-acp pin to 0.81.0: #1184. It's one small commit. A review would be appreciated.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions