Status: active. Base, driver and five tasks working; first batches run. More repetitions and tasks pending. Owning topic: operational workflow automation. Runbook: route-comparison experiments.
After the first manual comparison (Tactical 118), the operator asked for a repeatable way to run many such experiments: YA and agents inside a macOS Tart guest, model access through the host's agent-auth-router, and host YA analyzing results to find Machine Control gaps relative to Codex Computer Use.
Complete when a batch of at least five tasks, each run several times per route in disposable clones, produces oracle results and a host analysis without manual UI intervention.
Guests are dedicated appliances; the controller's desktop is never a trial target. AAR keeps its loopback bind; guests reach it only through a per-trial SSH reverse forward and a dedicated revocable client token. Transcripts, captures, tokens and private inventory stay out of this repository.
Run the five checks in the runbook's step 0: Computer Use through AAR, Computer Use in a guest, token visibility in guest agents, grants surviving clones, and guest YA session creation through the tunnel.
Prepared image, appliance resident, TCC grants, credential handoff, guest YA, Codex, Computer Use, Chrome with the extension, AAR client configuration, fixtures; prove it as the workspace ready base under a provisioning journal.
Driver: workspace, tunnels, setup, guest session, oracle, collection, release. Tasks: load unpacked extension, save through a native Save panel, web upload through a native Open panel, a System Settings toggle and a Finder rename/move, each with an application-state oracle.
Two concurrent trials at most. Host analyst session produces the gap classification; record sanitized results here and act on the largest gaps.
Each check in step 1 is recorded with its evidence level. A trial counts only with an oracle result; agent self-reports are secondary.
Current: The base is a Tart copy-on-write clone of the existing macOS candidate, with its own private inventory entry, configuration, workspace and claim state, and credential file, so the candidate stays unchanged for conformance. The clone used no extra disk at creation, booted to an unlocked session, and kept the resident's Accessibility and Screen Recording grants.
Inside the guest: Node 24 (already present), npm-installed Codex CLI and
YepAnywhere, a public machine-control clone, and Chrome for Testing. YA runs
as a per-user LaunchAgent on 127.0.0.1:3400. Codex uses an aar model
provider at http://127.0.0.1:8417/codex with env_key = "AAR_TOKEN"; the
LaunchAgent wrapper reads the token from a 0600 file. The controller reaches
the guest over SSH with a dedicated key; the guest's host key is read through
the Tart guest agent and pinned under a host-key alias, not trusted on first
use. One SSH connection carries -R 127.0.0.1:8417 to the controller's AAR and
-L to the guest YA. A dedicated AAR client grants only the Codex account.
| Check | Result |
|---|---|
| Token reaches guest agents | Pass: a YA-launched guest Codex session saw AAR_TOKEN and completed through AAR |
| Guest YA through the tunnel | Pass: session created and polled from the controller via the forwarded port |
| Clones keep grants | Pass: an isolated workspace clone booted unlocked, started ChatGPT and YA, passed guest Machine Control doctor and Computer Use accessibility, and was discarded on release |
| Gateway authentication | Unauthenticated request through the reverse forward returns 401 |
| Computer Use in the guest | Pass without a ChatGPT sign-in: getState, accessibility tree and a real screenshot |
| Computer Use through AAR | Pass: the guest's Codex used the js/cua tool with the aar provider |
Guest-local machine-control --target host target doctor passes every check
under the appliance's standing policy, so guest agents drive the guest desktop
target-natively.
Computer Use setup, so a rebuild needs no sign-in or human step:
- Copy the controller's matching
/Applications/ChatGPT.app,~/.codex/computer-useand~/.codex/plugins/cache/openai-bundledinto the guest and mirror the controller's computer-use plugin andnode_replMCP configuration with guest paths. OpenAI's signatures verify strictly there. node_replcannot start the Computer Use service unless the ChatGPT app is running; signed out is enough. A per-user LaunchAgent opens it at login.- Accessibility: press the service's Allow, turn on its switch through the
guest's own Machine Control, and answer the Privacy & Security sheet with an
authorization.beginlease andauthorization-submit --stored. - Screen Recording: the pane's Add button opens an Open panel;
desktop dialog chooseselects the service's.app, then Quit & Reopen.
Notes: Chrome for Testing raises a keychain prompt unless launched with
--use-mock-keychain --password-store=basic; its published bundle is unsealed,
so strict signature verification fails everywhere. The guest volume has about
12 GiB free after setup.
Current: tests/experiments/route_comparison.py with five tasks. Each
trial ran in its own isolated clone; every clone was discarded.
| Task | Computer Use | MC CLI (after fixes) | mc-repl prototype |
|---|---|---|---|
| System Settings option | pass, 25 s, 4 calls | pass, 135 s, 23 | pass, 35 s, 4 (after click fallback) |
| Load unpacked extension | fail, 55 s, 9 | pass, 85 s, 14 | pass, 55 s, 8 |
| Finder rename and move | pass, 45 s, 8 | pass, 75 s, 8 | pass, 75 s, 8 |
| Web page file picker | pass, 35 s, 6 | pass, 85 s, 12 | pass, 35 s, 4 |
| TextEdit save | pass, 35 s, 5 | pass, 65 s, 9 | pass, 45 s, 5 |
The original times are rounded controller polling waits, not precise agent turn durations; calls are model tool calls. Tactical 124 remeasured 23 retained trials from matched transcript events and found 0.2–9.4 seconds of polling excess. New batches record both clocks separately. One repetition per cell is anecdotal; the comparison needs repetitions before claiming rates.
Findings that changed Machine Control during the batches:
- The first smoke trial crashed the resident: a System Settings element reported a non-finite position and JSON encoding aborted the process. Replies now replace non-finite numbers with null.
- Every CLI trial spent about three calls on claim mistakes:
claim acquire --help,--claim C claim release, andclaim release --claim-id C. All three forms now work. - The host skill forbade opening a page's upload dialog, which blocked the
web picker when the browser extension was absent; it now directs agents to
press the file button and use
desktop dialog choose. - Computer Use failed only in the native folder chooser; the Machine Control
routes passed it with
dialog choose. - The persistent JavaScript route cut calls and time roughly in half against the CLI and approached Computer Use. Its remaining Settings failure was sidebar labels without a press action; clicking an element's centre when it cannot be pressed fixed it.
Open: a CLI equivalent of the element-centre click (or press fallback); Chrome web content deep in the accessibility tree is easy to miss with default snapshot depth; repetitions, more tasks (permission prompts, menus, drag), and a host YA analysis pass over the private results.
Pending.
Current, follow-up: Tactical 124 completed measurement hardening, deterministic native probes and five TextEdit repetitions per route. It owns the bounded pilot evidence; broader task/model coverage and this tactical's other open items remain separate.