Skip to content

Add the neutral-prompts skill, scanner, and evaluation harness - #1

Closed
skyRolly wants to merge 3 commits into
mainfrom
1
Closed

skyRolly wants to merge 3 commits into
mainfrom
1

Conversation

@skyRolly

@skyRolly skyRolly commented Sep 8, 2026

Copy link
Copy Markdown
Owner

Ship a complete skill repository for neutral decision framing in prompts: a
prompt states the objective, context, constraints, criteria, and admissible
outcomes, and leaves the outcome to the evidence.

Skill

  • skills/neutral-prompts/SKILL.md: ten rules covering the split between settled
    constraints and open decisions, the seven admissible outcomes, paired
    negations, criteria in place of protected actions, symmetric intensity,
    observable thresholds, and the decision record.
  • references/: the pattern catalog (NP001-NP012), whole-prompt rewrites for the
    lifecycle, review, investigation, and accept/reject domains, and the
    decision-record format.
  • agents/: Gemini CLI command and the Codex explicit-invocation policy.

Tooling

  • scripts/scan_prompt.py: a standard-library scanner for the twelve catalogued
    patterns, with severities, inline suppression, JSON output, and exit codes.
  • scripts/run_evals.py: offline measurement of the scanner against 26 labeled
    cases; extra findings fail as loudly as missing ones, and neutral text the
    scanner still flags is recorded as a known limitation rather than hidden.

Distribution and verification

  • Manifests for Claude Code, Codex, Gemini, Qwen, Kimi, OpenCode, and Cursor,
    plus an opt-in SessionStart hook that never blocks session start.
  • 74 unit tests over the scanner, the harness, and repository invariants
    (mirror sync, manifest alignment, reference links, no placeholder content).
  • CI runs the suite on Python 3.9 and 3.12 across Linux and Windows, and
    verifies the plugin reaches "enabled" in a scratch Claude Code config.

Ship a complete skill repository for neutral decision framing in prompts: a
prompt states the objective, context, constraints, criteria, and admissible
outcomes, and leaves the outcome to the evidence.

Skill
- skills/neutral-prompts/SKILL.md: ten rules covering the split between settled
  constraints and open decisions, the seven admissible outcomes, paired
  negations, criteria in place of protected actions, symmetric intensity,
  observable thresholds, and the decision record.
- references/: the pattern catalog (NP001-NP012), whole-prompt rewrites for the
  lifecycle, review, investigation, and accept/reject domains, and the
  decision-record format.
- agents/: Gemini CLI command and the Codex explicit-invocation policy.

Tooling
- scripts/scan_prompt.py: a standard-library scanner for the twelve catalogued
  patterns, with severities, inline suppression, JSON output, and exit codes.
- scripts/run_evals.py: offline measurement of the scanner against 26 labeled
  cases; extra findings fail as loudly as missing ones, and neutral text the
  scanner still flags is recorded as a known limitation rather than hidden.

Distribution and verification
- Manifests for Claude Code, Codex, Gemini, Qwen, Kimi, OpenCode, and Cursor,
  plus an opt-in SessionStart hook that never blocks session start.
- 74 unit tests over the scanner, the harness, and repository invariants
  (mirror sync, manifest alignment, reference links, no placeholder content).
- CI runs the suite on Python 3.9 and 3.12 across Linux and Windows, and
  verifies the plugin reaches "enabled" in a scratch Claude Code config.
@skyRolly skyRolly closed this Sep 8, 2026
@skyRolly
skyRolly deleted the 1 branch September 8, 2026 09:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant