test: run Chunk 2 and governance behavioral tests; fix failing rules

13 manual scenarios run across instructions and governance layers (two
rounds for failures). Fixed four rules that lost to RLHF defaults:

- Exploratory question format: tightened with boundary framing; added
  @import CONTEXT.md to repo CLAUDE.md and a standing rule to check
  docs/adr/ and ROADMAP resolved entries before answering design questions
  (3-round iteration to resolve)
- File-edit intent: added counter-example to stop clarification-seeking
- Push confirmation: reframed as "do not call the tool" not "ask first"
- Secrets rule: extended to cover credential reproduction in response
  text and usage examples, with explicit placeholder requirement

Scenario 4 (push confirmation) inconclusive — no remote configured.
Governance scenario 3 (HITL on real infra) untestable — Nginx not installed.
Both share the same root cause: agent delegates to permission system.

Also corrects stale skill list in docs/spec/overview.md (12 actual
deployed skills vs 16 names previously listed).

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-05-17 11:44:56 +00:00
parent b55eede1ef
commit 74f5e1840d
9 changed files with 85 additions and 13 deletions

View File

@@ -18,13 +18,15 @@ This repo is the global AI development configuration repository — the authorit
## Key documents
Read these at the start of every session in this repo:
@CONTEXT.md
Read these on demand:
- `CONTEXT.md` — domain language and principles; challenge any term that conflicts with it
- `docs/VISION.md` — purpose, goals, and long-term Management Application vision
- `docs/spec/overview.md` — current deployed state; what works today
- `docs/spec/architecture.md` — current directory structure, install pipeline, provider model
- `docs/ROADMAP.md` — chunk status table and open questions; read this to orient on where work stands
- `docs/adr/` — architectural decisions; read before answering design questions or proposing structural changes
- `docs/ai-constitution.md` — full governance evidence base; read when a governance decision needs justification
- `docs/HUMANS.md` — human practitioner checklist; applies when working with AI tools in this repo
- **Governance workstream** — `core/instructions/governance.md` (agent rules), loaded via `@import` in `providers/claude-code/CLAUDE.md`; `docs/research/governance_principles/CONTROLS.md` (Phase 2 enforcement spec, Chunk 6)