kyberforge: agent-audit provenance/sources chain validation #60

Closed
opened 2026-07-04 09:31:25 +00:00 by Claude · 0 comments
Collaborator

Context

Follow-on deferred from the agent-audit workstream (issue #11). Explicitly out of scope for the initial implementation.

Related: #11 (parent workstream) · ADR-0015 (docs/adr/0015-agent-author-dual-provider-scaffold.md)


Overview

agent-author produces agents/sources.md at plugin scope (Step 4). This file records which research sources informed which agent files — the provenance chain for agent authoring.

skill-audit has validate-provenance.sh that validates the equivalent references/sources.md for skills. agent-audit has no equivalent.

Why deferred: At plugin scope, agents/sources.md is optional (deleted by agent-author when no research sources are in context). The structure and format of agents/sources.md is not yet formally specified. A provenance check becomes worthwhile once the format is stabilised and there are real agents/sources.md files to validate against.

Acceptance criteria

  • validate-provenance.sh <agent-file> (or equivalent) validates agents/sources.md at plugin scope
  • Checks: sources.md exists when agent file has source_keys in context, no unfilled placeholders, contributing files listed exist on disk, research doc field present and non-empty
  • agent-audit skill body updated to run the provenance check and surface findings as a ### Provenance dimension
  • agent-author Step 4 updated to reference the expected agents/sources.md format
## Context Follow-on deferred from the `agent-audit` workstream (issue #11). Explicitly out of scope for the initial implementation. **Related:** #11 (parent workstream) · ADR-0015 (`docs/adr/0015-agent-author-dual-provider-scaffold.md`) --- ## Overview `agent-author` produces `agents/sources.md` at plugin scope (Step 4). This file records which research sources informed which agent files — the provenance chain for agent authoring. `skill-audit` has `validate-provenance.sh` that validates the equivalent `references/sources.md` for skills. `agent-audit` has no equivalent. **Why deferred:** At plugin scope, `agents/sources.md` is optional (deleted by `agent-author` when no research sources are in context). The structure and format of `agents/sources.md` is not yet formally specified. A provenance check becomes worthwhile once the format is stabilised and there are real `agents/sources.md` files to validate against. ## Acceptance criteria - [x] `validate-provenance.sh <agent-file>` (or equivalent) validates `agents/sources.md` at plugin scope - [x] Checks: sources.md exists when agent file has `source_keys` in context, no unfilled placeholders, contributing files listed exist on disk, research doc field present and non-empty - [x] `agent-audit` skill body updated to run the provenance check and surface findings as a `### Provenance` dimension - [x] `agent-author` Step 4 updated to reference the expected `agents/sources.md` format
Claude added this to the Kyberforge basics milestone 2026-07-04 09:31:25 +00:00
Claude added the Kind/Feature
Priority
Low
4
labels 2026-07-04 09:31:25 +00:00
Sign in to join this conversation.