research drift: installation.md omits apm runtime status and apm runtime remove, which exist in apm 0.28.0 #119

New Issue

Claude · 2026-08-30T16:50:54Z

Claude commented

2026-08-30 16:50:54 +00:00

Found during the #99 ADR-0020 retrofit, wave 4 (apm-install).

What happens

plugins/kyberforge/.apm/skills/apm-install/SKILL.md:50-51 documents apm runtime status and apm runtime remove <name> -y. Neither appears in the cited research doc, plugins/kyberforge/docs/research/docs/microsoft-apm/installation.md, which attributes both listing and default-pick to apm runtime list (:39).

An independent audit verified both subcommands against the installed apm 0.28.0 and found they exist. So the skill is right and the research doc is stale.

Why this is worth a ticket rather than a shrug

The failure mode is a future agent "correcting" working documentation to match a stale source. The provenance chain says the research doc is the authority for that skill's content; an audit that checks the skill against its cited source — which is exactly what skill-audit's provenance dimension asks for — finds a mismatch and has no way to tell which side is wrong. The obvious repair is to delete the two undocumented subcommands from the skill, which would remove accurate, working guidance.

This nearly happened in wave 4. It was avoided only because the auditor tested against the installed binary instead of trusting the doc, and the finding was then explicitly carried forward as "do not fix" into the repair brief.

Suggested fix

Refresh installation.md against apm 0.28.0's actual apm runtime --help. Worth checking the rest of that doc's command inventory at the same time rather than patching two lines — if runtime status and runtime remove drifted, other subcommands plausibly did too, and the doc is cited by more than one skill.

More generally this is the case #9 (the skill refresh workflow — re-research, diff, propagate, re-provenance) exists to handle. If that lands, this is one of its first inputs.

Files

plugins/kyberforge/docs/research/docs/microsoft-apm/installation.md:39 — the stale inventory
plugins/kyberforge/.apm/skills/apm-install/SKILL.md:50-51 — the correct-but-unprovenanced usage. Do not "fix" this side.

Found during #99 wave 4. See #9 (skill refresh workflow). Distinct from #118 (provenance that asserts a false contribution) — this is the opposite: accurate content whose source has fallen behind.

Found during the #99 ADR-0020 retrofit, wave 4 (`apm-install`). ## What happens `plugins/kyberforge/.apm/skills/apm-install/SKILL.md:50-51` documents `apm runtime status` and `apm runtime remove <name> -y`. Neither appears in the cited research doc, `plugins/kyberforge/docs/research/docs/microsoft-apm/installation.md`, which attributes both listing and default-pick to `apm runtime list` (`:39`). An independent audit verified both subcommands against the **installed apm 0.28.0** and found they exist. So the skill is right and the research doc is stale. ## Why this is worth a ticket rather than a shrug The failure mode is a future agent "correcting" working documentation to match a stale source. The provenance chain says the research doc is the authority for that skill's content; an audit that checks the skill against its cited source — which is exactly what `skill-audit`'s provenance dimension asks for — finds a mismatch and has no way to tell which side is wrong. The obvious repair is to delete the two undocumented subcommands from the skill, which would remove accurate, working guidance. This nearly happened in wave 4. It was avoided only because the auditor tested against the installed binary instead of trusting the doc, and the finding was then explicitly carried forward as "do not fix" into the repair brief. ## Suggested fix Refresh `installation.md` against apm 0.28.0's actual `apm runtime --help`. Worth checking the rest of that doc's command inventory at the same time rather than patching two lines — if `runtime status` and `runtime remove` drifted, other subcommands plausibly did too, and the doc is cited by more than one skill. More generally this is the case #9 (the skill refresh workflow — re-research, diff, propagate, re-provenance) exists to handle. If that lands, this is one of its first inputs. ## Files - `plugins/kyberforge/docs/research/docs/microsoft-apm/installation.md:39` — the stale inventory - `plugins/kyberforge/.apm/skills/apm-install/SKILL.md:50-51` — the correct-but-unprovenanced usage. **Do not "fix" this side.** ## Related Found during #99 wave 4. See #9 (skill refresh workflow). Distinct from #118 (provenance that asserts a false contribution) — this is the opposite: accurate content whose source has fallen behind.

Claude added the Kind/Bug

labels 2026-08-30 16:50:59 +00:00

Claude added this to the Skills & Agents milestone 2026-08-30 16:51:03 +00:00

Claude referenced this issue

2026-08-30 16:51:36 +00:00

refactor(skills): retrofit the 39 skills to the ADR-0020 context contract #99