Files
agent-skills/.github/workflows/test-plugin-install.yml
T
ayobamiseun cda4542ade fix(skills): close description-vocabulary gaps, raise rank-1 floor to 95
Eleven positive trigger prompts ranked their skill #2-#3 because the
descriptions lacked vocabulary users actually say (follow-up to #351):

- debugging-and-error-recovery: regression vocabulary (worked yesterday,
  what broke)
- documentation-and-adrs: 'document an architecture decision', design
  reasoning ('documentation' and 'document' don't stem together)
- doubt-driven-development: cross-examining assumptions, stress-testing
  a plan for hidden failure modes, high-stakes changes
- git-workflow-and-versioning: splitting a messy working tree into
  atomic commits
- incremental-implementation: thin/verifiable slices, next task from a
  plan, feature flags
- shipping-and-launch: what needs to be in place before shipping
- spec-driven-development: PRD, objectives and scope
- test-driven-development: red-green-refactor
- using-agent-skills: deciding which workflow applies to the work
- source-driven-development: verify against the official docs
  ('docs'/'documentation' don't stem together)

Trigger rank-1 rate: 86% -> 100% (76/76), no new collision warnings.
CI floor raised from 80 to 95 per the ratchet policy; README baseline
updated and the stale #351 tracking sentence rephrased as guidance.
2026-09-07 21:46:11 +01:00

100 lines
2.6 KiB
YAML

name: Test Plugin Installation
on:
push:
pull_request:
workflow_dispatch:
jobs:
validate-skills:
name: Validate skill content
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v6
with:
fetch-depth: 0
- name: Set up Node.js
uses: actions/setup-node@v6
with:
node-version: '24'
- name: Validate all skills
run: node scripts/validate-skills.js
- name: Validate manifest versions
run: node scripts/validate-versions.js
- name: Test manifest version validator
run: node --test scripts/validate-versions-test.js
- name: Test skill eval runner
run: node --test scripts/run-evals-test.js
- name: Run skill evals (trigger + routing)
run: node scripts/run-evals.js --min-rank1 95
- name: Validate references/ links in skills
run: node scripts/validate-reference-links.js
- name: Test reference-link validator
run: node --test scripts/validate-reference-links-test.js
validate-commands:
name: Validate command parity and description sync
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v6
- name: Set up Node.js
uses: actions/setup-node@v6
with:
node-version: '24'
- name: Validate commands across all tool directories
run: node scripts/validate-commands.js
- name: Test command validator
run: node --test scripts/validate-commands-test.js
- name: Validate spec/plan/todo artifact paths
run: node scripts/validate-artifact-paths.js
- name: Test artifact-path validator
run: node --test scripts/validate-artifact-paths-test.js
validate:
name: Validate plugin structure
needs: [validate-skills, validate-commands]
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v6
- name: Install Claude Code
run: npm install -g @anthropic-ai/claude-code
- name: Validate marketplace and plugin manifests
run: claude plugin validate .
test-install:
name: Test plugin installation
runs-on: ubuntu-latest
needs: validate
steps:
- uses: actions/checkout@v6
- name: Install Claude Code
run: npm install -g @anthropic-ai/claude-code
- name: Configure git to use HTTPS
run: git config --global url."https://github.com/".insteadOf "git@github.com:"
- name: Add marketplace
run: claude plugin marketplace add ./
- name: List marketplaces
run: claude plugin marketplace list
- name: Install plugin
run: claude plugin install agent-skills@addy-agent-skills --scope user