agent-skills

OpenSource/agent-skills

0 Fork 0

mirror of https://github.com/addyosmani/agent-skills.git synced 2026-10-26 15:05:04 +00:00

Files

T

History

mavericksea-aiandClaude Opus 5 0c497ba10f fix(evals): canonicalize expectation text and recompute pass_rate

Two hardening changes to parseGrading:

- Once a result's id is validated, overwrite its text with the declared
  expectation at that index. The id is the binding, so a grader that
  paraphrases an expectation no longer leaks its own wording into the
  saved grading report.
- Stop rejecting a grading whose summary.pass_rate disagrees with the
  counters. pass_rate is derived, not an independent observation, so a
  rounded or mis-divided value is now recomputed from the validated
  results instead of discarding the run. The integer counters
  (passed/failed/total) remain exact-match checks.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

2026-09-16 01:19:15 +00:00

lib

fix(performance): document the missing guard step

2026-08-28 12:15:32 +08:00

run-evals-test.js

fix(evals): canonicalize expectation text and recompute pass_rate

2026-09-16 01:19:15 +00:00

run-evals.js

fix(evals): canonicalize expectation text and recompute pass_rate

2026-09-16 01:19:15 +00:00

validate-artifact-paths-test.js

ci: add validator guarding spec/plan/todo artifact paths