mirror of
https://github.com/addyosmani/agent-skills.git
synced 2026-10-26 23:15:04 +00:00
RESULTS_DIR is only ever created and never cleared, and the output path is derived from skill name and eval id alone. When a run's grading is rejected (parseGrading returns null), the runner writes .grading.raw.txt but leaves any .grading.json from a previous successful run in place. A collector reading that directory gets the old score beside the raw output of the run that actually happened. Extract persistGradingOutcome so the write-and-cleanup is a testable unit, and unlink the stale .grading.json before writing the raw file.