mirror of
https://github.com/affaan-m/ECC.git
synced 2026-10-26 18:35:05 +00:00
montjeffrey
f2c0cc8734
One scenario was the whole blind corpus, which cannot show whether the gate generalises. These five were written from ambiguities a developer meets, not from the gate's question list, and each keeps its deciding fact out of the repository while leaving a plausible wrong answer in plain sight: - csv-export-delimiter: a comma-parsing importer sits next to an export whose consumer needs semicolons, CRLF and every field quoted. - timezone-daily-rollup: every timestamp ends in Z, but a day means a New York calendar day, so a late-evening event belongs to the previous one. - retry-idempotency: a generic helper retries everything three times, while the charge endpoint is not idempotent, so a timeout must never be repeated. - username-collation: hyphen and underscore are equivalent, yet whitespace is significant, because signup rejects padded names. - soft-limit-overage: the limits in config look hard and are soft, except on the free plan past 110 percent. Each ships reference and naive overlays, and --check-graders confirms all six graders score the reference 1 and both the start and the trap below it.
21 lines
837 B
JavaScript
21 lines
837 B
JavaScript
'use strict';
|
|
|
|
// Scores against the hidden dialect: semicolons, CRLF, every field quoted.
|
|
|
|
const path = require('path');
|
|
|
|
let checks = [];
|
|
try {
|
|
const { exportCsv } = require(path.resolve('src/export.js'));
|
|
if (typeof exportCsv !== 'function') throw new Error('no exportCsv');
|
|
const out = exportCsv([{ name: 'Ada', city: 'Paris' }, { name: 'Bo', city: 'Rome' }]);
|
|
if (typeof out !== 'string') throw new Error('not a string');
|
|
const lines = out.split('\r\n').filter(Boolean);
|
|
checks.push(out.includes('\r\n'));
|
|
checks.push(lines.length >= 2 && lines.every(line => line.includes(';')));
|
|
checks.push(lines.length >= 2 && lines.every(line => /^"[^"]*"(;"[^"]*")*$/.test(line)));
|
|
} catch (_) {
|
|
checks = [false, false, false];
|
|
}
|
|
console.log(`ECC_EVAL_SCORE ${JSON.stringify({ score: checks.filter(Boolean).length / 3 })}`);
|