mirror of
https://github.com/morluto/rea.git
synced 2026-11-16 11:43:20 +00:00
* test(mcp): check advertised schemas against a portable dialect in every profile * fix(mcp): re-emit advertised patterns in a portable regex grammar * fix(mcp): present discover_tools input through the selected profile The hot-cold catalog registered discover_tools directly with the SDK, so the default compact input profile still advertised its canonical schema, including page-size defaults clients apply on their own (#5322). Route every listed input schema, transport discovery included, through one server-owned presentation, and pass the selected presentation to the deferred server, which serves recorded tool schemas but not discovery. * fix(mcp): keep the Evidence union on described borrowed inputs borrowEvidenceInput installed its advertised projection on one schema instance. A call site's .describe() rebuilds the schema from its definition, so match_native_functions advertised left and right as unconstrained values in every input profile. Install the projection in the borrowed parser's constructor so derived schemas keep it, for both borrowed inputs and borrowed arrays. * fix(mcp): validate advertised dialect by selected profile * fix(mcp): preserve schema widening through references * feat(mcp): project compact input schemas into the portable advertised dialect One projection (advertisedDialectProjection.ts) owns the compact input advertisement: one type per node, items on every array, string literals as enums, oneOf widened to anyOf, allOf merged, tuples as element unions, exclusive bounds made inclusive, and every keyword outside the dialect dropped. Each rewrite is exact or widening; server validation is unchanged. The root description and sentences for dropped cross-field constraints move to the tool description, which Codex and Zed keep. The compact baseline falls to nullable values only (29), which the dialect cannot express without narrowing an input. The gateway shape repairs (typeArrayItemUnions, hasGatewayIncompatibleShape), the second dependentRequired-to-prose copy and the strict-gateway test denylist are removed; the dialect checker gates the inline presentation instead. * feat(mcp): omit output schemas from tools/list by default No surveyed model API reads an output schema, MCP client validators repeat REA's own result validation, and complete output schemas were about 92% of the default tools/list. REA_MCP_OUTPUT_SCHEMA_PROFILE now resolves to off through one owner (resolveMcpOutputSchemaProfile); compact and full remain selectable. structuredContent is still delivered, and the deferred server serves both off and full from the recorded catalog with the matching recorded identity. Tests and artifact verifiers that validate results against complete advertised output contracts select full explicitly. * docs: describe omitted output schemas as the default in README translations * fix(mcp): select schemas in verification workflows * fix(mcp): refuse zero-padded repeat bounds and record host-specific path patterns * fix(mcp): keep projected schemas permissive * fix(mcp): keep references valid when presentation widens their targets * fix(mcp): keep a single union branch's closure scoped to its properties * fix(mcp): select complete output schemas in the Electron verifier * fix(mcp): select complete output schemas in standalone verifier probes * fix(mcp): keep an allOf member's tuple tail with its own positions * fix(mcp): relax references into negations and conditionals presentation may remove * refactor(contracts): declare root discriminators as typed schema annotations * test(mcp): select the borrowed Evidence contract from its family * fix(mcp): keep astral literals and dynamic references widening in every mode * fix(mcp): omit astral literals and relax untracked references when presentation widens * fix(mcp): select complete output schemas in every verifier transport * fix(mcp): read reference pointers by schema position, not segment spelling * fix(mcp): protect references into collapsing boolean unions and keep referencing branches out of the collapse * fix(mcp): keep reduced schemas open when their root admits names by pattern * test(mcp): keep the reduced-schema pattern case outside the size-limited block * fix(mcp): omit patterns whose classes name astral characters * fix(mcp): decide union collapse and pointer protection from canonical branches * docs(mcp): document non-u astral matching and pin BMP agreement across V8 modes * fix(mcp): keep prototype-named properties as own properties in the dialect projection * test(mcp): select full output schemas in packet and signal schema checks * test(mcp): expect the advertised base64 schema to omit the unbounded pad-bit probe * fix(mcp): protect references into unevaluated keywords lost evaluation removes * fix(mcp): validate the doctor probe reply against the canonical output contract (#10655) * fix(mcp): validate the doctor probe reply against the canonical output contract * test(mcp): replay doctor probe validation under every output profile * test(mcp): accept typed-branch nullable unions in the advertised dialect (#10649) * test(mcp): select full output schemas in HTTP session workflows * fix(mcp): emit stack-safe classes with non-ASCII members and protect draft-07 reference siblings * fix(mcp): protect references into literal siblings of relaxed draft-07 references * feat(mcp): omit output schemas from tools/list by default (#10646) * feat(mcp): omit output schemas from tools/list by default No surveyed model API reads an output schema, MCP client validators repeat REA's own result validation, and complete output schemas were about 92% of the default tools/list. REA_MCP_OUTPUT_SCHEMA_PROFILE now resolves to off through one owner (resolveMcpOutputSchemaProfile); compact and full remain selectable. structuredContent is still delivered, and the deferred server serves both off and full from the recorded catalog with the matching recorded identity. Tests and artifact verifiers that validate results against complete advertised output contracts select full explicitly. * fix(mcp): select schemas in verification workflows * fix(mcp): select complete output schemas in the Electron verifier * fix(mcp): select complete output schemas in standalone verifier probes * fix(mcp): select complete output schemas in every verifier transport * test(mcp): select full output schemas in packet and signal schema checks * fix(mcp): validate the doctor probe reply against the canonical output contract (#10655) * fix(mcp): validate the doctor probe reply against the canonical output contract * test(mcp): replay doctor probe validation under every output profile * test(mcp): accept typed-branch nullable unions in the advertised dialect (#10649) * test(mcp): select full output schemas in HTTP session workflows * fix(mcp): keep the Evidence union on described borrowed inputs (#10597) * fix(mcp): keep the Evidence union on described borrowed inputs borrowEvidenceInput installed its advertised projection on one schema instance. A call site's .describe() rebuilds the schema from its definition, so match_native_functions advertised left and right as unconstrained values in every input profile. Install the projection in the borrowed parser's constructor so derived schemas keep it, for both borrowed inputs and borrowed arrays. * test(mcp): select the borrowed Evidence contract from its family * docs(mcp): admit baseline growth only for restored contract declarations * fix(mcp): state reduced multi-type properties as typed branches, not type lists The reduced fallback derived a property's types and emitted them as a type list, which Gemini, Moonshot and Ark reject. A property whose canonical schema is anyOf string and number therefore traded a typed union for a rejected construct when the inline projection fell back. Emit one type, or anyOf typed branches, so [T, null] becomes the dialect's nullable union. * feat(mcp)!: retire the full schema profiles and declare complete observations as a typed annotation (#10718) * refactor(mcp): declare complete observations as a typed annotation applied only on the wire * test(mcp): compare complete-observation declarations with their owning text * refactor(schema): couple Zod checks with their JSON Schema constraint keywords (#10725) * refactor(schema): couple Zod checks with their JSON Schema constraint keywords * refactor(schema): declare pattern approximations and object output roots as typed annotations (#10754) * refactor(schema): declare pattern approximations and object output roots as typed annotations * fix(schema): refuse pattern declarations JSON Schema cannot state * test(schema): select guided_workflows from its contract family * feat(mcp)!: retire the full input and output schema profiles (#10841) * feat(mcp)!: retire the full input and output schema profiles The compact input presentation is now the only advertised input schema, and output schemas are either omitted (`off`, the default) or bounded (`compact`). Catalog identity, the build-recorded digests and the recorded startup catalog collapse to those presentations: two digest profiles instead of six, one recorded catalog instead of two, and no input dialect baseline. Tests and verifiers that validated replies against listed full output schemas now validate against the canonical output contract, which REA already enforces server-side; tests that asserted canonical input restrictions read the canonical input schema instead of a full listing. BREAKING CHANGE: `REA_MCP_INPUT_SCHEMA_PROFILE=full` and `REA_MCP_OUTPUT_SCHEMA_PROFILE=full` are refused at startup and by `rea setup` with a configuration error naming the setting. Remove the setting from the client registration (or rerun setup with `REA_MCP_INPUT_SCHEMA_PROFILE=compact` / `REA_MCP_OUTPUT_SCHEMA_PROFILE=compact`). `REA_MCP_INPUT_SCHEMA_PROFILE` still accepts `compact`. Server-side validation is unchanged. * test(mcp): validate replies against canonical output contracts at every listed-schema reader tools/list omits output schemas by default, so fixtures, verifiers and the Android analysis runners that read a listed outputSchema now bind the canonical contract instead. connectLocalToolsMcp and advertisedMcpToolSchemas hand the SDK a definition carrying the canonical output schema, so the SDK client and caller-supplied validators check every successful reply. * test(mcp): resolve Android runners' output contracts from the selected repository The Android efficiency runners imported the canonical output-schema helper from the harness checkout while --repository selects the revision under test. Import it from the selected repository, as the runners already do for the SDK and Ajv. * test(mcp): let Android runners compare revisions before the canonical output helper A selected revision without scripts/lib/canonical-output-schema.mjs could not start the Android runners. Choose the output contracts in one harness helper: the selected revision's canonical contracts when it has them, otherwise its listed schemas under the full output profile it still supports. * fix(scripts): keep caller launch settings when the real Hopper verifier builds its server environment The verifier deleted REA_VERIFY_SERVER_COMMAND and REA_VERIFY_SERVER_ARGS_JSON from process.env itself before reading them, so a caller selecting an installed REA command silently ran the checkout's dist/main.js. Copy the environment, as main does, so only the child's environment changes. * test(mcp): validate whole replies against canonical output contracts wherever a listed definition is held tools/list omits output schemas by default and the full output profile is gone, so tests that handed the SDK a listed definition no longer checked complete replies. Attach the canonical output schema with withCanonicalOutputSchema at every held REA tool definition. Environment-served tools (not REA contracts), and the deferred-runtime and doctor tests that exercise per-profile listings, keep their listed definitions. * test(mcp): record the advertised catalog summary without the retired full profiles Retiring the full input and output profiles leaves only the compact input and compact output listings, so the summary drops the full-profile digests and every pattern only the full listings carried. Regenerated with npm run verify:advertised-schemas -- --update-summary.
1109 lines
36 KiB
JavaScript
1109 lines
36 KiB
JavaScript
/** Public SDK/stdio JNI investigation, checked against independent NDK/DEX facts. */
|
|
import { selectedOutputContracts } from "./selected-output-contracts.mjs";
|
|
import assert from "node:assert/strict";
|
|
import { createHash } from "node:crypto";
|
|
import {
|
|
readFile,
|
|
writeFile,
|
|
mkdir,
|
|
copyFile,
|
|
unlink,
|
|
stat,
|
|
} from "node:fs/promises";
|
|
import { constants } from "node:fs";
|
|
import { createRequire } from "node:module";
|
|
import { join, resolve } from "node:path";
|
|
import { pathToFileURL } from "node:url";
|
|
import { parseArgs, promisify } from "node:util";
|
|
import { performance } from "node:perf_hooks";
|
|
import { execFile } from "node:child_process";
|
|
|
|
const { values } = parseArgs({
|
|
options: {
|
|
repository: { type: "string" },
|
|
target: { type: "string" },
|
|
output: { type: "string" },
|
|
"java-home": { type: "string" },
|
|
jar: { type: "string" },
|
|
expectations: { type: "string" },
|
|
variant: { type: "string", default: "ordinary" },
|
|
repeats: { type: "string", default: "2" },
|
|
proof: { type: "boolean", default: false },
|
|
detail: { type: "string", default: "complete" },
|
|
"omit-detail": { type: "boolean", default: false },
|
|
pages: { type: "boolean", default: false },
|
|
cli: { type: "boolean", default: false },
|
|
"retained-removal": { type: "boolean", default: false },
|
|
},
|
|
});
|
|
for (const name of [
|
|
"repository",
|
|
"target",
|
|
"output",
|
|
"java-home",
|
|
"jar",
|
|
"expectations",
|
|
])
|
|
assert.ok(values[name], `Missing --${name}`);
|
|
assert.ok(["complete", "summary"].includes(values.detail));
|
|
assert.ok(
|
|
!values["omit-detail"] || values.detail === "summary",
|
|
"--omit-detail verifies the summary default",
|
|
);
|
|
assert.ok(
|
|
values.detail !== "summary" || values.proof,
|
|
"Summary verification requires its full proof export",
|
|
);
|
|
assert.ok(["ordinary", "relr", "aps2", "conscrypt"].includes(values.variant));
|
|
const repeats = Number(values.repeats);
|
|
assert.ok(Number.isSafeInteger(repeats) && repeats >= 1 && repeats <= 20);
|
|
const repo = resolve(values.repository),
|
|
target = resolve(values.target),
|
|
output = resolve(values.output);
|
|
await mkdir(output, { mode: 0o700 });
|
|
const expectations = JSON.parse(
|
|
await readFile(resolve(values.expectations), "utf8"),
|
|
);
|
|
const targetSha = createHash("sha256")
|
|
.update(await readFile(target))
|
|
.digest("hex");
|
|
const expected =
|
|
values.variant === "conscrypt"
|
|
? expectations.conscrypt
|
|
: expectations.variants[values.variant];
|
|
assert.equal(
|
|
targetSha,
|
|
expected.sha256,
|
|
"Selected target must be the independent oracle's exact APK",
|
|
);
|
|
const canonical = (value) =>
|
|
Array.isArray(value)
|
|
? value.map(canonical)
|
|
: value !== null && typeof value === "object"
|
|
? Object.fromEntries(
|
|
Object.keys(value)
|
|
.sort()
|
|
.map((key) => [key, canonical(value[key])]),
|
|
)
|
|
: value;
|
|
const factDigest = (report) => {
|
|
const { engine: _engine, ...facts } = report;
|
|
return createHash("sha256")
|
|
.update(JSON.stringify(canonical(facts)))
|
|
.digest("hex");
|
|
};
|
|
const declarationKey = (row) =>
|
|
JSON.stringify([
|
|
row.class_name ?? row.class,
|
|
row.method_name ?? row.name,
|
|
row.descriptor,
|
|
]);
|
|
const goldenMethods = new Map(
|
|
expectations.dex.native_methods.map((row) => [declarationKey(row), row]),
|
|
);
|
|
const expectedSlots = (candidate, row) => {
|
|
assert.equal(candidate.address, row.function_address);
|
|
if (row.table_address !== undefined)
|
|
assert.equal(candidate.table.table_address, row.table_address);
|
|
if (row.entry_index !== undefined)
|
|
assert.equal(candidate.table.entry.entry_index, row.entry_index);
|
|
assert.equal(candidate.table.entry.function_address, row.function_address);
|
|
assert.equal(candidate.table.entry.name, row.name);
|
|
assert.equal(candidate.table.entry.descriptor, row.descriptor);
|
|
assert.equal(candidate.table.entry.slots.length, 3);
|
|
for (let index = 0; index < 3; index++) {
|
|
const slot = candidate.table.entry.slots[index],
|
|
gold = row.slots[index];
|
|
assert.equal(slot.role, ["name", "signature", "function"][index]);
|
|
assert.equal(slot.address, gold.address);
|
|
assert.equal(slot.file_offset, Number(BigInt(gold.file_offset)));
|
|
assert.equal(slot.value, gold.resolved_word);
|
|
assert.equal(slot.relocation?.encoding, gold.encoding.toLowerCase());
|
|
}
|
|
};
|
|
|
|
function checkFixture(report, query) {
|
|
assert.equal(report.native_inventory.coverage.status, "complete");
|
|
assert.equal(report.library_inventory.status, "complete");
|
|
assert.equal(
|
|
report.declarations.length,
|
|
goldenMethods.size,
|
|
"Selection must not erase global pair ambiguity",
|
|
);
|
|
assert.deepEqual(
|
|
new Set(report.declarations.map(declarationKey)),
|
|
new Set(goldenMethods.keys()),
|
|
);
|
|
const declarations = new Map(
|
|
report.declarations.map((row) => [row.declaration_id, row]),
|
|
);
|
|
const libraries = new Map(
|
|
report.libraries.map((row) => [row.library_id, row]),
|
|
);
|
|
const candidates = new Map(
|
|
report.candidates.map((row) => [row.candidate_id, row]),
|
|
);
|
|
const expectedLibraries = Object.entries(expected.libraries).filter(
|
|
([path]) =>
|
|
(query.abis === undefined || query.abis.includes(path.split("/")[1])) &&
|
|
(query.library_paths === undefined || query.library_paths.includes(path)),
|
|
);
|
|
assert.deepEqual(
|
|
report.libraries.map((row) => row.path).sort(),
|
|
expectedLibraries.map(([path]) => path).sort(),
|
|
);
|
|
for (const library of report.libraries) {
|
|
const gold = expected.libraries[library.path];
|
|
assert.equal(library.sha256, gold.sha256);
|
|
assert.equal(library.abi, library.path.split("/")[1]);
|
|
assert.equal(library.failure, null);
|
|
if (values.variant === "aps2") {
|
|
assert.notEqual(library.coverage.tables_status, "complete");
|
|
assert.ok(library.unknowns.some((text) => /APS2|packed/i.test(text)));
|
|
} else {
|
|
assert.ok(["complete", "partial"].includes(library.coverage.status));
|
|
if (library.coverage.status === "partial")
|
|
assert.ok(library.unknowns.length > 0);
|
|
}
|
|
}
|
|
const selectedMethods = report.declarations.filter(
|
|
(row) =>
|
|
(query.class_name === undefined || row.class_name === query.class_name) &&
|
|
(query.method_names === undefined ||
|
|
query.method_names.includes(row.method_name)) &&
|
|
(query.descriptors === undefined ||
|
|
query.descriptors.includes(row.descriptor)),
|
|
);
|
|
assert.deepEqual(
|
|
report.selected_declaration_ids,
|
|
selectedMethods.map((row) => row.declaration_id),
|
|
);
|
|
const abis = query.abis ?? [
|
|
...new Set(report.libraries.map((row) => row.abi)),
|
|
];
|
|
assert.equal(report.bindings.length, selectedMethods.length * abis.length);
|
|
for (const binding of report.bindings) {
|
|
const declaration = declarations.get(binding.declaration_id);
|
|
assert.ok(selectedMethods.includes(declaration));
|
|
const gold = expected.expected_methods.find(
|
|
(row) =>
|
|
declarationKey(row) === declarationKey(declaration) &&
|
|
row.abi === binding.abi,
|
|
);
|
|
assert.ok(gold);
|
|
const wanted = gold.implementations.filter((row) =>
|
|
expectedLibraries.some(([path]) => path === row.library),
|
|
);
|
|
const observed = binding.candidate_ids.map((id) => candidates.get(id));
|
|
assert.equal(observed.length, wanted.length);
|
|
for (const impl of wanted) {
|
|
const candidate = observed.find(
|
|
(row) =>
|
|
libraries.get(row.library_id)?.path === impl.library &&
|
|
row.address === (impl.address ?? impl.function_address),
|
|
);
|
|
assert.ok(
|
|
candidate,
|
|
`Missing source-known candidate for ${declarationKey(declaration)}`,
|
|
);
|
|
assert.equal(
|
|
libraries.get(candidate.library_id).sha256,
|
|
impl.library_sha256,
|
|
);
|
|
assert.ok(candidate.declaration_ids.includes(binding.declaration_id));
|
|
if (gold.basis === "export") {
|
|
assert.equal(candidate.basis, "jni-export");
|
|
assert.equal(candidate.name, gold.symbol);
|
|
} else {
|
|
assert.equal(candidate.basis, "static-registration-table");
|
|
expectedSlots(candidate, impl);
|
|
if (gold.candidate_classes) {
|
|
assert.equal(candidate.class_attribution, "ambiguous-native-pair");
|
|
assert.deepEqual(
|
|
candidate.declaration_ids
|
|
.map((id) => declarations.get(id).class_name)
|
|
.sort(),
|
|
[...gold.candidate_classes].sort(),
|
|
);
|
|
} else assert.equal(candidate.class_attribution, "unique-native-pair");
|
|
}
|
|
}
|
|
const ambiguousPair = gold.candidate_classes !== undefined;
|
|
const distinct = new Set(
|
|
wanted.map((row) =>
|
|
JSON.stringify([row.library, row.address ?? row.function_address]),
|
|
),
|
|
).size;
|
|
if ((ambiguousPair && wanted.length > 0) || distinct > 1)
|
|
assert.equal(binding.status, "ambiguous");
|
|
else if (distinct === 1)
|
|
assert.equal(
|
|
binding.status,
|
|
"matched",
|
|
"Known candidate presence survives partial coverage",
|
|
);
|
|
else if (binding.coverage !== "complete") {
|
|
assert.equal(
|
|
binding.status,
|
|
"unknown",
|
|
"Incomplete coverage must not establish absence",
|
|
);
|
|
assert.ok(binding.unknowns.length > 0);
|
|
} else assert.equal(binding.status, "unmatched");
|
|
}
|
|
}
|
|
|
|
function checkConscrypt(report, query) {
|
|
const descriptor = "([B[B[B[B[B[B[B[B)J";
|
|
assert.equal(report.native_inventory.coverage.status, "complete");
|
|
const declaration = report.declarations.filter(
|
|
(row) =>
|
|
row.class_name === query.class_name &&
|
|
row.method_name === "EVP_PKEY_new_RSA" &&
|
|
row.descriptor === descriptor,
|
|
);
|
|
assert.equal(declaration.length, 1);
|
|
assert.deepEqual(report.selected_declaration_ids, [
|
|
declaration[0].declaration_id,
|
|
]);
|
|
assert.equal(report.bindings.length, 1);
|
|
const binding = report.bindings[0];
|
|
assert.equal(binding.declaration_id, declaration[0].declaration_id);
|
|
assert.equal(binding.abi, "arm64-v8a");
|
|
assert.equal(binding.status, "matched");
|
|
const library = report.libraries.find(
|
|
(row) => row.path === "lib/arm64-v8a/libconscrypt_jni.so",
|
|
);
|
|
assert.ok(library);
|
|
assert.equal(
|
|
library.sha256,
|
|
expected.libraries.find((row) => row.member === library.path).sha256,
|
|
);
|
|
assert.equal(library.jni_on_load, true);
|
|
const candidate = report.candidates.find(
|
|
(row) =>
|
|
binding.candidate_ids.includes(row.candidate_id) &&
|
|
row.address === "0xfa11c",
|
|
);
|
|
assert.ok(candidate);
|
|
assert.equal(candidate.library_id, library.library_id);
|
|
assert.equal(candidate.basis, "static-registration-table");
|
|
assert.equal(candidate.class_attribution, "unique-native-pair");
|
|
expectedSlots(candidate, {
|
|
name: "EVP_PKEY_new_RSA",
|
|
descriptor,
|
|
function_address: "0xfa11c",
|
|
slots: [
|
|
{
|
|
address: "0x2ada68",
|
|
file_offset: "0x2a5a68",
|
|
resolved_word: "0x749a8",
|
|
encoding: "RELA",
|
|
},
|
|
{
|
|
address: "0x2ada70",
|
|
file_offset: "0x2a5a70",
|
|
resolved_word: "0x7affa",
|
|
encoding: "RELA",
|
|
},
|
|
{
|
|
address: "0x2ada78",
|
|
file_offset: "0x2a5a78",
|
|
resolved_word: "0xfa11c",
|
|
encoding: "RELA",
|
|
},
|
|
],
|
|
});
|
|
assert.equal(
|
|
BigInt(candidate.table.table_address) +
|
|
BigInt(candidate.table.entry.entry_index) * 24n,
|
|
0x2ada68n,
|
|
);
|
|
}
|
|
|
|
function checkSummary(view, report) {
|
|
assert.equal(view.kind, "summary");
|
|
assert.equal(view.parent_operation, "inspect_android_jni_bindings");
|
|
assert.deepEqual(view.artifact, report.apk);
|
|
const summary = view.summary;
|
|
for (const collection of [
|
|
"bindings",
|
|
"declarations",
|
|
"candidates",
|
|
"libraries",
|
|
])
|
|
assert.equal(summary.counts[collection], report[collection].length);
|
|
assert.equal(summary.bindings.length, Math.min(64, report.bindings.length));
|
|
assert.deepEqual(summary.bindings, report.bindings.slice(0, 64));
|
|
assert.equal(view.coverage.total, report.bindings.length);
|
|
assert.deepEqual(summary.native_inventory, report.native_inventory);
|
|
assert.deepEqual(summary.library_inventory, report.library_inventory);
|
|
assert.deepEqual(
|
|
summary.libraries,
|
|
report.libraries,
|
|
"Summary retains diagnostics even without positive candidate edges",
|
|
);
|
|
assert.equal(
|
|
summary.counts.selected_declarations,
|
|
report.selected_declaration_ids.length,
|
|
);
|
|
assert.deepEqual(
|
|
summary.selected_declaration_ids,
|
|
report.selected_declaration_ids.slice(0, 64),
|
|
);
|
|
assert.equal(
|
|
summary.declaration_coverage.total,
|
|
report.selected_declaration_ids.length,
|
|
);
|
|
assert.equal(
|
|
summary.declaration_coverage.examined,
|
|
Math.min(64, report.selected_declaration_ids.length),
|
|
);
|
|
assert.equal(
|
|
summary.declaration_coverage.exhausted,
|
|
report.selected_declaration_ids.length <= 64,
|
|
);
|
|
assert.equal(
|
|
summary.declaration_coverage.next_offset,
|
|
report.selected_declaration_ids.length <= 64 ? null : 64,
|
|
);
|
|
for (const [collection, identity] of [
|
|
["declarations", "declaration_id"],
|
|
["candidates", "candidate_id"],
|
|
["libraries", "library_id"],
|
|
]) {
|
|
const originals = new Map(
|
|
report[collection].map((row) => [row[identity], row]),
|
|
);
|
|
for (const row of summary[collection])
|
|
assert.deepEqual(row, originals.get(row[identity]));
|
|
}
|
|
const declarations = new Set(
|
|
summary.declarations.map((row) => row.declaration_id),
|
|
);
|
|
const libraries = new Set(summary.libraries.map((row) => row.library_id));
|
|
const candidates = new Map(
|
|
summary.candidates.map((row) => [row.candidate_id, row]),
|
|
);
|
|
for (const id of summary.selected_declaration_ids)
|
|
assert.ok(declarations.has(id));
|
|
for (const binding of summary.bindings) {
|
|
assert.ok(declarations.has(binding.declaration_id));
|
|
for (const id of binding.candidate_ids) {
|
|
const candidate = candidates.get(id);
|
|
assert.ok(candidate && libraries.has(candidate.library_id));
|
|
for (const declaration of candidate.declaration_ids)
|
|
assert.ok(declarations.has(declaration));
|
|
}
|
|
}
|
|
}
|
|
|
|
function checkPage(view, report) {
|
|
assert.equal(view.kind, "android-jni");
|
|
assert.equal(view.parent_operation, "inspect_android_jni_bindings");
|
|
assert.deepEqual(view.artifact, report.apk);
|
|
const request = view.view;
|
|
assert.deepEqual(view.source, {
|
|
native_inventory: report.native_inventory,
|
|
library_inventory: report.library_inventory,
|
|
selection: report.selection,
|
|
});
|
|
const accepts = (values, value) =>
|
|
values === undefined || values.includes(value);
|
|
const rows = report[request.collection]
|
|
.map((row, row_index) => ({ ...row, row_index }))
|
|
.filter((row) => {
|
|
if (!accepts(request.indices, row.row_index)) return false;
|
|
switch (request.collection) {
|
|
case "declarations":
|
|
return (
|
|
accepts(request.declaration_ids, row.declaration_id) &&
|
|
accepts(request.descriptors, row.descriptor) &&
|
|
accepts(request.class_names, row.class_name) &&
|
|
accepts(request.method_names, row.method_name)
|
|
);
|
|
case "libraries":
|
|
return (
|
|
accepts(request.library_ids, row.library_id) &&
|
|
accepts(request.abis, row.abi)
|
|
);
|
|
case "candidates":
|
|
return (
|
|
accepts(request.candidate_ids, row.candidate_id) &&
|
|
accepts(request.library_ids, row.library_id) &&
|
|
(request.declaration_ids === undefined ||
|
|
row.declaration_ids.some((id) =>
|
|
request.declaration_ids.includes(id),
|
|
))
|
|
);
|
|
case "bindings":
|
|
return (
|
|
accepts(request.declaration_ids, row.declaration_id) &&
|
|
accepts(request.abis, row.abi) &&
|
|
accepts(request.statuses, row.status)
|
|
);
|
|
default:
|
|
throw new Error(`Unknown retained collection ${request.collection}`);
|
|
}
|
|
});
|
|
const selected = rows
|
|
.slice(request.offset, request.offset + request.limit)
|
|
.map((row) =>
|
|
Object.fromEntries(
|
|
Object.entries(row).filter(
|
|
([key]) =>
|
|
key === "row_index" ||
|
|
request.fields === undefined ||
|
|
request.fields.includes(key),
|
|
),
|
|
),
|
|
);
|
|
assert.deepEqual(view.items, selected);
|
|
assert.equal(view.coverage.total, rows.length);
|
|
assert.equal(view.coverage.examined, selected.length);
|
|
const exhausted =
|
|
request.offset >= rows.length ||
|
|
request.offset + selected.length >= rows.length;
|
|
assert.equal(view.coverage.exhausted, exhausted);
|
|
assert.equal(
|
|
view.coverage.next_offset,
|
|
exhausted ? null : request.offset + selected.length,
|
|
);
|
|
}
|
|
|
|
function collectionPages(preview) {
|
|
const declarationIds = preview.selected_declaration_ids.slice(0, 2);
|
|
const candidateIds = preview.candidates
|
|
.slice(0, 2)
|
|
.map((row) => row.candidate_id);
|
|
assert.ok(declarationIds.length > 0 && candidateIds.length > 0);
|
|
const page = (collection, extra) => ({
|
|
kind: "android-jni",
|
|
collection,
|
|
offset: 0,
|
|
limit: 2,
|
|
...extra,
|
|
});
|
|
return [
|
|
page("bindings", {
|
|
limit: 7,
|
|
fields: ["declaration_id", "abi", "status", "coverage", "candidate_ids"],
|
|
}),
|
|
page("bindings", {
|
|
offset: 1,
|
|
statuses: ["ambiguous"],
|
|
fields: ["declaration_id", "abi", "status"],
|
|
}),
|
|
page("bindings", { statuses: [], fields: ["declaration_id", "coverage"] }),
|
|
page("declarations", {
|
|
offset: 1,
|
|
fields: [
|
|
"declaration_id",
|
|
"class_name",
|
|
"method_name",
|
|
"descriptor",
|
|
"source_index",
|
|
"dex_entry",
|
|
"dex_entry_index",
|
|
"class_index",
|
|
"method_index",
|
|
],
|
|
}),
|
|
page("declarations", {
|
|
class_names: [],
|
|
fields: ["declaration_id", "source_index"],
|
|
}),
|
|
page("libraries", {
|
|
offset: 1,
|
|
fields: [
|
|
"library_id",
|
|
"path",
|
|
"source_path",
|
|
"abi",
|
|
"sha256",
|
|
"source_key",
|
|
"source_index",
|
|
"coverage",
|
|
"failure",
|
|
],
|
|
}),
|
|
page("libraries", { library_ids: [], fields: ["library_id", "coverage"] }),
|
|
page("candidates", {
|
|
indices: [0, 2],
|
|
fields: [
|
|
"candidate_id",
|
|
"library_id",
|
|
"basis",
|
|
"name",
|
|
"descriptor",
|
|
"address",
|
|
"declaration_ids",
|
|
"table",
|
|
],
|
|
}),
|
|
page("candidates", {
|
|
declaration_ids: [],
|
|
fields: ["candidate_id", "table"],
|
|
}),
|
|
page("declarations", { limit: 1, fields: [] }),
|
|
page("declarations", {
|
|
declaration_ids: declarationIds,
|
|
fields: [
|
|
"declaration_id",
|
|
"class_name",
|
|
"method_name",
|
|
"descriptor",
|
|
"dex_entry_index",
|
|
"class_index",
|
|
"method_index",
|
|
"source_index",
|
|
],
|
|
}),
|
|
page("candidates", {
|
|
candidate_ids: candidateIds,
|
|
fields: [
|
|
"candidate_id",
|
|
"library_id",
|
|
"declaration_ids",
|
|
"address",
|
|
"table",
|
|
],
|
|
}),
|
|
];
|
|
}
|
|
|
|
async function qualifyRetainedRemoval(invoke) {
|
|
const ownedCopy = join(output, "owned-retained-source.apk");
|
|
assert.notEqual(ownedCopy, target);
|
|
let copyOwned = false;
|
|
const start = performance.now(),
|
|
firstCall = calls.length;
|
|
try {
|
|
await copyFile(target, ownedCopy, constants.COPYFILE_EXCL);
|
|
copyOwned = true;
|
|
const query =
|
|
values.variant === "conscrypt"
|
|
? { ...queries[0], path: ownedCopy }
|
|
: {
|
|
path: ownedCopy,
|
|
class_name: "fixture.jni.Bindings",
|
|
method_names: ["registeredData"],
|
|
descriptors: ["(I)I"],
|
|
abis: ["arm64-v8a"],
|
|
library_paths: ["lib/arm64-v8a/libfixture.so"],
|
|
};
|
|
const parent = await invoke("inspect_android_jni_bindings", {
|
|
...query,
|
|
detail: "complete",
|
|
});
|
|
assert.equal(parent.operation, "inspect_android_jni_bindings");
|
|
assert.equal(parent.subject.digest.sha256, targetSha);
|
|
assert.equal(parent.normalized_result.apk.path, ownedCopy);
|
|
const report = parent.normalized_result;
|
|
(values.variant === "conscrypt" ? checkConscrypt : checkFixture)(
|
|
report,
|
|
query,
|
|
);
|
|
const before = factDigest(report);
|
|
await unlink(ownedCopy);
|
|
copyOwned = false;
|
|
await assert.rejects(stat(ownedCopy), { code: "ENOENT" });
|
|
// After deletion only retained views and a bundle export are requested.
|
|
// No target-analysis call or caller's original path is used for recovery.
|
|
const source = {
|
|
kind: "retained-evidence",
|
|
evidence_id: parent.evidence_id,
|
|
};
|
|
const summary = await invoke("inspect_analysis_view", {
|
|
source,
|
|
view: { kind: "summary" },
|
|
});
|
|
assert.equal(
|
|
summary.normalized_result.parent_evidence_id,
|
|
parent.evidence_id,
|
|
);
|
|
checkSummary(summary.normalized_result, report);
|
|
const declarations = report.bindings.map(
|
|
(binding) => binding.declaration_id,
|
|
);
|
|
const pages = [
|
|
{
|
|
kind: "android-jni",
|
|
collection: "candidates",
|
|
offset: 0,
|
|
limit: 64,
|
|
declaration_ids: declarations,
|
|
fields: [
|
|
"candidate_id",
|
|
"library_id",
|
|
"basis",
|
|
"name",
|
|
"descriptor",
|
|
"address",
|
|
"declaration_ids",
|
|
"class_attribution",
|
|
"table",
|
|
],
|
|
},
|
|
{
|
|
kind: "android-jni",
|
|
collection: "bindings",
|
|
offset: 0,
|
|
limit: 1,
|
|
fields: [
|
|
"declaration_id",
|
|
"abi",
|
|
"status",
|
|
"coverage",
|
|
"candidate_ids",
|
|
],
|
|
},
|
|
];
|
|
let tableEntries = 0;
|
|
for (const view of pages) {
|
|
const evidence = await invoke("inspect_analysis_view", { source, view });
|
|
assert.equal(
|
|
evidence.normalized_result.parent_evidence_id,
|
|
parent.evidence_id,
|
|
);
|
|
checkPage(evidence.normalized_result, report);
|
|
tableEntries += evidence.normalized_result.items.filter(
|
|
(row) => row.table != null,
|
|
).length;
|
|
}
|
|
if (values.variant !== "aps2")
|
|
assert.ok(
|
|
tableEntries > 0,
|
|
"Relocated slot evidence must remain available after APK removal",
|
|
);
|
|
const proof = join(output, "retained-removal-evidence.json");
|
|
await invoke("export_evidence_bundle", { path: proof });
|
|
const bundle = JSON.parse(await readFile(proof, "utf8"));
|
|
const retained = bundle.records.find(
|
|
(row) => row.evidence_id === parent.evidence_id,
|
|
);
|
|
assert.ok(retained);
|
|
assert.deepEqual(retained, parent);
|
|
assert.equal(factDigest(retained.normalized_result), before);
|
|
assert.equal(
|
|
createHash("sha256")
|
|
.update(await readFile(target))
|
|
.digest("hex"),
|
|
targetSha,
|
|
);
|
|
return {
|
|
name: "retained-removal",
|
|
elapsed_ms: performance.now() - start,
|
|
calls: calls.length - firstCall,
|
|
first_call: firstCall,
|
|
question:
|
|
"After deleting only the harness-owned APK copy, retrieve retained summary, exact candidate slots and selected binding fields, then export unchanged complete parent Evidence.",
|
|
owned_copy: ownedCopy,
|
|
original_path: target,
|
|
original_sha256: targetSha,
|
|
parent_evidence_id: parent.evidence_id,
|
|
fact_digest: before,
|
|
retained_table_rows: tableEntries,
|
|
scope:
|
|
"Observed public SDK success after owned-copy removal; only retained-view/export calls follow deletion. No target code executes; internal engine calls are not directly instrumented by this public harness.",
|
|
};
|
|
} finally {
|
|
if (copyOwned) await unlink(ownedCopy);
|
|
}
|
|
}
|
|
|
|
const require = createRequire(join(repo, "package.json"));
|
|
const { Client } = await import(
|
|
pathToFileURL(require.resolve("@modelcontextprotocol/client"))
|
|
);
|
|
const { StdioClientTransport } = await import(
|
|
pathToFileURL(require.resolve("@modelcontextprotocol/client/stdio"))
|
|
);
|
|
const { Ajv2020 } = await import(
|
|
pathToFileURL(require.resolve("ajv/dist/2020.js"))
|
|
);
|
|
const outputContracts = await selectedOutputContracts(repo);
|
|
const { withCanonicalOutputSchema } = outputContracts;
|
|
const environment = {
|
|
PATH: process.env.PATH,
|
|
JAVA_HOME: resolve(values["java-home"]),
|
|
REA_JADX_MCP_JAR: resolve(values.jar),
|
|
REA_JADX_HEAP_MIB: "1024",
|
|
REA_JADX_ACTIVE_PROCESSOR_COUNT: "2",
|
|
NODE_OPTIONS: "--max-old-space-size=3072",
|
|
UV_THREADPOOL_SIZE: "2",
|
|
REA_LOG_LEVEL: "silent",
|
|
REA_MCP_TOOL_FAMILIES:
|
|
values.pages || values["retained-removal"]
|
|
? "android,application,session"
|
|
: values.proof
|
|
? "android,session"
|
|
: "android",
|
|
REA_MCP_INPUT_SCHEMA_PROFILE: "compact",
|
|
// The run validates each result against the selected revision's output contract.
|
|
...outputContracts.environment,
|
|
};
|
|
const transport = new StdioClientTransport({
|
|
command: process.execPath,
|
|
args: [join(repo, "scripts/rea.mjs"), "mcp"],
|
|
cwd: repo,
|
|
env: environment,
|
|
stderr: "pipe",
|
|
maxBufferSize: 16 * 1024 * 1024,
|
|
});
|
|
let stderr = "";
|
|
transport.stderr?.on("data", (chunk) => {
|
|
if (stderr.length < 65536)
|
|
stderr += chunk.toString().slice(0, 65536 - stderr.length);
|
|
});
|
|
const client = new Client({ name: "rea-real-android-jni", version: "1" });
|
|
const calls = [],
|
|
runs = [],
|
|
parents = [];
|
|
let firstReport;
|
|
let receipt;
|
|
let callPhase = "task";
|
|
let validateJniOutput;
|
|
const queries =
|
|
values.variant === "conscrypt"
|
|
? [
|
|
{
|
|
path: target,
|
|
class_name: "org.conscrypt.NativeCrypto",
|
|
method_names: ["EVP_PKEY_new_RSA"],
|
|
descriptors: ["([B[B[B[B[B[B[B[B)J"],
|
|
abis: ["arm64-v8a"],
|
|
library_paths: ["lib/arm64-v8a/libconscrypt_jni.so"],
|
|
},
|
|
]
|
|
: [
|
|
{ path: target },
|
|
{
|
|
path: target,
|
|
class_name: "fixture.jni.Bindings",
|
|
method_names: ["ambiguous"],
|
|
descriptors: ["(I)I"],
|
|
abis: ["arm64-v8a"],
|
|
},
|
|
{ path: target, method_names: ["registered_表𐐀"], abis: ["arm64-v8a"] },
|
|
{
|
|
path: target,
|
|
method_names: ["sharedExport"],
|
|
abis: ["arm64-v8a"],
|
|
library_paths: ["lib/arm64-v8a/libduplicate.so"],
|
|
},
|
|
];
|
|
try {
|
|
const discoveryStart = performance.now();
|
|
await client.connect(transport);
|
|
const catalog = await client.listTools();
|
|
const startup_catalog_elapsed_ms = performance.now() - discoveryStart;
|
|
await writeFile(join(output, "catalog.json"), JSON.stringify(catalog));
|
|
const ajv = new Ajv2020({ strict: false, validateFormats: false });
|
|
const contracts = new Map();
|
|
for (const name of [
|
|
"inspect_android_jni_bindings",
|
|
...(values.proof || values["retained-removal"]
|
|
? ["export_evidence_bundle"]
|
|
: []),
|
|
...(values.pages || values["retained-removal"]
|
|
? ["inspect_analysis_view"]
|
|
: []),
|
|
]) {
|
|
const selected = catalog.tools.filter((tool) => tool.name === name);
|
|
assert.equal(selected.length, 1);
|
|
const definition = withCanonicalOutputSchema(selected[0]);
|
|
contracts.set(name, {
|
|
definition,
|
|
input: ajv.compile(definition.inputSchema),
|
|
output: ajv.compile(definition.outputSchema),
|
|
});
|
|
}
|
|
validateJniOutput = contracts.get("inspect_android_jni_bindings").output;
|
|
const invoke = async (name, args) => {
|
|
const contract = contracts.get(name);
|
|
const sent = { ...args };
|
|
if (
|
|
values["omit-detail"] &&
|
|
name === "inspect_android_jni_bindings" &&
|
|
sent.detail === "summary"
|
|
)
|
|
delete sent.detail;
|
|
assert.ok(contract.input(sent), JSON.stringify(contract.input.errors));
|
|
const start = performance.now();
|
|
const result = await client.callTool(
|
|
{ name, arguments: sent },
|
|
{ toolDefinition: contract.definition, timeout: 120000 },
|
|
);
|
|
calls.push({
|
|
phase: callPhase,
|
|
name,
|
|
arguments: sent,
|
|
result,
|
|
elapsed_ms: performance.now() - start,
|
|
});
|
|
assert.notEqual(result.isError, true, JSON.stringify(result.content));
|
|
assert.ok(
|
|
contract.output(result.structuredContent),
|
|
JSON.stringify(contract.output.errors),
|
|
);
|
|
return result.structuredContent;
|
|
};
|
|
let coldDigests;
|
|
for (let pass = 0; pass < repeats; pass++) {
|
|
const start = performance.now(),
|
|
firstCall = calls.length,
|
|
firstParent = parents.length;
|
|
const digests = [];
|
|
for (const query of queries) {
|
|
const selectedView =
|
|
values.detail === "summary" && values.pages && query === queries[1]
|
|
? {
|
|
kind: "android-jni",
|
|
collection: "bindings",
|
|
offset: 0,
|
|
limit: 1,
|
|
fields: [
|
|
"declaration_id",
|
|
"abi",
|
|
"status",
|
|
"coverage",
|
|
"candidate_ids",
|
|
],
|
|
}
|
|
: undefined;
|
|
const evidence = await invoke("inspect_android_jni_bindings", {
|
|
...query,
|
|
detail: values.detail,
|
|
...(selectedView === undefined ? {} : { view: selectedView }),
|
|
});
|
|
assert.equal(
|
|
evidence.operation,
|
|
values.detail === "summary"
|
|
? "inspect_analysis_view"
|
|
: "inspect_android_jni_bindings",
|
|
);
|
|
assert.equal(evidence.subject.digest.sha256, targetSha);
|
|
const parent = {
|
|
id:
|
|
values.detail === "summary"
|
|
? evidence.normalized_result.parent_evidence_id
|
|
: evidence.evidence_id,
|
|
query,
|
|
normalized:
|
|
values.detail === "complete" ? evidence.normalized_result : undefined,
|
|
view:
|
|
values.detail === "summary" ? evidence.normalized_result : undefined,
|
|
pages: [],
|
|
};
|
|
if (values.detail === "summary") assert.equal(evidence.raw_result, null);
|
|
parents.push(parent);
|
|
if (values.pages && query === queries[0]) {
|
|
const preview =
|
|
values.detail === "summary"
|
|
? evidence.normalized_result.summary
|
|
: evidence.normalized_result;
|
|
for (const view of collectionPages(preview)) {
|
|
const result = await invoke("inspect_analysis_view", {
|
|
source: { kind: "retained-evidence", evidence_id: parent.id },
|
|
view,
|
|
});
|
|
parent.pages.push(result.normalized_result);
|
|
assert.equal(result.normalized_result.parent_evidence_id, parent.id);
|
|
}
|
|
}
|
|
}
|
|
let bundle;
|
|
if (values.proof) {
|
|
const path = join(output, `pass-${pass}-evidence.json`);
|
|
await invoke("export_evidence_bundle", { path });
|
|
bundle = JSON.parse(await readFile(path, "utf8"));
|
|
}
|
|
for (const delivered of parents.slice(firstParent)) {
|
|
let report = delivered.normalized;
|
|
if (values.proof) {
|
|
const parent = bundle.records.find(
|
|
(record) => record.evidence_id === delivered.id,
|
|
);
|
|
assert.ok(parent, "Complete source Evidence must remain exportable");
|
|
assert.equal(parent.operation, "inspect_android_jni_bindings");
|
|
assert.equal(parent.subject.digest.sha256, targetSha);
|
|
if (report !== undefined)
|
|
assert.deepEqual(parent.normalized_result, report);
|
|
report = parent.normalized_result;
|
|
for (const [key, value] of Object.entries(delivered.query))
|
|
assert.deepEqual(parent.parameters[key], value);
|
|
}
|
|
assert.ok(report);
|
|
const { path: _path, ...selection } = delivered.query;
|
|
assert.deepEqual(report.selection, selection);
|
|
assert.equal(report.apk.path, target);
|
|
assert.equal(report.apk.sha256, targetSha);
|
|
(values.variant === "conscrypt" ? checkConscrypt : checkFixture)(
|
|
report,
|
|
delivered.query,
|
|
);
|
|
if (delivered.view?.kind === "android-jni")
|
|
checkPage(delivered.view, report);
|
|
else if (delivered.view) checkSummary(delivered.view, report);
|
|
for (const page of delivered.pages) checkPage(page, report);
|
|
digests.push(factDigest(report));
|
|
firstReport ??= report;
|
|
}
|
|
if (pass === 0) coldDigests = digests;
|
|
else
|
|
assert.deepEqual(
|
|
digests,
|
|
coldDigests,
|
|
"Warm reuse must preserve exact normalized facts",
|
|
);
|
|
runs.push({
|
|
temperature: pass === 0 ? "cold-provider" : "warm-session",
|
|
elapsed_ms: performance.now() - start,
|
|
calls: calls.length - firstCall,
|
|
fact_digests: digests,
|
|
});
|
|
}
|
|
const summary = {
|
|
targetSha,
|
|
variant: values.variant,
|
|
detail: values.detail,
|
|
omit_detail: values["omit-detail"],
|
|
proof: values.proof,
|
|
pages: values.pages,
|
|
question:
|
|
values.variant === "conscrypt"
|
|
? "Resolve NativeCrypto.EVP_PKEY_new_RSA to its static arm64 Conscrypt implementation and retain exact library identity and relocated slot evidence."
|
|
: "Resolve every fixture native declaration by ABI and library; preserve overloads, Unicode, global class ambiguity, duplicate libraries, unmatched methods and relocation uncertainty.",
|
|
baseline:
|
|
"Earlier main has no batch JNI operation. Manual inventory/export lookup cannot recover RegisterNatives with equivalent coverage; no equivalent before-speedup claim.",
|
|
startup_catalog_elapsed_ms,
|
|
elapsed_scope:
|
|
"Per-run task includes investigation calls, selected pages, proof export and local oracle checks. Startup/catalog and final transport cleanup are separate one-time costs. Resource supervisor measures the whole process family, including these phases.",
|
|
runs,
|
|
task_calls: calls.length,
|
|
calls: calls.length,
|
|
qualifications: [],
|
|
};
|
|
receipt = summary;
|
|
await writeFile(
|
|
join(output, "summary.json"),
|
|
JSON.stringify(summary, null, 2),
|
|
);
|
|
await writeFile(join(output, "calls.json"), JSON.stringify(calls));
|
|
if (values["retained-removal"]) {
|
|
callPhase = "qualification";
|
|
summary.qualifications.push(await qualifyRetainedRemoval(invoke));
|
|
summary.calls = calls.length;
|
|
await writeFile(
|
|
join(output, "summary.json"),
|
|
JSON.stringify(summary, null, 2),
|
|
);
|
|
}
|
|
console.log(JSON.stringify(summary));
|
|
} finally {
|
|
const closeStart = performance.now();
|
|
try {
|
|
await client.close();
|
|
} finally {
|
|
if (receipt) {
|
|
receipt.transport_close_elapsed_ms = performance.now() - closeStart;
|
|
await writeFile(
|
|
join(output, "summary.json"),
|
|
JSON.stringify(receipt, null, 2),
|
|
);
|
|
}
|
|
await writeFile(join(output, "calls.json"), JSON.stringify(calls));
|
|
await writeFile(join(output, "stderr.log"), stderr);
|
|
}
|
|
}
|
|
|
|
// CLI parity runs once after the MCP transport has joined its provider cleanup,
|
|
// keeping a second JVM out of the live warm-session measurement and memory set.
|
|
if (values.cli) {
|
|
const { path: _path, ...query } = queries[0];
|
|
const proof = join(output, "cli-evidence.json");
|
|
const args = [
|
|
join(repo, "scripts/rea.mjs"),
|
|
"inspect-android-jni-bindings",
|
|
target,
|
|
"--query",
|
|
JSON.stringify(query),
|
|
"--detail",
|
|
values.detail,
|
|
"--json",
|
|
];
|
|
if (values.detail === "summary") args.push("--evidence_output", proof);
|
|
const page =
|
|
values.pages && values.detail === "summary"
|
|
? {
|
|
kind: "android-jni",
|
|
collection: "bindings",
|
|
offset: 0,
|
|
limit: 7,
|
|
fields: [
|
|
"declaration_id",
|
|
"abi",
|
|
"status",
|
|
"coverage",
|
|
"candidate_ids",
|
|
],
|
|
}
|
|
: undefined;
|
|
if (page) args.push("--view", JSON.stringify(page));
|
|
const start = performance.now();
|
|
let command;
|
|
try {
|
|
command = await promisify(execFile)(process.execPath, args, {
|
|
cwd: repo,
|
|
env: environment,
|
|
encoding: "utf8",
|
|
maxBuffer: 16 * 1024 * 1024,
|
|
timeout: 120000,
|
|
killSignal: "SIGINT",
|
|
});
|
|
} catch (cause) {
|
|
await writeFile(join(output, "cli-stdout.json"), cause.stdout ?? "");
|
|
await writeFile(join(output, "cli-stderr.log"), cause.stderr ?? "");
|
|
throw cause;
|
|
}
|
|
const { stdout, stderr } = command;
|
|
await writeFile(join(output, "cli-stdout.json"), stdout);
|
|
await writeFile(join(output, "cli-stderr.log"), stderr);
|
|
const response = JSON.parse(stdout);
|
|
const evidence = values.detail === "summary" ? response.summary : response;
|
|
assert.ok(
|
|
validateJniOutput(evidence),
|
|
JSON.stringify(validateJniOutput.errors),
|
|
);
|
|
let report = evidence.normalized_result;
|
|
if (values.detail === "summary") {
|
|
const bundle = JSON.parse(await readFile(proof, "utf8"));
|
|
const parent = bundle.records.find(
|
|
(row) =>
|
|
row.evidence_id === evidence.normalized_result.parent_evidence_id,
|
|
);
|
|
assert.ok(parent);
|
|
report = parent.normalized_result;
|
|
if (page) checkPage(evidence.normalized_result, report);
|
|
else checkSummary(evidence.normalized_result, report);
|
|
}
|
|
assert.equal(factDigest(report), factDigest(firstReport));
|
|
await writeFile(
|
|
join(output, "cli-parity.json"),
|
|
JSON.stringify(
|
|
{
|
|
arguments: args,
|
|
elapsed_ms: performance.now() - start,
|
|
fact_digest: factDigest(report),
|
|
response,
|
|
stderr,
|
|
scope:
|
|
"One cold CLI parity check after MCP cleanup; separate from MCP task/token measurements.",
|
|
},
|
|
null,
|
|
2,
|
|
),
|
|
);
|
|
}
|