Files
SnapOtter/tests/qa/generate-ledger.mts
T
SnapOtterandGitHub bd1838e40b fix: repair docker validation QA tooling, dispatcher crash-accounting, and image-enhancement RAW hang (#391)
Found and fixed during a full local Docker build validation (amd64/arm64, all
four fleet targets, AI bundle installs, QA harness) and the follow-up bug
sweep requested afterward. None of the affected scripts run in CI, so these
had been silently broken indefinitely.

- docker/feature-manifest.json: pythonVersion was a flat "3.11", but the
  amd64 base (Ubuntu 24.04) ships Python 3.12 while arm64 (Debian bookworm)
  ships 3.11. Changed to a per-arch object matching the file's existing
  convention.
- tests/qa/api-sweep.mts and verify-ai.mts: bare "@snapotter/shared" import
  can't resolve since tests/ is not a pnpm workspace member, making both
  silently unrunnable via their own documented command on any fresh
  checkout. Switched to a relative import.
- tests/qa/generate-ledger.mts: wrote to docs/qa/ without creating the
  directory first; docs/ is gitignored except COMMUNITY_GUIDE.md, so a fresh
  checkout threw ENOENT.
- Seven QA Playwright spec files (input-preview, settings,
  settings-extended, multifile, output-preview, pipeline-ui, smoke) had
  ~115 fixture() calls using directory names that don't exist. Resolved
  every call programmatically against the real fixture tree.
- packages/ai/src/bridge.ts: AI dispatcher restart (happens on every bundle
  install) was falsely counted as a crash, risking permanent dispatcher
  disable after enough legitimate restarts within the crash window. Added a
  shuttingDown flag checked at all three recordCrash() call sites.
- packages/image-engine/src/operations/auto-enhance.ts: image-enhancement
  hung 40+ seconds on large RAW photos (confirmed on a real 20.2MP file) in
  Sharp's .clahe() step, whose cost scales with total pixel count regardless
  of tile size. Added a 16-megapixel cap above which CLAHE is skipped;
  verified against the real file (40+s -> 2.0s) with no regression to other
  RAW formats or normal-sized images. Fixing this surfaced a second,
  smaller bug where the saturation step's CLAHE compensation boost was
  keyed off the raw toggle instead of whether CLAHE actually ran.
- Two QA-harness robustness gaps closed per "fix everything, even the small
  bugs": the passport-photo/erase-object input-preview tests now skip
  cleanly with a clear reason on a container without their AI bundle
  installed, and docker-compose.qa.yml's hardcoded project/container name
  (the actual root cause of a mid-validation container swap between two
  concurrent sessions) is now parameterized via QA_PROJECT_NAME.

Full validation report is local-only per repo convention.
2026-07-02 14:21:13 +08:00

62 lines
1.8 KiB
TypeScript

// Generates the master coverage ledger (157 rows, complete by construction) from
// tools-meta.json. Discovery shards update cells; any "pending" cell at the end is
// an explicit, surfaced gap. Run: npx tsx tests/qa/generate-ledger.mts
import { mkdirSync, readFileSync, writeFileSync } from "node:fs";
import path from "node:path";
import { fileURLToPath } from "node:url";
interface ToolMeta {
id: string;
name: string;
modality: string;
acceptedInputs: string[];
executionHint: string;
isAI: boolean;
}
const dir = path.dirname(fileURLToPath(import.meta.url));
const meta: ToolMeta[] = JSON.parse(readFileSync(path.join(dir, "tools-meta.json"), "utf8"));
// Cells: "pending" | "pass" | "fail" | "n/a"; counts are integers.
const tools = meta.map((t) => ({
toolId: t.id,
name: t.name,
modality: t.modality,
executionHint: t.executionHint,
isAI: t.isAI,
acceptedFormats: t.acceptedInputs,
acceptedFormatCount: t.acceptedInputs.length,
inputFormatsTested: 0,
inputFormatsTotal: t.acceptedInputs.length,
settingsTested: "pending",
outputFormatsTested: "pending",
multiFile: "pending",
inputPreview: "pending",
outputPreview: "pending",
download: "pending",
negativePath: "pending",
consoleClean: "pending",
status: "pending",
bugs: [] as string[],
}));
const out = path.join(dir, "..", "..", "docs", "qa", "coverage-ledger.json");
mkdirSync(path.dirname(out), { recursive: true });
writeFileSync(
out,
`${JSON.stringify(
{
generatedAtNote: "stamp set by harness at run time",
toolCount: tools.length,
byModality: tools.reduce<Record<string, number>>((acc, t) => {
acc[t.modality] = (acc[t.modality] ?? 0) + 1;
return acc;
}, {}),
tools,
},
null,
2,
)}\n`,
);
console.log(`ledger: ${tools.length} tools -> ${out}`);