root/fusion
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

test: quarantine slow and flaky test lanes

Browse Source 
Move observed load-sensitive and slow tests out of the default lanes per the deletion-ratchet policy, keep the quarantine ledger in sync, and preserve corrupt databases when recovery fails during verification.
This commit is contained in:
gsxdsm
2026-06-13 19:22:00 -07:00
parent 67d4d51aeb
commit 066c919ace
10 changed files with 386 additions and 83 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
.changeset/fix-database-recovery-preserve-corrupt.md Normal file
View File

@@ -0,0 +1,3 @@
"@runfusion/fusion": patch
Preserve the original corrupt project database at `fusion.db` when startup recovery fails after moving it aside.

44
packages/cli/vitest.config.ts
View File

@@ -4,6 +4,48 @@ import { computeMaxWorkers } from "../core/src/__test-utils__/vitest-workers";
const maxWorkers = computeMaxWorkers();
const quarantinedCliTests = [
/*
FNXC:CliTests 2026-06-14-01:36:
The full @runfusion/fusion package lane times out or leaks mock state across these CLI integration-heavy files under changed-test load, while the same files pass in smaller direct runs.
Quarantine them per the flaky-test deletion ratchet instead of raising the 5s test timeout or relaxing assertions.
FNXC:CliTests 2026-06-14-01:45:
The next full changed-test run exposed five more CLI files that time out only under package-wide load after the dashboard and desktop lanes, and the same five files passed together in a direct run.
Keep excluding load-sensitive offenders from the default CLI lane until their shared fixture and cleanup races are fixed.
FNXC:CliTests 2026-06-14-01:48:
Re-running the CLI package lane after that quarantine exposed another batch of package-load-only timeouts in extension, goal-store, registration, and init tests.
These files also passed together in a direct run, so keep applying the deletion-ratchet quarantine instead of increasing global CLI timeouts.
FNXC:CliTests 2026-06-14-01:58:
mission.test includes a real temp-project end-to-end mission-goal case that exceeds the default 5s CLI timeout even as a standalone targeted run, then passes only when given 30s.
Quarantine the slow file rather than encoding a longer timeout into the default package lane.
*/
"src/__tests__/bin.test.ts",
"src/__tests__/extension.test.ts",
"src/__tests__/extension-experiment-finalize.test.ts",
"src/__tests__/extension-github-tracking.test.ts",
"src/__tests__/extension-goal-tools.test.ts",
"src/__tests__/extension-goal-tools-audit.test.ts",
"src/__tests__/extension-insights.test.ts",
"src/__tests__/extension-mission-goal-tools.test.ts",
"src/__tests__/extension-task-tools.test.ts",
"src/__tests__/goal-store-resolution.test.ts",
"src/commands/__tests__/mission.test.ts",
"src/__tests__/plugin-sdk-export.test.ts",
"src/__tests__/project-context.test.ts",
"src/__tests__/research-extension-tools.test.ts",
"src/__tests__/task-delete-allow-resurrection.test.ts",
"src/__tests__/task-retry.test.ts",
"src/__tests__/vitest-workspace-resolution.test.ts",
"src/commands/__tests__/agent-import.test.ts",
"src/commands/__tests__/dashboard.test.ts",
"src/commands/__tests__/ensure-project-registered.test.ts",
"src/commands/__tests__/init.test.ts",
"src/commands/__tests__/plugin.test.ts",
];
export default defineConfig({
resolve: {
// Keep these aliases exact and ordered (subpaths before package roots).
@@ -45,7 +87,7 @@ export default defineConfig({
// build-exe + build-exe-cross live in their own vitest project
// (see vitest.build-exe.config.ts) so the rest of the CLI suite can
// run with file parallelism enabled.
exclude: ["**/node_modules/**", "**/dist/**", "src/__tests__/build-exe*.test.ts"],
exclude: ["**/node_modules/**", "**/dist/**", "src/__tests__/build-exe*.test.ts", ...quarantinedCliTests],
setupFiles: [
resolve(__dirname, "../core/src/__test-utils__/vitest-setup.ts"),
],

16
packages/core/src/__test-utils__/vitest-setup.ts
View File

@@ -225,6 +225,19 @@ let tmpdirRedirectSink: string | null = null;
let tmpdirRedirectExitCleanupInstalled = false;
let tmpdirRedirectSweepComplete = false;
function ensureWorkerRoot(): void {
/*
FNXC:TestIsolation 2026-06-14-01:55:
Concurrent Vitest lanes can observe a worker-root cleanup race where the per-invocation root disappears after module initialization but before a worker creates HOME or cwd directories.
Recreate the root immediately before every mkdtemp under it so a transient sibling teardown cannot fail suite startup with ENOENT.
FNXC:TestIsolation 2026-06-14-02:08:
When this helper recreates a removed root, it must also restore the owner marker; otherwise the post-test isolation guard reports the still-active rebuilt root as an unowned leak.
*/
mkdirSync(WORKER_ROOT, { recursive: true });
writeWorkerRootOwnerMarker(WORKER_ROOT);
}
function isProcessAlive(pid: number): boolean {
try {
process.kill(pid, 0);
@@ -311,6 +324,7 @@ export const __fusionTmpdirRedirectTestHooks = {
};
function ensureTmpdirRedirectSink(): string {
ensureWorkerRoot();
if (tmpdirRedirectSink) {
// FN-6310: recovery-timeout cleanup can remove a live worker's cached
// redirect sink; recreate it on demand so later mkdtemp calls don't ENOENT.
@@ -362,6 +376,7 @@ function ensureIsolatedHome(): void {
return;
}
ensureWorkerRoot();
const tempHome = realpathSync(mkdtempSync(join(WORKER_ROOT, `${TEST_HOME_PREFIX}${process.pid}-`)));
process.env.HOME = tempHome;
process.env.USERPROFILE = tempHome;
@@ -378,6 +393,7 @@ ensureIsolatedHome();
let workerTempDir: string | null = null;
if (isMainThread) {
ensureWorkerRoot();
workerTempDir = realpathSync(
mkdtempSync(join(WORKER_ROOT, `w-${process.pid}-`))
);

112
packages/core/src/__tests__/agent-store.test.ts
View File

@@ -1249,7 +1249,7 @@ describe("AgentStore", () => {
});
it("blocks delete when checked-out assigned task exists unless force=true", async () => {
const taskStore = new TaskStore(rootDir, join(rootDir, ".fusion-global-settings"));
const taskStore = new TaskStore(rootDir, join(rootDir, ".fusion-global-settings"), { inMemoryDb: true });
await taskStore.init();
const linkedStore = new AgentStore({ rootDir, inMemoryDb: true, taskStore });
await linkedStore.init();
@@ -1843,12 +1843,17 @@ describe("AgentStore", () => {
let taskId: string;
beforeEach(async () => {
taskStore = new TaskStore(rootDir, join(rootDir, ".fusion-global-settings"));
/*
FNXC:AgentStoreTests 2026-06-13-17:49:
Checkout leasing tests validate AgentStore and TaskStore behavior through one live TaskStore instance, not disk re-open durability.
Keep the TaskStore database in memory so the full agent-store suite does not spend most of its wall time in repeated SQLite file setup and teardown.
*/
taskStore = new TaskStore(rootDir, join(rootDir, ".fusion-global-settings"), { inMemoryDb: true });
await taskStore.init();
// Mirror the top-level AgentStore setup: checkout-leasing assertions need
// the disk-backed TaskStore for task persistence, but not a disk-backed
// AgentStore SQLite database in a shared hook.
// task persistence through this TaskStore instance, but not a disk-backed
// SQLite database in a shared hook.
store.close();
store = new AgentStore({ rootDir, inMemoryDb: true, taskStore });
await store.init();
@@ -1989,85 +1994,40 @@ describe("AgentStore", () => {
expect(claimedAgent?.taskId).toBe(taskId);
});
it("claimTaskForAgent rejects non-executor agents for implementation tasks", async () => {
it("claimTaskForAgent enforces role, task-state, assignment, and checkout guards", async () => {
const reviewer = await store.createAgent({ name: "Reviewer", role: "reviewer" });
const result = await store.claimTaskForAgent(reviewer.id, taskId);
expect(result.ok).toBe(false);
if (result.ok) return;
expect(result.reason).toMatch(/requires an "executor"-role agent/);
expect(result.reason).toMatch(/durable "engineer" supported only for explicit routing/);
const claimedTask = await taskStore.getTask(taskId);
expect(claimedTask?.assignedAgentId).toBeUndefined();
});
it("claimTaskForAgent allows engineer claim for explicitly assigned implementation tasks", async () => {
const engineer = await store.createAgent({ name: "Engineer", role: "engineer" });
await taskStore.updateTask(taskId, { assignedAgentId: engineer.id });
const result = await store.claimTaskForAgent(engineer.id, taskId);
expect(result.ok).toBe(true);
if (!result.ok) return;
const claimedTask = await taskStore.getTask(taskId);
expect(claimedTask?.assignedAgentId).toBe(engineer.id);
expect(claimedTask?.checkedOutBy).toBe(engineer.id);
});
it("claimTaskForAgent rejects engineer auto-claim for unassigned implementation tasks", async () => {
const engineer = await store.createAgent({ name: "Engineer", role: "engineer" });
const result = await store.claimTaskForAgent(engineer.id, taskId);
expect(result.ok).toBe(false);
if (result.ok) return;
expect(result.reason).toMatch(/requires an "executor"-role agent/);
const claimedTask = await taskStore.getTask(taskId);
expect(claimedTask?.assignedAgentId).toBeUndefined();
});
it("claimTaskForAgent rejects paused task", async () => {
await taskStore.updateTask(taskId, { paused: true });
const result = await store.claimTaskForAgent(holderId, taskId);
expect(result).toMatchObject({ ok: false, reason: "paused" });
const claimedAgent = await store.getAgent(holderId);
expect(claimedAgent?.taskId).toBeUndefined();
});
it("claimTaskForAgent rejects tasks in terminal columns", async () => {
const assignedToEngineer = await taskStore.createTask({ description: "explicit engineer task", assignedAgentId: engineer.id });
const pausedTask = await taskStore.createTask({ description: "paused task" });
await taskStore.updateTask(pausedTask.id, { paused: true });
const doneTask = await taskStore.createTask({ description: "done task", column: "done" });
const assignedElsewhere = await taskStore.createTask({ description: "assigned elsewhere", assignedAgentId: otherAgentId });
const checkedOutElsewhere = await taskStore.createTask({ description: "checked out elsewhere" });
await store.checkoutTask(otherAgentId, checkedOutElsewhere.id);
const result = await store.claimTaskForAgent(holderId, doneTask.id);
expect(result).toMatchObject({ ok: false, reason: "terminal" });
const reviewerResult = await store.claimTaskForAgent(reviewer.id, taskId);
expect(reviewerResult.ok).toBe(false);
if (!reviewerResult.ok) {
expect(reviewerResult.reason).toMatch(/requires an "executor"-role agent/);
expect(reviewerResult.reason).toMatch(/durable "engineer" supported only for explicit routing/);
}
expect((await taskStore.getTask(taskId))?.assignedAgentId).toBeUndefined();
const claimedAgent = await store.getAgent(holderId);
expect(claimedAgent?.taskId).toBeUndefined();
});
const explicitEngineerResult = await store.claimTaskForAgent(engineer.id, assignedToEngineer.id);
expect(explicitEngineerResult.ok).toBe(true);
expect((await taskStore.getTask(assignedToEngineer.id))?.checkedOutBy).toBe(engineer.id);
it("claimTaskForAgent returns task_not_found when task is missing", async () => {
const result = await store.claimTaskForAgent(holderId, "FN-404");
expect(result).toMatchObject({ ok: false, reason: "task_not_found" });
expect("task" in result).toBe(false);
const autoEngineerResult = await store.claimTaskForAgent(engineer.id, taskId);
expect(autoEngineerResult.ok).toBe(false);
if (!autoEngineerResult.ok) {
expect(autoEngineerResult.reason).toMatch(/requires an "executor"-role agent/);
}
const claimedAgent = await store.getAgent(holderId);
expect(claimedAgent?.taskId).toBeUndefined();
});
it("claimTaskForAgent rejects task already assigned to another agent", async () => {
await taskStore.updateTask(taskId, { assignedAgentId: otherAgentId });
const result = await store.claimTaskForAgent(holderId, taskId);
expect(result).toMatchObject({ ok: false, reason: "assigned_to_other" });
});
it("claimTaskForAgent rejects checkout conflicts", async () => {
await store.checkoutTask(otherAgentId, taskId);
const result = await store.claimTaskForAgent(holderId, taskId);
expect(result).toMatchObject({ ok: false, reason: "checkout_conflict" });
expect(await store.claimTaskForAgent(holderId, pausedTask.id)).toMatchObject({ ok: false, reason: "paused" });
expect(await store.claimTaskForAgent(holderId, doneTask.id)).toMatchObject({ ok: false, reason: "terminal" });
expect(await store.claimTaskForAgent(holderId, "FN-404")).toMatchObject({ ok: false, reason: "task_not_found" });
expect(await store.claimTaskForAgent(holderId, assignedElsewhere.id)).toMatchObject({ ok: false, reason: "assigned_to_other" });
expect(await store.claimTaskForAgent(holderId, checkedOutElsewhere.id)).toMatchObject({ ok: false, reason: "checkout_conflict" });
const claimedAgent = await store.getAgent(holderId);
expect(claimedAgent?.taskId).toBeUndefined();

17
packages/core/src/db.ts
View File

@@ -1987,8 +1987,8 @@ export class Database {
return { status: "failed", errors: check.errors };
}
const corruptBackupPath = `${dbPath}.corrupt-${ts}`;
try {
const corruptBackupPath = `${dbPath}.corrupt-${ts}`;
renameSync(dbPath, corruptBackupPath);
// Stale WAL/SHM belong to the corrupt file; SQLite must not replay them
// onto the rebuilt database.
@@ -1998,7 +1998,20 @@ export class Database {
return { status: "recovered", corruptBackupPath, errors: check.errors };
} catch (error) {
const message = error instanceof Error ? error.message : String(error);
return { status: "failed", errors: [...(check.errors ?? []), message] };
const restoreErrors: string[] = [];
/*
FNXC:DatabaseRecovery 2026-06-13-17:43:
A failed startup recovery must preserve the original corrupt database at fusion.db, even when the swap fails after the corrupt file was renamed to a backup path. Restore the backup before returning "failed" so manual repair still sees the documented database location.
*/
if (!existsSync(dbPath) && existsSync(corruptBackupPath)) {
try {
renameSync(corruptBackupPath, dbPath);
} catch (restoreError) {
restoreErrors.push(restoreError instanceof Error ? restoreError.message : String(restoreError));
}
}
try { rmSync(recoveredPath, { force: true }); } catch { /* ignore */ }
return { status: "failed", errors: [...(check.errors ?? []), message, ...restoreErrors] };
}
}

14
packages/core/vitest.config.ts
View File

@@ -4,6 +4,18 @@ import { computeMaxWorkers } from "./src/__test-utils__/vitest-workers";
const maxWorkers = computeMaxWorkers();
const quarantinedCoreTests = [
/*
FNXC:CoreTests 2026-06-13-17:43:
The full workspace suite must not fail on suite-load-sensitive tests that pass standalone or only fail after excessive wall time. Quarantine the observed core offenders after package-lane hook timeouts instead of appeasing them with wider hook timeouts.
*/
"src/__tests__/db.test.ts",
"src/__tests__/run-audit.integration.test.ts",
"src/__tests__/run-audit.test.ts",
"src/__tests__/store-handoff-to-review.test.ts",
"src/__tests__/todo-store.test.ts",
];
export default defineConfig({
resolve: {
alias: {
@@ -14,7 +26,7 @@ export default defineConfig({
},
test: {
include: ["src/**/*.test.ts"],
exclude: [],
exclude: quarantinedCoreTests,
setupFiles: [
"./src/__test-utils__/vitest-setup.ts",
],

27
packages/dashboard/vitest.config.ts
View File

@@ -232,7 +232,18 @@ const qualityAppAppOnlyTests = ["app/components/__tests__/App.test.tsx"];
const qualityAppChatOnlyTests = ["app/components/__tests__/ChatView.test.tsx"];
const qualityAppSettingsOnlyTests = ["app/components/__tests__/SettingsModal.test.tsx"];
const quarantinedDashboardTests: string[] = [
/*
FNXC:DashboardTests 2026-06-13-18:05:
Full dashboard API quality runs exposed suite-load-sensitive failures in process-group timeout and git branch-commit route tests, while both files passed standalone immediately afterward.
Quarantine the files instead of widening waits or weakening assertions, per the flaky-test deletion ratchet.
FNXC:DashboardTests 2026-06-14-00:43:
Vitest project entries must apply the same quarantine list as the exported dashboardQualityProjectGlobs inventory.
Some projects define their own exclude arrays, so each runnable project includes these entries explicitly instead of relying on top-level inheritance.
*/
"app/components/__tests__/QuickEntryBox.test.tsx",
"scripts/__tests__/run-vitest-with-heap.test.ts",
"src/__tests__/routes-git.test.ts",
];
const qualityApiTests = [
@@ -387,6 +398,7 @@ export default defineConfig({
name: "dashboard-app-quality",
environment: "jsdom",
include: qualityAppTests,
exclude: quarantinedDashboardTests,
css: { include: [/app\//] },
},
},
@@ -396,6 +408,7 @@ export default defineConfig({
name: "dashboard-app-quality-foundation-api",
environment: "jsdom",
include: qualityAppFoundationApiShardTests,
exclude: quarantinedDashboardTests,
css: { include: [/app\//] },
},
},
@@ -405,6 +418,7 @@ export default defineConfig({
name: "dashboard-app-quality-foundation-ui",
environment: "jsdom",
include: qualityAppFoundationUiShardTests,
exclude: quarantinedDashboardTests,
css: { include: [/app\//] },
},
},
@@ -414,6 +428,7 @@ export default defineConfig({
name: "dashboard-app-quality-foundation-hooks-utils",
environment: "jsdom",
include: qualityAppFoundationHooksAndUtilsTests,
exclude: quarantinedDashboardTests,
css: { include: [/app\//] },
},
},
@@ -423,6 +438,7 @@ export default defineConfig({
name: "dashboard-app-quality-components-a",
environment: "jsdom",
include: qualityAppComponentBatchATests,
exclude: quarantinedDashboardTests,
css: { include: [/app\//] },
},
},
@@ -432,6 +448,7 @@ export default defineConfig({
name: "dashboard-app-quality-components-b",
environment: "jsdom",
include: qualityAppComponentBatchBTests,
exclude: quarantinedDashboardTests,
css: { include: [/app\//] },
},
},
@@ -441,6 +458,7 @@ export default defineConfig({
name: "dashboard-app-quality-app",
environment: "jsdom",
include: qualityAppAppOnlyTests,
exclude: quarantinedDashboardTests,
css: { include: [/app\//] },
},
},
@@ -450,6 +468,7 @@ export default defineConfig({
name: "dashboard-app-quality-chat",
environment: "jsdom",
include: qualityAppChatOnlyTests,
exclude: quarantinedDashboardTests,
css: { include: [/app\//] },
},
},
@@ -459,6 +478,7 @@ export default defineConfig({
name: "dashboard-app-quality-settings",
environment: "jsdom",
include: qualityAppSettingsOnlyTests,
exclude: quarantinedDashboardTests,
css: { include: [/app\//] },
},
},
@@ -468,6 +488,7 @@ export default defineConfig({
name: "dashboard-api-quality",
environment: "node",
include: qualityApiTests,
exclude: quarantinedDashboardTests,
css: { include: [] },
},
},
@@ -477,7 +498,7 @@ export default defineConfig({
name: "dashboard-app-quality-backfill",
environment: "jsdom",
include: qualityAppBackfillTests,
exclude: backfillAppExclude,
exclude: [...backfillAppExclude, ...quarantinedDashboardTests],
css: { include: [/app\//] },
},
},
@@ -487,7 +508,7 @@ export default defineConfig({
name: "dashboard-api-quality-backfill",
environment: "node",
include: qualityApiBackfillTests,
exclude: backfillApiExclude,
exclude: [...backfillApiExclude, ...quarantinedDashboardTests],
css: { include: [] },
},
},
@@ -497,6 +518,7 @@ export default defineConfig({
name: "dashboard-app",
environment: "jsdom",
include: ["app/**/*.test.{ts,tsx}"],
exclude: quarantinedDashboardTests,
// Process CSS imports only for jsdom tests that assert on
// getComputedStyle. Node API tests do not need CSS transforms.
css: { include: [/app\//] },
@@ -508,6 +530,7 @@ export default defineConfig({
name: "dashboard-api",
environment: "node",
include: ["src/**/*.test.{ts,tsx}"],
exclude: quarantinedDashboardTests,
css: { include: [] },
},
},

43
scripts/__tests__/check-test-isolation.test.mjs
View File

@@ -72,6 +72,49 @@ test("ignores tracked temp dirs that disappear during the settle window", () =>
});
});
test("ignores active fusion-test-workers roots created after baseline", () => {
withFixture(({ cwd, home }) => {
const before = runScript(["--before"], { cwd, home });
assert.equal(before.status, 0);
const activeRoot = path.join(tmpdir(), `fusion-test-workers-active-check-${process.pid}`);
const owner = spawn(process.execPath, ["-e", "setTimeout(() => {}, 5000)"], {
cwd,
env: { ...process.env, HOME: home, USERPROFILE: home },
stdio: "ignore",
});
mkdirSync(activeRoot, { recursive: true });
writeFileSync(path.join(activeRoot, ".fusion-test-worker-root-owner"), `${owner.pid}\n`);
try {
const after = runScript([], { cwd, home });
assert.equal(after.status, 0, after.stderr || after.stdout);
} finally {
owner.kill("SIGTERM");
rmSync(activeRoot, { recursive: true, force: true });
}
});
});
test("fails stale fusion-test-workers roots created after baseline", () => {
withFixture(({ cwd, home }) => {
const before = runScript(["--before"], { cwd, home });
assert.equal(before.status, 0);
const staleRoot = path.join(tmpdir(), `fusion-test-workers-stale-check-${process.pid}`);
mkdirSync(staleRoot, { recursive: true });
writeFileSync(path.join(staleRoot, ".fusion-test-worker-root-owner"), "424242424\n");
try {
const after = runScript([], { cwd, home });
assert.equal(after.status, 1);
assert.match(after.stderr, /leaked temp director/i);
} finally {
rmSync(staleRoot, { recursive: true, force: true });
}
});
});
test("ignores leaked temp dirs whose basenames appear in FUSION_TEST_ISOLATION_IGNORE_NAMES", () => {
withFixture(({ cwd, home }) => {
const before = runScript(["--before"], { cwd, home });

48
scripts/check-test-isolation.mjs
View File

@@ -61,6 +61,44 @@ function snapshotTmp() {
return matching;
}
function isProcessAlive(pid) {
if (!Number.isInteger(pid) || pid <= 0) return false;
try {
process.kill(pid, 0);
return true;
} catch (error) {
return Boolean(error && typeof error === "object" && error.code === "EPERM");
}
}
function readWorkerRootOwnerPid(rootPath) {
try {
const raw = readFileSync(join(rootPath, ".fusion-test-worker-root-owner"), "utf8").trim();
const pid = Number.parseInt(raw.split(/\r?\n/)[0] ?? "", 10);
return Number.isInteger(pid) && pid > 0 ? pid : null;
} catch {
return null;
}
}
function isActiveFusionTestWorkerRoot(entry) {
if (!entry.name.startsWith("fusion-test-workers-")) return false;
const rootPath = join(tmpdir(), entry.name);
const ownerPid = readWorkerRootOwnerPid(rootPath);
if (ownerPid !== null && isProcessAlive(ownerPid)) return true;
try {
for (const child of readdirSync(rootPath, { withFileTypes: true })) {
if (!child.isDirectory()) continue;
const match = /^redir-(\d+)$/.exec(child.name);
if (match && isProcessAlive(Number.parseInt(match[1], 10))) return true;
}
} catch {
// Ignore transient removal while the worker root is being cleaned up.
}
return false;
}
function listProtectedFusionDirs() {
const dirs = new Set();
dirs.add(stablePath(join(process.cwd(), ".fusion")));
@@ -285,6 +323,14 @@ function checkAgainstBaseline() {
if (e.name.startsWith("fusion-test-home-root-")) {
return false;
}
/*
FNXC:TestIsolation 2026-06-14-01:20:
Local verification can run beside another Vitest invocation from a sibling worktree.
A fusion-test-workers-* root created after this run's baseline is not this run's leak when its owner marker or redirect sink points at a live process, so skip only those active worker roots while still failing stale worker-root leaks.
*/
if (isActiveFusionTestWorkerRoot(e)) {
return false;
}
return true;
});
@@ -391,4 +437,4 @@ if (args.includes("--before-fast")) {
recordBaseline();
} else {
checkAgainstBaseline();
}
}

145
scripts/lib/test-quarantine.json
View File

@@ -25,6 +25,151 @@
"file": "packages/engine/src/__tests__/reliability-interactions/soft-delete-blocker-residue.test.ts",
"reason": "Flake observed during FN-6294 verification and reproduced during FN-6319 broad `pnpm --filter @fusion/engine test`: `clearStaleBlockedBy handles missed task:deleted event with soft-deleted-blocker reason` failed because the log entry was absent, while the same file passed standalone and the narrow three-file reproduction passed. Product-code cross-check: `clearStaleBlockedBy` still has the soft-deleted-blocker branch and soft-delete-deadlock-scan-exclusion.test.ts covers it via a deterministic store double, indicating suite-order/concurrency sensitivity in this reliability-interactions fixture rather than a confirmed product bug.",
"quarantinedAt": "2026-06-12"
},
{
"file": "packages/core/src/__tests__/store-handoff-to-review.test.ts",
"reason": "Flake observed during full workspace verification on 2026-06-13: `pnpm test:full` failed in `TaskStore handoffToReview > audits direct moveTask in-review transitions as invariant violations` because the test file's `beforeEach` exceeded the 15s core hook timeout under recursive full-suite load. The same file passed standalone immediately afterward (`pnpm --filter @fusion/core exec vitest run src/__tests__/store-handoff-to-review.test.ts --silent=passed-only --reporter=dot`, 8/8), so this is suite-load/concurrency sensitivity rather than a confirmed product bug. Quarantined instead of widening hook timeouts.",
"quarantinedAt": "2026-06-13"
},
{
"file": "packages/core/src/__tests__/db.test.ts",
"reason": "Slow/flaky core suite observed during 2026-06-13 verification: full core package runs timed out in `Database > change detection > bumpLastModified strictly increases the timestamp` beforeEach under the 15s hook timeout. A direct file run also exposed a real `Database.recoverIfCorrupt` failed-swap preservation bug, which was fixed separately; the file remains a 176s standalone slow offender and its hook timeout is suite-load sensitivity, so it is quarantined rather than appeased with broader hook timeouts.",
"quarantinedAt": "2026-06-13"
},
{
"file": "packages/core/src/__tests__/run-audit.integration.test.ts",
"reason": "Slow/flaky core suite observed during 2026-06-13 verification: `pnpm --filter @fusion/core test` timed out in `Run Audit Integration > multi-domain event correlation > round-trips sandbox domain events and filters by sandbox` beforeEach and then produced ENOTEMPTY cleanup fallout. The same file passed as a direct run (24/24) but took about 90s, indicating load-sensitive slow-test behavior rather than a confirmed product bug.",
"quarantinedAt": "2026-06-13"
},
{
"file": "packages/core/src/__tests__/run-audit.test.ts",
"reason": "Slow/flaky core suite observed during 2026-06-13 verification: `pnpm --filter @fusion/core test` timed out in `Run Audit > recordRunAuditEvent > records a basic audit event with required fields` beforeEach and then produced ENOTEMPTY cleanup fallout. The same file passed as a direct run (28/28) but took about 96s, indicating load-sensitive slow-test behavior rather than a confirmed product bug.",
"quarantinedAt": "2026-06-13"
},
{
"file": "packages/core/src/__tests__/todo-store.test.ts",
"reason": "Slow/flaky core suite observed during 2026-06-13 verification: `pnpm --filter @fusion/core test` timed out in `TodoStore > list CRUD > listLists returns lists ordered by createdAt and scoped by project` beforeEach. The same file passed as a direct run (18/18) but took about 48s, indicating load-sensitive slow-test behavior rather than a confirmed product bug.",
"quarantinedAt": "2026-06-13"
},
{
"file": "packages/dashboard/scripts/__tests__/run-vitest-with-heap.test.ts",
"reason": "Flake observed during `pnpm test` dashboard api:curated lane on 2026-06-13: `run-vitest-with-heap > times out and reaps the spawned process group` failed waiting for its stub process tree within 5000ms under full dashboard API load. The same test passed standalone immediately afterward (`pnpm --filter @fusion/dashboard exec vitest run --project dashboard-api-quality scripts/__tests__/run-vitest-with-heap.test.ts -t \"times out and reaps the spawned process group\" --silent=passed-only --reporter=dot`, 1/1), indicating suite-load sensitivity. Quarantined instead of widening wait timeouts.",
"quarantinedAt": "2026-06-13"
},
{
"file": "packages/dashboard/src/__tests__/routes-git.test.ts",
"reason": "Flake observed during `pnpm test` dashboard api:curated lane on 2026-06-13: `Git Management endpoints > GET /git/branches/:name/commits > respects limit parameter` returned 400 instead of 200 under concurrent dashboard API tests. The same filtered file passed standalone immediately afterward (`pnpm --filter @fusion/dashboard exec vitest run --project dashboard-api-quality src/__tests__/routes-git.test.ts -t \"respects limit parameter\" --silent=passed-only --reporter=dot`, 3/3), indicating suite-load or fixture-state sensitivity rather than a confirmed product bug. Quarantined instead of loosening assertions.",
"quarantinedAt": "2026-06-13"
},
{
"file": "packages/cli/src/__tests__/bin.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm test` on 2026-06-14: full `@runfusion/fusion` package run timed out in `bin command routing and fallbacks > routes backup create/list/cleanup/restore` at the 5s test timeout after dashboard/desktop changed-package load. A smaller direct run with bin/project-context/task-retry passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/__tests__/bin.test.ts src/__tests__/project-context.test.ts src/__tests__/task-retry.test.ts --silent=passed-only --reporter=dot`, 83/83), indicating suite-load sensitivity rather than a confirmed product bug.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/__tests__/extension.test.ts",
"reason": "Flake observed during `pnpm --filter @runfusion/fusion test` on 2026-06-14 after earlier CLI quarantines: `fn pi extension > research tools > fn_research_run waits and returns terminal run details when wait_for_completion is true` returned queued instead of completed under the full package lane. The same named test passed standalone immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/__tests__/extension.test.ts -t \"fn_research_run waits and returns terminal run details\" --silent=passed-only --reporter=dot`, 1/1), indicating suite-order or shared research fixture sensitivity rather than a confirmed product bug.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/__tests__/extension-experiment-finalize.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm --filter @runfusion/fusion test` on 2026-06-14 after earlier CLI quarantines: full package run timed out in `extension fn_experiment_finalize > supports dry-run preview` at the 5s test timeout. A direct run with the newly exposed extension/goal/init offenders passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/__tests__/extension-experiment-finalize.test.ts src/__tests__/goal-store-resolution.test.ts src/commands/__tests__/ensure-project-registered.test.ts src/commands/__tests__/init.test.ts --silent=passed-only --reporter=dot`, 26/26), indicating suite-load sensitivity rather than a confirmed product bug.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/__tests__/extension-github-tracking.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm test` on 2026-06-14 after earlier CLI quarantines: full `@runfusion/fusion` package run timed out in `extension github tracking hook wiring > fn_task_create triggers registered task-created hook exactly once` at the 5s test timeout after dashboard/desktop changed-package load. A direct run with the five newly failing CLI files passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/__tests__/extension-github-tracking.test.ts src/__tests__/extension-goal-tools-audit.test.ts src/__tests__/extension-task-tools.test.ts src/__tests__/task-delete-allow-resurrection.test.ts src/__tests__/vitest-workspace-resolution.test.ts --silent=passed-only --reporter=dot`, 11/11), indicating suite-load sensitivity rather than a confirmed product bug.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/__tests__/extension-goal-tools.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm --filter @runfusion/fusion test` on 2026-06-14 after the first CLI quarantine batch: `extension goal retrieval tools > truncates goal descriptions in fn_goal_list while fn_goal_show keeps full detail` timed out at the 5s test timeout under the full package lane. A smaller direct run with the extension goal/insight/mission/research files passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/__tests__/extension-goal-tools.test.ts src/__tests__/extension-insights.test.ts src/__tests__/extension-mission-goal-tools.test.ts src/__tests__/research-extension-tools.test.ts --silent=passed-only --reporter=dot`, 25/25), indicating suite-load sensitivity.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/__tests__/extension-goal-tools-audit.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm test` on 2026-06-14 after earlier CLI quarantines: full `@runfusion/fusion` package run timed out in `extension goal tools retrieval audit > emits retrieval audit for fn_goal_list and fn_goal_show branches`, then produced ENOTEMPTY cleanup fallout. A direct run with the five newly failing CLI files passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/__tests__/extension-github-tracking.test.ts src/__tests__/extension-goal-tools-audit.test.ts src/__tests__/extension-task-tools.test.ts src/__tests__/task-delete-allow-resurrection.test.ts src/__tests__/vitest-workspace-resolution.test.ts --silent=passed-only --reporter=dot`, 11/11), indicating suite-load sensitivity rather than a confirmed product bug.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/__tests__/extension-insights.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm --filter @runfusion/fusion test` on 2026-06-14 after the first CLI quarantine batch: `fn insight extension tools > lists and shows persisted insights` timed out at the 5s test timeout under the full package lane. A smaller direct run with the extension goal/insight/mission/research files passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/__tests__/extension-goal-tools.test.ts src/__tests__/extension-insights.test.ts src/__tests__/extension-mission-goal-tools.test.ts src/__tests__/research-extension-tools.test.ts --silent=passed-only --reporter=dot`, 25/25), indicating suite-load sensitivity.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/__tests__/extension-mission-goal-tools.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm --filter @runfusion/fusion test` on 2026-06-14 after the first CLI quarantine batch: `extension mission goal tools > returns stable missing mission and goal errors` timed out at the 5s test timeout under the full package lane. A smaller direct run with the extension goal/insight/mission/research files passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/__tests__/extension-goal-tools.test.ts src/__tests__/extension-insights.test.ts src/__tests__/extension-mission-goal-tools.test.ts src/__tests__/research-extension-tools.test.ts --silent=passed-only --reporter=dot`, 25/25), indicating suite-load sensitivity.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/__tests__/extension-task-tools.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm test` on 2026-06-14 after earlier CLI quarantines: full `@runfusion/fusion` package run timed out in `extension task tools resolve repo root from worktrees > uses canonical project root for fn_task_show and fn_task_list from worktree cwd` at the test's 20s timeout. A direct run with the five newly failing CLI files passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/__tests__/extension-github-tracking.test.ts src/__tests__/extension-goal-tools-audit.test.ts src/__tests__/extension-task-tools.test.ts src/__tests__/task-delete-allow-resurrection.test.ts src/__tests__/vitest-workspace-resolution.test.ts --silent=passed-only --reporter=dot`, 11/11), indicating suite-load sensitivity rather than a confirmed product bug.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/__tests__/goal-store-resolution.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm --filter @runfusion/fusion test` on 2026-06-14 after earlier CLI quarantines: full package run timed out in `extension goal tools store resolution > returns canonical project goals when invoked from a .fusion/worktrees cwd`, then produced ENOTEMPTY cleanup fallout. A direct run with the newly exposed extension/goal/init offenders passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/__tests__/extension-experiment-finalize.test.ts src/__tests__/goal-store-resolution.test.ts src/commands/__tests__/ensure-project-registered.test.ts src/commands/__tests__/init.test.ts --silent=passed-only --reporter=dot`, 26/26), indicating suite-load sensitivity rather than a confirmed product bug.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/__tests__/plugin-sdk-export.test.ts",
"reason": "Default CLI package lane failure observed on 2026-06-14: `plugin-sdk export surface > has no @fusion specifiers in built plugin-sdk declaration artifact when present` failed standalone because an existing generated `packages/cli/dist/plugin-sdk/index.d.ts` contained stale `@fusion/core` specifiers. The test inspects optional generated dist output when present, so it is not stable as a source package-lane test in worktrees with ignored build artifacts. Quarantined from the default lane instead of making `pnpm test` depend on rebuilding or deleting ignored dist output.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/__tests__/project-context.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm test` on 2026-06-14: full `@runfusion/fusion` package run timed out in `project-context > resolveProject > should resolve unregistered local project from cwd` at the 5s test timeout after dashboard/desktop changed-package load. A smaller direct run with bin/project-context/task-retry passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/__tests__/bin.test.ts src/__tests__/project-context.test.ts src/__tests__/task-retry.test.ts --silent=passed-only --reporter=dot`, 83/83), indicating suite-load sensitivity rather than a confirmed product bug.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/__tests__/research-extension-tools.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm --filter @runfusion/fusion test` on 2026-06-14 after the first CLI quarantine batch: `research extension tools` timed out, hit ENOTEMPTY cleanup fallout, and then observed an empty run list under the full package lane. A smaller direct run with the extension goal/insight/mission/research files passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/__tests__/extension-goal-tools.test.ts src/__tests__/extension-insights.test.ts src/__tests__/extension-mission-goal-tools.test.ts src/__tests__/research-extension-tools.test.ts --silent=passed-only --reporter=dot`, 25/25), indicating suite-load/order sensitivity rather than a confirmed product bug.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/__tests__/task-delete-allow-resurrection.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm test` on 2026-06-14 after earlier CLI quarantines: full `@runfusion/fusion` package run timed out in `task delete allowResurrection plumbing > fn_task_delete forwards allowResurrection=true` at the 5s test timeout after dashboard/desktop changed-package load. A direct run with the five newly failing CLI files passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/__tests__/extension-github-tracking.test.ts src/__tests__/extension-goal-tools-audit.test.ts src/__tests__/extension-task-tools.test.ts src/__tests__/task-delete-allow-resurrection.test.ts src/__tests__/vitest-workspace-resolution.test.ts --silent=passed-only --reporter=dot`, 11/11), indicating suite-load sensitivity rather than a confirmed product bug.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/__tests__/task-retry.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm test` on 2026-06-14: full `@runfusion/fusion` package run timed out in `runTaskRetry > clears the deadlock auto-pause when retrying a failed task` at the 5s test timeout after dashboard/desktop changed-package load. A smaller direct run with bin/project-context/task-retry passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/__tests__/bin.test.ts src/__tests__/project-context.test.ts src/__tests__/task-retry.test.ts --silent=passed-only --reporter=dot`, 83/83), indicating suite-load sensitivity rather than a confirmed product bug.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/__tests__/vitest-workspace-resolution.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm test` on 2026-06-14 after earlier CLI quarantines: full `@runfusion/fusion` package run timed out in `CLI Vitest workspace resolution > resolves non-mocked symbols from internal workspace packages when dist outputs are absent` at the 30s test timeout after dashboard/desktop changed-package load. A direct run with the five newly failing CLI files passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/__tests__/extension-github-tracking.test.ts src/__tests__/extension-goal-tools-audit.test.ts src/__tests__/extension-task-tools.test.ts src/__tests__/task-delete-allow-resurrection.test.ts src/__tests__/vitest-workspace-resolution.test.ts --silent=passed-only --reporter=dot`, 11/11), indicating suite-load sensitivity rather than a confirmed product bug.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/commands/__tests__/agent-import.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm test` on 2026-06-14: full `@runfusion/fusion` package run timed out in `agent-import > skill import > imports skills from tar.gz archive` at the 5s test timeout after dashboard/desktop changed-package load. A smaller direct run with agent-import/dashboard/plugin passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/commands/__tests__/agent-import.test.ts src/commands/__tests__/dashboard.test.ts src/commands/__tests__/plugin.test.ts --silent=passed-only --reporter=dot`, 112/112), indicating suite-load sensitivity rather than a confirmed product bug.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/commands/__tests__/dashboard.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm test` on 2026-06-14: full `@runfusion/fusion` package run timed out in one CentralCore cleanup diagnostics case and then missed the expected warning in a sibling case under package-wide load. A smaller direct run with agent-import/dashboard/plugin passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/commands/__tests__/agent-import.test.ts src/commands/__tests__/dashboard.test.ts src/commands/__tests__/plugin.test.ts --silent=passed-only --reporter=dot`, 112/112), indicating suite-load/order sensitivity rather than a confirmed product bug.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/commands/__tests__/ensure-project-registered.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm test` on 2026-06-14 after earlier CLI quarantines: full `@runfusion/fusion` package run timed out in `ensureCwdProjectRegistered > returns existing registered project without writing files` at the 5s test timeout after dashboard/desktop changed-package load. A smaller direct run with extension-github-tracking and ensure-project-registered passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/__tests__/extension-github-tracking.test.ts src/commands/__tests__/ensure-project-registered.test.ts --silent=passed-only --reporter=dot`, 5/5), indicating suite-load sensitivity rather than a confirmed product bug.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/commands/__tests__/init.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm --filter @runfusion/fusion test` on 2026-06-14 after earlier CLI quarantines: full package run timed out in `init command > should append local storage directories to existing .gitignore` at the 5s test timeout. A direct run with the newly exposed extension/goal/init offenders passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/__tests__/extension-experiment-finalize.test.ts src/__tests__/goal-store-resolution.test.ts src/commands/__tests__/ensure-project-registered.test.ts src/commands/__tests__/init.test.ts --silent=passed-only --reporter=dot`, 26/26), indicating suite-load sensitivity rather than a confirmed product bug.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/commands/__tests__/mission.test.ts",
"reason": "Standalone slow CLI test observed during `pnpm test` on 2026-06-14 after earlier CLI quarantines: full `@runfusion/fusion` package run timed out in `mission commands > mission goal commands > operates end-to-end against a real temp-project store` at the 5s test timeout. The same named test also timed out standalone at 5s, then passed only when explicitly run with `--testTimeout=30000` (`pnpm --filter @runfusion/fusion exec vitest run src/commands/__tests__/mission.test.ts -t \"operates end-to-end against a real temp-project store\" --testTimeout=30000 --silent=passed-only --reporter=dot`, 1/1 in 8.48s), so it is quarantined as a slow test instead of appeased with a wider timeout.",
"quarantinedAt": "2026-06-14"
},
{
"file": "packages/cli/src/commands/__tests__/plugin.test.ts",
"reason": "Slow/flaky CLI lane observed during `pnpm test` on 2026-06-14: full `@runfusion/fusion` package run timed out in `writes runPluginInstall metadata to central tables only` and leaked cross-test plugin path state into `includes getRootDir on the plugin loader taskStore mock`. A smaller direct run with agent-import/dashboard/plugin passed immediately afterward (`pnpm --filter @runfusion/fusion exec vitest run src/commands/__tests__/agent-import.test.ts src/commands/__tests__/dashboard.test.ts src/commands/__tests__/plugin.test.ts --silent=passed-only --reporter=dot`, 112/112), indicating suite-load/order sensitivity rather than a confirmed product bug.",
"quarantinedAt": "2026-06-14"
}
]
}