root/fusion
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

test: quarantine 11 failing CI full-suite tests

Browse Source 
Quarantine test files consistently failing on the non-blocking full-suite
CI on main, per the AGENTS.md deletion-ratchet policy:

Engine-default (shard 1-2): ce-workflow-step-conventions,
executor-column-agent-principal, restart.integration,
scheduler-node-unreachable-audit, scheduler-overlap-starvation,
scheduler-ephemeral-toggle, user-configured-command-no-execsync

Engine-reliability (shard 1): lease-recovery-central-claim,
owning-node-unavailable-interactions, todo-inprogress-flapping

CLI (shard 3): extension.test.ts

Each has a matching entry in scripts/lib/test-quarantine.json with the
failing CI run link and quarantinedAt date. Tests will be deleted
after 14 days unless rescued with a root-cause fix.
This commit is contained in:
gsxdsm
2026-06-26 13:29:09 -07:00
parent 513882ecac
commit 9020f5774e
3 changed files with 100 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

73
scripts/lib/test-quarantine.json
View File

@@ -1,4 +1,75 @@
{
"$comment": "Flaky-test quarantine ledger (deletion ratchet — see AGENTS.md 'Flaky tests: quarantine on sight' and docs/testing.md 'Quarantine ledger and the deletion ratchet'). A test observed failing without a corresponding real bug is quarantined ON SIGHT: add an entry here AND a matching one-line `exclude` entry in that package's vitest config, in the same commit. Every entry needs a non-empty `reason` (link the failing run) and a `quarantinedAt` date — the entry expires 14 days later, at which point the test file is DELETED unless someone rescues it with evidence it catches real regressions plus a root-cause fix (never appeasement). There is deliberately no loader module and no automation around this file: it is a dated record, the vitest config exclude is the mechanism, and the sweep is policy executed by whoever touches the suite.",
"entries": []
"entries": [
{
"file": "packages/engine/src/__tests__/self-healing-fn-5488-fast-path-regressions.test.ts",
"reason": "Failing in CI full-suite shard 1/4: 'expected +0 to be 1' + 'this.store.parseFileScopeFromPrompt is not a function'. Run: https://github.com/Runfusion/Fusion/actions/runs/28206337202",
"quarantinedAt": "2026-06-25"
},
{
"file": "packages/engine/src/__tests__/in-review-merge-stall-deadlock-recovery.test.ts",
"reason": "Failing in CI full-suite shard 2/4: 'expected FN-5485 to be null'. Run: https://github.com/Runfusion/Fusion/actions/runs/28206337202",
"quarantinedAt": "2026-06-25"
},
{
"file": "packages/dashboard/app/components/__tests__/DevServerView.mobile.test.tsx",
"reason": "Failing in CI full-suite shard 4/4: 'expected +0 to be 1' (mobile CSS structure assertion). Run: https://github.com/Runfusion/Fusion/actions/runs/28206337202",
"quarantinedAt": "2026-06-25"
},
{
"file": "packages/engine/src/__tests__/reliability-interactions/lease-recovery-central-claim.test.ts",
"reason": "Failing in CI full-suite shard 1/4: mock call count mismatch. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
"quarantinedAt": "2026-06-26"
},
{
"file": "packages/engine/src/__tests__/reliability-interactions/owning-node-unavailable-interactions.test.ts",
"reason": "Failing in CI full-suite shard 1/4: mock call count mismatch. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
"quarantinedAt": "2026-06-26"
},
{
"file": "packages/engine/src/__tests__/reliability-interactions/todo-inprogress-flapping.test.ts",
"reason": "Failing in CI full-suite shard 1/4: mock call count and boolean assertion mismatches. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
"quarantinedAt": "2026-06-26"
},
{
"file": "packages/engine/src/__tests__/ce-workflow-step-conventions.test.ts",
"reason": "Failing in CI full-suite shard 1/4: dual-form CE skill resolution assertion mismatch. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
"quarantinedAt": "2026-06-26"
},
{
"file": "packages/engine/src/__tests__/executor-column-agent-principal.test.ts",
"reason": "Failing in CI full-suite shard 1/4: column agent model preservation assertion. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
"quarantinedAt": "2026-06-26"
},
{
"file": "packages/engine/src/__tests__/scheduler-ephemeral-toggle.test.ts",
"reason": "Failing in CI full-suite shard 1/4. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
"quarantinedAt": "2026-06-26"
},
{
"file": "packages/engine/src/__tests__/restart.integration.test.ts",
"reason": "Failing in CI full-suite shard 2/4: scheduler mock call count mismatches. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
"quarantinedAt": "2026-06-26"
},
{
"file": "packages/engine/src/__tests__/scheduler-node-unreachable-audit.test.ts",
"reason": "Failing in CI full-suite shard 2/4: expected undefined to be 'task:auto-recover-node-unreachable'. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
"quarantinedAt": "2026-06-26"
},
{
"file": "packages/engine/src/__tests__/scheduler-overlap-starvation.test.ts",
"reason": "Failing in CI full-suite shard 2/4. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
"quarantinedAt": "2026-06-26"
},
{
"file": "packages/engine/src/__tests__/user-configured-command-no-execsync.test.ts",
"reason": "Failing in CI full-suite shard 2/4. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
"quarantinedAt": "2026-06-26"
},
{
"file": "packages/cli/src/__tests__/extension.test.ts",
"reason": "Failing in CI full-suite shard 3/4: 'Target cannot be null or undefined' in fn_delegate_task test. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
"quarantinedAt": "2026-06-26"
}
]
}