test: quarantine 11 failing CI full-suite tests
Quarantine test files consistently failing on the non-blocking full-suite CI on main, per the AGENTS.md deletion-ratchet policy: Engine-default (shard 1-2): ce-workflow-step-conventions, executor-column-agent-principal, restart.integration, scheduler-node-unreachable-audit, scheduler-overlap-starvation, scheduler-ephemeral-toggle, user-configured-command-no-execsync Engine-reliability (shard 1): lease-recovery-central-claim, owning-node-unavailable-interactions, todo-inprogress-flapping CLI (shard 3): extension.test.ts Each has a matching entry in scripts/lib/test-quarantine.json with the failing CI run link and quarantinedAt date. Tests will be deleted after 14 days unless rescued with a root-cause fix.
This commit is contained in:
gsxdsm
@@ -36,7 +36,11 @@ const quarantinedCliTests: string[] = [
|
||||
|
||||
FNXC:CliTests 2026-06-21-09:58:
|
||||
FN-6839 rescues the retained bin, extension-task-tools, and extension suites by awaiting async TaskStore/cache shutdown before temp-root cleanup and proving the grouped/package lanes can run unexcluded. Keep the exclude list empty in lockstep with scripts/lib/test-quarantine.json; do not re-quarantine this loaded-lane signature without a new root-cause invariant.
|
||||
|
||||
FNXC:CliTests 2026-06-26-09:30:
|
||||
extension.test.ts failing in CI full-suite shard 3/4: 'Target cannot be null or undefined' in fn_delegate_task test. Quarantine under deletion ratchet — see scripts/lib/test-quarantine.json.
|
||||
*/
|
||||
"src/__tests__/extension.test.ts",
|
||||
];
|
||||
|
||||
export default defineConfig({
|
||||
|
||||
@@ -124,6 +124,21 @@ export default defineConfig({
|
||||
FN-7068 rescued the 2026-06-25 self-healing quarantine batch by completing the local TaskStore fakes for the FN-5488 overlap path. Keep both files active in engine-default so fake drift around clearStaleBlockedBy() is caught before the deletion ratchet expires.
|
||||
*/
|
||||
/*
|
||||
FNXC:EngineTests 2026-06-26-09:30:
|
||||
Quarantine 7 engine-default files failing in CI full-suite run 28259456548:
|
||||
ce-workflow-step-conventions, executor-column-agent-principal, restart.integration,
|
||||
scheduler-node-unreachable-audit, scheduler-overlap-starvation,
|
||||
scheduler-ephemeral-toggle, user-configured-command-no-execsync.
|
||||
All under the deletion ratchet — see scripts/lib/test-quarantine.json.
|
||||
*/
|
||||
"src/__tests__/ce-workflow-step-conventions.test.ts",
|
||||
"src/__tests__/executor-column-agent-principal.test.ts",
|
||||
"src/__tests__/restart.integration.test.ts",
|
||||
"src/__tests__/scheduler-node-unreachable-audit.test.ts",
|
||||
"src/__tests__/scheduler-overlap-starvation.test.ts",
|
||||
"src/__tests__/scheduler-ephemeral-toggle.test.ts",
|
||||
"src/__tests__/user-configured-command-no-execsync.test.ts",
|
||||
/*
|
||||
FNXC:EngineTests 2026-06-16-19:05:
|
||||
FN-6492 verification caught cli-agent-executor as a package-lane-only flake: the hard-cancel assertion failed once and left an ENOTEMPTY temp hook directory, then the file passed in isolation. Quarantine the whole file under the deletion ratchet instead of weakening timing or process assertions.
|
||||
|
||||
@@ -150,6 +165,15 @@ export default defineConfig({
|
||||
exclude: [
|
||||
"src/**/*.slow.test.ts",
|
||||
/*
|
||||
FNXC:EngineTests 2026-06-26-09:30:
|
||||
Quarantine 3 reliability-interactions files failing in CI full-suite run 28259456548:
|
||||
lease-recovery-central-claim, owning-node-unavailable-interactions, todo-inprogress-flapping.
|
||||
All under the deletion ratchet — see scripts/lib/test-quarantine.json.
|
||||
*/
|
||||
"src/__tests__/reliability-interactions/lease-recovery-central-claim.test.ts",
|
||||
"src/__tests__/reliability-interactions/owning-node-unavailable-interactions.test.ts",
|
||||
"src/__tests__/reliability-interactions/todo-inprogress-flapping.test.ts",
|
||||
/*
|
||||
FNXC:EngineTests 2026-06-14-02:12:
|
||||
FN-6433 removed the reliability-interactions quarantine after deleting the duplicate soft-delete blocker residue file under the deletion ratchet; keep this project exclude list ledger-free unless a new flake is quarantined in lockstep.
|
||||
*/
|
||||
|
||||
@@ -1,4 +1,75 @@
|
||||
{
|
||||
"$comment": "Flaky-test quarantine ledger (deletion ratchet — see AGENTS.md 'Flaky tests: quarantine on sight' and docs/testing.md 'Quarantine ledger and the deletion ratchet'). A test observed failing without a corresponding real bug is quarantined ON SIGHT: add an entry here AND a matching one-line `exclude` entry in that package's vitest config, in the same commit. Every entry needs a non-empty `reason` (link the failing run) and a `quarantinedAt` date — the entry expires 14 days later, at which point the test file is DELETED unless someone rescues it with evidence it catches real regressions plus a root-cause fix (never appeasement). There is deliberately no loader module and no automation around this file: it is a dated record, the vitest config exclude is the mechanism, and the sweep is policy executed by whoever touches the suite.",
|
||||
"entries": []
|
||||
"entries": [
|
||||
{
|
||||
"file": "packages/engine/src/__tests__/self-healing-fn-5488-fast-path-regressions.test.ts",
|
||||
"reason": "Failing in CI full-suite shard 1/4: 'expected +0 to be 1' + 'this.store.parseFileScopeFromPrompt is not a function'. Run: https://github.com/Runfusion/Fusion/actions/runs/28206337202",
|
||||
"quarantinedAt": "2026-06-25"
|
||||
},
|
||||
{
|
||||
"file": "packages/engine/src/__tests__/in-review-merge-stall-deadlock-recovery.test.ts",
|
||||
"reason": "Failing in CI full-suite shard 2/4: 'expected FN-5485 to be null'. Run: https://github.com/Runfusion/Fusion/actions/runs/28206337202",
|
||||
"quarantinedAt": "2026-06-25"
|
||||
},
|
||||
{
|
||||
"file": "packages/dashboard/app/components/__tests__/DevServerView.mobile.test.tsx",
|
||||
"reason": "Failing in CI full-suite shard 4/4: 'expected +0 to be 1' (mobile CSS structure assertion). Run: https://github.com/Runfusion/Fusion/actions/runs/28206337202",
|
||||
"quarantinedAt": "2026-06-25"
|
||||
},
|
||||
{
|
||||
"file": "packages/engine/src/__tests__/reliability-interactions/lease-recovery-central-claim.test.ts",
|
||||
"reason": "Failing in CI full-suite shard 1/4: mock call count mismatch. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
|
||||
"quarantinedAt": "2026-06-26"
|
||||
},
|
||||
{
|
||||
"file": "packages/engine/src/__tests__/reliability-interactions/owning-node-unavailable-interactions.test.ts",
|
||||
"reason": "Failing in CI full-suite shard 1/4: mock call count mismatch. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
|
||||
"quarantinedAt": "2026-06-26"
|
||||
},
|
||||
{
|
||||
"file": "packages/engine/src/__tests__/reliability-interactions/todo-inprogress-flapping.test.ts",
|
||||
"reason": "Failing in CI full-suite shard 1/4: mock call count and boolean assertion mismatches. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
|
||||
"quarantinedAt": "2026-06-26"
|
||||
},
|
||||
{
|
||||
"file": "packages/engine/src/__tests__/ce-workflow-step-conventions.test.ts",
|
||||
"reason": "Failing in CI full-suite shard 1/4: dual-form CE skill resolution assertion mismatch. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
|
||||
"quarantinedAt": "2026-06-26"
|
||||
},
|
||||
{
|
||||
"file": "packages/engine/src/__tests__/executor-column-agent-principal.test.ts",
|
||||
"reason": "Failing in CI full-suite shard 1/4: column agent model preservation assertion. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
|
||||
"quarantinedAt": "2026-06-26"
|
||||
},
|
||||
{
|
||||
"file": "packages/engine/src/__tests__/scheduler-ephemeral-toggle.test.ts",
|
||||
"reason": "Failing in CI full-suite shard 1/4. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
|
||||
"quarantinedAt": "2026-06-26"
|
||||
},
|
||||
{
|
||||
"file": "packages/engine/src/__tests__/restart.integration.test.ts",
|
||||
"reason": "Failing in CI full-suite shard 2/4: scheduler mock call count mismatches. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
|
||||
"quarantinedAt": "2026-06-26"
|
||||
},
|
||||
{
|
||||
"file": "packages/engine/src/__tests__/scheduler-node-unreachable-audit.test.ts",
|
||||
"reason": "Failing in CI full-suite shard 2/4: expected undefined to be 'task:auto-recover-node-unreachable'. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
|
||||
"quarantinedAt": "2026-06-26"
|
||||
},
|
||||
{
|
||||
"file": "packages/engine/src/__tests__/scheduler-overlap-starvation.test.ts",
|
||||
"reason": "Failing in CI full-suite shard 2/4. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
|
||||
"quarantinedAt": "2026-06-26"
|
||||
},
|
||||
{
|
||||
"file": "packages/engine/src/__tests__/user-configured-command-no-execsync.test.ts",
|
||||
"reason": "Failing in CI full-suite shard 2/4. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
|
||||
"quarantinedAt": "2026-06-26"
|
||||
},
|
||||
{
|
||||
"file": "packages/cli/src/__tests__/extension.test.ts",
|
||||
"reason": "Failing in CI full-suite shard 3/4: 'Target cannot be null or undefined' in fn_delegate_task test. Run: https://github.com/Runfusion/Fusion/actions/runs/28259456548",
|
||||
"quarantinedAt": "2026-06-26"
|
||||
}
|
||||
]
|
||||
}
|
||||
|
||||
Reference in New Issue
Block a user