d8b80d0bfe
Quarantine compound-engineering timeout flakes from the broad test workflow. - Add the compound-engineering orchestrator and skill-wiring tests to the quarantine ledger. - Exclude the quarantined tests from the compound-engineering node Vitest project without changing timeouts or retries. - Document the quarantine requirement next to the Vitest excludes. Files changed: .../fusion-plugin-compound-engineering/vitest.config.ts | 15 ++++++++++++++- scripts/lib/test-quarantine.json | 10 ++++++++++ 2 files changed, 24 insertions(+), 1 deletion(-) Fusion-Task-Id: FN-6587 Fusion-Task-Lineage: 5aeb0202-8330-4a93-bdab-675c81b9cb54
26 lines
3.0 KiB
JSON
26 lines
3.0 KiB
JSON
{
|
|
"$comment": "Flaky-test quarantine ledger (deletion ratchet — see AGENTS.md 'Flaky tests: quarantine on sight' and docs/testing.md 'Quarantine ledger and the deletion ratchet'). A test observed failing without a corresponding real bug is quarantined ON SIGHT: add an entry here AND a matching one-line `exclude` entry in that package's vitest config, in the same commit. Every entry needs a non-empty `reason` (link the failing run) and a `quarantinedAt` date — the entry expires 14 days later, at which point the test file is DELETED unless someone rescues it with evidence it catches real regressions plus a root-cause fix (never appeasement). There is deliberately no loader module and no automation around this file: it is a dated record, the vitest config exclude is the mechanism, and the sweep is policy executed by whoever touches the suite.",
|
|
"entries": [
|
|
{
|
|
"file": "packages/dashboard/src/__tests__/github-tracking-hook.test.ts",
|
|
"reason": "FN-6496 merge verification: pnpm test failed in dashboard-api-quality-backfill with ENOTEMPTY while removing a temp task directory; isolated rerun of the file passed, so classify as unrelated cleanup flake. Failing command: pnpm test; confirming command: pnpm --filter @fusion/dashboard exec vitest run src/__tests__/github-tracking-hook.test.ts --reporter=dot --silent=passed-only.",
|
|
"quarantinedAt": "2026-06-16"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/cli-agent-executor.test.ts",
|
|
"reason": "FN-6492 verification observed the hard-cancel CLI session test fail only in the full @fusion/engine package lane (activeCliTaskSessions false plus ENOTEMPTY temp cleanup), while an immediate file-specific rerun passed; quarantined as a concurrency/temp-cleanup flake per the deletion ratchet.",
|
|
"quarantinedAt": "2026-06-16"
|
|
},
|
|
{
|
|
"file": "plugins/fusion-plugin-compound-engineering/src/__tests__/orchestrator-flow.test.ts",
|
|
"reason": "FN-6587 broad pnpm test investigation: this CE orchestrator file was reported as timing out at Vitest's 5000ms test limit only in the broad pnpm test workflow; isolated two-file repro and loaded compound-engineering-node runs passed, and the broad command hit its external 900s workflow timeout before reproducing the named CE timeout. Quarantined per deletion-ratchet policy without timeout bumps, retries, or assertion loosening.",
|
|
"quarantinedAt": "2026-06-17"
|
|
},
|
|
{
|
|
"file": "plugins/fusion-plugin-compound-engineering/src/__tests__/skill-wiring.test.ts",
|
|
"reason": "FN-6587 broad pnpm test investigation: this CE skill-wiring file was reported as timing out at Vitest's 5000ms test limit only in the broad pnpm test workflow; isolated two-file repro and loaded compound-engineering-node runs passed, and the broad command hit its external 900s workflow timeout before reproducing the named CE timeout. Quarantined per deletion-ratchet policy without timeout bumps, retries, or assertion loosening.",
|
|
"quarantinedAt": "2026-06-17"
|
|
}
|
|
]
|
|
}
|