## Summary Fixes shard 4 full-suite failures: chat_sessions schema baseline gap + two remaining PG auth bugs missed by PR #2086. **Scope: shard 4 only.** Shards 1/2 (engine timeouts) and shard 3 (compound-engineering CI-only failure) are separate issues not addressed here. ## Changes ### Schema baseline gap — `chat_sessions` missing columns (42703 error) - **`0000_initial.sql`**: Added `validator_thinking_level` and `planning_thinking_level` columns to `CREATE TABLE project.chat_sessions`. These exist in the Drizzle schema (`project.ts:1492-1493`) but were missing from the SQL baseline, causing `column does not exist` on all chat_sessions inserts in fresh test databases. - **`postgres-health.ts`**: Added both columns to `EXPECTED_PROJECT_COLUMNS` self-heal list so existing databases also get them via ALTER TABLE. **Fixes**: `chat-store-content-search-edit.pg.test.ts` (5 tests), `satellite-db-injected-stores.test.ts` (2 tests) ### Remaining auth bugs (password auth failed for user "runner") - **`allocator-cross-project.test.ts`**: Still had `process.env.USER` in inline adminExec — missed by PR #2086's batch fix. Replaced with `PG_TEST_URL_BASE` connection string. - **`connection.test.ts`**: Used `FUSION_PG_TEST_URL` (not set on CI) with a bare default URL lacking credentials. `postgres.js` fell back to OS user `runner`. Changed to derive from `FUSION_PG_TEST_URL_BASE` which includes credentials. **Fixes**: `allocator-cross-project.test.ts` (2 tests), `connection.test.ts` (3 tests) ## Verification | Check | Result | |---|---| | Merge gate (`pnpm test:gate`) | ✅ 294 + 114 + 63 = 471 passed | | chat-store-content-search-edit | ✅ 5 passed | | satellite-db-injected-stores | ✅ 10 passed | | allocator-cross-project | ✅ 2 passed | | connection | ✅ 13 passed | | Lint | ✅ exit 0 | | Typecheck | ✅ clean | ## Not in scope - **Shards 1/2**: Engine test suite timeouts with `getAsyncLayer`/`updateSettings` mock warnings. Pre-existing. - **Shard 3**: `compound-engineering stage-skill-loading.test.ts` — 14 tests fail on CI (`TypeError: Cannot read properties of undefined (reading 'close')`), pass locally. Likely CI-specific teardown issue. <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit * **New Features** * Added separate `validator_thinking_level` and `planning_thinking_level` fields to chat session data, including database schema and health-check recognition. * **Bug Fixes** * Improved PostgreSQL test connectivity by using configured connection URL settings instead of hardcoded local defaults. * Made Postgres-related test teardown null-safe to avoid failures when setup doesn’t complete. * **Tests** * Updated automated test quarantine/exclusions for known failing engine and reliability-interaction cases. <!-- end of auto-generated comment: release notes by coderabbit.ai -->
186 lines
15 KiB
JSON
186 lines
15 KiB
JSON
{
|
|
"$comment": "Flaky-test quarantine ledger (deletion ratchet — see AGENTS.md 'Flaky tests: quarantine on sight' and docs/testing.md 'Quarantine ledger and the deletion ratchet'). A test observed failing without a corresponding real bug is quarantined ON SIGHT: add an entry here AND a matching one-line `exclude` entry in that package's vitest config, in the same commit. Every entry needs a non-empty `reason` (link the failing run) and a `quarantinedAt` date — the entry expires 14 days later, at which point the test file is DELETED unless someone rescues it with evidence it catches real regressions plus a root-cause fix (never appeasement). There is deliberately no loader module and no automation around this file: it is a dated record, the vitest config is the enforcement.",
|
|
"entries": [
|
|
{
|
|
"file": "packages/cli/src/__tests__/extension-dist-barrel.test.ts",
|
|
"reason": "FN-7530 RESCUE-by-split of the prior extension.test.ts entry: the dist-barrel fn_task_list test timed out at 5000ms in the full-suite shard 4/4 (run https://github.com/Runfusion/Fusion/actions/runs/28697507894) while passing locally in ~1.2s and in 3 of the 4 surrounding CI runs. Root-cause invariant: the test does in-test module recompilation (vi.resetModules + vi.importActual of the full @fusion/core dist barrel + a fresh dynamic import of extension.js) inside the default 5s test timeout; that work is CPU-bound and degrades non-linearly under 4-shard CI contention (same loaded-lane signature as FN-6483/FN-6705/FN-6795/FN-6839). Widening the timeout is forbidden by the flaky-test rule and removing the recompilation removes the test's only point, so the file is quarantined pending a split into smaller compilation units.",
|
|
"quarantinedAt": "2026-07-04"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/backlog-pressure-reporter.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/cross-node-claim-mutex.integration.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/distributed-claim-mutex.integration.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/mission-autopilot.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/mission-factory-parity.integration.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/owning-node-handoff.integration.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/planner-overseer-intervention-wiring.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/project-engine.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/self-healing.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/unlinked-missions-advisory-reporter.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/workflow-graph-task-runner.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/agent-tools-intake-column.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/agent-workflow-tools-exposure.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/dependency-blocked-todo-reporter.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/executor-task-done-invariant.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/goal-injection-diagnostics-wiring.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/group-merge-coordinator.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/hybrid-executor-multi-node-routing.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/merger-cwd-fallback-removed.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/mission-autopilot-end-to-end.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/routine-runner.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/self-healing-meta-archive-guards.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/triage-token-usage.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/workflow-foreach-wiring.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: fails due to SQLite removal or sync API incompatibility in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/reliability-interactions/in-review-handoff-atomic.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: reliability fixture uses PG-backed store but sync APIs (getRunAuditEvents, getDatabase) fail in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/reliability-interactions/multi-node-claim-mutex-interactions.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: reliability fixture uses PG-backed store but sync APIs (getRunAuditEvents, getDatabase) fail in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/reliability-interactions/owning-node-unavailable-interactions.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: reliability fixture uses PG-backed store but sync APIs (getRunAuditEvents, getDatabase) fail in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/reliability-interactions/integration-worktree-state.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: reliability fixture uses PG-backed store but sync APIs (getRunAuditEvents, getDatabase) fail in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/reliability-interactions/explicit-duplicate-marker-sweep.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: reliability fixture uses PG-backed store but sync APIs (getRunAuditEvents, getDatabase) fail in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/reliability-interactions/self-defeating-dep-reconcile.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: reliability fixture uses PG-backed store but sync APIs (getRunAuditEvents, getDatabase) fail in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/reliability-interactions/dependency-cycle-reconcile.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: reliability fixture uses PG-backed store but sync APIs (getRunAuditEvents, getDatabase) fail in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/reliability-interactions/merge-runner-spawn-enoent-prevention.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: reliability fixture uses PG-backed store but sync APIs (getRunAuditEvents, getDatabase) fail in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/reliability-interactions/meta-archive-guard-composition.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: reliability fixture uses PG-backed store but sync APIs (getRunAuditEvents, getDatabase) fail in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/reliability-interactions/meta-chain-auto-close.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: reliability fixture uses PG-backed store but sync APIs (getRunAuditEvents, getDatabase) fail in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
},
|
|
{
|
|
"file": "packages/engine/src/__tests__/reliability-interactions/post-done-continuation-no-wedge.test.ts",
|
|
"reason": "VAL-REMOVAL-005 PG migration: reliability fixture uses PG-backed store but sync APIs (getRunAuditEvents, getDatabase) fail in backend mode. Failing run: https://github.com/Runfusion/Fusion/actions/runs/29344576232. Mirrored in packages/engine/vitest.config.ts.",
|
|
"quarantinedAt": "2026-07-14"
|
|
}
|
|
]
|
|
}
|