gsxdsm 294209f64b FN-5943: maintain tasks FTS5 indexes automatically ...

Keep the tasks FTS5 index compact and self-healing during routine maintenance.

- add FTS5 trigger helpers, index sizing utilities, and a schema migration that skips no-op searchable-field rewrites
- run merge/optimize/rebuild maintenance from self-healing with thresholds, cadence, and run-audit logging
- add focused FTS maintenance coverage and update storage/architecture docs for the new behavior

Files changed:
 docs/architecture.md                               |   1 +
 docs/storage.md                                    |  14 ++
 packages/core/src/__tests__/db-migrate.test.ts     |  50 ++--
 packages/core/src/__tests__/db.test.ts             |  84 +++----
 packages/core/src/__tests__/goals-schema.test.ts   |   2 +-
 packages/core/src/__tests__/insight-store.test.ts  |  10 +-
 .../src/__tests__/merge-request-record.test.ts     |   2 +-
 packages/core/src/__tests__/mission-store.test.ts  |   2 +-
 packages/core/src/__tests__/run-audit.test.ts      |   2 +-
 .../src/__tests__/store-archive-search.test.ts     |  33 +++
 .../core/src/__tests__/store-merge-queue.test.ts   |   2 +-
 packages/core/src/__tests__/task-documents.test.ts |   2 +-
 packages/core/src/archive-db.ts                    |   6 +-
 packages/core/src/db.ts                            | 162 ++++++++++---
 packages/core/src/store.ts                         |  16 ++
 .../engine/src/__tests__/fts-maintenance.test.ts   | 268 +++++++++++++++++++++
 packages/engine/src/self-healing.ts                |  70 ++++++
 .../src/store/__tests__/roadmap-store.test.ts      |   4 +-
 18 files changed, 622 insertions(+), 108 deletions(-)

Fusion-Task-Id: FN-5943

Fusion-Task-Lineage: 9a851ede-95ee-4b76-bc34-737912f0e3fc

2026-06-07 18:51:46 -07:00

..

__tests__

FN-5943: maintain tasks FTS5 indexes automatically

2026-06-07 18:51:46 -07:00

auto-recovery-handlers

fix(engine): un-deadcode bootstrap-misbinding auto-recovery fallback

2026-05-23 02:29:38 -07:00

cli-agent

fix(review): schema-version gate, output-filter escape-bypass, generic double-wrap, follow-up resolution

2026-06-05 03:41:54 -07:00

experiment

FN-5782: wire branch groups into merge routing

2026-05-31 13:50:23 -07:00

external-integrations

feat(FN-5321): add evidence gap detector for external integration manifests

2026-05-20 15:54:44 -07:00

ipc

FN-5703: forward task:deleted events through in-process runtime

2026-05-29 20:05:14 -07:00

notification

FN-5924: throttle OAuth expiry alerts across restarts

2026-06-02 23:13:16 -07:00

providers

FN-5638: migrate pi-ai and pi-coding-agent packages to @earendil-works scope

2026-05-28 21:23:48 -07:00

recovery

feat(FN-5349): add integration branch resolver with auto-recovery fallback

2026-05-21 12:04:58 -07:00

remote-access

feat(FN-5189): complete Step 3 — migrate supervised spawns

2026-05-19 17:19:02 -07:00

research

fix: Replace htmlUrl with url in gh search repos query

2026-05-23 22:09:25 -03:00

runtimes

merge: main (workflow editor 109 / cli_sessions 110-111 / workflow_settings 112) — renumber PR-entity migration to 113, union core exports, TaskCard prNode + cliSessionState badges, executor PrNodeDeps + CliAgentRuntime options

2026-06-05 23:06:46 -07:00

sandbox

feat(FN-5189): complete Step 3 — migrate supervised spawns

2026-05-19 17:19:02 -07:00

spec-validation

feat(FN-5321): add evidence gap detector for external integration manifests

2026-05-20 15:54:44 -07:00

test

…

types/node-pty

feat(engine): extract shared PTY native-asset loader and redactSecrets (U16)

2026-06-04 22:53:02 -07:00

active-session-registry.ts

fix(FN-5256): keep live task worktrees through pause/resume races

2026-05-21 09:06:23 -07:00

agent-action-gate.ts

…

agent-assignment.ts

FN-5941: stop missions stalling on incompatible/custom-role agents

2026-06-03 17:14:42 -07:00

agent-heartbeat.ts

feat(engine): effective column agent becomes the execution principal

2026-06-05 00:19:13 -07:00

agent-instructions.ts

…

agent-logger.ts

…

agent-memory-index.ts

…

agent-reflection.ts

…

agent-runtime.ts

FN-5638: migrate pi-ai and pi-coding-agent packages to @earendil-works scope

2026-05-28 21:23:48 -07:00

agent-self-improve.ts

…

agent-session-helpers.ts

FN-5638: migrate pi-ai and pi-coding-agent packages to @earendil-works scope

2026-05-28 21:23:48 -07:00

agent-tools.ts

merge: main (editor consolidation #1433, fast-tests, learnings) — renumber workflow_settings migration to 110, settings panel joins the sidebar disclosures, full-workspace literal sweep

2026-06-05 15:23:15 -07:00

already-merged-detector.ts

fix(FN-branch-group): address PR review feedback (#1357)

2026-06-03 13:51:13 -07:00

auth-storage.ts

FN-5924: throttle OAuth expiry alerts across restarts

2026-06-02 23:13:16 -07:00

auto-claim-snapshot.ts

fix(FN-5137): complete Step 2-3 — guard deleted tasks in snapshot and executor

2026-05-19 07:45:12 -07:00

auto-recovery.ts

feat(FN-5348): remove cwd-main integration mode fallback

2026-05-21 12:49:50 -07:00

backlog-pressure-reporter.ts

feat(FN-5009): merge fusion/fn-5009

2026-05-18 12:31:21 -07:00

base-commit-capture.ts

fix(engine): capture baseCommitSha against local main, not origin/main

2026-06-03 15:24:03 -07:00

branch-attribution.ts

fix(FN-5304): guard against silent no-op landed-file attribution mismatches

2026-05-20 08:23:40 -07:00

branch-autocorrect.ts

fix(FN-5456): tidy autocorrect shell quoting and disambiguate checkout

2026-05-23 00:03:12 -07:00

branch-conflicts.ts

fix: treat origin/main commits as integrated contamination base

2026-05-30 15:15:47 -07:00

cli-agent-validator.ts

feat(engine): cli-agent one-shot sessions for validator, planning, and CE (U9)

2026-06-05 00:15:57 -07:00

code-node-runner.ts

fix: address PR review feedback (#1424)

2026-06-04 16:16:50 -07:00

concurrency.ts

feat(engine): in-txn capacity enforcement + generalized hold/release sweep with reservation-first ordering (U6)

2026-06-04 01:22:56 -07:00

context-limit-detector.ts

…

cron-runner.ts

…

custom-providers.ts

FN-5833: fix custom Responses API model lookup

2026-06-01 08:23:02 -07:00

dependency-blocked-todo-reporter.ts

fix(FN-5091): harden maxAutoMergeRetries settings parsing

2026-05-19 03:21:18 -07:00

effective-node.ts

…

effective-settings.ts

feat(engine): per-task effective workflow settings — resolver, two-tier entry merge, fallback alignment

2026-06-04 22:37:51 -07:00

engine-singleton-lock.ts

feat(engine): guard one engine per project per machine

2026-05-19 22:50:39 -07:00

ephemeral-worker-manager.ts

…

error-classifier.ts

…

eval-followups.ts

feat(FN-5232): add deterministic verification-followup deduplication to pre

2026-05-19 19:28:05 -07:00

evaluator-evidence.ts

FN-5697: retry transient auto-merge failures and fix migration versioning

2026-05-29 10:23:59 -07:00

evaluator.ts

…

executor.ts

merge: main (workflow editor 109 / cli_sessions 110-111 / workflow_settings 112) — renumber PR-entity migration to 113, union core exports, TaskCard prNode + cliSessionState badges, executor PrNodeDeps + CliAgentRuntime options

2026-06-05 23:06:46 -07:00

experiment-executor.ts

…

fallback-model-observer.ts

…

gating-classifications.ts

FN-5764: expose mission assertion backfill through API and CLI

2026-05-31 08:32:01 -07:00

goal-anchoring-audit.ts

FN-5758: add cited-goal audit aggregation and runtime route

2026-05-30 22:53:24 -07:00

goal-context-injector.ts

FN-5651: add single-seam goal-context injector for system prompts

2026-05-29 07:11:00 -07:00

goal-injection-diagnostics.ts

FN-5959: bridge task goal provenance from mission links

2026-06-03 15:32:29 -07:00

gridlock-detector.ts

…

group-merge-coordinator.ts

fix(FN-branch-group): repair CI failures — execFile mock compatibility, TaskCard narrowing, e2e memo race

2026-06-03 17:57:00 -07:00

heartbeat-procedure-resolver.ts

…

heartbeat-prompt-trim.ts

…

hold-release.ts

fix(core): shared workflow-IR resolver, prod branch persistence + pruning, latest-run JOIN, sweep reservation-leak fix (#1402 #1407 #1412 #1413)

2026-06-04 07:34:02 -07:00

hybrid-executor-gate.ts

perf(dashboard): speed up startup and eliminate API request storms

2026-05-26 21:57:31 -07:00

hybrid-executor.ts

feat(FN-4813): complete Step 5 — add isolation transition runtime restart path

2026-05-16 17:31:09 -07:00

index.ts

refactor(workflow): add workflow task runtime facade

2026-06-07 17:42:43 -07:00

integration-branch.ts

feat(FN-5349): add integration branch resolver with auto-recovery fallback

2026-05-21 12:04:58 -07:00

interactive-ai-session.ts

feat(engine): cli-agent one-shot sessions for validator, planning, and CE (U9)

2026-06-05 00:15:57 -07:00

logger.ts

feat(pr): node-agnostic PR reconcile + hold-release firing (U4)

2026-06-05 20:05:29 -07:00

merge-trait.ts

fix(core): shared workflow-IR resolver, prod branch persistence + pruning, latest-run JOIN, sweep reservation-leak fix (#1402 #1407 #1412 #1413)

2026-06-04 07:34:02 -07:00

merger-ai.ts

FN-5874: persist fast-forward merge details

2026-06-02 08:35:47 -07:00

merger-audit-recovery.ts

…

merger-auto-prerebase.ts

fix(FN-5627): always rebase behind branches before squash (safety fallback)

2026-05-28 15:04:41 -07:00

merger-bare-subject.ts

fix(engine): harden merge finalize SQLite bind and recover bare merge subjects

2026-05-26 21:57:31 -07:00

merger-diff-volume-gate.ts

…

merger-integration-worktree.ts

fix(merger): harden reuse-handoff autostash against shell injection and edit loss

2026-05-22 14:44:21 -07:00

merger-orphan-rehome.ts

feat(merger): auto-rehome FF-recoverable orphan commits in contamination recovery

2026-05-23 09:59:50 -07:00

merger-overlap-guard.ts

…

merger-ref-update-advance.ts

fix(FN-5627): close merger TOCTOU + add fast-path reachability gate

2026-05-28 13:02:30 -07:00

merger-scope-auto-widen.ts

feat(FN-5226): add scope auto-widen layer 2.5 to merger for attribution-bas

2026-05-21 16:30:31 -07:00

merger-squash-audit.ts

…

merger.ts

feat(engine): per-task effective workflow settings — resolver, two-tier entry merge, fallback alignment

2026-06-04 22:37:51 -07:00

mesh-lease-manager.ts

fix(FN-4826): complete Step 6 — stabilize audit emission and tests

2026-05-16 23:45:17 -07:00

mission-autopilot.ts

FN-5941: stop missions stalling on incompatible/custom-role agents

2026-06-03 17:14:42 -07:00

mission-execution-loop.ts

feat(engine): per-task effective workflow settings — resolver, two-tier entry merge, fallback alignment

2026-06-04 22:37:51 -07:00

mission-feature-sync.ts

FN-5715: gate mission feature completion on assertion validation

2026-05-30 09:43:02 -07:00

node-dispatch-validation.ts

…

node-health-monitor.ts

…

node-routing-policy.ts

feat(FN-4813): complete Step 3 — add owning-node handoff policy

2026-05-16 17:31:09 -07:00

notifier.ts

FN-5634: fix ntfy JSON publish priority mapping

2026-05-28 21:17:02 -07:00

peer-exchange-service.ts

…

permanent-agent-gating.ts

…

pi.ts

FN-5941: stop missions stalling on incompatible/custom-role agents

2026-06-03 17:14:42 -07:00

plugin-parser-adapter.ts

feat(engine): U12e+U14 — parse-steps node handler, plugin parser adapter, code node runner (esbuild + child-process harness)

2026-06-04 12:44:43 -07:00

plugin-runner.ts

feat(engine): U12e+U14 — parse-steps node handler, plugin parser adapter, code node runner (esbuild + child-process harness)

2026-06-04 12:44:43 -07:00

plugin-trait-adapter.ts

fix(core): shared workflow-IR resolver, prod branch persistence + pruning, latest-run JOIN, sweep reservation-leak fix (#1402 #1407 #1412 #1413)

2026-06-04 07:34:02 -07:00

pr-comment-handler.ts

feat(FN-5232): add deterministic verification-followup deduplication to pre

2026-05-19 19:28:05 -07:00

pr-monitor-gh.ts

…

pr-monitor.ts

…

pr-nodes.ts

fix(lint): empty-interface PrSourceDescriptor → type alias, drop unused eslint-disable directives

2026-06-06 00:15:28 -07:00

pr-reconcile.ts

feat(pr): node-agnostic PR reconcile + hold-release firing (U4)

2026-06-05 20:05:29 -07:00

pr-response-run-ops.ts

fix(review): apply autofix feedback

2026-06-05 22:49:39 -07:00

pr-response-run.ts

feat(pr): security-hardened review-response run — pr-respond body (U5)

2026-06-05 20:20:25 -07:00

project-engine-manager.ts

feat(pr): node-agnostic PR reconcile + hold-release firing (U4)

2026-06-05 20:05:29 -07:00

project-engine.ts

merge: main (workflow editor 109 / cli_sessions 110-111 / workflow_settings 112) — renumber PR-entity migration to 113, union core exports, TaskCard prNode + cliSessionState badges, executor PrNodeDeps + CliAgentRuntime options

2026-06-05 23:06:46 -07:00

project-manager.ts

FN-5703: forward task:deleted events through in-process runtime

2026-05-29 20:05:14 -07:00

project-runtime.ts

merge: main (workflow editor 109 / cli_sessions 110-111 / workflow_settings 112) — renumber PR-entity migration to 113, union core exports, TaskCard prNode + cliSessionState badges, executor PrNodeDeps + CliAgentRuntime options

2026-06-05 23:06:46 -07:00

prompt-layers.ts

FN-5653: inject active goal context into heartbeat and executor prompts

2026-05-29 20:05:14 -07:00

pty-native.ts

feat(engine): extract shared PTY native-asset loader and redactSecrets (U16)

2026-06-04 22:53:02 -07:00

rate-limit-retry.ts

…

recovery-policy.ts

…

research-dispatcher.ts

…

research-orchestrator.ts

…

research-step-runner.ts

…

restart-recovery-coordinator.ts

perf(dashboard): cache gh CLI checks and defer SQLite integrity scan

2026-05-26 23:41:28 -07:00

retry-burned-logger.ts

…

reviewer.ts

feat(engine): per-task effective workflow settings — resolver, two-tier entry merge, fallback alignment

2026-06-04 22:37:51 -07:00

room-ambiguity.ts

feat(FN-4861): merge fusion/fn-4861

2026-05-17 02:08:01 -07:00

room-coordination.ts

feat(FN-5425): add coordination notice system for multi-agent room task fil

2026-05-21 00:17:33 -07:00

routine-runner.ts

test(FN-4689): complete Step 2 — add routine sandbox audit tests

2026-05-15 16:38:45 -07:00

routine-scheduler.ts

…

run-audit.ts

feat(engine): merge trait — enqueue-only orchestration, workflow-configurable strategy/fileScope, lost-work guards non-configurable (U7)

2026-06-04 01:03:34 -07:00

run-verification-tool.ts

FN-5638: migrate pi-ai and pi-coding-agent packages to @earendil-works scope

2026-05-28 21:23:48 -07:00

runtime-resolution.ts

FN-5638: migrate pi-ai and pi-coding-agent packages to @earendil-works scope

2026-05-28 21:23:48 -07:00

scheduler.ts

FN-5960: add unlinked mission advisory reporting

2026-06-07 18:51:46 -07:00

secrets-env-writer.ts

chore: minor cleanups — docs index, test-project fixture, empty catches, triage timestamp guard

2026-05-19 14:22:11 -07:00

self-healing.ts

FN-5943: maintain tasks FTS5 indexes automatically

2026-06-07 18:51:46 -07:00

session-skill-context.ts

…

session-token-usage.ts

FN-5638: migrate pi-ai and pi-coding-agent packages to @earendil-works scope

2026-05-28 21:23:48 -07:00

shell-utils.ts

…

skill-resolver.ts

FN-5638: migrate pi-ai and pi-coding-agent packages to @earendil-works scope

2026-05-28 21:23:48 -07:00

smart-pull.ts

feat(engine): export smartPull() library for stash-aware fast-forward

2026-05-23 14:26:57 -07:00

spec-staleness.ts

fix(engine): preserve parked progress through stale-spec checks

2026-05-30 21:53:00 -07:00

stale-task-reporter.ts

…

step-integration.ts

fix(review): apply code-review fixes — runId/foreachNodeId wiring, worktree-leak cleanup, rework re-execution, instance pruning, SIGKILL fallback, type dedup, board memo split, agent-native field-schema context + fn_workflow_get

2026-06-04 14:01:55 -07:00

step-runner.ts

feat(engine,core): U5+U6+U12core — step-review verdict handler, graph-source projection discipline, pluggable step-parser registry

2026-06-04 12:26:05 -07:00

step-session-executor.ts

feat(engine): execute and step-execute sessions run as the column agent

2026-06-05 00:05:02 -07:00

streaming-delta.ts

FN-5803: normalize streamed sentence spacing across message boundaries

2026-05-31 23:24:53 -07:00

stuck-task-detector.ts

feat(engine): cli-agent resume coordinator and self-healing integration (U8)

2026-06-05 00:16:14 -07:00

task-agent-sync.ts

…

task-completion.ts

…

token-budget-enforcer.ts

…

token-cap-detector.ts

FN-5638: migrate pi-ai and pi-coding-agent packages to @earendil-works scope

2026-05-28 21:23:48 -07:00

tool-availability.ts

FN-5638: migrate pi-ai and pi-coding-agent packages to @earendil-works scope

2026-05-28 21:23:48 -07:00

transient-error-detector.ts

FN-5866: suppress post-done non-continuable session errors

2026-06-02 01:48:26 -07:00

transient-merge-error-classifier.ts

fix(FN-5627): suppress ntfy notifications for transient merge failures the engine auto-recovers

2026-05-28 15:39:23 -07:00

triage-preflight.ts

fix(FN-4892): harden intake auto-archive fail-open behavior

2026-05-18 00:53:23 -07:00

triage.ts

feat(engine): per-task effective workflow settings — resolver, two-tier entry merge, fallback alignment

2026-06-04 22:37:51 -07:00

unlinked-missions-advisory-reporter.ts

FN-5960: add unlinked mission advisory reporting

2026-06-07 18:51:46 -07:00

usage-limit-detector.ts

…

verification-followup-dedup.ts

feat(FN-5232): add deterministic verification-followup deduplication to pre

2026-05-19 19:28:05 -07:00

verification-utils.ts

feat(FN-4643): complete Step 4 — delegate verification streaming to sandbox backend

2026-05-15 12:12:50 -07:00

web-fetch.ts

…

workflow-graph-branches.ts

fix(core): shared workflow-IR resolver, prod branch persistence + pruning, latest-run JOIN, sweep reservation-leak fix (#1402 #1407 #1412 #1413)

2026-06-04 07:34:02 -07:00

workflow-graph-executor.ts

feat(pr): top-level bounded rework + auto-merge gate + legacy-bypass pin (U6)

2026-06-05 20:32:24 -07:00

workflow-graph-foreach.ts

merge: main (workflow editor 109 / cli_sessions 110-111 / workflow_settings 112) — renumber PR-entity migration to 113, union core exports, TaskCard prNode + cliSessionState badges, executor PrNodeDeps + CliAgentRuntime options

2026-06-05 23:06:46 -07:00

workflow-graph-task-runner.ts

feat(pr): pr-create/pr-respond/pr-merge node kinds + handlers (U3)

2026-06-05 19:55:31 -07:00

workflow-node-handlers.ts

merge: main (workflow editor 109 / cli_sessions 110-111 / workflow_settings 112) — renumber PR-entity migration to 113, union core exports, TaskCard prNode + cliSessionState badges, executor PrNodeDeps + CliAgentRuntime options

2026-06-05 23:06:46 -07:00

workflow-parity-observer.ts

FN-5768: add dual-observe workflow parity instrumentation

2026-05-31 08:32:01 -07:00

workflow-step-tool-policy.ts

FN-5638: migrate pi-ai and pi-coding-agent packages to @earendil-works scope

2026-05-28 21:23:48 -07:00

workflow-task-runtime.ts

fix(FN-6021): align workflow runtime fallback run ids

2026-06-07 17:59:24 -07:00

worktree-acquisition.ts

FN-5818: fix shared-branch-group execution to use per-task working branches

2026-06-01 01:37:25 -07:00

worktree-backend.ts

feat(FN-5519): merge fusion/fn-5519

2026-05-22 22:43:26 -07:00

worktree-db-hydrate.ts

feat(FN-5128): complete Step 2 — add soft-delete guard to hydration

2026-05-19 05:57:57 -07:00

worktree-desktop-artifacts.ts

feat(FN-4938): complete Step 2 — add helper and wire cleanup

2026-05-18 01:50:22 -07:00

worktree-hooks.ts

feat(FN-5519): merge fusion/fn-5519

2026-05-22 22:43:26 -07:00

worktree-names.ts

feat(engine): U10 — parallel step execution: dependency scheduler, per-instance worktrees, ordered integration, conflict→rework (KTD-11)

2026-06-04 13:04:15 -07:00

worktree-paths.ts

feat(FN-4623): complete Step 3 — add backend-aware path resolution

2026-05-15 19:37:48 -07:00

worktree-pool.ts

fix(ci): widen Column to ColumnId in plugins + drop unused import after #1403 widening

2026-06-04 08:40:10 -07:00

worktree-prune.ts

feat(FN-5058): merge fusion/fn-5058

2026-05-18 11:01:32 -07:00

worktree-ref-sync.ts

fix(engine,dashboard): close 7 review findings on merger auto-sync

2026-05-23 15:13:17 -07:00

worktree-stale-lock.ts

feat(FN-4830): complete Step 1 — add stale lock helper

2026-05-16 20:54:33 -07:00

worktree-stale-registration.ts

feat(FN-5063): merge fusion/fn-5063

2026-05-18 15:51:01 -07:00

worktrunk-failure-handler.ts

feat(FN-4626): complete Step 5 — align worktrunk failure payload shape

2026-05-15 22:18:09 -07:00

worktrunk-installer.ts

feat(FN-5321): add evidence gap detector for external integration manifests

2026-05-20 15:54:44 -07:00