Commit Graph

9 Commits

Author SHA1 Message Date
gsxdsm
6c2c880699 chore: refresh test velocity baseline and shard-timing snapshot post-trim
Measured wall times: gate 14.0s, boot smoke 20.4s (-6.3s), changed-only
pnpm test 17.5s; quarantine ledger 0. Shard-timing snapshot rebuilt
from today's CI shard artifacts (run 31929730933) plus a locally
measured full dashboard suite so dashboard lane weighting keeps its
per-file data. The trim shows: the former top-6 core PG offenders are
gone from the slowest-20 (sqlite-migrator 2m29s serial -> 20.4s;
SettingsModal.general off the table entirely). Caveat: the dashboard
rows come from the pre-trim analysis measurement, so entries like
SettingsModal.scheduling-merge (30.2s, now ~13s) are pessimistic until
the next dashboard re-measure.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-08-15 23:05:20 -07:00
gsxdsm
878db6dca7 FN-8951: repair script-test governance drift
Keep test-shard timing governance aligned with the current workspace and workflow seams.

- Add a safe timing-snapshot pruning mode with coverage.
- Align Todo plugin Vitest isolation and Docker dependency manifests.
- Refresh workflow reliability evidence and remove deleted test timings.

Files changed:
 Dockerfile                                         |  7 ++-
 docs/testing.md                                    |  9 ++-
 plugins/fusion-plugin-todos/vitest.config.ts       | 26 ++++++--
 scripts/__tests__/ci-test-shard-timings.test.mjs   | 71 ++++++++++++++++++++++
 scripts/ci-test-shard.mjs                          | 65 ++++++++++++++++++--
 .../lib/workflow-reliability-release-check.json    | 22 +++----
 scripts/test-timings.json                          | 21 -------
 7 files changed, 175 insertions(+), 46 deletions(-)

Fusion-Task-Id: FN-8951

Fusion-Task-Lineage: fbf7e79f-4cb2-43e2-9982-09f3f94de70d

Co-authored-by: Fusion (runfusion.ai) <noreply@runfusion.ai>
2026-08-10 12:09:20 -07:00
gsxdsm
49fb39e644 fix(ci): prune six phantom paths from the shard-timing snapshot, red on main since their features died (#3040)
## Six phantom paths in the shard-timing snapshot

```
AssertionError: timing snapshot references missing test files:
packages/core/src/__tests__/dependency-blocked-todo-report.test.ts
packages/core/src/__tests__/workflow-parity.test.ts
packages/engine/src/__tests__/dependency-blocked-todo-reporter.test.ts
packages/engine/src/__tests__/reliability-interactions/meta-archive-guard-composition.test.ts
packages/engine/src/__tests__/reliability-interactions/meta-chain-auto-close.test.ts
packages/engine/src/__tests__/self-healing-meta-archive-guards.test.ts
```

The guard's own note says why this matters past the red assertion:
*"stale or phantom-path entries silently degrade CI shard balancing and
can hide merge-gate regressions."*

**The balancing cost is not academic.**
`self-healing-meta-archive-guards` carried **20700 ms**. A shard has
been budgeting 20.7 seconds for a file that cannot run, plus five more.

## Deleted, not moved — checked one at a time

A moved test should be **repointed** to keep its measurement; only a
deleted one should be dropped. So I resolved each rather than assuming:

| file | deleted by |
| --- | --- |
| `dependency-blocked-todo-report` / `-reporter` | `710d56b2db` — U4
trim, the feature deletion |
| `workflow-parity` | `4158cf1ab7` — Phase A workflow-owned lifecycle |
| `meta-archive-guard-composition`, `meta-chain-auto-close`,
`self-healing-meta-archive-guards` | `0e3d2a2265` — meta-task
auto-archive/auto-close deletion |

All six died with their features. None has a surviving equivalent
anywhere in `packages/`.

## Pruned, not regenerated

Regenerating means a full measured suite run and rewrites all 2499
entries — burying six deletions inside a wholesale diff nobody can
review. `capturedAt` is **6.8 days old against a 30-day budget**, so the
snapshot is otherwise current and the other **2493 measurements are
untouched**.

The diff is exactly six deleted lines, `capturedAt` unchanged.

## Revert proof

Pruning a list is worthless if the assertion cannot fail afterwards, so
I re-introduced a phantom entry:

```
with a fake path   →  ℹ pass 11   ℹ fail 1   (references missing test files)
removed            →  ℹ pass 12   ℹ fail 0
```

## Third of the red suites, and still not a sweep

Mechanical, like `verify-fast` (#3038). Unlike
`workflow-reliability-release-check`, whose acceptance map cites 13 test
files with **8 missing** and **2 of 5 rows carrying zero surviving
evidence** — that one needs its owner, and a repoint would launder the
gap (diagnosed on #3036).

Same failure phrasing, opposite safety. That is why these are going one
at a time.

## Verification (measured)

- this suite — **12 passed / 0 failed** (was 1 failed)
- snapshot integrity — 2493 files retained, `capturedAt` unchanged, no
reformatting

No changeset: CI tooling data.
2026-07-31 02:05:51 -07:00
gsxdsm
6166b496e4 FN-8559: refresh test timing snapshots
Refresh timing data and keep velocity reports aligned with the current snapshot.

- Attribute CI timing reports from absolute checkout paths
- Render report-only slowest tests from the latest timing snapshot
- Update timing snapshot data and regression coverage

Files changed:
 scripts/__tests__/ci-test-shard-timings.test.mjs  |    9 +
 scripts/__tests__/test-velocity-baseline.test.mjs |   38 +
 scripts/ci-test-shard.mjs                         |   13 +
 scripts/test-timings.json                         | 2522 +++++++++++++--------
 scripts/test-velocity-baseline.mjs                |   33 +-
 5 files changed, 1616 insertions(+), 999 deletions(-)

Fusion-Task-Id: FN-8559

Fusion-Task-Lineage: 09ed6b78-f82f-4732-a5e3-1066efe385b3

Co-authored-by: Fusion (runfusion.ai) <noreply@runfusion.ai>
2026-07-24 06:21:53 -07:00
gsxdsm
4178e7d325 FN-7415: Delete stale executor pause quarantine
Delete the expired executor pause quarantine and its stale direct-dispatch coverage.

- Remove the obsolete executor-pause test suite after the graph runtime cutover.
- Clear the matching Vitest exclude and quarantine-ledger entry.
- Refresh test audit, timing, line-count, and planning references for the deleted suite.

Files changed:
 ...7-001-refactor-workflow-runtime-cutover-plan.md |    2 +-
 docs/test-value-audit.json                         |  102 -
 .../engine/src/__tests__/executor-pause.test.ts    | 3061 --------------------
 packages/engine/vitest.config.ts                   |    5 -
 scripts/__tests__/test-velocity-baseline.test.mjs  |    2 +-
 scripts/lib/test-quarantine.json                   |    8 +-
 scripts/line-count-baseline.json                   |    1 -
 scripts/test-timings.json                          |    1 -
 8 files changed, 3 insertions(+), 3179 deletions(-)

Fusion-Task-Id: FN-7415
Fusion-Task-Lineage: 3d1551c8-1353-47cb-a70f-d88e733a6652
Co-authored-by: Fusion (runfusion.ai) <noreply@runfusion.ai>
2026-07-02 11:38:31 -07:00
gsxdsm
1f49cea6c0 FN-7092: refresh test velocity snapshots
Refresh the weekly test velocity baseline after the pnpm test lane recovered.

- Update the latest baseline with green gate, boot smoke, and pnpm test timings.
- Drop stale timing rows for removed or split test files.
- Append the new weekly history entry with current slowest-file data.

Files changed:
 docs/test-velocity-baseline.md     |  48 +++++++---------
 scripts/test-timings.json          |  14 +----
 scripts/test-velocity-history.json | 112 +++++++++++++++++++++++++++++++++++++
 3 files changed, 133 insertions(+), 41 deletions(-)

Fusion-Task-Id: FN-7092

Fusion-Task-Lineage: 0b2cfa7a-953b-4cf8-ac4b-c81a0580a4e0

Co-authored-by: Fusion (runfusion.ai) <noreply@runfusion.ai>
2026-06-27 09:28:29 -07:00
gsxdsm
193532bd2b FN-6968: refresh test timing snapshots
Refresh the weekly test velocity baseline with current timing evidence.

- Update the rendered baseline report with the latest capture timestamps and velocity deltas.
- Replace stale slowest-file timing rows with the refreshed snapshot entries.
- Append the latest velocity history sample used by the weekly report.

Files changed:
 docs/test-velocity-baseline.md     |   61 +-
 scripts/test-timings.json          | 1772 +++++++++++++++++++++++++++++-------
 scripts/test-velocity-history.json |  112 +++
 3 files changed, 1580 insertions(+), 365 deletions(-)

Fusion-Task-Id: FN-6968

Fusion-Task-Lineage: 940f3581-3650-4feb-8730-d6dbb760e30c
2026-06-24 23:32:52 -07:00
gsxdsm
918da22bfe FN-5969: remove obsolete cwd fallback timing entry
Clean up stale test timing metadata after the cwd fallback test removal.

- remove the obsolete timing entry for cwd-integration-fallback-removed.test.ts
- keep scripts/test-timings.json aligned with the current reliability-interactions test set

Files changed:
 scripts/test-timings.json | 1 -
 1 file changed, 1 deletion(-)

Fusion-Task-Id: FN-5969

Fusion-Task-Lineage: 8e8541a6-6198-4472-a40a-1161cc8443bd
2026-06-07 18:51:46 -07:00
gsxdsm
c69d384e67 perf(test): add timing telemetry, cold-start probe, and baseline snapshot
- ci-test-shard.mjs: --write-timings aggregation into scripts/test-timings.json (bucketed, newer-snapshot-protected, corrupt-shard tolerant) and --cold-start-probe; CI shard invocations emit vitest json timings
- test-changed.mjs: structured mode/reason telemetry line (+ --print-mode)
- pr-checks.yml: upload per-shard timing artifacts
- baseline: docs/test-speed-baseline-2026-06-03.md (core 41s, engine 179s, cli 49s; cold-start ~1.3-1.8s/process => U8 gate: worthwhile-not-urgent)
2026-06-03 16:48:50 -07:00