FN-7420: fix test velocity quarantine reporting
Refresh the test velocity baseline and coverage so quarantine counts come from the live ledger.\n\n- Update the weekly baseline report to show zero active quarantines and a neutral delta.\n- Strengthen the report-only regression test to cover stale report and history quarantine values.\n- Document the FN-7420 requirement near the regression scenario.\n\nFiles changed:\n docs/test-velocity-baseline.md | 10 +++++-----\n scripts/__tests__/test-velocity-baseline.test.mjs | 10 +++++++---\n 2 files changed, 12 insertions(+), 8 deletions(-) Fusion-Task-Id: FN-7420 Fusion-Task-Lineage: 9144ddb5-3a72-4a37-a1d1-471871f3cbc4 Co-authored-by: Fusion (runfusion.ai) <noreply@runfusion.ai>
This commit is contained in:
@@ -16,7 +16,7 @@
|
||||
| Merge gate wall-time (`pnpm test:gate`) | 7.7s | +778ms |
|
||||
| Boot smoke wall-time (`pnpm smoke:boot`) | 17.4s | -557ms |
|
||||
| Changed-only test wall-time (`pnpm test`) | 9.3s | -4.4s |
|
||||
| Quarantine / flake count | 1 | +1 |
|
||||
| Quarantine / flake count | 0 | 0 |
|
||||
| Deletion-due quarantines | 0 | n/a |
|
||||
|
||||
## Measurement failures
|
||||
@@ -56,7 +56,7 @@
|
||||
|
||||
| Age bucket | Count |
|
||||
|---|---:|
|
||||
| 0-6 days | 1 |
|
||||
| 0-6 days | 0 |
|
||||
| 7-13 days | 0 |
|
||||
| deletion due (>=14 days) | 0 |
|
||||
| unknown/future | 0 |
|
||||
@@ -72,15 +72,15 @@
|
||||
| Row | Captured at | Gate | Boot smoke | `pnpm test` | Quarantine count |
|
||||
|---|---|---:|---:|---:|---:|
|
||||
| Previous | 2026-06-27T05:43:17.293Z | 6.9s | 18.0s | 13.7s | 0 |
|
||||
| Latest | 2026-07-02T08:47:17.721Z | 7.7s | 17.4s | 9.3s | 1 |
|
||||
| Delta | — | +778ms | -557ms | -4.4s | +1 |
|
||||
| Latest | 2026-07-02T08:47:17.721Z | 7.7s | 17.4s | 9.3s | 0 |
|
||||
| Delta | — | +778ms | -557ms | -4.4s | 0 |
|
||||
|
||||
_Future weekly rows append to `scripts/test-velocity-history.json`; compare the latest row against the previous row before posting to #leads._
|
||||
|
||||
## Post to #leads
|
||||
|
||||
```text
|
||||
FN-6612 weekly test velocity: gate 7.7s (+778ms), boot smoke 17.4s (-557ms), pnpm test 9.3s (-4.4s), quarantine ledger 1 (+1). Slowest file: packages/dashboard/src/__tests__/insights-routes.test.ts at 26.5s. Deletion-due quarantines: 0.
|
||||
FN-6612 weekly test velocity: gate 7.7s (+778ms), boot smoke 17.4s (-557ms), pnpm test 9.3s (-4.4s), quarantine ledger 0 (0). Slowest file: packages/dashboard/src/__tests__/insights-routes.test.ts at 26.5s. Deletion-due quarantines: 0.
|
||||
```
|
||||
|
||||
## How to refresh
|
||||
|
||||
@@ -213,7 +213,11 @@ describe("main", () => {
|
||||
}
|
||||
});
|
||||
|
||||
it("renders zero quarantine figures from an empty live ledger in report-only mode", async () => {
|
||||
/*
|
||||
FNXC:TestVelocityQuarantine 2026-07-02-12:00:
|
||||
FN-7420 requires report-only regeneration to render quarantine surfaces from the live ledger even when the committed report and latest timing history still claim a non-zero quarantine count.
|
||||
*/
|
||||
it("renders zero quarantine figures from an empty live ledger over stale report and history values", async () => {
|
||||
const rootDir = tempRoot();
|
||||
try {
|
||||
writeJson(rootDir, "scripts/lib/test-quarantine.json", { entries: [] });
|
||||
@@ -233,7 +237,7 @@ describe("main", () => {
|
||||
gateMs: 7_000,
|
||||
bootSmokeMs: 18_000,
|
||||
testMs: 25_000,
|
||||
quarantineCount: 0,
|
||||
quarantineCount: 1,
|
||||
slowestTop20: [{ file: "packages/a/src/__tests__/slow.test.ts", package: "@pkg/a", ms: 9_000 }],
|
||||
measurementFailures: [],
|
||||
},
|
||||
@@ -242,7 +246,7 @@ describe("main", () => {
|
||||
mkdirSync(path.join(rootDir, "docs"), { recursive: true });
|
||||
writeFileSync(
|
||||
path.join(rootDir, "docs/test-velocity-baseline.md"),
|
||||
"| Quarantine / flake count | 3 | +3 |\n| 0-6 days | 3 |\nquarantine ledger 3 (+3)\n",
|
||||
"| Quarantine / flake count | 1 | +1 |\n| 0-6 days | 1 |\nquarantine ledger 1 (+1)\n",
|
||||
"utf8",
|
||||
);
|
||||
|
||||
|
||||
Reference in New Issue
Block a user