17 Commits

Author SHA1 Message Date
Miguel de Benito Delgado
f7396b282a 🐛 Explain saved renderer A/B failures
Print compact A/B failure summaries from the last saved comparison when
the command returns status 1 with an empty error list. Include reasons
and run, build or comparison references, with bounded fields and an
eight-entry limit.

Read interruption state after execution and cover saved configuration
failures, unacknowledged differences and signal output in tests.

AI-assisted-by: gpt-6.1-sol
2026-11-09 14:09:24 +01:00
Miguel de Benito Delgado
3446dcfefb 🐛 Preserve renderer benchmark failure context
Retain saved-run input paths and roles in compare and merge errors.
Carry bounded build identities and process details through saved
 diagnostics and terminal reports. Preserve browser startup context
through failure wrappers and quote string paths for terminal output.

Cover file reads, compiler exits, catalog identities and browser startup
with behavioral tests across persistence and CLI reporting.

AI-assisted-by: gpt-6.1-sol
2026-11-09 14:09:24 +01:00
Miguel de Benito Delgado
433437d735 ✨ Complete renderer benchmark command catalogue
- Improve readme
- Migrate scene cases to measured commands and remove obsolete descriptors.
- Preserve exact camera targets, including very small positive scales.

AI-assisted-by: gpt-6.1-sol
2026-11-09 14:09:09 +01:00
Miguel de Benito Delgado
a90db9f6ee ✨ Enforce benchmark case deadlines
Stop failed cases and preserve their execution evidence.

AI-assisted-by: gpt-6.1-sol
2026-11-09 14:09:09 +01:00
Miguel de Benito Delgado
3d72d6beea ✨ Save raw benchmark phases and reports
Record raw phases and report statistics per execution.

AI-assisted-by: gpt-6.1-sol
2026-11-09 14:09:09 +01:00
Miguel de Benito Delgado
097eb11d95 ♻️ Reorganize benchmark runner, reporting and cli 2026-11-09 14:09:09 +01:00
Miguel de Benito Delgado
c83177335e ✨ Complete benchmarking cli redesign
AI-assisted-by: gpt-6.1-sol, deepseek-flash
2026-11-09 14:09:09 +01:00
Miguel de Benito Delgado
d1c3783f18 ♻️ Use per-command schemas in benchmark cli 2026-11-09 14:09:09 +01:00
Miguel de Benito Delgado
3986703efb ✨ Implement run merging
AI-assisted-by: deepseek-flash
2026-11-09 14:09:09 +01:00
Miguel de Benito Delgado
2aabc46939 🚧 WIP 28, enable GPU support 2026-11-09 14:09:09 +01:00
Miguel de Benito Delgado
7f1198f378 🚧 WIP 27, improve logging and console reporting
AI-assisted-by: deepseek-flash, gpt-6.1-sol
2026-11-09 14:09:09 +01:00
Miguel de Benito Delgado
2c904d3021 🚧 WIP 26, A/B tests and a bunch of fixes
AI-assisted-by: deepseek-flash, gpt-6.1-sol
2026-11-09 14:08:43 +01:00
Miguel de Benito Delgado
210d0da72a 🚧 WIP 25.3 Clean up
- remove manual schema versioning
- clean docstrings

AI-assisted-by: deepseek-flash, gpt-6.1-sol
2026-11-09 14:08:43 +01:00
Miguel de Benito Delgado
188c8e0e80 🚧 WIP 25.2 Safer deletion and symlink handling
AI-assisted-by: deepseek-flash, gpt-6.1-sol
2026-11-09 14:08:21 +01:00
Miguel de Benito Delgado
1c4b9b77fe 🚧 WIP 25.1 Clean up
More consistent args.
Avoid importing unnecessary namespaces.
Improve file write error handling.

AI-assisted-by: deepseek-flash, gpt-6.1-sol
2026-11-09 14:08:21 +01:00
Miguel de Benito Delgado
2329630033 🚧 WIP 25 complete runner, drop pilot
AI-assisted-by: deepseek-flash, gpt-6.1-sol
2026-11-09 14:08:10 +01:00
Miguel de Benito Delgado
e58c255bab ✨ Add retained renderer benchmark builds and host
Add prepared build artifacts, browser host and the build and
purge commands for the CLJS renderer benchmarks.

Each preparation attempt gets a build ID and a retained directory with
its manifest, log, Node case catalog, browser bundle, renderer files
and host page. Ready builds load their matching catalog in process and
serve only their own directory through an owned loopback host.

Own Chromium through a bounded process group, verify the compiled build
identity before execution and retain failed preparations for diagnosis.
Wire the diagnostic pilot to the same build, catalog, server and
browser APIs.

Add real boundary tests for artifacts, processes, servers, browsers and
CLI parsing, and register them with the performance test runner. Rename
the benchmark lint and test scripts to match the suite.

AI-assisted-by: deepseek-flash
2026-11-09 14:08:10 +01:00