Skip to content

Historical benchmark and failure reports

The 29 reports below preserve authored findings previously held only in ignored artifact trees. They are historical records, not current launch instructions or performance claims. Original reports and raw evidence remain untouched. Known directory moves are repaired in these copies; absent evidence is explicitly identified in each report rather than replaced with a different run.

Reports

Report Unavailable explicit references
2026-05-03-measurement-campaign-analysis 2
2026-05-11-cpython-failures-classification 0
2026-05-16-measurement-campaign-analysis 1
2026-05-19-measurement-campaign-analysis 3
2026-05-24-measurement-campaign-analysis 4
2026-05-27-issue-30-short-backend-campaign-analysis 4
2026-05-28-issue-30-post-step4-campaign-analysis 4
2026-05-31-bk-cpp-campaign-analysis 0
2026-06-06-measurement-campaign-analysis 0
2026-06-07-bk-cpp-latest-pair-analysis 0
2026-06-11-duckdb-bk-cpp-regression-analysis 1
2026-06-14-duckdb-bk-cpp-post-fix-campaign-analysis 0
2026-06-18-issue-057-embedding-matrix-analysis 2
2026-06-27-final-embedding-campaign-20260626T023243-report 10
2026-06-28-final-embedding-campaign-20260627T201446-report 15
2026-06-28-final-embedding-campaign-20260628T114116-report 2
2026-06-29-final-embedding-campaign-20260629T002747-duckdb-salvage-analysis 1
2026-06-29-final-embedding-campaign-20260629T094609-duckdb-bulk-rewrite-analysis 2
2026-06-29-final-embedding-campaign-20260629T140909-duckdb-cache-vector-analysis 3
2026-06-30-final-embedding-campaign-20260629T204308-duckdb-intervention-plan 4
2026-06-30-final-embedding-campaign-20260630T060856-report 4
2026-07-01-onnx-parameter-sweep-report 2
2026-07-01-split-engine-gate-investigation-note 0
2026-07-11-aggregate-embedding-campaign-report 5
2026-07-18-retrieval-quality-campaign-analysis 5
2026-07-19-vector-store-authority-rebased-campaign 1
2026-07-20-vector-store-authority-redress-campaign 1
2026-07-21-vector-store-authority-redress-final-report 0
2026-10-04-campaign-016-failure-analysis 0

Remaining evidence gap

21 reports reference historical evidence that could not be located in this checkout. These include early backend runs, the embedding matrix, final embedding campaigns, ONNX sweeps, split-engine experiments, the July 14 retrieval-quality run, and earlier vector-store candidate runs. Recover those exact identities from an external backup before attempting to revalidate their numbers. A rerun is new evidence and cannot replace an old identity.

The July 20 vector-store final campaign and later agent-efficiency failure evidence remain available. Generated CSV tables and raw diagnostics remain ignored; a Git-only checkout contains authored findings, not all reproduction data. Their absence must not be presented as current verification.

Current retention policy is in the dated review.