docs(reference): add the benchmarks page#54
Conversation
Publishes the EQL v3 query-performance numbers from cipherstash/benches at /reference/benchmarks, so the performance claims have a docs page to land on: - encrypted-vs-plaintext query latency (exact match and OPE range within ~1.2-1.4x of plaintext, flat from 10k to 10M rows) - the OPE-vs-ORE range/order tradeoff, free-text bloom match, JSON, GROUP BY - ingest throughput, methodology, caveats, and repro steps Every figure is sourced from the public benches report and cross-checked against the plaintext baseline. Ticks the IA checklist item.
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
freshtonic
left a comment
There was a problem hiding this comment.
Got the docs running locally and checked this branch out.
The breakdown of latency versus scaling is really well thought out - and the link to the raw benchmarks will satisfy those craving more detail.
The page had the ordering variants backwards relative to shipped EQL 3.0.0. It attributed OPE (fast, ~1s index build) to `_ord_ope` only and called `_ord` the ORE variant. Shipped, `_ord` IS the OPE default (op term, `eql_v3.ord_term`, indexes under the built-in btree opclass), and `_ord_ore` is the ORE-pinned variant (ob term, `eql_v3.ord_term_ore`, needs a superuser opclass). Verified against the 3.0.0 install SQL. Only the variant labels were wrong; every latency and build-time figure was already correct and is unchanged.
|
Fixed the OPE/ORE variant labels, which were inverted relative to shipped EQL 3.0.0 (commit The page attributed OPE (fast, ~1 s index build) to
Verified against the EQL 3.0.0 install SQL ( |
|
@coderdan nice! |
Adds
/docs/reference/benchmarks— the performance numbers with methodology, per the IA. Closes the gap where these figures existed only in the external benches repo.Source
Numbers distilled from the public cipherstash/benches EQL v3 suite (PR:
eql-v3-benches), specifically thereport/BENCHMARK_REPORT.md"vs plaintext PostgreSQL" table andreport/V3_COMPARISON.md. Every figure is cross-checked against the plaintext baseline; nothing is restated without a source.What the page covers
0.12 ms (1.3x), OPE range0.12 ms (1.2x), ORE range0.52 ms (5.2x), JSON@>0.40 ms (1.4x),GROUP BY83 ms (2.2x).Verification
bun run buildgreen (694 pages);validate-linksreports no broken links.Notes / scope
/concepts/compare/aws-kmspage yet to cross-link. Left it out rather than restate an unsourced number — happy to add a "key-management throughput" section once that benchmark/page lands.contains10M outlier is a documented plan artifact, flagged as such.