September 1, 2026

Cutting p99 latency by 60% with request coalescing

Our read path had a thundering-herd problem on cache misses. Single-flight coalescing plus a short negative cache took p99 from 850ms to 340ms with no extra hardware. Implementation and before/after graphs.

Placeholder copy — replace with the real article.

Cutting p99 latency by 60% with request coalescing