September 1, 2026
Cutting p99 latency by 60% with request coalescing
Our read path had a thundering-herd problem on cache misses. Single-flight coalescing plus a short negative cache took p99 from 850ms to 340ms with no extra hardware. Implementation and before/after graphs.
Placeholder copy — replace with the real article.