Switch language한국어
Back to the list

That 0.8 second P99 Latency Cliff in Production Wasnt Supposed to Happen

TL;DR AI

Key summary

2 min read
  1. A Redis-backed config layer pushed P99 latency to 700 ms in a high-throughput matchmaking service.

  2. Every request synchronously hit Redis, and cache flushes plus gRPC fetches created stampedes and latency spikes.

  3. Scaling Redis, disabling flushes, and using replicas or cluster mode did not solve the consistency and performance issues.

  4. The team replaced the hot-path design with ConfigEdge, using a Git-backed control plane and node-local file reads for config delivery.

Read the original