Per-entry metadata grows until high-cardinality caches run out of memory.
Per-entry metadata grows until high-cardinality caches run out of memory. Cloudflare's 1.1.1.1 post shows that cutting per-entry footprint by over 50% freed roughly 100 TB. Before redesigning your session store, RAG cache, or Redis layer around LFU versus LRU, measure bytes-per-entry, allocation counts, and allocator size classes. Shrinking entries is the cheapest capacity win; change eviction policy only after you know the per-entry cost.
How we saved 100 terabytes of memory by optimizing 1.1.1.1’s DNS cache
#Database
All posts