3 min readInfrastructure
Optimizing Vector Search at Scale
Reducing latency in large vector indexes: quantization, graph pruning, and why the page cache is usually a better tiering strategy than the one you were about to write.
High-signal thoughts on infrastructure, artificial intelligence, and the intricacies of building resilient systems at scale.
Reducing latency in large vector indexes: quantization, graph pruning, and why the page cache is usually a better tiering strategy than the one you were about to write.