Article Source

• Product quantization in Faiss and from scratch

Product quantization in Faiss and from scratch

Abstract

In this video, we talk about a vector compression technique called Product quantization. We first explain conceptually, what the main ideas are and then show how one can use an existing implementation of it from Faiss (IndexPQ). Finally, we also implement the algorithm from scratch. Last but not least, we run some experiments and compare different methods.

• Code: https://github.com/jankrepl/mildlyoverfitted/tree/master/github_adventures/product_quantization
• Faiss: https://github.com/facebookresearch/faiss
• Nanopq: https://github.com/matsui528/nanopq