293 Runs
Created on 11/16/2023, 3:53:22 PM
Binary Quantization Create an image showing how some aspect of binary quantization works (the algorithm, distance metrics, etc.)
Binary Quantization Create an image showing how some aspect of binary quantization works (the algorithm, distance metrics, etc.)Why is everyone all of a sudden so excited about binary quantization? If you’re in the same social media bubble as me, you have heard a lot of buzz around binary quantization in the last weeks. Although binary quantization is not a brand new concept, the new wave of excitement was caused by @cohere announcing their native support for int8 and binary embeddings in Cohere embed v3. Here’s what you need to know: What is binary quantization? Vector embeddings are usually generated by embedding models, such as Cohere’s embed v3, and look like this: [0.031, -0.046, -0.009, …, 0.086] Because these have very small absolute numbers close to zero, you can turn them into a binary vector: 1: If the value is greater or equal to 0. 0: If the value is smaller than 0. So that you get something like this. [1, 0, 0, …, 1] What is so cool about binary quantization? By convertin…
Binary Quantization Create an image showing how some aspect of binary quantization works (the algorithm, distance metrics, etc.)Why is everyone all of a sudden so excited about binary quantization? If you’re in the same social media bubble as me, you have heard a lot of buzz around binary quantization in the last weeks. Although binary quantization is not a brand new concept, the new wave of excitement was caused by @cohere announcing their native support for int8 and binary embeddings in Cohere embed v3. Here’s what you need to know: What is binary quantization? Vector embeddings are usually generated by embedding models, such as Cohere’s embed v3, and look like this: [0.031, -0.046, -0.009, …, 0.086] Because these have very small absolute numbers close to zero, you can turn them into a binary vector: 1: If the value is greater or equal to 0. 0: If the value is smaller than 0. So that you get something like this. [1, 0, 0, …, 1] What is so cool about binary quantization? By convertin…