technique

scalar quantization

techniqueactivescalar-quantization-30db15e5·1 events·first seen 28d ago

Aliases: scalar quantization

Co-occurring entities

binary quantization USearch Hugging Face Sentence Transformers FAISS

More like this (12)

quantization binary quantization Vector Quantization 1.58-bit quantization Channel-wise Vector Quantization INT4 Quantization KV Cache Quantization quantization-induced degradation quantization-aware training Power-of-Two (PoT) Quantization INT4 quantisation W4A4 quantization

Recent events (1)

5Hugging Face Blog·28d ago·source ↗

Binary and Scalar Embedding Quantization for Significantly Faster & Cheaper Retrieval

This Hugging Face blog post covers techniques for quantizing text embeddings to binary and scalar (int8) representations, enabling dramatically faster similarity search and reduced memory footprint. The post details how binary quantization can achieve ~40x memory reduction with Hamming distance search, while scalar quantization offers a middle ground between speed and accuracy. Practical implementation guidance is provided using Sentence Transformers and FAISS/USearch libraries, with benchmark results showing retrieval speed and accuracy tradeoffs.

Inference Economics Enterprise Deployment Patterns binary quantization USearch Hugging Face +4 more