turbovec

Summary

Rust index with Python bindings for TurboQuant (arXiv 2504.19874, ICLR 2026): data-oblivious 2/4-bit quantization and no separate train step. README: 10M float32 docs ~31 GB → ~4 GB. Hand-written SIMD (NEON SDOT/SMMLA, AVX-512 VNNI) beats FAISS IndexPQFastScan in measured configs (~3.4× at 4-bit). Incremental crash-safe sync, allowlist-filtered search, and LangChain/LlamaIndex/Haystack/Agno drop-ins. PyPI and crates.io.

Keywords

turbovec · turboquant · vector-search · quantization · rust · faiss · rag · simd

Topics

vector search, quantization, ANN

Research notes

• Primary: GitHub README + API (MIT, Rust, 14772 stars / 1324 forks at check). Implements Zandieh/Daliri/Hadian/Mirrokni TurboQuant arXiv 2504.19874 (ICLR 2026). Discord posted the repo. Index library, not a new hosted corpus, so no datasets_local row.