Google introduces TurboQuant, a compression method that reduces memory usage and increases speed, though results depend on benchmarks and real-world implementation variability.

source https://www.techradar.com/pro/a-high-speed-digital-cheat-sheet-google-unveils-turboquant-ai-compression-algorithm-which-it-claims-can-hugely-reduce-llm-memory-usage