44.
The poolside technical report contains some interesting details about quantization. They leverage a rotation tech…
The poolside technical report contains some interesting details about quantization. They leverage a rotation technique called Spinquant. Spinquant is essentially Turboquant’s cousin; TurboQuant rotates the KV cache, SpinQuant R1 rotates ac