| ▲ | unglaublich 5 hours ago | |||||||
So I guess we'll all be applying a random rotation to our matrices now to obscure their contents, like TurboQuant does. https://arkaung.github.io/interactive-turboquant/#rotation | ||||||||
| ▲ | buildbot 5 hours ago | parent [-] | |||||||
Not that it super matters, but random hadamards for quantization have been a thing since way before turboquant. | ||||||||
| ||||||||