Remix.run Logo
ashvardanian 3 days ago

Sadly, no! On the bright side, they support new AVX2 VNNI extensions, that help with low precision integer dot products for Vector Search!

SimSIMD (inside USearch (inside ClickHouse)) already has those SIMD kernels, but I don’t yet have the hardware to benchmark :(

yvdriess 3 days ago | parent [-]

Something that could help is to use llvm-mca or similar to get an idea of the potential speedup.

Sesse__ 3 days ago | parent [-]

A basic block simulator like llvm-mca is unlikely to give useful information here, as memory access is going to play a significant part in the overall performance.