Remix.run Logo
ttyyzz 5 days ago

I'm not convinced, what would be the use case?

energy123 5 days ago | parent [-]

Data science where you need to keep ~50GB of data in RAM and do intensive things with it (e.g. loop over it repeatedly with numba). You can't get use out of more than 4 cores because memory bandwidth is the only limitation. The data is too big for AMD's cache to be a factor.

Threadripper is built for this. But I am talking about the consumer options if you are on a budget. Intel has significantly more memory bandwidth than AMD in the consumer end. I don't have the numbers on hand, but someone at /r/localllama did a comparison a while ago.

exceptione 3 days ago | parent | next [-]

This? https://old.reddit.com/r/LocalLLaMA/comments/1ak2f1v/ram_mem...

I can't see how that supports your conclusion.

energy123 3 days ago | parent [-]

There's many red herrings in that table (namely: old DDR4 consumer platforms, server platforms, low bandwidth DDR5 sticks), but surfacing the two relevant numbers (DDR5-6400 consumer heads-up comparison):

> AMD 7900X - 68.9 GB/sec

> Intel 13900K - 93.4 GB/sec

That's 35% better.

Marsymars 4 days ago | parent | prev [-]

Framework Desktop?