Remix.run Logo
Pragmata 2 days ago

I got a RTX5080 as primary and a RTX3050 (8gb) as secondary.

I always max out on context size so that means i need to split the model between both gpus + offload some into system ram when using LM studio. I'm guessing that is what accounts for most of the slowdown when i use that.

With this recipe i don't have to worry about it. It's pretty fast, and since its all running in the 5080 with max context it's stable (though i got to look out not to load anything big on the same gpu)