Remix.run Logo
spacedcowboy 3 hours ago

It's not. I've got a single one of those 512GB machines and it's pretty damn impressive for a local model.

Greed 3 hours ago | parent [-]

Assuming you ran the gamut up from what you could fit on 32 or 64GB previously, how noticeable is the difference between models you can run on that vs. the 512GB you have now?

I've been working my way up from a 3090 system and I've been surprised by how underwhelming even the finetunes are for complex coding tasks, once you've worked with Opus. Does it get better? As in, noticeably and not just "hallucinates a few minutes later than usual"?