Remix.run Logo
pizza234 a day ago

> Why did I initially spend the extra $1600 if I knew ahead of time that it wasn't as good as cloud AI? Because I thought I could use some local LLM for the easy tasks or when I hit cloud rate limits.

The maths don't check. With Deepseek Flash one goes a very long way with 1600$ - even 10$/month, for easy jobs, are more than 13 years, and at a higher quality.

a day ago | parent | next [-]
[deleted]
wolvoleo a day ago | parent | prev [-]

Oh no doubt. But one does have the guarantee that no bits left their home and that's a big one for some.

The low hanging fruit stuff for me is more something I use it for because I have the local LLM setup running anyway. It wasn't the reason I bought it, but now that it's there I might just as well use it as much as I can.

pizza234 18 hours ago | parent [-]

> Oh no doubt. But one does have the guarantee that no bits left their home and that's a big one for some.

No, this is a big misconception, and part of the cargo cult.

Use cases like the parent's are essentially about having a local LLM handle the leftover tasks. By that point, a lot of bits (main/big tasks) have already left home anyway.

wolvoleo 10 hours ago | parent [-]

I'm just saying that's why I bought my local setup. I do use cloud but only for stuff where privacy is irrelevant.