Remix.run Logo
nchmy 18 hours ago

This entire argument rests upon the fact that Gemini Flash ain't cheap.

Try plan with opus 4.8 and then implement with Deepseek v4 flash - its 35x cheaper for reads, 90x cheaper writes, and 18x cheaper cache reads.

Or plan with Deepseek Pro, or even Flash itself. I've been impressed with both.

pdyc 12 hours ago | parent [-]

+1. i have similar workflow and i use local models on igpu so token cost is free and electricity cost is in cents.

spuz 9 hours ago | parent [-]

I cannot imagine local models running on an igpu could get anything close to either a useful plan or execution of a plan. I've tested Qwen 3.5 27B locally and its solutions to coding problems are usually flawed and running in thinking mode is too slow and that's on a discrete GPU. How do you get anything useful done on a model that runs on an igpu?

nchmy an hour ago | parent [-]

yeah, i dont understand, whatsoever, the folks who are running models locally other than for privacy/curiosity. It is surely FAR slower, more expensive (electricity + hardware costs), and worse quality. Better to outsource to providers who have optimized everything and costs are distributed/amortized across all users.

Perhaps someday local llms will be sufficient for coding etc, but it's going to be a while.