Remix.run Logo
datadrivenangel 6 hours ago

Rounding everything down in the most optimistic setting got me to $0.40 per million tokens, and openrouter has the same model at $.38/mtok.

nativeit 2 hours ago | parent | next [-]

But once all that is done you still own a Mac in one case, and you don’t in the other, correct?

teekert an hour ago | parent | next [-]

Plus your privacy.

odo1242 2 hours ago | parent | prev [-]

Yea this; it’s the same reason why mortgaging is cheaper than renting

ericpauley 2 hours ago | parent | next [-]

This is far from a universal truth: https://www.nytimes.com/interactive/2024/upshot/buy-rent-cal...

Real estate is only a clearly good investment if you ignore opportunity cost.

seanmcdirmid 2 hours ago | parent | next [-]

You also need to pay close attention to rent vs purchase ratios. A lot of cities are cheap to rent but expensive to buy (eg beijing 10 years ago).

mantas 2 hours ago | parent [-]

Key word being „ago“.

deaux an hour ago | parent [-]

Such cities still exist and have been in such a state for decades. They can change but that's meaningless as they can also change the other way around.

sgt 2 hours ago | parent | prev | next [-]

Articles like that still miss a bit of the nuance. Imagine having your house paid for, and you grow old and you have no rent to pay. Yes, you could have invested but likely you would have spent some of that money on something else, or your investments might have not worked out so well, or any other reason. Human reasons, to be specific. Owning property is like a lock.

orangecat 43 minutes ago | parent | next [-]

Imagine having your house paid for, and you grow old and you have no rent to pay.

My home is "paid for". Except for the HOA and property taxes that are not that far off from what I was previously paying in rent, the ongoing maintenance costs with random large spikes, and the opportunity cost of having a large chunk of money in the house and not in the market. It was still probably the right decision, but it's not at all a free lunch.

ffsm8 a few seconds ago | parent | next [-]

And it's gonna be interesting wherever this narrative will shift over the next 5 yrs

I keep hearing that properties are in the biggest bubble yet in the USA - with the affordable housing shortage being a red herring, because real estate managers and boomers are unwilling/unable to reduce their prices - despite not getting renters/buyers because it would kick off a death spiral as their interests would consequently go up (because of lower security). Along with the ai layoffs etc

I'm not American so I only hear the occasional interview so don't have any idea if it's really as pressing as these industry professionals keep saying but I'm definitely at the edge of my seat watching...

sgt 6 minutes ago | parent | prev [-]

Surely though, the HOA and all that would likely be baked into a renter's price.

And you didn't need to go live in a HOA. I don't, and it's much cheaper.

ericpauley an hour ago | parent | prev [-]

You and Matt Levine would get along: https://news.bloomberglaw.com/banking-law/matt-levines-money...

hadlock an hour ago | parent | prev [-]

It never fails, there's always someone who trots this thing out. We had bought our house, and then had to move and decided to rent. I was APPALLED that they wanted me to fill out an APPLICATION form, where they would decide my worth, and let me know if we would be allowed to live there. When buying a house, my cash was as good as anyone elses'. And then the management company would come inside my house to inspect that I wasn't running a meth lab or something. Thankfully that only lasted two years. I will never rent again. Majority owner-occupied neighborhoods have different characteristics as well.

loeg 43 minutes ago | parent [-]

> I was APPALLED that they wanted me to fill out an APPLICATION form, where they would decide my worth, and let me know if we would be allowed to live there. When buying a house, my cash was as good as anyone elses'.

House sellers receive offers from buyers, sometimes including letters, and can choose to sell to any of them (or none of them), whether or not those offers are higher than the listed price. It's not so different.

> And then the management company would come inside my house to inspect that I wasn't running a meth lab or something.

Yeah that part is different. I also prefer owning.

BoorishBears an hour ago | parent | prev [-]

Except one day the hype will catch up to reality that was always true, people will realize their $20,000 Mac is has less utility as a "way to learn AI" than some kids 3090 fortnite machine, and it'll be back to below MSRP.

novok 15 minutes ago | parent | prev | next [-]

Also many have power even cheaper or even free unused surplus power with solar.

I don't do local inference other than hobby & learning reasons because electricity is so expensive where I am at.

650REDHAIR 5 hours ago | parent | prev | next [-]

I’ll keep my data local over a $.02/mtok difference.

quietsegfault 5 hours ago | parent [-]

It’s more than just data locality. OpenRouter is faster, no? I have an M4 pro, and anything but the smallest dumbest models are unusably slow for interactive use. I personally haven’t yet found a good use case for offline/non-interactive LLM work locally.

PAndreew 3 minutes ago | parent | next [-]

I’m running a local Whisper + Gemma 4 pipeline with a cheap USB mic to extract health related data and potential todos from ambient speech. It doesn’t have to be fast doesn’t have to be 100% correct because if it captures at least a few bits of interesting information that would otherwise go unnoticed it’s still a win.

novok 21 minutes ago | parent | prev | next [-]

I played with classifying and summarizing my entire email history (per email) with small models, but that only took about 12h of GPU time at most. Using a coding agent cli wrapper in that case is far slower because of all the spin up cost and the system prompt they inject even if you want to turn it all off.

If I used an actual direct API it probably would've been much faster, but I'm doing it for hobby / fun reasons. You also get to fiddle with a lot more params.

datadrivenangel 4 hours ago | parent | prev | next [-]

Yeah. The speed is the biggest issue. The intelligence of open models is good enough for serious work (though still worse than the frontier models), but the cloud models are often 3-7 times faster, and you can get more parallelization and so get speeds on the order of hundreds of tokens per second, which makes things fast!

freeopinion 2 hours ago | parent [-]

Even extremely slow LLMs can generate Part B faster than I can audit Part A. So the LLM can generate Part A while I look over my email. Then it can worry over Part B while I look over Part A.

It can worry over Part C while I have my 10:30 group meet. And it can worry over Part D while I do whatever other silly, time-wasting thing all humans do in almost all organizations. Then I still haven't reviewed Part B, yet, so the extremely slow AI is waiting on me.

Maybe someday I'll be good enough to need faster AI so I can rewrite something like Bun in a few days. Right now, slow and local fits my use case very well.

quietsegfault an hour ago | parent [-]

I don’t think it matters if you’re “good enough” or not. Much of AI development is iterative. If you context switch between A from project 1 to B from project 2 back to check A, then maybe C while B finishes up, you will lose the flow state that AI assistance can enable with speed for those who are not fluent coders.

Sure, I can wait hours for my local model to finish, or I can spend basically as much and get the answer right away

There’s a lot of exciting stuff with local LLMs despite the speed, but for me I don’t have the discipline and working memory to jump from project to project.

threatofrain 2 hours ago | parent | prev [-]

And continuing the argument of "more than just...", if you stopped inferencing on your Mac you still have a generally nice computer. The difference between rent vs buy.

formerly_proven 4 hours ago | parent | prev [-]

What is it with AI SaaS naming themselves "openxyz" when there is 0% open about them?

em500 3 hours ago | parent | next [-]

They learnt from ooenai that naming yourself open-xyz doesn't actually require opening anything.

debugnik 2 hours ago | parent | prev [-]

It's the next co-opted buzzword after "democratize".