I'm with you. And what do you even do when the quota is breached, nuke the resources? People will complain about that just as much as overspends.

I don't buy the 'evil corp screwing people' angle either. They are making farrr too much legit money to care about occasionally screwing people out of 20k and 50k.

▲

johnmaguire 9 hours ago | parent | next [-]

If I set a limit, and you cut off my service because I reached the limit, I would definitely not "complain just as much" as if I set a limit and you allowed me to spend past it.

We're not talking about an EC2 or EBS volume here, this is access to an API.

▲

9 hours ago | parent | next [-]

[deleted]

▲

walthamstow 9 hours ago | parent | prev [-]

Meh, you probably would complain. Maybe you forgot you set it. Now your project is taking off, making money, and it got nuked.

Why aren't we talking about an EC2 - is that not a cloud compute service? People have been complaining about cloud billing since long before LLMs.

Anything to say about the technical problem of constantly monitoring many services against a project or account-level limit?

	▲	ChromaticPanic 8 hours ago \| parent [-]
		You mean we can implement rate limiting on API for security purposes no problem but suddenly having it track costs as well is technically impossible?

▲

ChromaticPanic 8 hours ago | parent | prev [-]

Block network access ? It's not that hard