If I set a limit, and you cut off my service because I reached the limit, I would definitely not "complain just as much" as if I set a limit and you allowed me to spend past it.

We're not talking about an EC2 or EBS volume here, this is access to an API.

▲

8 hours ago | parent | next [-]

[deleted]

▲

walthamstow 7 hours ago | parent | prev [-]

Meh, you probably would complain. Maybe you forgot you set it. Now your project is taking off, making money, and it got nuked.

Why aren't we talking about an EC2 - is that not a cloud compute service? People have been complaining about cloud billing since long before LLMs.

Anything to say about the technical problem of constantly monitoring many services against a project or account-level limit?

	▲	ChromaticPanic 7 hours ago \| parent [-]
		You mean we can implement rate limiting on API for security purposes no problem but suddenly having it track costs as well is technically impossible?