wow this would be great for a webapp/site that just needs a basic/performant LLM for some basic tasks.

You might hit some throttling limits. During certain periods of the day, at least in my location, some requests are not served.

It might not be OK for that kind of usecase, or might breach ToS.

But it's still great. Even my premium Perplexity account doesn't give me free API access.