is this the right way to think about LLMs?

For example, the syscalls for linux are never changing IMO. The cost is unbounded to change, even with AI.

Should your APIs be treated any different?

At the very least, the LLMs work better with better APIs and data models, which yet accelerates the solving of problems.