but... they could add the LLM to the app
Let's take Zawinski's old law up a notch:
"Every program attempts to expand until it has a built in LLM."