In some sense you're firing a human and hiring a new one each time you start a new conversation / clear the context window.

My point is at the systems design level. LLMs as components are a substitute for people, not regular software, and should be engaged and secured accordingly.

So your point is "Get the hell out of LLMs" then? As found in https://sgnt.ai/p/hell-out-of-llms/? Or am I still missing something about the subtleties here?