I agree with you one hundred percent.
But: Interestingly, the behavior of LLMs in different contexts is also the subject of scientific research.