Unguarded LLMs create knowledge just like that, im not sure why you would consider it nonsense.

There's a reason people hated Grok for sexualising children