That's not a requirement for LLMs. Training can be done differently.