I personally wish we could make a language LLMs would stay away from, rather than make it easier...

That’s easy – just use a language that is not popular enough to have a lot of training data.