LLMs can work without tokens: https://arxiv.org/abs/2412.09871. Tokens are more or less a performance optimisation.