Wake word can be tiny. Like 10k weights and can run on an esp32 or similar with plenty of compute to spare.
TinyML is a book that goes through the process of building a wake word model for such constrained environments.