People are working on lots of things all the time, so far, nothing has approached the efficacy of the transformer architecture.

LLMs didn't emerge by chance, they are the culmination of decades of research intersecting with brute force engineering rigor in a perfect storm of innovation. You're not just going to stumble into an alternative approach by dumping loads of cash into research.