Emergent behavior is not new in the realm of software. Cellular automata has emergent behavior that can get pretty wild. For example: https://en.wikipedia.org/wiki/Lenia

There are huge differences between brains and computers running LLMs. One of the big ones is that we (collectively) understand how every component of computers running LLMs actually work. The same is not true for neurons.