I don't think "biology" and "elegantly" belongs in the same sentence. Let alone the one you wrote.

I suspect that the "elegant" workings of the human brain are a pile of hacks. Evolution crammed the brain full of patterns that are a good fit for the specific problems it typically solves - the way curve detectors and scale invariance are a good fit for CNNs.

We don't have millions of years of evolution of non-random init, but what we have is enormous datasets and compute at scale.

The brain is a pile of hacks, but it's still the most advanced thinking machine on the planet and it works on barely any power.