there's also the fact that the brain doesn't process inputs in discrete, feed-forward steps. everything is running continuously and feeding back to earlier layers.

and then there's the abstraction of 'activation' used in neuralnets that is very useful computationally, but omits a lot of the complexity in actual neural signals. you don't get fine-detail in the timing of spikes or the fact that neurons use different types of neurotransmitters.