Neurons are stateful though, it is core to their function and how they learn.