On the one occasion I met Steve Furber, he told me about how when they connected up the very first chip, he was surprised that the it started running before he had even connected the power.

Turns out the design was such a low power design that just the voltage from the data lines was enough to run the chip.