That was my take, too. You could control a bike with just one linear neuron with one input, if you pass in the correct steering torque. Still a fun paper.

Footnote 1 mentions:

Actually, the title of this paper is unproven. We have not ruled out the possibility that a single neuron could ride a bicycle.