Isn't it a bug that when spinning the object the light also spins?

It's the equivalent of spinning the view camera around in the scene. Up / Down spins the light coordinates, Left / Right spins the camera viewpoint.

Probably could have been written that way though, since it is spinning the camera view rather than the object.