> Can a game work where all you do is scroll?

Yes. MVP: <https://sc.rollc.at/>