input lag is a minor part of it. it depends on the game, but for example in CS2, refresh rate changes game mechanics like recoil, movement, even trajectories of thrown grenades.

i went from 60hz to 240hz, with <100fps average, and the difference was still immense. refresh rate is more important than fps, that's how big it is.