I expect cameras will start to come with built-in IR filters in that case.

If it's near IR, bright and erratic, enough will get through and it will mess up with the auto gain.