The aggregate effects on employment caused by immigration work on an identical timescale. If your point is, "people are terrible at blaming individual outcomes on aggregate statistical phenomena", then I agree with you.