So what happens when the website layout updates, does the monitoring job fail silently?

So with APIs, it adjusts. For HTML layouts, it looks at the previous diffs to catch potential errors and then re-indexes.