> Couldn't this increase FOUC?

Not if the font data is in a style tag in head, or otherwise before any content that's display might need, or be indirectly affected by, the font.

It will delay first paint on slow connections (all connections, in fact, but on a strong link you'll not notice) though.