Is it? I can see the broiler glowing, so at least a decent chunk is close to visible light.

Look up the emission spectrum for a body at the temperature of a typical oven element: yes, it starts emitting some light that is visible, but the bulk of the energy is still in the IR band.