I just tried on an iPad, so it's possible it's a different experience, but it was only 3: swipe down (exit's fullscreen) > swipe down (same flow as before) > X in the corner.

It is a very different experience on the iPad. I don't use YT much there, but it's not as annoying, for sure.