Any Airpods connect directly to the AppleTV. You don't need the remote, phone or an app at all.

If you're using wired headphones then a $20 Bluetooth dongle will do the same.

Pretty much any bluetooth headphones work connected directly to the AppleTV, not just Airpods