I have full size HomePods beside the living room TV, and the one in my studio, and I've never been able to get this feature to work.

works for me on quite a few different TVs and setups. but my current TV requires using HDMI port 3. maybe an Ai can help you troubleshoot it!