Apart from actual support on real networks, isn't this the problem IP multicast was supposed to solve ages ago?

Yep, it's similar to multicast but L7.

But a huge difference is that there's a plan for congestion. We heavily rely on QUIC to drain network queues and prioritize/queue media based on importance. It's doable with multicast+unicast, but complicated.