It's called performance management.

If middle management can't figure it out for remote or in-office employees, they need a new line of work.

The people that are slackers at home have low output in the office and are probably the annoying gabber distracting the rest of the team in-office.

Collective punishment isn't a solution, and the best will walk.