To be fair, freedom of movement is one of the core principles[1] of the EU.

Restricting that is a tall ask, I wouldn't describe refusing that as being inflexible.

[1]: https://european-union.europa.eu/principles-countries-histor... "Freedom of movement gives citizens the right to move and reside freely within the Union."