You may think you're funny or something, but boy do I have news for you.

There absolutely are fines for French administrations. And, knowing the French tax system, they've probably found a way to levy VAT and some other taxes on top of those fines.