There is no FOSS modem. The baseband is a separate computer operating on a lower level than the OS.

Your provider can run arbitrary code there.