Samsung still make the rugged Xcover range which has both replaceable batteries and waterproofing. And 3.5mm jacks too.

These devices are mostly sold in enterprise environments (eg field use, factories) and as such get a lot of wear and tear. But they hold up well. They're not ultra rugged but a good compromise. We use tons of them in our factories, we replaced DECT handheld phones with the Xcovers loaded with ms teams. Not an ideal setup (teams for mobile kinda sucks) but at least this way they can easily communicate with people in the offices.