> Get special elections going and get a working congress

That's not actually legal in many (most?) states. Recall is not a universal feature.

What you're advocating for is civil war. In many states, the only way to get Congresspeople to leave would be "voluntarily" (i.e. "We threaten to burn down every piece of property you have if you don't give up your seat"). Which, actually, has worked deep in America's past; the post-Revolutionary era had a lot more "We don't like the governor, so we're going to take his house apart and throw it into the river" stories.

You're not wrong exactly, but I think you've underestimated how fundamentally anti-democratic American democracy is. It was a 1.0-template and had baked pretty deeply into it fear of mob rule (hence the President not being chosen by direct vote, for example).

I think you are conflating two concepts. Most states do not allow recall of state legislators as you mentioned, but recalling federal legislators is not allowed in any state—there is no constitutional mechanism enabling it.