Don't they usually take out the primary residence when doing the calculation?

Typically, it would seem that is indeed the case from most calculations I've seen. I mean, are you really worth a million dollars if you have to be homeless to access those dollars?

You can get those dollars back and rent your home. Or buy a cheaper one.