cvs.com doesn't allow me to delete my account unless I provide an address in certain states.

So I provided a fake address in California, and it was done.

Unfortunately that's how things work these days sometimes.