Both OpenAI and Anthropic let you disable and delete keys. I'd be surprised if Google doesn't.