The key with gemini is to migrate to a new chat once it makes a single dumb mistake. It's a very strong model, but once it steps in the mud, you'll lose your mind trying to recover it.

Delete the bad response, ask it for a summary or to update [context].md, then start a new instance.