At least on windows, closing chrome doesn't close the system tray process which keeps Chrome and Gemini prestaged and cached. Wonder if OP is experiencing a version of that on his Mac?

Microsoft Edge does this too, iirc, for "Startup Boost".