The "Clipboard History"[0] Gnome extension also does this quite well in my experience. I also recently switched from Windows 11 (to Ubuntu), very happy so far.

Edit: Supports pinning and binding it to Super+V as well!

[0] https://extensions.gnome.org/extension/4839/clipboard-histor...