Author here: I didn't unplug the display, I went to the settings and disabled the TV. I am not saying that I didn't do anything wrong, but I expected that disabling the TV would make the monitor the primary display and move the taskbar to it.

This is most likely a bug in KDE indeed. I misunderstood disabled in the setting with powering off.