On Linux you can feed the GPU encoded bitstream and then GPU will use hardware to decode and display it as overlay.

Why is this relevant? To be clear, I'm asking from a place of ignorance. Are you saying that because the video player can have the video decoding happen entirely on the GPU, screen recording software can't pick it up? Couldn't the software just read from the GPU buffer?