Digital is digital, but you’re ignoring multiple places where things might not be the same:

That $30 CD player… if it’s connected to headphones, how were the headphones driven? Especially if you have nice headphones, it’s very easy for a cheap device to not be able to competently drive them.

Vinyl vs CD mastering is a thing. There could be differences there. Additionally, depending on how you ripped the vinyl (especially with a “cheap dongle”) that may introduce its own color to the record.

There’s a reason why music collectors differentiate between every single source, because often there are differences (sometimes small, sometimes big) between the various sources.