> it just wasn't called that back in the day

Right, I think they were more just like "VGA cards" or "graphics adapters" for a while, and before that would have been CGA/EGA/Hercules, etc. I view the first GPUs as being those with 2D + 3D acceleration.