I tried something similar when in college. Built a 8bit GPU on a breadboard, i don't remember all the details now, but it was such a fun project.[1]

[1] https://nabraj.com/blog/8-bit-gpu/