12 GB isn't a lot. You need a lot of VRAM or RAM for context window.