Doesn't Windows already do this by default? I can already run models bigger than my GPU VRAM and it will start using up to 50% of my system RAM as "shared memory". This is on a Desktop PC without a shared memory architecture.

▲

Yokohiii 5 hours ago | parent | next [-]

The nvidia windows driver enables RAM swapping by default.

Great way to backstab you if you prefer inference speed.

▲

3836293648 5 hours ago | parent | prev [-]

I don't think Windows does this, but Ollama does

	▲	nodja 4 hours ago \| parent [-]
		NVIDIA's GPU drivers on windows 100% do this https://i.imgur.com/c0a3vUy.png