I just wish they'd support Pascal :(

Nvidia might have given up support but it doesn't mean vllm have to (llama.cpp didn't).

Pascal? The programming language?

	▲	lightdot a day ago \| parent \| next [-]
		In this case, Pascal as a Nvidia's codename for a GPU microarchitecture. https://en.wikipedia.org/wiki/Pascal_(microarchitecture) I guess many would like to use stock vLLM to run inference on affordable P100...
	▲	SillyUsername 15 hours ago \| parent \| prev [-]
		Sorry I should have qualified it as Nvidia Pascal architecture.