I haven’t had much time with it, but I’ve had to set the split in the BIOS. There’s probably a way to do it from within Linux though. Also hoping some progress is made on using the AMD NPU in Linux. I know it only recently got kernel level support.

▲

hedora 2 hours ago | parent | next [-]

I thought I had to split it in the BIOS, but then I just didn't (this is on a 2025 machine), and llama ended up with the same available "GPU" ram either way (confirmed by running inference on it).

	▲	mrbuttons454 2 hours ago \| parent [-]
		Oh that's fantastic, I'll give it a try. thank you!

▲

pstuart 41 minutes ago | parent | prev [-]

Finally there's good news for Linux users: https://github.com/FastFlowLM/FastFlowLM