What is unified ram? RAM and VRAM as one thing?

AbsurdCensor 5 hours ago | parent | next [-]

Big ole pool of very fast ram that can be accessed by the CPU and GPU. Lets you run larger models. AMD does the same thing with Strix Halo. I have a 128gb machine at home, and have had difficulties running 120b models, but 70b and below run pretty well.

▲

dannyw 3 hours ago | parent [-]

AMD Strix Halo unified memory still requires allocating X to GPU, x to CPU at UEFI.

So not as flexible as apple's unified memory.

	▲	EgregiousCube 2 hours ago \| parent [-]
		Not in Linux! See setting GTT: https://rocm.docs.amd.com/en/docs-7.2.0/how-to/system-optimi...

▲

5 hours ago | parent | prev | next [-]

[deleted]

▲

lynndotpy 5 hours ago | parent | prev | next [-]

Yep, exactly. It's just one shared pool of RAM with zero-copies necessary.

▲

Zylokloto 4 hours ago | parent | prev | next [-]

In best case its also on-chip high speed ram.

▲

5 hours ago | parent | prev [-]

[deleted]