Remix.run Logo
Tepix 3 hours ago

Have you thought about getting a second 128GB device? Open weights models are rapidly increasing in size, unfortunately.

tarruda 11 minutes ago | parent [-]

Considered getting a 512G mac studio, but I don't like Apple devices due to the closed software stack. I would never have gotten this Mac Studio if Strix Halo existed mid 2024.

For now I will just wait for AMD or Intel to release a x86 platform with 256G of unified memory, which would allow me to run larger models and stick to Linux as the inference platform.