| ▲ | Tepix 3 hours ago | |
Have you thought about getting a second 128GB device? Open weights models are rapidly increasing in size, unfortunately. | ||
| ▲ | tarruda 11 minutes ago | parent [-] | |
Considered getting a 512G mac studio, but I don't like Apple devices due to the closed software stack. I would never have gotten this Mac Studio if Strix Halo existed mid 2024. For now I will just wait for AMD or Intel to release a x86 platform with 256G of unified memory, which would allow me to run larger models and stick to Linux as the inference platform. | ||