I’ve a 128GB m3 max MacBook Pro. Running the gpt oss model on it via lmstudio once the context gets large enough the fans spin to 100 and it’s unbearable.

▲

pixelpoet 6 hours ago | parent | next [-]

Laptops are fundamentally a poor form factor for high performance computing.

▲

embedding-shape 6 hours ago | parent | prev [-]

Yeah, Apple hardware don't seem ideal for LLMs that are large, give it a go with a dedicated GPU if you're inclined and you'll see a big difference :)

	▲	politelemon 3 hours ago \| parent [-]
		What are some good GPUs to look for if you're getting started?