What HW are you running this on?

bigyabai 16 hours ago | parent | next [-]

Full GLM-5.3 needs a beast of a system, but you can run GLM-5.3 Flash on the 2x Spark setup the GP comment mentioned. If benchmarks are anything to go by, Flash is like having a local Terra-tier coding model: https://artificialanalysis.ai/models/comparisons?compare=glm...

	▲	solarkraft 15 hours ago \| parent [-]
		I’m also pretty happy with GLM 5.3 Flash (for coding, navigation and german language it sucks at). Incredible that you can run it on a fairly practical (seeming) home setup. But here’s the standard question: At what speeds/other limiting factors?

▲

Toslink 9 hours ago | parent | prev [-]

[dead]