Missing multimodal again?

It is so valuable in practise to be able to have the models see screenshots - I guess if they aren't in the benchmarks then nobody will focus on it. But it completely nixes these for some of my main use cases.

▲

xscott 2 hours ago | parent | next [-]

Probably not what you're after, but I've considered having a separate small mm-model act as a seeing-eye dog for the bigger more capable one.

▲

pllbnk an hour ago | parent | prev | next [-]

I can’t come up with a use case where I couldn’t extract the image details using another, multimodal model and pass it into the GLM’s context with as many details as I need.

	▲	zmmmmm an hour ago \| parent [-]
		I think you lose a lot by not having the vision capability shared with the text. It is the joint reasoning across them where the power lies (the same model that sees the code and made the changes to produce the visual presentation, sees the image of it and reasons about it).

▲

arcanemachiner 2 hours ago | parent | prev [-]

I would assume that GLM 6 will be multimodal, but 5.x will be text-only.