Sure but all of these find some way of mapping inputs (any medium) to state space concepts. That's the core of the transformer architecture.

The user you originally replied to specifically mentioned > without going to text first

	▲	adastra22 9 hours ago \| parent [-]
		Yeah, and that's my understanding. Nothing goes video -> text, or audio -> text, or even text -> text without first going through state space. That's where the core of the transformer architecture is.