Hope this on day will be used for auto-tagging all video assets with time codes. The dream of being able to search for running horse and find a clip containing a running horse at 4m42s in one of thousands of clips.

▲

ArnavAgrawal03 6 hours ago | parent | next [-]

you can do that with Morphik already :)

We use an embedding model that processes videos and allows you to perform RAG on them.

	▲	bn-l 2 hours ago \| parent [-]
		Rag as in the content is used to generate an answer or rag as in searching for a video?

▲

laidoffamazon 8 hours ago | parent | prev [-]

It’s not difficult to hack this together with CLIP. I did this with about a tenth of my movie collection last week with a GTX 1080 - though it lacks temporal understanding so you have to do the scene analysis yourself

	▲	vhcr 4 hours ago \| parent \| next [-]
		I'm guessing you're not storing the CLIP for every single frame, instead of every second or so? Also, are you using the cosine similarity? How are you finding the nearest vector?
	▲	dynode 6 hours ago \| parent \| prev [-]
		Would you be willing to share more details of what you did?