Hiya! So I've been playing around with having Claude make videos for a bit now even had some success posting the results to TikTok (and setup a whole pipeline so Claude can generate and post autonomously). With the release of Nano Banana 2 Lite, I was curious show fast I could make the generation, so last night I gave it a whirl and got down to around 30s for short-form video.

It uses GLM-5.2 fast via Fireworks to generate the scripts and image prompts and, like I said, Nano Banana 2 Lite for the images, gpt-4o-mini-tts for the narration, and ffmpeg to string it all together and add the Ken Burns zoom effect (which still has a shake I haven't been able to get rid of). The video compilation proved to be the blocker once the rest was in place, but I was able to speed that up by putting it on a 64 vCPU EC2.

The cost might be the most interesting aspect as the short form videos tend to be about 25 cents. Almost 90% of that is the images, which are 3.336 cents a piece. Of course, running the big 64 core EC2 to allow for the creation isn't cheap.

It seems like on-demand AI video is coming, and I thought this was an interesting demo of how close it might be in at least one narrow video domain.

Cool idea! Looks like my prompt is stuck, though. Might be an idea to provide a share link at the moment of hitting the button so you can check back later, because if I close the tab I will lose my prompt

How would I create a video like this?

For example, I have several posts that explain concepts in detail, with supporting images. They're written in Markdown, and I keep refining them until I'm confident that the average person can read them and immediately understand the concept.

The problem is that text is becoming a less popular medium for learning, while short form videos are increasingly being used to explain the same ideas.

From what I can tell, this tool only lets you provide a prompt. Can it turn my existing Markdown posts and images into videos, or is it mainly intended for generating videos from simple prompts? I'm looking for something that preserves the explanations I've already written rather than creating something entirely new.

Fun idea! Hope it doesn't cost you too much to keep up depending on how much traction this thread gets ;)

One small quirk I noticed with the generated short video: for each new slide/photo, there is a very gradual "zoom in" effect that occurs, which causes text to jitter a bit and is a bit disorienting. Not sure if that is specific to the "The Great Molasses Flood of 1919 in Boston" prompt I used or not.

Also, is Claude involved in the video generation itself? I noticed the generated video has "By Claude" in the top left corner, but the logs seem to indicate that only GLM-5.2, Gemini Flash, and GPT-4o are involved (just curious!)

I'm guessing its being hugged now - it says generate in under a minute but my short is taking ten minutes and counting; anyway I like the simplicity and am interested in seeing the results - though I do think it is quite depressing as we will see this sort of service mostly put to use for slop.

Currently getting errors

---

File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run result = self.fn(self.args, *self.kwargs) File "/home/ubuntu/byclaude/video/harness/pipeline/pipeline.py", line 829, in build_clip clip = round(dur + TAIL, 3) TypeError: unsupported operand type(s) for +: 'NoneType' and 'float' Video build failed (pipeline exit 1) — please try again. Powered by AI · by Claude · ~

I'm around to answer questions or receive feedback if anyone as any!

https://instantvideos.org/video/6be78e5ea542

Quotations from Chairman Mao Tse-tung (Short form)

The audio narration is great and the documentary is accurate. Improvements could include more pictures or animations.

This is a very great tool and framework! Thank you so much.

Ugh looks like I'm hitting my Gemini Tier 1 usage limits. Sorry!

Image not generating?

Did you really rent a 64 vCPU EC2 without exploiting ffmpeg GPU acceleration?