2D animators can still feel safe about their job, I asked it to generate a sprite sheet animation by giving it the final frame of the animation (as a PNG file) and asking in detail what I wanted in the spritesheet, it just gave me mediocre results, I asked for 8 frames and it just repeated a bunch of poses just to reach that number instead of doing what a human would have done with the same request, meaning the in-betweens to make the animation smoother (AKA interpolations)

I’ve been using the same test since Dalle 2. No model has passed it yet.

However, I don’t think 2D animators should feel too safe about their jobs. While these models are bad at creating sprite sheets in one go, there are ways you can use them to create pretty decent sprite sheets.

For example, I’ve had good results by asking for one frame at a time. Also had good results by providing a sprite sheet of a character jumping, and then an image of a new character, and then asking for the same sprite sheet but with the new character.

the problem here is that text as the communication interface is not good for this. the model should be reasoning in the pose space (and generally in more geometric spaces), then interpolation and drawing is pretty easy. I think this will happen in some time.

With local models you can use control net, which is simply speaking, the model trying to adhere to a given wireframe/openpose. Which is more likely to give you an stable result. I have no experience with it, just wanted to point out that there is tooling that is more advanced.

At least until someone decides to fine-tune a general purpose model to the task of animation.