New Optical Flow Cadence! Deforum Stable Diffusion WebUI

Music from YouTube Audio Library:
“Just Breathing (Instrumental)” - NEFFEX

I recently added a checkbox to the Coherence section of Deforum WebUI for "Optical flow cadence", which changes the behavior of cadence to not only fade between frames while moving the animation, but also using optical flow to warp one frame into the next. Whether to use it is highly dependent on the content you're rendering, but for many things, it can offer a significant boost in rendering times, because cadence works better. This is set on cadence 5, at 30fps. So, it's actually only rendering 6 Stable Diffusion frames per second. The other 24 frames are filled in by Deforum's cadence routines, and now improved with optical flow in this instance. This can provide similar results to something like RIFE, but it isn't directly comparable - and this is much faster. It hardly takes any more time than cadence already took.

I'm also using a very small amount of hybrid video compositing here, but only to help guide the hallucination. Using a Blend mask with comp alpha at 0.05 and blend alpha at 0.05. This basically only allows the video to affect it a little bit when the scene is very dark. Make no mistake though - this is 3D animation. The original video is nothing like this. It's actually this LG video: https://www.youtube.com/watch?v=mkggXE5e2yk

This is also possible now because I fixed the depth stretching bug that had plagued anything but 1:1 videos since the beginning of Deforum. Now, depth warping is consistent, and much more usable.

I'm also using another feature I added, color coherence = Video Input.

I hope you enjoy all the new tools as much as I am enjoying them!

One prompt:
"multi-colored smoke everywhere with beautiful women taking hits from complex glass bong turbo encabulators and blowing out huge clouds of rainbow colored smoke, swirls of smoke around everyone, chambers of bubbling colored liquids, marijuana themed, marijuana posters, head shop background, photography for high times magazine"

#aiart #aiartist #deforum #stablediffusion

🌲⭐🌃
🤜 Forest Star Walz
👉 #reallybigname
https://www.youtube.com/reallybigname
https://www.facebook.com/reallybigname
https://www.instagram.com/reallybigname
https://www.pinterest.com/reallybigname
https://www.twitter.com/reallybigname
https://www.snapchat.com/add/reallybigname
https://www.soundcloud.com/forest-star-walz