Frame morphing

Workflow for creating a morphing effect between two images (or video frames). It uses a combination of RiFE frame interpolation and i2i with IPA (SD1.5).

The main difference between this and pure RiFE is that using diffusion model (SF1.5) for key frames allows a much smooth effect where in-between images make more sense, rather than being gargled blobs of color.

Using SD1.5 adds a bit more otherworldly mesmerizing effects due to being trained on low resolution (512), and key frames being scaled to large resolution (~1024).

For examples of this approach being used for cuts between clips, I have used this on a youtube series here: