Flux 2 Klein Image Edit Skeleton Pose Extractor

Details

Model description

THIS DOES NOT ANIMATE IMAGES. I'm using Wan Steady Dancer to make the videos.

Tools exist to do this, so why bother?

If you've worked with existing pose extraction tools, you've probably seen the glitches—limbs vanishing off-screen, skeletons disappearing, or joints drifting into impossible positions. That got me wondering: could a model like Klein infer body positioning even when parts are out of frame?

I took stills of many videos and ran them through the normal skeleton pose extractor tools then train this lora with the results.

The outcome surprised me—it works better than expected, though it's far from perfect. V3 is my third iteration, and honestly more of a proof of concept than a finished product. I have some ideas for improvements, but can't commit to how much time I'll invest. Hopefully someone smarter runs with it.

When I used this with video, I scaled down the frames by half. I seems to go a little faster.

Examples are made with Wan SteadyDancer using the workflow from this guy. Just change the pose input to be the output of my Lora model.

I won't be uploading V1 & V2.

Notes:

V3:

  • Bone colors can fluctuate in video output, though testing suggests this doesn't affect usability all that much.

  • Front-facing only. I included some rear-facing shots in training, but clearly not enough—if your subject turns around, the skeleton will break

Images made by this model