r/StableDiffusion

The need for InfiniteTalk in Wan 2.2

InfiniteTalk is one of the best features out there in my opinion, it's brilliantly made.

What I'm surprised about, is why more people aren't acknowledging how limited we are in 2.2 without upgraded support for it. Whilst we can feed a Wan 2.2 generated video into InfiniteTalk, you'll strip it of much of 2.2's motion, raising the question as to why you generated your video with that version in the first place...

InfiniteTalk's 2.1 architecture still excels for character speech, but the large library of 2.2 movement LORAs are completely redundant because it will not be able to maintain those movements whilst adding lipsync.

Without 2.2's movement, the use case is actually quite limited. Admittedly it serves that use case brilliantly.

I was wondering to what extent InfiniteTalk for 2.2 may actually be possible, or whether the 2.1 VACE architecture was superior enough to allow for it?

https://redd.it/1o80k2i
@rStableDiffusion

Reddit

From the StableDiffusion community on Reddit

Explore this post and more from the StableDiffusion community

www.tgoop.com/rStableDiffusion/55901

4 viewsOct 16 at 09:40

The need for InfiniteTalk in Wan 2.2

InfiniteTalk is one of the best features out there in my opinion, it's brilliantly made.

What I'm surprised about, is why more people aren't acknowledging how limited we are in 2.2 without upgraded support for it. Whilst we can feed a Wan 2.2 generated video into InfiniteTalk, you'll strip it of much of 2.2's motion, raising the question as to why you generated your video with that version in the first place...

InfiniteTalk's 2.1 architecture still excels for character speech, but the large library of 2.2 movement LORAs are completely redundant because it will not be able to maintain those movements whilst adding lipsync.

Without 2.2's movement, the use case is actually quite limited. Admittedly it serves that use case brilliantly.

I was wondering to what extent InfiniteTalk for 2.2 may actually be possible, or whether the 2.1 VACE architecture was superior enough to allow for it?

https://redd.it/1o80k2i
@rStableDiffusion

BY r/StableDiffusion