The single most important feature for film makers that’s currently missing from Hedra. Hope you guys can put it on the roadmap soon. Runway and Pika have such features but they either look bad or won’t work on half the faces, so a better solution is direly needed. Thanks and godspeed!
Michael Lingelbach
Team•
Aug 28, 2024
The main reason Hedra looks good is that we holistically generate every frame of the video, audio drives the whole body, not just the lips.
Philipp Lenssen
•
Aug 28, 2024
Sure, and that’s great… but when you make a film you usually have action in the scene to make it more interesting and to push the story forward, engaging the viewer. And cropping the Hedra result and trying to paste it into a moving, possibly rotating scene is bound to fail a lot of the times. That’s why Runway’s lipsync that works on video is so superb — if only it would look better. So there’s a real (paid) niche to be filled in the market still…
Philipp Lenssen
•
Aug 31, 2024
Any response to what I said?
jataylor
•
Mar 13, 2025
Yes please!
Michael Lingelbach
Team•
Apr 26, 2025
Hi Marc,
Let me clarify with you a few things before I merge this ticket into another ticket.
Kling takes a base video and applies lipsync on top of the video
Are you asking for this? Or are you asking to take a base video and use it to drive a second video?
Hedra is an image to video model, not a lipsync tool, to clarify.
Michael
Marc Dahms
•
Apr 26, 2025
Hi Michael,
yes, that’s exactly what I mean. It would be great to have a feature where you can upload an existing video, add an audio file, and then have the lipsync applied to the video. Currently, with Hedra, you take a single image, animate it, and the lipsync is added during that process. However, sometimes I find the animation from Hedra a bit too "jerky" or unnatural, and I would prefer using a pre-existing video instead.
Thanks for clarifying!
Best, Marc
Michael Lingelbach
Team•
Apr 26, 2025
A pre-existing AI video, or a pre-existing real world video? If it’s the former, we’d rather focus efforts on just closing any gap.
Marc Dahms
•
Apr 26, 2025
I mean both and didn't know at this point that it made a difference :) To take the Kling example: There I can upload real videos and AI videos and use them with the LipSync tool. But your LipSync is more consistent than Kling. But Kling's animations are a bit better :) But I would prefer it with you, because you can at least get an answer to questions here ;)
Michael Lingelbach
Team•
Apr 26, 2025
Got it, I’ll merge the ticket then :)
Marc Dahms
•
Apr 26, 2025
P.S: I create music videos on my YouTube channel and use it mainly for singing. So LipSync is already hard enough that it looks good. Vocals are a step above. I think some of these will be similar to what I use in this area.
Here is an example of what I did with your tool. The head movement is quite good here, but the characters sometimes have the urge to look to the side and lose contact with the camera.
Log in to comment and vote
Comments22
Michael Lingelbach
May 13, 2025
Great feature suggestion!
Michael Lingelbach
Nov 28, 2025
•Merged request
•28 votes
Add video-to-video support
Philipp Lenssen
Aug 28, 2024
The single most important feature for film makers that’s currently missing from Hedra. Hope you guys can put it on the roadmap soon. Runway and Pika have such features but they either look bad or won’t work on half the faces, so a better solution is direly needed. Thanks and godspeed!
Michael Lingelbach
Aug 28, 2024
The main reason Hedra looks good is that we holistically generate every frame of the video, audio drives the whole body, not just the lips.
Philipp Lenssen
Aug 28, 2024
Sure, and that’s great… but when you make a film you usually have action in the scene to make it more interesting and to push the story forward, engaging the viewer. And cropping the Hedra result and trying to paste it into a moving, possibly rotating scene is bound to fail a lot of the times. That’s why Runway’s lipsync that works on video is so superb — if only it would look better. So there’s a real (paid) niche to be filled in the market still…
Philipp Lenssen
Aug 31, 2024
Any response to what I said?
jataylor
Mar 13, 2025
Yes please!
Michael Lingelbach
Apr 26, 2025
Hi Marc,
Let me clarify with you a few things before I merge this ticket into another ticket.
Kling takes a base video and applies lipsync on top of the video
Are you asking for this? Or are you asking to take a base video and use it to drive a second video?
Hedra is an image to video model, not a lipsync tool, to clarify.
Michael
Marc Dahms
Apr 26, 2025
Hi Michael,
yes, that’s exactly what I mean.
It would be great to have a feature where you can upload an existing video, add an audio file, and then have the lipsync applied to the video.
Currently, with Hedra, you take a single image, animate it, and the lipsync is added during that process.
However, sometimes I find the animation from Hedra a bit too "jerky" or unnatural, and I would prefer using a pre-existing video instead.
Thanks for clarifying!
Best,
Marc
Michael Lingelbach
Apr 26, 2025
A pre-existing AI video, or a pre-existing real world video? If it’s the former, we’d rather focus efforts on just closing any gap.
Marc Dahms
Apr 26, 2025
I mean both and didn't know at this point that it made a difference :) To take the Kling example: There I can upload real videos and AI videos and use them with the LipSync tool. But your LipSync is more consistent than Kling. But Kling's animations are a bit better :) But I would prefer it with you, because you can at least get an answer to questions here ;)
Michael Lingelbach
Apr 26, 2025
Got it, I’ll merge the ticket then :)
Marc Dahms
Apr 26, 2025
P.S: I create music videos on my YouTube channel and use it mainly for singing. So LipSync is already hard enough that it looks good. Vocals are a step above. I think some of these will be similar to what I use in this area.
Here is an example of what I did with your tool. The head movement is quite good here, but the characters sometimes have the urge to look to the side and lose contact with the camera.
https://www.youtube.com/watch?v=cBJl3brHydo
Dear Woke Christian
Nov 28, 2025
•Merged request
•1 vote
Picture and video sample
Is it possible to use a picture as well as a video clip? The picture is for the look and the video is for the body language.
Abera Getachew
Jan 21
Michael Lingelbach
Jan 23
You can now selection motion control models on hedra.com/app/video
We’ll be adding more models soon.
Aisha imran
Mar 29
Jy Saxena
Jul 13
K okke ka net dalwaya hai kya
S Sx
Jul 20
بسم الله الرحمن الرحيم السلام عليكم ورحمه الله
S Sx
Jul 20
بسم الله الرحمن الرحيم السلام عليكم ورحمه الله