Topic: Digital Face tracking and lip sync

I'm learning how to track, compose and do lip syncing.

For now I've managed to get the face tracked on top of a clean head.
There are some flaws, as this was a quick test to see if my idea to get it done will work.

Next step will be adding audio and create a face with lip movement.


http://www.youtube.com/watch?v=UQPPXReVxEY


Here's a pic of how it was done.
http://titanpictures.com/DS/lipsyncmask3.jpg

Re: Digital Face tracking and lip sync

That's very interesting. Do you have to align the face frame by frame, or is there an auto track feature there?

Re: Digital Face tracking and lip sync

Looks like a good start. I look forward to seeing a more involved test with a longer animation (higher framerate/smoother?) and some lip sync.

If anything the face seems a bit too sharp for the image - try to match the blur level closer.

THAC XIV entry here: (Never) Meant To Be

Re: Digital Face tracking and lip sync

I do it frame by frame. From the whole process to get one face lip synced and rotoscoped this is the easiest part.

Re: Digital Face tracking and lip sync

Sean wrote:

Looks like a good start. I look forward to seeing a more involved test with a longer animation (higher framerate/smoother?) and some lip sync.

If anything the face seems a bit too sharp for the image - try to match the blur level closer.

Thanks. I'll do that.

In the footage with the original face there's actually color bleeding around the edges that makes it look blurrier, I'm still working on that.

Last edited by TitanPictures (October 10, 2011 (05:20pm))