Real-time Lip-syncing and Audio Recording

If your webcam has a microphone, then you can synchronously capture the facial expressions along with the voice recording via Face3D by using the Motion LIVE 2D plugin. Alternatively, install a microphone on your computer if an iPhone is the capture device, as iPhone's true depth camera can only transfer facial image data.

Not only the voice of the actor can be recorded, but also the facial expressions with the lip-sync (lip shapes) can be automatically captured and generated at the same time. The benefits are:

  • Recording live audio with the facial capture in one session.
  • Recorded audio generates lip-sync data in real time.
  • Blend lip-sync and motion capture to make a cohesive performance.

( Watch Tutorial - Audio Recording and Real-time Lip Syncing )