Synchronous Audio Recording during Facial Capture

If your webcam or headcam has a microphone, then you can synchronously capture the facial expressions along with the voice recording with the iClone Facial Mocap for Faceware plug-in.

Not only the voice of the actor can be recorded, but also the facial expression with the lipsync (lip shapes) can be automatically captured and generated at the same time.

The benefits are:

• Recording live audio with the facial capture in one session.
• Recorded audio generates lip-sync data on the fly.
• Blend lip-sync and motion capture to create a cohesive performance.

1. In iClone, start the Facial Mocap for Faceware Plug-in. For more information about Facial Mocap for Faceware Plug-in, please refer to Workflow for Facial Mocap.
2. Apply a character; make sure it is selected.
   
3. Open the Facial Mocap for Faceware panel (Plugins menu >> Facial Mocap for Faceware >> Facial Mocap for Faceware).
   
4. Activate the Record Audio for Viseme Track checkbox. Select the audio input installed on your PC from the drop-down list.
   
5. Speak while you are capturing the facial expressions in Record mode.
6. Play back the project to observe the character's facial expressions and lipsyncs. You can open the timeline to view the data in their corresponding tracks.
   
   
   Note

   • If you want to further adjust the captured facial expression clips, please refer to Facial Animation Tools for more information.
   • However, if you want to adjust the lipsync viseme, then please refer to Audio Lipsync with Phoneme Pairs for more information.