Live Footage and CGI Integration

Integrating CGI and VFX with live footage requires precise synchronization of motion, audio, and video elements. iClone Timecode eliminates alignment guesswork by enabling frame-accurate synchronization directly within iClone’s real-time environment, ensuring sample-accurate sync for motion capture, facial animation, and audio playback. This maintains broadcast-quality alignment (at 1 millisecond tolerances) while streamlining production workflows.

  1. Make sure the audio recorder (microphone) and video camera are connected to timecode generators.

  2. Start the recording process for all devices.

    The devices on the male actor:

    • Microphone - records voice
    • Facial mocap device (iPhone) - captures facial expressions
    • Body mocap device - captures body motions
    • All are connected to timecode generators (time-synchronized)

    In the left illustration, the video camera is connected to a time-synchronized timecode generator and shoots the female actor with the main scene.
  3. Create an iClone project with a character within. Audio, facial expressions, and mocap will be applied onto this character.
  4. Import the motion and facial expression onto the character.

    Check out the timecode of the clip on its tip.
  5. Manually set the approximate start timecode of the project in accordance with the timecode of the clips.
  6. Right-click on one of the clips and choose Align Clip to Embedded Timecode.
    The clip will be repositioned to an accurate timeframe.

    Repeat the same step for the other clip.
  7. Import the timecoded voice file as a sound track for the character.

    Repeat the same step to align the clip to the correct timecode position.
  8. Open the Project panel and double click on the slot in the 2D Background section to load the timecoded video (from step 1).
  9. The video will be deployed as a 2D background to the scene.

    You can view the 2D GB Video track in the timeline under Project.
  10. Right click on the clip and align it to the correct timeframe.
  11. Use the timeline markers to set the desired playback range.
  12. You can also apply post effect to achieve an ideal tone.

    The scene without post effect.

    The same scene with post effect.

  13. Playback to view the final results.