Setting Lipsync Data

In the Viseme category of the Facial Profile Editor, you are able to set the Mouth bones, Tongue bone and Mouth shapes for lipsync visemes. After the applying these settings, the character can then talk with adequate lip-shapes in iClone.

  1. Make sure the character has been converted to a Humanoid character.
  2. Click the Face Profile Editor button under the Motion Pose tab in the Modify panel.

  3. Select the Viseme node from the left tree-view, the related sliders will be listed in the right-side pane.

    You can determine if you want to apply the 8 + 7 Phoneme Pair or the 1:1 Direct lipsync systems for the character by clicking the button under the Viseme node.

  4. Adjust the character's face in Bone-based, Morph-based or Hybrid-based methods.
    • ClosedBone-based
      1. Click the Proportion button at the top of the panel.

        The Modify panel will enter the Proportion Mode.
      2. If you are using 8 + 7 Phoneme Pair system, then pick the bone that may be related to the lip-sync around the mouth from the Bone List panel (Shortcut: F3); otherwise, skip this step.
      3. Move and rotate the bone to the desired limit direction in one axis.

        You can type in specific numbers in the Move and Rotate fields in the Proportion panel.
      4. Repeat the same steps for the symmetrical bone on the other side.

        Exit the Proportion mode by clicking the Proportion button again.
    • ClosedMorph-based
      1. Click the Edit Mesh button at the top of the panel.

        The Modify panel will enter the Edit Mesh Mode.
      2. Edit the mesh. This step ensures that the bone and the mesh of the lips will be animated synchronously.
      3. Repeat the step to modify the vertex of the mesh on the other side.

        Click the Edit Mesh button again to exit the Edit Mesh mode.
    • ClosedHybrid-based

      You can compose the character's face with both Bone-based and Morph-based to create Hybrid-based facial expressions.

  5. Click the Quick Update button of a slider (in this case, the V_Lip_Open) for saving the limit data (both bone transformations and the mesh alterations).

    You can drag the enabled slider to check out the result.
  6. Repeat the step for the rest of the sliders under the Viseme node and set adequate limit data.
  7. Once exported to iClone, the character can then talk with proper lip-shapes. You can manually set visemes for this character with the Lips Editor as well.