Open topic with navigation

Basic Workflow for LIVE FACE (New for v3.3)

With the LIVE FACE app for iPhone X, the most exquisite facial expressions can now be quickly captured and instantly applied onto virtual character in CrazyTalk Animator.

Flow chart for facial motion data capture

  1. LIVE FACE iPhone X App: Captures and passes human facial feature' motion data to the Facial Mocap Panel inside of CrazyTalk Animator (B).
  2. Facial Mocap Panel of CrazyTalk Animator: Receives facial motion data from LIVE FACE iPhone X App (A) and applies it to a virtual character in the viewport.
  3. The final result can be seen in the viewport of CrazyTalk Animator.
Closed Hardware and Software Requirements
Closed Hardware Requirements
Closed Software Requirements
  • CrazyTalk Animator Pro or Pipeline version 3.3, or higher.
  • The Free LIVE FACE from the Mac App Store.
Closed Connect LIVE FACE and CrazyTalk Animator

Connect the iPhone X to your computer, and make sure that they are in the same domain. You may connect to the same Wi-Fi network or use the iPhone X's hotspot to share Wi-Fi internet.

Connecting to a same Wi-Fi network Using iPhone hotspot to share Wi-Fi internet
Closed For Windows Users

Make sure your computer has a wireless LAN card embedded in order to detect Wi-Fi networks. Then turn on Wi-Fi and connect your iPhone X and computer to the same Wi-Fi network from the list.

Alternatively, if your mobile data connection is enabled, you could share Wi-Fi internet from the iPhone to the computer.

  1. On your iPhone, go to Settings > Cellular > Personal Spot and turn it ON. If your Wi-Fi is disabled, select Turn on Wi-Fi.
    * Stay on this screen and wait until the computer is connected to the Wi-Fi network.
  2. On a Windows computer, look for the iPhone hotspot in the Wi-Fi list and get connected.

Launch the LIVE FACE on your iPhone X and start your first facial capture project.

Closed For Mac Users

Turn on Wi-Fi and connect your iPhone X and computer to the same Wi-Fi network from the list.

Alternatively, if your mobile data connection is enabled, you can share Wi-Fi internet from the iPhone to the computer.

  1. On your iPhone, go to Settings > Cellular > Personal Spot and turn it ON. If your Wi-Fi is disabled, select Turn on Wi-Fi.
    * Stay on this screen and wait until the computer is connected to the Wi-Fi network.
  2. On a iMac or Macbook, look for the iPhone hotspot in the Wi-Fi list and get connected.

Launch the LIVE FACE app on your iPhone X and start your first facial capture project.

Closed Start Your First Facial Capture Project

Please follow the steps below to capture your facial performance. ( View video )

  1. Launch the LIVE FACE App on your iPhone X. You will see your face on the screen through the front camera, and the Face ID bars on the bottom will keep changing while you make expressions. Notice the popup tip with an IP address. If it disappears, tap the Info icon on the left-top to show the tip again.
  2. Return to CrazyTalk Animator. Apply and select a desired character from the Content Manager. In this case, we applied a character with a front face.
  3. Click the Facial Mocap button on the Functional Tool Bar to launch the Facial Mocap Panel. Alternatively, you may click the Animation >> Facial Mocap command on the Top Menu bar.
    The Facial Mocap panel will show.
  4. Click the Server Settings button to open the Server Settings dialog. Type in the IP address shown on your iPhone X in Step 1, and then click OK.
  5. Click the Connect button. When the computer is successfully connected to the iPhone, the light ON/OFF signal inside the Connect button will turn green, and a blue success message will appear on the LIVE FACE App.
    If you are disconnected from the iPhone, then click the Connect button again to resume the connection.
  6. You may click the Tracking Data Inspector button to open the inspector and observe whether the computer has received your facial motion data (Face ID stream) from the iPhone X. The Face ID bars on the inspector will keep constantly changing.
  7. Click the Preview button to preview your real human facial expressions on the virtual character. For better capture results, click the Zero Pose button to initialize the facial expression.
  8. When you are satisfied with the mocap results, click the Record button to start recording.
  9. Open the Timeline and click the Face button, you will find the recorded facial mocap clip stored in the Facial Clip track.