Using 3D to Video with References (v1.01)
The 3D Guided Gen tool supports Seedance references to enhance character consistency in generated videos.
In addition to First Frame and Video inputs captured from the 3D viewport, it supports references such as AI Actors and audio, providing greater control over character identity and voice.
This helps maintain a consistent character appearance across multiple shots, dialogues, and camera angle changes, even when characters are viewed from behind or reappear from different perspectives.
See also: Tutorial - Seedance Consistency with References
Required Elements
- Image: First Frame Image (AI-generated). Supported formats: PNG, JPG, JPEG, and WebP.
- Video: Captured Video from Viewport.
- Reference: Up to 7 AI Actors and 3 audio files are supported. Supported audio formats: MP3 and WAV. The First Frame image and captured video motion must originate from the same project to ensure the render style of the First Frame can be consistently maintained throughout the video.
3D to Video Workflow
This workflow guides AI to generate optimized video renders (up to 10 seconds) from existing 3D projects or previz assets.
Select the 3D Guided Gen
tool from the left AI Toolbar and complete the tasks in each section under the 3D to Video tab.
You can collapse or expand a section by clicking its caption.
Select Seedance 2.0 model from the Model drop-down list.

Once the first-frame reference image is generated from 3D to Image in the final render style, it should be used as the initial input frame for 3D to Video generation. It can also be further refined using AI tools in AI Studio or external image editors before use.
- Set up the 3D scene to generate a First Frame image using the 3D to Image workflow.
- Go to the 3D to Video tab, then drag the 3D to Image result from the History panel or Windows File Explorer into the Image slot in the 3D Viewport Video section.

Alternatively, click Load First Frame to Define Style to browse and upload a modified image (.png, .jpg, .jpeg, or webp) derived from the 3D to Image result.
- The image will be inserted into the Image slot and resized to match the output resolution based on the selected AI model and video ratio and resolution.

Hover over the image thumbnail to view a larger preview, or click the Trash button to remove the current input.
- Animate the 3D scene, then set the Start and End frames to capture a reference video for AI rendering.
Use Switch Camera to create multi-shot sequences when needed.

Since AI video output is limited to 10 seconds, switch to Time mode to better monitor the duration between the Start and End frames. - Click Capture Video from 3D Viewport in the AI Studio Tools toolbar to send the captured video to AI Studio.

If starting from AI Studio, click Capture Video from 3D Viewport in the 3D Viewport Video section of the 3D Guided Gen tool under the 3D to Video tab.
- The captured video appears in the Video slot of AI Studio, using the preset Video Ratio and Resolution settings.

- Hover over the exclamation mark
icon to check the captured video duration and view additional operational notes.

- Hover over the video thumbnail to view an enlarged preview.

- Hover over the exclamation mark
- Click Edit 3D Scene to switch to the 3D viewport for scene editing or adjusting the video range.

- The 3D viewport will appear.
To minimize the influence of character materials, colors, and facial features on the generated results, replace the characters with motion dummies, available in the free Character Resource Pack.

Using Characters for 3D-Guided GenerationWhen generating images or videos, you can choose different character setups based on your production needs. Adding an AI Actor reference allows the AI to maintain character consistency based on the referenced actor rather than the original 3D character assets. The table below summarizes how each character type influences the generated results:
Refer to Tutorial - Seedance Consistency with ReferencesCharacter Type AI Output Basic Character

Fully textured and shaded 3D character.The AI may rely too heavily on the original 3D appearance, making characters appear overly CG and reducing creative flexibility.
Gray Model Character

Simplified materials and textures with reduced shading.Characters appear less CG, and AI Actor references help maintain consistency across shots and camera angles. Facial expressions and movement may still appear somewhat rigid.
Dummy Character

No clothing, textures, or facial features;
used only for motion reference.Appearance is generated entirely from AI Actor references, while the AI automatically infers natural motion with physics-based effects and emotional expressions aligned with the prompt, producing realistic results with strong character consistency even in rear or distant shots.
- Change the dummy characters' shading colors to make them easier to identify in prompts.
Switch to the Material tab in the Modify panel, select all materials, and set a new Diffuse Color for each dummy character in the Material Settings section.

- Click Capture Video from 3D Viewport in the AI Studio Tools toolbar to send the updated video to the AI Tool using the selected video ratio and resolution.

Hover over the video thumbnail to view an enlarged preview of the update.
Since the captured video uses dummy characters, AI Actor references are needed to provide additional character information for more accurate and consistent video generation.
In the Reference section, click a reference slot to add inputs that help maintain character appearance and dialogue voice consistency.
Supported reference types include AI Actors and audio.

Before adding references, review the requirements for each media type, including format, file size, and duration, as shown below. If a reference does not meet the requirements, a compatibility warning dialog will indicate the issue preventing the upload.
| Requirements | AI Actor | Audio |
Max number | Up to 7 | Up to 3 |
Formats | iModel | MP3, WAV |
File size | -- | 15 MB max per audio
|
Duration | 2–15 sec |
For example, in a 3D scene with male and female dummies, you can provide AI Actors and dialogue audio to assign characters and their voices.
AudioSelect Audio and upload dialogue audio to define the voice used for actors’ dialogue in the video.
Each reference is represented by a label tag in the Prompt field for quick editing and reference assignment.
Click the Reset Prompt button to clear the prompt field and start over if needed.

- Move tags anywhere within the prompt by cutting and pasting them.
- Click Copy on a reference thumbnail to add its tag to the prompt, or type @ to insert a reference tag from the context menu.

For example, "Pink dummy character is Camila / Blue dummy character is Kevin. This is a disaster movie. Kevin and Camila gaze ahead as a massive, apocalyptic tsunami rapidly approaches. Camila is terrified, tears streaming down her face, as she tremblingly cries out, "God!" Kevin looks back at her, his eyes reflecting a mix of deep dread and calm acceptance. They hold each other close for a poignant farewell, sharing a deeply emotional and passionate final kiss. As they embrace tightly and kiss, a colossal wall of water suddenly surges from behind, instantly engulfing them both in the churning ocean water". |
|
Adjust the video capture aspect ratio and resolution using the corresponding drop-down menus to modify the framing and scene composition.

After changing these settings, Capture Video from 3D Viewport again to recapture the video and replace the current content in the Video slot.
Each submitted task is charged using your available AI, Bonus, or DA Points.
Click the account icon in the bottom-left corner of AI Studio to view your current point balance.
Points are deducted in the following order: AI Points → Bonus Points → DA Points.

To obtain additional credits, subscribe to an AI Service Plan for more AI Points, or purchase DA Points to top up your account.
Ensure both an image and a video are provided to enable the GENERATE button.
Note the task price displayed above the button before clicking.

Track progress on the AI Render View or via the new entry in History on the right.
When the submission completes successfully, the AI-generated video will appear.
Click Play to play the video, Loop to repeat it, or drag the playhead to a specific point.
Next, use the Video or Talking Actor options in the Quick Access Menu at the top of the AI Render View to edit the video or load the generated video as a reference to update the dialogue script if needed.


