Using 3D to Video with References (v1.11)

Once the first-frame reference image is generated from 3D to Image in the final render style, it should be used as the initial input frame for 3D to Video generation. It can also be further refined using AI tools in AI Studio or external image editors before use.

1. Set up the 3D scene to generate a First Frame image using the 3D to Image workflow.
2. Go to the 3D to Video tab, then drag the 3D to Image result from the History panel or Windows File Explorer into the Image slot in the 3D Viewport section.
   
   
   Alternatively, click Load Start Frame to Define Style to browse and upload a modified image (.png, .jpg, .jpeg, or webp) derived from the 3D to Image result. Seedance 2.5 also supports .bmp and .gif formats.
   
3. The image will be inserted into the Image slot and resized to match the output resolution based on the selected AI model and video ratio and resolution.
   
   
   Hover over the image thumbnail to view a larger preview, or click the Trash button to remove the current input.
   

1. Animate the 3D scene, then set the Start and End frames to capture a reference video for AI rendering. Use Switch Camera to create multi-shot sequences when needed.
   
   
   Since the maximum video duration varies by AI model, switch to Time mode to monitor the duration between the Start and End frames. Refer to the following table for 3D Viewport video duration limits by AI model.
   
2. Click Capture Video from 3D Viewport in the AI Studio Tools toolbar to send the captured video to AI Studio.
   
   
   If starting from AI Studio, click Capture Video from 3D Viewport in the 3D Viewport section of the 3D Guided Gen tool under the 3D to Video tab.
   
3. The captured video appears in the Video slot of AI Studio, using the preset Video Ratio and Resolution settings.
   
   • Hover over the exclamation mark icon to check the captured video duration and view additional operational notes.
     
   • Hover over the video thumbnail to view an enlarged preview.
     
4. Click Edit 3D Scene to switch to the 3D viewport for scene editing or adjusting the video range.
   
5. The 3D viewport will appear. To minimize the influence of character materials, colors, and facial features on the generated results, replace the characters with motion dummies, available in the free Character Resource Pack.
   
   Using Characters for 3D-Guided Generation

   When generating images or videos, you can choose different character setups based on your production needs. Adding an AI Actor reference allows the AI to maintain character consistency based on the referenced actor rather than the original 3D character assets. The table below summarizes how each character type influences the generated results:

   Character Type	AI Output
   Basic Character Fully textured and shaded 3D character.		The AI may rely too heavily on the original 3D appearance, making characters appear overly CG and reducing creative flexibility.
   Gray Model Character Simplified materials and textures with reduced shading.		Characters appear less CG, and AI Actor references help maintain consistency across shots and camera angles. Facial expressions and movement may still appear somewhat rigid.
   Dummy Character No clothing, textures, or facial features; used only for motion reference.		Appearance is generated entirely from AI Actor references, while the AI automatically infers natural motion with physics-based effects and emotional expressions aligned with the prompt, producing realistic results with strong character consistency even in rear or distant shots.

   Refer to Tutorial - Seedance Consistency with References
6. Change the dummy characters' shading colors to make them easier to identify in prompts. Switch to the Material tab in the Modify panel, select all materials, and set a new Diffuse Color for each dummy character in the Material Settings section.
   
7. Click Capture Video from 3D Viewport in the AI Studio Tools toolbar to send the updated video to the AI Tool using the selected video ratio and resolution.
   
   
   Hover over the video thumbnail to view an enlarged preview of the update.
   

Since the captured video uses dummy characters, AI Actor references are needed to provide additional character information for more accurate and consistent video generation. In the References section, click a reference slot to add inputs that help maintain character appearance and dialogue voice consistency. Supported reference types include AI Actors, images, videos, and audio.


Before adding references, review the requirements for each media type, including format, file size, and duration, as shown below. If a reference does not meet the requirements, a compatibility warning dialog will indicate the issue preventing the upload.

• AI Actor

  Select AI Actor, choose one or more actors from the AI Actor Library, and click Apply AI Actors.
  
  AI Actors marked with a diamond icon in the top-left corner of their thumbnails require an AI Service subscription.
• Image (v1.11)

  Select Image and upload an image, such as an outfit or environment reference. You can also drag images directly from the History panel on the right or Windows File Explorer.
• Video (v1.11)

  Select Video and upload a video reference to inherit character motion, voice, visuals, music, and overall style, enabling seamless extension of an existing video.
• Audio

  Select Audio and upload dialogue audio to define the voice used for actors’ dialogue in the video.

1. Reference Filter: Filters references by All, Image, Video, or Audio, and displays the input count for each type.
2. Video Duration: Displays the current video input duration and the maximum duration supported by the selected AI model.
3. Audio Duration: Displays the current audio input duration and the maximum duration supported by the selected AI model.
4. Reset All:Removes all reference inputs.

Each reference is represented by a label tag in the Prompt field for quick editing and reference assignment. Click the Reset Prompt button to clear the prompt field and start over if needed.

• Drag the tag to reposition it within the prompt.
• Click Copy on a reference thumbnail to insert its tag into the prompt. Alternatively, click Add Reference @ or type @ to select a reference tag from the context menu. Use the Image, Video, Audio, and AI Actor filters to show only references of the selected media type.
  

Adjust the video capture aspect ratio and resolution using the corresponding drop-down menus in the 3D Viewport section to modify the framing and scene composition.

After changing these settings, Capture Video from 3D Viewport again to recapture the video and replace the current content in the Video slot.

Each submitted task uses available AI Points, Bonus Points, or DA Points. View your available points in the bottom-left corner of AI Studio, or click the ... button and select Account Settings to check your point balance.


To obtain more credits, click Plans to subscribe to an AI Service Plan for additional AI Points or purchase DA Points to top up your account.