Skip to content
Email Support
  • There are no suggestions because the search field is empty.

Vubbing Multiple Characters in a Single Shot

Visually dub multiple characters within a single shot and composite them all back together.

DeepEditor affects one character per vub. To vub multiple characters in the same shot, you need to generate a separate vub for each character, then use the face merge functionality to composite them together in a single output.

Driving Data

Create separate Driving Data media for each character you want to vub. If your Driving Data is audio, create audio files that each contain only the dialogue for that character.

For example if James and Eleanor are both in a shot and the dialogue for both characters is new:

  • DrivingData_Eleanor.wav - Eleanor's dialogue only
  • DrivingData_James.wav - James's dialogue only

Characters talking over each other? Try separating the voices in your editing sofware. If that's not possible, include both sets of dialogue in a single driving data file.

Workflow

  • Upload your Source media and all Driving Data media files:

multiface_step1_upload_media

 

  • Create a single shot using your Source media:

multiface_step2_create_shot

  • Add the Driving Data in the Shot Media tab for each character.

multiface_step3_add_draving_data

 

  • In the Characters tab, review and name each detected character. It's important to check that all characters have been correctly identified before generating any vubs.

multiface_step4_name_characters

 

  • Generate one vub per speaking character, selecting the correct Driving Data each time. Name each vub clearly, including the character name.

multiface_step5_vub_generation_per_character

 

  • If lip sync refinement is desired, each character must be refined separately. You cannot refine multiple characters in a single refinement session.

multiface_step6_refine_per_character