Skip to content
  • There are no suggestions because the search field is empty.

How to Vub Multiple Characters in One Shot

DeepEditor can visually dub multiple characters within a single shot and auto-composite them back into a single plate.

DeepEditor changes the spoken performance of one character per vub. To vub multiple characters in the same shot, you generate a separate vub for each character, then use Merge Exports to auto-composite them into a single output.

Driving Data

You should already be familiar with source media preparation. The key difference in a multi-face workflow is your driving data.

Create a separate .wav file for each character you want to vub, each containing only the clean dialogue for that character.

For example if James and Eleanor are both in a shot and the dialogue for both characters is changing:

  • DrivingData_Eleanor.wav - Eleanor's dialogue only
  • DrivingData_James.wav - James's dialogue only

Characters talking over each other? Try separating the voices in a non-linear editor. If that's not possible, include both sets of dialogue in a single driving data file.

Workflow

Upload Media Upload your source media and all driving data files.

multiface_step1_upload_media


 

Create One Shot Create a single shot using your source media.

multiface_step2_create_shot


 

Add All Driving Data In the Shot Media tab, add the driving data files for all characters.

multiface_step3_add_draving_data


 

Review and Organize Characters In the Characters tab, review and name each detected character. It's important to check that all characters have been correctly identified before generating any vubs.

multiface_step4_name_characters


 

Generate a Separate Vub for Each Character Generate one vub per speaking character, selecting the correct driving data file each time. Name each vub clearly, including the character name is best practice.

multiface_step5_vub_generation_per_character


 

Refine Each Vub (if needed) Refinement is not always required, but if it is needed, each character must be handled separately. You cannot refine multiple characters in a single session.

multiface_step6_refine_per_character


 

Merge Exports Once all per-character exports are ready, head to the Exports tab, select the exports you want to combine, and click Merge multiple exports. This is what brings everything together, a single composited output with all visually dubbed faces in one plate.

multiface_step7_merge_exports

 

Note: You'll get an error if you try to merge vubs of the same character, different quality levels, different source media, or an already-merged export.