Skip to content
  • There are no suggestions because the search field is empty.

How To Create a Vub

Step-by-step guide to generating a vub

Step 1 - Create a Project
      Editing Project Type
      Localisation Project Type
Step 2 - Create a Shot
Step 3 - Upload Media
Step 4 - Generate a Vub
Step 5 - Vub In Progress to Completed 
A vub is a visual dub that combines your Source Media (original shot) with Driving Data (new performance).

 

Step 1 - Create a Project

  • Click Create Project
  • Name your project (note that currently a project cannot be renamed once created)
  • Choose Project Type
    • If you choose the Editing project type, enter and confirm the e-mail of the Rights Clearance Manager for the project, then click "Create".
    • If you choose the Localisation project type, click "Create" to proceed.

The choice of project type is related to the Artistic Rights Treasury - DeepEditor's system for managing consent. Read the guidance below about when to choose "Editing" and when to choose "Localisation".

Editing Project Type

If your intended use for DeepEditor is to alter performances, select the "Editing" project type. You will then be prompted to input the email address of your Rights Clearance Manager.

Localisation Project Type

If your project includes a legal "Dubbing Agreement" or comprehensive consent from the talent (or an authorized representative of their estate or interests) for facial modifications, select the "Localisation" Project Type.

Selecting "Localisation" means you can bypass the Artistic Rights Treasury process.

We trust our customers to act in good faith regarding the legal implications of opting to bypass the Artistic Rights Treasury.

Step 2 - Create a Shot

  • Select Create First Shot or Add Shot in the top right corner of the page
  • Name your shot

We recommend including context about what you're uploading, especially if you'll be running the shot multiple times. Note that it is currently not possible to rename a shot once it's been created.

  • Click Create
  • Click on the shot to access the upload section under the Media tab.

Step 3 - Upload Media

See Supported Media Formats for details of compatible file types.

  • Upload your Source Media - this is the original shot you'd like to vub.
    • Drag and drop the original shot you'd like to vub or click "Add source".
    • You can upload a maximum of two Source Media files (this is intended for a proxy and a full resolution media file).
    • To upload EXR sequences click "Add source" and then "Via media shuttle".
  • Upload your Driving Data - this is the new audio you'd like to transfer to your Source Media.
  • Your Driving Data must have the same frame rate and frame count as your Source media. 
  • If you upload a video file as Driving Data, DeepEditor will transfer the video performance to your Source media. Any audio present in the video file will be present in the final vub, but it will not drive the performance.
  • You must upload audio only as driving data if you want to drive the performance in the final vub with audio.

Note: You can upload Source Media and Driving Data simultaneously, without waiting for one to finish before the other.

  • Upload your Training Data (optional) - this is additional footage of the same person you want to vub. It teaches DeepEditor the unique mouth movements of the person in more detail and produce better results. The person must be speaking and in the same lighting conditions and head poses as your source media.  Aim to upload at least 15 seconds of training data. You can add up to 40 clips of Training Data of up to 1,440 frames each. 

Note: Vubs with Training Data can take up to 24 hours to render depending on how much Training Data is uploaded.

Step 4 - Generate a Vub

Once you have uploaded Source, Driving Data, and Training Data (optional) you can create your vub by clicking on the Generate Vub button. 

  • Click on Generate Vub
  • Enter Vub Name
  • Choose your preferred Quality Level
  • Select the character you want to vub
  • Click on View Character Appearances to check that these have been identified correctly. If you need to make changes, go to the Characters tab to do so.
  • Click Next and select your Source media, Driving data and Training data (if using)
  • Click Next to check all details, then click Create to start the vub generation process

You can now close the webpage if you wish. 

Step 5 - Vub In Progress to Completed

In the Vub tab, your newly created vub will be displayed with status "In Progress".  

When your vub is ready, you will get an e-mail notification. 

Note: Generating a vub can take between 1 and 24 hours depending on the duration and resolution of your media and whether you have uploaded Training Data.

Here are the average times it currently takes to generate a vub based on the Quality setting you select and whether you have uploaded Training Data:

Quality Level

Average Time to Generate

Draft

2 hours

Draft with Training

4 hours

Standard

2 hours

Standard with Training

11 hours

Professional

2 hours

Professional with Training

11 hours

Theatrical

2 hours

Theatrical with Training

11 hours

Clicking on a vub row will open a window on the right side of your screen that shows more information about your vub.

Note: What you see in the Preview and in the Refine tool is not the full quality resolution of your export, but a version optimized for web playback.

Read Refine a Vub for more information on how to refine your vub. You can refine, render and export vubs multiple times without being charged.