Skip to content
Email Support
  • There are no suggestions because the search field is empty.

How To Create a Vub

Step-by-step guide to generating a vub

Step 1 - Create a Project
Editing Project Type
Localisation Project Type

Step 2 - Create a Shot

Step 3 - Upload Media

Step 4 - Generate a Vub

Step 5 - Vub In Progress to Completed

A vub is a visual dub that combines your Source Media (original shot) with Driving Data (new performance).

Step 1 - Create a Project

CreateProject

  • Click Create Project
  • Name your project (note that currently a project cannot be renamed once created)
  • Choose Project Type
The choice of project type is related to the Artistic Rights Treasury - DeepEditor's system for managing consent. Read the guidance below about when to choose "Editing" and when to choose "Localisation".

 

Editing Project Type

If your intended use for DeepEditor is to alter performances, select the "Editing" project type. You will then be prompted to input the email address of your Rights Clearance Manager.

editing choice

Localisation Project Type 

If your project includes a legal "Dubbing Agreement" or comprehensive consent from the talent (or an authorized representative of their estate or interests) for facial modifications, select the "Localisation" Project Type.

localization choice

Selecting "Localisation" means you can bypass the Artistic Rights Treasury process.

We trust our customers to act in good faith regarding the legal implications of opting to bypass the Artistic Rights Treasury.

Step 2 - Create a Shot

Create a Shot_preMultiface1
  • Select Create First Shot or Add Shot in the top right corner of the page.
  • Name your shot
We recommend including context about what you're uploading, especially if you'll be running the shot multiple times. Note that it is currently not possible to rename a shot once it's been created.
  • Click Create
  • Click on the shot to access the upload section under the Media tab

Step 3 - Upload Media

See Supported Media Formats for details of compatible file types.

UploadMedia

  • Upload your Source Media - this is the original shot you'd like to vub.
    • Drag and drop the original shot you'd like to vub or click Add source
    • You can upload a maximum of two Source Media files (this is intended for a proxy and a full resolution media file)
    • To upload EXR sequences click Add source and then Via Media Shuttle
  • Upload your Driving Data - this is the new audio you'd like to transfer to your Source Media.
  • Your Driving Data must have the same frame rate and frame count as your Source media. 
  • If you upload a video file as Driving Data, DeepEditor will transfer the video performance to your Source media. Any audio present in the video file will be present in the final vub, but it will not drive the performance.
  • You must upload audio only as driving data if you want to drive the performance in the final vub with audio.

Note: You can upload Source Media and Driving Data simultaneously, without waiting for one to finish before the other.

  • Upload your Training Data (optional) - this is additional footage of the same person you want to vub. It teaches DeepEditor the unique mouth movements of the person in more detail and produce better results. The person must be speaking and in the same lighting conditions and head poses as your source media.  Aim to upload at least 15 seconds of training data. You can add up to 40 clips of Training Data of up to 1,440 frames each. 

Note: Vubs with Training Data can take up to 24 hours to render depending on how much Training Data is uploaded.

Step 4 - Generate a Vub

Once you have uploaded Source, Driving Data, and Training Data (optional) you can create your vub by clicking on the "Generate Vub" button. 

CreateVubpreMultiface

  • Enter a Vub Name
  • Select the Vub Quality Level and click Next
  • Review the media that will be used for the vub and click Next
  • Click Create to start the vub generation. A token will be deducted from your account at this stage. This is the only step in DeepEditor where a user is charged a token.

You can now close the webpage if you wish. You will be notified by e-mail when your vub is ready.

Step 5 - Vub In Progress to Completed

In the Vub tab, your newly created vub will be displayed with status "In Progress".

CheckVubStatuspreMultiface

When your vub is ready, you will get an e-mail notification. 

Email notification

Note: Generating a vub can take between 1 and 24 hours depending on the duration and resolution of your media and whether you have uploaded Training Data.

Here are the average times it currently takes to generate a vub based on the Quality setting you select and whether you have uploaded Training Data:

Quality Level Average Time to Generate
Draft 2 hours
Draft with Training 4 hours
Standard 2 hours
Standard with Training 11 hours
Professional 2 hours
Professional with Training 11 hours
Theatrical 2 hours
Theatrical with Training 11 hours

Clicking on a vub row will open a window on the right side of your screen that shows more information about your vub.

VubCompletedSidePanelpreMultiface

Note: What you see in the Preview and in the Refine tool is not the full quality resolution of your export, but a version optimized for web playback.

Read Refine a Vub for more information on how to refine your vub. You can refine, render and export vubs multiple times without being charged.