Skip to content
Email Support
  • There are no suggestions because the search field is empty.

Training Data

Improve the quality of your vub by uploading Training Data

 

What is Training Data

Training Data is additional footage of the character you want to vub. You can upload this into DeepEditor to help generate a more accurate vub.

NOTE: Additional Training Data can only be added to Standard, Professional and Theatrical Vubs.

How Training Data Works

Training data enables DeepEditor to learn how the face of the person you are vubbing moves, so it can produce better results.

DeepEditor will go through and add extra detail to the model based on the video frames in your Training Data.

Training Data Requirements

To get the best results use footage that is really similar to your Source media (e.g. alternate takes) and meets the following criteria:

  • The person is speaking and their mouth interior is visible (this helps DeepEditor learn the way the person's mouth moves when they speak)
  • The person's face position and angle is very similar to the Source media
  • Lighting and background are very similar to the Source media
  • There are at least 15 seconds of footage showing a variety of mouth shapes (footage can be in separate video clips)
  • Each clip features the same actor as the Source media
  • The person's face is clear and unobstructed
  • The media is compliant with the DeepEditor Supported Media Formats

Uploading Training Data

Drag and drop training data files or click Add Training Data in the Training Data section of the Media tab. Currently, you can upload a maximum of 40 video files of up to 1,440 frames each.

To upload EXRs, click on Add Training Data and select Via Media Shuttle.

Screenshot 2025-06-05 at 12.06.22

When uploading EXRs, drag and drop the folder containing the EXRs and not the individual EXRs themselves (there is a limit of 100 files if uploading individual EXRs).

Once you have uploaded your training data files, you will be prompted to select which files you want to use to create your Vub.

Your Training Data can take a bit longer to upload than your Source Media & Driving Data.

NOTE: Vubs with Training Data will take longer to render. Completion can take up to 12 hours, depending on the amount of Training Data you uploaded.

However, the results are much better when you add Training Data.

Here is an example of how adding Training Data can improve your Vub.

Source

Vub without Training Data

Vub with Training Data

In the final image, with Training Data, you can see the teeth and the inside of the mouth are much more clearly defined.