This article explains everything you need to know about creating a Vub in DeepEditor—from creating a new project all the way to exporting your Vub.
You create a Vub when you generate a new performance on a face model in DeepEditor. A Vub combines your Source Media with new Driving Data and any extra Training Data.
For information on creating this media be sure to check out Media Prep.
DeepEditor is only fully compatible with Google Chrome.
Step 1 - Create a Project
The first time you open DeepEditor, your Home screen will be empty. As you start creating Vubs, you'll see your Media Library populate with the Project folders.
Click "Create First Shot" and a new window will open, so you can name your new project in the Project field. Existing projects will be displayed in the dropdown list.
Tip: We recommend staying organized. Different video projects should be separated by title with the Project title.
Enter a name for your project.
Note* You are creating a library of your Vubs. It is best to name your projects the actual project name or working title in order to easily find them in the future.
Enter and confirm the email address of your Rights Clearance Manager.
Visit our knowledge base for more information on Rights Clearances and A.R.T. Consent Flow.
Step 2 - Name Your Shot
Select "Create Shot" located in the top right corner of the page.
A window will open for you to enter text.
Choose a memorable name for your shot. We recommend including context about what you're uploading, especially if you'll be running the shot multiple times., e.g. V2_with_new_DD (driving data)
Click "Create" once satisfied.
Click on the shot to access the upload section.
Your Vubs will appear in the "Shot" area.
Step 3 - Upload Your Source
Next, upload your Source Upload assets into DeepEditor.
Drag and drop the original shot you'd like to vub. This is your Source Media. (Alternatively, you can click "Add source".)
See "Asset Specifications" for details of compatible file types.
Once the progress bar turns fully green and displays "Done," you're ready to upload your Driving Data.
If you get an error message, upload your asset again, checking the file type is correct. (For example, in the below image, the wrong asset type was selected.)
You can upload a maximum of two Source Media files. This is great if you have more than one shot you want to try with new audio.
Check out our knowledge base for more information about Driving Data
Note: You can upload Source Media and Driving Data simultaneously, without waiting for one to finish before the other.
Step 4 - Upload Your Driving Data
Driving Data is the new dialogue that you would like to use in your Source Media.
Drag and drop your asset or click to select your asset to start the upload.
Once your progress bar turns green and “Done” appears, you can proceed.
If you get a red error message, try uploading your asset again.
See “Asset Specifications” for more information on what content works best.
Optional - Upload Training Data
You can choose to upload additional Training Data here, as well. Training Data is more content of the person you want to Vub. If you have clean shots of the character from other takes or excess footage, you can load it into DeepEditor. This enables DeepEditor to create a more accurate mask and smoother mouth movements.
Like Source Media & Driving Data, drag and drop your asset or click to select your asset to start the upload. You can add up to 10 clips of Training Data.
Your Training Data uploads can take a bit longer to upload than your Source Media & Driving Data.
Please read our knowledge base for more information on Training Data
Step 5 - Create a Vub
Once you have uploaded Source, Driving Data, and Training Data (optional) you will see the "Create Vub" button.
Step 6 - Name Your Vub
At the top of the pop up window, you will see "Vub Name" type the name you wish to name your new file.
Choose a memorable name for your Vub. Our recommendation is to use detailed information and context to stay organized, i.e. V2_with_new_drivingdata
Step 7 - Select Your Output Quality
Select the quality level for your Vub export.
Draft Vub:
A Draft Quality Vub is used for creative decision-making and allows filmmakers to experiment with different storytelling options.
Users can upload offline-quality media, which will be used to generate a Draft Vub. This version can be used during the editing process until you're ready for a full-quality render. Note, in the free trial, you can export three Draft Vubs.
To create a Draft vub, you can use a variety of video and audio specs. See “Asset Specifications” for the full list of media specs. Draft Vubs take about an hour to generate.
Currently, the output file when you “Download latest render” your new vubbed file will be DNxHR SQ and in the native frame rate and aspect ratio.
Standard Vub:
A Standard Quality Vub is similar to a Draft Vub but it will generate a higher quality visual, with less artifacting, but will take longer to do so. Users can upload offline-quality media and it will take about 3-8 hours to generate.
This version can be used during the editing process until you're ready for a full-quality render.
To create a Standard Vub, you can use a variety of video and audio specs. See “Asset Specifications” for the full list of media specs.
Currently, the output file when you “Download latest render” your new Vubbed file will be DNxHR SQ and in the native frame rate and aspect ratio.
After choosing a quality click "Next" at the bottom right of the window.
Step 8 - Choose Data Files
After clicking "Next" you'll be prompted to choose which uploaded files you'll like to use. If you have more than one Source Media or Driving Data uploads, you can select which ones you want DeepEditor to use when generating your Vub.
You must select the Driving Data assets to be used for each Vub.
Click "Next" when finished.
Step 9 - Confirm Your Vub Creation
Lastly, look over all of the information and names you chose. Click "Back" if you'd like to make any changes.
If you approve of all of the information, click "Create".
At this point, exports are exchanged for tokens in your account.
Step 10 - Check Vub Status
After you've created a Vub it will begin to generate. Once finished, you will get an email notification to the email address you used to create your account.
You can check the status in the meantime, navigate to the "Vubs" tab.
Click on the Vub you want to see the generating status.
You'll then see a window open at the right side of your screen. It has the information about the Vub you are generating and a Preview Area. It will also be where you can Refine & Export your completed Vub.
Note: The Preview & Refine quality will not display at the full quality of your export. It is optimized for the web.
In the "Status" column you see "Queued" or "Completed".
Once "Completed" you'll be able to "Export" or "Refine".
See "Refine a Vub" for more information.