Avid Extension: Creating Your Vub 

• Explainer Video

• Configuring Default Preferences

• Source Media and Driving Data

• Step 1: Checking your Workspace & Creating a Project

• Step 2: Creating a Shot

• Step 3: Source and Driving Data Creation

• Step 4: Choose Character and Create Vub 

---

 

Explainer Video

 

---

 

Configuring Default Preferences

At any time in the DeepEditor extension, you can access the Preferences menu by selecting the 'sandwich' icon in the top right-hand corner:

Within the Preferences page, there are two options you can configure:

• Default temp media bin
  • From the dropdown menu, select the Avid bin you’d like DeepEditor to use when linking temporary media created during the Load from the timeline process, as described in Step 3 later.

• Default temp media destination
  • This is the folder where DeepEditor will store temporary media files generated during the Load from the timeline process, as described in Step 3 later.
  • .To customize this location, type your preferred directory path directly into the field. 

 

---

  

Source Media and Driving Data

Before creating your first vub, it’s important to understand shots, vubs and the two main assets used in DeepEditor’s visual dubbing (vubbing) workflow - see Introduction to Vub Creation for details.

DeepEditor is designed to work on a single shot basis; the elements needed to vub a shot are:

• Source media - your original shot containing the actor’s performance you wish to adjust. See here to understand what makes good Source media.
• Driving Data - the new dialogue or performance you want to apply to the actor in the Source media. See here to understand what makes good Driving Data.
• Training Data is only needed in certain scenarios and is not supported in the DeepEditor Extension - you would have to use the web app if this was desired. See here to understand when Training Data  can be useful.

The placement of the Driving Data relative to the Source media should take into consideration the actor’s physicality and how it aligns with the new dialogue. Align your Source media and Driving Data in yout timeline to be ready for vubbing. See here for guidance.

---

 

Step 1: Checking your Workspace and Creating a Project

Before creating a project, check you're in the correct workspace. If you're a member of multiple workspaces, you can switch between them via the menu icon in the top-right corner, under Switch workspace.

Then, if you are logging into DeepEditor for the first time you will need to create and name a project.

 

If you’ve already created a project within your workspace, you’ll see your existing projects listed. You can either create a new project or select the one you want to access.

 

---

Step 2: Creating a Shot

Open your project and you will be able to create a new shot.

If your project is new you will see this:

If your project already has shots in it, you can create a new shot using the button in the bottom-right corner:

Selecting to create a new shot will bring you here:

 

---

 

Step 3: Source and Driving Data Creation

The easiest way to load your media into DeepEditor is to load directly from your Avid timeline using the Load from the timeline buttons. 

To do this, you can utilize in/out points and track selection to create your assets. 

• Load Source media:
  • In your timeline, select only the video + audio tracks of the shot containing the original performance you want to adjust (note: selecting audio is optional).
  • Set in/out points for the duration of the shot you want to vub. Optionally, add handles if you want some flexibility later in the edit.
  • Click Load from the timeline in the Source media section of the DeepEditor Extension.
• Load Driving Data:

• • In your timeline, deselect the video and audio tracks that contained the Source media.
  • Keep the in-out points as they were when you uploaded the Source media.
  • If you are using audio only as Driving Data, select only the audio track containing the new dialogue.
  • If you are using video as your Driving Data, select both the video + audio tracks containing the new performance. The video will drive the new performance, but you will need the audio to be present if you choose to refine your vub in the web app.
  • Click Load from the timeline in the Driving data section of the DeepEditor Extension.

 

 

Once your Source media and Driving Data are set up, you can Create shot & process media.

The media will then be uploaded to DeepEditor. When the upload is complete, the video media will be analyzed to detect and identify all faces. 

---

     

Step 4: Choose Character and Create Vub

Once your Source media and Driving data are analyzed, you’ll be prompted to select two options before creating your vub:

 

Select Character to Vub

You’ll see thumbnails of all detected faces labeled (e.g. Character 1, Character 2). You must select which character you wish to vub.

If, during the face identification stage, one or more characters were unable to be identified, you will be notified in this window that there are unassigned appearances:

When this happens, it is important to check these unassigned appearances. If they are instances of the character you want to vub, their identity needs to be assigned. Use the link in the bottom right of the character section to navigate to the web app Characters tab for your shot and validate the character appearances - see here for guidance. 

If you do make updates to the character appearances in the web app, these will be reflected straight away  in the DeepEditor Extension:

 

Select Vub Quality Level 

The vub quality determines the maximum resolution, maximum bit depth and available file formats of the vub you generate. See DeepEditor Token Types & Pricing for details.

Assuming you are using offline quality media in your Avid timeline, your quality section should almost certainly be Draft. You would only use Final quality if there are certain restriction you wish to overcome, or are mastering using your Avid media.

Once the above is selected, click Create Vub.

 

You will be returned to the list of Shots & Vubs where you can monitor the status of your vub

---

 

Read next: Avid Extension: Downloading Your Vub

Go back to top