# Quick Start Guide: Real-Time Retargeting in Unreal Engine with Live Link Content ## Requirements * Motive 3.1 or higher * Unreal Engine 5.5 * OptiTrack Live Link Plugin 5.5 ## Setup ### Install Live Link Plugin This step is completed once per computer. * Download and unzip the latest version of the OptiTrack Live Link Plugin from the OptiTrack [Download ](https://www.optitrack.com/support/downloads/plugins.html)site. * Place the plugin files into one of the following directories: * A global engine plugin can be placed in `C:\Program Files\Epic Games\ [Engine Version]\ Engine\ Plugins` * A project-specific plugin can be placed in `[Project Directory]\Plugins` ### Enable Plugin in Unreal Engine This step is completed with each new project. Go to *Edit → Plugins* and enable the two required plugins: * **OptiTrack - Live Link** plugin, located under the *Installed* group. This is the plugin downloaded in the previous step. * Unreal Engine's built-in **Live Link** plugin. {% hint style="info" %} Search for *Live Link* on the plugins window to find these and other Live Link related plugins. {% endhint %} Allow Unreal Engine to restart, then close the plugin window when the project reloads. {% hint style="info" %} **Show Content** To show the OptiTrack plugins folder in the Content Browser, click the Settings button in the Browser's top right corner and check the boxes to *Show Engine Content* and *Show Plugin Content*. {% endhint %} ### Motive Streaming Settings To enable streaming in Motive, click the

button to open the [*Applications Settings*](https://docs.optitrack.com/v3.2/motive-ui-panes/settings) panel, then select the [*Streaming* ](https://docs.optitrack.com/v3.2/motive-ui-panes/settings/settings-streaming)tab, or use the

button in the right corner of the [Control Deck](https://docs.optitrack.com/v3.2/motive-ui-panes/control-deck) to open the *Streaming* tab directly. * In the *NatNet* section, select ***Enable*** to begin streaming. * Select the **Local Interface**. Use Loopback if streaming to the same computer, otherwise select the IP address for the network where the client application resides. * Set the **Bone Naming Convention** to *UnrealEngine*. * Set the **Up Axis** to Y-Axis. The plugin will bring the data in with a Y-Forward orientation. Please see the [Data Streaming](https://docs.optitrack.com/v3.2/motive/data-streaming) page for more details on all settings available for streaming.

Application Settings Panel: Streaming Tab, Streaming enabled.

## Connect Motive to Unreal Engine * In Unreal Engine, open Live Link Hub from the *Tools* menu *o*n the toolbar, if it's not open already. Under *Virtual Production,* select *Live Link Hub.* * Click the

button in Live Link Hub to add a new Live Link source. * Select *OptiTrack Source*, check *Connect Automatically,* or enter the IP address for the Motive PC in the *Server Address* field, the IP address for the Unreal PC in the *Client Address* field. Enter 127.0.0.1 in both fields if running both on the same PC. Click create.

Add a Live Link source in Unreal Engine.

Live Link will display information about the connection, including a list of assets streaming from Motive:

OptiTrack Live Link Connection in Unreal Engine.

### OptiTrack Live Link Display The OptiTrack Live Link Display provides validation that the data is streaming in correctly from Motive. In the Unreal Engine Outliner pane, all assets in the Motive volume should nest under the OptiTrack Live Link Display. #### Add OptiTrack Live Link Display Click the

Quick Add button and start typing *OptiTrack* over the menu to activate the search function. Select the OptiTrack Live Link Display from the list of available options and drop it into the scene in the desired location.

Play the *Take* file when working with recorded data to see the Live Link assets in the Viewport. Once the assets are available, you can pause playback and the assets will still be displayed. Once you have validated the Live Link connection, we recommend turning off Live Link asset visibility to improve performance as you work through the rest of the pipeline. * Select *OptitrackLiveLinkDisplay* in the Outliner panel. * The properties for the *OptitrackLiveLinkDisplay* will populate in the Details pane. * In the *Assets* section, uncheck *Display Assets*.

Assets section of the Details pane for the OptitrackLiveLinkDisplay: Display Assets highlighted.

{% hint style="info" %} Turn the *Display Assets* setting on or off as needed throughout the workflow. {% endhint %} ## Retargeting to MetaHumans Retargeting is the process of applying an existing animation model to a character, at the correct scale. In this section, we'll demonstrate the retargeting workflow using skeleton data streaming from Motive and retarget it to a MetaHuman in Unreal Engine in real-time. For each MetaHuman, we'll create the following in Unreal Engine: * A Retargeter to map the Motive Animation data to the correct Skeletal Meshes in Unreal. * An Animation Blueprint for the Motive Avatar. * An Animation Blueprint for the MetaHuman. * A Blueprint for a MetaHuman character. For more information and tutorials about working with MetaHumans in Unreal Engine, please visit [Epic Games' MetaHuman community](https://dev.epicgames.com/community/metahuman). {% hint style="info" %} This workflow is fine-tuned specifically for MetaHumans, but it can be used for characters with unique custom skeletons as well. {% endhint %} #### Y-Forward vs. X-Forward Axis MetaHuman joints use a Y-Forward axis, and the plugin brings the data in using this orientation. Prior versions of the plugin used an X-Forward axis for the skeletal mesh, with adjustments made to the linked asset in Unreal Engine. To work with legacy assets configured for an X-Forward axis: * From the LiveLink tab, select OptiTrack to display the LiveLink properties. * In the *Coordinates* section, uncheck *Animate Y-Forward*.

Live Link settings: Animate Y-Forward property.

### Add MetaHuman We'll start the workflow by adding the MetaHuman to the project. This will create a folder structure in the project to consolidate the content related to each individual MetaHuman. We'll use these folders to save the Retargeter and the two Animation Blueprints we need to complete the retarget. #### Add the MetaHuman to the Project To add a new MetaHuman to your project: * Click the Quick Add button

and select *Quixel Bridge.* * Select either a new MetaHuman from a preset to download or browse the local collection for any previously downloaded MetaHumans. * Once the MetaHuman is downloaded, a green arrow will appear in the upper left corner of the profile picture. Click the blue arrow in the upper right corner to add the MetaHuman to your project.

* The Content Browser will have a new *MetaHumans* folder within the *Content* folder. Each MetaHuman has their own folder, which contains their Blueprint and all the content needed to render them.

MetaHuman content in the Content Browser in UE.

#### Copy the MetaHuman Blueprint We recommend using a copy of the MetaHuman when setting up the retarget. This allows you to take the data that comes from the MetaHuman in the retarget during production and add it to the original MetaHuman later in post-production. To create a copy, right-click the Blueprint and select *Duplicate*, or use the keyboard shortcut *Ctrl + D*. We suggest using a simple convention such as *BP\_<*MetaHumanNam*e>\_Retarget* for all copies.

MetaHuman Blueprints: Original and Copy.

Now that the file structure for the MetaHumans is setup, we can create the Retargeter and the two Animation Blueprints. We'll update the MetaHuman Blueprint once these are done. ### Create Retargeter * In the Content Browser, browse to and open the folder for the MetaHuman. * Right-click the Content Browser and select *Animation -> Retargeting -> IK retargeter*. * Name the retargeter. We recommend a name such as *IKR\_Motive\_to\_Meta*. #### Set Retargeter Source and Target Open the newly created retargeter. In the Details pane, update the Source and Target values as follows: * **Source IKRig Asset:** IK\_MotiveAvatar\_Opti * **Source PreviewMesh:** * Female avatars: SKM\_F\_MotiveAvatar\_Opti * Male avatars: SKM\_M\_MotiveAvatar\_Opti * **Target IKRig Asset:** IK\_metahuman * **Target Preview Mesh:** * Female avatars: f\_med\_nrw\_body * Male avatars: m\_med\_nrw\_body {% hint style="success" %} The *Preview Mesh* fields will auto-complete once the *IKRig Asset* is selected. {% endhint %} #### Align Skeletons The Viewport will show that the two skeletons are not properly aligned. This occurs because the skeletons are in different poses.

Click the Running Retargeter button in the upper left corner to stop the retargeter and switch to edit mode. The button will update to *Editing Retarget Pose.*

Click the Auto Align button

and select *Align all Bones t*o complete the alignment. The retarget will now display correctly in the Viewport.

### Motive Avatar Animation Blueprint * Right-click the Content Browser and select *Animation -> Animation Blueprint*.

Add Animation Blueprint in Unreal Engine.

In the *Create Animation Blueprint* Search bar, type *Opti*, then select the *SK\_MotiveAvatar\_Opti* skeleton. Give the newly created Animation Blueprint a name, such as *ABP\_MotiveAvatar*.

Create Animation Blueprint: Select template.

* Double-click the new Animation Blueprint to open the AnimGraph window. * Right-click in the graph area and type *Live Link Pose* in the Search field, then select the node that appears. * In the Live Link Pose node, use the dropdown list under *Live Link Subject Name* to select the actor whose skeleton will be used for the Motive avatar. * To connect the two nodes, click the *Result* icon in the Output Pose and drag it to the corresponding icon on the Live Link Pose.

Click the Result icon to connect the Output Pose...

* Click the Compile button, then Save. The Compile button will update as all changes are incorporated:

### MetaHuman Animation Blueprint * Right-click the Content Browser and select *Animation -> Animation Blueprint*. * On the Create Animation Blueprint window, select the *metahuman\_base\_skel* skeleton. * We suggest a naming convention such as *ABP\_*\*\_Meta.* Name, then open the newly created animation blueprint. * Right click the AnimGraph. From the list of *All Actions*, search for and select *Retarget Pose From Mesh*.

Unconfigured Retarget Pose from Mesh in UE.

* Select *Retarget Pose from Mesh* in the AnimGraph to display its properties in the Details pane. * Find *IKRetargeter Asset* in the Settings section. * Click the

button and select the IK retargeter created in the [prior step](#create-retargeter-asset).

IKRetargeter Asset - with Retargeter Asset selected.

* Drag the *Output Pose* Result icon to the corresponding icon on the *Retarget Pose From Mesh* node to link the two.

* Click the Compile button, then save. ### Update MetaHuman Blueprint #### Add Skeletal Mesh and Skeletal Animation * Open the [MetaHuman Blueprint](#copy-the-metahuman-blueprint) created in a prior step. * Click the *Viewport* tab to see the MetaHuman character. * In the Components panel, Click the

Add button and select *Skeletal Mesh*. * Name the new mesh something distinct, such as *OptiTrackSkeletalMesh*. * Drag the body component of the MetaHuman under the new skeletal mesh. * The Components should now look like this:

Skeletal Mesh added to a MetaHuman in UE.

* Next, add the *Live Link Skeletal Animation* component. This will allow playback to start once the animation blueprint is attached. * To improve performance while streaming to MetaHumans, click the *LODSync* component. In the Details pane, go to *LOD -> Forced LOD* and change the setting to 1. * Click Compile to update the Blueprint, then save. #### Apply Animation Blueprints to Skeletal Meshes * In the *Components pane*, select the OptiTrack [skeletal mesh](#link-metahuman) created previously. * In the Details pane, go to *Animation -> Anim Class*. * Use the drop-down to search for and select the [Motive Avatar Animation Blueprint](#motive-avatar-animation-blueprint) created earlier.

Animation Details for the OptiTrack Skeletal Mesh Component in UE.

* With the OptiTrack skeletal mesh still selected, go to *Mesh -> Skeletal Mesh Asset*. * Type *Opti* in the dropdown's search bar to quickly find the applicable Motive Avatar. This should match the the Source Preview Mesh used in the [IK Retargeter](#set-retargeter-source-and-target) created earlier: * Female avatar: SKM\_F\_MotiveAvatar\_Opti * Male avatar: SKM\_M\_MotiveAvatar\_Opti

Skeletal Mesh Asset for the OptiTrack Skeletal Mesh component in UE.

* In the *Components pane,* select the skeletal mesh for the MetaHuman. This is the *Body* previously moved to nest directly below the OptiTrack Skeletal mesh. * In the Details pane, go to *Animation -> Anim Class*. * Use the drop-down to search for and select the [MetaHuman Animation Blueprint ](#metahuman-animation-blueprint)created earlier.

Animation Details for the MetaHuman Skeletal Mesh.

* With the MetaHuman (body) skeletal mesh still selected, go to *Mesh -> Skeletal Mesh Asset*. * Select the same mesh used in the Target Preview Mesh in the IK Retargeter created earlier: * Female avatar: f\_med\_nrw\_body * Male avatar: m\_med\_nrw\_body Animation should now be playing in the viewport of the MetaHuman blueprint. {% hint style="warning" %} Disregard any visual issues with the animation in this view. They will not appear in the environment when you add the MetaHuman to your scene. {% endhint %} ### Add MetaHuman to Scene * Now that the MetaHuman blueprint is configured correctly, drag it from the Content Browser into the scene. * In the Outliner pane, drag the newly added blueprint to the *OptiTrackLiveLinkDisplay* component created earlier. The mouse tip will display the drop location with a green checkmark as you drag the component, to show exactly where it will nest when the mouse is released.

Move the MetaHuman under the *OptiTrackLiveLinkDisplay* in the Outliner.

* Once the MetaHuman is nested under the *OptiTrackLiveLinkDisplay*, its location coordinates will update to reflect the OptiTrack global origin. * To align the MetaHuman with the subject configured in the Motive Avatar Animation Blueprint, go to *Details -> Transform* and zero out the coordinates by clicking the

button to the right of the values.

Transform values for the MetaHuman prior to reset.

{% hint style="info" %} If you previously disabled the display of assets after setting up the [OptiTrack Live Link Display](#add-optitrack-live-link-display), re-enable the display now to validate that the retarget is running correctly. {% endhint %} ### MetaHuman Animation Tips The MetaHuman may not be animating exactly as intended. At this point, the rest of retargeting is much more of a trial-by-error artistic process. We achieved the best standard results using the following settings for all the Hand and Foot Goals, however, we recommend testing other values and changing other fields to get the best results for your project: * FK * Rotation Mode: One to One * Translation Mode: Absolute * IK * Blend to Source: 1