Use the Live Link Hub to stream OptiTrack camera data to the UEFN plugin for video game development in Fortnite.
Last updated
Was this helpful?
The OptiTrack Live Link Hub plugin allows game designers to use OptiTrack Motion Capture data to animate characters in Fortnite through Unreal Editor for Fortnite (UEFN).
Download the latest Unreal Engine 5 Plugin from the .
Open the Epic Games Launcher. The following Epic Games applications must be installed:
Unreal Engine 5.5
Live Link Hub
UEFN
Fortnite
Launch Unreal Editor for Fortnite (UEFN).
Select Live Link Hub from the Tools menu, if it's not already open.
Click the Settings button in the upper right corner and select Plugins...
In the User Plugin Directories section, click the Add Element button.
Click the ellipses button to browse to and select the downloaded plugin.
Restart UEFN when prompted after the plugin is installed.
In the NatNet section, select Enable to begin streaming.
Select the Local Interface. Use Loopback if streaming to the same computer, otherwise select the IP address for the network where the client application resides.
Set the Bone Naming Convention to UnrealEngine.
Set the Up Axis to Y-Axis. The plugin will bring the data in with a Y-Forward orientation.
In Unreal Engine, open Live Link Hub from the Tools menu on the toolbar, if it's not open already. Under Virtual Production, select Live Link Hub.
Select OptiTrack Source, check Connect Automatically, or enter the IP address for the Motive PC in the Server Address field, the IP address for the Unreal PC in the Client Address field. Enter 127.0.0.1 in both fields if running both on the same PC. Click create.
Properties are shown in the Source Details tab when the OptiTrack source is selected. The properties that are applicable to Fortnite characters are listed below.
Adjust the location, orientation, or scale of the streaming data.
Timecode is fully supported in the plugin. Click the button in the top right to use preset system time codes or add a new Timecode Provider in the Source Details tab.
Timecode data may appear to stutter in Unreal Editor even when it is transmitting correctly. To confirm that the data is in sync, compare the timecode in Live Link Hub to the timecode in Motive.
We recommend using Windows Explorer to copy assets into the project folder. Right-click the project folder in the Unreal Editor Content Browser and select Show in Explorer.
In the Content Browser, copy the following files and folders from All > Engine > Plugins > OptiTrack - Live Link Content > Animations to the project folder:
Female Avatar (folder)
Male Avatar (folder)
Textures (folder)
IK_MotiveAvatar_Opti.uasset (file)
SK_MotiveAvatar_Opti.uasset (file)
Unreal Editor will validate the project files before launching the live session.
All skeletons in Unreal Editor are based on the standard Fortnite mannequin. Animation is applied to the mannequin rather than using an animation blueprint. In this example, we will use the Fortnite Mannequin to build an IK Rig to receive data from the OptiTrack skeletons.
Before creating our IK Rig, drag the Motive Avatar of your choosing into the scene to prep the retarget phase.
To create the IK Rig:
Right-click in the Content area. Select Animation > Retargeting > IKRig.
Name the IKRig. We recommend IK_FNMannequin.
Double-click the newly created IKRig to edit it. This will open in a new window.
In the Details tab, change the Preview Mesh to the FN Mannequin.
The mannequin is pre-configured to work with Fortnite. This allows you to use the Auto Create features in the upper left corner to finish setting up the IK Rig.
Click the Auto Create Retarget Chains button.
Click Auto Create IK.
Click Reset.
Click Save.
The IK Rig is now configured and the tab can be closed.
Right-click in the Content area. Select Animation > Retargeting > IK Retargeter.
Name the IK Retargeter. We recommend RTG_Motive_FN.
Open the newly created Retargeter.
On the Details tab, go to Source > Source IKRig Asset.
Use the dropdown list to select the standard Motive avatar, IK_MotiveAvatar_Opti.
The Viewport will show that the two skeletons are not properly aligned. This occurs because the skeletons are in different poses.
Click the Running Retargeter button in the upper left corner to stop the retargeter and switch to edit mode. The button will update to Editing Retarget Pose.
Set the Retargeter back to Run mode for the remaining steps.
To complete the next step, it's easiest if only the mapped bone chains are visible.
In the Chain Mapping pane, click the Settings button and select Hide Chains Without IK.
Select all of the mapped Chains.
In the Details tab, go to IK > Blend to Source.
Set the value to 1.0.
Go to Blend to Source > Blend to Source and set the value to 1.0.
The retarget will now display correctly in the Viewport. This window can now be closed.
From the Content Browser, drag the skeletal mesh for the Fortnite mannequin into the scene. The mannequin is located in All > Fortnite > Characters > PlayerBasics.
Both the Motive Avatar and the Fortnite Mannequin will be in the scene.
Select the Motive Avatar.
In the Details tab, go to Performer > Performance Capture > Subject Name.
Select a performer from the list of actors in Motive.
The Motive Avatar will now animate with the selected actor.
Select the Fortnite Mannequin to display its properties in the Details pane.
Once the Retarget Component is attached to the Mannequin, update the following properties in the Retarget section:
Source Skeletal Mesh Component: Select the Motive Avatar.
Controlled Skeletal Mesh Component: This should already be set to the Fortnite Mannequin.
In the Outliner pane, drag the Mannequin to nest under the Motive Avatar.
In the Details pane for the Mannequin, go to Transform > Location and reset the values to 0.
The Avatar and the Mannequin will be aligned.
Once all of the characters are configured, the next step is to record the animation using the Take Recorder and Sequencer in Unreal Editor.
To open either pane, go to the Windows menu > Cinematics.
Type the project name in the Slate field.
Select From Actor > Add 'Device Mannequin'.
With the Mannequin selected, update the following properties:
Disable Transform > Transform Track.
Disable Animation Recorder > Remove Root Animation (shown below).
Go to User Settings > Countdown to include a countdown timer to start recording.
To begin recording, click the large red Play button on the right edge of the Slate in the Take Recorder:
When the recording is completed, click the Review button in the Take Recorder pane.
The character will now animate as expected.
You can find the Take and the associated animations in the Cinematics folder in the Content Browser. Takes are organized with a folder for each subscene. The animations recorded in that subscene are stored in an Animation folder, one for the Device Mannequin and one for the Motive Avatar.
Now that the animation has been created and aligned to the Device Mannequin, it's time to apply it to a Fortnite character. Since all characters in Fortnite use this same skeleton, no additional alignment is required.
Fortnite has a large selection of characters available, all based on the Device Mannequin skeleton. To add a character to the scene from the Content Browser:
Go to Fortnite > Devices > AI.
Drag the Character Device to the scene.
Select the Character Device in the Viewport.
Go to Fortnite > Characters and select the desired character from the gallery.
In the Details pane for the newly added Character Device, drag the Fortnite character you wish to use to User Options > Character.
Select the Fortnite character in the Viewport.
Under User Options, check the box for Custom Idle.
Drag the Device Mannequin animation from the Content Browser to the Custom Idle field.
Fortnite will update the game in Edit Mode, with the status displayed in the upper right corner. The game will move through the following phases: Preparing; Loading Project; Downloading; and Connecting (displayed on the Edit Session screen). When the game loads, the status will be Up to Date.
The animation will play on the Fortnite character when the game starts. It will not play in the editor. To see this, you can start the game from UEFN or inside Fortnite itself.
To enable streaming in Motive, click the button to open the panel, then select the tab, or use the button in the right corner of the to open the Streaming tab directly.
Please see the page for more details on all settings available for streaming.
Click the button in Live Link Hub to add a new Live Link source.
Once the required assets are copied to the project folder, click the button. Unreal Editor will prompt to Save Selected, with all unsaved content selected by default.
In the Target section, set the Target IKRig Asset to the , IK_FNMannequin.
Click the Auto Align button and select Align all Bones to complete the alignment.
Click the Root Settings button in the top right corner.
Click the Add button to add the Performer component.
Click the Add button and use the search bar to find and add the Retarget Component.
Retarget Asset: Select the created in an earlier step (RTG_Motive_FN in our example).
Click the Push Changes button to save the change into the Fortnite game.
With the Mannequin selected, click the add source button.
Recorded tracks will show in the Sequencer tab. Click the Stop Recording button when done recording.
Click the Push Changes button to save and update the game.
