Overview

Timecode for each captured frame can also be streamed into MotionBuilder using the plugin. When the timecode data is available in Motive, you can view the streamed data under the properties of the connected OptiTrack devices.

To monitor the timecode, select the connected OptiTrack I/O devices under the Navigator taband open the Properties tab of the Resources panel as the tracking data is being streamed to MotionBuilder. Among the properties, timecode values will be reported. This will be available for any type of devices (Optical device, Skeleton device, Insight VCS device) that is connected to Motive. Please note that timecode gets streamed out only if it is available in the capture. Timecode signal can be integrated to the capture data only when SMPTE timecode signal is fed into the camera system via the eSync synchronization hub.

• Timecode data is presented to MotionBuilder on each device with the following properties, which can be keyed during recording.

• Use the Timecode Key Interpolation property to set the interpolation method:

  • 0 : Constant (aka Stepping)

Timecode on Assets

In addition to timecode on each device, the Skeleton device also writes timecode onto each skeleton asset root as an animatable user property. This allows you to export that asset only, while keeping the original timecode.

The Skeleton Device Keying to Timecode

The Skeleton Device has the option of writing keys using the timecode contained in the Motive data stream. This requires:

• A timecode generator

• OptiTrack Ethernet Series only

• OptiTrack eSync connected to timecode generator and configured in Motive for timecode.

See the for how to do this.

To enable keying to timecode, set the following Device properties:

• Use Motive Timecode

  • Check this property to enable timestamping keys using the timecode contained in the Motive data packet.

• Timecode Format

MotionBuilder defines the following formats, and the numeric value to use for the property:

NTSC_DROP : 29.97 NTSC_FULL: -29.97f PAL_25: -25.0f FILM_24 : -24.0f FILM_23976: -23.976f FRAMES_30: -30.0f FRAMES_5994: -59.94f

Overview

The OptiTrack MotionBuilder Plugin is a collection of MotionBuilder devices, scripts, and samples used for working with OptiTrack Motive data inside MotionBuilder. The device plugins allow users to stream Motive Live or from recorded .tak data into MotionBuilder.

This page is designed to help you get started with the general download and setup process, and organize the three MotionBuilder plugin pages for quick reference.

For basic instructions on setting up a motion capture system, please refer to the Getting Started guide.

Included Plugins:

• OptiTrack - Skeleton

• OptiTrack - Optical

• OptiTrack - Insight VCS

Motive Data Streaming Setup (Server)

Follow the steps below to configure data streaming in Motive. When the NatNet streaming service is enabled, Motive broadcasts tracking data to a designated network interface where client applications can receive them.

Streaming Settings

To enable streaming in Motive, click the button to open the panel, then select the tab, or use the button in the right corner of the to open the Streaming tab directly.

• In the NatNet section, select Enable to begin streaming.

• Select the Local Interface. Use Loopback if streaming to the same computer, otherwise select the IP address for the network where the client application resides.

• Set the Bone Naming Convention to FBX if streaming skeletons.

Please see the page for more details on all settings available for streaming.

Additional Tips

• For best results, run Motive and MotionBuilder on separate computers so they are not competing for processing resources.

• When streaming the data over a Wi-Fi network, use Unicast transmission.

Streaming Recorded Data

• To stream recorded data, load the Take in Motive.

• Set the to Endpoint.

• Begin recording in MotionBuilder.

• At the desired frame, start playback in Motive. This will stream the captured Take into MotionBuilder.

For additional information on data streaming in general, read through the page.

Plugins

OptiTrack - Skeleton

The OptiTrack Skeleton Device allows to you map Motive 6DOF Skeleton joint angle data directly onto a MotionBuilder character

OptiTrack - Optical

The OptiTrack Optical Plugin device allows to you to map motion capture (optical) data onto an animated character within MotionBuilder.

OptiTrack - Insight VCS

The Virtual Camera device is specifically designed for creating a Virtual Camera in MotionBuilder. You can use the Insight VCS device with standard OptiTrack applications such as Motive, or you can use the device in "Universal" mode, which works with generic MotionBuilder Optical or RigidBody objects, allowing you to use the Insight VCS device with alternative motion capture systems that support optical or Rigid Body devices in MotionBuilder.

Downloading the Plugins

After downloading the from the OptiTrack website, follow the steps below for a successful install.

1. Double click the OptiTrack MotionBuilder Plugin .exe file to open the installer.

2. Read the End User License Agreement, then check the box "I agree to the license terms and conditions."

3. Click the Install button to begin the installation.

Wireless Multiplayer Setup

When setting up multiplayer games on wireless clients, it's best for each client to directly connect to both the tracking server (Motive) and the game server, rather than rebroadcasting the streamed tracking data through the game-server. This ensures that game-related actions that interact with the tracking data can be processed on the game server, which then sends out the corresponding updates to the wireless clients. This allows the wireless clients to receive both the tracking data or updates without having to send back any information, minimizing the number of data transfers needed. If wireless clients are sending data, it will require at least two transfers on the wireless network, with each wireless transfer increasing the risk of latency or lost packets.

Overview

This page provides instructions on how to use the OptiTrack MotionBuilder Skeleton plugin. This plugin allows you to map Motive 6DOF Skeleton joint angle data directly onto a MotionBuilder character.

Before following the walkthrough below, please refer to Autodesk MotionBuilder Plugin page for initial steps for setting up motive and downloading the OptiTrack MotionBuilder plugin.

Motive Data Streaming Setup (Server)

First, you'll want to follow the instructions below to set up the data streaming settings in Motive. Once this is configured, Motive will be broadcasting tracking data onto a designated network interface where client applications can receive them.

Streaming Settings

Open the in Motive's Settings window and set the following settings:

• Enable - Turn on the Enable setting at the top of the NatNet section.

• Local Interface - Choose the desired IP network address from this dropdown to stream data over.

  • Loopback

MotionBuilder Setup (Client)

To get started, drag the OptiTrack Skeleton plugin from the Motion Builder Asset Browser tab > Devices into the Viewer window. This will create a dropdown menu called I/O Devices in the Navigator tab. Click the + button next to I/O Devices and select OptiTrack Skeleton. This will populate the plugin's settings tab if it hasn't already auto-populated from the drag and drop step from earlier.

Device Settings

• Local address - IP address of the MotionBuilder computer. In situations where multiple network adapter cards are present, select the adapter that is on the same network as the Motive application.

  • 127.0.0.1

    • This is the local computer IP address (127.0.0.1 or Localhost).

Once the above settings are input appropriately, you'll want to click the box next to Online. This indicate whether or not Motive is successfully streaming to MotionBuilder.

• Online color indicator

  • Green - Connected and streaming.

  • Yellow - Connected but not streaming.

Model Binding

The Skeleton Device plugin uses model binding to map Motive Skeleton data to MotionBuilder animation nodes. There can be multiple model binding templates in a MotionBuilder scene. The active model binding is indicated in the model binding combo box on the Device tab.

Automatic Binding Update

The MotionBuilder plugin monitors the tracking model list it is receiving from the server (e.g. Motive). If it detects a change in the tracking model list, it will automatically update the current MotionBuilder Skeleton list to match, creating new Skeletons when necessary, or re-connecting to existing Skeletons where possible, based upon the Skeleton/tracking model name. It will not remove existing MotionBuilder Skeletons.

Manual Binding Update

If the plugin is unable to automatically update the model template, you must update your model binding in the Skeleton Device plugin to a model binding that matches the tracked model. To do this:

1. [Motive] Change the actively tracked models list by checking/unchecking the desired asset in the Asset pane.

2. [MotionBuilder Plugin] Press the Update Bindings button on the Skeleton Device tab.

3. [MotionBuilder Plugin] Select a valid model binding in the Model Binding dropdown.

Auto-Characterize

The Auto-Characterize button on the Skeleton Device will automatically characterize each generated Skeleton based on the scaled neutral pose of the performer. It will create a new MotionBuilder character with the same name as the mocap performer/MotionBuilder Skeleton pairing. The advantages of using this approach are:

• Does not require Performers to be in T-Pose.

• Simplifies the number of steps required to map mocap Skeleton onto your rigged MotionBuilder character.

• Can result in improved retargeting results, if performs typically do not present a good T-Pose, since the characterization is on a scale neutral, or ‘zeroed’ pose.

Step-By-Step Example

Motive Skeleton Streaming Step-by-step

Recording Skeleton Data

The OptiTrack Skeleton device can record optical data to the current MotionBuilder take. Please refer to the page for steps on how to record from devices into MotionBuilder.

Playing Back Recorded Data

The OptiTrack Skeleton device can be used show live data or blend live data with a recorded take. Please refer to for steps on how to record from devices into MotionBuilder.

MotionBuilder Skeleton Character Setup QuickStart

One approach to quickly stream Motive Skeletons onto MotionBuilder characters:

1. [Motive] - Setup a streaming session as outlined above under . Set Data Streaming > Bone Naming Convention > FBX. If this is not set to FBX, the plugin will change this automatically when connected to the server.

2. [MoBu] - Connect to Motive and create a model binding as described in .

3. [MoBu] - Make sure the Auto-Characterize feature is enabled under the OptiTrack Skeleton Device.

Overview

This page provides instructions on how to use the OptiTrack MotionBuilder Optical plugin. The OptiTrack Optical Plugin device allows to you to map motion capture (optical) data onto an animated character within MotionBuilder.

Motive Data Streaming Setup (Server)

First, you'll want to follow the instructions below to set up the data streaming settings in Motive. Once this is configured, Motive will be broadcasting tracking data onto a designated network interface where client applications can receive them.

Streaming Settings

• Enable - Turn on the Enable setting at the top of the NatNet section.

• Local Interface - Choose the desired IP network address from this dropdown to stream data over.

  • Loopback

MotionBuilder Setup (Client)

To get started, drag the OptiTrack Optical plugin from the Motion Builder Asset Browser tab > Devices into the Viewer window. This will create a dropdown menu called I/O Devices in the Navigator tab. Click the + button next to I/O Devices and select OptiTrack Optical. This will populate the plugin's settings tab if it hasn't already auto-populated from the drag and drop step from earlier.

Device Settings

• Optical Model

  • Specified the MotionBuilder "Opticals" model to map the markers to.

• Generate a new Optical model/Update the current optical model

Once the above settings are input appropriately, you'll want to click the box next to Online. This indicate whether or not Motive is successfully streaming to MotionBuilder.

• Online color indicator

  • Green - Connected and streaming.

  • Yellow - Connected but not streaming.

Step-By-Step Example

Motive Skeleton Streaming Step-by-step

Recording Optical Data

The OptiTrack Optical device can record streamed optical data to the current MotionBuilder take. Note that the looping feature in Motive must be disabled in order to record streamed data in MotionBuilder. The following step-by-step procedure can be used to record data:

Recording Optical Data Step-by-step

Playing Back Recorded Data

The OptiTrack Optical device can be used to show live data or blend live data with a recorded take. To playback recorded optical data, you need to tell MotionBuilder to disable live streaming.

Playing Back Recorded Data Step-by-step

Optical Data Namespace

When the opticals are generated, their naming conventions will be determined depending on whether the Organize Assets option was enabled under the Optical Device properties.

Organize Assests Enabled (default)

The device will generate optical data with colon ( : ) separator (e.g. AssetName:MarkerName), and all of the optical data will be organized under their corresponding root nodes.

Organize Assets Disabled

The device will generate optical data with an underscore ( _ ) (e.g. AssetName_MarkerName) and all of the optical data will be listed under a same optical node.

MotionBuilder Actor/Character Setup

The following guide is provided as a simplified process for working specifically with Motive, but this is not the only way. For the latest information on setting up and configuring MotionBuilder Actors and Characters, please refer to the .

To animate characters in MotionBuilder, you need to create the following data flow (or “mapping”):

Mocap Marker Data > MotionBuilder “Actor” > Skeleton Data > MotionBuilder “Character”

The Mocap Marker Data > MotionBuilder Actor step maps Motion Capture data (Markers) to the MotionBuilder Actor object. The MotionBuilder Actor object is a Skeleton solver that creates joint angles from Marker data.

The MotionBuilder “Actor” > Skeleton Data > MotionBuilder “Character” step is specific to MotionBuilder, and this pipeline maps the MotionBuilder Actor Skeleton onto your final character Skeleton. This step requires a “rigged” character. Refer to the MotionBuilder help for detailed information on this process.

Actor Setup (Mocap Marker Data > MotionBuilder "Actor")

There are 3 ways to create a Motive Marker Set > MobBu Actor mapping.

1. Create a new marker map from scratch.

2. Import a Motive exported FBX Ascii file.

3. Auto-create an actor from the Motive stream.

1. Create a new marker map from scratch

1. Create OptiTrack Optical device

2. Connect to Motive

3. Generate Opticals

4. Stream a frame of T-Pose data from Motive

2. Import Existing Marker Map (from File)

Option 1: Restore Marker Set from HIK file

1. [MoBu] Import Marker Set definition (.hik file)

2. [MoBu] Connect to Motive

3. [MoBu] Generate Opticals

4. [Motive] Stream a T-Pose frame of data into MotionBuilder

Option 2. Export FBX from Motive (Mobu 2017 and earlier only)

1. [Motive] Right-click on the Skeletons in the Assets pane and export Skeleton as FBX. Make sure the namespace separator is set to (_).

2. [MoBu] Merge FBX from Step 1 (File > Merge)

3. [MoBu] Connect to Motive

4. [MoBu] Select the OptiTrack Optical device in the navigator and access its properties under the resources panel.

3. Auto-Create from Stream

The Optitrack MotionBuilder plugin can generate a MoBU Actor for you automatically.

1. Set the “Create Actors” property to true before bringing the Optical device online.

2. The Optitrack Mobu plugin will generate an Actor for each Marker Set in the Motive data stream, and correctly map the Motive Marker Set markers to the corresponding Mobu Actor.

Offline Workflow with Actor Binding

In order to workaround Autodesk's removal of support for FBX actor import, we recommend the following:

1. [Motive] Load a TAK file with desired assets

2. [Mobu] Use Optical Device to Create Actors over stream from TAK file.

3. [Motive] Export TAK data from Motive (FBX or C3D)

4. [Mobu] Import C3D/FBX into Mobu

Character Setup (MotionBuilder Actor > Character)

1. Do Actor Setup (Above)

2. Import a rigged Skeleton (File -> Merge -> Skeleton)

3. If Skeleton is not “characterized, characterize it:

4. Create MB Character (Drag onto Skeleton “hips” )

Unlabled Markers

Unlabeled markers are not commonly needed in the MotionBuilder workflow, but if needed, they can get streamed through the Optical Device plugin.

1. [Motive] Make sure streaming of unlabeled markers is enabled in Motive’s data streaming panel.

2. [MoBu] Under the properties of the Optical Device loaded in the scene, make sure Using Unlabeled Markers option is enabled and the Unlabeled Marker Limit is set to the maximum number of unlabeled makers allowed in the scene.

3. [MoBu] In Optical Devices, generate or update the optical model.

Overview

This page provides instructions on how to use the OptiTrack MotionBuilder Virtual Camera Device (Insight VCS) plugin. The Virtual Camera device is specifically designed for creating a Virtual Camera in MotionBuilder. You can use the Insight VCS device with standard OptiTrack applications such as Motive, or you can use the device in "Universal" mode, which works with generic MotionBuilder Optical or RigidBody objects, allowing you to use the Insight VCS device with alternative motion capture systems that support optical or Rigid Body devices in MotionBuilder.

Before following the walkthrough below, please refer to Autodesk MotionBuilder Plugin page for initial steps for setting up motive and downloading the OptiTrack MotionBuilder plugin.

Motive Data Streaming Setup (Server)

First, you'll want to follow the instructions below to set up the data streaming settings in Motive. Once this is configured, Motive will be broadcasting tracking data onto a designated network interface where client applications can receive them.

Streaming Settings

• Enable - Turn on the Enable setting at the top of the NatNet section.

• Local Interface - Choose the desired IP network address from this dropdown to stream data over.

  • Loopback

MotionBuilder Setup (Client)

To get started, drag the OptiTrack Optical plugin from the Motion Builder Asset Browser tab > Devices into the Viewer window. This will create a dropdown menu called I/O Devices in the Navigator tab. Click the + button next to I/O Devices and select OptiTrack Optical. This will populate the plugin's settings tab if it hasn't already auto-populated from the drag and drop step from earlier.

Device Settings

• Local address - IP address of the MotionBuilder computer. In situations where multiple network adapter cards are present, select the adapter that is on the same network as the Motive application.

  • 127.0.0.1

    • This is the local computer IP address (127.0.0.1 or Localhost).

Once the above settings are input appropriately, you'll want to click the box next to Online. This indicate whether or not Motive is successfully streaming to MotionBuilder.

• Online color indicator

  • Green - Connected and streaming.

  • Yellow - Connected but not streaming.

Insight VCS Features

Creating a Virtual Camera Device (OptiTrack Server)

First you'll need to create the "neutral" or "zero" orientation of a Rigid Body

The “neutral” or “zero” orientation of a Rigid Body is the orientation when it is created in Motive. This will be the camera’s neutral orientation. In addition, for correct interpretation into MotionBuilder’s coordinate system, it is important you align your Rigid Body with the correct axis and coordinate system convention as follows:

• Point your tracking controller (e.g. VCS Pro) along physical volume -Z axis.

Step-By-Step

After correctly orienting your Rigid Body follow the steps below to continue with the setup:

1. [Motive] Create a Rigid Body from your tracking controller’s markers.

2. [OptiTrack Server App] Enable network streaming (make sure Rigid Body data is streaming).

3. [MotionBuilder] Drag the OptiTrack Insight VCS device from the Motion Builder Asset Browser Panel into the Viewer or Navigator window.

4. [Insight VCS Panel] Connect to an OptiTrack Server (e.g. Motive, Arena, TrackingTools) by clicking the “Online” checkbox. If the connection was successful and data is streaming from you OptiTrack server application, this box will change from Red to Green.

You should now see a standard MotionBuilder Camera moving within your 3D scene:

Creating a Virtual Camera Device (Universal Mode)

In Universal mode, a MotionBuilder Rigid Body is used to drive a camera position. This position/orientation information is merged with the VCS camera controls and applied to the camera's final state (position, lens settings, etc.). It is assumed the Rigid Body orientation matches the MotionBuilder default camera orientation (camera lens aimed down +X axis). For example, if streaming from Motive, create a Rigid Body in MotionBuilder from the optical data, with the camera lens aimed down +X in MotionBuilder.

Step-By-Step

1. [MotionBuilder] Create a Rigid Body or a Marker. For a Marker:

   • Create a bone (or some rigid element) from the geometry your 6DOF system streams into MotionBuilder

   • Create a MotionBuilder "Marker" element, and make this new marker a child of the bone

Controllers

The Insight VCS plugin supports any DirectInput compatible joystick or USB device. Controllers can then be configured to perform actions or control the camera using Controller Profiles.

Controller Profiles

Virtual Camera controls are managed by a Control-to-Event mapping system called the Controller Profile. The controller profile is configured in the Controller Tab. The Insight VCS plugin allows you to create and swap between multiple controller profiles, allowing you to create any number of custom button/axis configurations depending upon the scene, particular move types, different physical VCS controllers or HID devices, etc. Profiles can be saved and then later swapped out using the Profile Dropdown. Profiles are saved into <VCS Mobu install folder>\Profiles folder.

The VCS plugin ships with 2 default profiles:

• The 2 controller VCS Pro (<VCS Mobu install folder>\Profiles\VCSProDefault.xml).

• The XBox based VCS Mini (<VCS Mobu install folder>\Profiles\VCSMiniDefault.xml).

When the Insight VCS plugin is first launched, it will attempt to detect any compatible controllers. It will then attempt to match the detected controllers with an existing Controller Profile, beginning with the last used ("preferred") profile.

Profile Setup

The VCS plugin supports 2 types of controller inputs and 2 types of actions:

Axis Inputs / Actions

• Axis inputs are analog inputs and represent the range of values. This range has been scaled to [0, 1000]. Axis inputs can be assigned to Axis actions. PTZ operations (Pan, Tilt, Zoom) are good examples of typical Axis Actions.

Button Inputs / Actions

• Button inputs are the button inputs on the controller. These are “one shot” events that occur when the button is pressed. Transport commands such as Play, Record, and Rewind are typical examples of “one shot” events.

Typical Insight VCS Controller Map

Insight VCS Inputs/Action Settings

Action Parameters

Some actions have parameters that modify the way they operate. The following tables list the axis and button actions, and how the parameter value for that action is interpreted.

VCS Controller - Axis Actions

Curve Types

When mapping a controller thumbstick axis to an animatable camera parameter (pan, zoom), you have the option of specifying how the Insight VCS plugin should interpret controller axis movement as a standard animation curve. Instead of modifying the value over time, however, the motion curve modifies the value over the controller span, from neutral/center position (0) to maximum position (Max). The following diagram describes this relationship:

Button Actions

VCS Controller - Button Actions

Run Script Usage

When using the Run Script action to map button presses to MotionBuilder scripts, be sure to note the following:

1. Scripts must be placed in the MotionBuilder scripts folder in order to be correctly located. For a typical MotionBuilder installation this folder is:

   • C:\Program Files\Autodesk\MotionBuilder 2014\bin\config\Scripts:

2. The RunScript Param is the filename of the script, including the .py extension:

Virtual Camera Device Settings

The Insight VCS plugin has several properties that can be used to customize its behavior. These properties can be accessed in the same manner as any other MotionBuilder object property, such as from the Asset Browser or from MotionBuilder's Python scripting environment.

MotionBuilder Camera Settings

A MotionBuilder Camera controls how you see the 3D scene. MotionBuilder’s Camera object allow users the ability to model realworld cameras, including settings such as Focal length, aspect ratio, film format, etc.

Refer to the for more information on Camera Settings.