What is Markerless Motion Capture?

At its core, markerless motion capture leverages proven algorithms and machine learning models trained on curated datasets of human movement together with our proprietary motion capture hardware. Here’s how markerless mocap takes you from concept to visualization faster than ever before.

High-Precision Cameras

At the heart of Vicon’s Markerless motion capture system are our purpose-built motion cameras, built with decades of experience for the utmost accuracy and precision. These cameras are designed to detect and analyze subtle variations in human movement without the need for physical markers. By recording from multiple angles, the system constructs an accurate representation of the performer’s motion in 3D space. The advanced optical sensors ensure smooth, artifact-free data acquisition, making the process seamless and efficient for 3D animators, whether in game, film or episodic TV studios.

ML and Computer Vision

Vicon’s Markerless system employs advanced computer vision machine learning models and human motion solving algorithms to recognize and track multiple people dynamically. The ML-driven software is trained on extensive motion capture datasets, enabling it to identify joints, limb positions, and movement patterns with high accuracy. Machine learning plays a crucial role in continuously refining the system’s ability to detect even the most complex human motions. By interpreting skeletal structures and biomechanical motion, the AI reconstructs 3D animations with near-optical precision, allowing for realistic and fluid character movements in digital environments.

Seamless Integration

A key advantage of Vicon’s Markerless technology is its seamless integration with traditional optical motion capture systems. The system is built with industry-validated pipelines that allow users to incorporate markerless mocap into their existing workflows without disruption. With Shōgun Live and Post this is made even more efficient and works with industry tools from Unreal Engine to Autodesk MotionBuilder. This hybrid approach gives production teams the flexibility to use marker-based and markerless mocap interchangeably, depending on project requirements.

Real-Time Mocap Visualization

Vicon’s Markerless system enables real-time visualization of motion data, allowing creators to instantly assess and refine their animations. Performers can interact with virtual environments naturally while their movements are tracked and animated on-screen in real-time. This means that the animation you see during the performance is the same as the data being recorded – particularly beneficial where immediate feedback is crucial for decision-making. The real-time animation displayed in Shōgun Live mirrors the final recorded data, ensuring consistency and reducing the need for extensive post-processing adjustments.

Instant Capture Playback & Interactive Post-Processing

With Vicon’s instant playback feature, captured motion data can be reviewed and edited on the spot. The ability to stream captured animations directly into game engines or 3D software allows animators and developers to fine-tune performances without waiting for lengthy processing times. Furthermore, Vicon’s Shōgun software provides interactive post-processing tools, giving users control over data refinement, noise reduction, and keyframe adjustments before exporting animations for production use.

Efficient System Calibration & Monitoring

Ensuring the accuracy and reliability of markerless motion capture data is critical for professional productions. Vicon’s Active Wand calibration and system monitoring tools help maintain precision throughout the capture process. The calibration system optimizes camera alignment and performance, while real-time monitoring alerts operators to any potential tracking issues.

Data Cleaning & Batch Processing

To streamline the animation pipeline further, Vicon provides a comprehensive suite of data cleaning tools. These tools allow for both manual and automated adjustments, ensuring that motion capture data is polished and production-ready. The batch processing feature enables users to clean multiple datasets simultaneously, significantly reducing the time spent on post-processing.

Markerless motion capture offers several key advantages over traditional marker-based systems in early creative processes, most notably efficiency and removing barriers to early iteration.

• Simplicity and Ease of Use: Without the need for markers or suits, setup time is significantly reduced, allowing for quicker and more efficient capture sessions.
• Natural Movement Capture: Markerless systems excel at capturing natural, unencumbered movements, making them ideal for scenarios where realism is likely to be crucial.
• Flexibility: Markerless motion capture promises to be able to be used in a variety of environments, from small studios to large-scale productions in due course, without the constraints of marker placement.
• Seamless Integration: Markerless systems integrate smoothly into existing motion capture pipelines, reducing the time it takes to clean up data and get it into the hands of creative teams.

As the demand for high-quality, efficient animation continues to grow, the innovation of markerless motion capture is set to play an increasingly vital role in the industry. For game studios, film productions, and TV companies looking to push the boundaries of motion capture, Vicon’s Markerless solution gets you creating the most impactful art with the least amount of friction. Vicon sees a future of decentralizing mocap, allowing more satellite studios access to mocap volumes, rapid prototyping and previsualization – something that markerless motion capture is paving the way for. At Vicon, we want to see the barriers to creativity lifted, so that great ideas can soar.