Ningbo Polytechnic University uses the NOKOV Motion Capture System together with the Unitree G1 humanoid robot to perform MuJoCo simulation training and real-time teleoperation.
During the experiment, an operator wearing a motion capture suit with reflective markers performs upper-body movements such as arm lifting, arm extension, and waving. The NOKOV motion capture system captures human motion in real time and streams high-precision pose data to both the MuJoCo simulation environment and the physical robot, enabling synchronized motion retargeting and teleoperation.
Experimental Workflow
The experiment consists of two stages.
Human Motion Capture
The operator wears a motion capture suit equipped with reflective markers and performs natural upper-body movements inside the capture area.
The NOKOV Motion Capture System continuously tracks the operator's motion and outputs accurate, low-latency pose data for robot control.
Captured motion data is streamed directly into the MuJoCo simulation environment.
The Unitree G1 robot model reproduces the operator's movements in real time, allowing researchers to validate robot behavior before deployment to the physical platform.
Following simulation, the same motion data drives the physical Unitree G1 humanoid robot.
The robot synchronously performs arm lifting, waving, and other movements, demonstrating real-time interaction between human motion input and robot execution.
This application demonstrates how the NOKOV Motion Capture System supports:
Human motion capture for humanoid robots
MuJoCo simulation training
Human motion retargeting
Real-time humanoid robot teleoperation
Imitation learning data collection
A1:Motion capture provides accurate and low-latency human pose data that can be mapped directly to a humanoid robot, enabling intuitive teleoperation and reliable robot control.
A2:The NOKOV Motion Capture System streams real-time motion data into the MuJoCo simulation environment, allowing the virtual robot to reproduce human movements for algorithm development and validation.
A3:Yes. In this application, the same human motion data is used to control both the Unitree G1 model in MuJoCo and the physical Unitree G1 humanoid robot, creating a seamless workflow from simulation to real-world teleoperation.
Learn more about the application of NOKOV mocap on Humanoid Robotics&Embodied AI