Case Studies
Model Training For Hand Gesture Recognition
School of Science, Harbin Institute of Technology, Shenzhen
6M × 4M × 2.6M
Human-Computer Interaction, Hand Gesture Recognition, Training Algorithm
Track of a single marker on the back of the hand
8 × Mars 2H Mocap Camera

Human-computer interaction is a key feature of virtual reality technology. Today, with the continuous update of intelligent hardware and the acceleration of mobile network, human-computer interaction has been rapidly developed, among which hand gesture recognition is the most popular human-computer interaction mode. At present, hand gesture interaction has been used as a new generation of human-computer interaction in smart cars, wearable devices, automotive electronics, smart phones and other fields.

stick motion capture markers on hand

To realize hand gesture interaction, the first step is to collect gesture data. There are two ways to realize data acquisition: visual gesture capture based on camera image and inertial gesture capture based on sensor tracking. However, these two methods still have obvious disadvantages, such as, insufficient capture accuracy, high data noise and data pre-processing. Dr. Wang Yifeng, from School of Science, Harbin Institute of Technology, has been working on the Hand Gesture interaction of smart bracelets.

the experimental process of motion capture to collect gesture data

Dr. Wang Yifeng used NOKOV motion capture system to obtain hand gesture data. Through the marker on the surface of the smart bracelet, the motion capture system based on infrared optics can output the three-dimensional coordinate of the marker in real time. When wearing the smart bracelet and making gestures, the information of different gestures can be reflected by the change of the position of the marker, and the accuracy reaches sub-millimeter level. The speed, acceleration and other information of hand movement are also provided by the motion capture system. All data is directly imported into different systems through the rich SDK interface provided by NOKOV motion capture system. Instead of spending time pre-processing large amounts of data, researchers can focus on classification and recognition algorithms.

gesture trajectory

After the classification and recognition model was trained by imported data information, various gestures with 26 letters were used as test samples to verify the algorithm, and the accuracy of recognition and classification was analyzed by statistics of the correct recognition frequency and the category and frequency of wrong classification of gesture samples through continuous real-time test.


Please Feel Free to Reach Us

  • We are dedicated to assisting you with your inquiries and providing comprehensive information.

    Share your concerns with us, and we will promptly guide you towards the most effective solution.

  • Capture Volume * m m m
  • Objectives to be Tracked *
  • Number of Objectives (optional)
  • Camera Type (optional)
  • Camera Count (optional)
  • Submit
Contact us

Contact us

By using this site, you agree to our terms, which outline our use of cookies. CLOSE ×