Gesture recognition device, gesture recognition method, and virtual reality system

Abstract

The invention provides a gesture recognition device, a gesture recognition method, and a virtual reality system. The gesture recognition device comprises an imaging device, a first inertial sensor, a second inertial sensor, and a processor. To be specific, the imaging device is used for shooting a hand image; the first inertial sensor is fixed relative to the imaging device and is used for sensing lens orientation information of the imaging device; the second inertial sensor arranged on a hand is used for sensing orientation information of a hand palm center; and the processor connecting the first inertial sensor and the second inertial sensor is used for determining a relative direction relation of the hand palm center with the imaging device according to the lens orientation information and the orientation information of the hand palm center. Besides, the gesture recognition method includes: determining orientation information of a palm center of a hand; and determining a relative direction relation of the palm center of the hand with an imaging device according to lens orientation information and the orientation information of the palm center of the hand. And the virtual reality system consists of a gesture recognition device and a head-mounted device. Therefore, the gesture recognition becomes accurate.

Description

technical field [0001] The invention relates to a gesture recognition device, a gesture recognition method and a virtual reality system. Background technique [0002] With the rapid development of technologies related to virtual reality, human-computer interaction, and image recognition, there is an increasing demand for accurate gesture recognition in various industries. It can be applied to: smart home control, vehicle operation control, PC and mobile terminal control, industrial design and other aspects. And its commercial value is also increasing day by day. [0003] There are also various methods of gesture recognition, which can be roughly divided into three technologies: image recognition technology based on light technology, motion capture technology based on inertial sensors, and hand shape simulation technology based on mechanical structure. These three technologies have their own advantages and disadvantages and are incompatible with each other. [0004] The te...

AI Technical Summary

Problems solved by technology

Its disadvantages are: it is difficult to judge the front and back of the hand, and it is easy to make a misjudgment; it is greatly affected by light, including outdoor visible light, the laser emitted by the laser camera itself, and the recognition interference of the capture camera itself; the recognition range is limited and limited by the optical path. The tolerance of obstacles is low, and the recognition and judgment of overlapping hands are wrong

However, in the field of gesture recognition, it has some obvious defects: it cannot restore the fine movements of the hand joints; it cannot perform absolute positioning in space, and the integral calculation is performed through the posture information of each part of the body, and the obtained spatial position information causes different degrees of integral drift.

Unable to accurately locate hand movements; easily affected by the ferromagnet in the surrounding environment and reduce accuracy

Images