Composite gesture recognition device based on ultrasound and vision and control method thereof

Abstract

The invention discloses a composite gesture recognition device based on ultrasound and vision and a control method of the device. The device comprises a vision recognition unit, an ultrasonic recognition unit and a control unit which is used for controlling the vision recognition unit and the ultrasonic recognition unit to be switched selectively according to use conditions. When the device is in a standby state, the ultrasonic recognition unit is selected through switching to recognize a gesture instruction so that the device can be in a work state. When the device is in the work state, the vision recognition unit is selected through switching to recognize a gesture object if it is judged that the relative displacement between the gesture object and the device is larger than a preset value S, and otherwise the ultrasonic recognition unit is selected through switching to recognize the gesture object. The device can integrate the advantages of camera gesture recognition and the advantages of sound wave gesture recognition, and different gesture recognition modes are adopted in different application environments, so that standby time of a multimedia device is properly prolonged, recognition precision and the variety of recognized gestures can be improved, and the application range is greatly increased.

Description

technical field [0001] The invention relates to a gesture recognition device and a control method thereof. Background technique [0002] With the development of sensor technology and the maturity of various technologies, gesture recognition technology has entered the usability stage and has become a key symbol of high-end flagship smartphones, media tablets and smart glasses. Gesture recognition is to use various sensors to continuously collect the shape and displacement of hands / hand tools, complete modeling at intervals, form a sequence frame of model information, and then convert these information sequences into corresponding instructions for use Control implements certain operations. At present, various products and solutions have also begun to emerge. Most of the common gesture recognition on the market uses cameras on multimedia devices to recognize gestures. The technical process of gesture recognition based on cameras includes gesture image acquisition, gesture segm...

AI Technical Summary

Problems solved by technology

[0003] There are still some deficiencies in camera-based gesture recognition technology. Feel uncomfortable; it mainly uses area changes to measure the distance between the palm and the camera, and the error is large when the distance between the hand and the camera is far away; in portable multimedia devices, camera-based gesture recognition technology consumes a lot of power, seriously Affects the standby time of portable multimedia devices, which is a fatal shortcoming for portable multimedia devices

Similarly, the disadvantage of gesture recognition technology based on sound waves is: since the palm is a surface, the sound wave is a spherical wave, and the sound wave returns to the sound wave receiver after being refracted by the palm, and only the signal with stronger energy is processed and processed after the signal processing. Analysis, cannot identify all signals reflected back through the palm

Therefore, it can only be recognized when the hand is displaced relative to the multimedia device. When the palm moves parallel to the multimedia direction for a small distance, the movement distance cannot be recognized; when the palm movement distance is small or there is no displacement, the finger movement cannot be recognized

Images