Intelligent interaction system for fingertip force detection and gesture recognition and intelligent finger ring

Abstract

The invention provides an intelligent interaction system for fingertip force detection and gesture recognition and an intelligent finger ring, the intelligent interaction system comprises an information acquisition module, an information processing module and an image rendering and display module, a convenient man-machine interaction mode can be provided in the fields of AR, VR, intelligent home control and the like, natural and simple gesture interaction is realized by using the specially designed intelligent finger ring, and the intelligent finger ring is convenient to use. And the experience feeling of the user during man-machine interaction is improved. The fingertip gesture and the contact force are identified according to the characteristic that the color distribution under the nail cover changes when the finger pulp is pressed, and meanwhile, the muscle shape and the color change of the fingertip serve as an identification characteristic for joint detection. Gesture categories are clear and practical, and interaction is natural. According to the method, a preprocessing program and a deep neural network are used for extracting features and recognizing gesture types and contact force, a complete interaction system is provided, system separation is achieved through wireless communication, multiple application scenes are provided, and the application prospect and feasibility of the system are improved.

Description

technical field [0001] The invention relates to the technical field of intelligent interaction, in particular to an intelligent interactive system for fingertip force detection and gesture recognition and an intelligent ring. Background technique [0002] At the beginning of the development of gesture recognition technology, data gloves were used to collect user gesture features. However, due to the inconvenient and uncomfortable gesture interaction devices and their influence on the natural tactile sense of human interaction with objects, data gloves are used to collect user gestures. The program is gradually being phased out. With the development of computer technology, the vision-based optical tracking method has become the mainstream of gesture recognition research. In the augmented reality interaction technology, the inside-out-based visual detection method has been widely developed, but when the camera built in the HMD recognizes the gesture, it needs to perform the g...

AI Technical Summary

Problems solved by technology

There are various problems in the existing gesture recognition schemes. For example, the IMU can recognize gesture movements, but cannot detect static gestures, and there is a phenomenon of zero drift.

Other laser and infrared detection methods have problems such as uncomfortable wearing and inconvenient carrying

And in the interaction problem, the detection of fingertip force is also an important research direction. The traditional detection method is divided into two types due to the different positions of the force sensor. One sensor is placed on the interactive plane surface, and the other is placed under the fingertips. , both of these two interaction methods have their own shortcomings, and affect the natural sense of touch when humans interact with objects

Images