Natural gesture finger recognition algorithm

Abstract

The invention discloses a finger recognition algorithm, and relates to a human-computer interaction interface, in particular to judgment of an operator and finger recognition in a multi-point touch interface and rich input primitives in the human-computer interaction interface so as to solve the problems that an existing recognition algorithm depends on specific equipment and is high in operation complexity, poor in real-time performance and the like. According to the algorithm, fingers corresponding to touch points in a multi-point touch interface are recognized through information of natural gestures such as the relative orientation relation and the distance between the finger touch points, and whether an operating hand is a left hand or a right hand is recognized according to positive and negative cross products of vectors from geometric center points of the five finger touch points to the thumb touch point and the index finger touch point. According to the method, input primitives in the multi-point touch interface can be enriched, convenience is provided for people to realize blind operation man-machine interaction such as touch typing text input and the like in the multi-point touch interface, convenience is provided for blind people to effectively utilize multi-point touch equipment and the like, and interaction performance is improved.

Description

technical field [0001] The invention relates to a human-computer interaction interface, in particular to rich input primitives in the human-computer interaction interface and recognition of operating hands and fingers in a multi-touch interface. Background technique [0002] Multi-touch screen devices ranging from smart phones and tablet computers to wall-sized touch screens are widely used in people's daily work, study and life. The touchscreen is both an output device and an input device. Touch screen devices usually do not have external input devices such as mouse and keyboard. When people use touch screen devices, they usually use bare hands to operate on them: this provides convenience for operation on the one hand; The input primitives are not rich enough, limiting human interaction performance. For example, when people input text on mobile phones and tablet computers, the existing method is mainly to click on the soft keyboard with a single finger to input, which is...

AI Technical Summary

Problems solved by technology

[0004] Existing typical identification methods require special equipment (such as the literature "Masson D, Goguey A, Malacria S, et al. Whichfingers: Identifying Fingers on Touch Surfaces and Keyboards Using Vibration Sensors [C] / / Proceedings of the 30th Annual ACM Symposium on UserInterface Software and Technology. Quebec City, QC, Canada: ACM, 2017: 41-48."), or a camera that is specifically placed relative to the operation surface (such as the literature "Zheng J, Vogel D. Finger-Aware Shortcuts[C] / / Proceedings of the 2016CHI Conference on Human Factors in ComputingSystems.San Jose,CA,USA:ACM,2016:4274-4285."): Such conditions are not available on general touch devices

Images