Natural gesture finger recognition algorithm

Abstract

The invention discloses a finger recognition algorithm, and relates to a human-computer interaction interface, in particular to judgment of an operator and finger recognition in a multi-point touch interface and rich input primitives in the human-computer interaction interface so as to solve the problems that an existing recognition algorithm depends on specific equipment and is high in operation complexity, poor in real-time performance and the like. According to the algorithm, fingers corresponding to touch points in a multi-point touch interface are recognized through information of natural gestures such as the relative orientation relation and the distance between the finger touch points, and whether an operating hand is a left hand or a right hand is recognized according to positive and negative cross products of vectors from geometric center points of the five finger touch points to the thumb touch point and the index finger touch point. According to the method, input primitives in the multi-point touch interface can be enriched, convenience is provided for people to realize blind operation man-machine interaction such as touch typing text input and the like in the multi-point touch interface, convenience is provided for blind people to effectively utilize multi-point touch equipment and the like, and interaction performance is improved.

Description

technical field

[0001] The invention relates to a human-computer interaction interface, in particular to rich input primitives in the human-computer interaction interface and recognition of operating hands and fingers in a multi-touch interface. Background technique

[0002] Multi-touch screen devices ranging from smart phones and tablet computers to wall-sized touch screens are widely used in people's daily work, study and life. The touchscreen is both an output device and an input device. Touch screen devices usually do not have external input devices such as mouse and keyboard. When people use touch screen devices, they usually use bare hands to operate on them: this provides convenience for operation on the one hand; The input primitives are not rich enough, limiting human interaction performance. For example, when people input text on mobile phones and tablet computers, the existing method is mainly to click on the soft keyboard with a single finger to input, which is...

Examples

Embodiment Construction

[0010] The algorithm is triggered when 5 touch points touch the interface. Firstly, the coordinates of 5 touch points are obtained, and then the sum of the distances from one touch point to the other 4 touch points is calculated cyclically, and the largest touch point is the thumb touch point T .

[0011] Calculate the distance from the remaining 4 contacts to point T, and the smallest one is the index finger contact I.

[0012] Calculate the geometric center point C of the 5 contacts, calculate Whether the operating hand is the left hand or the right hand is determined based on the positive or negative of the cross product.

[0013] Calculate the 3 vectors with C as the starting point and the other 3 finger contacts as the end points, in the arrive In the rotation direction of , the finger contacts corresponding to the three vectors are the middle finger contact M, the ring finger contact R and the little finger contact L in turn.

technical field

[0001] The invention relates to a human-computer interaction interface, in particular to rich input primitives in the human-computer interaction interface and recognition of operating hands and fingers in a multi-touch interface. Background technique

[0002] Multi-touch screen devices ranging from smart phones and tablet computers to wall-sized touch screens are widely used in people's daily work, study and life. The touchscreen is both an output device and an input device. Touch screen devices usually do not have external input devices such as mouse and keyboard. When people use touch screen devices, they usually use bare hands to operate on them: this provides convenience for operation on the one hand; The input primitives are not rich enough, limiting human interaction performance. For example, when people input text on mobile phones and tablet computers, the existing method is mainly to click on the soft keyboard with a single finger to input, which is...

Examples

Embodiment Construction

[0010] The algorithm is triggered when 5 touch points touch the interface. Firstly, the coordinates of 5 touch points are obtained, and then the sum of the distances from one touch point to the other 4 touch points is calculated cyclically, and the largest touch point is the thumb touch point T .

[0011] Calculate the distance from the remaining 4 contacts to point T, and the smallest one is the index finger contact I.

[0012] Calculate the geometric center point C of the 5 contacts, calculate Whether the operating hand is the left hand or the right hand is determined based on the positive or negative of the cross product.

[0013] Calculate the 3 vectors with C as the starting point and the other 3 finger contacts as the end points, in the arrive In the rotation direction of , the finger contacts corresponding to the three vectors are the middle finger contact M, the ring finger contact R and the little finger contact L in turn.

Images