A recognition method for multi-finger touch operation in a screen interaction system
A multi-finger touch and recognition method technology, applied in the field of human-computer interaction, can solve the problems of being unable to know which hand the finger touch comes from, unable to determine the start and end positions of the finger touch, and difficult to realize the operation task, so as to improve the resistance Interference ability and stability, solving natural interaction problems, identifying convenient effects
Active Publication Date: 2020-09-29
中关村科技租赁股份有限公司
View PDF12 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
During the interaction process, the system relies on multi-finger finger contacts for action recognition, and the recognition system cannot know which hand the finger contacts come from. Without marking and tracking, it is impossible to determine the start and end positions of the finger contacts , so that motion recognition cannot be performed, it is difficult to achieve correct operation tasks, and it affects user experience
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0030] The technical solutions of the present invention will be further described in detail below in conjunction with specific embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, and are not intended to limit the present invention.
[0031] An embodiment of the present invention provides a recognition method for a multi-finger touch operation of a screen interaction system, such as figure 1 shown, including the following steps:
[0032] S1: Turn on the near-infrared laser, make the light curtain parallel to the screen, and complete the geometric calibration of the finger contact position;
[0033] S2: Collect images of all finger contacts with a near-infrared camera;
[0034] S3: Divide all finger contacts;
[0035] S4: Record all finger touch points, mark the finger ID and initialize the occurrence times of all finger touch points to 1;
[0036] S5: Collect all the images of the finger touch aga...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a multi-finger touch operation identification method for a screen interactive system. The multi-finger touch operation identification method comprises the following steps: starting a near-infrared laser, enabling a light certain to be parallel to a screen and finishing geometric calibration at finger contact positions; collecting an image by employing a near-infrared camera; segmenting out all finger contacts; recording the all finger contacts, and labeling IDs of the finger contacts and initializing a frequency that the all finger contacts occur as one; carrying out labeling and tracking on the IDs of the finger contacts according to a minimum distance and a motion estimation, updating an end position of a locus of the finger contacts and increasing the frequency that the finger contacts occur with one by itself; when the finger contact at a certain ID leaves the screen, ending the tracking on the finger contact whose ID is labeled currently; when the all finger contacts leave the screen, carrying out identification on a multi-finger touch operation; and returning parameters which reflect a current touch operation, and carrying out zero clearing on all the finger contacts. According to the identification method provided by the invention, the identification on the multi-finger touch operation becomes convenient.
Description
technical field [0001] The invention belongs to the technical field of human-computer interaction, and in particular relates to a recognition method for a multi-finger touch operation of a screen interaction system. Background technique [0002] In the existing near-infrared light-based screen touch human-computer interaction system, multi-finger touch has the characteristics of intuitive operation and natural interaction mode, and is favored by the field of human-computer interaction. During the interaction process, the system relies on multi-finger finger contacts for action recognition, and the recognition system cannot know which hand the finger contacts come from. Without marking and tracking, it is impossible to determine the start and end positions of the finger contacts , so that action recognition cannot be performed, and it is difficult to achieve correct operation tasks, which affects user experience. Contents of the invention [0003] The present invention pro...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/0488G06F3/042
CPCG06F3/042G06F3/0488G06F2203/04104
Inventor 田启川谭登峰
Owner 中关村科技租赁股份有限公司