Method for controlling user interfaces through non-contact gestures

Abstract

The invention relates to a method for controlling a computer, a touch screen, a projector and other user interfaces through Kinect non-contact gestures. The method comprises the main steps of acquiring actions of double arms of an operator and using a gesture recognition algorithm to recognize gestures, utilizing recognized gestures to achieve interaction between the operator and the computer, the touch screen, projector and other user interfaces. The method relates to six gestures including single click, right-key single click, double clicks, forward rolling, back rolling, zooming in, zooming out and dragging and basically covers the demands for interaction between the operator and the computer, the touch screen, projector and other user interfaces. The method is a novel recognition method, gesture recognition accuracy can be improved, and recognition rapidity can be improved. By the combination of the six gestures, man-machine interaction can be convenient and flexible.

Description

Technical field [0001] The invention relates to a non-contact gesture interaction method, in particular to a method for non-contact interaction between gestures based on Kinect and user interfaces such as computers, touch screens and projections. Background technique [0002] In the 21st century, the hardware performance and popularity of electronic devices such as mobile phones and computers have continued to increase, and touch screens have become popular. Touch operation frees people from the shackles of keyboard and mouse, and directly manipulates the objects displayed on the screen, which is more in line with people's cognition and living habits, and has become the trend of human-computer interaction in the near future. However, with the emergence of more and more different types and specifications of screens, the inconvenience and limitations of touch operation are gradually revealed: the small touch screen is just a new form of mouse and keyboard, and it has not yet let us...

AI Technical Summary

Problems solved by technology

However, with the emergence of more and more screens of different types and specifications, the inconvenience and limitations of touch operations are gradually revealed: the small-size touch screen is just another form of mouse and keyboard, and it still does not let users get rid of it. Hardware constraints; the size of the touch screen hung on the wall can reach 60 or even 100 inches, and the user must approach the screen when operating, so that the user cannot see the object on the full screen. In addition, the huge area occupied by the object on the screen also makes dragging and zooming difficult. Basic operations such as selection and selection become so clumsy that they cannot be completed; in some scenarios, users are not allowed to touch the operating equipment, for example, a doctor who is performing an operation cannot touch any Disinfect hands after operation

Images