Man-machine interactive system and real-time gesture tracking processing method for same

Abstract

The invention discloses a man-machine interactive system and a real-time gesture tracking processing method for the same. The method comprises the following steps of: obtaining image information of user side, executing gesture detection by a gesture detection unit to finish separation of a gesture and a background, and automatically determining a smaller rectangular frame which surrounds the hand as a region of interest in the image information through a vision algorithm; calculating the hand profile state of each frame in a video sequence by a gesture tracking unit; executing validity check on hand actions according to the calculated hand profile state, and determining the gesture action finished by the user; and generating a corresponding gesture action control instruction according to the determined gesture action, and making corresponding feedbacks by a three-dimensional user interface according to the gesture action control instruction. In the system and the method, all or part of gesture actions of the user are sensed so as to finish accurate tracking on the gesture, thus, a real-time robust solution is provided for an effective gesture man-machine interface port based on a common vision sensor.

Description

technical field [0001] The present invention relates to the technical field of human-computer interaction, in particular to a human-computer interaction system and a real-time gesture tracking processing method thereof. Background technique [0002] Human-computer interaction technology is one of the fastest-growing fields in user interface research at present, and all countries attach great importance to it. Among the national key technologies, the United States lists the human-machine interface as one of the six key technologies in information technology alongside software and computers. Among the key technologies of US national defense, the human-computer interface is not only one of the important contents of software technology, but also one of the 11 key technologies alongside computer and software technology. The European Community's European Information Technology Research and Development Strategic Plan (ESPRIT) has also set up a user interface technology project, in...

AI Technical Summary

Problems solved by technology

[0008] The technical problem to be solved by the present invention is to provide a human-computer interaction system and its real-time gesture tracking processing method for the above-mentioned defects of the prior art. The problem of inaccurate detection can solve the problem of tracking failure due to complex lighting and background. Using computer vision and image processing technology to realize automatic hand detection, tracking and gesture recognition, real-time, robust, easy to implement and operate , enabling computer users to interact with computers more naturally, intuitively and intelligently through hand gestures

Images