Man-machine interaction system device on basis of gesture recognition and method for operating man-machine interaction system device

Abstract

The invention discloses a man-machine interaction system device on the basis of gesture recognition and a method for operating the man-machine interaction system device. The man-machine interaction system device comprises a single camera, a PC (personal computer), a PLC (programmable logic control) board and physical application equipment. Man-machine interaction programs are installed in the PC. The method is implemented by the aid of a gesture input module, a fingertip positioning module, a gesture tracking module and a keyboard and mouse mapping module. According to the man-machine interaction scheme on the basis of gesture recognition, the man-machine interaction system device and the method have the advantages that the problem of limitation of man-machine interaction modes which need to be sensed by a large quantity of hardware equipment at present can be solved, and accordingly man-machine interaction can be naturally and conveniently carried out.

Description

technical field [0001] The invention relates to a human-computer interaction system device and an operating method, in particular to a gesture recognition-based human-computer interaction system device and an operating method. Background technique [0002] With the rapid development of science and technology and the increasing popularity of computer vision, people have higher and higher requirements for the naturalness of human-computer communication. All traditional human-computer communication methods, such as mouse, keyboard, microphone, etc., are increasingly unable to meet people's needs. Using human hands as a means of communication between computers and humans is more natural, concise, rich, and direct than other means of communication. Therefore, a computer that can provide gesture recognition will make communication between humans and machines more natural and convenient. [0003] The current gesture recognition system mostly uses the following two types: [0004] ...

AI Technical Summary

Problems solved by technology

[0011] Another object of the present invention is to provide an operation method for applying the above-mentioned human-computer interaction system device based on gesture recognition, propose a solution for palm point calculation, and use the Camshift algorithm to realize the simulation of the keyboard and mouse, and solve the existing problems. The limitations of human-computer interaction methods that require a large number of hardware devices make human-computer interaction more natural and convenient, and better solve the problems caused by ambiguity and diversity of gestures

Images