hand touch interaction system

Abstract

The invention discloses a hand touch interaction system which comprises a main controller, a hand touch sensor and a client-side arranged in a terminal device, wherein the hand touch sensor is connected with the main controller by a finger touch sensing layer; the hand touch sensor is used for detecting the touch actions of all contacts and transmitting the touch state information into the main controller; the main controller is used for carrying out data acquisition, comprehensive operation and control on more than one sensing device; the client-side is used for controlling the output of interactive results according to the information obtained by the acquisition and comprehensive operation of the main controller. According to the system, the touch or slide actions of fingers and palms can be detected by the hand touch sensor, the direction and the motion state of the hands can be detected by the other sensing devices, a finger contact detection part is used for replacing keyboard input, and a hand space displacement detection device is used for replacing a mouse, so that a more convenient and faster human-computer interaction way is provided.

Description

technical field [0001] The invention relates to human-computer interaction input technology, in particular to a hand touch interaction system. Background technique [0002] Touch screen technology is a new type of human-computer interaction input method. Compared with traditional keyboard and mouse input methods, touch screen input is more intuitive. With the improvement of touch screen technology, due to the convenience of manipulation, the touch screen has gradually replaced the mouse and keyboard in many occasions. The touch screen is mainly composed of a touch detection component and a touch screen controller. The touch detection component is installed in front of the display screen to detect the touch position, and then transmit relevant information to the touch screen controller. The main function of the touch screen controller is to receive touch information from the touch point detection device, convert it into contact coordinates and send it to the CPU, and at the ...

AI Technical Summary

Problems solved by technology

[0009] 1) Microsoft's Kinnect, which integrates functions such as real-time motion capture and image recognition, has changed the previous single operation mode of using keyboard, mouse, handle, etc., and has hand recognition and gesture support functions. However, as a game peripheral, Kinnect , the recognition accuracy is low, the response speed is slow, the hand interaction method based on dynamic capture and image recognition technology is easily affected by the external environment, and the reliability is poor, so it cannot be adapted to applications that require high real-time and reliability

[0010] 2) Leap's Leap Motion hand interaction control technology, compared with Kinnect technology, has the characteristics of being able to quickly and accurately identify the user's hand position and movement, but because Leap Motion uses infrared LED + dual-camera technology, the user's The hand must be in the recognition field. If it exceeds the recognition critical area or some fingers are covered by other fingers, the system will not be able to recognize it.

Due to the high difficulty of hand interaction technology, it is difficult to guarantee reliable accuracy and response speed, and there is no reliable hand interaction system product on the market

Images