Virtual touch screen human-computer interaction method, system and device based on depth sensor

Abstract

The invention discloses a virtual touch screen human-computer interaction method, system and device based on a depth sensor. The system comprises a construction module, a division module, a calculation module and a control module. The method comprises the steps that a virtual touch screen interactive space is constructed according to virtual touch screen anchor points; the virtual touch screen interactive space is divided; interactive touch points are monitored, and touch force factors corresponding to the interactive touch points are calculated; and operation control is performed according totwo-dimensional coordinate positions and the touch force factors corresponding to the interactive touch points. The device comprises a memory and a processor used for implementing the virtual touch screen human-computer interaction method. By use of the virtual touch screen human-computer interaction method, system and device, the reliability and flexibility of virtual touch screen interaction can be greatly improved, responses can be made to different touch screen operation based on region boundaries, misoperation is reduced, and the accuracy of virtual touch screen operation is greatly improved. The virtual touch screen human-computer interaction method, system and device based on the depth sensor can be widely applied to the human-computer interaction field.

Description

technical field [0001] The invention relates to non-contact human-computer interaction technology, in particular to a virtual touch screen human-computer interaction method, system and device based on a depth sensor. Background technique [0002] Explanation of technical terms: [0003] The camera of the first-generation Kinect system: it belongs to the depth sensor, which uses PrimeSense’s structured light technology, that is, perceives the surrounding environment through the CMOS infrared sensor, and uses discrete light spots to project such a one-dimensional or two-dimensional image onto the measured object. According to the size and distortion of the image, the surface shape of the measured object can be judged, that is, the depth information. In the somatosensory device of Microsoft Kinect, two infrared cameras collect and provide depth data by emitting / receiving infrared rays. [0004] The camera of the second-generation Kinect system: it belongs to the depth sensor,...

AI Technical Summary

Problems solved by technology

However, the current non-contact touch technology developed based on the depth sensor is prone to misuse, resulting in low reliability, and also has disadvantages such as low accuracy of interactive recognition, poor stability, and low operating experience. The non-contact touch technology developed based on sensors cannot well meet the user's requirements for the use of non-contact touch technology, which makes it difficult to widely promote and apply the technology, and the commercial availability is low

Images