Virtual touch screen system and method for automatically switching interaction modes

Abstract

The invention provides a method for automatically switching interaction modes in a virtual touch screen system, and the virtual touch screen system. The method comprises the following steps of: projecting an image on a projection surface; continuously obtaining the images of the environment of the projection surface; in each frame of images obtained, detecting a candidate speckle block of at least one object within preset distance in front of the projection surface; collecting each speckle block in corresponding point sequence according to the relation of the centroid points of the speckle blocks obtained in two front and rear adjacent frames of images in time and in space; and searching the depth value of a special pixel in the candidate speckle block, when judging that the depth value is less than a first distance threshold, determining that the virtual touch screen system is in a first operation mode, and when judging that the depth value is greater than the first distance threshold and less than a second distance threshold, determining that the virtual touch screen system is in a second operation mode, and controlling the virtual touch screen system to switch automatically between the first operation mode and the second operation mode.

Description

technical field [0001] The invention relates to the fields of human-computer interaction and digital image processing. More specifically, the present invention relates to a virtual touch screen system and a method for automatically switching interaction modes. Background technique [0002] Touch screen technology is now more and more widely used in handheld devices (such as smart phones) and PCs (such as desktop PCs) as HMI devices. Through the touch screen, users can operate the device more comfortably and conveniently and bring a good experience. Although touch screen technology has been very successful in handheld devices, there are still some problems and opportunities for touch screens with large displays [0003] Belonging to Canesta, Inc titled "System and Method for Determining an Input Selected By a User through a Virtual Interface (system and method for determining the input selected by the user through a virtual interface)" US Patent US7151530B2 proposes a metho...

AI Technical Summary

Problems solved by technology

At that time, there were still many problems with the current technical solutions for large-size touch screens, such as: In general, these types of devices are usually bulky and bulky due to their hardware, so they are difficult to carry and not portable

Moreover, the screen size of these types of devices is limited by hardware and cannot be adjusted freely according to the needs of the environment, and a special electromagnetic pen or an IR pen is required for operation.

[0008] For some virtual whiteboard projectors, the user must control the on / off switch of the laser pointer, which is very cumbersome, so there is a problem that the laser pointer is difficult to control

In addition, in this kind of virtual whiteboard projector, once the laser pointer is turned off, it is difficult to accurately locate the laser point to the next position, so there is a problem that the laser point is difficult to locate

Some virtual whiteboard projectors use a finger mouse instead of a laser pointer, but a virtual whiteboard projector using a finger mouse cannot detect touch on or touch up

Images