Multi-point touch method based on binocular stereo vision

Abstract

The invention relates to a multipoint touch method based on binocular stereoscopic vision, which relates to the technical field of computer vision. The method comprises the following steps: firstly, the azimuth and the projection parameters of a camera relative to a three-dimensional scene are determined through camera calibration, and a binocular camera is utilized to acquire an image pair; secondly, two pictures on the same frame which are acquired on the first step are taken as input, and a scene depth map is calculated by the stereoscopic vision algorithm; thirdly, closest patches are obtained through Gaussian blur and determined thresholds, and central coordinates of the patches are calculated; and fourthly, a plurality of coordinates obtained in the third step are taken as input of a multipoint touch program, and interactive results are returned to a screen. The multipoint touch method based on binocular stereoscopic vision can realize completing the multipoint touch operation in space by a user without touching the screen, and coordinate information of input points acquired is three-dimensional, so that the multipoint touch method can realize more complex interaction such as push and pull of a virtual object and so on.

Description

technical field [0001] The invention relates to a human-computer interaction method in the technical field of computer vision, in particular to a multi-point touch method based on binocular stereo vision. Background technique [0002] Binocular stereo vision is a kind of image modeling technology. Its purpose is to use stereo image pairs to obtain the depth information of the scene and restore the geometric model of the object. The focus of stereo vision is different from the generalized image-based modeling technology, which also includes recovering the appearance, lighting conditions, and motion trajectories of objects from images, so it can be used with a small amount of geometric information or even without any geometric information In the case of information, the imaging of the object under the new viewpoint is drawn based on only several original images. The main advantage of stereo vision is to use the images of two or more cameras to recover the depth information of...

AI Technical Summary

Problems solved by technology

Not only is the equipment relatively fine and expensive, but the coordinate information obtained is only two-dimensional

[0004] After searching the literature of the prior art, it was found that in the article "3d virtual studio for natural interacting" published by Namgyu Kim et al. on IEEE TRANSACTIONS ONSYSTEMS, MAN, AND CYBERNETICS in 2006, it was proposed to use stereo vision technology to obtain the scene model and interact with the 3D scene , its shortcoming is that the stereo vision algorithm used does not take into account the color and pixel distance, and the obtained scene depth map has a lot of noise. If it is applied to multi-touch, it will generate more invalid input points.

Images