Multi-point touch method based on binocular stereo vision

A binocular stereo vision and multi-touch technology, applied in the field of human-computer interaction, can solve the problems of fine and expensive equipment, multiple invalid input points, no consideration of color and pixel distance, etc., and achieve diversified operation methods and natural operation experience Effect

Inactive Publication Date: 2009-03-25
SHANGHAI JIAO TONG UNIV
View PDF0 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Not only is the equipment relatively fine and expensive, but the coordinate information obtained is only two-dimensional
[0004] After searching the literature of the prior art, it was found that in the article "3d virtual studio for natural interacting" published by Namgyu Kim et al. on IEEE TRANSACTIONS ONSYSTEMS, MAN, AND CYBERNETICS in 2006, it

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-point touch method based on binocular stereo vision
  • Multi-point touch method based on binocular stereo vision
  • Multi-point touch method based on binocular stereo vision

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The embodiments of the present invention are described in detail below in conjunction with the accompanying drawings: this embodiment is implemented on the premise of the technical solution of the present invention, and detailed implementation methods and specific operating procedures are provided, but the protection scope of the present invention is not limited to the following the described embodiment.

[0033] Such as figure 1 As shown, it is the multi-touch system based on binocular stereo vision adopted in this embodiment. The binocular camera group composed of two cameras inputs images, and the user can make actions at a distance of about half a meter from the cameras to collect images. After calculation by the algorithm of the present invention, the depth information of the scene can be obtained in real time, and through Gaussian blur filtering to noise points and appropriate selection of the threshold, multiple patches closest to the camera are extracted, and th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a multipoint touch method based on binocular stereoscopic vision, which relates to the technical field of computer vision. The method comprises the following steps: firstly, the azimuth and the projection parameters of a camera relative to a three-dimensional scene are determined through camera calibration, and a binocular camera is utilized to acquire an image pair; secondly, two pictures on the same frame which are acquired on the first step are taken as input, and a scene depth map is calculated by the stereoscopic vision algorithm; thirdly, closest patches are obtained through Gaussian blur and determined thresholds, and central coordinates of the patches are calculated; and fourthly, a plurality of coordinates obtained in the third step are taken as input of a multipoint touch program, and interactive results are returned to a screen. The multipoint touch method based on binocular stereoscopic vision can realize completing the multipoint touch operation in space by a user without touching the screen, and coordinate information of input points acquired is three-dimensional, so that the multipoint touch method can realize more complex interaction such as push and pull of a virtual object and so on.

Description

technical field [0001] The invention relates to a human-computer interaction method in the technical field of computer vision, in particular to a multi-point touch method based on binocular stereo vision. Background technique [0002] Binocular stereo vision is a kind of image modeling technology. Its purpose is to use stereo image pairs to obtain the depth information of the scene and restore the geometric model of the object. The focus of stereo vision is different from the generalized image-based modeling technology, which also includes recovering the appearance, lighting conditions, and motion trajectories of objects from images, so it can be used with a small amount of geometric information or even without any geometric information In the case of information, the imaging of the object under the new viewpoint is drawn based on only several original images. The main advantage of stereo vision is to use the images of two or more cameras to recover the depth information of...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/041G06T7/00
Inventor 丁晓东杨旭波肖双九陈一帆
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap