Binocular image and object contour-based virtual and actual sheltering treatment method

Abstract

The invention relates to a binocular image and object contour-based virtual and actual sheltering treatment method, which comprises the following steps of: accurately calculating the regional contour of a real object by an interactive image segmentation algorithm, and taking the regional contour as the geometrical information of the real object; and according to the negatively-correlated relation between parallax and depth, estimating the parallax of a virtual object under a current visual angle, determining the relative depth information between the virtual object and the real object in a current scene, and hierarchically dividing the scene. The front-and-back sheltering relation between the virtual object and the real object is estimated and determined by using the relative depth information, the depth information is not required to be calculated in a pixel-by-pixel manner; and the virtual and actual sheltering treatment is achieved in a two-dimensional image space, whether the sheltering between the virtual object and the real object exists or not is judged, and corresponding treatment is carried out, so that the binocular image and object contour-based virtual and actual sheltering treatment method can be applicable to most sheltering circumstances and a better virtual and actual sheltering treatment effect is achieved. The binocular image and object contour-based virtual and actual sheltering treatment method can be widely applied to the spatial sheltering treatment of virtual reality systems, such as interactive digital entertainment, sports research and training simulation, distance education and training and the like.

Description

technical field [0001] The invention belongs to the field of augmented reality and the field of image processing, and is a method for processing virtual and real occlusion based on interactive object segmentation to solve the problem of virtual and real occlusion in the augmented reality field. Background technique [0002] Augmented reality, also known as augmented virtual reality, is a further extension of virtual reality. It has the characteristics of combination of virtual and real, real-time interaction, and three-dimensional registration. In an augmented reality scene, when a virtual object is three-dimensionally registered in the original scene, the three-dimensional orientation of its placement may have an occlusion relationship with some real objects in the original scene. In order to realize the fusion of virtual and real, it is necessary to solve the occlusion problem between virtual and real objects to ensure the realism and credibility of the augmented reality s...

AI Technical Summary

Problems solved by technology

At the beginning of image segmentation research, image segmentation methods are based on low-level features and machine learning methods, without rigid foreground and background constraints, can only extract the position or rough outline of the object in the image, and cannot accurately distinguish the object from the original image. purpose extracted from

Images