A virtual-real fusion method with specular objects and transparent objects in the scene

Abstract

A virtual-real fusion method in which specular objects and transparent objects exist in a scene belongs to the technical field of computer virtual reality. The present invention first uses an RGB-D camera to photograph a scene in which specular objects and transparent objects exist, and recognizes the positions of the specular objects and transparent objects, and Perform 3D reconstruction of the scene. The reflection between objects is considered in the initial light source estimation, and the material parameters of specular objects and transparent objects are estimated. The estimated lighting results and model parameters are used for differential rendering to obtain the virtual-real fusion effect map. By estimating the BRDF model parameters of the specular object, the refractive index and the color attenuation coefficient of the transparent object, the present invention obtains a more realistic virtual-real fusion effect, and solves the problem of the virtual-real fusion illumination consistency of the mirror object and the transparent object in the scene. At the same time, the present invention proceeds from the optical principle when estimating the position of the light source, and considers the reflection between objects to obtain a more accurate position of the light source.

Description

technical field [0001] The invention belongs to the technical field of computer virtual reality, in particular to a method for estimating the position and intensity of a light source in a scene, the reflection coefficient of a specular object, the refractive index and color attenuation coefficient of a transparent object. Background technique [0002] Augmented reality technology combines the generated virtual objects with the actual scene and presents them in front of the user's eyes. In order to achieve a more realistic virtual-real fusion effect, it is necessary to make the virtual objects present the same lighting effect as the actual scene. The main consideration of lighting consistency should be the color and brightness changes caused by real light sources and real objects in the scene to the surface patches of virtual objects. [0003] Existing methods for solving illumination consistency virtual-real fusion are mainly divided into three categories: methods with auxil...

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to address the deficiencies of the existing methods, and propose a method for fusion of virtual and real images with consistent illumination that is applicable to specular objects and transparent objects in the scene, and solves the problem of caustics of specular objects and transparent objects in the actual scene. The impact that this method adopts is:

Images