Real-time rendering method and device based on dynamic illumination change

Abstract

The invention discloses a real-time rendering method and device based on dynamic illumination change. The method comprises the steps that a 3D model and an HDRI environment map of a scene are acquired; performing illumination estimation on the scene based on the 3D model of the scene and an HDRI environment map; performing basic rendering on the virtual object by adopting a shadow volume algorithmbased on the illumination estimation; performing HDRI mapping on the virtual object environment after basic rendering to obtain a current environment diagram, and performing enhanced rendering on thevirtual object based on the current environment diagram to obtain a real shadow of the virtual object; and when the illumination in the scene changes, updating the current environment map to match the current illumination based on the latest illumination estimation of the scene, and performing real-time rendering on the virtual object by using the updated current environment map. The rendering method and device solve the problem that in the prior art, a rendering method and device cannot create realistic illumination of the virtual object in the outdoor environment with dynamic illumination changes.

Description

technical field [0001] The invention relates to the field of augmented reality technology, in particular to a real-time rendering method and device based on dynamic lighting changes. Background technique [0002] Augmented Reality (AR) technology is a technology that ingeniously integrates virtual information with the real world. It superimposes computer-generated virtual objects on the real scene around the user in real time, thereby realizing the "enhancement" of the real world. In this process, it can be perceived by human senses, so as to achieve a sensory experience beyond reality. [0003] However, for augmented reality to be convincing, an important factor is to use real-world lighting when rendering virtual objects so that they are consistently shaded and cast consistent shadows when real-world lighting changes, such as When clouds pass by and cover the sun, the light will become weaker, and the light of the virtual object will also change accordingly. Otherwise, th...

AI Technical Summary

Problems solved by technology

The effect diagram of the rendering method in the prior art is as follows figure 1 as shown, figure 1 The picture on the left shows that when the lighting does not change, the white statue as a virtual object can be subtly integrated with the real scene, but when the real scene lighting changes, such as figure 1 As shown in the picture on the right, the dark clouds covered the sun, and the light in the yard was dimmed, but the white statue was still bathed in sunlight that was much stronger than the surrounding environment, and the shadow it cast on the ground did not disappear in the shadow of the cloud, enhancing the The real system cannot estimate and change the light in the scene as the lighting conditions change

Images