A single shot hybrid reality implementation method combining environment mapping and global illumination rendering

Abstract

The invention discloses a single shot mixed reality realization method combining environment mapping and global illumination rendering. The method comprises the steps of positioning a virtual object and generating a realistic scene model; voxelizing and filtering the real scene model and virtual object; generating an environment map, and segmenting the realistic scene image by uniform distribution, and then inverting and mapping the image to form the environment map; carrying out cone-tracking rendering, and using the environment mapping of the cone-tracking rendering output to become a composite image. The method can utilize the powerful graphics computing power of the GPU to enhance the output effect of a general mixed reality system, and can simulate the reflection effect of a bright object on the surrounding environment under the condition of a single lens.

Description

technical field [0001] The invention relates to a mixed reality realization method, in particular to a single-lens mixed reality realization method combined with environment mapping and global illumination rendering. Background technique [0002] Nowadays, computers play a very important role in various industries, and the friendliness of human-computer interaction interface is a very important topic. A poor human-machine interface can greatly hinder the acceptance of an application, even if the application has strong functions. With the development, the human-machine interface has changed from the command line, to the graphical interface, and then to the multimedia interface, and in recent years, virtual reality has emerged. Mixed reality (Mixed Reality, MR) is the concept of expressing the fusion of virtual and reality. MR integrates multiple disciplines such as computer graphics, fusion display, and multi-sensors. The demand for this technology is also growing, and its ...

AI Technical Summary

Problems solved by technology

[0004](1) Realistic mixed reality effects need to meet the requirements of lighting consistency, but there are still many problems in this point, such as the overall ambient lighting information cannot be passed through ordinary Acquired by a single camera, high-quality lighting rendering requires a large amount of calculations, etc.

[0005](2) The academic community has proposed many algorithms to improve the consistency of illumination, but these algorithms are often complex, time-consuming to run, and difficult to apply to real-time In demanding occasions, and many algorithms use the method of adding additional lenses or placing markers, the versatility is low

[0006](3) The academic community basically uses the original local lighting for the rendering of mixed reality, and the rendering result is relatively rough

Moreover, global illumination technology is rarely able to achieve real-time effects. With the development of technology, several real-time global illumination technologies have emerged. However, coupled with the computing needs of the mixed reality system itself, it is also a problem to be solved to be able to achieve real-time requirements.

Images