A technology to combine photorealistic 3D reconstruction and synthetic objects

Abstract

This is a method of photorealistic integration of three-dimensional objects into real photographic images. First, a 3D model of the environment is created from the available photographs using the 3D Gaussian Splats method. The mutual position and orientation are calculated for each photograph. A virtual object (3D mesh) is then inserted into the model obtained in this way, which in the final rendering is appropriately overlapped with the real elements of the scene (occlusion). This achieves an authentic connection of real and virtual elements without additional manual adjustments or complex masking procedures. The method is particularly suitable for marketing, architecture and the creation of augmented reality, where it speeds up and simplifies the process of photorealistic visualization.