Image based outdoor illumination environment reconstruction method

Abstract

The invention discloses an image based outdoor illumination environment reconstruction method, which comprises the steps of extracting video key frames from video according to equal time intervals, using the sky, the ground and a vertical surface in images of the video key frames as clues respectively, estimating a possibility distribution diagram of the sun position which is calculated and deduced by each clue, deducing a possibility distribution diagram of the sun position in a scene of the video key frames by combining the sun position possibility obtained according to the video sky, the ground and the vertical surface, and generating a sparse radiance diagram of the video scene key frames; and correcting an illumination estimation result of video non-key frames by using an illumination estimation result of the video key frames through an illumination parameter filtering algorithm, and realizing virtual light and real light integration of the video scene. According to the method, the lighting effect of generating the virtual and real light integration video is effectively smoothed.

Description

technical field [0001] The invention relates to a video-based outdoor lighting environment reconstruction method, which is used for video virtual-real fusion soundscape, and belongs to the technical field of image processing and enhancement. Background technique [0002] Virtual reality is a research field that has been developing continuously in recent years. Through high-tech with computer science and technology as the core, a realistic virtual environment that is highly similar to the real environment in terms of sight, hearing, and touch is generated, so that users can get immersive experience in the virtual environment. Feelings and experiences of the environment. Traditional virtual reality technology mainly emphasizes virtual scene modeling and virtual scene performance, and seldom directly integrates the virtual environment into the objective real world, which affects the development and application of virtual reality technology to a certain extent. Augmented realit...

AI Technical Summary

Problems solved by technology

Furthermore, from the perspective of video processing, most of the existing technologies ignore the correlation between video frames. When performing illumination estimation frame by frame, there are inevitably differences in the estimated information of a single frame, resulting in the generation of virtual images in the video scene. The discontinuity of the light and shadow effects of objects, that is, there are differences in the consistency of virtual and real lighting and virtual and real shadows between adjacent frames in the video

Images