Moving object multi-view light and shadow synthesizing method based on sparse light field elements

Abstract

The invention provides a moving object multi-view light and shadow synthesizing method based on sparse light field elements. Light distribution of a light field data acquisition system is set according to the illumination radiation diagram of a target scene, and multi-view and multi-illumination light field data of a moving object are acquired and then the illumination effect of the moving object under the target scene is synthesized. The method mainly comprises the following steps that firstly the scene illumination radiation diagram is acquired from multiple scene light ball images of different exposures and decomposed into scene illumination elements; then clustering combination is performed on the illumination elements so that the sparse light field elements are obtained, and the number and the position of light field acquisition equipment light and video cameras are set according to the sparse light field elements; and finally the multi-view and multi-illumination light field data of the moving object are acquired in the light field acquisition equipment and the multi-view light and shadow effect of the moving object is synthesized. The moving object multi-view light and shadow synthesizing method based on the sparse light field elements can be widely applied to the aspects like film and television production.

Description

technical field [0001] The invention relates to the fields of computer vision and virtual reality, in particular to a multi-view light and shadow synthesis method for moving objects based on sparse light field primitives. Background technique [0002] Existing ray tracing algorithms can efficiently and realistically draw 3D models, but if an image or video similar to a real object is to be drawn, accurate 3D modeling of the scene and accurate extraction of material properties in the scene are required. Time consuming and in some cases impossible. To solve this problem, Image-Based Lighting (IBL) is proposed, which is an important method for realistically generating virtual scenes. The basic principle is to collect the multi-illumination and multi-view light field data of the target object, and generate the lighting effect of the collected object in the target scene through the linear addition of the difference of view angle and the light and shadow effect. However, this te...

AI Technical Summary

Problems solved by technology

However, this technology requires an ultra-high-speed camera to complete the data collection of various viewing angles and lighting conditions under a "relatively still" object in a very short time

The high price of ultra-high-speed cameras and the complicated synchronization equipment between cameras and lights make this technology difficult to promote

Images