A Method of Illumination Estimation Based on Multiple Perspective Images

Abstract

A lighting estimation method based on multiple viewing angle images belongs to the technical field of computer image processing. The present invention reconstructs three-dimensional points in multiple viewing angle images. If there are specular reflection highlights in the viewing angle images, the number of light sources q is calculated, and highlights will not be included. The point image is decomposed into the intrinsic image, and the overdetermined equations composed of the gray value of the illumination map and the Lambert model are solved to obtain the number of light sources y. If q=y, directly solve the overdetermined equations to obtain the position and intensity of the light source, otherwise in the known part Solve the overdetermined equations under the position of the light source to obtain the position and intensity of the light source. When there is no highlight point in each perspective image, perform intrinsic image decomposition, and solve the overdetermined equations to obtain the position and intensity of the light source. The invention solves the problem of specular reflection and diffuse reflection in the scene at the same time, without any auxiliary markers or equipment, can still estimate the accurate light source position for the light source that cannot be detected according to the specular highlight point, and obtain a satisfactory virtual-real fusion effect.

Description

technical field [0001] The invention belongs to the technical field of computer image processing, and in particular relates to an illumination estimation method based on multiple perspective images. Background technique [0002] Augmented reality technology is an extension of virtual reality technology. It combines virtual objects generated by computers with actual scenes and presents them in front of users. It has great application prospects in various fields of production and life. In the early days, people paid more attention to the problems of 3D registration and virtual-real occlusion. With the continuous advancement of technology, solving the lighting consistency after virtual-real fusion is also the top priority. Illumination consistency mainly analyzes the light and shade changes and shadows caused by the real light source in the scene to the surface patch of the virtual object. [0003] The existing illumination estimation methods mainly include two methods of usin...

AI Technical Summary

Problems solved by technology

Salma Jiddi proposed to calculate the reflection direction of light based on the highlight points of specular reflection in the scene, but the estimation fails for light sources that do not cause specular reflection in the scene.

Images