Method for calculating lighting parameters and carrying out relighting rendering based on image and model

A lighting parameter, model calculation technology, applied in the field of heavy lighting rendering, to achieve the effect of fast rendering process, improve efficiency and increase cost

Inactive Publication Date: 2016-03-30
ZHEJIANG UNIV
View PDF4 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the complexity of the calculation of plenoptic functions, there are relatively few studies on re-illumination using plenoptic functions.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for calculating lighting parameters and carrying out relighting rendering based on image and model
  • Method for calculating lighting parameters and carrying out relighting rendering based on image and model
  • Method for calculating lighting parameters and carrying out relighting rendering based on image and model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031]The core of the method of the present invention is to extract the three-dimensional point cloud model of the scene from the input RGB image, use the information to establish an energy function and minimize it, thereby obtaining the illumination parameters, and finally render the scene model of the original image into the target image.

[0032] An embodiment is utilized below to describe the implementation of the specific process, and the steps are as follows (see figure 1 ):

[0033] (1) Read in a single original RGB image (see figure 2 ) and the 3D scene point cloud model corresponding to the image (see image 3 ), according to the relationship between the scene point cloud and the normal vector in the direction of the light source and the RGB value of the image, a linear equation system is established, and the direction vector of the light source is estimated by the least square method;

[0034] (2) Assuming that the objects in the scene are all Lambert bodies, cons...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for calculating lighting parameters and carrying out relighting rendering based on an image and a model, comprising the following steps: (1) using a 3D point cloud model of a scene to calculate the normal vector of each 3D point; (2) calculating the light source position and direction vector of an image according to the coordinates and the normal vector of each 3D point and the pixel value of the image; (3) by supposing that the lighting model of the image is a Phong model, calculating the parameters of an energy function in the model based on the light source information obtained in the previous step; (4) calculating the shadow and highlight areas of the image; and (5) giving a target RGB image to be rendered, fusing and rendering the scene and lighting information of the original image into the target image, and outputting a final rendering result. By using the method, the relighting process of special-effects production in film and television post-production is simplified, the relighting rendering result can be output quickly, and a user can preliminarily judge whether an input image is applicable to later virtual-real combination. The problem that rework is caused as the lens and post-production inconsistency cannot be found in the existing film and television production process is solved.

Description

technical field [0001] The present invention relates to a re-illumination rendering method, in particular to a method for calculating image illumination parameters and performing re-illumination rendering based on a single RGB image and a three-dimensional point cloud model of an image scene. Background technique [0002] Image-based relighting technology (IBRL) has a lot of research results in the field of graphics and image processing, but due to the influence of complex lighting changes, such as the formation of shadows and the mutual interference of multiple light sources, most of the existing research It is limited to relighting according to the ambient light after the 3D model is known or modeled on the 3D model. The existing image-based re-illumination methods are generally divided into three categories in terms of implementation principles, methods based on birefringence functions, basis functions and plenoptic functions. [0003] Compositing techniques in games and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T15/50
CPCG06T15/506
Inventor 耿卫东黄倩妮
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap