Method for estimating material reflection parameters based on images acquired by portable equipment

A portable device, reflection parameter technology, applied in image data processing, image enhancement, image analysis, etc., can solve problems such as ineffective effect, large deviation between roughness and specular reflection coefficient estimation and true value, etc., to avoid false effects of shadows, reasonable specularity and roughness

Active Publication Date: 2021-04-09
ZHEJIANG UNIV
View PDF4 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, a large number of tests have shown that this method is not robust, especially on materials such as specular materials whose brightness changes drastically with angle changes, the output results have obvious artifacts on the parameter map, and sometimes the roughness and The specular reflection coefficient estimate has a large deviation from the true value

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for estimating material reflection parameters based on images acquired by portable equipment
  • Method for estimating material reflection parameters based on images acquired by portable equipment
  • Method for estimating material reflection parameters based on images acquired by portable equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0048] This embodiment mainly compares the existing methods (see [Deschaintre, Valentin, et al. "Single-image svbrdf capture with a rendering-aware deep network." ACM Transactions on Graphics (ToG) 37 (4), 1-15, 2018 .]) and the estimation results of the method of the present invention in real materials are compared. figure 2 These are 4 material pictures collected under ambient light and flash light. image 3 For the comparison between the present invention and the existing method, it can be found that the present method does not have the ubiquitous artifact phenomenon in the existing method, and the specular map and roughness map estimated by this method are more in line with the objective reality, from Figure 4 From the rendering results, the image re-rendered by this method is closer to the actual collected image than the existing method.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for estimating a material reflection parameter based on images acquired by portable equipment. The method comprises the following steps: shooting a material ambient light image and a flash lamp image; estimating the material roughness, the specular reflection coefficient, the diffuse reflection coefficient and the normal map according to the ambient light image; calibrating the direction, the distance and the real irradiance to the camera and the light source in a per pixel manner; solving a color channel correction vector between the ambient light image and the flash light image; and determining the positions of similar pixel points based on clustering, determining the final cluster number by adopting a gradual iterative refinement mode, and endowing points in each class with the same reflection parameters. The method can be used for conveniently estimating the SVBRDF parameters of the material; and aiming at the phenomenon that some material maps estimated by a neural network at present have serious halo and the like, the method can re-estimate the reflection parameters of the material by shooting the material flash lamp image andthe ambient light image, so that the sense of reality of rendering is improved.

Description

technical field [0001] The invention relates to material reflection parameter estimation, in particular to a method for estimating material reflection parameters based on images collected by portable devices. Background technique [0002] In the real world, the appearance properties of an object under different lighting conditions and different viewing angles are determined by the material on the surface of the object. How to restore the material conveniently and efficiently is an important topic in computer graphics at present, and it is widely used in visual effects, electronics, etc. business, product design, and entertainment. However, digitally obtaining high-quality material appearance from the real world is still a challenging problem. The biggest challenge is that the material appearance in the real world has great complexity. Objects in the real world are generally composed of multiple materials, and the surface of the material has complex geometry, which will incr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06T7/80G06K9/62
CPCG06T5/001G06T7/80G06T2207/10024G06F18/23213
Inventor 张锦博沈会良
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products