A light and shadow estimation and reconstruction method suitable for AR virtual soft package synthesis

A light and shadow and soft decoration technology, applied in computing, 3D image processing, image data processing, etc., can solve the problems of high cost and not beautiful enough, achieve the effect of low hardware requirements, shorten rendering time, and ensure rendering quality

Active Publication Date: 2019-06-28
南京可居网络科技有限公司
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to increase the rendering speed, one method is "cloud rendering", which is to distribute the rendering work to thousands of large-scale server groups for parallel computing in the background. Currently The fastest high-definition cloud rendering on the market can reach 10 seconds, but this requires the hardware support of many server farms, and the cost is high. Another method is to sacrifice quality for speed, ignoring factors with lower weight such as reflected light and scattered light Wait, so as to greatly increase the computing speed and achieve real-time computing effects. The typical representative is unity, and the application site is games. The problem with unity is that it is not beautiful enough, which is fatal in the field of soft decoration design

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A light and shadow estimation and reconstruction method suitable for AR virtual soft package synthesis
  • A light and shadow estimation and reconstruction method suitable for AR virtual soft package synthesis
  • A light and shadow estimation and reconstruction method suitable for AR virtual soft package synthesis

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment 1

[0041] combine figure 1 , the present invention refers to a light and shadow estimation and reconstruction method suitable for AR virtual soft decoration synthesis, the method includes:

[0042] S1: Receive scene pictures and material pictures.

[0043] The scene pictures and material pictures received are not limited to sources, they can be computer rendered pictures, real pictures and so on.

[0044] S2: Estimate the light and shadow parameters of each pixel in the scene image.

[0045] S3: Synthesize the material picture into the scene picture according to the perspective relationship, call the light and shadow parameters of the pixel points of the scene picture corresponding to the position of the material picture, and add the light and shadow parameters of each pixel point to the synthesized scene according to the set rules In the corresponding pixels of the picture, to complete the light and shadow reconstruction.

[0046] The present invention calculates the light an...

specific Embodiment 2

[0104] Figure 5 is a picture of a scene, yes Figure 5 After estimating the light and shadow parameters in , save the estimated light and shadow parameters to the mask.png file.

[0105] right Figure 5The carpet in the scene is replaced, and the new carpet material picture is replaced to the corresponding position in the original scene, such as Image 6 As shown in (a), when the replacement operation is performed and the original light and shadow parameters are not restored, there is no light and shadow effect caused by outdoor sunlight on the new carpet, which is inconsistent with the light and shadow effects on the surrounding furniture, and the fusion effect is poor.

[0106] If according to the light and shadow reconstruction method mentioned in the present invention, the original light and shadow parameters in the extracted scene are added to the synthesized picture, such as Image 6 As shown in (b), the new carpet has similar light and shadow parameters to the origi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a light and shadow estimation and reconstruction method suitable for AR virtual soft package synthesis. The method comprises the steps of receiving a scene picture and a material picture; estimating a light and shadow parameter of each pixel point in the scene picture; and synthesizing the material picture into the scene picture according to the perspective relationship, calling the light and shadow parameters of the pixel points of the scene picture corresponding to the position where the material picture is located, and adding the light and shadow parameters of each pixel point into the corresponding pixel point of the synthesized scene picture according to a set rule. The light and shadow parameters of each pixel point in the scene picture are estimated, and thenthe light and shadow parameters of each pixel point are added to the corresponding pixel point of the synthesized scene picture according to the set rule, so that the rendering time is shortened on the premise that the rendering quality is ensured, the requirement on hardware is low, and the method is suitable for being used by a mobile terminal.

Description

technical field [0001] The present invention relates to the technical field of graphics and image processing, in particular to a light and shadow estimation and reconstruction method suitable for AR virtual soft decoration synthesis. Background technique [0002] When compositing soft decoration renderings, if you simply add or replace materials in the scene, the light and shadow effects of the source images are inconsistent, resulting in a "fake" rendering, and the materials and the scene are out of place. Especially in some occasions, the scene pictures and / or material pictures are taken by the user, and the aforementioned "out of place" feeling will be more obvious. [0003] At present, mainstream rendering software such as 3dMax adopts a rendering method to naturally integrate the two. The mainstream rendering algorithm idea is to calculate the light rendering effect point by point according to the nature, position, attenuation, position of the light object, material an...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T15/50G06T15/04
Inventor 徐耀华徐耀文郑霖
Owner 南京可居网络科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap