Virtual Image Rendering with Blockwise Illumination Transfer
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image rendering technologies produce images that are not smooth enough, leading to reduced image quality and degraded user experience.
Innovation Solution
An image processing method involving replacing an object in a scene image with a preset template image, mapping it into a pixel coordinate system, dividing the scene image into blocks, determining pixel residuals and illumination offsets, and updating pixel values to implement illumination transfer, thereby enhancing image naturalness.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If existing image rendering technologies are used to replace objects with template images, then the rendering process is simple and fast, but the generated virtual images are not smooth enough and lack natural illumination, leading to reduced image quality
Solution Approach 1:
The scene image is divided into multiple image blocks, and pixel residuals are calculated for each block separately. This segmentation approach allows the illumination transfer to be performed locally on each block, improving the smoothness and naturalness of the virtual image while maintaining computational efficiency through parallel processing of blocks.
Solution Approach 2:
The patent applies local illumination transfer by calculating pixel residuals and illumination offsets for each image block individually. This local processing approach ensures that illumination characteristics are preserved accurately in different regions of the image, resulting in more natural-looking virtual images with proper lighting variations across different areas.
2Manufacturing precision
If simple template replacement is performed without illumination transfer, then the processing speed is fast and complexity is low, but the virtual image appears unnatural and image quality deteriorates
Solution Approach 1:
The patent performs preliminary calculations of pixel residuals and illumination offsets before the actual template replacement. By pre-computing these illumination parameters from the scene image, the method enables fast application of illumination transfer during the virtual image generation process, reducing overall processing time while maintaining high image quality.
Solution Approach 2:
The patent introduces illumination offsets as an intermediary element that mediates between the original scene illumination and the template image. These offsets are calculated from pixel residuals and used to adjust the pixel values of the virtual image, effectively transferring illumination characteristics from the scene to the template while maintaining processing efficiency.
Data Source
AI summary
The present disclosure provides an image processing method and an image processing apparatus. The image processing method including replacing an object in a scene image with a preset template image to generate a virtual image; dividing the scene image into a plurality of image blocks with a preset size; determining pixel residuals of the scene image according to an average pixel value of pixel points in an area where the object is located in the scene image and an average pixel value of pixel points falling into the area where the object is located in each of the plurality of image blocks; determining illumination offsets according to the pixel residuals; and updating pixel values of pixel points in the virtual image according to the illumination offsets to implement illumination transfer.