Image Processing Apparatus Correcting Shine With Real Illumination Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing technologies fail to generate natural images with a three-dimensional effect by incorrectly correcting high-luminance areas, leading to unnatural lighting and loss of depth in images due to inadequate consideration of real illumination orientation.
Innovation Solution
An image processing apparatus that acquires normal information, estimates real illumination parameters, and performs lighting processing to correct high-luminance areas based on real and virtual illumination parameters, ensuring accurate orientation and depth preservation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Object-affected harmful factors
If luminance is reduced in high-luminance areas to suppress shine, then shine is corrected, but the variation of luminance value becomes small and the three-dimensional effect is lost
Solution Approach 1:
The patent applies different processing strategies to different regions of the image. High-luminance areas (shine regions) undergo luminance reduction to remove unwanted reflections, while other regions maintain their original luminance characteristics to preserve three-dimensional depth. This localized differential processing allows simultaneous suppression of shine and preservation of spatial depth information.
Solution Approach 2:
The patent performs preliminary identification and segmentation of high-luminance areas before applying correction. By detecting and marking shine regions in advance based on luminance thresholds and normal vector analysis, the system can selectively apply correction only where needed, preventing over-correction that would flatten the entire image and preserve three-dimensional effects in non-shine areas.
2Shape
If virtual illumination is generated without considering real illumination orientation, then three-dimensional effect is produced, but the gloss and shade are attached to incorrect positions creating unnatural images
Solution Approach 1:
The patent uses the estimated real illumination orientation as feedback to guide the generation of virtual illumination. By analyzing the orientation of high-luminance areas and normal vectors to infer the direction of real light sources, the system adjusts the virtual illumination parameters to match the real lighting conditions, ensuring that added gloss and shade appear at physically correct positions and create natural-looking images.
Solution Approach 2:
The patent dynamically adjusts illumination parameters (direction, intensity, color temperature) of the virtual light source based on estimated real illumination characteristics. By changing these parameters to align with the inferred real lighting conditions, the system ensures that synthetic three-dimensional effects are consistent with the actual scene lighting, preventing unnatural artifacts.
Data Source
AI summary
A natural image with a three-dimensional effect is generated after correcting a high-luminance area of an image. The image processing apparatus of the present invention includes a first acquisition unit configured to acquire normal information corresponding to an image, an estimation unit configured to estimate a real illumination parameter based on a high-luminance area of an object included in the image, a first setting unit configured to set a virtual illumination parameter based on the real illumination parameter, and a lighting processing unit configured to perform lighting processing for the image based on the normal information and the virtual illumination parameter.