3D Shape Data Position Adjustment for Natural Image Lighting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing techniques struggle with accurately adjusting the position of three-dimensional shape data relative to captured images, leading to strange or unnatural images due to poor alignment, and fail to correctly estimate normal directions in the presence of noise and shadows.
Innovation Solution
An image processing apparatus that includes an image acquisition unit, distance acquisition unit, setting unit, detection unit, holding unit, position adjustment unit, and processing unit, which acquires image data, determines distance information, detects feature patterns, adjusts the position of three-dimensional shape data based on detected reference points, and performs lighting correction by prioritizing agreement at specific reference points.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If three-dimensional shape data is used for lighting correction, then lighting processing capability is improved, but position alignment accuracy deteriorates
Solution Approach 1:
The patent divides the position adjustment process into multiple reference points distributed across the three-dimensional shape data. Instead of treating position alignment as a single global adjustment, it is segmented into local adjustments at multiple reference points, allowing each point to be optimized independently while maintaining overall alignment accuracy.
Solution Approach 2:
The patent applies different weighting priorities to different reference points during position adjustment. The first reference point is given higher priority (greater importance) than the second reference point, allowing local optimization at critical locations while accommodating minor discrepancies at less critical locations, thus resolving the contradiction between overall alignment and local precision.
2Device complexity
If normal direction is estimated from brightness information, then processing simplicity is improved, but estimation accuracy deteriorates in presence of noise and shadow
Solution Approach 1:
The patent introduces three-dimensional shape data as an intermediary medium to estimate normal directions. Instead of directly estimating normal directions from captured image brightness information (which is affected by noise and shadow), the system uses the three-dimensional shape data as an intermediate reference to calculate normal directions, thereby filtering out the harmful effects of noise and shadow while maintaining processing simplicity.
Data Source
AI summary
An image processing apparatus generates a normal image, when lighting correction of an image is performed using three-dimensional shape data. Three-dimensional shape data of a predetermined object is adjusted with a subject in position, based on a feature pattern detected in image data, and lighting processing for correcting a pixel value of the image data is performed based on the adjusted three-dimensional shape data, distance information of the subject, and a position of a virtual light source. When the three-dimensional shape data is adjusted with the image data in position, a region having a large irregularity in the three-dimensional shape data is preferentially adjusted in position.