3D Image Processing Apparatus Edge-Adaptive Search
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques for estimating three-dimensional information using disparity images struggle to accurately account for luminance gradients and edges when multiple cameras are positioned arbitrarily, leading to reduced search accuracy and estimation precision.
Innovation Solution
An image processing apparatus that calculates three-dimensional information by selecting a base image and a reference image from a set of disparity images, using an evaluation value based on luminance gradients on the epi-polar line to determine the most reliable reference image for corresponding point search, thereby reducing the influence of luminance gradients and edges.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If block matching is performed along a straight line in an image, then the corresponding point search can be simplified, but accuracy deteriorates when luminance gradient exists perpendicular to search direction or edge exists parallel to search direction
Solution Approach 1:
The patent dynamically adjusts the search direction for each pixel based on the detected edge direction in the reference image. Instead of using a fixed straight-line search, the search direction varies adaptively to be perpendicular to the edge direction, allowing the algorithm to maintain simplicity while improving accuracy in regions with luminance gradients or edges.
2Reliability
If disparity images with horizontal and vertical disparity are used, then the influence of luminance gradient and edge can be reduced, but the requirement for specific camera setup (set camera with fixed positions) increases
Solution Approach 1:
The patent changes the parameter being optimized from camera configuration to image selection and processing parameters. Instead of requiring specific camera setups, the system selects the most appropriate reference image from multiple candidates and adjusts the search direction parameter based on edge detection, making the solution adaptable to arbitrary camera positions while maintaining reliability.
3Adaptability or versatility
If multiple cameras are positioned at arbitrary positions and attitudes, then the system becomes more versatile, but the accuracy of corresponding point search deteriorates due to luminance gradient and edge effects
Solution Approach 1:
The patent performs preliminary edge detection and luminance gradient analysis on the reference image before executing the corresponding point search. This preliminary action allows the system to pre-determine the optimal search direction for each pixel, ensuring that the subsequent search avoids luminance gradient and edge effects even when cameras are positioned arbitrarily, thereby maintaining precision while preserving versatility.
Data Source
AI summary
An image processing apparatus that calculates three-dimensional information on a subject by a corresponding point search by taking one of three or more disparity images including the common subject to be a base image and one of the disparity images other than the base image to be a reference image, and includes: a search unit configured to search corresponding points base on an evaluation value in relation to a luminance gradient on an epi-polar line in each of the disparity images other the base image.