Stereo Matching Distortion Correction for Dual Camera Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Image processing systems with cameras having different optical systems or line scan speeds face accuracy issues in distance estimation due to image distortion, particularly when angles of view or exposure timings differ, leading to degraded stereo matching performance.
Innovation Solution
An image processing apparatus that detects characteristic points in images from cameras with different angles of view or line scan speeds, determines characteristic point pairs, calculates mapping parameters, and corrects distortion using affine transform equations to generate undistorted images for accurate pattern matching and stereo matching.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If stereo matching is performed using two images with different distortion, then distance estimation can be performed, but distance estimation accuracy degrades
Solution Approach 1:
The patent applies preliminary action by calculating distortion parameters and performing distortion correction on images before stereo matching is executed. The distortion correction unit pre-processes the images from cameras with different optical systems or line scan speeds, ensuring that the images are geometrically aligned prior to feature point matching. This preliminary correction prevents accuracy degradation in subsequent distance estimation.
Solution Approach 2:
The patent utilizes parameter changes by dynamically calculating distortion parameters based on camera-specific characteristics such as angle of view and line scan speed. These parameters are used to transform the images into a common reference frame, adjusting the geometric parameters of the images to compensate for optical differences between cameras, thereby maintaining high stereo matching accuracy.
2Measurement precision
If acceleration sensors are used to detect image distortion, then distortion can be detected, but system cost increases
Solution Approach 1:
The patent replaces the mechanical sensor-based distortion detection system with a computational image processing approach. Instead of using acceleration sensors to physically detect camera movement and infer distortion, the system uses image processing algorithms to directly calculate distortion parameters from the image data itself, eliminating the need for additional mechanical sensing hardware and reducing system cost.
Solution Approach 2:
The patent applies self-service by enabling the image processing system to automatically detect and correct its own distortion without external sensing devices. The distortion correction unit uses the image data from the cameras themselves to calculate distortion parameters and perform correction, making the system self-diagnosing and self-correcting without requiring separate detection hardware.
Data Source
AI summary
According to an embodiment, an image processing apparatus includes a characteristic point detecting unit configured to detect a plurality of characteristic points in a first image and a second image imaged with two cameras having angles of view or angular velocity of line scan different from each other, a characteristic point pair determining unit configured to determine a plurality of characteristic point pairs between the first image and the second image from the detected plurality of characteristic points, a mapping parameter calculating unit configured to calculate a first parameter indicating mapping between the first image and the second image, and a distortion parameter calculating unit configured to obtain a second parameter indicating distortion of the first image and the second image from the first parameter.


