Stereo Matching Distortion Correction for Dual Camera Systems

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Image processing systems with cameras having different optical systems or line scan speeds face accuracy issues in distance estimation due to image distortion, particularly when angles of view or exposure timings differ, leading to degraded stereo matching performance.

Innovation Solution

An image processing apparatus that detects characteristic points in images from cameras with different angles of view or line scan speeds, determines characteristic point pairs, calculates mapping parameters, and corrects distortion using affine transform equations to generate undistorted images for accurate pattern matching and stereo matching.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If stereo matching is performed using two images with different distortion, then distance estimation can be performed, but distance estimation accuracy degrades

Engineering Contradiction:
Improvedistance estimation accuracyVSAvoidstereo matching accuracy
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent applies preliminary action by calculating distortion parameters and performing distortion correction on images before stereo matching is executed. The distortion correction unit pre-processes the images from cameras with different optical systems or line scan speeds, ensuring that the images are geometrically aligned prior to feature point matching. This preliminary correction prevents accuracy degradation in subsequent distance estimation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent utilizes parameter changes by dynamically calculating distortion parameters based on camera-specific characteristics such as angle of view and line scan speed. These parameters are used to transform the images into a common reference frame, adjusting the geometric parameters of the images to compensate for optical differences between cameras, thereby maintaining high stereo matching accuracy.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If acceleration sensors are used to detect image distortion, then distortion can be detected, but system cost increases

Engineering Contradiction:
Improvedistortion detection accuracyVSAvoidsystem cost
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical sensor-based distortion detection system with a computational image processing approach. Instead of using acceleration sensors to physically detect camera movement and infer distortion, the system uses image processing algorithms to directly calculate distortion parameters from the image data itself, eliminating the need for additional mechanical sensing hardware and reducing system cost.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent applies self-service by enabling the image processing system to automatically detect and correct its own distortion without external sensing devices. The distortion correction unit uses the image data from the cameras themselves to calculate distortion parameters and perform correction, making the system self-diagnosing and self-correcting without requiring separate detection hardware.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10726528B2Image processing apparatus and image processing method for image picked up by two cameras
Publication Date: 2020.07.28 KK TOSHIBA
  • US10726528B2 patent drawing
  • US10726528B2 patent drawing
  • US10726528B2 patent drawing

AI summary

According to an embodiment, an image processing apparatus includes a characteristic point detecting unit configured to detect a plurality of characteristic points in a first image and a second image imaged with two cameras having angles of view or angular velocity of line scan different from each other, a characteristic point pair determining unit configured to determine a plurality of characteristic point pairs between the first image and the second image from the detected plurality of characteristic points, a mapping parameter calculating unit configured to calculate a first parameter indicating mapping between the first image and the second image, and a distortion parameter calculating unit configured to obtain a second parameter indicating distortion of the first image and the second image from the first parameter.