Stereo Image Correction for Windshield Distortion Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems face challenges in enhancing the accuracy of parallax images due to image distortion caused by windshields, which affects the precision of stereo matching processes.

Innovation Solution

An image processing apparatus and method that includes a first distance calculation unit, a second distance calculation unit, a correction amount calculation unit, and an image correction unit to adjust pixel positions in lateral directions based on correction amounts, using correction map data to compensate for non-uniform optical characteristics of windshields, thereby improving parallax image accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a stereo matching process is performed on stereo images to detect distance and orientation, then object recognition capability is improved, but measurement precision deteriorates due to windshield-induced image distortion

Engineering Contradiction:
Improvedistance measurement precisionVSAvoidwindshield distortion
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent introduces a correction map as an intermediary element that models the distortion caused by the windshield. This correction map is used to transform the distorted stereo images into corrected images, thereby eliminating the harmful distortion effect while preserving the original imaging data. The correction map acts as a mediator between the distorted image and the desired accurate measurement.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the parameter space by transforming image coordinates using the correction map. The correction map provides correction values that adjust the pixel positions in the stereo images, effectively changing the spatial parameters of the image data to compensate for the windshield distortion and improve measurement precision.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If correction map data is used to adjust pixel positions, then parallax image accuracy is improved, but device complexity increases

Engineering Contradiction:
Improveparallax image accuracyVSAvoidimage processing system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The correction map is pre-calculated and stored before the actual image processing. This preliminary action allows the system to use simple lookup and transformation operations during runtime, rather than performing complex calculations in real-time. The correction map is generated in advance using calibration data, reducing the computational complexity during actual stereo matching operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a corrected image by copying and transforming the original distorted image using the correction map. Instead of fundamentally redesigning the imaging system, the system copies the original image data and applies geometric transformations through the correction map, achieving accurate parallax images without adding complex hardware components.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12499523B2Image processing apparatus and image processing method
Publication Date: 2025.12.16 SUBARU CORP
  • US12499523B2 patent drawing
  • US12499523B2 patent drawing
  • US12499523B2 patent drawing

AI summary

An image processing apparatus includes a first distance calculation unit, a second distance calculation unit, a correction amount calculation unit, and an image correction unit. The first distance calculation unit calculates a first distance to an imaging target based on first images which are generated by a first camera and included in stereo images. The second distance calculation unit calculates a second distance to the imaging target based on at least one of the stereo images. The correction amount calculation unit calculates, if a difference between pixel positions, each corresponding to the imaging target, in the respective first images is within a predetermined amount, a correction amount of a pixel position corresponding to the imaging target in an image based on the first and second distances. The image correction unit causes a position of a pixel value included in the image to move laterally based on the correction amount.