Vehicle Camera Distortion Mapping for 3D Object Positioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in accurately estimating the position or distance of objects through a transmission body like glass, such as windshields, due to image distortion, which affects the accuracy of stereo disparity and three-dimensional reconstruction in automatic driving and driver assistance systems.
Innovation Solution
An information processing device that uses a distortion map to estimate camera motion, three-dimensional feature points, and correct image distortion, allowing for simultaneous estimation of these parameters to improve accuracy in object positioning and distance estimation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If image distortion caused by glass (windshield) is not corrected, then the device complexity is reduced, but the measurement precision of object position and distance estimation deteriorates
Solution Approach 1:
The patent applies preliminary action by pre-calculating and storing a distortion map that characterizes the glass-induced image distortion before actual object detection. This distortion map is created in advance through calibration processes and stored for later use during runtime, allowing the system to efficiently correct images without performing complex real-time calculations during object detection.
Solution Approach 2:
The patent introduces a distortion map as an intermediary element that mediates between the raw distorted images and the object detection algorithms. This distortion map serves as a correction layer that transforms distorted image coordinates into accurate real-world coordinates, enabling precise measurement without requiring complex iterative optimization during detection.
2Measurement precision
If distortion correction using distortion map is applied, then the measurement precision improves, but the processing time and computational load increase
Solution Approach 1:
The distortion map is pre-computed and stored during a calibration phase, eliminating the need for complex real-time distortion correction calculations during actual object detection and three-dimensional reconstruction. This preliminary preparation significantly reduces processing time during runtime while maintaining high measurement precision.
Solution Approach 2:
The patent replaces complex iterative mechanical optimization processes with a straightforward coordinate transformation using the pre-computed distortion map. Instead of performing repeated geometric optimizations to account for glass distortion, the system simply applies the stored distortion correction, dramatically reducing computational load and processing time.
3Measurement precision
If multiple images from different positions are used for three-dimensional reconstruction, then the measurement precision improves, but the device complexity and processing complexity increase
Solution Approach 1:
The distortion map serves as a unifying intermediary that standardizes coordinates across multiple images captured from different positions. By transforming all images into a common undistorted coordinate system using the distortion map, the system simplifies the three-dimensional reconstruction process and enables accurate depth estimation without requiring complex multi-camera calibration.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables more accurate three-dimensional reconstruction and object positioning by accounting for image distortion caused by glass, ensuring geometrical consistency between images and enhancing the accuracy of depth estimation.
Implementation Method 1
a plurality of pieces of detection information including distortion due to the transmission body that exists between the detection devices and the object
Data Source
AI summary
According to an embodiment, an information processing device includes one or more processors. The processors are configured to: acquire a plurality of pieces of detection information including detection results at two-dimensional positions different from each other acquired by detection of an object by one or more detection devices through a transmission body, the plurality of pieces of detection information including distortion due to the transmission body that exists between the detection devices and the object; detect a feature point from each of the plurality of pieces of detection information; and estimate, by minimizing an error between a three-dimensional position corresponding to the feature point and a detection position of the feature point corrected based on a distortion map expressing distortion at each of the two-dimensional positions, the distortion map, the three-dimensional position, and the detection position.