Vehicle Image Stitching via Perspective Conversion for Seam Continuity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems for vehicles struggle to maintain continuity at seams between images captured by on-board cameras, leading to discomfort for drivers due to discontinuities caused by camera position and orientation shifts.
Innovation Solution
An image processing apparatus that acquires and processes images from multiple cameras, performs outline detection, determines if outlines represent the same object, and applies area setting and perspective conversion to ensure continuous outlines in the combined image, thereby eliminating discontinuities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If distant 360° circular images are combined to suppress overlap at seams, then the occurrence of overlap at seams is reduced, but the discontinuous portion at seams in near images remains conspicuous and causes driver discomfort
Solution Approach 1:
The patent applies parameter changes by performing perspective conversion on captured images to adjust their geometric parameters. This transformation modifies the viewing angle and spatial relationships in the images, enabling seamless stitching at seams while maintaining natural appearance in near-field regions, thus eliminating both overlap and discontinuity issues
Solution Approach 2:
The patent transitions from 2D image plane coordinates to 3D spatial coordinates by performing perspective conversion. This dimensional transformation allows the system to account for camera positions and orientations in three-dimensional space, enabling accurate image stitching that maintains continuity at seams while preserving natural appearance in near-field regions
2Reliability
If cameras are mounted by adjusting position and orientation to avoid discontinuity at seams, then continuity at seams is maintained, but position and orientation may shift due to vibration or external shock, causing discontinuity
Solution Approach 1:
The patent performs preliminary action by pre-calculating and storing the position and orientation information of each camera before image capture. This advance preparation enables the system to compensate for shifts in camera position and orientation during operation, maintaining continuity at seams even when physical mounting conditions change due to vibration or external shock
Solution Approach 2:
The patent implements feedback by using the stored position and orientation information to adjust the image processing parameters dynamically. This feedback mechanism allows the system to compensate for camera shifts in real-time, maintaining seamless stitching despite changes in camera mounting conditions caused by vehicle vibration or external forces
Data Source
AI summary
An image processing apparatus and method can combine images, while maintaining continuity without causing discomfort, that capture the surrounding area of an automobile. An image processing apparatus includes an image acquisition unit that acquires first and second images respectively capturing surrounding areas of an automobile including first and second areas, an outline detector that performs outline detection on the first and second images and generates first and second outlines respectively, a determiner that determines whether the first and second outlines each include an outline of the same object, and a area selector that performs area setting and perspective conversion on the first or second image when the first and second outlines are determined to include an outline of the same object, so that in a combined image generated by combining at least the first and second images, the first and second outlines are continuous at the same object.