Vehicle Camera Monitor Image Stitching for Panoramic Rear-Side Views
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing camera systems in vehicles struggle to efficiently combine images from multiple cameras, making it difficult for drivers to analyze the surrounding environment effectively.
Innovation Solution
A method and apparatus for image stitching in a camera monitor system (CMS) that involves obtaining images from multiple cameras, performing perspective transformations, and aligning and blending them to create a combined panoramic view, including distortion correction and cropping as necessary.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If multiple camera images are provided to the vehicle operator, then the field of view is enhanced and comprehensive coverage is achieved, but it becomes difficult for the driver to efficiently analyze the images
Solution Approach 1:
The patent combines multiple camera images (side cameras and rear camera) into a single stitched panoramic image. This merging process integrates the separate image feeds into one unified view that provides comprehensive coverage while eliminating the need for the driver to analyze multiple separate images, thus resolving the contradiction between enhanced field of view and ease of analysis
2Loss of information
If images from multiple cameras are displayed separately, then complete coverage of surrounding areas is achieved, but the complexity of analyzing multiple feeds increases
Solution Approach 1:
The system merges multiple camera feeds into a single stitched panoramic image that maintains complete coverage of all surrounding areas. By combining the information from side cameras and rear camera into one integrated display, the system preserves all necessary visual information while reducing the complexity of analysis for the driver
3Device complexity
If conventional mirrors are used, then the system is simple, but the field of view is limited and cannot provide views not fully obtainable via conventional mirror
Solution Approach 1:
The patent replaces conventional mechanical mirrors with an electronic camera-based monitoring system. This substitution enables a significantly enhanced field of view and comprehensive coverage of surrounding areas that cannot be achieved with traditional mirrors, while the processed panoramic display maintains ease of viewing for the driver
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method for a camera monitor system (CMS) includes obtaining a first image from a first camera that depicts a first area that extends along a first side of a commercial vehicle; obtaining a second image from a second camera that depicts a second area that extends along a second side, opposite the first side, of the commercial vehicle; obtaining a third image from a third camera that depicts a rear area behind the commercial vehicle; performing a perspective transformation on the first image, the second image, and the third image to obtain an updated image set, such that each of the first image, second image, and third image are updated in the updated image set; and stitching the images of the updated image set together to form a combined image in which the third image is disposed between the first image and second image, and in which the first area, second area, and rear area are each depicted. A CMS is also disclosed.