Vehicle 360 Surround View Image Synthesis System
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle surveillance systems fail to provide an accurate 360° surrounding view due to misalignment of edges in stitched images, especially when 3D objects are present, leading to potential safety risks in complex driving environments.
Innovation Solution
An image synthesis system comprising cameras, an image processing device with defining, synthesis, transformation, seam registration, and deformation components, which transforms and stitches images from overlapping regions to create a seamless 360° view, aligning object edges and propagating alignment to generate a complete and accurate image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If multiple cameras are mounted on the vehicle to capture 360° surrounding images, then the monitoring coverage is improved, but the image stitching accuracy deteriorates due to edge misalignment of 3D objects
Solution Approach 1:
The patent divides the image stitching process into multiple stages: initial stitching of adjacent images, detection of misaligned 3D object edges, separate stitching of 3D objects versus background, and composite image generation. This segmentation allows different stitching methods to be applied to different image components, resolving the contradiction between comprehensive coverage and stitching accuracy.
Solution Approach 2:
The patent applies different stitching quality standards to different regions: 3D object edges receive precise alignment treatment while background regions use standard stitching. This local quality approach ensures high accuracy where needed (object edges) while maintaining overall system efficiency, directly addressing the edge misalignment problem in 360° views.
2Device complexity
If simple image stitching is used to combine multiple camera images, then the system complexity is reduced, but the image quality deteriorates due to visible seams and misalignment
Solution Approach 1:
The patent segments the stitching process into distinct modules: overlap region detection, 3D object identification, edge alignment, and composite generation. This modular segmentation maintains manageable system complexity while achieving high image quality through specialized processing at each stage.
Solution Approach 2:
The patent performs preliminary detection of 3D objects and their edges before executing the stitching operation. This preliminary action allows the system to prepare appropriate stitching strategies in advance, ensuring high image quality without requiring overly complex real-time processing.
3Speed
If traditional stitching methods are applied to images with 3D objects, then the processing speed is maintained, but the stitching accuracy deteriorates due to edge misalignment on seams
Solution Approach 1:
The patent separates 3D object stitching from background stitching, allowing each to be processed with optimized algorithms. This segmentation enables faster processing of simple background regions while applying more computationally intensive accurate alignment only where 3D objects are present, maintaining overall processing speed while improving accuracy.
Solution Approach 2:
The patent applies high-precision edge alignment processing only to 3D object regions rather than the entire image. This local quality approach concentrates computational resources where accuracy is critical, improving stitching accuracy for objects while maintaining acceptable processing speed for the overall system.
Data Source
AI summary
The present invention discloses an image synthesis system for a vehicle to provide the driver with a downward-facing image of the car's 360° surrounding view. The system includes: a first camera, which is used to shoot a first image of the periphery of the vehicle; a second camera, which is used to shoot a second image of the periphery of said vehicle, wherein the second image and the first image have an overlap region; an image processing device comprising a defining component and a synthesis component, which is used to synthesize the first image and the second image and output a third image; a display device, which is used to display the third image.