Surround View Image Stitching for 3D Object Visibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional surround view systems for commercial vehicles face issues with reduced object visibility in stitching areas, leading to potential disappearance of 3D objects when images from multiple cameras are blended, due to static blending methods that fail to account for dynamic vehicle conditions and object positions.
Innovation Solution
An image synthesizer that dynamically adjusts the stitching line and blending area based on external conditions, such as vehicle speed and object positions, to ensure optimal visibility of 3D objects by moving the stitching line away from objects and using dynamic blending techniques like gradient or binary blending, and can also handle camera malfunctions by using adjacent camera views.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If static blending methods are used to combine images from multiple cameras, then the system complexity is reduced and ease of manufacture is improved, but object visibility is reduced and 3D objects may disappear in the stitching area
Solution Approach 1:
The patent applies dynamics by making the stitching line position variable rather than fixed. The stitching line is dynamically adjusted based on detected object positions and movement trajectories. When an object approaches the stitching line, the system shifts the stitching line position to maintain object visibility, preventing objects from disappearing at the boundaries of blended image regions.
Solution Approach 2:
The patent implements feedback by continuously monitoring object positions and movement in the surveillance area. The system uses detected object trajectories to provide feedback for adjusting the stitching line position in real-time, creating a closed-loop control system that adapts to changing scene conditions to maintain optimal object visibility.
2Area of stationary object
If the stitching line is positioned to provide seamless coverage of the surveillance area, then the area of coverage is maximized, but objects crossing the stitching line may disappear or become partially visible
Solution Approach 1:
The system dynamically repositions the stitching line based on real-time object detection and trajectory analysis. When objects are detected approaching the stitching line, the system shifts the stitching line position to ensure objects remain fully visible in one camera view, preventing the object disappearance problem while maintaining comprehensive surveillance coverage.
Solution Approach 2:
The patent changes the parameter of stitching line position dynamically based on object characteristics and movement. By adjusting this critical parameter in response to detected objects, the system optimizes the balance between seamless coverage and object visibility, ensuring that objects crossing what would traditionally be the stitching line location remain fully visible.
3Device complexity
If conventional surround view systems are used without adapting to commercial vehicle needs, then device complexity is reduced, but adaptability to specific vehicle conditions and external environments is limited
Solution Approach 1:
The patent introduces dynamic adaptability by adjusting image synthesis parameters based on external conditions such as vehicle speed, steering angle, and detected object characteristics. The system dynamically modifies stitching line position, blending parameters, and virtual camera positioning to adapt to changing operational conditions specific to commercial vehicles, enhancing versatility without requiring complete system redesign.
Solution Approach 2:
The system changes multiple parameters including stitching line position, virtual camera positioning, and image blending characteristics based on external conditions and vehicle operational state. This parameter adaptation allows the system to optimize performance for different commercial vehicle applications and environmental conditions while building upon conventional surround view system architecture.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An image synthesizer for a surround monitoring system for a vehicle comprises a receiving module (110) for receiving a first image (211) from a first camera (201), a second image (212) from a second camera (202), and a control signal (225) from a control module (220); and a combining module (120) for combining the first image (211) and the second image (212) in the overlapping region (213) and, dependent on the control signal (225), to generate a combined image (123), wherein the control signal (225) indicates a condition external to the vehicle.