Spatial Masking for Seam Changes in Surround View Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle Surround View Systems suffer from visually perceptible seams and distortions due to dynamic seam placement and adaptive 3D bowl changes, which can be distracting and negatively impact the viewing experience.
Innovation Solution
Implement spatial and temporal masking techniques to coordinate viewport changes with dynamic seam and 3D bowl updates, using predicted future states and temporal filtering adjustments to minimize visual artifacts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Object-affected harmful factors
If dynamic seam placement is used to avoid objects in stitched images, then seam visibility is reduced, but visual discontinuities and artifacts appear between successive frames
Solution Approach 1:
The system predicts future object positions and pre-determines optimal seam locations before they become problematic. By anticipating where objects will move to in subsequent frames, the system can proactively place seams in advance to avoid both current and future object intersections, preventing visual discontinuities before they occur.
Solution Approach 2:
The system continuously monitors object positions and seam placements across successive frames, using this feedback to adjust and optimize seam locations dynamically. This closed-loop approach ensures that seam placements remain optimal as objects move, maintaining both seam avoidance and visual continuity over time.
2Loss of information
If adaptive 3D bowl modeling is used to represent surrounding environment, then distance information is recovered, but visual artifacts and distortions appear in surround view visualization
Solution Approach 1:
The system predicts future 3D bowl configurations based on anticipated scene changes and pre-adjusts the bowl parameters before significant distortions occur. This proactive approach allows smooth transitions in the 3D bowl representation while maintaining accurate distance information, preventing visual artifacts before they become noticeable.
Solution Approach 2:
The system dynamically adapts the 3D bowl model parameters in response to changing scene conditions, smoothly adjusting the bowl geometry as objects enter or leave the scene. This dynamic adaptation maintains the accuracy of distance information while minimizing visual artifacts through continuous, smooth parameter adjustments rather than abrupt changes.
Data Source
AI summary
In various examples, updates to a dynamic seam placement and/or fitted 3D bowl may be at least partially concealed using spatial masking. A future time in which a predicted change in dynamic seam placement and/or fitted 3D bowl exceeds some threshold may be determined, and a predicted dynamic seam movement and/or fitted 3D bowl update may be spatially masked by triggering a viewport switch to coincide with (a) the predicted dynamic seam placement and/or fitted 3D bowl update and/or (b) a relaxation or disabling of temporal filtering. Additionally or alternatively to predicting that a future change will exceed a threshold, the determination of the change may occur based on a change between a current and previous frame. In some embodiments that employ viewport switching to spatially mask visualization updates, the switch may be to one of a plurality of candidate viewports for an applicable scene maintained in a scene catalog.