Panoramic Vision System Parallax Mitigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Panoramic vision systems with camera rings face challenges in transitioning between cameras, resulting in pronounced parallax differences and excessive latency due to processing requirements, which are undesirable for real-time applications.
Innovation Solution
A panoramic image system with a head tracker providing azimuth and elevation position signals to determine the contribution of image data from multiple image sensors, blending overlapping fields of view to minimize parallax errors and reduce latency, using a controller to dynamically adjust the image contribution based on head movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If image sensors are switched at the center of the angle between two cameras, then latency is reduced, but parallax difference causes pronounced scene jumps
Solution Approach 1:
The patent applies dynamics by making the transition between image sensors dynamic rather than static. Instead of switching at a fixed center angle, the system dynamically determines which image sensor to use based on real-time head position tracking. The controller continuously monitors head azimuth and elevation angles and selects the appropriate image sensor dynamically, allowing seamless transitions that account for the viewer's actual gaze direction and minimize parallax effects.
Solution Approach 2:
The patent implements feedback through head position tracking. A head tracker provides real-time feedback on the viewer's head orientation (azimuth and elevation angles), which the controller uses to dynamically adjust image sensor selection. This feedback loop enables the system to adapt to changing viewing conditions and maintain optimal image quality by selecting the appropriate sensor based on where the viewer is actually looking.
2Manufacturing precision
If depth fields are generated for accurate image stitching, then stitching accuracy is improved, but processing time increases causing excessive latency
Solution Approach 1:
The patent extracts and eliminates the unnecessary depth field generation step from the image stitching process. Instead of generating complex depth fields and applying video images as textures overlaying them, the system directly selects and switches between image sensors based on head position. This removes the computationally intensive depth mapping operation while maintaining acceptable stitching accuracy through intelligent sensor selection in overlapping FOV regions.
Solution Approach 2:
The patent replaces the expensive, time-consuming depth field generation process with a simpler, faster alternative. Rather than investing significant processing resources in generating accurate depth maps for every frame, the system uses a lighter approach: tracking head position and switching between pre-captured images from multiple sensors. This disposable-like approach uses simple, fast operations (head tracking and sensor switching) instead of complex, resource-intensive processing.
Data Source
AI summary
A panoramic image system with parallax mitigation includes a controller that can generate on a display an IFOV that includes image data from both a first image sensor having a first FOV and a second image sensor having a second FOV which are overlapping FOVs. The IFOV includes a portion of the non-overlapping section of a first FOV, the overlapping sections of both the first and second FOVs, and a portion of the non-overlapping section of the second FOV. The overlapping section of the first FOV is blended with the overlapping section of the second FOV, wherein the first FOV and the second FOV both have a level of contribution to the blended overlapping section. The level of contribution to the blending from the first FOV increases as the viewer’s head moves in a first angular direction and decreases as the viewer’s head moves in a second angular direction.