Compensating Disparity Variation in Multi-Video Image Streams
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Virtual reality 360-degree stereoscopic video displays experience visual distortion when a user's view direction differs from the in-line image view direction, causing artifacts and altering perceived depth due to varying camera configurations and overlapping fields of view.
Innovation Solution
A method and system that adjust the video image streams by calculating a disparity parameter based on the user's view direction relative to the in-line view direction, applying stretching or compressing techniques to the left and right eye video image streams to maintain a consistent disparity, thereby minimizing distortion and enhancing the stereoscopic view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If stereoscopic video is captured using VR/360 camera rigs to provide a 360 degree virtual reality environment, then the immersive viewing experience is improved, but visual distortion occurs when the user's view direction differs from the in-line image view direction
Solution Approach 1:
The system dynamically adjusts the disparity parameter based on the user's viewing direction. When the user looks away from the in-line direction, the system calculates a new disparity parameter that compensates for the angular difference, thereby maintaining consistent depth perception across different viewing angles and eliminating visual distortion
Solution Approach 2:
The system changes the disparity parameter according to the user's view direction angle. By calculating the angular difference between the user's actual viewing direction and the in-line image view direction, the system adjusts the disparity parameter to compensate for perspective changes, thus maintaining accurate depth representation regardless of viewing angle
2Object-affected harmful factors
If the disparity parameter is adjusted based on user view direction, then visual distortion is reduced, but the system complexity increases due to real-time calculation requirements
Solution Approach 1:
The system implements a feedback mechanism where the user's viewing direction is continuously monitored, and the disparity parameter is dynamically adjusted in response. This closed-loop approach ensures that distortion compensation is applied in real-time based on actual user behavior, maintaining image quality without requiring overly complex pre-processing
3Measurement precision
If stretching or compressing is applied to video image streams to maintain consistent disparity, then depth perspective accuracy is improved, but processing time increases
Solution Approach 1:
The system pre-calculates disparity parameters for different viewing angles and stores them for quick retrieval. When the user's viewing direction changes, the system selects the appropriate pre-computed parameter rather than performing complex real-time calculations, thus maintaining depth accuracy while minimizing processing time
Data Source
AI summary
The disclosure is directed to a method to compensate for visual distortion when viewing video image streams from a multiple camera capture of a scene where the method determines the disparity difference utilizing the user view orientation and then compresses and/or stretches the left and/or right eye video image streams to compensate for the visual distortion. In another aspect, the method describes additional adjustments and corrections to the video image streams including rotating, tilting, shifting, and scaling the video image streams, and correcting for gapping and clipping visual image artifacts. In another aspect, a visual compensation system is described to implement the method. Additionally, a visual compensation apparatus is disclosed to perform the method operations.