Immersive Video System Using Eye-Tracking for Foveal Quality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional immersive video systems consume excessive resources and increase costs by transferring high-quality video content to all areas of a viewer's field of view, regardless of human visual system (HVS) sensitivity, which limits quality and efficiency in content delivery.
Innovation Solution
An immersive video system that uses eye-tracking technology to adjust video quality based on saccadic eye movement, delivering higher quality content to the foveal area and lower quality to peripheral regions, optimizing resource usage by predicting and adapting to the viewer's field of view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high-quality video content is transferred to all areas of a viewer's field of view, then video quality is improved, but resource consumption and transmission costs increase
Solution Approach 1:
The patent applies local quality by transferring high-quality video content only to the foveal area (central field of view) where the human visual system is most sensitive, while peripheral regions receive lower quality content. This resolves the contradiction by matching video quality to the spatial distribution of visual sensitivity, improving perceived quality without proportionally increasing resource consumption across the entire field of view.
Solution Approach 2:
The patent segments the field of view into distinct regions (foveal and peripheral areas) with different quality requirements. By dividing the visual field and applying different quality levels to different segments, the system achieves high perceived quality in critical areas while reducing overall data transmission and resource consumption.
2Manufacturing precision
If high-quality video content is transferred to all areas of a viewer's field of view, then video quality is improved, but data transmission requirements increase
Solution Approach 1:
The patent applies local quality by transferring high-quality video content only to the foveal area (central field of view) where the human visual system is most sensitive, while peripheral regions receive lower quality content. This resolves the contradiction by matching video quality to the spatial distribution of visual sensitivity, improving perceived quality without proportionally increasing data transmission across the entire field of view.
Solution Approach 2:
The patent segments the field of view into distinct regions (foveal and peripheral areas) with different quality requirements. By dividing the visual field and applying different quality levels to different segments, the system achieves high perceived quality in critical areas while reducing overall data transmission and resource consumption.
3Ease of manufacture
If uniform coding is applied to each frame, then coding simplicity is maintained, but HVS perception capabilities are not sufficiently met
Solution Approach 1:
The patent applies local quality by using uniform coding for the entire frame while applying different quality parameters to different spatial regions after rendering. The foveal area receives higher quality processing while peripheral areas receive lower quality processing, maintaining coding simplicity in the encoding stage while achieving HVS-appropriate quality distribution in the final output.
Data Source
AI summary
A visual coding system is contemplated to facilitate encoding and decoding of visuals, representations, images, etc. utilized to facilitate immersive, augmented reality (AR), virtual reality (VR), light field or other types of video. The visual coding system may facilitate coding, scaling, segmenting, tiling, or otherwise processing portions of individual frames differently depending on light, color and/or spatial resolution sensitivities of the human visual system (HVS), such as to account for the HVS processing light/color information unequally/differently across its field of view.