Foveated Image Encoding for VR Headset Bandwidth Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Head-mounted displays (HMDs) for virtual or augmented reality applications require high bandwidth for image data transmission due to high frame rates, impacting component requirements, battery life, and data connectivity, necessitating a more efficient data encoding method to maintain image quality with reduced bandwidth and computational load.
Innovation Solution
Implementing foveated rendering and encoding techniques that vary image quality based on zones, with the highest quality in the foveal zone and progressively lower quality in peripheral zones, using different encoding schemes and settings to optimize bandwidth usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If high frame rate image data is transmitted to maintain image quality and reduce nausea, then subjective image quality and user comfort are improved, but bandwidth requirements and computational load increase significantly
Solution Approach 1:
The patent applies foveated rendering and encoding techniques that divide the image into different zones (foveal zone, intermediate zone, peripheral zone) and encode each zone at different quality levels. The foveal zone corresponding to the user's central vision is encoded at high quality, while peripheral zones are encoded at lower quality, thereby maintaining subjective image quality while reducing overall bandwidth requirements
Solution Approach 2:
The image is segmented into multiple zones based on their importance to human vision. The encoding process treats each zone separately with different encoding parameters, allowing selective allocation of bandwidth resources to regions that contribute most to perceived image quality
2Reliability
If high frame rate image data is transmitted to maintain image quality, then user comfort is improved, but battery life is reduced due to increased power consumption
Solution Approach 1:
By encoding only the foveal zone at high quality and peripheral zones at lower quality, the patent reduces the total computational workload for encoding and decoding operations, thereby reducing power consumption and extending battery life while maintaining perceived image quality
Solution Approach 2:
The patent applies the principle of partial action by providing high-quality encoding only where necessary (in the foveal zone) rather than uniformly across the entire image, reducing overall computational effort and energy consumption
3Manufacturing precision
If uniform high-quality encoding is applied to the entire image, then objective image quality is maximized, but bandwidth efficiency is reduced
Solution Approach 1:
The patent implements differential encoding quality across different spatial zones of the image, with the foveal zone receiving high-quality encoding and peripheral zones receiving lower-quality encoding, optimizing the trade-off between encoding quality and bandwidth efficiency
Solution Approach 2:
The patent changes encoding parameters (such as compression ratio, resolution, and bit depth) based on the spatial location within the image, adjusting these parameters to match the visual importance of different zones as perceived by the human visual system
Data Source
AI summary
A data encoding method includes identifying within an image at least a foveal zone and a peripheral zone, the foveal zone of the image being estimated to coincide with the fovea of a user's eye when viewed by the user, encoding for transmission the different zones of the image at different qualities, the encoding quality for the foveal zone being higher than for the peripheral zone, and transmitting the encoded image to a remote viewing device; meanwhile, a data decoding method includes receiving an encoded image, different portions of the encoded image having been encoded at different qualities according to whether they are in at least a foveal zone and a peripheral zone, the foveal zone of the image being estimated to coincide with the fovea of a user's eye when viewed by the user, and the encoding quality for the foveal zone being higher than for the peripheral zone, decoding the portions of the image according to a respective decoding scheme corresponding to the respective encoding of each portion of the image, and outputting the decoded image for display.