ROI-Based Image Data Processing for VR Bandwidth Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional aerial photography transmission systems face limitations in providing clear views of regions of interest due to limited bandwidth and lack of dynamic user interaction, as they use a unified coding strategy for all image regions, which cannot effectively prioritize and enhance image quality in specific areas of interest.
Innovation Solution
Implementing a system that dynamically tracks the region of interest (ROI) using eye-tracking technology, allowing for differential compression rates and enhanced image quality in ROI regions, while displaying images on wearable devices with augmented or virtual reality capabilities, and adjusting imaging parameters based on ROI data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If a unified coding strategy is used for all image regions, then the transmission bandwidth requirement is reduced, but the image quality in regions of interest deteriorates
Solution Approach 1:
The patent applies local quality by implementing differential coding strategies where different regions of the image are encoded with different compression rates. Specifically, regions of interest (ROI) are identified and assigned lower compression rates to maintain high image quality, while non-ROI regions use higher compression rates to reduce overall data transmission requirements. This resolves the contradiction by allowing selective preservation of quality in important areas while accepting lower quality in less important areas.
Solution Approach 2:
The patent segments the image into multiple regions based on their importance to the user's field of view. By dividing the image into ROI and non-ROI segments, the system can apply different coding parameters to each segment. This segmentation enables the system to optimize the balance between overall bandwidth consumption and localized image quality in a way that a unified coding strategy cannot achieve.
2Device complexity
If a unified coding strategy is used for all image regions, then the coding process is simplified, but the user interaction capability deteriorates
Solution Approach 1:
The patent implements feedback mechanisms where the system continuously monitors the user's field of view and dynamically adjusts the regions of interest accordingly. This feedback loop enables the system to adapt to changing user attention and interactively modify the coding strategy in real-time, transforming a static unified coding approach into a dynamic, user-responsive system that enhances interaction capability without excessive complexity.
Solution Approach 2:
The patent introduces dynamics by making the coding strategy adaptive rather than static. The regions of interest are not fixed but change dynamically based on user gaze tracking and field of view analysis. This dynamic adjustment allows the system to respond to user interaction in real-time, improving adaptability while maintaining manageable complexity through automated tracking and classification algorithms.
3Quantity of substance
If image data is compressed to reduce file size, then the transmission bandwidth is saved, but the image quality in important regions deteriorates
Solution Approach 1:
The patent applies local quality by implementing differential coding strategies where different regions of the image are encoded with different compression rates. Specifically, regions of interest (ROI) are identified and assigned lower compression rates to maintain high image quality, while non-ROI regions use higher compression rates to reduce overall data transmission requirements. This resolves the contradiction by allowing selective preservation of quality in important areas while accepting lower quality in less important areas.
Data Source
AI summary
A display device includes a display area configured to display one or more images of a virtual reality (VR) environment or an augmented reality (AR) environment, one or more sensors configured to obtain region-of-interest (ROI) data of a user in response to the user wearing the display device and looking at the one or more images of the VR environment or the AR environment displayed on the display area, and one or more processors. The one or more processors are individually or collectively configured to select one or more ROI zones from a plurality of zones based on the ROI data and effect display of the one or more ROI zones on the display area to the user. The plurality of zones are used to divide the one or more images of the VR environment or the AR environment on the display area.