Image Data Transfer With Gaze-Aware Rate Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image data transfer technologies face challenges in balancing image quality and delay time, particularly in systems where user interactions are reflected in real-time displays, leading to potential delays and impaired realism or motion sickness.
Innovation Solution
An image data transfer apparatus and method that utilizes a rate control map to set image quality deterioration tolerances for each compression unit, allowing for dynamic adjustment of data sizes and compression rates to optimize both image quality and delay reduction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If image quality is pursued with higher resolution and better compression, then image quality is improved, but delay time increases due to larger data sizes
Solution Approach 1:
The patent applies local quality by differentiating compression rates across different regions of the image. The rate control map divides the image into multiple regions and assigns different image quality deterioration tolerances to each region, allowing important regions to maintain higher quality while less important regions use higher compression, thus reducing overall data size without significantly impacting perceived image quality.
Solution Approach 2:
The patent changes compression parameters dynamically based on the rate control map. By adjusting compression rates for different regions according to their importance and the available communication bandwidth, the system optimizes the balance between image quality and transmission speed, reducing delay time while maintaining acceptable image quality.
2Loss of time
If compression rate is increased to reduce data size, then delay time is reduced, but image quality deteriorates
Solution Approach 1:
The patent applies local quality by differentiating compression rates across different regions of the image. The rate control map divides the image into multiple regions and assigns different image quality deterioration tolerances to each region, allowing important regions to maintain higher quality while less important regions use higher compression, thus reducing overall data size without significantly impacting perceived image quality.
Solution Approach 2:
The patent segments the image into multiple regions for differential compression. By dividing the image plane into multiple compression units and applying different compression rates to each unit based on the rate control map, the system can reduce overall data size through aggressive compression in non-critical areas while preserving quality in important areas.
3Loss of time
If uniform high compression is applied to entire image, then delay time is reduced, but image quality deterioration becomes apparent in important regions
Solution Approach 1:
The patent applies local quality by differentiating compression rates across different regions of the image. The rate control map divides the image into multiple regions and assigns different image quality deterioration tolerances to each region, allowing important regions to maintain higher quality while less important regions use higher compression, thus reducing overall data size without significantly impacting perceived image quality.
Data Source
AI summary
At a server 400, a rate control map storage section 430 of a compressing/encoding section 422 stores a rate control map on which an image quality deterioration tolerance is set for each compression unit. A status acquiring section 432 acquires a distribution of image resolutions and positional coordinates of a point of gaze of a user, and a map generating section 434 generates or corrects the rate control map on the basis of the acquired information. On the basis of the rate control map, a compression/encoding processing section 436 sets a target value of a data size, and compresses and encodes image data while performing feedback control. A communication section 426 transmits the data obtained after the compression, in units of partial images formed by splitting a frame.