Regional Attention-Based Image Compression for Low-Latency Transfer
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face delays in image display due to communication latency between client terminals and servers, particularly in head-mounted displays, leading to degraded realism and potential motion sickness, exacerbated by high image quality demands.
Innovation Solution
An image data transfer apparatus and method that divides frames into partial images, estimates attention degrees for each region, and varies compression rates based on these degrees, enabling efficient compression and transmission to reduce latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If image data is transmitted via network communication to achieve real-time display, then image quality can be improved through streaming from a server, but delay time period increases due to communication latency
Solution Approach 1:
The frame plane is divided into multiple unit regions, and each region is compressed at a different compression rate according to its attention degree. This segmentation allows selective transmission of high-priority regions with lower compression, reducing overall transmission time while maintaining perceived image quality.
Solution Approach 2:
Different compression rates are applied to different regions of the frame based on their attention degrees. Regions with high attention degrees (where users are likely to look) are compressed at lower rates to maintain quality, while regions with low attention degrees are compressed at higher rates to reduce data size and transmission delay.
2Loss of time
If compression rate is increased to reduce data transmission size, then delay time period is reduced, but image quality deteriorates
Solution Approach 1:
The patent applies different compression rates to different regions based on their attention degrees. High-attention regions receive lower compression rates to preserve quality, while low-attention regions receive higher compression rates to reduce data size, achieving a balance between transmission speed and perceived image quality.
Solution Approach 2:
The compression rate parameter is dynamically adjusted for each unit region based on its attention degree. This allows the system to optimize the trade-off between compression ratio and image quality on a regional basis, rather than applying a uniform compression rate to the entire frame.
3Ease of manufacture
If uniform compression rate is applied to the entire frame, then processing is simplified, but transmission efficiency and perceived quality are suboptimal
Solution Approach 1:
The frame is segmented into unit regions with different attention degrees, allowing differentiated compression strategies. This segmentation improves transmission efficiency by focusing bandwidth on important regions while reducing overall data size through aggressive compression of less important regions.
Solution Approach 2:
Different compression rates are applied to different regions based on their attention degrees. This local differentiation optimizes transmission efficiency by allocating more bits to regions that contribute more to perceived quality, rather than treating all regions equally.
Data Source
AI summary
An attention degree estimation section in a compression coding section of a server estimates an attention degree on the basis of contents indicated by a moving image generated by an image forming section, for each of unit regions produced by dividing a frame plane. A compression coding processing section compression-codes the moving image at a compression rate varied in the frame plane according to a distribution of the attention degrees. A communication section transmits compression-coded data to an image processing apparatus.