Foveated Image Compression in Portable Computing Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems in portable computing devices (PCDs) face inefficiencies in optimizing bus bandwidth and memory components due to the need to ensure a minimum quality of service (QoS) by oversizing components for the worst-case compression scenarios, leading to higher costs and power consumption.

Innovation Solution

Implementing a foveated compression method that uses a fixation point sensor to determine the user's focus area, sectoring the image frame, and applying varying compression algorithms based on distance from the fixation point, including lossless for focused areas and increasingly lossy for peripheral regions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If lossless compression methodology is used to maintain high quality output, then QoS is improved, but memory component size and bus bandwidth requirements increase

Engineering Contradiction:
Improvequality of serviceVSAvoidmemory component size
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent applies different compression methodologies to different regions of the image frame based on their importance. The fixation sector (containing the user's focus point) is compressed with a first methodology that preserves quality, while foveated sectors (peripheral regions) use a second methodology that achieves higher compression. This local differentiation allows the system to maintain QoS for critical regions while reducing overall memory and bandwidth requirements through aggressive compression of less critical peripheral regions.

Inventive Principle:
Principle #3Local quality

2Reliability

If lossless compression methodology is used to maintain high quality output, then QoS is improved, but bus bandwidth requirements increase

Engineering Contradiction:
Improvequality of serviceVSAvoidbus bandwidth
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent implements region-specific compression where the fixation sector uses a compression methodology that maintains high quality suitable for user focus areas, while foveated sectors use more aggressive compression. This approach ensures that bus bandwidth is allocated efficiently - sufficient for transmitting quality data in the fixation sector while allowing higher compression ratios in peripheral sectors, thereby reducing overall bus bandwidth requirements while maintaining acceptable QoS.

Inventive Principle:
Principle #3Local quality

3Reliability

If memory component and bus bandwidth are sized for worst-case compression scenario, then QoS is guaranteed, but component sizing becomes inefficient for most use cases

Engineering Contradiction:
Improvequality of serviceVSAvoidcomponent utilization efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent introduces dynamic, region-adaptive compression that adjusts compression intensity based on the specific characteristics of different image regions and their relative importance to user perception. By using fixation point information to identify critical sectors and applying appropriate compression methodologies to each sector, the system dynamically optimizes the balance between quality and compression ratio, eliminating the need to size components for worst-case scenarios across the entire image while maintaining QoS guarantees for perceptually important regions.

Inventive Principle:
Principle #15Dynamics

4Quantity of substance

If high compression factor is applied to reduce memory and bandwidth requirements, then resource usage is optimized, but output quality deteriorates

Engineering Contradiction:
Improvememory component sizeVSAvoidoutput quality
Core Design Contradiction:
Quantity of substanceVSManufacturing precision

Solution Approach 1:

The patent applies compression factors locally based on region importance. The fixation sector, which contains the user's focus point and is therefore most critical to perceived quality, is compressed with a first methodology that maintains high output quality. Foveated sectors, which represent peripheral visual regions less critical to user perception, are compressed with a second methodology that achieves higher compression factors. This local quality approach allows aggressive compression in peripheral regions without significantly impacting overall perceived quality, thereby optimizing the balance between resource usage and output quality.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP4242856B1System and method for foveated compression of image frames in a system on a chip
Publication Date: 2025.06.25 QUALCOMM INC
  • EP4242856B1 patent drawingFigure 1
  • EP4242856B1 patent drawingFigure 2
  • EP4242856B1 patent drawingFigure 3

AI summary

A method for intelligent data compression in a portable computing device ("PCD") is provided, the method comprising: determining a fixation point within an image frame by a fixation point sensor, wherein the fixation point sensor is configured to determine an area of user focus within a given image frame; sectoring the image frame into two or more sectors, wherein the two or more sectors comprises a fixation sector that includes the fixation point and one or more foveated sectors, each foveated sector does not include the fixation point, and each sector comprises a plurality of tiles; compressing the image frame such that the fixation sector is compressed according to a compression algorithm having a low compression factor and the one or more foveated sectors are compressed according to a compression algorithm having a high compression factor, wherein each respective tile within a particular foveated sector is subject to a different compression factor that is based on a distance between the fixation sector and the respective tile, each compression factor of a respective tile within a foveated sector having a magnitude that is assigned corresponding to the distance between the fixation sector and a respective tile; and storing the compressed image frame.