Region-Based Output Surface Generation for Compositing Systems

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Compositing window systems require significant memory bandwidth and power consumption due to the frequent recomposition of output surfaces, with most time spent on User Interface (UI) generation and composition, especially in mobile devices.

Innovation Solution

The method involves generating an output surface by determining which regions of the input surfaces contribute to the output surface and only regenerating those regions that have changed, allowing for efficient reuse of unchanged regions and reducing unnecessary processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the entire output surface is regenerated from input surfaces in every frame, then the output surface is always up-to-date, but memory bandwidth and power consumption increase significantly

Engineering Contradiction:
Improveoutput surface update accuracyVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The output surface is divided into multiple regions, and the system determines which specific regions need regeneration by checking for changes in contributing input surface regions. Only the necessary regions are regenerated instead of the entire output surface, reducing power consumption while maintaining update accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies different processing quality to different regions of the output surface. Regions that have changed receive full regeneration processing, while unchanged regions are skipped. This local differentiation optimizes power consumption based on actual update needs.

Inventive Principle:
Principle #3Local quality

2Reliability

If the entire output surface is regenerated from input surfaces in every frame, then the output surface is always up-to-date, but memory bandwidth consumption increases significantly

Engineering Contradiction:
Improveoutput surface update accuracyVSAvoidmemory bandwidth
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The output surface is segmented into multiple regions, and the system identifies only those regions that require regeneration based on changes in input surfaces. This segmentation approach reduces the volume of data transferred in memory from the entire surface to only the necessary regions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies differentiated processing to different regions, regenerating only those with changes. This local quality approach minimizes memory bandwidth consumption by avoiding redundant data transfers for unchanged regions.

Inventive Principle:
Principle #3Local quality

3Device complexity

If unchanged regions are processed anyway, then the processing is simplified, but unnecessary processing time and power are wasted

Engineering Contradiction:
Improveprocessing logic simplicityVSAvoidwasted power
Core Design Contradiction:
Device complexityVSLoss of energy

Solution Approach 1:

The system performs preliminary actions by checking for changes in input surface regions before regenerating output surface regions. This advance checking prevents unnecessary processing of unchanged regions, reducing energy waste while adding a simple change-detection step.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback from change detection mechanisms to control the regeneration process. By monitoring whether input regions have changed and using this feedback to决定是否 regenerate output regions, the system avoids wasted processing energy while maintaining a relatively simple overall structure.

Inventive Principle:
Principle #23Feedback

4Use of energy by moving object

If region-by-region processing is implemented, then power and memory bandwidth are reduced, but the processing complexity increases

Engineering Contradiction:
Improvepower consumptionVSAvoidcomposition system complexity
Core Design Contradiction:
Use of energy by moving objectVSDevice complexity

Solution Approach 1:

The output surface is segmented into regions that correspond to input surface regions. This segmentation enables selective processing of only changed regions, reducing power consumption. The segmentation structure itself serves as the basis for both the reduction in energy use and the increase in processing complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements local quality processing where different regions receive different treatment based on their change status. This approach reduces overall power consumption by focusing resources only on regions that need updates, while the complexity management is handled through the regional differentiation framework.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9182934B2Method and apparatus for generating an output surface from one or more input surfaces in data processing systems
Publication Date: 2015.11.10 ARM LTD
  • US9182934B2 patent drawing
  • US9182934B2 patent drawing
  • US9182934B2 patent drawing

AI summary

In a data processing system, an output surface, such as frame to be displayed, is generated as a plurality of respective regions with each respective region of the output surface being generated from a respective region or regions of one or more input surfaces. When a new version of the output surface is to be generated 80, for each region of the output surface it is determined which region or regions of the input surface or surfaces contribute to the region of the output surface 84 and then checked whether the contributing region or regions of the input surface or surfaces have changed since the previous version of the output surface region was generated 85. If there has been a change in the contributing region or regions of the input surface or surfaces since the previous version of the region in the output surface was generated 86, the region of the output surface is regenerated 87.