Display Controller Border Handling for Image Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Display controllers face challenges in reducing or avoiding blurring when composing and processing multiple input surfaces, as image processing operations can 'bleed' colors across borders between layers, leading to undesirable effects like blur.

Innovation Solution

The display controller associates border information with the composited surface, allowing the image processing stage to selectively use data from the appropriate input surface when processing pixels near borders, thereby reducing or eliminating blurring without complex edge detection algorithms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If image processing operations use multiple input pixels to derive output pixel values (e.g., 3x3 filtering window), then image processing quality is improved, but blurring occurs at borders between different input surfaces

Engineering Contradiction:
Improveimage processing qualityVSAvoidblurring at borders
Core Design Contradiction:
Manufacturing precisionVSObject-generated harmful factors

Solution Approach 1:

The patent applies preliminary action by pre-identifying and marking border regions between different input surfaces before the image processing operation is performed. Border indicator information is generated during the composition stage, indicating which pixel positions lie at borders. This allows the subsequent image processing stage to proactively handle border regions differently, preventing color bleeding and blurring before they can occur during filtering operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements local quality by applying different processing strategies to different regions of the composited surface. Border regions identified by the border indicators receive specialized handling (such as using only pixels from the same input surface or adjusting the filtering window), while non-border regions undergo standard image processing. This localized approach maintains high image processing quality in regular areas while preventing blurring at critical border regions.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If complex edge detection algorithms are used to identify borders between input surfaces, then border accuracy is improved, but device complexity increases

Engineering Contradiction:
Improveborder identification accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The composition stage performs preliminary action by generating border indicator information based on the known geometry and arrangement of input surfaces. Since the composition stage already has complete information about which pixels belong to which input surface and where borders lie, it can directly mark border positions without needing complex edge detection. This preliminary identification simplifies the subsequent image processing stage's task significantly.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces border indicator information as an intermediary data structure that bridges the composition stage and the image processing stage. These indicators serve as a simple, pre-computed representation of border locations that the image processing stage can use directly without implementing complex detection algorithms. The intermediary carries essential border information in a format suitable for guiding the image processing operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10565966B2Display controllers
Publication Date: 2020.02.18 ARM LTD
  • US10565966B2 patent drawing
  • US10565966B2 patent drawing
  • US10565966B2 patent drawing

AI summary

In a display controller of a data processing system, when composing two or more input surfaces to generate a composited surface comprising the two or more input surfaces, data indicating a border between different input surfaces in the composited surface is associated with the composited surface. The data indicative of the border between two input surfaces in the composited surface is then used to control subsequent processing, such as compression and/or filtering, of the composited surface.