Pre-multiplied Alpha Handling in Image Processing Hardware

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image processing methods result in undesirable image artifacts when dealing with pre-multiplied alpha content in RGB pixel values during gamma operations, as these methods are costly and complex, involving extensive software operations and resource usage.

Innovation Solution

Incorporating hardware that enables division and multiplication by alpha channel values within the display pipeline and memory-to-memory scaler and rotator hardware to remove pre-multiplied alpha content during gamma operations and add it during scaling operations, using lookup tables for efficient alpha value manipulation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Object-affected harmful factors

If software operations are used to remove pre-multiplied alpha content during gamma operations, then image artifacts are reduced, but processing cost and system complexity increase

Engineering Contradiction:
Improveimage artifactsVSAvoidprocessing complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The patent replaces software-based alpha content removal with dedicated hardware circuitry integrated into the display pipeline. The hardware automatically performs division operations to strip pre-multiplied alpha content from RGB channels during gamma operations, eliminating the need for complex software processing while maintaining artifact reduction.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent extracts and removes the pre-multiplied alpha content from the RGB pixel values through dedicated hardware division operations. By separating the alpha content removal from the main processing flow and handling it through specialized circuitry, the system reduces image artifacts without burdening the main processor with complex software operations.

Inventive Principle:
Principle #2Taking out (Extraction)

2Manufacturing precision

If software operations are used to process pre-multiplied alpha content, then processing accuracy is improved, but processing speed decreases

Engineering Contradiction:
Improveprocessing accuracyVSAvoidprocessing speed
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent replaces software-based alpha processing with hardware circuitry that performs division and multiplication operations in parallel with the display pipeline. This hardware implementation maintains precise alpha content manipulation while executing operations simultaneously with other processing tasks, eliminating the speed penalty associated with sequential software processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent integrates alpha content removal and addition operations continuously throughout the display pipeline. The hardware circuitry operates continuously alongside gamma operations and scaling operations, ensuring that alpha processing occurs without interrupting or slowing down the overall image processing flow.

Inventive Principle:
Principle #20Continuity of useful action

3Quantity of substance

If pre-multiplied alpha content is included in RGB channels during gamma operations, then memory usage is reduced, but image artifacts increase

Engineering Contradiction:
Improvememory usageVSAvoidimage artifacts
Core Design Contradiction:
Quantity of substanceVSObject-affected harmful factors

Solution Approach 1:

The patent extracts pre-multiplied alpha content from RGB channels through hardware division operations performed during gamma operations. By removing the alpha content at this specific point in the pipeline, the system maintains the memory efficiency of pre-multiplied formats while preventing gamma operations from corrupting the alpha values and creating artifacts.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces an intermediary hardware processing stage that temporarily separates the alpha content from the RGB channels during gamma operations. This intermediary division operation allows the system to benefit from pre-multiplied alpha memory storage while preventing artifact generation by isolating the alpha values from gamma transformation.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Productivity

If hardware is added to the display pipeline for alpha manipulation, then processing efficiency is improved, but device complexity increases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidhardware complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent merges the alpha content manipulation functionality directly into the existing display pipeline hardware. The division and multiplication operations are integrated with the gamma operation circuits and scaling circuits, eliminating the need for separate processing units and reducing overall system complexity while maintaining high processing efficiency.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent designs the display pipeline hardware to perform multiple functions: gamma operations, alpha content removal, and scaling operations all within the same circuitry. This multi-functional approach allows the hardware to efficiently process pre-multiplied alpha content without requiring dedicated separate processing units, thereby improving efficiency without proportionally increasing complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12118962B2Systems and methods for processing pre-multiplied alpha content
Publication Date: 2024.10.15 APPLE INC
  • US12118962B2 patent drawing
  • US12118962B2 patent drawing
  • US12118962B2 patent drawing

AI summary

This disclosure is directed toward systems and methods of pre-multiplied alpha handling during image processing operations. The image processing circuitry may include hardware that enables removal and insertion of pre-multiplied alpha content into red, green, blue (RGB) pixel values during gamma and scaling operations. The division by alpha and multiplication by alpha hardware may enable removal of pre-multiplied alpha content to RGB pixel values prior to gamma operations and insertion of pre-multiplied alpha content into RGB pixel values prior to scaling operations.