Smart Compositor Module Allocates Layers Across DPU Portions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current display processing techniques inefficiently utilize display processing unit (DPU) resources, as GPUs are used for composition while some DPU resources remain unused, leading to suboptimal performance and increased power consumption.

Innovation Solution

A smart compositor module allocates and composes layers across multiple DPU portions based on their composition capabilities, utilizing a second DPU as a composition device to enhance the composition capacity and reduce reliance on the GPU for layer composition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If GPU is used for layer composition, then composition capability is provided, but DPU resources remain unused and power consumption increases

Engineering Contradiction:
Improvelayer composition capabilityVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The DPU is designed to perform multiple functions including both display processing and layer composition. By enabling the DPU to handle composition tasks that were traditionally performed by the GPU, the system achieves better resource utilization and reduces power consumption while maintaining composition capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The DPU serves itself by performing layer composition internally rather than relying on external GPU resources. This self-service approach allows the DPU to utilize its own unused resources for composition tasks, improving overall system efficiency and reducing the need for additional high-power components.

Inventive Principle:
Principle #25Self-service

2Productivity

If GPU is used for layer composition, then composition tasks are performed, but resource utilization is inefficient

Engineering Contradiction:
Improvecomposition throughputVSAvoidresource allocation complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent merges the composition function with the DPU's existing display processing capabilities. By combining layer composition with display output processing in a single unit, the system eliminates the need for separate GPU involvement in composition, thereby improving resource utilization and reducing system complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The display processing system is segmented into distinct functional portions within the DPU, where different portions can be independently allocated for composition tasks. This segmentation allows flexible resource allocation and efficient utilization of DPU capabilities without requiring complex inter-component coordination.

Inventive Principle:
Principle #1Segmentation

3Productivity

If multiple layers are composed by single DPU, then composition capacity is limited, but resource utilization improves

Engineering Contradiction:
Improvenumber of composable layersVSAvoidDPU architecture
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The DPU is divided into multiple functional portions or processing units, each capable of handling composition tasks. This segmentation enables parallel processing of multiple layers simultaneously, increasing the overall composition capacity while maintaining manageable complexity through modular architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an additional processing dimension by utilizing unused DPU resources and portions that were previously idle. By activating these dormant resources for composition tasks, the system effectively increases composition capacity without adding external components, thereby scaling performance through internal resource optimization.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS12027087B2Smart compositor module
Publication Date: 2024.07.02 QUALCOMM INC
  • US12027087B2 patent drawing
  • US12027087B2 patent drawing
  • US12027087B2 patent drawing

AI summary

This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for a smart compositor module. A display processor may obtain a plurality of layers associated with at least one frame in a scene. The display processor may identify a composition capability of a first portion of at least one DPU and a second portion of the at least one DPU. The display processor may allocate at least one first layer of the plurality of layers to the first portion of the at least one DPU and at least one second layer of the plurality of layers to the second portion of the at least one DPU. The display processor may compose the at least one first layer at the first portion of the at least one DPU and the at least one second layer at the second portion of the at least one DPU.