Display Layer Compositing for Dynamic Background Lightening

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Electronic devices with displays face challenges in achieving a desired aesthetic appearance and efficient processing power consumption, particularly when applying lightening or darkening effects to user interfaces, especially when the background is dynamic, such as a video feed.

Innovation Solution

A method of encoding lightening or darkening effects into display layers based on relative depth, using opacity values and color values, and applying these effects during compositing with additional layers, reducing processing requirements by performing intensive operations only when user interface elements change and applying effects frequently with low power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If lightening or darkening effects are applied to user interface elements on a display, then the aesthetic appearance is improved, but the processing power consumption increases

Engineering Contradiction:
Improveaesthetic appearanceVSAvoidprocessing power consumption
Core Design Contradiction:
Illumination intensityVSUse of energy by moving object

Solution Approach 1:

The patent pre-calculates and stores compositing results for different background brightness conditions. When displaying UI elements, instead of performing intensive real-time compositing operations, the system retrieves pre-computed results that match the current background conditions, significantly reducing processing power consumption while maintaining aesthetic quality

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies different compositing strategies based on background brightness parameters. For bright backgrounds, lightening effects are applied; for dark backgrounds, darkening effects are applied. This parameter-based approach optimizes the balance between aesthetic appearance and processing efficiency by selecting appropriate effects based on current display conditions

Inventive Principle:
Principle #35Parameter changes

2Illumination intensity

If lightening or darkening effects are applied to user interface elements, then the visual quality is improved, but the processing complexity increases

Engineering Contradiction:
Improvevisual qualityVSAvoidprocessing complexity
Core Design Contradiction:
Illumination intensityVSDevice complexity

Solution Approach 1:

The system performs complex compositing operations in advance and stores the results. During actual display, it simply retrieves and applies pre-computed compositing results, transforming a complex real-time processing task into a simple lookup and display operation

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent divides the display into different regions (UI elements vs. background) and applies different processing strategies to each. Background processing is done separately and in advance, while UI element rendering uses the pre-processed background information, reducing overall processing complexity

Inventive Principle:
Principle #1Segmentation

3Manufacturing precision

If real-time compositing operations are performed for every frame, then the visual accuracy is improved, but the power consumption increases

Engineering Contradiction:
Improvevisual accuracyVSAvoidpower consumption
Core Design Contradiction:
Manufacturing precisionVSUse of energy by stationary object

Solution Approach 1:

Instead of performing compositing operations on every frame, the patent implements periodic updates only when background conditions change significantly. The system monitors background brightness changes and triggers compositing operations only when necessary, reducing power consumption while maintaining visual accuracy during stable conditions

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system pre-computes compositing results for various background conditions and stores them for quick retrieval. This eliminates the need for continuous real-time compositing operations, reducing power consumption while maintaining visual accuracy by using pre-calculated results that match current conditions

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240104888A1Displays with Lightening and Darkening Effects
Publication Date: 2024.03.28 APPLE INC
  • US20240104888A1 patent drawing
  • US20240104888A1 patent drawing
  • US20240104888A1 patent drawing

AI summary

An electronic device may include a display and a camera. The camera may capture images of a physical environment around the electronic device. The images of the physical environment may sometimes be displayed on the display as a background layer (e.g., for a pass-through video feed). A user interface may be displayed over the pass-through video feed. Operating the display may include rendering one or more layers of one or more user interface elements, with at least one user interface element being encoded with a lightening or darkening effect. The one or more layers of one or more user interface elements may be composited together and subsequently composited with the pass-through video feed. Compositing the user interface composite with the pass-through video feed may cause the encoded lightening or darkening effect to be applied to the pass-through video feed.