Bypassing Desktop Compositor for Display Latency Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional desktop operating systems introduce significant delay and inflexibility due to repeated data copying and reliance on hardware clocks for display data transmission through desktop compositors, impacting display latency and refresh rates.

Innovation Solution

A computer system with a redirection module that intercepts display calls from applications, bypassing parts of the display subsystem to transmit display output directly to the display driver, thereby reducing latency and increasing refresh rates by avoiding unnecessary copy operations and hardware clock synchronization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If display data is sent through a desktop compositor that generates a single image for display, then display management and composition are simplified, but display latency increases and refresh rates are limited

Engineering Contradiction:
Improvedisplay subsystem complexityVSAvoiddisplay latency
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The patent segments the display data path by creating multiple independent output paths from the rendering subsystem. Instead of a single composited image flowing through one compositor, multiple display outputs can be generated independently with different refresh rates and timing characteristics, allowing low-latency paths for time-sensitive displays while maintaining standard composition for others

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a display output manager as an intermediary component that sits between the rendering subsystem and multiple display drivers. This mediator coordinates the generation of display images, allowing some outputs to bypass full composition while maintaining overall system coherence and managing the transition from single-compositor architecture to multi-path architecture

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If display data is copied repeatedly to different parts of memory through the desktop compositor, then display composition and management are achieved, but processing efficiency decreases and latency increases

Engineering Contradiction:
Improvedisplay composition capabilityVSAvoiddisplay processing efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent selectively applies copying only where necessary. Instead of copying display data through multiple compositor stages, the system allows direct rendering output to be passed through to displays that support it, copying only when composition or format conversion is required. This reduces redundant copy operations while maintaining composition capability where needed

Inventive Principle:
Principle #26Copying

3Reliability

If the display driver uses the hardware clock associated with the attached display device, then display synchronization is achieved, but timing flexibility is reduced

Engineering Contradiction:
Improvedisplay synchronizationVSAvoidtiming flexibility
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic timing selection where the display output manager can adaptively choose between hardware clock synchronization and software-controlled timing based on the specific display requirements. This allows the system to switch between synchronized operation for standard displays and flexible timing for high-refresh-rate or low-latency displays, making the timing system dynamic rather than static

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11200019B2Bypassing desktop composition
Publication Date: 2021.12.14 DISPLAYLINK (UK) LTD
  • US11200019B2 patent drawing
  • US11200019B2 patent drawing
  • US11200019B2 patent drawing

AI summary

A computer system is disclosed comprising an operating system having a display subsystem. The display subsystem includes a display interface for receiving display information from applications, and is adapted to generate display output based on the display information. A redirection module is configured to intercept calls from an application to the display interface. Responsive to the intercepted calls, the redirection module transmits display output generated by the application to a connected display device, bypassing at least part of the display subsystem, including for example a desktop compositor or window manager.