Compositor Metadata Composition for Encrypted Display Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In collaborative display systems, compressing and transmitting display data from multiple devices to a shared display introduces inefficiencies due to the need for decompression and recompression, and encrypted data cannot be securely used without exposing it to intermediate devices.

Innovation Solution

A method where a compositor receives compressed and encrypted image data from multiple devices, composites it without decompressing or decrypting, using metadata to arrange and transmit the data, allowing secure transmission and efficient composition without intermediate access to raw data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If display data is compressed for transmission, then transmission efficiency is improved, but composition cannot be performed without decompression causing delay

Engineering Contradiction:
Improvetransmission efficiencyVSAvoidcomposition delay
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The display frame is segmented into multiple independent regions, each containing data from a different source device. Each region is compressed independently with its own metadata, allowing the compositor to selectively decompress only the regions it needs to compose, rather than decompressing the entire frame. This reduces the time loss while maintaining transmission efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Metadata including compression parameters, region boundaries, and source device identifiers are prepared in advance alongside the compressed display data. This preliminary preparation allows the compositor to quickly identify and process only the necessary data regions without performing full decompression, thus resolving the contradiction between transmission efficiency and composition delay.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If encrypted data is transmitted to ensure security, then data security is improved, but intermediate devices cannot access the data for composition

Engineering Contradiction:
Improvedata securityVSAvoidcomposition accessibility
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

Different regions of the display frame are encrypted with different keys or encryption levels based on their source and sensitivity. The compositor can access and decrypt only the specific regions it needs to compose, while other regions remain encrypted. This maintains data security for sensitive regions while enabling composition accessibility for necessary regions.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The encrypted display data is segmented into multiple regions with separate encryption credentials. Each region's encryption parameters are included in its metadata, allowing selective decryption by the compositor for composition purposes. This resolves the contradiction by maintaining security through encryption while enabling operational accessibility through selective decryption of only necessary segments.

Inventive Principle:
Principle #1Segmentation

3Productivity

If multiple devices transmit compressed data to a shared display, then system efficiency is improved, but the compositor cannot composite without decompressing and recompressing

Engineering Contradiction:
Improvesystem efficiencyVSAvoidprocessing energy
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

Multiple compressed data streams from different source devices are merged at the metadata level rather than requiring full decompression and recompression. The compositor combines the compressed regions with updated metadata indicating their new positions in the composited frame, eliminating the energy-intensive decompress-recompress cycle while maintaining system efficiency.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

Instead of decompressing and recreating the display data, the compositor creates a metadata copy that references the existing compressed data regions and specifies their arrangement in the final composited frame. This approach maintains system efficiency by avoiding redundant processing while reducing energy loss through elimination of the decompress-recompress cycle.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11580619B2Method of managing display data
Publication Date: 2023.02.14 DISPLAYLINK (UK) LTD
  • US11580619B2 patent drawing
  • US11580619B2 patent drawing
  • US11580619B2 patent drawing

AI summary

A compositor receives, from each of a plurality of originating devices, compressed and/or encrypted image data portions of a frame of image data, together with portion metadata for each of the compressed and/or encrypted image data portions. Frame metadata for the frame of image data. The compositor then composites the image data portions without decompressing and/or decrypting them, based on the portion and frame metadata, by generating composited frame metadata for the composited image frame and amending the portion metadata for each of the compressed and/or encrypted image data portions to indicate a location of the compressed and/or encrypted image data portions in the composited image frame. The compressed and/or encrypted image data portions, the composited frame metadata and the amended portion metadata are then transmitted by the compositor to a display control device.