Wireless Display Subsystem Hardware Composition Generator Latency Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Wireless display technologies experience latency due to data processing delays, resulting in increased response time and time lag when transferring video and audio data from mobile devices to external displays.

Innovation Solution

A wireless display subsystem comprising a hardware composition generator, a hardware video encoder, and a wireless hardware transport stream multiplexer, which processes and encodes video data in real-time without using memory storage, reducing latency by directly transferring data between components.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If data processing is performed to prepare video and audio data for wireless transfer, then the data is placed in a form suitable for wireless transfer, but the response time increases and latency is introduced

Engineering Contradiction:
Improvedata transfer suitabilityVSAvoidresponse time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-processing video and audio data into suitable formats before wireless transmission is needed. The composition generator pre-synthesizes video frames and the encoder pre-encodes video data, so that when wireless transmission is required, the data is already prepared and can be transmitted immediately with minimal additional processing delay.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces software-based data processing with dedicated hardware components. The composition generator, video encoder, and transport stream multiplexer are implemented as hardware circuits that perform data processing operations in parallel and simultaneously, eliminating the sequential processing delays inherent in software implementations and significantly reducing overall latency.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of time

If hardware components are used for real-time data processing, then latency is reduced and transfer speed is improved, but device complexity increases

Engineering Contradiction:
ImprovelatencyVSAvoidsystem complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The system segments the wireless display functionality into distinct hardware modules: a composition generator for video frame synthesis, a video encoder for compression, and a transport stream multiplexer for packetization. Each module is independently optimized for its specific function and can operate in parallel, reducing overall latency while keeping each individual module relatively simple and manageable.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The hardware components are designed with multi-functionality to reduce overall system complexity. The video encoder can handle different video formats and compression standards, the transport stream multiplexer can multiplex various types of data streams, and the composition generator can synthesize frames from different sources, allowing a single hardware design to serve multiple purposes across different application scenarios.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10595047B2Wireless display subsystem and system-on-chip
Publication Date: 2020.03.17 SAMSUNG ELECTRONICS CO LTD
  • US10595047B2 patent drawing
  • US10595047B2 patent drawing
  • US10595047B2 patent drawing

AI summary

A wireless display subsystem includes a hardware composition generator, a hardware video encoder, and a wireless hardware transport stream multiplexer. The hardware composition generator reads video data from a memory device and generates video frame data by synthesizing the video data. The hardware video encoder receives the video frame data in an on-the-fly (OTF) manner from the hardware composition generator and generates a video stream by encoding the video frame data. The wireless hardware transport stream multiplexer receives the video stream in the OTF manner from the hardware video encoder, reads an audio stream from the memory device, multiplexes the video stream and the audio stream, and generates a wireless display packet by packetizing the multiplexed video and audio streams.