Key Color Extraction for Thin-Client Video Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In small computer systems, such as mobile devices and thin-client terminal systems, the limited CPU power, memory, and video display adapter resources make it difficult to efficiently render full-motion video, leading to high memory bandwidth requirements that can limit functionality.

Innovation Solution

The implementation of a system that uses a thin-client server computer system to decode and compress full-motion video, with a thin-client terminal system decoding and rendering the video locally, and employing a key color extraction method to minimize memory bandwidth usage by selectively reading from frame and full-motion video buffers based on a matrix representation of macro block states.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If full-motion video is decoded and displayed locally in small computer systems, then video display functionality is achieved, but memory bandwidth requirements become excessively high

Engineering Contradiction:
Improvevideo display functionalityVSAvoidmemory bandwidth consumption
Core Design Contradiction:
Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The patent extracts only the essential information needed for video display by using a thin-client architecture where the server performs computationally intensive tasks (video decoding, compression) and transmits only necessary data to the client. This extraction approach reduces the data volume transferred over the network, thereby lowering memory bandwidth requirements on resource-constrained devices.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces a thin-client server as an intermediary between the video source and the display device. This intermediary handles the heavy processing workload and communicates with the client via a optimized protocol that minimizes data transfer. The server acts as a mediator that processes video data before it reaches the client, reducing the bandwidth burden on the client's memory system.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If key color extraction is performed by reading entire frame buffers, then complete color information is obtained, but memory bandwidth is wasted on unnecessary data

Engineering Contradiction:
Improvecolor information accuracyVSAvoidmemory bandwidth waste
Core Design Contradiction:
Measurement precisionVSLoss of energy

Solution Approach 1:

The patent applies local quality by selectively processing only the portions of the frame buffer that contain key colors (non-hue data) rather than reading the entire buffer. The system identifies macro blocks containing key colors and extracts only those regions, maintaining color information accuracy for critical areas while skipping redundant data in other regions, thus optimizing memory bandwidth usage.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the frame buffer into macro blocks and processes each segment independently to determine whether it contains key colors. This segmentation allows the system to read only the necessary macro blocks that contain non-hue data, rather than loading the entire frame buffer. The segmentation strategy reduces memory bandwidth consumption while preserving the accuracy of key color extraction for the relevant regions.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS9317891B2Systems and methods for hardware-accelerated key color extraction
Publication Date: 2016.04.19 NCOMPUTING GLOBAL INC
  • US9317891B2 patent drawing
  • US9317891B2 patent drawing
  • US9317891B2 patent drawing

AI summary

Systems and methods for hardware-accelerated key color extraction are disclosed. An update corresponding to a portion of a digital representation of a display screen is received. Key color information for locations within the update is identified. A data structure code associated with the portion of the digital representation of the display screen is determined based on the identification of the key color information. The data structure code is provided to a data structure. During a scan of the frame buffer for display, the frame buffer is capable of being read according to the data structure.