Multi-VPU Video Compositing via Interlink Module

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current graphics and video processing systems face challenges in producing high-quality, complex video at affordable costs while minimizing memory requirements and maintaining operational speeds, especially for mass production, and require seamless compatibility with existing computer systems.

Innovation Solution

A video processing system that utilizes multiple graphics or video processing units (VPUs) working in parallel, with a programmable interlink module to combine and composite frame data from each VPU, allowing for various modes of operation and load balancing, including super-tiling, scissoring, and alternate frame rendering, to enhance performance and efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a single VPU is used for video processing, then device complexity is low, but productivity is insufficient to produce high-quality complex video at acceptable speeds

Engineering Contradiction:
Improvevideo processing speedVSAvoidVPU system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system divides video processing tasks across multiple VPUs, with each VPU handling specific portions of the rendering workload. The interlink module segments the composite video signal into separate component signals (Y, Pb, Pr) that can be processed independently by different VPUs, enabling parallel processing while maintaining manageable complexity for each individual VPU.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Multiple VPUs are merged into a coordinated system through the interlink module, which combines their individual processing capabilities to achieve high-quality video output. The interlink module merges the processed component signals back into a composite video signal, allowing the system to achieve productivity levels unattainable by a single VPU.

Inventive Principle:
Principle #5Merging (Combining)

2Manufacturing precision

If memory requirements are increased to improve video quality, then manufacturing cost increases, but video quality improves

Engineering Contradiction:
Improvevideo qualityVSAvoidmemory requirements
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The video signal is segmented into separate component signals (Y, Pb, Pr) that can be processed independently with smaller memory buffers. Each VPU processes one component at a time, requiring less memory than a single VPU would need to handle the complete high-quality video signal, thus reducing overall memory requirements while maintaining video quality.

Inventive Principle:
Principle #1Segmentation

3Quantity of substance

If multiple VPUs are used to reduce memory requirements, then device complexity increases, but memory requirements decrease

Engineering Contradiction:
Improvememory requirementsVSAvoidVPU system complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The interlink module serves as an intermediary that manages the complexity of coordinating multiple VPUs. It handles signal routing, synchronization, and component separation/combination, allowing the VPUs to operate with simplified individual processing tasks while achieving the goal of reduced memory requirements through their coordinated operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Productivity

If processing tasks are distributed across multiple VPUs, then productivity improves, but ease of operation decreases

Engineering Contradiction:
Improvevideo processing capabilityVSAvoidsystem configuration complexity
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The interlink module is designed with universal functionality to handle multiple VPU configurations and processing modes. It can route signals between any combination of VPUs and handle various component signal formats, making the system easier to operate despite the complexity of having multiple VPUs, as the interlink module abstracts away the configuration details.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS7613346B2Compositing in multiple video processing unit (VPU) systems
Publication Date: 2009.11.03 ATI TECHNOLOGIES ULC
  • US7613346B2 patent drawing
  • US7613346B2 patent drawing
  • US7613346B2 patent drawing

AI summary

Systems and methods are provided for processing data. The systems and methods include multiple processors that each couple to receive commands and data, where the commands and/or data correspond to frames of video that include multiple pixels. Additionally, an interlink module is coupled to receive processed data corresponding to the frames from each of the multiple processors. The interlink module selects pixels of the frames from the processed data of one of the processors based on a predetermined pixel characteristic and outputs the frames that include the selected pixels.