Video Multiviewer Scaling via Segmented GPU Processing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current multiviewer systems face challenges in efficiently scaling and rearranging multiple video streams in real-time, leading to significant hardware requirements, limited bandwidth, and large form factors, which hinder user flexibility and scalability.

Innovation Solution

A video multiviewer system comprising multiple video scalers operating in parallel for initial scaling in one dimension, coupled with a processing unit for additional scaling, and a display for multiple video windows, utilizing a GPU and DMA engine to distribute computational workload and reduce hardware demands.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If full input scaling is used to scale video streams before compression and combination, then video streams can be completely scaled to desired sizes, but significant hardware requirements are needed that exceed mobile packaging environments

Engineering Contradiction:

Improvevideo stream scaling qualityVSAvoidhardware size

Core Design Contradiction:

Manufacturing precisionVSVolume of stationary object

Solution Approach 1:

The patent divides the scaling operation into two separate stages: input scaling performed by the encoder before compression, and output scaling performed by the GPU after decompression. This segmentation allows each component to handle only part of the scaling task, reducing the hardware requirements for any single device while maintaining overall scaling quality.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary scaling at the input stage before compression using the encoder's built-in scaling capabilities. This preliminary action reduces the resolution of video streams early in the processing chain, reducing the amount of data that needs to be transmitted and stored, while final scaling is then performed efficiently by the GPU.

Inventive Principle:

Principle #10Preliminary action

2Ease of operation

If dedicated hardware is used for each desired scaled size of video streams, then precise scaling control is achieved, but hardware complexity and size increase significantly

Engineering Contradiction:

Improvescaling control precisionVSAvoidhardware configuration

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent makes the GPU the universal scaling component that can perform all scaling operations for different video stream sizes and configurations. Instead of having dedicated hardware for each scaling scenario, the GPU handles all output scaling tasks dynamically, allowing a single multi-functional component to replace multiple specialized hardware elements.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent implements dynamic scaling where the GPU can adjust scaling parameters in real-time based on user preferences and display requirements. The scaling factors, dimensions, and arrangements are not fixed in hardware but can be changed programmatically, allowing the system to adapt to different scenarios without physical reconfiguration.

Inventive Principle:

Principle #15Dynamics

3Productivity

If multiple video streams are scaled and arranged to fit on a single monitor, then all streams are visible simultaneously, but user flexibility to rearrange and resize streams in real time is reduced

Engineering Contradiction:

Improvevideo stream monitoring efficiencyVSAvoidreal-time stream arrangement flexibility

Core Design Contradiction:

ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent implements a feedback mechanism where user interactions with the displayed video streams (resizing, moving, reordering) are captured and used to dynamically adjust the GPU's scaling and rendering operations. The system continuously monitors user actions and adjusts the display arrangement in real-time, creating a responsive interface that adapts to user preferences while maintaining efficient multi-stream monitoring.

Inventive Principle:

Principle #23Feedback

4Adaptability or versatility

If significant hardware is included to provide adequate processing power for real-time scaling operations, then advanced user features are enabled, but form factor and housing size increase to undesirable levels

Engineering Contradiction:

Improvereal-time stream manipulation capabilityVSAvoidhousing size

Core Design Contradiction:

Adaptability or versatilityVSVolume of stationary object

Solution Approach 1:

The patent replaces traditional hardware-based scaling mechanisms with software-based GPU processing. Instead of using dedicated hardware circuits for scaling operations, the system uses the GPU's programmable shader architecture to perform scaling through software algorithms, dramatically reducing the physical space required for scaling functionality while maintaining real-time performance.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS9172900B2Video multiviewer system with switcher and distributed scaling and related methods

Publication Date: 2015.10.27 HBC SOLUTIONS

AI summary

A video multiviewer system may include a plurality of video scalers operating in parallel for generating initially scaled video streams by performing video scaling in at least one dimension on a plurality of video input streams. The video multiviewer system may also include at least one video cross-point switcher coupled downstream from the video scalers, and a processing unit coupled downstream from the video cross-point switcher for generating additionally scaled video streams by performing additional video scaling on the initially scaled video streams. The video multiviewer system may also include a display cooperating with the processing unit for displaying multiple video windows based upon the additionally scaled video streams.