Video Processing Device Tile-Based Merging

Solution Overview

Problem

Existing video processing systems require significant memory and computational resources to merge multiple video streams from different sources, especially when generating panoramic or surround views, as they need to buffer and process entire frames simultaneously, leading to high power consumption and memory inefficiencies.

Innovation Solution

The system employs a tile-based approach where the output image is divided into tiles, with each tile being computed from corresponding input tiles from multiple sources, using a dedicated tile buffer and access control unit to manage data retrieval, allowing for reduced memory requirements and efficient processing by buffering only necessary tiles for each merging round.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the system buffers entire frames from multiple video sources simultaneously, then complete frame merging can be achieved, but memory requirements and power consumption increase significantly

Engineering Contradiction:

Improveframe merging completenessVSAvoidmemory requirements

Core Design Contradiction:

ReliabilityVSQuantity of substance

Solution Approach 1:

The patent divides video frames into multiple tiles and processes them independently in merging rounds. Instead of buffering entire frames simultaneously, the system buffers only the necessary tiles for each round, reducing memory requirements while maintaining complete frame merging capability.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system performs partial frame processing by handling only the necessary tiles for each merging round rather than processing complete frames. This partial action approach reduces the amount of data that needs to be buffered in memory, thereby reducing power consumption and memory requirements.

Inventive Principle:

Principle #16Partial or excessive action

2Reliability

If the system buffers entire frames from multiple video sources simultaneously, then complete frame merging can be achieved, but power consumption increases significantly

Engineering Contradiction:

Improveframe merging completenessVSAvoidpower consumption

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent divides video frames into multiple tiles and processes them independently in merging rounds. Instead of buffering entire frames simultaneously, the system buffers only the necessary tiles for each round, reducing memory requirements while maintaining complete frame merging capability.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system performs partial frame processing by handling only the necessary tiles for each merging round rather than processing complete frames. This partial action approach reduces the amount of data that needs to be buffered in memory, thereby reducing power consumption and memory requirements.

Inventive Principle:

Principle #16Partial or excessive action

3Manufacturing precision

If the system processes complete frames simultaneously, then output quality is maintained, but processing efficiency decreases due to memory access stalls

Engineering Contradiction:

Improveoutput qualityVSAvoidprocessing efficiency

Core Design Contradiction:

Manufacturing precisionVSProductivity

Solution Approach 1:

The patent divides video frames into multiple tiles and processes them independently in merging rounds. This segmentation allows the processing unit to work on smaller data units, reducing memory access stalls and improving processing efficiency while maintaining output quality through systematic tile merging.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system performs preliminary organization of tiles into merging rounds before actual processing. By pre-organizing which tiles need to be merged together, the system minimizes memory access stalls during processing and improves overall processing efficiency without compromising output quality.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS9232156B1Video processing device and method

Publication Date: 2016.01.05 NXP USA INC

AI summary

A video processing device for generating an output video stream on the basis of two or more concurrent input video streams and a method thereof are described. Each input video stream comprises a sequence of input images. The output video stream comprises a sequence of output images. The video processing device generates each output image by merging a respective set of input images. The set of input images comprises one input image from each input video stream. The video processing device merges the input images in a series of merging rounds. Each merging round comprises forming an output tile by merging a set of input tiles, and writing the output tile to an output memory unit. The set of input tiles comprises one input tile from each input image of the respective set of input images. The output tiles written to the output memory unit represent the output image.