Video Data Processing Pipeline Segmentation for Circuit Area Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The increasing circuit scale of video data processing devices due to enhanced processing capacity for high-resolution and high-frame-rate video processing leads to larger circuit areas, which is inefficient and costly.

Innovation Solution

A video data processing device with at least one first functional module for processing larger data units and one second functional module for processing smaller data units, where the control unit manages the execution order to start the second module only after the completion of the previous stage, allowing for reduced circuit size by utilizing hardware corresponding to the smaller processing unit size.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the processing capacity is enhanced by constructing a pipeline with larger processing units, then the processing capability for high-resolution and high-frame-rate video is improved, but the circuit area becomes large

Engineering Contradiction:
Improveprocessing capabilityVSAvoidcircuit area
Core Design Contradiction:
ProductivityVSArea of stationary object

Solution Approach 1:

The patent divides the video processing pipeline into multiple stages, each handling smaller processing units (e.g., 4x4 blocks) rather than one large processing unit. This segmentation allows each functional module to be smaller, reducing the overall circuit area while maintaining high processing capability through parallel processing of multiple units across different stages.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic control of the pipeline where the execution order and timing of functional modules are adjusted based on data availability and processing requirements. This allows flexible allocation of computational resources, enabling the system to process high-resolution video at high frame rates without requiring all functional modules to operate at maximum capacity simultaneously, thus reducing the required circuit area.

Inventive Principle:
Principle #15Dynamics

2Productivity

If the circuit scale of each processing block is increased to improve processing capacity, then the processing capability is enhanced, but the circuit area becomes large and costly

Engineering Contradiction:
Improveprocessing capacityVSAvoidcircuit scale
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The processing pipeline is segmented into multiple functional modules (e.g., prediction unit, transformation unit, quantization unit), each handling smaller data blocks. This segmentation allows each module to be implemented with smaller, less complex circuitry while the collective processing capacity is maintained through parallel operation of multiple modules across different pipeline stages.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent designs functional modules that can perform multiple functions depending on the pipeline stage and processing requirements. For example, a functional module can handle different types of processing operations (intra prediction, inter prediction, transformation) by adjusting its operation based on control signals, reducing the need for dedicated specialized hardware for each function and thereby reducing overall circuit complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If pipeline processing is implemented with multiple functional modules, then the processing capability is enhanced, but the control complexity increases

Engineering Contradiction:
Improveprocessing capabilityVSAvoidcontrol complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements feedback mechanisms where the control unit monitors the completion status of each functional module and adjusts the execution order accordingly. This feedback-based control ensures that downstream modules wait for upstream modules to complete their processing, maintaining data integrity and processing correctness while simplifying the control logic through systematic dependency management.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The control unit performs preliminary actions by pre-determining the execution order of functional modules and preparing control signals in advance. This allows the pipeline to operate efficiently with minimal real-time control adjustments, reducing control complexity while maintaining high processing capability through optimized data flow management.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240331080A1Video data processing device and video data processing method
Publication Date: 2024.10.03 RENESAS ELECTRONICS CORP
  • US20240331080A1 patent drawing
  • US20240331080A1 patent drawing
  • US20240331080A1 patent drawing

AI summary

The video data processing device includes at least one first functional module that performs first processing preset for each first processing unit data, at least one second functional module that performs second processing preset for each second processing unit data smaller than the first processing unit data, and a control unit that controls the execution order of pipeline processing for the first processing unit data by controlling the timing at which the first function module and the second function module operate. The control unit controls the subsequent stage so that the first function module and the second module are started in response to the completion of the respective processing in accordance with the end of the pre-stage.