Shared Residual Upsampling Circuit Transpose Access

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video coding standards face challenges in implementing efficient residual up-sampling and down-sampling operations, particularly in achieving low cost and high performance for transform block processing in video encoders and decoders.

Innovation Solution

The design incorporates a shared residual up-sampling and down-sampling circuit using a single processing kernel for both directions, with a buffer to store intermediate results and a multiplexer to manage data paths, allowing for efficient processing of transform blocks by performing transpose access and merging operations without additional buffers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If separate processing circuits are used for first-direction and second-direction residual up-sampling operations, then processing performance is improved, but device complexity increases

Engineering Contradiction:
Improveprocessing performanceVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies a shared processing circuit that can perform both first-direction and second-direction residual up-sampling operations using the same circuit structure. The circuit uses transpose access to switch between processing directions, allowing a single circuit to replace what would traditionally require separate circuits for each direction, thereby reducing device complexity while maintaining processing performance.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Manufacturing precision

If additional buffers are added to store intermediate results, then processing accuracy is improved, but device complexity increases

Engineering Contradiction:
Improveprocessing accuracyVSAvoiddevice complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent employs transpose access to retrieve intermediate results directly from the input buffer without requiring separate output buffers for storing intermediate results. The same buffer that receives input data also stores intermediate results by utilizing transpose access patterns, allowing the system to serve itself and eliminate additional buffering hardware while maintaining processing accuracy.

Inventive Principle:
Principle #25Self-service

3Reliability

If conventional residual up-sampling design is used, then compatibility with video coding standards is maintained, but power consumption increases

Engineering Contradiction:
ImprovecompatibilityVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by stationary object

Solution Approach 1:

The patent merges the processing of first-direction and second-direction residual up-sampling operations into a single shared processing circuit. By combining these operations and using transpose access to switch between directions, the design reduces the total number of active circuit components and data transfers required, thereby lowering power consumption while maintaining compatibility with video coding standards through standardized processing interfaces.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS10257524B2Residual up-sampling apparatus for performing transform block up-sampling and residual down-sampling apparatus for performing transform block down-sampling
Publication Date: 2019.04.09 MEDIATEK INC
  • US10257524B2 patent drawing
  • US10257524B2 patent drawing
  • US10257524B2 patent drawing

AI summary

A residual up-sampling apparatus has a residual up-sampling buffer and a shared residual up-sampling circuit. The residual up-sampling buffer stores an intermediate residual up-sampling result. The shared residual up-sampling circuit employs a same processing kernel to perform a first-direction residual up-sampling operation and a second-direction residual up-sampling operation. The first-direction residual up-sampling operation processes an inverse transform output of an inverse transform circuit to generate the intermediate residual up-sampling result to the residual up-sampling buffer. The second-direction residual up-sampling operation performs transpose access upon the residual up-sampling buffer to retrieve the intermediate residual up-sampling result, and processes the intermediate residual up-sampling result to generate a final residual up-sampling result.