Video Encoding Units Spatial Temporal Correlation Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding technologies face challenges in efficiently managing resources for high-quality video transmission, especially in limited bandwidth environments, leading to network performance degradation and poor user experience, particularly in real-time conference video services.

Innovation Solution

A video processing apparatus and method that form encoding units in an image frame, encode sub-encoding units based on spatial and temporal correlations, and generate a video stream, reducing computational complexity and improving user experience by ignoring sub-encoding units with smaller differences, thereby optimizing resource allocation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If traditional video coding is used to ensure high-quality video transmission, then video quality is maintained, but bandwidth consumption increases and network performance degrades

Engineering Contradiction:
Improvevideo qualityVSAvoidbandwidth consumption
Core Design Contradiction:
Manufacturing precisionVSLoss of energy

Solution Approach 1:

The video frame is divided into multiple encoding units, and each encoding unit is further divided into sub-encoding units. This segmentation allows the system to process and transmit only the necessary sub-encoding units based on complexity assessment, rather than encoding the entire frame uniformly, thus reducing overall bandwidth consumption while maintaining quality in important regions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different encoding strategies to different regions of the video frame based on local complexity characteristics. Regions with high complexity (large differences between adjacent sub-encoding units) receive more detailed encoding, while regions with low complexity use simpler encoding or are skipped entirely, optimizing the trade-off between video quality and bandwidth usage.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If all sub-encoding units are encoded to maintain video quality, then video transmission quality is improved, but encoding complexity increases

Engineering Contradiction:
Improvevideo transmission qualityVSAvoidencoding complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

Instead of encoding all sub-encoding units uniformly, the patent selectively encodes only those sub-encoding units that exceed a complexity threshold. This partial action approach encodes only the necessary portions of the video data, significantly reducing encoding complexity while maintaining video quality in critical regions where detail is most important.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent dynamically adjusts encoding parameters based on the complexity assessment of each encoding unit. By changing the encoding depth and detail level according to local complexity characteristics, the system optimizes the balance between video quality and encoding complexity, avoiding unnecessary computation in simple regions while preserving quality in complex regions.

Inventive Principle:
Principle #35Parameter changes

3Ease of manufacture

If encoding is performed on all regions uniformly, then encoding simplicity is maintained, but resource allocation efficiency decreases

Engineering Contradiction:
Improveencoding simplicityVSAvoidresource allocation efficiency
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The patent introduces dynamic adaptability into the encoding process by assessing the complexity of each encoding unit and adjusting the encoding strategy accordingly. This dynamic approach allows the system to allocate computational resources efficiently, focusing encoding efforts on regions that require more detail while using simpler methods in other regions, thereby improving overall resource allocation efficiency without significantly complicating the encoding process.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11363298B2Video processing apparatus and processing method of video stream
Publication Date: 2022.06.14 WISTRON CORP
  • US11363298B2 patent drawing
  • US11363298B2 patent drawing
  • US11363298B2 patent drawing

AI summary

A video processing apparatus and a processing method of video stream are provided. In the method, at least one encoding unit is formed in an image frame, sub-encoding units in multiple encoding units of an image sequence are encoded according to a correlation between a first sub-encoding unit and a second sub-encoding unit in the sub-encoding units, and a video stream is generated according to an encoded result of the image sequence. The image frame is an image of the image sequence, and each of the encoding units records encoding information of a belonging block.