Skip Block Detection in Video Encoding Reduces Computational Complexity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video encoding processes are computationally intensive and time-consuming, particularly when evaluating whether a picture portion has little or no changes from a previously encoded co-located portion, making skip-mode encoding resource-intensive.

Innovation Solution

Implementing simplified transforms, such as Hadamard transforms, and applying skip-block detection procedures before and after motion estimation to determine if a block can be encoded in skip mode, reducing computational complexity and resource usage by selectively applying core transforms and quantization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional video encoding processes are used to evaluate whether a picture portion has little or no changes from a previously encoded co-located portion, then encoding accuracy is maintained, but computational complexity and resource usage increase significantly

Engineering Contradiction:
Improveencoding accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary skip-block detection procedures before motion estimation to identify blocks that can be encoded in skip mode. This preliminary action evaluates whether a current block has little or no changes from a previously encoded co-located block before committing to full motion estimation, thereby reducing computational complexity while maintaining encoding accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the encoding process into multiple stages: first applying simplified transforms and skip-block detection, then selectively applying full core transforms only to blocks that pass the initial detection. This segmentation allows the system to maintain high encoding accuracy for complex blocks while using lightweight evaluation for blocks likely to be skip blocks, thus reducing overall computational complexity.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If conventional video encoding processes are used to evaluate whether a picture portion has little or no changes from a previously encoded co-located portion, then encoding quality is maintained, but encoding time increases

Engineering Contradiction:
Improveencoding qualityVSAvoidencoding time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary skip-block detection before motion estimation to quickly identify blocks suitable for skip-mode encoding. This preliminary evaluation uses simplified transforms and early exit criteria to determine if a block has little or no changes from a previously encoded co-located block, significantly reducing encoding time for qualifying blocks while maintaining encoding quality through subsequent verification steps.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies partial action by using simplified transforms and incomplete motion estimation for blocks identified as potential skip blocks, rather than applying the full encoding process to all blocks. This partial evaluation approach reduces encoding time significantly while maintaining quality by applying full processing only when necessary.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If simplified transforms are applied to reduce computational complexity, then encoding speed increases, but transform accuracy may be compromised

Engineering Contradiction:
Improveencoding speedVSAvoidtransform accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent segments blocks into two categories: skip blocks and non-skip blocks. For skip blocks identified through preliminary detection, simplified transforms are applied to maintain encoding speed. For non-skip blocks, full core transforms are applied to ensure transform accuracy. This segmentation allows the system to achieve high encoding speed overall while maintaining accuracy where it matters most.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the transform parameter based on the block type. Skip blocks use simplified transforms with reduced computational complexity, while non-skip blocks use full core transforms with complete accuracy. This parameter change approach allows the system to optimize encoding speed for the majority of blocks while preserving transform accuracy for blocks that require it.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10708594B2Adaptive skip or zero block detection combined with transform size decision
Publication Date: 2020.07.07 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10708594B2 patent drawing
  • US10708594B2 patent drawing
  • US10708594B2 patent drawing

AI summary

Disclosed herein are exemplary embodiments of innovations in the area of encoding pictures or portions of pictures and determining whether and how certain encoding operations should be performed and flagged for performance by the decoder in the bitstream. In particular examples, various implementations for selectively encoding picture portions (e.g., blocks) in a skip mode (e.g., as in the skip mode of the H.265/HEVC standard) are disclosed. Embodiments of the disclosed techniques can be used to improve encoder efficiency, decrease overall encoder resource usage, and/or improve encoder speed. Such embodiments can be used in encoder modes in which efficient, fast encoder performance is desired (e.g., during encoding of live events, such as video conferencing).