Video Coding Padding Samples Generation via Motion Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video coding techniques inefficiently handle the expansion of video units by duplicating boundary samples, which limits bandwidth efficiency and fails to exploit motion continuity within and between pictures.

Innovation Solution

Generating padding samples for an extended video unit without duplicating boundary samples, using methods such as prediction, interpolation, and motion compensation based on various prediction modes and motion vectors, to create a larger video unit for improved coding efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If boundary samples are duplicated to generate padding samples, then the video unit can be expanded to a larger size, but bandwidth efficiency is limited and motion continuity is not exploited

Engineering Contradiction:
Improvevideo unit sizeVSAvoidbandwidth efficiency
Core Design Contradiction:
Area of stationary objectVSLoss of energy

Solution Approach 1:

The patent performs preliminary action by generating motion-compensated padding samples in advance before actual video coding operations. Motion vectors from boundary blocks are used to predict and fill padding areas with samples that anticipate future motion patterns, enabling more efficient subsequent coding operations and reducing overall bandwidth requirements.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by replicating boundary samples through motion compensation rather than simple duplication. Motion vectors guide the copying process to create padding samples that reflect actual motion patterns, preserving motion continuity while reducing the information redundancy associated with naive duplication methods.

Inventive Principle:
Principle #26Copying

2Ease of manufacture

If boundary samples are duplicated to generate padding samples, then the video unit expansion is simple to implement, but motion continuity within and between pictures is not exploited

Engineering Contradiction:
Improveimplementation simplicityVSAvoidmotion continuity information
Core Design Contradiction:
Ease of manufactureVSLoss of information

Solution Approach 1:

The patent introduces motion vectors as an intermediary between boundary samples and padding samples. These motion vectors serve as mediators that carry motion information from boundary blocks to guide the generation of padding samples, enabling the system to exploit motion continuity while maintaining a structured and implementable process.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent applies parameter changes by using motion vector parameters to transform the simple duplication process into a motion-aware sampling process. By changing the generation parameters from static duplication to dynamic motion-compensated prediction, the system preserves motion continuity information while remaining computationally feasible.

Inventive Principle:
Principle #35Parameter changes

3Loss of energy

If motion compensation based padding is used, then bandwidth efficiency and compression performance are improved, but the processing complexity increases

Engineering Contradiction:
Improvebandwidth efficiencyVSAvoidprocessing complexity
Core Design Contradiction:
Loss of energyVSDevice complexity

Solution Approach 1:

The patent applies partial action by performing motion compensation only for padding sample generation rather than for the entire video coding process. This selective application of motion compensation achieves bandwidth efficiency improvements while limiting the increase in processing complexity to only the necessary padding areas, avoiding full-frame processing overhead.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20230396777A1On boundary padding samples generation in image/video coding
Publication Date: 2023.12.07 DOUYIN VISION CO LTD
  • US20230396777A1 patent drawing
  • US20230396777A1 patent drawing
  • US20230396777A1 patent drawing

AI summary

A method for coding video data implemented by a video coding apparatus. The method includes filling an extended area disposed around a video unit with padding samples to generate a larger video unit. Some of the padding samples are generated without duplicating boundary samples within the video unit. The method further includes converting between the video unit of the video and a bitstream in accordance with the extended area as filled.