Intra Picture Motion Compensation Using Temporary Pixel Padding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding standards face inefficiencies in motion compensation when dealing with intra pictures, as they lack the ability to use the currently processing picture as a reference, leading to suboptimal prediction and increased computational complexity.

Innovation Solution

The current picture is utilized as a reference for motion compensation by padding unknown pixels with temporary values, allowing it to be treated similarly to other reference pictures, thereby enhancing prediction efficiency and simplifying the decoding process without requiring additional memory or complexity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If motion compensation is performed between two different pictures as defined in existing video coding standards, then temporal redundancy is removed, but intra pictures cannot use motion compensation and require less efficient intra prediction

Engineering Contradiction:
Improvecoding efficiencyVSAvoidreference picture availability
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent enables the current picture to serve dual functions: as the picture being decoded and as a reference picture for motion compensation. This allows intra pictures to utilize motion compensation techniques previously reserved for inter pictures, improving coding efficiency while maintaining standard compatibility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent performs preliminary decoding and padding of the current picture before motion compensation is applied. By temporarily completing the decoding process and filling unknown pixels with padding values, the current picture becomes available as a reference picture, enabling subsequent motion compensation operations without requiring additional reference pictures.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If the current picture is used as a reference picture for motion compensation, then prediction efficiency is improved, but unknown pixels need to be padded with temporary values

Engineering Contradiction:
Improveprediction accuracyVSAvoiddecoding process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces padding values as intermediary temporary data to represent unknown pixels in the current picture. These padding values act as placeholders that enable motion compensation to proceed without requiring actual pixel values, allowing the process to use the current picture as reference while managing the complexity of incomplete data.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the decoding process into distinct phases: preliminary decoding with padding, motion compensation using the padded current picture, and final refinement. This segmentation allows each phase to focus on specific tasks, improving prediction accuracy while managing complexity through structured processing steps.

Inventive Principle:
Principle #1Segmentation

3Productivity

If intra prediction is used for intra pictures as required by current standards, then no additional reference pictures are needed, but coding efficiency is much lower than motion compensation

Engineering Contradiction:
Improvecoding efficiencyVSAvoiddecoding simplicity
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent merges the advantages of intra prediction (no additional reference pictures needed) with motion compensation (higher coding efficiency). By allowing the current picture to serve as its own reference picture, the patent combines the self-containment of intra prediction with the predictive power of motion compensation, achieving both coding efficiency and decoding simplicity.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS8218641B2Picture encoding using same-picture reference for pixel reconstruction
Publication Date: 2012.07.10 SONY INTERACTIVE ENTERTAINMENT LLC
  • US8218641B2 patent drawing
  • US8218641B2 patent drawing
  • US8218641B2 patent drawing

AI summary

Digital pictures may be encoded by padding all un-processed pixels within a currently processing picture with temporary pixel values; searching the picture for a matching section for use as a reference in pixel reconstruction of a section of the picture independent of whether the picture is intra-coded or inter-coded; and using the matching section to perform pixel prediction on the section to generate one or more predicted pixels for the section.