Motion Compensating Prediction for Polyhedron Spherical Panorama

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Motion compensating prediction in spherical panorama images is inaccurate when reference pixels are not on the same projection plane due to geometrical deformation in polyhedron-format two-dimensional images, leading to poor prediction of pixel values.

Innovation Solution

A method that determines a target reference pixel based on the initial reference pixel's location and layout information of the polyhedron, using a connecting line through the polyhedron's center to find a pixel value for accurate prediction, especially when the initial reference pixel is outside the corresponding sub-image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If motion compensating prediction is performed using initial reference pixel location directly in polyhedron-format two-dimensional image, then the prediction process is simple, but the prediction accuracy deteriorates due to geometrical deformation when reference pixel is outside the corresponding sub-image

Engineering Contradiction:

Improveprediction process simplicityVSAvoidpixel value prediction accuracy

Core Design Contradiction:

Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent transitions from two-dimensional image coordinate space to three-dimensional polyhedron surface space by projecting the initial reference pixel onto the polyhedron surface and finding the target reference pixel along the radial line through the polyhedron center. This dimensional transformation enables accurate reference pixel selection across sub-image boundaries while maintaining prediction accuracy.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The polyhedron structure serves as an intermediary between the initial reference pixel location and the target reference pixel. By using the polyhedron center and radial projection as the mediator, the patent accurately maps reference pixels across different sub-images while accounting for geometrical deformation, thus improving prediction accuracy without excessive complexity.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Measurement precision

If target reference pixel is determined using polyhedron projection method when initial reference pixel is outside corresponding sub-image, then the prediction accuracy is improved, but the computational complexity increases

Engineering Contradiction:

Improvepixel value prediction accuracyVSAvoidprediction process complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the prediction process into two distinct paths: a simple path when the initial reference pixel is within the corresponding sub-image, and a complex polyhedron projection path when it is outside. This segmentation allows the system to apply the sophisticated polyhedron method only when necessary, balancing accuracy improvement with computational efficiency.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent applies different prediction strategies based on the local condition of the initial reference pixel location. When the pixel is within the corresponding sub-image, simple direct prediction is used. When it is outside, the polyhedron projection method is applied. This local adaptation optimizes the balance between computational complexity and prediction accuracy for different scenarios.

Inventive Principle:

Principle #3Local quality

3Productivity

If reference pixel selection does not consider sub-image boundaries in polyhedron-format image, then the prediction process is fast, but the prediction effect deteriorates due to deformation in join regions of faces

Engineering Contradiction:

Improveprediction processing speedVSAvoidprediction effect quality

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The patent performs preliminary determination of whether the initial reference pixel is outside the corresponding sub-image before executing the full prediction process. This preliminary check allows the system to quickly identify cases requiring the polyhedron projection method and apply the appropriate strategy, maintaining high processing speed while ensuring prediction reliability when needed.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent replaces the simple mechanical coordinate copying approach with a geometric projection-based system when sub-image boundary issues are detected. By substituting the direct coordinate mapping with polyhedron surface projection, the system maintains processing efficiency through conditional logic while achieving reliable prediction results across face boundaries.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11128874B2Motion compensating prediction method and device

Publication Date: 2021.09.21 HUAWEI TECH CO LTD

AI summary

Embodiments of the present invention provide a motion compensating prediction method and a motion compensating prediction apparatus. The motion compensating prediction method includes: determining a location of an initial reference pixel of a current pixel in a reference image, where the current pixel is located in a first sub-image of a current image; when the initial reference pixel is located outside a second sub-image that is in the reference image and that is at a location corresponding to the first sub-image, determining a location of a target reference pixel of the current pixel in the reference image based on the location of the initial reference pixel; and determining a predicted value of a pixel value of the current pixel based on a pixel value of the target reference pixel and/or a pixel value of a pixel near the target reference pixel.