3D Video Coding Using Decoder Emulator for Motion Vector Prediction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video compression standards, such as H.264, are limited in their ability to efficiently encode 3D video content due to high bit requirements for 3D motion parameters, which can be up to 10 times larger than those for 2D motion, and are computationally complex, making it impractical to implement more accurate prediction methods.

Innovation Solution

The method involves using 3D motion vectors that include parameters for translation, rotation, scaling, and color characteristics, and employs a decoder emulator to determine if motion vectors can be skipped during encoding, reducing the number of bits needed to transmit prediction parameters by allowing the decoder to independently determine motion vectors from previously decoded images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If 3D motion parameters are encoded using conventional methods, then prediction accuracy is improved, but bit transmission requirements increase up to 10 times compared to 2D motion

Engineering Contradiction:
Improveprediction accuracyVSAvoidbit transmission
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential motion parameters needed for 3D prediction while omitting redundant information. By using a decoder emulator to determine which motion vectors can be skipped, the system transmits only the critical subset of parameters, reducing bit transmission by up to 10 times while preserving sufficient prediction accuracy for 3D video content.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of the encoder determining all motion parameters and transmitting them, the patent inverts the approach by using a decoder emulator to identify which parameters the decoder can independently derive. This inversion shifts the burden from encoder transmission to decoder derivation, dramatically reducing the bit transmission requirement while maintaining prediction accuracy.

Inventive Principle:
Principle #13The other way round (Inversion)

2Measurement precision

If complex 3D motion prediction methods are implemented, then prediction accuracy is improved, but computational complexity increases making it impractical

Engineering Contradiction:
Improveprediction accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent employs a decoder emulator that enables the decoder to independently determine motion vectors for sections without requiring complex encoder computations. The emulator uses previously decoded images to derive motion parameters, allowing the decoder to self-service the complex prediction tasks that would otherwise burden the encoder, thereby reducing overall computational complexity while maintaining accuracy.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary decoding of reference sections to extract motion information before the actual decoding of the current section. By preparing motion vectors in advance through the decoder emulator using previously decoded images, the system reduces the computational burden during real-time decoding while maintaining high prediction accuracy for 3D motion.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If motion vectors are transmitted for all sections, then prediction accuracy is improved, but transmission efficiency deteriorates

Engineering Contradiction:
Improveprediction accuracyVSAvoidtransmission efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent extracts and transmits only the necessary motion vector parameters while omitting redundant ones. By using the decoder emulator to identify which motion vectors can be independently determined from previously decoded sections, the system transmits only the essential subset, improving transmission efficiency by reducing the total number of parameters sent while preserving prediction accuracy where needed.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system discards redundant motion vector information that can be recovered by the decoder through independent determination using previously decoded images. The decoder emulator identifies which parameters can be discarded during encoding but recovered during decoding, thereby improving transmission efficiency without sacrificing prediction accuracy for the essential parameters.

Inventive Principle:
Principle #34Discarding and recovering

Data Source

PatentEP2638695B1Video coding methods and apparatus
Publication Date: 2017.10.18 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP2638695B1 patent drawing
  • EP2638695B1 patent drawing
  • EP2638695B1 patent drawing

AI summary

In methods for encoding and decoding digital pictures certain prediction parameters may be omitted from the output on the encoder side or the input on the decoder side. An encoder can identify prediction parameter values that can be omitted by determining whether a decoder emulator can reproduce the prediction parameter values from other information, such as predicted pixel and prediction error values of one or more previously decoded sections from the same or a different picture.