Multi-Plane Image Encoding with Layer Change Detection for CGH Reconstruction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for encoding and decoding multiple plane images (MPIs) representative of 3D scenes are inefficient in handling dynamic scenes and fail to effectively reconstruct Computer Generated Holograms (CGHs), leading to computational complexity and resource consumption, especially in generating video CGHs where only some layers change between frames.

Innovation Solution

The proposed method involves encoding an indicator in the bitstream to track changes in each layer of the MPI, allowing for the reuse of previously computed CGH layers when no change is detected, and storing each layer of the multi-layer CGH structure to reduce computational load by reusing unchanged layers from a reference frame.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional encoding methods are used for all layers of MPIs, then complete 3D scene information is preserved, but computational time and resources are excessively consumed

Engineering Contradiction:
Improveencoding speedVSAvoidlayer change detection accuracy
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent segments the MPI encoding process by layer, introducing change detection indicators for each layer. This allows the system to process only changed layers in detail while reusing unchanged layers, thereby improving encoding speed without losing essential 3D scene information.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the encoding parameter by introducing a change detection indicator for each layer. This parameter allows the system to dynamically adjust the encoding process based on whether layers have changed, optimizing the balance between encoding speed and information preservation.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If all layers are processed for CGH reconstruction, then accurate holographic representation is achieved, but computational complexity increases

Engineering Contradiction:
ImproveCGH reconstruction accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the CGH reconstruction process by layer, using change detection indicators to identify which layers require full processing. This segmentation allows accurate reconstruction of changed layers while simplifying processing of unchanged layers, reducing overall computational complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by processing only the necessary layers for CGH reconstruction based on change detection. Instead of processing all layers uniformly, the system applies full processing only where needed, reducing computational complexity while maintaining reconstruction accuracy.

Inventive Principle:
Principle #16Partial or excessive action

3Use of energy by moving object

If change detection is implemented for each layer, then computational resources are reduced, but encoding complexity increases

Engineering Contradiction:
Improvecomputational resource consumptionVSAvoidencoding process complexity
Core Design Contradiction:
Use of energy by moving objectVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by performing change detection on each layer before full encoding processing. This preliminary step identifies unchanged layers that can be reused, reducing overall computational resource consumption while the added complexity is manageable through efficient implementation.

Inventive Principle:
Principle #10Preliminary action

4Productivity

If reference frames are reused for unchanged layers, then encoding efficiency improves, but reliability of current frame representation may decrease

Engineering Contradiction:
Improveencoding efficiencyVSAvoidframe accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements feedback through change detection indicators that determine whether to reuse reference frames or encode current frames. This feedback mechanism ensures that reference frames are reused only when appropriate (when layers haven't changed), maintaining reliability while improving encoding efficiency.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20240196011A1Methods and apparatuses for encoding/decoding a sequence of multiple plane images, methods and apparatus for reconstructing a computer generated hologram
Publication Date: 2024.06.13 INTERDIGITAL CE PATENT HOLDINGS SAS
  • US20240196011A1 patent drawing
  • US20240196011A1 patent drawing
  • US20240196011A1 patent drawing

AI summary

Methods (1400) and apparatuses for encoding/decoding a sequence of multiple plane images representative of a 3D scene are provided, wherein the sequence of multiple plane images comprises at least one multiple plane image. a multiple plane image comprising a plurality of layers. said encoding comprising encoding in a bitstream. for at least one layer of the plurality of layers of the at least one multiple plane image. an indicator indicating whether the at least one layer has changed with respect to a corresponding layer of a reference multiple plane image, and encoding the at least one multiple plane image. Methods (1100) and apparatuses for reconstructing Computer Generated Holograms from the sequence of multiple plane images are also provided.