Multiplane Image Encoding And Decoding With Layer Subsampling

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing image and video coding schemes face limitations in handling multiplane image representations due to constraints on the maximum size of pictures that can be processed by conventional decoders, limiting the number of layers and resolution of each layer in 3D scene rendering.

Innovation Solution

The method involves reducing the size of layers in a multiplane image representation by subsampling and/or cropping, and encoding information about layer sizes and positions within a tiled picture, allowing for increased number of layers and resolution while maintaining compatibility with existing 2D video decoders.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the number of layers and resolution in MPI representation are increased to improve 3D scene rendering quality, then the picture size exceeds the maximum processing capability of conventional decoders

Engineering Contradiction:

ImproveresolutionVSAvoidpicture size

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The picture is segmented into multiple layers, where each layer represents a specific depth plane of the 3D scene. By dividing the complex multiplane image into separate layers, the system can process and transmit each layer independently, managing the overall complexity while maintaining high resolution and layer count for improved rendering quality

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces a new dimension by packing multiple 2D layers into a single picture structure with explicit layer identification. This dimensional transformation allows conventional 2D decoders to process the data by adding layer interpretation logic, effectively handling multiplane representations without requiring specialized 3D decoding hardware

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If the number of layers is increased to improve 3D scene rendering, then the total picture size exceeds the maximum size constraint of conventional decoders

Engineering Contradiction:

Improvenumber of layersVSAvoidpicture size

Core Design Contradiction:

Adaptability or versatilityVSArea of stationary object

Solution Approach 1:

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent creates a universal picture structure that can accommodate multiple layers with different resolutions and configurations. This multi-functional framework allows the same decoding infrastructure to handle varying numbers of layers and resolution combinations, providing adaptability without requiring separate decoding paths for different picture sizes

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentEP4622256A1Encoding and decoding methods of multiplane image representation and corresponding apparatuses

Publication Date: 2025.09.24 INTERDIGITAL CE PATENT HOLDINGS SAS

Figure 1
Figure 2
Figure 3

AI summary

A decoding method is disclosed. At least one picture is decoded that comprises packed layers of a multiplane image representation wherein a size of at least one layer is reduced with respect to a reference size. Information is decoded describing each layer in terms of size and position in the at least one picture. A multiplane image representation is reconstructed that comprises a plurality of layers based on the decoded at least one picture and the decoded information.