Low-Complexity Multilayer Image Rendering with Non-Intersecting Depth Maps
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing multilayer image formats, such as multiplane images (MPI) and multi-view plus depth (MVD), suffer from rendering errors and computational inefficiencies due to assumptions about pixel depth values and object surfaces, leading to increased bitrate, pixel rate, and processing costs.
Innovation Solution
A method for generating multilayer images by creating layers with restricted displacement maps that ensure non-intersection, using constraints on layer spacing, angles, and curvature to enable efficient rendering with simpler algorithms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If displacement maps are added to each layer to define depth surfaces, then rendering precision is improved, but device complexity increases due to more computationally expensive rendering algorithms
Solution Approach 1:
The patent segments the scene into multiple layers at different depth ranges, with each layer having an associated displacement map. This segmentation allows the complex rendering task to be divided into simpler per-layer operations, where displacement maps provide depth information without requiring full 3D rendering algorithms for each pixel.
Solution Approach 2:
The displacement maps are pre-generated during encoding based on 3D source data, storing depth information in advance. This preliminary action eliminates the need for complex real-time depth calculations during rendering, as the depth surfaces are already defined in the encoded bitstream.
2Measurement precision
If layers are spaced closer together to reduce MPI type error, then rendering precision is improved, but bitrate and pixelrate increase
Solution Approach 1:
Instead of using uniformly spaced layers, the patent employs displacement maps that dynamically adjust the effective depth position of each pixel within its layer. This allows layers to be spaced farther apart while maintaining accurate depth representation through the displacement values, reducing the number of layers needed and thus lowering bitrate.
Solution Approach 2:
The patent changes the parameter representation by storing displacement values (depth offsets) rather than creating additional full-resolution layers. This parameter change allows precise depth control with fewer layers, reducing the overall data quantity while maintaining depth accuracy.
3Measurement precision
If views are spaced closer together to compensate for MVD type error, then rendering precision is improved, but processing cost increases
Solution Approach 1:
The patent extracts depth information into separate displacement maps that are stored in the bitstream. This extraction eliminates the need to process multiple closely-spaced views during decoding, as the depth information is directly available from the displacement maps, significantly reducing processing cost while maintaining boundary accuracy.
4Manufacturing precision
If more layers are added to reduce blurring, then image quality is improved, but computational resources and time increase
Solution Approach 1:
The patent uses displacement maps as a compact representation that copies depth information from 3D source data into a 2D format suitable for layered rendering. This copying approach maintains image quality by preserving depth accuracy without requiring additional full-resolution layers, thus avoiding the computational overhead of processing extra layers.
Data Source
AI summary
The invention provides a method for generating multilayer images. The method comprises receiving three-dimensional, 3D, source data of a scene and generating a plurality of layers at different depths in a virtual 3D scene, wherein each layer corresponds to a particular layer depth value relative to an origin point. Image data is generated for each layer based on the 3D source data, wherein the image data comprises texture data and transparency data, and displacement maps are generated for the layers based on the 3D source data and the depth values of the layers. The displacement maps define the depth of different points on a corresponding layer relative to the layer depth, wherein the generation of the displacement maps is restricted such that a depth surface, as defined by any displacement map, does not intersect any other depth surface in the virtual 3D scene. A depth surface is defined as the mapping of a displacement map onto the corresponding layer.