Composite Multi-Plane Image Compression for Low-Bandwidth 3D Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional multi-plane image (MPI) techniques require high bandwidth and computational resources for transmitting and rendering 3D images, making them impractical for resource-constrained platforms.
Innovation Solution
Generate a single composite texture and alpha image from an MPI stack, which captures sufficient information for rendering, reducing the data to be transmitted and processed, using machine learning models to create a volumetric representation of a scene as a stack of semi-transparent images or planes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional multi-plane image techniques are used to transmit and render 3D images, then rendering quality is maintained, but bandwidth and computational resources required become excessively high
Solution Approach 1:
The patent extracts only the essential information from the multi-plane image stack by generating a single composite texture image and a single composite alpha image. This extraction process identifies and transmits only the critical visual and depth information needed for rendering, eliminating redundant data while preserving rendering quality.
Solution Approach 2:
The patent merges multiple texture planes and multiple alpha planes into single composite images. By combining the information from N texture planes and N alpha planes into one composite texture image and one composite alpha image, the data volume is reduced by a factor of N while maintaining the necessary information for high-quality rendering.
2Reliability
If conventional multi-plane image techniques are used for 3D image transmission, then rendering fidelity is preserved, but computational burden increases significantly
Solution Approach 1:
The patent extracts only the essential information from the multi-plane image stack by generating a single composite texture image and a single composite alpha image. This extraction process identifies and transmits only the critical visual and depth information needed for rendering, eliminating redundant data while preserving rendering quality.
Solution Approach 2:
The patent merges multiple texture planes and multiple alpha planes into single composite images. By combining the information from N texture planes and N alpha planes into one composite texture image and one composite alpha image, the data volume is reduced by a factor of N while maintaining the necessary information for high-quality rendering.
3Adaptability or versatility
If full multi-plane image stacks are transmitted, then complete 3D scene information is available, but data size becomes prohibitively large for resource-constrained devices
Solution Approach 1:
The patent extracts only the essential information from the multi-plane image stack by generating a single composite texture image and a single composite alpha image. This extraction process identifies and transmits only the critical visual and depth information needed for rendering, eliminating redundant data while preserving rendering quality.
Solution Approach 2:
The patent merges multiple texture planes and multiple alpha planes into single composite images. By combining the information from N texture planes and N alpha planes into one composite texture image and one composite alpha image, the data volume is reduced by a factor of N while maintaining the necessary information for high-quality rendering.
Data Source
AI summary
Example methods, apparatus, systems and articles of manufacture (e.g., physical storage media) to implement multi-plane image (MPI) compression are disclosed. Example apparatus disclosed herein include an interface to access an input multiplane image stack corresponding to a source camera viewpoint, the input multiplane image stack including a plurality of texture images and a corresponding plurality of alpha images, ones of the alpha images including pixel values representative of transparency of corresponding pixels in respective ones of the texture images. Disclosed example apparatus also include a compressed image encoder to at least one of (i) convert the plurality of texture images to a single composite texture image to generate a compressed multiplane image stack, or (ii) convert the plurality of alpha images to a single composite alpha image to generate the compressed multiplane image stack. In some disclosed examples, the interface is to output the compressed multiplane image stack.