3D Message Generation With Packed Depth Maps
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in efficiently processing digital images captured under varying conditions, such as changes in scale, noise, lighting, and geometric distortion, which are computationally intensive and hinder the enhancement of user experiences with digital images.
Innovation Solution
A messaging system infrastructure that supports the creation and sharing of interactive 3D media, enabling depth-based media sharing and incorporating motion sensor input, along with the management of depth data and external effects, to enhance image processing and provide augmented reality experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If traditional 2D image processing is used, then processing is simpler and faster, but spatial detail and geometry information are lost
Solution Approach 1:
The patent transitions from 2D image processing to 3D message processing by incorporating depth information and spatial geometry. The system generates 3D messages from 2D images by adding depth maps, surface normal maps, and geometric data, enabling viewers to see spatial details and interact with content in three-dimensional space.
Solution Approach 2:
The patent segments the 3D message into multiple data components including depth information, surface normal maps, geometric data, and texture maps. This segmentation allows the system to process and transmit only the necessary spatial detail information while maintaining manageable complexity in the overall system.
2Ease of operation
If 3D media processing is implemented, then user engagement and interactivity are enhanced, but computational requirements and processing time increase
Solution Approach 1:
The system performs preliminary processing by pre-computing depth maps, surface normal maps, and geometric data from original images before they are transmitted. This allows the receiving device to render 3D messages quickly without performing computationally intensive real-time processing, thus reducing perceived processing time while maintaining interactivity.
Solution Approach 2:
The patent creates a compressed representation or copy of the 3D spatial information that can be transmitted and rendered efficiently. The 3D message serves as a condensed data structure that preserves essential spatial relationships while reducing the data volume compared to full 3D models, enabling faster processing and rendering.
3Measurement precision
If depth data and 3D effects are added to messages, then spatial representation is improved, but data size and storage requirements increase
Solution Approach 1:
The patent applies local quality by providing depth and spatial information only where necessary within the image content. Rather than uniformly adding 3D data to entire images, the system processes and transmits depth maps and geometric data selectively for regions that require enhanced spatial representation, reducing overall data size while maintaining measurement precision where needed.
Data Source
AI summary
The subject technology applies a three-dimensional (3D) effect to image data and depth data based at least in part on an augmented reality content generator. The subject technology generates a segmentation mask based at least on the image data. The subject technology performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a packed depth map based at least in part on the a depth map of the depth data. The subject technology generates, using the processor, a message including information related to the applied 3D effect, the image data, and the depth data.