3D Video Transmission via Depth Map Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 2D video communication methods lack depth information, preventing stereoscopic rendering and limiting video calls and conferencing to two-dimensional imagery.
Innovation Solution
An electronic device obtains and processes 2D images and depth maps to generate and transmit 3D images via wireless communication, enabling stereoscopic 3D video transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If 2D video communication is used, then the system is simple and widely compatible, but depth information is lost and stereoscopic rendering is impossible
Solution Approach 1:
The patent applies dimensionality change by transitioning from 2D video images to 3D video images. The electronic device obtains 2D video images and corresponding depth maps, then processes them to generate 3D video images that include depth information. This allows the terminal device to render stereoscopic video content, solving the problem of lost depth information while maintaining system compatibility through software-based processing rather than hardware overhaul.
2Loss of information
If 3D video processing is implemented, then depth information and stereoscopic rendering are achieved, but processing complexity and computational requirements increase
Solution Approach 1:
The patent uses depth maps as an intermediary element to bridge 2D video images and 3D video images. The electronic device obtains depth maps that represent depth information for each pixel, then combines these with 2D video images to generate 3D video images. This intermediary approach simplifies the processing complexity by providing a structured representation of depth data that can be efficiently integrated with visual information.
Solution Approach 2:
The patent applies preliminary action by pre-processing video content to generate depth maps before 3D rendering. The electronic device obtains depth maps in advance and performs preliminary processing to create the necessary depth information structure. This allows the terminal device to perform lighter processing during actual playback, reducing real-time processing complexity while maintaining 3D rendering capability.
3Loss of information
If multiple image types (2D images and depth maps) are processed, then complete 3D reconstruction is achieved, but data transmission volume and processing time increase
Solution Approach 1:
The patent merges 2D video images and depth maps into a unified 3D video image format. The electronic device processes these separate data types together to create integrated 3D video images that contain both visual and depth information in a single data structure. This merging reduces the need to separately process and transmit multiple image types, thereby reducing processing time and transmission overhead.
Solution Approach 2:
The patent applies parameter changes by transforming the representation of visual data from 2D coordinates to 3D spatial parameters. The electronic device converts 2D video images with associated depth maps into 3D video images using depth values as additional parameters. This parameter transformation enables efficient storage and transmission of depth information within the image data structure itself, reducing overall processing time compared to separate depth map handling.
Data Source
AI summary
The present disclosure provides a communication method, a communication system, an electronic device, and a non-transitory computer-readable storage medium. The method includes: obtaining a plurality of 2D images and/or a plurality of depth maps for a current scene; processing the plurality of 2D images and/or the plurality of depth maps to obtain a plurality of 3D images; and transmitting the plurality of 3D images to the terminal device.