3D Image Processing Selective Object Transmission
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In 3D video streaming, existing methods face challenges in efficiently transmitting and processing images from multiple cameras to create a 3D effect, leading to high data throughput and latency issues, particularly in real-time applications like virtual reality and augmented reality.
Innovation Solution
A 3D image processing method that captures images from two cameras, transmits only object images based on depth information, and rebuilds a third image by combining these with the first image, reducing data transmission and latency through selective image transmission and processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If all image data from multiple cameras is transmitted to create a 3D effect, then the 3D effect quality is improved, but the network throughput and latency increase
Solution Approach 1:
The patent extracts and transmits only the depth information (disparity maps) from the second image rather than transmitting the entire second image. This selective extraction of essential information reduces the data transmission volume while preserving the 3D effect quality, thereby reducing network latency and throughput requirements.
Solution Approach 2:
The patent segments the image processing into two distinct components: the first image (color/image data) and the depth information (disparity map). These segmented components are transmitted separately and then recombined at the receiving end, allowing efficient utilization of network bandwidth while maintaining 3D effect quality.
2Measurement precision
If all image data from multiple cameras is transmitted to create a 3D effect, then the 3D effect quality is improved, but the data transmission volume increases
Solution Approach 1:
The patent extracts only the essential depth information from the second image and transmits it separately. This extraction of critical information while discarding redundant data significantly reduces the data transmission volume while maintaining the quality of the 3D effect.
Solution Approach 2:
The patent divides the complete image data into two segments: the first image containing color and basic visual information, and the second image processed to extract only depth information. This segmentation allows the system to transmit minimal necessary data while preserving 3D effect quality.
3Measurement precision
If complete image data is processed and transmitted, then image quality is maintained, but processing complexity and transmission requirements increase
Solution Approach 1:
The patent extracts only the depth information from the second image through disparity calculation, eliminating the need to process and transmit redundant image data. This extraction approach simplifies the processing complexity while maintaining image quality through selective information transmission.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach reduces network throughput and latency, enabling efficient 3D image display for real-time applications by selectively transmitting and processing image data, thereby enhancing the 3D effect in virtual and augmented reality systems.
Implementation Method 1
In some 3D video streaming applications, a user receives two different images from two eyes correspondingly. Due to the parallax effect, the user may feel the distances/depths to the objects in the image are different, and therefore the 3D effect is achieved.
Data Source
AI summary
A 3D image processing method includes: capturing, by a camera device, a first image with a first camera and a second image with a second camera; transmitting, by the camera device, the first image to an electronic device; transmitting, by the camera device, one or more object images in the second image to the electronic device based on a depth information of the second image; and rebuilding, by the electronic device, a third image by combining the one or more object images and the first image.