Stereoscopic Video Stream Multiplexing with Depth Maps
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current stereoscopic video stream technologies lack a unified format for generating, transmitting, and receiving 3D images that is compatible with both traditional 2D and 3D devices, including self-stereoscopic displays, and do not allow for adjustable depth perception.
Innovation Solution
A method and device for multiplexing right and left images with one or more depth maps into a single composite frame, using an unused region to accommodate the depth map, allowing for efficient transmission and reception, and enabling depth adjustment by interpolating pixel values to reduce noise and maintain high image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If stereoscopic video streams transport information about two sequences of images for left and right perspectives, then three-dimensional perception is achieved, but the data transmission load and storage requirements increase significantly
Solution Approach 1:
The patent extracts and transmits only the depth information (depth maps) separately from the full-color images. Instead of transmitting complete stereoscopic image pairs, the system transmits one full-color image and extracts depth information that can be used to synthesize the second image and adjust depth perception, thereby reducing the quantity of data that needs to be transmitted while maintaining 3D perception capability
Solution Approach 2:
The patent introduces depth maps as an intermediary element that mediates between the transmitted image data and the final displayed stereoscopic image. The depth maps serve as a compact representation that enables the receiver to reconstruct and adjust stereoscopic images without requiring transmission of complete image pairs, thus reducing data load while preserving adaptability
2Adaptability or versatility
If depth maps are transmitted to enable depth adjustment and intermediate image synthesis, then adaptability and image quality are improved, but the complexity of the transmission and processing system increases
Solution Approach 1:
The patent creates a universal format that can be used across multiple device types including traditional 2D displays, stereoscopic 3D displays with active glasses, and self-stereoscopic displays. The same depth map data structure and transmission format serve multiple functions and are compatible with different display technologies, reducing the need for device-specific processing complexity while maintaining adaptability
Solution Approach 2:
The patent uses standardized parameter representations for depth maps (such as grayscale values representing depth distances) that can be processed through consistent algorithms across different devices. By establishing standardized parameter formats and processing methods, the system reduces complexity while enabling depth adjustment and intermediate image synthesis across various display types
3Adaptability or versatility
If a unified format is created for both traditional 2D and 3D devices, then compatibility and versatility are improved, but the complexity of maintaining multiple formats is reduced
Solution Approach 1:
The patent establishes a universal transmission format that encapsulates both traditional 2D image data and depth map information in a single standardized structure. This format can be interpreted by different device types according to their capabilities, eliminating the need for separate format management systems and reducing complexity while maintaining broad compatibility across 2D and 3D devices
Data Source
AI summary
A method for generating a stereoscopic video stream (101) having composite images (C) that include information about a right image (R) and a left image (L), as well as at least one depth map includes pixels from the right image (R) and from the left image (L), and then entering the selected pixels into a composite image (C) of the stereoscopic video stream. The method also provides for entering all the pixels of the right image (R) and all the pixels of the left image (L) into the composite image (C) by leaving one of said two images unchanged and breaking up the other one into regions (R1, R2, R3) having a plurality of pixels. The pixels of the depth map(s) are then entered into that region of the composite image which is not occupied by pixels of the right and left images.