3D Media Content Generation Using Depth Map Pixel Accuracy Adjustment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Capturing and generating three-dimensional media content is a costly and time-consuming process, despite advancements in high-resolution displays that can present 3D content with clarity.

Innovation Solution

A system that generates a disparity map based on a depth map, determines pixel accuracy using a confidence map, and adjusts inaccurate pixels using a cost function, such as the graph cut or belief propagation method, to produce an adjusted depth map for generating three-dimensional media content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If traditional methods are used to capture and generate three-dimensional media content, then the quality and clarity of 3D content can be achieved, but the process becomes costly and time-consuming

Engineering Contradiction:
Improve3D content qualityVSAvoidcontent generation time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by capturing both 2D images and depth information simultaneously during the initial拍摄 phase, rather than generating 3D content from 2D images later. This preliminary capture of depth data eliminates time-consuming post-processing while ensuring high 3D content quality from the start

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses depth maps as a simplified copy or representation of the actual 3D scene geometry. By working with these depth map copies rather than full 3D models, the system achieves efficient processing while maintaining the ability to generate high-quality 3D content

Inventive Principle:
Principle #26Copying

2Manufacturing precision

If traditional methods are used to capture and generate three-dimensional media content, then the quality and clarity of 3D content can be achieved, but the process becomes costly

Engineering Contradiction:
Improve3D content qualityVSAvoidcontent production cost
Core Design Contradiction:
Manufacturing precisionVSEase of manufacture

Solution Approach 1:

The system uses depth maps as simplified digital copies of scene geometry, which are much cheaper and easier to capture and process than traditional multi-camera 3D systems or mechanical scanning equipment, thereby reducing production costs while maintaining 3D content quality

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces complex mechanical 3D capture systems with computational methods that process 2D images combined with depth maps using algorithms like graph cuts and belief propagation, substituting expensive hardware with more affordable computational approaches

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If all pixels in the depth map are processed to ensure accuracy, then the 3D content quality improves, but the processing resources required increase significantly

Engineering Contradiction:
Improvedepth map accuracyVSAvoidprocessing resources
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system applies different processing strategies to different regions of the depth map based on local characteristics. High-confidence regions are processed with standard algorithms, while low-confidence regions (such as boundaries and occluded areas) receive specialized processing, optimizing resource usage while maintaining overall accuracy

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the depth map processing into different confidence-based regions, separating high-confidence pixels from low-confidence pixels. This segmentation allows the system to apply computationally intensive algorithms only where necessary, reducing overall processing resource requirements while maintaining measurement precision in critical areas

Inventive Principle:
Principle #1Segmentation

4Productivity

If inaccurate pixels in the depth map are not adjusted, then processing is faster and simpler, but the accuracy and quality of 3D media content deteriorates

Engineering Contradiction:
Improveprocessing speedVSAvoid3D content accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system performs preliminary identification and classification of inaccurate pixels before the main 3D content generation process. By pre-marking problematic regions using confidence maps and boundary detection, the subsequent processing can focus resources efficiently on correcting only the necessary pixels, maintaining both speed and accuracy

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9674506B2Apparatus and method for providing three dimensional media content
Publication Date: 2017.06.06 AT&T INTELLECTUAL PROPERTY I L P
  • US9674506B2 patent drawing
  • US9674506B2 patent drawing
  • US9674506B2 patent drawing

AI summary

A system that incorporates teachings of the exemplary embodiments may include, for example, means for generating a disparity map based on a depth map, means for determining accuracy of pixels in the depth map where the determining means identifies the pixels as either accurate or inaccurate based on a confidence map and the disparity map, and means for providing an adjusted depth map where the providing means adjusts inaccurate pixels of the depth map using a cost function associated with the inaccurate pixels. Other embodiments are disclosed.