3D Video Display Processing Using DP Matching and Thinned Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current stereo viewing technologies face challenges in maintaining high resolution and accurate depth estimation, especially when using cameras with different resolutions, leading to mechanical positioning difficulties, increased manufacturing complexity, and potential depth errors due to phase differences and misalignment issues.
Innovation Solution
A three-dimensional video image display processing device that processes first and second video information with substantially the same resolution, using thinned image extraction sections and dynamic programming matching to estimate depth, while incorporating offset addition and look up tables to correct for misalignment and lens aberration, enabling accurate depth estimation and reduced processing time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If cameras with different resolutions are used for stereo viewing, then depth estimation can be performed, but mechanical positioning difficulties and manufacturing complexity increase
Solution Approach 1:
The patent applies homogeneity by using cameras with substantially the same resolution for both left and right video information capture. This eliminates the need for complex mechanical positioning and calibration that would be required if cameras with different resolutions were used, while still enabling accurate depth estimation through the subsequent thinning and matching processes.
2Manufacturing precision
If high resolution video information is processed for depth estimation, then image quality is maintained, but processing time increases
Solution Approach 1:
The patent applies segmentation by dividing the high-resolution video information into thinned images with lower resolution for depth estimation purposes. This allows the system to process only necessary portions of the image data at reduced resolution, significantly decreasing processing time while maintaining the ability to generate accurate depth maps for stereo display.
Solution Approach 2:
The patent applies partial action by using thinned images that contain only essential information for depth estimation. Instead of processing the entire high-resolution image, the system extracts and processes a subset of pixels at strategic locations, achieving sufficient depth accuracy with reduced computational burden.
3Productivity
If pixels are thinned out to increase processing speed, then processing time decreases, but depth estimation accuracy may be compromised
Solution Approach 1:
The patent applies preliminary action by performing offset addition to correct for camera misalignment and lens aberration before the thinning process. This pre-correction ensures that even when pixels are thinned out, the remaining pixels accurately represent the true spatial relationships, preserving depth estimation accuracy despite reduced processing resolution.
Solution Approach 2:
The patent introduces look-up tables as an intermediary mechanism that stores pre-calculated correction data for camera misalignment and lens aberration. These look-up tables enable rapid correction during processing without requiring complex real-time calculations, maintaining accuracy while supporting the use of thinned images for fast processing.
4Device complexity
If camera misalignment and lens aberration are not corrected, then processing is simpler, but depth estimation errors increase
Solution Approach 1:
The patent applies preliminary action by performing offset addition to correct for camera misalignment and lens aberration before the thinning process. This pre-correction ensures that even when pixels are thinned out, the remaining pixels accurately represent the true spatial relationships, preserving depth estimation accuracy despite reduced processing resolution.
Solution Approach 2:
The patent introduces look-up tables as an intermediary mechanism that stores pre-calculated correction data for camera misalignment and lens aberration. These look-up tables enable rapid correction during processing without requiring complex real-time calculations, maintaining accuracy while supporting the use of thinned images for fast processing.
Data Source
AI summary
A three-dimensional video image display processing device that causes a three-dimensional image to be displayed on a display by processing a first video information and a second video information. The three-dimensional video image display processing device includes: a DP matching processor that sets a matching scan direction to a direction of a line segment connecting a viewpoint center of the first video information with a viewpoint center of the second video information, and that uses DP matching to obtain depth estimation information for pixels extracted by a first thinned image extraction section and a second thinned image extraction section; and a display information generation section that generates movie display information for the display using video information of either the first video information or the second video information and using the depth estimation information obtained by the DP matching processor.