Saliency-Based Disparity Mapping for 3D Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D image processing methods often result in high disparities that exceed the comfortable processing range of the human visual system, leading to visual discomfort, fatigue, or diplopia, especially when shifting a high disparity region of interest to zero disparity, which reduces the overall 3D experience and image quality.
Innovation Solution
The method involves deriving a first depth map and saliency data from the 3D image signal, determining a display depth sub-range, and applying a depth mapping function to map salient depth values towards this sub-range, while keeping non-salient values within the usable depth range, using weighted histograms to ensure higher image quality and comfort.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If disparity shift is applied to make the region of interest have zero disparity, then the region of interest achieves optimal 3D perception, but other areas exceed the comfortable disparity range causing visual discomfort and fatigue
Solution Approach 1:
The patent applies different disparity mapping strategies to different regions of the image based on their saliency. Salient regions (region of interest) are mapped to have zero disparity for optimal depth perception, while non-salient regions are mapped to stay within the comfortable disparity range, thus avoiding visual discomfort in those areas.
Solution Approach 2:
The patent changes the disparity parameter dynamically based on region saliency. By calculating importance values for different pixels and adjusting the disparity mapping function accordingly, it transforms the fixed disparity shift approach into an adaptive one that modifies disparity values according to local image characteristics.
2Measurement precision
If a large disparity shift is applied to move the region of interest to zero disparity, then the region of interest achieves optimal depth, but the overall 3D experience is reduced due to excessive disparities in other areas
Solution Approach 1:
The patent makes the disparity mapping quality non-uniform across the image by applying local adjustments based on saliency. This allows optimal depth perception in salient regions while maintaining acceptable disparity levels in non-salient regions, thus preserving overall 3D experience quality.
Solution Approach 2:
Instead of applying a uniform disparity shift to the entire image, the patent applies disparity adjustment only where necessary (in salient regions), leaving non-salient regions with minimal or no disparity shift, thereby avoiding excessive disparities that would degrade the overall 3D experience.
3Object-affected harmful factors
If blurring is applied to hide discomforting areas with high disparity, then visual discomfort is reduced, but image quality is degraded
Solution Approach 1:
Instead of using blurring to hide high disparity regions (which degrades image quality), the patent converts the problem by applying selective disparity mapping that prevents excessive disparities from occurring in the first place. The 'harm' of high disparity in non-salient regions is converted into a benefit by mapping those regions to stay within comfortable disparity ranges while maintaining sharp image quality.
Data Source
AI summary
A three dimensional [3D] image signal is processed for rendering 3D image data (33) on a specific 3D display, e.g. an auto-stereoscopic display. A first depth map (34) and saliency of the 3D image data are determined. A display depth sub-range (35) of a usable depth range (36) of the 3D display is determined and provides a higher 3D image quality for a viewer than the 3D image quality across the usable depth range. A depth mapping function is determined in dependence of the saliency data. The depth mapping function maps the first depth map to a second depth map for generating views for the 3D display. Advantageously the salient range of depth values is mapped towards the display depth sub-range.