Stereo Image Sharpness Control Using Gaze and Parallax
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing stereo image technologies fail to reduce cognitive load and improve immersion due to mismatched focal length and angle of convergence, leading to eyestrain and decreased sense of realism.
Innovation Solution
An image processing apparatus that adjusts sharpness based on viewer line-of-sight information, enhancing the region of interest while reducing sharpness in other regions, without altering the focal length.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the focal length is changed after image generation to match the angle of convergence, then the viewer's cognitive load is reduced and immersion is improved, but the focal length in the stereo image cannot be changed after generation
Solution Approach 1:
The patent applies preliminary action by performing image processing on the captured image before stereo image generation. Specifically, it adjusts the focal length of the captured image to match the angle of convergence before generating the stereo image, ensuring that the focal length relationship is correctly established in advance rather than attempting to modify it after generation.
Solution Approach 2:
The patent applies parameter changes by modifying the focal length parameter of the captured image. It changes the focal length from its original predetermined value to a new value that corresponds to the angle of convergence, thereby aligning the optical parameters with human visual perception and eliminating the mismatch that causes viewer discomfort.
2Ease of operation
If the focal length is adjusted to match the angle of convergence, then cognitive load is reduced and eyestrain is minimized, but the original focal length setting is lost
Solution Approach 1:
The patent performs the focal length adjustment as a preliminary processing step on the captured image before stereo image generation. This ensures that the original captured image with its predetermined focal length is preserved, while a processed version with adjusted focal length is created for stereo image generation, maintaining both the original precision and the viewer comfort.
Data Source
AI summary
An image data obtaining unit obtains stereo image data from an input I/F or a secondary storage device. A parallax data obtaining unit obtains parallax data corresponding to the stereo image data from the image data obtaining unit. A line-of-sight information obtaining unit obtains line-of-sight information of a user wearing a head mounted display from a line-of-sight detection apparatus via a line-of-sight detection I/F. A process region determination unit generates a sharpness map based on the parallax data from the parallax data obtaining unit and the line-of-sight information from the line-of-sight information obtaining unit. A sharpness changing unit performs sharpness changing image processes on the stereo image data from the image data obtaining unit, based on the sharpness map from the process region determination unit. A display control unit displays the stereo image subjected to the sharpness change by the sharpness changing unit, on the head mounted display.