Gaze-Aware Image Processing for Depth-Based Foveated Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing technologies fail to detect specific regions of interest when users are in a surveying mode, where the line of sight is not directed at a subject, leading to inadequate rendering processing.
Innovation Solution
An image processing apparatus that performs line-of-sight detection, first and second distance detection, and adjusts image quality based on the detected distances and surveying degree to enhance rendering processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high-resolution rendering processing is performed on the line of sight point, then rendering quality is improved, but rendering costs increase
Solution Approach 1:
The patent applies foveated rendering technology to render the line of sight point area in high definition while rendering peripheral areas in low definition. This local quality differentiation allows the system to concentrate computational resources on the foveal region where users have acute vision, thereby improving perceived rendering quality while reducing overall rendering costs.
2Ease of operation
If the line of sight detection function is installed, then user viewing assistance is improved, but device complexity increases
Solution Approach 1:
The head-mounted display integrates multiple functions including line of sight detection, depth information acquisition, and rendering processing into a single device. The line of sight detection unit, depth information acquisition unit, and rendering processing unit work together as a unified system, allowing the device to perform multiple functions simultaneously without proportionally increasing complexity.
3Area of stationary object
If rendering processing is performed on the entire visual field, then coverage area is improved, but computational resources increase
Solution Approach 1:
The system divides the visual field into different rendering quality zones based on the line of sight point. The foveal region (line of sight point area) receives high-definition rendering processing, while peripheral regions receive low-definition rendering. This approach maintains adequate coverage area across the entire visual field while significantly reducing computational resources by applying different processing intensities to different regions.
Data Source
AI summary
An image processing apparatus includes a processor and a memory storing a program which causes the image processing apparatus to execute detecting a direction of a line of sight of a user viewing the display, detecting a first distance that is a distance relating to a depth to a position of a line of sight of the user, based on the detected direction of the line of sight, detecting a second distance that is a distance relating to a depth to a subject that exists in a direction of the user's line of sight, and changing, based on the first distance and the second distance, at least one of an area in which processing for changing image quality of the image is performed and an image quality in the processing for changing the image quality of the image.