Eye-Directed Image Processing for Pupil-Based Luminosity Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image signal processing techniques require significant computational resources and time, compromise visual quality, and fail to adapt to high-resolution, small pixel size, and high frame-rate requirements, leading to sub-optimal and non-immersive viewing experiences, especially in extended-reality devices.
Innovation Solution
An eye-directed image signal processing system and method that selectively processes image signals based on a user's pupil size to determine a luminosity range, adjusting image signal processes and parameters accordingly, thereby generating high-quality and realistic images efficiently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If uniform image signal processing is applied to all parts of the image, then visual fidelity is maintained across the entire image, but processing resources, time, and computing power are significantly increased
Solution Approach 1:
The patent applies different image signal processing techniques to different regions of the image based on their importance. Critical regions (such as the central area where users focus their attention) receive enhanced processing for high visual fidelity, while less critical regions (peripheral areas) receive reduced or no processing, thereby maintaining overall visual quality while significantly improving processing efficiency and reducing computational resource consumption.
2Productivity
If existing image signal processing techniques are used, then processing can be performed, but visual quality is compromised and visual artifacts are introduced
Solution Approach 1:
The patent segments the image processing task into different stages: capturing raw image data, determining eye tracking information to identify critical regions, selectively applying image signal processing only to those critical regions, and generating the final output image. This segmentation allows high processing capability to be directed only where visually important, avoiding the introduction of visual artifacts in peripheral regions while maintaining processing efficiency.
3Manufacturing precision
If high-resolution and high frame-rate requirements are met, then display quality improves, but processing resources and time consumption increase significantly
Solution Approach 1:
The patent applies local quality processing by focusing high-resolution processing only on critical regions identified through eye tracking. This allows the system to meet high display quality requirements in the region of interest while using significantly fewer processing resources and time compared to processing the entire image at high resolution, thus resolving the contradiction between display quality and processing speed.
4Stability of the object's composition
If uniform processing parameters are applied, then processing consistency is maintained, but processing burden is unnecessarily increased
Solution Approach 1:
The patent introduces dynamic processing parameters that adapt based on eye tracking information. Processing consistency is maintained through standardized processing pipelines, but the parameters (such as processing intensity, resolution, and computational complexity) are dynamically adjusted according to the identified critical regions and user gaze patterns, thereby reducing unnecessary processing burden while maintaining processing consistency where needed.
Data Source
AI summary
Disclosed is a system with an image sensor comprising a plurality of photo-sensitive cells; and processor(s) configured to: receive, from the image sensor, a plurality of image signals captured by corresponding photo-sensitive cells of the image sensor; obtain information indicative of a current pupil size of a user of a display apparatus; determine a given luminosity range corresponding to the current pupil size; and selectively perform a sequence of image signal processes on the plurality of image signals and control a plurality of parameters employed for performing the sequence of image signal processes, based on the given luminosity range, to generate an image.