Gaze-Controlled Focusable Camera for AR Depth Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional imaging equipment for virtual and augmented reality devices has limitations, including low resolution, poor depth representation, and noise in captured images, due to fixed focus cameras, high processing power requirements, and reduced light intake for enhanced depth of field.
Innovation Solution
An imaging system comprising focusable cameras, depth map or voxel map generation, and a processor that adjusts focus length based on user gaze direction to capture high-resolution images with improved depth characteristics and minimal noise.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If fixed focus cameras are used to simplify the imaging system, then device complexity is reduced, but image resolution and depth representation deteriorate
Solution Approach 1:
The patent employs dynamic focus adjustment mechanisms that allow the camera to change focus distance based on detected object depth. The focusable camera lens can be actively adjusted to different focal positions, transforming the static fixed-focus system into a dynamic one that adapts to varying scene depths, thereby maintaining high resolution across different distance ranges.
Solution Approach 2:
The system changes optical parameters (focus distance, aperture) based on depth map information. By adjusting the focal length and aperture settings according to the detected depth characteristics of the scene, the camera optimizes image quality for different depth ranges without requiring a completely complex multi-camera system.
2Measurement precision
If small aperture is used to enhance depth of field, then depth representation is improved, but light intake is reduced causing poor resolution and noise
Solution Approach 1:
The system dynamically adjusts aperture size based on the depth characteristics of the captured scene. When objects are at similar depths, the aperture can be opened wider to maximize light intake. When there is significant depth variation, the aperture is adjusted to achieve appropriate depth of field while maintaining sufficient brightness, thus dynamically optimizing both depth representation and light intake.
Solution Approach 2:
The depth map is generated in advance before image capture, allowing the system to pre-determine the optimal aperture setting based on the detected depth distribution. This preliminary depth analysis enables the camera to be configured with the appropriate aperture before exposure, ensuring both adequate depth of field and sufficient light intake for the specific scene.
3Measurement precision
If auto focus cameras are used to adjust focus within the scene, then image resolution is improved, but processing power and processing time increase significantly
Solution Approach 1:
The patent replaces complex computational auto-focus algorithms with a depth-map-guided focus control system. Instead of using intensive image processing to determine focus distance, the system uses dedicated depth sensing (such as time-of-flight or structured light) to directly obtain depth information, which then directly controls the focus lens position, significantly reducing computational requirements.
Solution Approach 2:
The depth map acts as an intermediary between the scene and the focus control system. Rather than processing raw images to determine focus points, the system uses the depth map as a intermediate representation that directly encodes distance information, which then straightforwardly translates to lens positioning, simplifying the control algorithm and reducing processing power needs.
4Measurement precision
If auto focus adjustment is performed to improve focus within the scene, then image resolution is improved, but focusing properties of user eyes are interfered with
Solution Approach 1:
The system incorporates feedback from the display apparatus about the user's gaze direction. The gaze tracking information feeds back to the focus control system, allowing the camera to adjust focus to match the user's natural eye focus point. This feedback mechanism ensures that the camera's focus adjustment aligns with the user's visual attention, avoiding interference with natural eye focusing properties.
Solution Approach 2:
The system performs preliminary gaze tracking and depth analysis to determine the optimal focus point before capturing the image. By preemptively adjusting the focus based on where the user is looking, the system ensures that the final image is focused exactly where the user's eyes are naturally focused, eliminating the need for post-capture focus adjustments that would interfere with user eye properties.
Data Source
AI summary
An imaging system and a method of producing images for a display apparatus, via the imaging system includes at least one focusable camera for capturing at least one image of a given real-world scene; means for generating a depth map or a voxel map of the given real-world scene; and a processor coupled to the focusable camera and the aforesaid means. The processor is communicably coupled with the display apparatus. The processor is configured to receive information of the gaze direction of the user; map the gaze direction to the depth map or the voxel map to determine an optical depth of a region of interest in the given real-world scene; and control the focusable camera to employ a focus length that is substantially similar to the determined optical depth of the region of interest when capturing the at least one image.