Eye-Tracking Viewport Adjustment for AR Display Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing portable devices with image capture and display modules struggle to provide an optimal augmented reality experience as the images displayed do not always fit the background scene when the viewing distance between the user and the device changes, compromising the interactive and digitized experience.
Innovation Solution
Incorporating an eye-tracking module to track the user's viewpoint position and adjust the viewport within the images captured by the image capture module, allowing for the generation of modified images that fit the background scene, thereby enhancing the augmented reality experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the image display is constrained by camera specification, then the device structure remains simple, but the augmented reality experience deteriorates when viewing distance changes
Solution Approach 1:
The patent implements feedback by using the eye-tracking module to detect the user's viewpoint position and feeding this information back to dynamically adjust the viewport. This closed-loop system ensures the displayed image always aligns with the user's actual viewing direction, resolving the AR experience deterioration issue without requiring complex hardware changes to the camera or display modules.
Solution Approach 2:
The patent changes the viewport parameter dynamically based on the tracked viewpoint position. By adjusting which portion of the captured image is displayed according to the user's eye position and viewing distance, the system maintains optimal AR experience across different viewing conditions while keeping the underlying camera and display hardware unchanged.
2Manufacturing precision
If the viewport is fixed according to camera specification, then the system complexity remains low, but the image alignment with background scene deteriorates when user moves
Solution Approach 1:
The eye-tracking module provides continuous feedback on the user's viewpoint position, enabling real-time adjustment of the viewport to maintain precise image alignment with the background scene regardless of user movement or viewing distance changes.
Solution Approach 2:
The patent transforms the static viewport into a dynamic one that automatically adjusts its position and size based on the user's real-time eye position and viewing distance. This dynamic adaptation ensures consistent image alignment without requiring complex mechanical adjustment mechanisms.
3Adaptability or versatility
If the display image does not adapt to viewing distance, then the device operation remains simple, but the immersive experience deteriorates
Solution Approach 1:
The system performs self-service by automatically detecting the user's viewpoint through the eye-tracking module and autonomously adjusting the viewport without requiring any manual intervention. This eliminates the need for complex user operations while achieving adaptive viewing experience across different distances and positions.
Solution Approach 2:
The system performs preliminary action by pre-adjusting the viewport based on predicted or tracked viewpoint positions before the user actually shifts their gaze. This proactive adjustment ensures the displayed content is always optimally positioned, enhancing adaptability without adding operational complexity for the user.
Data Source
AI summary
A portable device includes a display module, an image capture module, and an eye-tracking module. The image capture module is used to capture images steadily. The eye-tracking module is used to track a user's viewpoint position relative to the portable device. Viewport within the images captured by the image capture module is adjusted in accordance with the user's viewpoint position for generating modified images displayed on the display module instantaneously. The modified images shown on the display module can fit the background scene seen by the user, and the augmented reality experience on the portable device may be improved accordingly.