Synchronizing Light Sources and Optics in XR Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing extended-reality (XR) devices have limited data processing capabilities and fail to properly synchronize their components with changes in user gaze and device pose, resulting in unrealistic and distorted XR environments, which negatively impact user experience.
Innovation Solution
A system and method that includes means for tracking user gaze and device pose, with a processor configured to process gaze and pose data, predict user gaze and device position, and adjust light sources and optics to generate and present realistic XR images by synchronizing light sources and optics based on predicted gaze and pose information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If existing XR devices use basic gaze-tracking and pose-tracking, then the device complexity is reduced, but the manufacturing precision and reliability of the XR environment presentation deteriorate due to inability to properly synchronize components with gaze and pose changes
Solution Approach 1:
The system performs preliminary actions by predicting future gaze positions and device poses before the actual gaze shift or pose change occurs. The processor uses current gaze-tracking data and pose-tracking data to predict upcoming gaze positions and device orientations, allowing the light sources and optics to be pre-adjusted to the correct configuration for the anticipated gaze direction, thereby eliminating synchronization lag and distortion
Solution Approach 2:
The system implements continuous feedback loops where gaze-tracking data and pose-tracking data are constantly monitored, processed to determine current gaze position and device pose, and used to adjust light source configuration and optical element positioning in real-time. This closed-loop feedback ensures that the XR environment remains accurately synchronized with the user's actual gaze and device movement, maintaining high precision despite dynamic changes
2Productivity
If existing XR devices process gaze-tracking data and pose-tracking data in real-time, then the productivity of generating XR images is improved, but the device complexity increases beyond current capabilities
Solution Approach 1:
The system performs preliminary processing by predicting future gaze positions and device poses based on current tracking data, allowing image generation to be prepared in advance for the anticipated gaze direction and device orientation. This predictive approach enables high-speed image generation without requiring complex real-time processing of every gaze and pose change, as the system proactively prepares the next image state based on predicted user behavior
Solution Approach 2:
The system applies partial processing by focusing computational resources only on the specific parameters needed for image generation (gaze position, device pose, light source configuration) rather than processing all possible sensor data. By selectively processing only the critical data elements required for XR image synthesis, the system achieves high productivity without requiring excessive overall processing power
3Reliability
If existing XR devices fail to synchronize light sources and optics with gaze changes, then the device complexity is reduced, but the viewing experience quality deteriorates due to unrealistic and distorted views
Solution Approach 1:
The system performs preliminary adjustment of light sources and optical elements based on predicted gaze positions and device poses before the actual gaze shift or pose change occurs. By proactively configuring the optical system in advance for the anticipated gaze direction, the system ensures that when the user actually shifts gaze or moves the device, the light and optics are already in the correct synchronized configuration, eliminating distortion and maintaining realistic viewing experience
Solution Approach 2:
The system implements continuous feedback by constantly monitoring gaze-tracking data and pose-tracking data, comparing the actual gaze position and device pose with the current light source and optics configuration, and making real-time adjustments to maintain synchronization. This feedback mechanism ensures that the optical system remains accurately aligned with the user's gaze and device orientation, preventing distortion and maintaining high viewing experience quality
Data Source
AI summary
A display apparatus communicably coupled with server arrangement. Display apparatus includes means for tracking user's gaze; means for tracking pose of display apparatus; light source; optical element; and processor. Processor is configured to: process gaze-tracking data; process pose-tracking data; send, to server arrangement, gaze information and apparatus information, server arrangement predicts gaze information and apparatus information, and processes input image to generate image based on predictions; receive, image, predicted gaze information, and predicted apparatus information; determine adjustment required in configuration of light source and optical element prior to displaying image; determine if portion of previous image is to be displayed during adjustment; if yes, display said portion during adjustment; if no, switch off or dim light source during adjustment; display image via light source after adjustment.