Remote Rendering Adjusts for Vestibulo-Ocular Reflex
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for generating images in extended reality (XR) technologies are inefficient in adapting to dynamic human vision during head and eye movements, leading to reduced image quality and motion-induced discomfort, and fail to adapt to users' visual acuity and perception.
Innovation Solution
A system and method for remote rendering that dynamically adjusts video rendering parameters during Vestibulo-Ocular Reflex (VOR) movements by modifying head pose and gaze direction data to maintain zero total retinal angular velocity, ensuring visual clarity and comfort by detecting the start and end of VOR movements and reverting to default settings.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If existing systems generate images using traditional rendering techniques, then the system complexity remains manageable, but visual clarity and stability deteriorate during head and eye movements
Solution Approach 1:
The system dynamically adjusts rendering parameters based on detected VOR movements. The rendering engine modifies image generation in real-time during head movements, transitioning from static rendering to dynamic adaptive rendering, thereby maintaining visual clarity without requiring complete system redesign
Solution Approach 2:
The system changes rendering parameters such as resolution, frame rate, and rendering priority for different visual fields during VOR movements. By adjusting these parameters dynamically, the system achieves improved visual clarity during head movements without proportionally increasing overall system complexity
2Stability of the object's composition
If existing systems maintain fixed rendering parameters, then the device complexity remains low, but visual stability and comfort worsen during Vestibulo-Ocular Reflex movements
Solution Approach 1:
The system implements feedback loops by detecting VOR movements through sensors and using this information to adjust rendering parameters. This closed-loop control maintains visual stability during head movements by continuously adapting the rendered content to match the user's physiological response
Solution Approach 2:
The system detects VOR movements and proactively adjusts rendering parameters before visual degradation occurs. By anticipating visual instability during head movements and pre-adjusting the rendering pipeline, the system maintains visual stability without requiring complex real-time correction mechanisms
3Manufacturing precision
If the system adapts rendering to dynamic human vision during VOR movement, then visual clarity improves, but the complexity of detecting and measuring VOR movements increases
Solution Approach 1:
The system uses intermediary sensors (accelerometers, gyroscopes, eye trackers) to detect VOR movements indirectly rather than measuring retinal motion directly. These intermediaries translate complex physiological movements into detectable signals, enabling image quality adaptation without requiring direct measurement of VOR parameters
4Adaptability or versatility
If existing systems do not adapt to users' visual acuity and perception, then the ease of operation remains high, but the immersive experience and realistic perception deteriorate
Solution Approach 1:
The system applies different rendering qualities to different regions of the visual field based on user gaze and visual acuity requirements. High-resolution rendering is concentrated on the foveal region where visual acuity is highest, while peripheral regions receive lower resolution, thereby adapting to human visual perception without requiring complete system complexity
Data Source
AI summary
Disclosed is a system with at least one server that is communicably coupled to at least one display apparatus, wherein the at least one server is configured to detect a start of a Vestibulo-Ocular Reflex (VOR) movement (T1) based on a gaze tracking-data and a pose tracking-data received from the at least one display apparatus; control remote rendering of an extended reality video stream at the at least one display apparatus by modifying a head pose data indicated in the pose tracking-data and a gaze direction data indicated in the gaze tracking-data such that a total retinal angular velocity of a focus target approaches a zero value during a VOR movement (T2); detect an end of the VOR movement (T3); and stop the modification and revert video rendering parameters to pre-set default settings after the end of the VOR movement (T3).