AR/VR Display Fixation Coordinate Tracking and Refresh Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In AR/VR systems, fast eye movement can lead to inconsistencies between the fixation coordinate and the image for the fixation region, resulting in incongruous visual effects due to error transmission, which affects the real-time perception of the display.
Innovation Solution
A method where the fixation coordinate is collected at high speed through an image acquisition device and transmitted directly to the display device, combining it with the image coordinate from the system processor to determine abnormal fixation coordinate changes, allowing for separate and efficient refresh and display of images for fixation and non-fixation regions without interference.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If the fixation coordinate is updated at high speed to track fast eye movement, then the real-time perception is improved, but the inconsistency between fixation coordinate and image coordinate increases causing visual incongruity
Solution Approach 1:
The patent applies preliminary action by predicting the fixation coordinate based on historical data before the actual eye movement occurs. The prediction module pre-calculates the expected fixation coordinate, and this predicted value is used to generate the fixation region image in advance, ensuring that the displayed image coordinate matches the actual fixation coordinate even during fast eye movements.
Solution Approach 2:
The patent implements feedback by continuously comparing the predicted fixation coordinate with the actual fixation coordinate detected by the image acquisition device. When a deviation is detected, the system adjusts the prediction model and corrects the fixation region image, ensuring coordinate consistency. This closed-loop feedback mechanism maintains reliability while enabling high-speed tracking.
2Reliability
If the image for fixation region is refreshed continuously to maintain visual accuracy, then the display quality is improved, but the power consumption increases
Solution Approach 1:
The patent segments the display refresh process into two distinct modes: fixation region refresh and non-fixation region refresh. The row scan controller selectively activates only the necessary scanning lines based on the current fixation coordinate, refreshing only the fixation region when needed while skipping the non-fixation region. This segmentation significantly reduces power consumption while maintaining display accuracy in the critical fixation area.
Solution Approach 2:
The patent applies partial action by refreshing only the necessary portion of the display (fixation region) rather than the entire screen. The row scan controller dynamically adjusts the scanning range to cover only the fixation region and its immediate surroundings, performing partial refresh operations that consume less power while maintaining visual accuracy where it matters most.
3Productivity
If separate scanning is implemented for fixation and non-fixation regions to improve efficiency, then the refresh speed is improved, but the device complexity increases
Solution Approach 1:
The patent makes the row scan controller universal by designing it to handle both fixation region scanning and non-fixation region scanning within a single device. The controller dynamically configures its scanning behavior based on the current operation mode, eliminating the need for separate dedicated scanning circuits. This multi-functionality maintains refresh efficiency while reducing device complexity.
Solution Approach 2:
The patent introduces dynamic adaptability in the scanning control mechanism. The row scan controller dynamically adjusts its scanning parameters (such as scanning line range and timing) based on the current fixation coordinate and refresh mode. This dynamic behavior allows the system to optimize refresh efficiency for different scenarios without requiring complex fixed infrastructure, balancing productivity and device complexity.
Data Source
AI summary
A display method, a display device, a display system, and a storage medium are provided. The display method includes: obtaining a first fixation coordinate transmitted by an image acquisition device, and obtaining a second fixation coordinate and a current frame of image that are transmitted by a first processor; performing refresh and display by using the current frame of image; determining a type of the current frame of image, and determining, based on the type, whether the first fixation coordinate changes abnormally; and performing refresh and display by using a previous frame of image for non-fixation region in a case that the first fixation coordinate changes abnormally, and performing refresh and display by using a next frame of image transmitted by the first processor in a case that the first fixation coordinate does not change abnormally.