Local Image Correction for Low-Latency Head-Mounted Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented and virtual reality systems in amusement park attractions suffer from latency and lag, leading to compromised immersion and potential guest discomfort, such as motion sickness, due to outdated tracking information used in image rendering.
Innovation Solution
A distributed image correction system that includes a local correction device and a server, where updated tracking information is used to apply final corrections to augmented and virtual reality images before transmission to a head-mounted display, enhancing accuracy and reducing latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a centralized server system is used for rendering AR/VR images, then system management and maintenance are simplified, but latency and lag increase due to outdated tracking information
Solution Approach 1:
The patent divides the image correction function into two stages: first stage correction at the server using initial tracking information, and second stage correction at the local correction device using updated tracking information. This segmentation allows the server to handle bulk rendering while the local device handles real-time adjustments, reducing latency without complicating server management.
Solution Approach 2:
The local correction device acts as an intermediary between the server and the head-mounted display. It receives rendered images from the server and applies additional correction using updated tracking information before displaying them, thereby reducing latency while maintaining centralized server management.
2Measurement precision
If real-time tracking information is continuously updated and applied, then image accuracy and immersion are improved, but system complexity and computational load increase
Solution Approach 1:
The correction process is segmented into two distinct stages with different levels of complexity. The first stage at the server handles basic rendering, while the second stage at the local device handles real-time tracking compensation. This segmentation reduces overall system complexity by distributing computational loads appropriately.
Solution Approach 2:
The system applies partial correction at the server level and reserves the full real-time correction capability for the local device. This approach achieves the necessary tracking accuracy while avoiding the excessive computational complexity that would result from implementing full real-time correction at every system level.
3Loss of time
If a distributed correction system with local devices is implemented, then latency is reduced and image accuracy is improved, but system complexity and maintenance difficulty increase
Solution Approach 1:
The system segments correction functions between server and local devices, allowing independent maintenance of each component. The local correction devices can be upgraded or repaired without affecting the central server, and vice versa, thereby reducing overall maintenance difficulty despite the distributed architecture.
Solution Approach 2:
The local correction devices serve as intermediaries that can be independently configured and maintained. Their standardized interface with the server allows for modular replacement and updates without disrupting the entire system, easing maintenance despite the distributed nature of the architecture.
4Device complexity
If traditional centralized rendering is used, then system architecture is simpler, but guest comfort deteriorates due to motion sickness from lag
Solution Approach 1:
The local correction device acts as an intermediary that eliminates lag between tracking information and displayed images by applying real-time corrections locally. This reduces motion sickness without requiring a complete overhaul of the centralized server architecture, maintaining architectural simplicity while improving guest comfort.
Solution Approach 2:
The system performs preliminary rendering at the server using initial tracking information, then applies final real-time corrections at the local device before display. This preliminary action at the server reduces the computational burden on local devices while ensuring final image accuracy, thereby preventing motion sickness without excessive complexity.
Data Source
AI summary
An image correction system may include a head-mounted display, a server, and a local correction device. The head-mounted display includes a display configured to display one or more corrected images and one or more sensors configured to generate initial tracking information and updated tracking information, wherein the initial tracking information is associated with a first time point and the updated tracking information is associated with a second time point subsequent to the first time point. The local correction device is configured to: receive the tracking information from the head-mounted display, transmit the initial tracking information to a server, receive one or more rendered images from the server, generate the one or more corrected images based on the one or more rendered images and the updated tracking information, and transmit the one or more corrected images to the head-mounted display.