Head-Mounted Display Image Correction for Network Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies for real-time image display on head-mounted displays suffer from delay periods due to communication latency, leading to degraded realism and potential motion sickness, especially with high image quality demands.
Innovation Solution
An image processing apparatus and method that includes position-posture tracking, prediction, and correction to synchronize head-mounted display images with user head movements, and an image data transfer apparatus that predicts and transmits frames based on anticipated head positions and postures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If image data is transmitted via network communication for real-time display, then image quality can be improved through streaming transfer from a server with abundant resources, but a delay time period is produced due to communication latency
Solution Approach 1:
The system performs preliminary actions by predicting future head positions and pre-processing image data in advance. The server predicts the user's head movement trajectory and prepares image frames for anticipated positions before actual movement occurs, thereby reducing the perceived delay while maintaining high image quality through server-side processing resources
Solution Approach 2:
The system dynamically adjusts the display timing and image processing based on real-time head position feedback. By continuously tracking head movement and dynamically modifying the prediction model and image generation timing, the system adapts to varying movement speeds and patterns, optimizing both image quality and response timing
2Reliability
If image display is synchronized with head movement to reduce delay, then realistic sensation is improved, but communication latency between client terminal and server cannot be eliminated
Solution Approach 1:
The system introduces an intermediary prediction model that acts as a mediator between the user's head movement and the server's image generation. The prediction model translates head position into anticipated image requirements, allowing the server to prepare images in advance without waiting for actual movement to occur, thereby reducing latency while maintaining synchronization
Solution Approach 2:
The server performs preliminary image processing and preparation based on predicted head positions before the user actually reaches those positions. By anticipating movement and pre-generating image frames, the system eliminates communication latency's impact on realistic sensation while maintaining high image quality
Data Source
AI summary
An image forming section of a server predicts a position or a posture of a head of a user wearing a head mounted display at the time of display, and draws an image of a frame of a moving image in a visual field corresponding to the predicted position or posture. A communication section transmits data of the moving image and a prediction value of the position or the posture to an image processing apparatus. An image processing section of the image processing apparatus corrects an image on the basis of a difference between a latest position or posture and the prediction value. A display control section changes a correction target on the basis of the difference.