Wide Field-of-View Image Streaming for Head-Mounted Display Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image display systems experience significant delays due to communication between client terminals and servers, particularly when user interactions are reflected in real-time, leading to degraded immersion and potential motion sickness in head-mounted displays, especially when pursuing high image quality.
Innovation Solution
An image display system that generates and transfers frames of a moving image with a wider field of view than the display field, allowing the client terminal to crop and display only the necessary region, reducing data transmission delays and improving latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If image data is transmitted from server to client terminal by streaming, then high image quality can be achieved, but delay time increases due to communication between client terminal and server
Solution Approach 1:
The patent segments the transmitted image data into multiple regions by generating a wide field of view image and dividing it into multiple display field of view regions. The client terminal then processes only the necessary region based on its display requirements, reducing the amount of data transmitted and processed while maintaining image quality for the displayed region.
Solution Approach 2:
The patent introduces a dimensional approach by generating image data in a wide field of view that encompasses multiple potential display regions. This additional dimensional perspective allows the system to prepare comprehensive image data that can be efficiently cropped and displayed, reducing transmission delays without compromising quality.
2Ease of operation
If user operation is reflected in real-time on display image, then interactivity is improved, but delay time increases due to data exchange between client terminal and server
Solution Approach 1:
The server generates wide field of view image data in advance that includes multiple potential user interaction regions. This preliminary generation of comprehensive image data allows the system to respond more quickly to user operations, as the necessary image regions are already prepared and can be transmitted and displayed with minimal delay.
3Adaptability or versatility
If head-mounted display is used to display panoramic video, then sense of immersion is enhanced, but display delay occurs from head motion
Solution Approach 1:
The patent divides the wide field of view image into multiple display field of view regions, allowing the head-mounted display to process and display only the necessary region based on the user's head position. This segmentation reduces the processing time and data transmission requirements, minimizing display delay while maintaining the immersive experience.
Solution Approach 2:
The system dynamically adjusts which region of the wide field of view image is processed and displayed based on real-time detection of user head motion. This dynamic adaptation ensures that the display always shows the appropriate region with minimal delay, maintaining immersion while reducing latency.
Data Source
AI summary
A server transfers a wide field-of-view image having a field of view wider than the display field of view of a client by multicast streaming or the like. Image processing devices of clients crop regions corresponding to the display fields of view of head-mounted displays and flat panel displays connected to the respective image processing devices to form images compatible with the respective formats and then output the images.