Display Device Metadata for VR System Trouble Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for virtual reality (VR), mixed reality (MR), and augmented reality (AR) do not effectively mitigate the impact of system troubles such as processing delays, processor freezes, and signal transmission issues.
Innovation Solution
A communication system comprising a display device and an information processing apparatus, where the display device includes a communication unit, a display unit, processors, and memory for acquiring, correcting, and transmitting image data, and the information processing apparatus estimates the position and posture of the display device to generate and transmit images, both attaching metadata for operating and communication states.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If image data is transmitted from the information processing apparatus to the display device, then the image can be displayed on the HMD, but processing delays and system troubles may occur
Solution Approach 1:
The system performs preliminary actions by having the display device continuously detect its own posture and store it, and by having the information processing apparatus continuously estimate the posture and generate corresponding image data in advance. This preparation ensures that when a trouble occurs in the signal transmission path, the display device can immediately display the pre-generated image data without waiting for new data, thereby reducing processing delays and maintaining system reliability.
2Reliability
If the display device operates independently without continuous external apparatus control, then system robustness improves, but synchronization of image data with device posture may deteriorate
Solution Approach 1:
The system implements feedback mechanisms where the display device continuously detects its posture and transmits this information to the information processing apparatus. The apparatus uses this feedback to continuously update and regenerate image data that is synchronized with the current posture. This feedback loop ensures that even when operating independently, the display device maintains accurate posture synchronization while improving system robustness.
3Difficulty of detecting and measuring
If metadata transmission is implemented for system state monitoring, then trouble detection capability improves, but communication data load increases
Solution Approach 1:
The system extracts only the essential and critical state information from the complex system states and transmits it as metadata. Specifically, it extracts posture information from the display device and estimation accuracy information from the information processing apparatus. By selecting only these key parameters for transmission, the system achieves effective trouble detection capability while keeping the communication data load minimal and manageable.
Data Source
AI summary
A display device including a control communication section configured to perform communication with an external apparatus, and a display section configured to display an image. Image data of an image to be displayed on the display unit is acquired from the external apparatus via a network. A video correction section corrects an image to be displayed on the display unit. Metadata of information concerning an operating state and a communication state of the display device is generated and transmitted to the external apparatus in a state attached to data to be transmitted to the external apparatus.