Gaze-Adaptive Video Data Reduction for HMDs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video systems with head-mounted displays face communication delays and potential video interruptions due to large video data volumes, especially when displaying 360-degree whole-sky videos that require high-definition processing, making it difficult to integrate the video generating device and head-mounted display into a single, portable unit without compromising image quality or user experience.
Innovation Solution
A video system that includes a head-mounted display with an imaging unit to capture the user's gaze direction and a video generating device that adjusts video data volume based on the user's gaze point, reducing data transmission by generating lower-resolution video outside the designated gaze region and dynamically adapting to communication environment changes using a calculation unit and communication evaluation system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If video data is transmitted with high definition quality, then image quality is improved, but communication data volume increases causing delays and interruptions
Solution Approach 1:
The patent applies local quality by transmitting video data with high definition only in the gaze-point region where the user is looking, while reducing data quality in non-gaze regions. This resolves the contradiction by maintaining high image quality where needed (gaze point) while reducing communication data volume elsewhere, preventing delays and interruptions.
2Adaptability or versatility
If 360-degree whole-sky video is transmitted in full resolution, then viewing coverage is improved, but data volume increases leading to delivery interruptions
Solution Approach 1:
The patent transmits 360-degree video data with full resolution only in the current gaze-point region, while using reduced resolution for other regions. This maintains comprehensive viewing coverage capability while significantly reducing data volume to ensure reliable delivery without interruptions.
3Device complexity
If video generating device and head-mounted display are integrated into single unit, then device complexity is reduced, but portability and size requirements make integration difficult
Solution Approach 1:
The patent extracts the video generating device from the head-mounted display, allowing them to be separate units connected via wireless communication. This resolves the contradiction by removing the integration requirement, enabling the head-mounted display to remain lightweight and portable while the video generating device can be placed elsewhere.
4Ease of operation
If wireless communication is used between video generating device and head-mounted display, then device portability is improved, but large video data volume causes transmission interruptions
Solution Approach 1:
The patent reduces video data volume by transmitting high-definition data only in the gaze-point region while using lower resolution elsewhere. This enables reliable wireless transmission by fitting the reduced data volume within available bandwidth, maintaining portability without transmission interruptions.
Data Source
AI summary
Appropriate reduction of transferred data volume is used to deliver interruption-free video to a user, minimizing viewing discomfort. A head-mounted display secured to the head of a user and a video generating device that generates a video for presentation to the user by the head-mounted display are combined in a video system. In the head-mounted display, a presentation unit presents the video to the user, an imaging unit captures an image of the user's eye, the first communication unit sends the captured image to the video generating device, and receives the video from the video generating device. In the video generating device, a second communication unit receives captured images from the head-mounted display and sends a video to the head-mounted-display, a gaze point acquisition unit acquires, based on the captured images, the gaze point of the user in the video, a calculation unit defines a designated region based on the acquired gaze point, and generates the video, wherein the data volume per unit pixel count used for the exterior of the designated region is reduced compared to the data volume used for the interior of the designated region.