Wearable Video Display Synchronization for Gaze Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video display systems that detect user gaze for generating next frames in 360-degree videos face challenges in accurately capturing eye images and ensuring sufficient time for video data preparation, as imaging is typically done at predetermined intervals without guaranteeing the user's view of the frame.
Innovation Solution
A video display system that includes a wearable device with a reception unit, display unit, irradiation unit, imaging unit, gaze detection unit, and control unit, which uses near-infrared light to image the user's eyes at controlled timing synchronized with video frame display, allowing for accurate gaze detection and extended video data preparation time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If imaging is performed at every predetermined timing, then the imaging unit can capture eye images periodically, but the accuracy of capturing eyes viewing each frame is not guaranteed and the time for video data preparation is insufficient
Solution Approach 1:
The control unit performs preliminary action by controlling the imaging unit to capture eye images at predetermined timings before the actual video data preparation is needed. This allows the system to advance the imaging timing to ensure the user has viewed the frame, thereby guaranteeing measurement precision while managing time effectively for subsequent video data generation.
2Reliability
If imaging is performed at predetermined timing, then the imaging unit operates periodically, but it cannot guarantee that the user has actually viewed the frame being captured
Solution Approach 1:
The control unit implements feedback by monitoring the timing relationship between frame display and imaging. It adjusts the imaging timing based on the displayed frame timing to ensure the user has actually viewed the frame before capture. This feedback mechanism guarantees reliability of frame viewing confirmation while optimizing the timing for efficient video data preparation.
3Measurement precision
If the imaging timing is not synchronized with video frame display, then the imaging unit can operate independently, but the accuracy of capturing eyes viewing the displayed frame is reduced
Solution Approach 1:
The control unit merges the imaging timing control with the video frame display timing by receiving the frame timing information and using it to control when the imaging unit captures eye images. This merging ensures synchronization between frame display and imaging operations, achieving high measurement precision while managing device complexity through integrated timing control.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system accurately images the user's eyes viewing each frame and extends the time for video data preparation by controlling the imaging timing to match the user's viewing, enhancing the generation of video data for next frames.
Implementation Method 1
an irradiation unit that irradiates eyes of a user with near infrared light
Data Source
AI summary
An video display system having room in a generation time of a next frame to be generated on the basis of a gaze direction of the user is provided. A video display system includes a wearable device including a reception unit that receive a video, a display unit that displays the video received by the reception unit, an irradiation unit that irradiates eyes of a user with near infrared light, and an imaging unit that images the eyes of the user viewing the video displayed on the display unit, on the basis of the near infrared light, the user wearing the wearable device and viewing the video; a gaze detection unit that detects a gaze point of the user on the basis of a captured image captured by the imaging unit; and a video generation unit that generates a video to be displayed on the wearable device on the basis of the gaze point detected by the gaze detection unit, and the wearable device includes a control unit that instructs an imaging start timing to the imaging unit so that the imaging of the imaging unit can be executed at a timing at which it is estimated that the user is viewing the frame each time each frame of the video to be displayed on the display unit is displayed.