Eye-Gaze Identification Using HMD Head Tracking and Mobile Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Eyeglass-type HMD devices often lack an image capture device due to weight, processing throughput, or power consumption constraints, or have insufficient image quality, making it difficult to identify an eye-gaze area and provide corresponding additional information.
Innovation Solution
A wearable device worn on the head detects the orientation of the user's head, while a separate mobile device with an image capture device identifies the eye-gaze area using orientation information from both devices, allowing the wearable device to display additional information corresponding to the gaze area without needing an image capture device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If an image capture device is equipped in the HMD device to identify eye-gaze area, then eye-gaze identification capability is improved, but device weight increases
Solution Approach 1:
The image capture device is extracted from the HMD device and placed in a separate mobile terminal (smartphone or other mobile device). The HMD device retains only the orientation detection function, while the mobile terminal performs image capture and eye-gaze area identification. This separation allows the HMD device to remain lightweight while still achieving accurate eye-gaze identification through collaboration with the mobile terminal.
2Measurement precision
If an image capture device is equipped in the HMD device to identify eye-gaze area, then eye-gaze identification capability is improved, but power consumption increases
Solution Approach 1:
The power-intensive image capture and processing functions are extracted from the HMD device and transferred to the mobile terminal, which has greater power capacity. The HMD device only performs low-power orientation detection using sensors, while the mobile terminal handles image capture, processing, and eye-gaze area identification, significantly reducing the HMD device's power consumption.
3Measurement precision
If image capture device is provided in HMD device, then eye-gaze area can be identified, but device complexity increases
Solution Approach 1:
The complex image capture and processing subsystem is extracted from the HMD device and relocated to the mobile terminal. The HMD device is simplified to contain only the orientation detection sensors and basic processing, while the mobile terminal assumes responsibility for image capture, processing, and eye-gaze area identification, thereby reducing the HMD device's structural and functional complexity.
4Measurement precision
If image capture device is equipped in HMD device, then eye-gaze identification is enabled, but processing throughput requirements increase
Solution Approach 1:
The computationally intensive image processing and eye-gaze identification algorithms are extracted from the HMD device and executed on the mobile terminal, which possesses greater processing power and throughput capacity. The HMD device only performs simple sensor data acquisition and transmission, while the mobile terminal handles the heavy processing workload, eliminating throughput bottlenecks.
Data Source
AI summary
An identification system that identifies an eye-gaze area of a user includes a wearable device and a mobile device. The wearable device is an HMD that is worn on the head of the user and detects an orientation of the head of the user. The mobile device is worn on the body of the user separately from the wearable device. The mobile device includes an image capture device, an acquirer, and an identifier. The acquirer acquires first orientation information indicative of an orientation of the head of the user, the orientation being detected by the wearable device, and second orientation information indicative of an orientation of an optical axis of the image capture device. The identifier identified, based on the first and second orientation information acquired by the acquirer, an eye-gaze area of the user from an image captured by the image capture device.