HMD Camera Object Staring Detection for Contextual Display Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional head-mounted displays (HMDs) struggle to effectively provide information based on the wearer's interaction with others, often displaying inappropriate or unwanted information due to their reliance on the wearer's gaze alone, leading to inefficiencies in communication situations.
Innovation Solution
An HMD equipped with a camera unit and processor that detects the staring state of a person relative to the wearer, allowing for the display of different information images based on the detected state, including varying information amounts and locations, and maintaining image display for a predetermined period to prevent frequent changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the HMD displays information based only on the wearer's eye gaze, then the system is simple to control, but the information provided becomes inappropriate during communication situations
Solution Approach 1:
The patent introduces an intermediary detection mechanism (camera and processor) that detects the staring state of objects in the environment. This intermediary system provides additional context about the wearer's surroundings and communication state, enabling the HMD to select appropriate information to display based on both gaze direction and environmental context, thereby resolving the contradiction between control simplicity and information appropriateness
Solution Approach 2:
The system implements feedback by continuously monitoring the wearer's gaze direction and the staring states of detected objects. Based on this feedback, the processor dynamically adjusts which information is displayed, ensuring that information is only provided when appropriate (e.g., when the wearer is not engaged in communication). This feedback loop resolves the contradiction by adapting information display to real-time situational context
2Loss of information
If the HMD provides information continuously based on gaze, then information availability is high, but the wearer experiences confusion and loss of focus during communication
Solution Approach 1:
The system uses feedback from gaze detection and object state monitoring to dynamically control information display. When the wearer's gaze indicates communication engagement, the system suppresses information display to prevent confusion. This feedback-based control maintains information availability when needed while eliminating harmful effects during communication
Solution Approach 2:
The system takes preliminary anti-action by detecting communication states (through gaze analysis) before providing information. When communication is detected, the system proactively prevents information display that would cause confusion. This preliminary detection and prevention mechanism addresses the harmful effect of wearer confusion before it occurs
3Speed
If the HMD detects and responds to every state change immediately, then responsiveness is high, but the display changes too frequently causing distraction
Solution Approach 1:
The system implements preliminary action by maintaining a predetermined threshold for state changes before triggering a display change. Not every minor state variation triggers immediate response; instead, the system waits for sufficient, sustained state changes that indicate genuine context shifts. This preliminary filtering action maintains appropriate responsiveness while preventing excessive display changes that would cause distraction
Data Source
AI summary
A head mounted display (HMD) is disclosed. The HMD includes a camera unit configured to capture an image; a display unit configured to display an information image; and a processor configured to control the camera unit and the display unit, wherein the processor is further configured to: detect an object using the camera unit, wherein the object has a staring state in which the object substantially stares at a wearer wearing the HMD and an unstaring state in which the object does not substantially stares at the wearer, display a first information image when the object in the staring state is detected, display a second information image when the object in the unstaring state is detected, and wherein the first information image includes at least one of a different amount of displayed information from the second information image and a different displaying location from the second information image.