Head-Mounted Display Sightline Control for Controller-Free Event Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional head-mounted displays (HMDs) require a separate controller for event processing, limiting user interaction to viewpoint changes and necessitating additional input devices like touch pads or game pads.

Innovation Solution

A head-mounted display system that utilizes a sensor unit to measure user motion, computes the line of sight direction, and uses it as an input signal to control elements other than viewpoint, such as image type, output region, and playback speed, without a separate controller, allowing for event processing through sustained or directed line of sight.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a separate controller is used for event processing, then control functionality is achieved, but device complexity and user burden increase

Engineering Contradiction:
Improveuser interaction convenienceVSAvoidcontroller requirement
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent merges the control function into the HMD device itself by utilizing the sensor unit already present for viewpoint control. The sensor unit now serves dual purposes: tracking head motion for viewpoint changes and detecting sustained gaze patterns for event processing, thereby eliminating the need for separate controllers while maintaining full control functionality

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The sensor unit is designed to perform multiple functions: it tracks head motion for viewpoint control and simultaneously detects sustained gaze directions for event processing. This multi-functional approach allows the HMD to handle both navigation and interaction tasks using a single integrated sensor system

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If line of sight is used for control, then ease of operation improves, but measurement precision requirements increase

Engineering Contradiction:
Improveinput method simplicityVSAvoidline of sight detection accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system performs preliminary integration of sensor data to establish baseline head position and gaze direction before detecting event-triggering patterns. By continuously tracking and averaging gaze data over time, the system prepares the measurement foundation needed to accurately distinguish intentional sustained gaze from casual glances

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system incorporates feedback mechanisms where detected line of sight patterns are processed to determine event triggers, and this information can be used to adjust sensitivity parameters and refine future detections. The feedback loop allows the system to learn from measurement patterns and improve precision over time

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10261581B2Head-mounted display controlled by sightline, method for controlling same, and computer program for controlling same
Publication Date: 2019.04.16 FXGEAR CO LTD
  • US10261581B2 patent drawing
  • US10261581B2 patent drawing
  • US10261581B2 patent drawing

AI summary

A head-mounted display (HMD) may comprise: a sensor unit configured to measure the movement of a user wearing the HMD; a display unit configured to display an image; and a control unit configured to calculate the user's sightline direction from a measurement value from the sensor unit and, when the user's sightline direction satisfies a preset condition, control elements of the image other than the viewpoint using the user's sightline as a input signal. When the user's sightline direction satisfies the preset condition, the HMD controls the image, which is displayed on the HMD, using the user's sightline as an input signal, thereby performing event processing and the like without any separate controller.