Head Mounted Display Cursor Maneuvering via Orientation Sensors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality devices require free hands for user interface control, which is impractical in situations where hands are busy, such as outdoor activities, and voice activation may not be suitable in all conditions, affecting usability and safety.

Innovation Solution

A head-mounted display system with an orientation sensor and processor that calculates the display's orientation and estimates pixel positions of real-world features, allowing for hands-free control by displaying and activating functions with a cursor that can be maneuvered using head movements, without the need for additional hardware.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual control methods (touch pads, hand gestures) are used for user interface control, then control precision is improved, but ease of operation deteriorates when hands are busy

Engineering Contradiction:
Improvecontrol precisionVSAvoidease of operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces manual mechanical control methods (touch pads, hand gestures) with a head-mounted display system that uses orientation sensors and cursor manipulation through head movements. This substitution allows users to control the interface without using their hands, resolving the contradiction by maintaining control precision through cursor accuracy while dramatically improving ease of operation when hands are occupied with activities like cycling or cooking.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If voice activation is used for hands-free control, then ease of operation is improved, but reliability deteriorates in conditions unsuitable for voice activation

Engineering Contradiction:
Improveease of operationVSAvoidreliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent introduces an intermediary control method between manual control and voice activation. The head-mounted display with orientation sensor and cursor manipulation serves as a mediator that provides hands-free control through head movements and eye tracking. This intermediary approach maintains reliability in noisy environments where voice activation fails while still providing ease of operation through natural head and eye movements.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If additional hardware is added for hands-free control, then ease of operation is improved, but device complexity increases

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent makes the head-mounted display serve multiple functions: it displays augmented reality content, tracks user orientation through built-in sensors, manipulates the cursor through head movements, and activates interface elements through eye tracking. This multi-functionality approach improves ease of operation by providing comprehensive hands-free control while avoiding device complexity increases that would result from adding separate dedicated control hardware.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables hands-free control of augmented reality systems, maintaining focus on surroundings and enhancing usability and safety by allowing activation of functions through head movements, even in conditions unsuitable for voice activation.

Implementation Method 1

an orientation sensor configured to sense an orientation of the head mount display

Methodology Applied
Scientific EffectGravitation: Gravitation

Implementation Method 2

an orientation sensor configured to sense an orientation of the head mount display

Methodology Applied
Scientific EffectMagnetic field sensing: Magnetic Field

Data Source

PatentUS10635189B2Head mounted display curser maneuvering
Publication Date: 2020.04.28 GETZ ALON
  • US10635189B2 patent drawing
  • US10635189B2 patent drawing
  • US10635189B2 patent drawing

AI summary

An augmented reality system and method including calculating an orientation of a head mounted display, the head mounted display comprising a cursor located fixedly on the display, estimating pixel positions of a real world feature viewable via the head mounted display, and displaying a display element having an assigned function in a fixed position relative to the estimated pixel positions the real world feature, the display element is configured to execute the assigned function when the cursor is maneuvered to be on top of the display element. Additionally, the method including displaying, on a head mounted display a plurality of display elements, each having an assigned function, in a fixed positions relative to real world features viewed via the display, detecting according to sensed orientation when the cursor is maneuvered to be on top of one of the display elements, and executing the corresponding assigned function.