Head-Mounted Display Menu Navigation via Focal Point Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Wearable virtual reality (VR) head-mounted displays (HMDs) lack effective navigation and control within virtual environments without the need for an independent controller device.

Innovation Solution

Implementing a system that generates positional data using sensors like gyroscopes, accelerometers, and magnetometers to track the focal point within a virtual environment, utilizing a fixation timer to determine when a focal point is within the operational range of a menu navigation element, and executing corresponding functions upon expiration of the timer.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If an independent controller device is used for navigation in VR environments, then navigation and control functionality is achieved, but device complexity and user burden increase

Engineering Contradiction:
Improvenavigation controlVSAvoidcontroller requirement
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent merges the navigation control functionality into the HMD itself by using the display elements as input sensors. The focal point tracking and menu navigation capabilities are integrated directly into the head-mounted display, eliminating the need for separate controller devices. Users interact with the virtual environment through natural head movements and focal point positioning rather than external controllers.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The HMD system performs self-navigation and self-control functions by utilizing its own display elements to detect user intent. The system tracks the focal point automatically and interprets user commands through eye movement and head position data, allowing the device to serve itself as both display and control interface without requiring external input devices.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If focal point tracking is implemented for menu navigation, then controller-less navigation is enabled, but measurement precision requirements increase

Engineering Contradiction:
Improvemenu navigationVSAvoidfocal point detection
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces visual indicators and operational range zones as intermediaries between the user's focal point and the menu selection. Instead of requiring precise direct detection of the focal point, the system displays visual feedback showing the operational range of menu elements, making the measurement process more tolerant and easier to execute accurately.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary actions by displaying visual indicators of the focal point position and operational ranges before final selection is made. This allows users to adjust their focus and ensures accurate detection by providing feedback before the measurement is finalized, reducing precision requirements through iterative adjustment.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables seamless navigation and control within VR environments directly through head movements, eliminating the need for a separate controller and enhancing user interaction with virtual interfaces.

Implementation Method 1

at least one of a gyroscope, magnetometer, and an accelerometer that generate positional data

Methodology Applied
Scientific EffectGyroscope: Gyroscope

Implementation Method 2

at least one of a gyroscope, magnetometer, and an accelerometer that generate positional data

Methodology Applied
Scientific EffectAccelerometer: Accelerometer

Implementation Method 3

at least one of a gyroscope, magnetometer, and an accelerometer that generate positional data

Methodology Applied
Scientific EffectMagnetometer: Magnetometer

Implementation Method 4

a head-mounted display including at least one lens to display a focal point in a virtual environment

Methodology Applied
Scientific EffectRefraction: Refraction

Data Source

PatentUS11693476B2Menu navigation in a head-mounted display
Publication Date: 2023.07.04 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11693476B2 patent drawing
  • US11693476B2 patent drawing
  • US11693476B2 patent drawing

AI summary

A wearable computing device includes a head-mounted display (HMD) that generates a virtual reality environment. Through the generation and tracking of positional data, a focal point may be tracked with respect to one or menu navigation elements. Following the fixated positioning of the focal point over the menu navigation element for a predetermined amount of time, a process corresponding to the menu navigation element is executed.