HMD Head Orientation Input for Virtual Object Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users wearing Head Mounted Displays (HMDs) face difficulties in performing input operations other than changing the orientation of the virtual camera, such as selecting options, due to the burden of using hand-held controllers while wearing the device.

Innovation Solution

A system that includes a non-transitory computer-readable recording medium with a program executed by a processor to display a stereoscopic image on the HMD, acquire orientation information, and identify and select optional objects based on a predetermined position relationship between a virtual line and the objects, allowing users to input instructions by changing the orientation of the HMD.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a user wears an HMD and uses hand-held controllers for input operations, then the user can perform various input operations, but the user burden increases and operation convenience deteriorates

Engineering Contradiction:
Improveoperation convenienceVSAvoidinput device requirement
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent extracts the input operation function from external hand-held controllers and integrates it directly into the HMD by using head orientation detection. The system determines input operations based on the direction the HMD is facing, eliminating the need for separate input devices and reducing user burden.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The HMD is given multiple functions: it not only displays the virtual space but also detects user input through head orientation. The same device serves both as the display terminal and the input device, allowing the user to perform various input operations (navigation, selection, confirmation) simply by changing head direction.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If the HMD displays multiple optional objects in the virtual space, then the user can select from more options, but the difficulty of correctly identifying and selecting the intended object increases

Engineering Contradiction:
Improveoption varietyVSAvoidobject identification accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system provides visual feedback by highlighting or changing the appearance of optional objects based on the HMD's orientation. When the HMD faces a particular direction, the corresponding optional object is visually emphasized, helping users quickly identify and select the intended object from multiple options.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent employs color changes or visual differentiation to indicate which optional object corresponds to the current head orientation direction. By changing the visual appearance (such as color or brightness) of objects based on orientation, the system makes object identification more accurate and easier for users.

Inventive Principle:
Principle #32Color changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables users to easily select options within a virtual space displayed on the HMD without the need for additional input devices, reducing the likelihood of incorrect selections and minimizing user burden, especially when multiple options are involved.

Implementation Method 1

displays, on a display provided in the front of the user's eyes, for example, an image that is captured by a virtual camera and is a stereoscopic image to which binocular parallax is applied

Methodology Applied
Scientific EffectBinocular parallax: Parallax

Data Source

PatentUS11861060B2Recording medium for selecting objects using head mounted display, information processing system, and information processing method
Publication Date: 2024.01.02 KONAMI DIGITAL ENTERTAINMENT CO LTD
  • US11861060B2 patent drawing
  • US11861060B2 patent drawing
  • US11861060B2 patent drawing

AI summary

A non-transitory computer readable recording medium having recorded therein a program, the program causes a processor to: cause a display provided on a Head Mounted Display to display a stereoscopic image to which binocular parallax is applied, the stereoscopic image being an image of a virtual space in which optional objects are disposed, and the virtual space being captured by a virtual camera; acquire orientation information on an orientation of the Head Mounted Display; when a predetermined position relationship is established between a virtual line and one optional object from among the optional objects, the virtual line having a direction according to the orientation information and intersecting with the virtual camera, identify the one option image; and when one or more optional objects are identified and a predetermined condition relating to the orientation information is satisfied, select the one or more optional objects.