Head-Mounted Display GUI Object Positioning and Sizing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In VR applications using head-mounted displays, GUI objects interfere with virtual representations of users' arms and hands, causing unnaturalness and compromising immersion, either when they appear to penetrate or are completely separated from the virtual space.

Innovation Solution

A program that determines the user's viewpoint and movable range in the virtual space based on the head-mounted display's position, positions GUI objects outside the movable range, and adjusts their size using depth-display size relationships to maintain a constant display size, preventing overlap with virtual objects and ensuring visibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the GUI object is disposed at a position relatively close to the user in the virtual space, then the user can recognize the GUI object, but the GUI object interferes with the virtual objects corresponding to the user's arms and hands, causing unnaturalness and compromising immersion

Engineering Contradiction:
Improverecognizability of GUI objectVSAvoidinterference with virtual body representations
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent positions the GUI object in a different depth dimension relative to the user's movable range. By placing the GUI object behind the user's reachable space (at a position farther from the viewpoint than the movable range), the system resolves the conflict between visibility and interference by utilizing the depth dimension to separate the GUI object from the user's virtual body representations.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Object-affected harmful factors

If the GUI object is displayed completely separated from the virtual space on the display unit, then interference with virtual objects is avoided, but the sense of immersion is considerably compromised

Engineering Contradiction:
Improveinterference with virtual objectsVSAvoidsense of immersion
Core Design Contradiction:
Object-affected harmful factorsVSProductivity

Solution Approach 1:

Instead of separating the GUI object completely from the virtual space (2D display separation), the patent places the GUI object within the virtual space but at a different depth position (3D spatial separation). The GUI object is positioned behind the user's movable range, allowing it to exist in the virtual environment without interfering with the user's virtual body, thus maintaining immersion while avoiding harmful interference.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Object-affected harmful factors

If the GUI object is positioned behind the user's movable range, then interference with virtual body is prevented, but the display size of the GUI object may become too small to be recognized

Engineering Contradiction:
Improveinterference with virtual bodyVSAvoiddisplay size and recognizability
Core Design Contradiction:
Object-affected harmful factorsVSMeasurement precision

Solution Approach 1:

The patent dynamically adjusts the display size parameter of the GUI object based on its depth position. By using correspondence between depth and display size, the system compensates for the reduced apparent size that results from positioning the GUI object behind the user's movable range, ensuring the GUI object remains recognizable despite its distant position.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11036053B2Program, information processing method, information processing system, head-mounted display device, and information processing device
Publication Date: 2021.06.15 CYGAMES INC
  • US11036053B2 patent drawing
  • US11036053B2 patent drawing
  • US11036053B2 patent drawing

AI summary

The present invention is a program executed by a processing device that performs rendering processing of a virtual space including a predetermined GUI object to be displayed on a display unit of a head-mounted display device, the program causing the processing device to execute a step of determining the position of a viewpoint of a user in the virtual space; a step of determining a movable range of the user in the virtual space; a step of determining a position of the GUI object in a region of the virtual space outside the determined movable range; a step of determining, by using a perspective property profile, a size of the GUI object in the virtual space such that the GUI object at the determined position has a constant display size on the display unit; and a step of generating rendering data of the virtual space including the GUI object.