HMD Virtual Object Positioning with Dynamic Hand Interval Adaptation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In existing virtual object operation systems, it is difficult to maintain the localization of a virtual object with respect to both hands of a user when the interval between the hands changes, leading to a sense of incongruity.

Innovation Solution

A display control device and method that acquires right and left hand position information and controls a head-mounted display to maintain the virtual object's position independently of hand interval changes, ensuring the virtual object's longitudinal direction remains parallel to the line connecting the hands.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the virtual object position is tied to hand positions, then the virtual object can be localized with both hands, but the localization becomes inaccurate when hand interval changes

Engineering Contradiction:
Improvevirtual object localization accuracyVSAvoidhand interval flexibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent divides the virtual object into multiple segments or control points that can be independently positioned. The first hand positions a first portion of the virtual object, while the second hand positions a second portion, allowing the object to maintain proper spatial relationships even when hand distance varies.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts the virtual object's configuration based on the detected hand positions. When hands are at different intervals, the virtual object automatically adapts its scale and orientation to maintain proper localization, transforming from a static to a dynamic positioning system.

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If the virtual object size is fixed, then the object maintains its intended scale, but it cannot adapt to different hand intervals

Engineering Contradiction:
Improvevirtual object size consistencyVSAvoidhand interval adaptation
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The virtual object's size is made dynamic rather than fixed. The system calculates the appropriate scale based on the detected hand positions, allowing the object to maintain proper proportions and localization accuracy across different hand intervals while adapting its overall size accordingly.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the size parameter of the virtual object based on the detected hand interval. By adjusting this parameter dynamically, the system maintains the object's intended scale relative to the user's hands while accommodating different physical configurations.

Inventive Principle:
Principle #35Parameter changes

3Stability of the object's composition

If the virtual object orientation is fixed parallel to hand line, then the object maintains proper alignment, but it cannot accommodate hand movements

Engineering Contradiction:
Improveobject alignment stabilityVSAvoidhand movement flexibility
Core Design Contradiction:
Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The virtual object's orientation is made dynamic, automatically adjusting to remain parallel to the line connecting the user's hands as they move. This maintains proper alignment stability while accommodating continuous hand movement and position changes.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system continuously monitors hand positions and uses this feedback to adjust the virtual object's orientation in real-time, ensuring it remains properly aligned with the hands while accommodating their movements.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11947119B2Display control device, display control method, and recording medium
Publication Date: 2024.04.02 SONY GROUP CORP
  • US11947119B2 patent drawing
  • US11947119B2 patent drawing
  • US11947119B2 patent drawing

AI summary

A display control device includes: an acquisition unit that acquires right hand position information indicating a position of a right hand of a user and left hand position information indicating a position of a left hand of the user of a head mounted display; and a display control unit that: controls the head mounted display to arrange a virtual object having a certain size at the position of the right hand and the position of the left hand based on of the right hand position information and the left hand position information; and controls the head mounted display to change a position of the virtual object independently of a change in a distance between a right hand and a left hand while maintaining a display state of the virtual object.