Virtual Object Display Control for Penetration Prevention

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing virtual reality and augmented reality systems face usability issues when a user's hand or finger motion results in the operation element appearing to penetrate a virtual object, leading to unnatural interactions and delayed visual responsiveness when trying to move the element away from the object.

Innovation Solution

An information processing apparatus and method that control the display of a first virtual object in a virtual space to remain externally tangent to a second virtual object when the first object's calculated position is inside the second, and gradually align the display position with the reference position when moving away, using a controller to calculate and update the display position based on movement vectors and relative position relationships.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If the operation element is displayed at the calculated position inside the virtual object, then the visual responsiveness is improved, but the penetration effect occurs making the interaction unnatural

Engineering Contradiction:
Improvevisual responsivenessVSAvoidnatural interaction
Core Design Contradiction:
SpeedVSEase of operation

Solution Approach 1:

The patent introduces a virtual wall as an intermediary boundary between the operation element and the virtual object. When the operation element approaches the virtual object, the virtual wall is generated at the contact position to prevent penetration. This mediator allows the element to visually respond quickly (by allowing approach) while maintaining natural interaction (by blocking penetration through the virtual wall mechanism).

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent applies preliminary anti-action by proactively generating a virtual wall before the operation element can penetrate the virtual object. The system detects when the element is approaching the object and preemptively creates the virtual wall at the boundary position, preventing the harmful penetration effect before it occurs while maintaining smooth visual transition.

Inventive Principle:
Principle #9Preliminary anti-action

2Ease of operation

If the operation element is prevented from penetrating the virtual object by displaying it outside, then the natural appearance is improved, but the visual responsiveness is delayed

Engineering Contradiction:
Improvenatural appearanceVSAvoidvisual responsiveness
Core Design Contradiction:
Ease of operationVSSpeed

Solution Approach 1:

The patent resolves this contradiction by transitioning from a binary inside/outside positioning to a three-dimensional solution involving the virtual wall boundary. The operation element can visually approach closely to the virtual object (maintaining responsiveness) while the virtual wall prevents actual penetration (maintaining natural appearance). This dimensional approach allows simultaneous satisfaction of both requirements.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If the operation element is moved away from the virtual object, then the penetration is prevented, but the movement appears unnatural and delayed

Engineering Contradiction:
Improvenatural interactionVSAvoidmovement smoothness
Core Design Contradiction:
Ease of operationVSDuration of action of moving object

Solution Approach 1:

The patent applies preliminary action by pre-positioning the virtual wall at the boundary before the operation element needs to be moved away. When the element contacts the virtual wall, it is naturally blocked and redirected along the surface of the virtual object rather than being forcibly pushed away. This preliminary setup of the virtual wall creates smooth, natural-looking movement without artificial delays or unnatural jumping effects.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11301031B2Information processing apparatus and display control method to control a display position of a virtual object
Publication Date: 2022.04.12 SONY GROUP CORP
  • US11301031B2 patent drawing
  • US11301031B2 patent drawing
  • US11301031B2 patent drawing

AI summary

An information processing apparatus that includes a display control unit that generates display information for controlling a display device to display a first virtual object defined in a virtual space, and a second virtual object different from the first virtual object, and a controller that controls the display device are provided. The controller controls, when determining that a reference position of the first virtual object is located inside the second virtual object, the display device to display the first virtual object at a position at which the first virtual object is externally tangent to the second virtual object, and controls, when determining that an operation to space the first virtual object away from the second virtual object is performed, a display position of the first virtual object such that the reference position and the display position of the first virtual object gradually become the same in association with the operation.