Dynamic Boundary Representation for Virtual-Real Object Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head-mounted displays (HMDs) struggle to accurately represent the boundary between virtual and real objects, leading to a feeling of strangeness for users due to inaccuracies in recognition and movement of real objects, which affects the immersion and naturalness of virtual object placement in real space.

Innovation Solution

An information processing device with a display control unit that adjusts the boundary representation between virtual and real objects based on recognition information, including shielding displays to present different boundary representations depending on the accuracy and movement speed of real objects, using techniques such as expanding shielding regions, adding effects, or altering visibility to improve user perception.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the boundary between virtual and real objects is represented based on recognition information, then the accuracy of virtual object placement is improved, but the feeling of strangeness increases when recognition accuracy is low

Engineering Contradiction:
Improveboundary representation accuracyVSAvoiduser discomfort
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent changes the parameter of boundary representation based on recognition accuracy levels. When recognition accuracy is high, a first boundary representation is used that clearly distinguishes virtual from real objects. When recognition accuracy is low, a second boundary representation is used that reduces the visual distinction to avoid creating a strange feeling for the user. This dynamic parameter adjustment resolves the contradiction by adapting the boundary representation to the quality of recognition data.

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If shielding display is used to represent boundary between virtual and real objects, then the naturalness of virtual object placement is improved, but the complexity of display control increases

Engineering Contradiction:
Improveuser perception naturalnessVSAvoiddisplay control complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent implements dynamic shielding display control that adjusts the boundary representation based on recognition information in real-time. The display control unit dynamically switches between different shielding display modes (first boundary representation and second boundary representation) depending on the quality of recognition data. This dynamic approach maintains natural user perception while managing complexity through conditional logic based on recognition accuracy thresholds.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11288869B2Information processing device, and information processing method
Publication Date: 2022.03.29 SONY GROUP CORP
  • US11288869B2 patent drawing
  • US11288869B2 patent drawing
  • US11288869B2 patent drawing

AI summary

An information processing device including a display control unit that controls, when recognition information related to recognition based on sensing of a real object includes first recognition information, shielding display representing shielding of a virtual object by the real object such that the shielding display presents a first boundary representation at a boundary between the virtual object and the real object or at a position near the boundary, and controls, when the recognition information includes second recognition information different from the first recognition information, the shielding display such that the shielding display presents a second boundary representation different from the first boundary representation at the boundary or at a position near the boundary.