Cross Reality Object Selection Mode Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face difficulty in selecting a desired virtual object from multiple objects arranged at various positions in cross reality systems, as existing technologies do not provide an intuitive and efficient method for navigation and selection.

Innovation Solution

An information processing apparatus with a display control unit, a first acquisition unit for hand position, a second acquisition unit for line-of-sight position, and a control unit that switches between hand operation mode and ray operation mode based on the distance between the hand or controller and line-of-sight position, allowing users to select virtual objects by direct touch or pointing with a beam-like display item.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple virtual objects are arranged at various positions in three-dimensional space, then the system provides rich interactive content, but user operation becomes complicated

Engineering Contradiction:
Improvevirtual object arrangementVSAvoidobject selection
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent implements dynamic switching between two operation modes: hand operation mode for nearby objects and ray operation mode for distant objects. The system automatically determines which mode to use based on the distance between the user's hand and the target virtual object, enabling adaptive interaction that simplifies selection across various spatial configurations

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent introduces a ray (beam-like display item) as an intermediary mechanism for selecting distant virtual objects. When the hand is far from the target object, the ray serves as a mediator that extends the user's pointing capability, making distant object selection as intuitive as nearby object selection

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If a distant virtual object is attracted to a user's hand-reachable range, then the object becomes accessible, but the selection process becomes less intuitive

Engineering Contradiction:
Improveobject accessibilityVSAvoidspatial relationship
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent adds a spatial dimension consideration by introducing distance-based mode switching. Instead of treating all object selections uniformly, the system evaluates the three-dimensional distance between hand and target, automatically selecting the appropriate interaction mode (hand or ray) based on this spatial parameter, thereby preserving spatial relationship information

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS20240231481A1Information processing apparatus, information processing method, and storage medium
Publication Date: 2024.07.11 CANON KK
  • US20240231481A1 patent drawing
  • US20240231481A1 patent drawing
  • US20240231481A1 patent drawing

AI summary

An information processing apparatus includes: a display control unit configured to display a virtual object such that the virtual object is arranged in a three-dimensional space; a first acquisition unit configured to acquire information of a position of an operating body; a second acquisition unit configured to acquire information of a line-of-sight position of the user; and a control unit configured to switch between a first operation mode and a second operation mode, based on a distance between the position of the operating body and the line-of-sight position, and perform control to select the virtual object at the position of the operating body in the first operation mode, and display a display item indicating a direction to which the operating body is directed, and select the virtual object indicated by the display item in the second operation mode.