3D Virtual Object Selection via 2D Region Expansion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users find it difficult to select desired virtual objects from multiple objects in a three-dimensional virtual space within virtual reality, mixed reality, and augmented reality systems.

Innovation Solution

An information processing apparatus with a display control unit and a selection unit that allows users to select virtual objects by specifying a two-dimensional region with their hand or controller, expanding it in the depth direction to create a three-dimensional selection range, enabling easy identification and selection of virtual objects in a three-dimensional space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If virtual objects are disposed in a three-dimensional space, then the visual field and immersion are improved, but the difficulty of selecting desired virtual objects increases

Engineering Contradiction:
Improvevisual fieldVSAvoidobject selection
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent applies dimensionality change by expanding a two-dimensional selection region specified on the display screen into a three-dimensional selection range in the virtual space. This allows the system to maintain simple 2D user input while effectively selecting objects in 3D space, resolving the contradiction between immersive 3D display and ease of object selection.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Volume of moving object

If multiple virtual objects are disposed in the depth direction, then the three-dimensional space utilization is improved, but the difficulty of detecting and selecting specific objects increases

Engineering Contradiction:
Improvethree-dimensional space utilizationVSAvoidobject detection
Core Design Contradiction:
Volume of moving objectVSDifficulty of detecting and measuring

Solution Approach 1:

The patent introduces a selection region as an intermediary between the user's 2D input and the 3D object selection. This selection region acts as a mediator that translates simple 2D screen coordinates into a 3D selection range, making object detection in depth-oriented 3D space much easier while maintaining full utilization of three-dimensional space.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If a two-dimensional selection region is expanded in the depth direction, then the selection accuracy in three-dimensional space is improved, but the complexity of the selection mechanism increases

Engineering Contradiction:
Improveselection accuracyVSAvoidselection mechanism
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by automatically determining the depth extent of the selection range based on the 2D selection region's position and size. Instead of requiring complex user input for 3D selection, the system changes the selection parameters from 2D coordinates to a 3D range by adding depth information calculated from the 2D input, thereby improving selection accuracy without significantly increasing mechanism complexity.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20240233299A9Information processing apparatus and information processing method
Publication Date: 2024.07.11 CANON KK
  • US20240233299A9 patent drawing
  • US20240233299A9 patent drawing
  • US20240233299A9 patent drawing

AI summary

An information apparatus includes at least one memory and at least one processor which function as: a display control unit configured to perform display control of a virtual object so that the virtual object is disposed in a three-dimensional space which becomes a visual field of a user; and a selection unit configured to set the virtual object included in a selection range in the three-dimensional space, which is selected using an operation body at a position of a hand of the user, to a selected state, wherein the selection range is a three-dimensional range determined by expanding a two-dimensional selected region, which the user specifies using the operation body, in the depth direction.