Augmented Reality Object Selection Using Virtual Lines and Depth Ranges

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality systems face challenges in accurately selecting physical objects at a distance due to limited control over physical objects and difficulty in distinguishing intended objects from grouped or distant items, leading to user frustration and limited functionality.

Innovation Solution

A method that identifies physical objects in a camera feed using object detection techniques, detects user gestures to extrapolate virtual lines from fingers, and performs actions on selected objects by overlaying depth ranges and rendering menus for user interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional object selection methods are used in augmented reality, then the system is simple to implement, but the object selection accuracy deteriorates when objects are at a distance or grouped together

Engineering Contradiction:
Improveobject selection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces depth information as an additional dimension to distinguish objects. By overlaying depth ranges and using depth data from the camera, the system can differentiate between objects at different distances, allowing accurate selection even when objects are grouped together or at a distance, thus resolving the object selection accuracy problem without requiring complex additional hardware

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces virtual lines and depth range overlays as intermediary visual elements between the user and physical objects. These intermediaries help the user understand which object will be selected and provide clear visual feedback, improving selection accuracy while maintaining system simplicity through software-based solutions

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If gesture-based selection is implemented, then user interaction becomes more natural, but the difficulty of detecting intended objects increases due to grouped or distant items

Engineering Contradiction:
Improveuser interaction naturalnessVSAvoidintended object detection difficulty
Core Design Contradiction:
Ease of operationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent implements visual feedback through virtual lines that extend from the user's finger and depth range overlays that highlight selected objects. This feedback mechanism helps users understand which object their gesture will select, making it easier to detect intended objects among grouped or distant items while maintaining natural gesture-based interaction

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

By incorporating depth information displayed through overlaying depth ranges, the system adds a visual dimension that helps users distinguish between objects at different distances. This makes gesture-based selection more reliable when objects are grouped together or at varying distances, reducing the difficulty of detecting intended objects

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If virtual lines are rendered from fingers, then object selection precision improves, but the device complexity increases due to additional rendering and gesture processing

Engineering Contradiction:
Improveselection precisionVSAvoidrendering and gesture processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses the camera feed to serve multiple functions: it provides both the visual display for users and the data source for gesture detection and object identification. By processing the same camera input for multiple purposes, the system achieves precise selection through virtual lines without requiring separate sensors or complex additional hardware, thus limiting the increase in device complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20240096028A1Method and system for augmented-reality-based object selection and actions for accentuation progression
Publication Date: 2024.03.21 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US20240096028A1 patent drawing
  • US20240096028A1 patent drawing
  • US20240096028A1 patent drawing

AI summary

According to one embodiment, a method, computer system, and computer program product for physical object selection within an augmented-reality environment is provided. The present invention may include identifying a plurality of physical objects in a camera feed from an augmented reality device; responsive to detecting one or more gestures of a user within the camera feed, rendering one or more virtual lines extrapolating from one or more fingers of the user within the augmented reality environment; and responsive to the user selecting a physical object of the plurality of physical objects, performing one or more actions with respect to the selected physical object.