Virtual Pointer for 3D Object Selection in AR

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality systems for controlling objects in real spaces lack intuitive and efficient methods for object selection and control, particularly in complex environments, where virtual objects are not necessarily aligned with real objects and require precise positioning and orientation for effective interaction.

Innovation Solution

A method and system that utilize a virtual pointer with depth effects, generated from the position and orientation of an operator control device, to select and control objects in real spaces, allowing for navigation and control through augmented reality interfaces, enabling selective control operations and visualization of object components.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If virtual objects are placed in a map of real space without alignment requirements, then the system is easier to implement, but the precision of object selection and control deteriorates

Engineering Contradiction:
Improveease of system implementationVSAvoidprecision of object selection
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent extends the selection mechanism from 2D screen space to 3D physical space by introducing depth-based selection. The selection ray is extended into the third dimension (depth), allowing objects to be selected based on their spatial position in 3D space rather than just 2D projection. This resolves the contradiction by maintaining implementation simplicity while achieving precise 3D object selection through depth information.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces a selection ray as an intermediary element that connects the user's gaze direction with the virtual objects in 3D space. This selection ray acts as a mediator that translates the 2D gaze position into 3D object selection, enabling precise object control without requiring complex alignment mechanisms between virtual and real objects.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If a virtual pointer with depth effect is generated from operator control device position and orientation, then the precision of object selection improves, but the device complexity increases

Engineering Contradiction:
Improveprecision of object selectionVSAvoidcomplexity of control system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent makes the operator control device multi-functional by enabling it to serve both as a display device (showing virtual objects) and as a sensing device (detecting position and orientation). This eliminates the need for separate control devices and sensors, reducing overall system complexity while achieving precise 3D object selection through the generated virtual pointer.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges the display function and control sensing function into a single operator control device. By combining these functions, the system avoids the complexity of coordinating multiple separate devices while still achieving precise object selection through the virtual pointer generated from the unified device's position and orientation data.

Inventive Principle:
Principle #5Merging (Combining)

3Adaptability or versatility

If multiple virtual elements are linked to real objects in complex environments, then the versatility of the system improves, but the difficulty of detecting and measuring object positions increases

Engineering Contradiction:
Improveversatility of object controlVSAvoiddifficulty of position detection
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent implements a feedback mechanism where the system continuously detects the operator control device's position and orientation, generates an updated virtual pointer based on this feedback, and uses it to select and control virtual objects. This closed-loop feedback enables the system to handle complex environments with multiple virtual elements by constantly adapting the selection ray to the current device state, making position detection more reliable.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10789775B2Method for controlling an object
Publication Date: 2020.09.29 BECKHOFF AUTOMATION GMBH
  • US10789775B2 patent drawing
  • US10789775B2 patent drawing
  • US10789775B2 patent drawing

AI summary

Method for controlling an object, wherein the object is arranged in the real space and is linked to at least one virtual element of a character space, wherein the object, a depiction device, an operator control device and/or a control device are functionally connected to one another, having the steps of ascertaining a position and an orientation of the operator control device and/or of the depiction device in relation to the object, generating a virtual pointer from the ascertained position and the ascertained orientation of the operator control device and/or of the depiction device, selecting the object by means of the virtual pointer, depicting the object, augmented with the at least one element of the character space, by means of the depiction device, and/or controlling the object by means of the operator control device.