Wearable 3D Device Positioning for Precise AR Control Placement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Wearable devices struggle to accurately determine the three-dimensional position of controllable devices for rendering user interface controls and distinguishing between similar-looking devices, leading to inefficiencies in user interaction and control.
Innovation Solution
A wearable device captures visual data, generates a 3D map from a map database, and renders user interface objects at the correct position using six-degree-of-freedom positioning, leveraging object recognition and 3D mapping to identify and control specific devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If 2D position detection is used from camera visual data, then device detection is simplified, but the position accuracy in 3D space is insufficient for proper UI rendering
Solution Approach 1:
The patent transitions from 2D position detection to 3D position detection by generating three-dimensional maps from visual data. The system creates 3D representations of the environment and controllable devices, enabling accurate spatial positioning in three-dimensional space rather than limited two-dimensional plane detection.
2Speed
If conventional 2D position detection is used, then processing is faster, but multiple similar-looking devices cannot be distinguished
Solution Approach 1:
The system uses 3D mapping to capture depth information and spatial relationships that differentiate similar-looking devices. By representing devices in three-dimensional space with precise coordinates and environmental context, the system can distinguish between devices that appear identical in 2D views.
3Measurement precision
If 3D mapping is implemented for precise positioning, then UI rendering accuracy improves, but system complexity increases
Solution Approach 1:
The system generates 3D maps and identifies controllable devices in advance during a setup phase. By pre-processing the environment and storing 3D positional information before actual use, the system reduces real-time computational complexity while maintaining high positioning accuracy for UI rendering.
Data Source
Figure 1A
Figure 1B
Figure 1C~1D
AI summary
According to an aspect, a method of identifying a position of a controllable device includes receiving visual data from an image sensor on a wearable device, generating, by an object recognition module, identification data based on the visual data, and identifying, using the identification data, a first three-dimensional (3D) map from a map database that stores a plurality of 3D maps including the first 3D map and a second 3D map, where the first 3D map is associated with a first controllable device and the second 3D map is associated with a second controllable device. The method includes obtaining a position of the first controllable device in a physical space based on visual positioning data of the first 3D map and rendering a user interface (UI) object on a display in a position that is within a threshold distance of the position of the first controllable device.