3D Model AR Point Identification Using Virtual Proximity Sensing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality (AR) applications in industry settings, such as quality assurance and maintenance, are cumbersome and prone to errors due to reliance on paper manuals and fixed monitors, which are time-consuming to update when instructions change.
Innovation Solution
A method using a 3D model of a physical object in AR to identify places of interest by aligning the 3D model with the object, tracking user gestures, and employing virtual proximity sensors to determine intersection points, allowing for intuitive marking, categorization, and documentation of these points within the AR environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If paper manuals or fixed monitors with media type manuals are used to assist service technicians, then instructions can be provided, but the process becomes cumbersome and time-consuming
Solution Approach 1:
The patent replaces traditional mechanical information delivery systems (paper manuals, fixed monitors) with an augmented reality system that overlays digital information directly onto the physical object. This substitution eliminates the need for technicians to physically handle manuals or switch between multiple devices, making the information retrieval process instantaneous and context-aware.
Solution Approach 2:
The patent introduces an augmented reality interface as an intermediary between the technician and the physical object. This intermediary layer provides contextual information, instructions, and annotations directly in the technician's field of view, eliminating the need to look away at separate manuals or monitors, thereby reducing time loss and improving ease of operation.
2Adaptability or versatility
If paper manuals or fixed monitors are used, then instructions can be displayed, but updating instructions or material takes a lot of time
Solution Approach 1:
The patent replaces static, physically-bound instruction systems with a digital augmented reality system where instructions are stored as data. This allows instant updates to be deployed remotely without requiring physical redistribution of manuals or reconfiguration of fixed monitors, dramatically reducing the time needed to reflect changes in procedures or materials.
Solution Approach 2:
The patent transforms the instruction system from a static, fixed-state medium (paper or fixed monitor content) to a dynamic, remotely-updatable digital system. Instructions can be modified, updated, or replaced in real-time through software updates, allowing the system to adapt quickly to changing requirements without the delays inherent in traditional manual updating processes.
3Difficulty of detecting and measuring
If traditional AR applications are used with 3D models, then visualization is improved, but identifying places of interest remains complex
Solution Approach 1:
The patent implements a self-service mechanism where the 3D model automatically performs intersection detection and place of interest identification when the user's gesture (e.g., raycast) intersects with the model. The system autonomously determines intersection points and identifies relevant features without requiring the user to manually navigate complex menus or perform sophisticated selection operations, thereby simplifying user interaction while improving detection capability.
Data Source
AI summary
Various embodiments of the teachings herein include a method for identifying at least one place of interest on a physical object within a physical environment using augmented reality and a 3D model of the physical object. The method may include: aligning, in an augmented reality view, the 3D model with the physical object within the physical environment; determining motion data by tracking at least one gesture of a user related to the physical object; and identifying the at least one place of interest by determining at least one intersection point of said at least one gesture and the physical object. The at least one intersection point is determined by using at least one virtual proximity sensor comprised by the 3D model in relation to the motion data.