AR Reference Overlay for Out-of-View Object Matching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems struggle to adapt to situations where objects out of the user's field of view are needed for comparison or reference, leading to inefficiencies and increased time in tasks requiring tool selection or object matching, especially for less-experienced users.
Innovation Solution
A control system for augmented reality devices that detects when a reference object is out of view and superimposes relevant content, such as images or instructions, to assist users in identifying and selecting the correct tools or objects by analyzing video streams and applying rules based on workflow and user context.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the system only displays documentation for objects currently in the user's field of view, then the system complexity remains low, but the user efficiency decreases when objects needed for comparison are out of view
Solution Approach 1:
The system captures and stores reference images of objects before the user moves away from them. This preliminary action ensures that when the user needs to compare objects or retrieve information about previously viewed objects, the images are already available for immediate display, eliminating the need for the user to return to the original location.
Solution Approach 2:
The system creates digital copies (reference images) of physical objects and displays them through the AR device. This allows the user to view copies of objects that are currently out of the field of view, enabling comparison and information retrieval without physically returning to those objects.
2Productivity
If the system captures and displays reference content for objects out of view, then the user efficiency improves for comparison tasks, but the use of energy increases due to continuous video stream processing
Solution Approach 1:
The system processes the video stream partially by detecting specific objects of interest and capturing reference images only for those objects, rather than continuously processing and storing all video data. This selective approach reduces energy consumption while still providing the necessary reference content for comparison tasks.
Solution Approach 2:
The system automatically detects when objects are out of view and retrieves their reference content without requiring user input or manual intervention. This self-service mechanism ensures that reference images are available when needed while minimizing unnecessary processing and energy usage.
3Adaptability or versatility
If the system provides comprehensive reference content for all objects, then the adaptability to different situations improves, but the device complexity increases
Solution Approach 1:
The system extracts only the necessary reference content (images of objects out of view) from the comprehensive video stream data, rather than processing and displaying all possible information. This extraction approach provides adaptability for comparison situations while keeping the system complexity manageable by focusing on essential functionality.
Data Source
Figure 1a~1b
Figure 1c~1d
Figure 2a~2b
AI summary
Some embodiments are directed to a control system (400) for an augmented reality device (410). The control system may determine a comparison-situation, at least from a received video stream, in which the user is selecting a physical object matching a reference object. Augmented reality content may be generated that indicate reference content.