AR Photo Capture Using Visibility Tracking for Hands-Free Viewing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) devices struggle with inefficient use of resources and user experience when capturing and displaying augmented photos, particularly in industrial manufacturing, due to the need for multiple screenshots from different angles and the inability to update virtual objects after the AR device is set aside.
Innovation Solution
An AR device that tracks the position and visibility of a target object, generates a trigger signal based on visibility criteria, and stores or displays views automatically or manually when visibility meets predetermined thresholds, ensuring optimal image capture and display without requiring constant hand-held operation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the user takes multiple screenshots from different relative positions and angles to ensure adequate display of target device and virtual objects, then the completeness of captured information is improved, but the time consumption and resource usage increase significantly
Solution Approach 1:
The system automatically determines optimal capture positions and angles, and autonomously captures screenshots without requiring user intervention. The AR device self-adjusts based on tracked target object positions, eliminating the need for users to manually take multiple photos from different angles.
Solution Approach 2:
The system continuously tracks the target object's position and uses this feedback to dynamically adjust capture parameters. By monitoring visibility criteria and target position changes, the system adaptively determines when and where to capture images, ensuring information completeness while minimizing unnecessary captures.
2Ease of operation
If the AR device is set aside after taking a screenshot, then the user can perform manufacturing tasks more conveniently, but the displayed image and virtual objects are no longer updated according to position and rotation changes
Solution Approach 1:
The system pre-captures multiple screenshots from different positions and angles before the user needs them. By anticipating future viewing needs and capturing images in advance from optimal positions, the system ensures that relevant information is available when the user sets the device aside, maintaining information accuracy without requiring continuous device handling.
3Measurement precision
If the user requires detailed knowledge of manufacturing tasks to determine optimal relative position for screenshots, then the precision of image capture is improved, but the ease of operation deteriorates
Solution Approach 1:
The AR device automatically determines optimal capture positions and angles by tracking the target object and evaluating visibility criteria. The system self-adjusts without requiring user expertise, eliminating the need for detailed manufacturing task knowledge while maintaining capture precision through automated spatial analysis.
Solution Approach 2:
The system dynamically changes capture parameters (position, angle, timing) based on real-time tracking data and visibility assessments. By automatically adjusting these parameters according to target object position and orientation, the system achieves precise capture without requiring user intervention or specialized knowledge.
Data Source
AI summary
A computer implemented method can include displaying, via a display of an augmented reality (AR) device, views of image data obtained by a camera of the AR device as the AR device is moved by a user; storing each view of a plurality of the displayed views in association with a respective visibility matrix comprising at least one visibility matrix element indicative of visibility of a target object within the each view; retrieving a respective visibility matrix for a plurality of the stored displayed views; selecting a plurality of the stored displayed views based on the retrieved visibility matrices; determining a displaying order of the selected views based on the retrieved visibility matrices; and displaying the selected views via the display of the AR device simultaneously or successively in the determined order.