AR Plane Detection for Essential Feature Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional systems for capturing images of real-life objects for Augmented Reality (AR) and Virtual Reality (VR) applications often fail to cover all essential features, leading to insufficient content for training object detection models, which can result in ineffective object detection.
Innovation Solution
A method and system that detect an AR plane based on feature points, capture poses and coordinate points, and dynamically generate recommendations to adjust the position and orientation of an AR imaging device to ensure all essential features of a target object are captured, using a processor and memory to execute instructions for detecting AR planes, capturing poses, determining distances and angles, and generating recommendations for optimal image capture.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If manual capturing method is used, then user can capture images, but essential features of object are missed
Solution Approach 1:
The system continuously monitors the capturing process by detecting AR planes and calculating coverage metrics, providing real-time feedback to the user about which features have been captured and which are missing. This feedback loop ensures all essential features are captured while guiding the user through the process.
Solution Approach 2:
An AR imaging device with automated plane detection and pose estimation acts as an intermediary between the user and the object. This intermediary automatically identifies essential features, calculates optimal viewing angles, and guides the user, eliminating the need for the user to manually reference documentation.
2Manufacturing precision
If expert manually captures content, then essential features can be identified, but time consumption increases
Solution Approach 1:
The system performs automated plane detection, feature point identification, and coverage analysis without requiring expert intervention. The AR imaging device independently detects AR planes, estimates object poses, and determines which features have been captured, enabling non-experts to efficiently capture all essential features.
Solution Approach 2:
The system pre-identifies essential features and calculates optimal capture angles before the user begins capturing. By preparing the guidance information in advance based on detected AR planes and object characteristics, the system eliminates the need for continuous reference to documentation during the capturing process.
3Reliability
If conventional capturing system is used, then images can be recorded, but content is insufficient for training models
Solution Approach 1:
This principle is not applicable to this patent as the solution does not involve pneumatic or hydraulic systems.
Solution Approach 2:
The system transitions from 2D image capture to 3D spatial understanding by detecting AR planes and estimating object poses in three-dimensional space. This dimensional enhancement ensures comprehensive coverage of essential features from multiple angles and orientations, providing sufficient content for robust model training.
4Ease of operation
If existing recommendation systems are used, then navigation guidance is provided, but standard operating procedures are not followed
Solution Approach 1:
The system integrates multiple functions including AR plane detection, pose estimation, coverage analysis, and guidance generation into a single unified platform. This multi-functional system simultaneously provides navigation guidance and ensures compliance with standard operating procedures by referencing embedded capture requirements.
Data Source
AI summary
The disclosure relates to system and method for generating recommendations for capturing images of a real-life object with essential features. The method includes detecting an Augmented Reality (AR) plane for a target object. The method further includes capturing a set of poses corresponding to the target object and a set of coordinate points in the AR plane. The set of poses includes a tracking marker, and the set of coordinate points indicates a location of the target object. The method further includes determining an instant distance between the AR imaging device and the target object, and an instant angle of the AR imaging device with respect to the target object. The method further includes dynamically generating the recommendations for adjusting a position and an orientation of the AR imaging device with respect to the target object.