Handheld Tool Location via SLAM and Visual Markers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing tool location systems in manufacturing environments suffer from low accuracy, inflexibility, and the need for dedicated infrastructure, which is inadequate for dynamic and changing production environments, leading to potential human errors and quality control issues.
Innovation Solution
A tool location system using a camera-equipped handheld tool with SLAM navigation, which determines tool location in both global and local coordinate systems based on images, allowing seamless transition and integration with CAD or pointcloud data, and includes inertial measurement units for enhanced accuracy and flexibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If UWB radio communication systems are used for tool location, then the system can be implemented with existing wireless infrastructure, but the positional accuracy deteriorates to about 50 cm which is insufficient for manufacturing tolerances
Solution Approach 1:
The patent combines multiple location determination methods (UWB radio communication and visual recognition via camera) into a hybrid system. The UWB provides coarse location data while the camera-based visual recognition system provides fine-tuned positional accuracy, merging the advantages of both approaches to achieve both ease of implementation and high precision.
Solution Approach 2:
The patent introduces visual markers and camera-based recognition as an intermediary system between the UWB radio communication and the final position determination. The camera captures images of visual markers attached to the tool and workpiece, using image processing to calculate precise positions, thereby mediating between the low-precision UWB system and the requirement for high manufacturing accuracy.
2Reliability
If dedicated infrastructure is installed for tool location tracking, then the system can provide continuous monitoring capability, but the flexibility to adapt to changing production environments deteriorates
Solution Approach 1:
The patent employs visual markers that can be universally applied to any tool or workpiece without requiring dedicated infrastructure installation. The camera-based recognition system can identify and track multiple different tool types and workpiece configurations using the same general-purpose visual marker technology, providing continuous monitoring capability while maintaining flexibility to adapt to changing production environments.
Solution Approach 2:
The system uses visual markers that are self-contained and do not require external infrastructure for operation. The markers contain all necessary identification and positioning information, and the camera system can independently recognize and process them without needing dedicated tracking infrastructure, enabling the system to adapt flexibly to different production environments while providing reliable monitoring.
3Productivity
If manual handling and mounting steps are performed by human workers, then the system remains flexible and economically viable, but human errors such as mistakes, inaccuracies, and overlooks increase
Solution Approach 1:
The patent implements a feedback system where the camera continuously captures images of the work area, visual markers are recognized and processed, and position determination results are provided back to the control system. This closed-loop feedback enables real-time monitoring and verification of manual operations, allowing the system to detect and alert operators to potential errors while maintaining the economic viability of manual handling.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The invention relates to a tool location system for a handheld tool in a manufacturing environment, wherein the tool is equipped with a camera for capturing images. According to the invention, the location system comprises numerical evaluator means, which is built to determine a tool-location of the tool by a simultaneous location and mapping (SLAM) navigation calculation based on the images from the camera. Therein the tool-location is determined with respect to a global coordinate system in relation to the manufacturing environment from portions of the images which comprise a view of the manufacturing environment and the tool-location is determined with respect to a local coordinate system in relation to the workpiece from portions of the images which comprise a view of the workpiece.