Machine-Area Sensor Visualization Using Linked Reference Markers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for visualizing sensor information in machine areas, such as robot cells, face challenges in accurately localizing sensors due to complexity and error-prone comparisons of 3D models and issues with optical markers, especially when sensors are partially covered or have protective housings, which complicates setup and maintenance.
Innovation Solution
A method using reference and object markers detected by a mobile device to create a link structure for accurate localization of sensors and objects, allowing for reliable visualization of sensor information through augmented reality, where reference markers are fixed and object markers are attached to sensors or objects, enabling intuitive display of sensor data on a mobile terminal.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If 3D models are used to recognize and localize physical objects, then information about objects can be visualized, but the comparison between 3D models becomes complex and error-prone, especially when objects are partially covered
Solution Approach 1:
The patent introduces optical markers as intermediary elements that are attached to physical objects. These markers serve as mediators between the camera system and the objects, providing easily detectable reference points that simplify the localization process. Instead of comparing complex 3D models of partially visible objects, the system detects simple optical markers whose positions can be precisely determined even when objects are partially covered.
Solution Approach 2:
The patent creates a simplified digital representation by replacing complex 3D model comparisons with detection of optical marker positions. The optical markers act as simplified copies or proxies for the actual objects, allowing the system to determine object locations through marker detection rather than through complex 3D model matching, thereby reducing computational complexity and error rates.
2Measurement precision
If optical markers are attached to objects for visualization, then object localization becomes possible, but markers must be individually created for each object and replaced when defective, which is time-consuming
Solution Approach 1:
The patent employs universal optical marker templates that can be attached to multiple different objects. Instead of creating individual custom markers for each object, standardized marker templates are designed that work across various objects and applications. These universal markers can be freely exchanged between objects without requiring custom creation, significantly reducing the time needed for marker preparation and replacement while maintaining localization accuracy.
3Measurement precision
If optical markers are used for sensor localization, then sensor information can be visualized, but markers must be readable from the mobile device location and sufficient size, which is challenging when sensors have protective housings or are in difficult positions
Solution Approach 1:
The patent addresses the accessibility problem by considering the three-dimensional spatial relationships between markers, sensors, and the mobile device. By properly positioning markers on or near sensors and accounting for spatial transformations, the system ensures markers remain detectable from various viewing angles and distances. This dimensional approach allows markers to be placed on sensors with protective housings or in difficult positions while maintaining readability from mobile device locations throughout the working area.
Data Source
Figure 1
Figure 2a~3
Figure 4~5
AI summary
A method for configuring a visualization device for a machine area (10) in which at least one sensor (18) is arranged is specified, wherein a reference marker (28) is attached in the machine area (10) and an object marker (24) is attached to the sensor (18), at least two markers (24, 28) are detected by a detection device and the two markers (24, 28) are linked abstractly in their neighborhood relationship and/or geometrically in their mutual spatial position.