AR-Assisted Forklift Setup via Virtual Environment Marking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The setup of robotic and/or assistive system units in industrial trucks is time-consuming, expensive, and requires specialized personnel, especially when the work environment changes, as existing methods rely on CAD-like software or direct teaching, which can be outdated and labor-intensive.
Innovation Solution
An augmented reality (AR) device is used by an operator to record and virtually mark features in the work environment, allowing direct input of travel paths, storage areas, and driving regulations, with the information transmitted to the industrial truck's system unit for autonomous or semi-automated operation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If CAD-like software or direct teaching methods are used to set up robotic systems, then the system can be configured, but the process becomes very time-consuming and expensive
Solution Approach 1:
The patent replaces manual mechanical teaching methods and CAD software operations with automated optical scanning and image processing. A camera system automatically captures images of the work environment, and image processing algorithms automatically extract feature information, replacing the need for manual path marking and teaching operations.
Solution Approach 2:
The system enables self-configuration by automatically processing images to extract work environment features. The image processing unit automatically identifies storage positions, travel paths, and other relevant features without requiring specialized personnel to manually teach or program the system.
2Manufacturing precision
If specialized personnel are used to set up robotic systems, then configuration accuracy is maintained, but costs increase significantly
Solution Approach 1:
The patent replaces specialized manual teaching operations with automated image capture and processing. The camera system and image processing algorithms perform the configuration task that previously required skilled technicians, thereby reducing both complexity and dependency on specialized personnel.
Solution Approach 2:
The system creates a digital copy of the work environment through image capture and processing. This visual representation is then used for system configuration, replacing the need for specialized personnel to physically measure and program the environment.
3Adaptability or versatility
If map data is created manually or through CAD software, then initial setup is possible, but the data becomes outdated when the work environment changes
Solution Approach 1:
The system transitions from static map data to dynamic image-based representation. The camera system can capture current state images whenever the environment changes, and the image processing automatically extracts updated feature information, ensuring the system always works with current environmental data.
Solution Approach 2:
The system performs preliminary image capture and processing to create an up-to-date representation of the work environment before configuration is needed. This ensures that when the environment changes, the system already has current visual data to work with.
4Reliability
If manual teaching methods are used where each position must be approached, then the system learns the environment, but the process becomes extremely time-consuming
Solution Approach 1:
The patent replaces manual physical teaching operations with automated image capture and processing. The camera system captures images of all positions simultaneously, and image processing algorithms automatically extract feature coordinates and relationships, eliminating the need for step-by-step manual teaching.
Solution Approach 2:
The system creates a visual copy of the work environment through image capture. This image representation contains all position and feature information that would otherwise require manual teaching, allowing simultaneous extraction of multiple position data points.
Data Source
Figure 1~2
AI summary
The invention relates to a method for setting up a robotic and/or assistive system unit (2) of a forklift truck (1) for autonomous and/or semi-automated operation of the forklift truck (1) in a work environment. It is proposed that an operator (4) uses an augmented reality device (AR device) (5) to record the work environment and virtually mark features (12) in the work environment recorded by the AR device (5), and that information about the recording of the work environment with the virtual marks (13) is transmitted to the forklift truck (1) and that this information is used in the robotic and/or assistive system unit (2) of the forklift truck (1) during autonomous and/or semi-automated operation in the work environment. The invention further relates to a system for carrying out the method.