Gesture-Controlled Order Picking System for Warehouse Automation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional storage and picking systems face challenges in accurately monitoring and controlling the movements of operators, leading to uncertainties in accessing correct source and destination locations, and discrepancies in the number of goods manipulated, which affects picking performance due to the need for acknowledgment buttons that require operators to move to stationary devices.
Innovation Solution
A method using a motion sensor system that tracks the operator's movements in real time, employing a position determination system with cameras and light sources to detect hand and forearm positions, and motion sensors to generate control commands through specific gestures, allowing for accurate tracking and monitoring without the need for stationary acknowledgment buttons.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If acknowledgment buttons are used to confirm picking operations, then the system can verify correct manipulation, but operators must move to stationary devices causing interruptions and reduced productivity
Solution Approach 1:
The patent replaces the mechanical interaction of pressing physical acknowledgment buttons with an optical/gestural recognition system. Motion sensors detect hand movements and gestures in the air to confirm picking operations, eliminating the need for operators to physically approach and press stationary buttons. This substitution maintains verification reliability while removing the productivity bottleneck caused by stationary control devices.
Solution Approach 2:
The patent introduces an intermediary gesture recognition system between the operator and the control system. Instead of direct interaction with physical buttons, operators perform gestures in the air that are captured by motion sensors and translated into control commands. This intermediary layer allows verification of manipulation while keeping operators mobile and uninterrupted in their picking workflow.
2Measurement precision
If motion sensor systems are implemented to track operator movements, then picking accuracy can be improved, but system complexity increases
Solution Approach 1:
The motion sensor system serves multiple functions simultaneously: it tracks hand positions for measurement precision, recognizes gestures for control commands, verifies picking operations, and provides real-time feedback. By making the sensor system multi-functional, the patent achieves high measurement precision without proportionally increasing overall system complexity, as the same hardware infrastructure supports multiple capabilities.
Solution Approach 2:
The system uses the operator's own hand movements as the tracking target, eliminating the need for additional markers or attachments on the operator. The motion sensors directly detect natural hand gestures and positions, allowing the operator to serve as their own tracker. This self-service approach reduces system complexity by avoiding additional tracking components while maintaining high measurement precision.
3Ease of operation
If voice recognition is used for communication, then hands-free operation is enabled, but speech recognition accuracy may be insufficient for complex commands
Solution Approach 1:
The patent merges voice recognition with gesture recognition into a hybrid control system. Voice commands provide hands-free operation for simple instructions, while hand gestures provide precise spatial and confirmatory input for complex operations. The combination of these two recognition methods compensates for the limitations of each individual method, achieving both hands-free ease of operation and high command recognition accuracy through complementary input modalities.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enhances picking performance by reducing errors and increasing efficiency, as operators can perform tasks without interruptions, with immediate feedback on correct or incorrect manipulation, and the system can monitor the correct number of goods picked and their orientation, reducing the need for manual counting and stationary controls.
Implementation Method 1
a camera which is set up to record the positions of the light sources
Data Source
Figure 1~2
Figure 3A~3B
Figure 4~5
AI summary
The invention relates to a storage and order-picking system (10) for storing and picking piece goods (40) for an order, comprising: a manual workstation (22) having a defined working area (30), in which an operator (34) is intended to manipulate piece goods (40) with their hands (68) in a predefined manner, which is communicated to the operator (34) visually and/or audibly, in that the operator (34) moves the piece goods (40) within the working area (30); a movement sensor system (60), which registers movements (46; 146), preferably of the hands (68) and/or forearms (66), of the operator (34) in the working area (30) of the workstation (22) and converts said movements into corresponding movement signals (27); a computing unit (26), which has a data connection to the movement sensor system (60) and is equipped to convert the movement signals (27) into corresponding, preferably time-dependent, trajectories in a virtual space which is an image of the working area (30), and where the trajectories are compared with reference trajectories or reference volumes in the virtual space in order to generate and output control signals (28), which inform the operator (34) about correct or erroneous performance of the predefined method of manipulation.