Extremity-Mounted Sensor Units for Pick-by-Vision Object Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Manual picking processes, particularly those using Pick-by-Vision, face challenges in accurately recognizing objects due to the distance between data glasses and objects, leading to errors in identifying picking steps.

Innovation Solution

A method and system where a mobile unit with a sensor device is attached to the user's extremities, such as the arm, hand, or wrist, to acquire sensor data and determine the execution of picking steps, combined with data glasses for visual, acoustic, or tactile output, ensuring accurate and reliable logging of picking steps with reduced error rates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If pick-by-vision using smart glasses is used, then ease of operation is improved, but measurement precision deteriorates due to distance between glasses and objects

Engineering Contradiction:
Improveconvenience for pickerVSAvoidobject recognition accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system divides the sensing function into two parts: smart glasses for visual information display and mobile units with sensors attached to the picker's extremities for accurate object detection. This segmentation allows each component to perform its optimal function - glasses provide hands-free visual guidance while proximity sensors on hands/arms accurately detect objects during interaction.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Mobile units with sensor devices act as intermediaries between the picker and the objects. These units are attached to the picker's extremities and serve as a bridge that captures sensor data from objects at close proximity, transmitting this data to the system for accurate identification and verification of picked items.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If sensor device is positioned at a distance from objects, then ease of operation is improved, but reliability deteriorates due to recognition errors

Engineering Contradiction:
Improvepicker convenienceVSAvoidpicking step identification accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system transitions from a single-dimension solution (smart glasses at fixed distance from face) to a multi-dimensional solution by attaching sensors to multiple body extremities (hands, arms, legs, feet). This spatial distribution across different dimensions allows the system to maintain close proximity to objects during picking actions while keeping the picker's body positioned comfortably.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The mobile units with sensor devices are pre-positioned on the picker's extremities before the picking process begins. This preliminary placement ensures that sensors are already in optimal position for detecting objects when picking actions occur, eliminating the need for real-time adjustment and ensuring consistent measurement quality throughout the task.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If mobile units are attached to extremities for close proximity sensing, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improveobject detection accuracyVSAvoidsystem structure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The mobile units are designed as multi-functional devices that combine sensor capabilities, data processing, and communication functions in a single integrated unit. Each mobile unit can serve multiple purposes: detecting objects, tracking picker position, verifying picked items, and communicating with both smart glasses and the central system, thereby reducing the need for separate specialized devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system merges the functions of object detection, picker tracking, and verification into integrated mobile units that are attached to the picker's extremities. These unified units combine sensor arrays, processors, and communication modules, reducing overall system complexity compared to having separate systems for each function.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentEP3423988B1Method for technically supporting a manual order picking process
Publication Date: 2022.08.17 TEAMVIEWER GERMANY GMBH
  • EP3423988B1 patent drawingFigure 1~2
  • EP3423988B1 patent drawingFigure 3
  • EP3423988B1 patent drawingFigure 4

AI summary

The invention relates to a method for technically supporting a manual order picking process. As part of the manual order picking process, a user carries out order picking steps. One or more order picking steps specify the respective removal of one or more objects (5) from at least one storage location by means of the user and/or one or more order picking steps specify the respective deposit of one or more objects at at least one storage location by means of the user. A sensor device (RF) in a mobile unit (2) detects sensor data from which the execution of a respective order picking step is ascertained. The mobile unit (2) is supported on an arm, a hand, a foot, or a leg of the user via a securing means. Furthermore, data which is based on the sensor data of the sensor device (RF) is transmitted via a wireless data interface (WM, BM) of the mobile unit (2), whereupon a managing server (1) is informed of the execution of the respective order picking step. In the method, further information on the manual order picking process is output to the user in an at least partly visual manner via data glasses (3).