Semantic Warehouse Mapping With Fiducials for Robotic Picking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current robotic navigation systems in warehouse order-fulfillment are inefficient in picking items from shelves due to technical difficulties in robotic manipulation, leading to increased human operator involvement and reduced efficiency.

Innovation Solution

Implementing a semantic mapping system using fiducial markers and SLAM navigation, where robots communicate with human operators to retrieve items, and utilize laser-radar and camera data to create and navigate through a map of the warehouse, correlating bin locations with fiducial IDs to efficiently locate and pick items.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If robotic manipulation is used to pick items from shelves, then automation and productivity are improved, but technical difficulties and complexity increase

Engineering Contradiction:
Improveorder-fulfillment efficiencyVSAvoidrobotic manipulation complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces human operators as intermediaries between the robotic navigation system and the items on shelves. The robot navigates autonomously using semantic mapping and SLAM to reach shelf locations, but human operators perform the actual item retrieval and placement tasks. This intermediary approach allows the system to benefit from robotic navigation efficiency while avoiding the technical complexities of fully automated robotic manipulation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If human operators manually pick items in large warehouses, then operational flexibility is maintained, but time consumption and inefficiency increase

Engineering Contradiction:
Improveoperational flexibilityVSAvoidwalking time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent segments the order-fulfillment process into distinct functional components: the robotic navigation system handles autonomous transportation and location navigation using semantic mapping, while human operators handle item retrieval and placement tasks. This segmentation allows each component to optimize for its specific function, with the robot eliminating walking time through autonomous navigation and humans providing operational flexibility for item handling.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If semantic mapping with fiducial markers is implemented, then navigation precision and item location accuracy are improved, but system complexity and mapping infrastructure requirements increase

Engineering Contradiction:
Improvebin location accuracyVSAvoidmapping system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses fiducial markers as simplified copies or representations of physical bin locations. Instead of implementing complex real-time 3D mapping and object recognition systems, the invention places standardized fiducial markers at known bin locations, creating a simplified symbolic representation of the warehouse layout that the robot can easily interpret and navigate using SLAM algorithms.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances the efficiency of the order-fulfillment process by allowing robots to navigate and pick items accurately and quickly, reducing human operator walking time and increasing productivity through precise navigation and task coordination.

Implementation Method 1

a processor configured to receive data from a laser-radar and a camera, the data representing an environment of the warehouse

Methodology Applied
Scientific EffectTime of Flight: Time of Flight

Implementation Method 2

receive data from a laser-radar and a camera, the data representing an environment of the warehouse

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentEP3320497B1Robotic navigation utilizing semantic mapping
Publication Date: 2021.07.21 LOCUS ROBOTICS CORP
  • EP3320497B1 patent drawingFigure 1
  • EP3320497B1 patent drawingFigure 2
  • EP3320497B1 patent drawingFigure 3

AI summary

A method for performing tasks on items located in a space using a robot, the items being located proximate fiducial markers, each fiducial marker having a fiducial identification. The method includes receiving an order to perform a task on at least one item and determining the fiducial identification associated with the at least one item. The method also includes obtaining, using the fiducial identification of the at least one item, a set of coordinates representing a position of the fiducial marker with the determined fiducial identification, in a coordinate system defined by the space. The method further includes navigating the robot to the coordinates of the fiducial marker associated with said determined fiducial identification.