Warehouse Robot Integration via Screen Parsing at Picking Stations
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional picking stations in warehouses require extensive modifications and high costs to integrate pick and place robots, which are labor-intensive and inefficient, leading to significant barriers for adoption due to high initial costs and temporary service interruptions.
Innovation Solution
A parsing system that includes an imaging device to capture visual instructions, processors to generate and transmit functions to robots, and a button-pushing device to indicate completion, allowing robots to perform pick and place tasks without modifying existing warehouse software or hardware, enabling seamless integration of robots into existing picking stations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If pick and place robots are integrated into existing picking stations, then productivity and efficiency are improved, but device complexity and modification requirements increase
Solution Approach 1:
The patent introduces an intermediary system comprising an imaging device, processor, and button-pushing device that mediates between the existing warehouse management software and the robot. This intermediary captures visual instructions from the monitor, processes them through OCR and function generation, and transmits appropriate commands to the robot, thereby bridging the gap without requiring modifications to the existing WS or WCS systems.
Solution Approach 2:
The system creates a visual copy of the pick and place instructions displayed on the monitor by capturing the screen image. The imaging device takes a picture of the monitor display, and the processor extracts the instructional content through OCR, effectively copying the information flow from the human operator interface to the robot control system without altering the original software architecture.
2Adaptability or versatility
If extensive modifications are made to warehouse software and hardware, then robot integration is achieved, but loss of time and service interruption increase
Solution Approach 1:
The system performs preliminary actions by capturing the visual instructions from the monitor before the actual pick and place operation begins. The imaging device continuously monitors the display, and the processor pre-processes the visual information into actionable robot commands, allowing the robot to execute tasks in real-time without waiting for software modifications or system reconfigurations.
Solution Approach 2:
The patent replaces the mechanical system of direct software-hardware integration with an optical-information processing system. Instead of modifying the warehouse management software to communicate directly with the robot, the system uses an imaging device to capture visual information, processes it through OCR and function generation, and transmits commands to the robot, substituting physical integration with information-based mediation.
3Ease of operation
If manual pick and place operations are performed, then operational flexibility is maintained, but productivity and efficiency decrease
Solution Approach 1:
The system enables the robot to serve itself by autonomously interpreting visual instructions from the monitor and executing pick and place operations without human intervention. The imaging device captures the instructions, the processor generates the appropriate robot functions through OCR and algorithmic processing, and the robot executes the tasks independently, maintaining operational flexibility while dramatically increasing productivity.
Solution Approach 2:
The system changes the operational parameters from manual human actions to automated robotic actions while maintaining the same instructional interface. The visual instructions remain unchanged, but the execution speed, precision, and consistency are transformed by replacing human motor skills with robotic actuators controlled by processed visual information.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables the efficient integration of pick and place robots into existing picking stations with minimal modifications, reducing costs and downtime, allowing robots to perform tasks as if done manually, thereby increasing efficiency and lowering operating costs.
Implementation Method 1
an imaging device to capture visual instructions displayed on a monitor
Implementation Method 2
The one or more processors are further configured to perform visual and optical character recognition algorithms on the captured visual instructions to determine instructions included in the visual instructions
Data Source
AI summary
A parsing system includes an imaging device and one or more processors. The imaging device may capture visual instructions displayed on a monitor. The one or more processors may be configured to receive, from the imaging device, the captured visual instructions, generate functions for a robot to perform based on the captured visual instructions, and transmit, to a robot, the functions to perform.


