Bin arrangement control method and bin arrangement control device
The bin arrangement control method optimizes the placement of bins relative to picking robots in warehouses by determining the positional relationship based on object characteristics, addressing inefficiencies in conventional picking operations and reducing the time needed for picking tasks.
Patent Information
- Application Number
- PCT/JP2024/012555
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-31
- Filing Date
- 2024-03-28
- Publication Date
- 2024-12-05
AI Technical Summary
Conventional methods for picking operations in warehouses, especially when using multiple picking robots, do not efficiently manage the positional relationship between storage and delivery bins, leading to increased time requirements for picking tasks.
A bin arrangement control method and device that determine the positional relationship between storage and delivery bins based on object information, using a processor to optimize the placement of bins relative to the picking robot, considering factors like object weight, size, and arrangement state to minimize travel time.
This approach significantly shortens the time required for picking operations by optimizing the placement of bins, allowing for more efficient movement of objects between storage and delivery bins, thereby improving overall picking efficiency.
Smart Images

Figure JP2024012555_05122024_PF_FP_ABST
Abstract
Description
Bin arrangement control method and bin arrangement control device
[0001] The present disclosure relates to a bin arrangement control method and a bin arrangement control device.
[0002] A conventional information processing method for assigning picking tasks to picking means is known (see Patent Document 1). The information processing method of Patent Document 1 generates a picking task list for picking tasks of picking items from shelves transported by an automated guided vehicle based on an order list obtained from an external device, calculates the processing capacity for processing the picking tasks included in the picking task list for each picking means based on task logs related to past picking tasks, and assigns the picking tasks included in the generated picking task list to each picking means based on the processing capacity. The picking means is a worker or a robot.
[0003] Japanese Patent Application Laid-Open No. 2023-017393
[0004] The present disclosure provides a bin placement control method and a bin placement control device that can reduce the time required for picking work when a picking robot is used to move an object from a storage bin to an outgoing bin.
[0005] One aspect of the present disclosure is a bin placement control method for controlling the placement of bins relative to a picking robot that performs picking work on objects, wherein the bins include a storage bin in which the object is stored before the picking work and an output bin in which the object is stored after the picking work, and the bin placement control method includes the steps of: acquiring object information regarding the object; determining a positional relationship between the storage bin and the output bin based on the object information; and controlling the placement of the storage bin and the output bin relative to the picking robot based on the determined positional relationship.
[0006] One aspect of the present disclosure is a bin placement control device that includes a processor and controls the placement of bins relative to a picking robot that performs picking work on objects, wherein the bins include a storage bin in which the object is stored before the picking work and an output bin in which the object is stored after the picking work, and the processor acquires object information regarding the object, determines a positional relationship between the storage bin and the output bin based on the object information, and controls the placement of the storage bin and the output bin relative to the picking robot based on the determined positional relationship.
[0007] According to the present disclosure, when a picking operation is performed using a picking robot to move an object from a storage bin to an outgoing bin, the time required for the picking operation can be reduced.
[0008] Schematic diagram showing an example of the appearance of a warehouse management system according to the first embodiment. Diagram showing an example of the environment in a warehouse. Diagram showing an example of a picking station where workers are placed. Diagram showing an example of a picking station where a picking robot that is an orthogonal robot is placed. Diagram showing an example of a picking station where a picking robot that is an articulated robot is placed. Diagram showing an example of the configuration of bins. Diagram showing an example of bins and a transport robot that transports the bins. Diagram showing an image of camera placement. Block diagram showing an example of the configuration of a host management device. Block diagram showing an example of the configuration of a robot control system. Diagram showing an example of picking instruction data. Diagram showing an example of robot configuration information. Diagram showing an example of object information. Diagram showing an example of picking success rate information. Diagram showing an example of takt time information. Diagram showing an example of picking result data. Storage bin location FIG. 1 is a diagram showing an example of a target and output bin coordinates. A flowchart showing an example of the operation of a host management device. A flowchart showing an example of the details of sorting processing. A diagram showing an example of bin movement during picking work. A block diagram showing an example of the configuration of a host management device of the second embodiment. A block diagram showing an example of the configuration of a robot control system of the second embodiment. A diagram showing updated picking instruction data I1A. A diagram showing an image of hand movement times in the X and Y directions according to the relative positions of storage bins and output bins. A diagram showing an image of hand movement speed in the Z direction. A diagram showing an image of object movement according to weight. A flowchart showing an example of the operation of a host management device. A diagram of the inside of an output bin and a storage bin viewed from above. A diagram showing an example of an arrangement pattern for arranging storage bins and output bins in a bin arrangement area. A diagram showing an example of the flow of movement of the hand and object during picking.
[0009] Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed description of well-known matters or redundant description of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.
[0010] (Background to the Development of the First Embodiment) In the information processing method of Patent Document 1, a picking means picks an item from a shelf and places it on a tray, but does not consider the case where the picking means picks an item from a storage bin where the product is stored and stores the item in an outgoing bin where the product is outgoing. Also, while a picking robot is assumed as the picking means, the existence of multiple picking robots is not intended. Therefore, for example, if each picking robot has strengths and weaknesses in picking depending on the characteristics of the product, no consideration is given to which picking robot among multiple picking robots the storage bin should be moved to.
[0011] In the following embodiments, a bin sorting method and a bin sorting device that can improve the efficiency of picking work when a plurality of picking robots are used to move items from storage bins to delivery bins will be described.
[0012] (First embodiment) <Configuration of warehouse management system> Fig. 1 is a diagram showing an example of the configuration of a warehouse management system 5 according to the first embodiment. The warehouse management system 5 includes a warehouse management device 10, a host management device 20, a robot control system 30, a robot device 40, and a camera 60. The robot device 40 includes a transport robot 40C and a picking robot 40P.
[0013] The warehouse management device 10, also known as a Warehouse Management System (WMS), is a device for facilitating logistics within a warehouse. The warehouse management device 10 manages items such as inventory. The warehouse management device 10 has an inventory management function and an inbound / outbound management function. The warehouse management device 10's inventory management function manages information about the status of currently stored inventory. The information about the inventory status includes, for example, the item's storage location, arrival date, quantity, expiration date, color, size, etc. The warehouse management device 10's inbound / outbound management function manages records of the inbound and outbound of items. The warehouse management device 10 can manage inbound and outbound schedules and record actual inbound and outbound activities. The warehouse management device 10 also has a function for facilitating tasks associated with inbound and outbound, such as creating picking lists and slips for items.
[0014] The host management device 20 operates as a warehouse operation management device (Warehouse Execution System: WES) and has warehouse management and warehouse control functions. The host management device 20 is an intermediate device between the warehouse management device 10 and the robot control system 30. The host management device 20 can also grasp on-site operation data such as inventory management, warehousing, and picking in real time. In other words, the host management device 20 is a device for comprehensively controlling people, goods, equipment, etc. in the warehouse.
[0015] The host management device 20 has a work management function and an equipment control function. With its work management function, the host management device 20 visualizes the work status of the robot device 40 or the worker, enabling progress to be grasped in real time. It can also send predetermined instructions to a terminal carried by the worker (e.g., a wearable terminal or an audio terminal) or a terminal installed in the work area (e.g., a display). With its equipment control function, the host management device 20 can control various devices in the warehouse (e.g., the robot device 40 or the camera 60).
[0016] The warehouse management device 10 and the upper management device 20 may be integrated, with one device having the functions of the other.
[0017] The robot control system 30 operates as a warehouse control system (WCS). The robot control system 30 controls various devices in the warehouse (e.g., robot devices 40 or cameras 60) in real time, enabling items to be stored and retrieved on an optimal schedule. The robot control system 30 can monitor the operation of the devices in real time and send predetermined instruction information to the devices.
[0018] The robot device 40 contributes to the automation of various tasks in a warehouse. The robot device 40 includes a plurality of transport robots 40C and a plurality of picking robots 40P.
[0019] The transport robot 40C transports bins 70 in which various items managed in the warehouse are stored. The bins 70 include storage bins 71 in which incoming items are stored and outgoing bins 72 in which outgoing items are stored. Note that the bins 70 may be automated guided vehicles (AGVs) and the bins 70 themselves may operate as the transport robot 40C, i.e., the bins 70 may be self-propelled.
[0020] The picking robot 40P picks various items stored in the storage bin 71 in response to instructions from the robot control system 30, and moves them to the output bin 72 for storage. The picking robot 40P has an arm and a hand. The arm can approach a predetermined position inside the bin 70. It can pick items inside the bin 70. The hand is attached to the tip of the arm. The picking robot 40P may include multiple picking robots 40PA, 40PB, and 40PC of different types.
[0021] The picking robot 40PA is an orthogonal pickup robot. The orthogonal pickup robot can move its arm, for example, in two orthogonal directions along a horizontal plane (e.g., X direction and Y direction) and one direction perpendicular to the horizontal plane (Z direction), and picks up an item by picking it up with its hand. The picking robot 40PA can recognize the surface of the item based on an image captured by a camera 60 using the robot control system 30. The picking robot 40PA is good at picking box-shaped items, for example. Here, "good at" refers to, for example, a high picking success rate or a short takt time, as described below.
[0022] The picking robot 40PB is a two-fingered robot with orthogonal fingers. The two-fingered robot can move its robot arm in the X, Y, and Z directions described above, and picks items using the two fingers of its hand. The picking robot 40PB can recognize the shape of an item based on an image captured by the camera 60 using the robot control system 30. The picking robot 40P is good at picking heavy items, for example.
[0023] The picking robot 40PC is an articulated robot. An articulated robot has multiple rotation mechanisms as multiple joints on its arm, and the rotation mechanisms rotate to allow the robot to approach in various directions. The picking robot 40PC picks items using two fingers of its hand. The picking robot 40PC can recognize the three-dimensional shape of an item based on an image captured by the camera 60 using the robot control system 30. The picking robot 40PC is good at picking items with irregular shapes, for example.
[0024] Note that the strengths of each robot device 40 are merely examples, and the strengths will differ depending on various factors such as the type, size, and hand shape of the robot.
[0025] Therefore, for each type of picking robot 40P, there are items that can be picked and items that cannot be picked. Each type of picking robot 40P can complement the characteristics of other types of picking robots 40P regarding whether they can be picked. For example, a certain item 1 can be picked by the picking robot 40PA, the picking robot 40PB, and the picking robot 40PC. A certain item 2 can be picked by the picking robot 40PA and the picking robot 40PB. A certain item 3 can be picked by the picking robot 40PB and the picking robot 40PC. A certain item 4 can be picked by the picking robot 40PC and the picking robot 40PA.
[0026] In FIG. 1 , a warehouse management device 10 generates picking instruction data based on a picking list and transmits it to a host management device 20. The host management device 20 includes a robot configuration database (robot configuration DB) 20D1 and an object database (object DB) 20D2. The robot configuration database 20D1 stores robot configuration information related to the configuration of the robot. The object database 20D2 stores object information related to the object. The host management device 20 has a distribution function that distributes a bin 70 to one of multiple picking robots 40P based on the picking instruction data from the warehouse management device 10 and an evaluation index related to the picking work. The host management device 20 also controls the operation of the robot device 40 and the camera 60 via a robot control system 30.
[0027] <Warehouse Environment> FIG. 2 is a diagram showing an example of the environment inside the warehouse 50. As shown in FIG.
[0028] The warehouse 50 is, for example, an automated warehouse. Storage shelves 51 for storing bins 70 are arranged within the warehouse 50. The storage shelves 51 are partitioned horizontally or spatially and can store a large number of bins 70. The transport robot 40C receives a transport instruction, for example, from the upper-level management device 20, and transports the bins 70 stored on the storage shelves 51 to one of multiple picking stations PS. The storage shelves 51 store storage bins 71, and the storage bins 71 may be transported from the storage shelves 51 to a predetermined picking station PS at a predetermined timing. The outgoing bins 72 may be located, for example, near the storage shelves 51 or at an outgoing station, and may be transported to a predetermined picking station PS at a predetermined timing. The storage bins 71 and outgoing bins 72 are transported to the picking stations to which they are assigned by the sorting function of the upper-level management device 20.
[0029] A picking robot 40P or a worker 45 is positioned at each picking station PS to perform picking work. Picking station PS0 is a picking station where picking work is performed by a human. Picking station PS1 is a picking station where picking work is performed by a picking robot 40P. Three or more picking stations PS may be provided. Also, multiple picking stations PS1 for the picking robot 40P may be provided.
[0030] When the picking operation at the picking station PS is completed, the transport robot 40C receives a transport instruction from, for example, the upper management device 20, and transports the outgoing bin 72 to a predetermined position (for example, an outgoing station). The outgoing station is, for example, a spatial area where the objects are inspected and packed into boxes for delivery.
[0031] The picking work is the work of picking up an object from a storage bin 71, moving the object 80 to an output bin 72, and placing it in the output bin 72. In other words, the picking work is a pick-and-place work.
[0032] <Configuration of Picking Station> Fig. 3 is a diagram showing an example of picking station PS0 where a worker 45 is stationed. Fig. 4 is a diagram showing an example of picking station PS1 (PS11) where picking robot 40PA or picking robot 40PB, which is an orthogonal robot, is stationed. Fig. 5 is an example of picking station PS1 (PS12) where picking robot 40PC, which is an articulated robot, is stationed.
[0033] As shown in FIGS. 4 and 5 , at picking station PS1 (PS11, PS12) where the picking robot 40P is located, four bins 70 are arranged around the center of the picking robot, two in each of the X and Y directions (i.e., in a 2×2 configuration). The four bins 70 include at least one storage bin 71 and at least one output bin 72. By arranging multiple bins 70 in this 2×2 configuration, the warehouse management system 5 can perform picking operations using other bins 70 even when replacing one bin 70, thereby efficiently performing picking operations and shortening the overall takt time. Note that the bins are not limited to a 2×2 configuration, and may be arranged in a 2×3, 3×2, 3×3, or other configuration, allowing for more bins 70 to be simultaneously arranged around the picking robot 40P.
[0034] <Bin Configuration> FIG. 6 is a diagram showing an example of the configuration of a bin 70. The bin 70 has a substantially rectangular parallelepiped shape, and items can be placed in and removed from above. Therefore, the picking robot 40P and the worker 45 place items in and remove items from the bin 70 from above. FIG. 7 is a diagram showing an example of a bin 70 and a transport robot 40C that transports the bin 70. In FIG. 7, the transport robot 40C moves the bin 70 by pushing or pulling it. However, the bin 70 may be placed on the transport robot 40C and moved. Note that different transport robots 40C may be used for transporting storage bins and for transporting outgoing bins, or the same transport robot 40C may be used.
[0035] <Camera Arrangement> FIG. 8 is a diagram showing an example of the arrangement of the camera 60. The camera 60 is arranged so as to be able to capture images of the inside of the bin 70. The camera 60 is used, for example, to recognize the state inside the bin 70. The camera 60 may be installed in the picking station PS, for example, as in camera 60A, and may be installed inside or near the picking robot 40P. Alternatively, the camera 60 may be installed outside the picking station PS, for example, as in camera 60B. The captured image G1 captured by the camera 60 reflects items stored in, for example, the storage bin 71 or the output bin 72, making it possible to determine how the items are arranged. Furthermore, the captured image G1 captured by the camera 60A reflects the presence or absence of the storage bin 71 or the output bin 72, making it possible to determine whether the storage bin 71 or the output bin 72 has arrived at the destination picking station PS based on the captured image G1. Note that the camera 60 may be installed as a single camera, as in camera 60A, or multiple cameras, as in camera 60B.
[0036] 9 is a block diagram showing an example of the configuration of the host management device 20. The host management device 20 includes a processor 21, a memory 22, an input device 23, a communication device 24, and an input / output interface 25.
[0037] The processor 21 may be configured using, for example, a Central Processing Unit (CPU) or a Digital Signal Processor (DSP). The processor 21 may be configured using various integrated circuits (for example, a Large Scale Integration (LSI) or a Field Programmable Gate Array (FPGA)). The processor 21 realizes various functions by executing programs stored in the memory 22. The processor 21 comprehensively controls each part of the upper management device 20 and performs various processes. The processing by the processor 21 may be, for example, processing in the cloud.
[0038] The processor 21 acquires picking instruction data for instructing the picking work of an object. The processor 21 acquires evaluation indices related to the picking work for each object and each picking robot. The evaluation indices include, for example, a picking success rate indicating the success rate of the picking work for each object and each picking robot, and a takt time, which is the time required for the picking work for each object and each picking robot. The processor 21 allocates a bin 70 to one of the multiple picking robots 40P based on the picking instruction data and the evaluation indices. In this way, the processor 21 allocates a bin 70 capable of storing an object to be picked by the picking robot 40P.
[0039] The memory 22 includes a primary storage device (for example, a random access memory (hereinafter referred to as "RAM") or a read only memory (hereinafter referred to as "ROM")). The memory 22 may include a secondary storage device (for example, a hard disk drive (hereinafter referred to as "HDD") or a solid state drive (hereinafter referred to as "SSD")) or a tertiary storage device (for example, an optical disk or an SD card). The memory 22 may also be an external storage medium or may be detachable from the upper management device 20. The memory 22 stores various data, information, programs, logs, etc. The memory 22 has a robot configuration database 20D1 and an object database 20D2.
[0040] The memory 22 stores, for example, picking instruction data, robot configuration information, object information, picking success rate information (described later), takt time information (described later), and picking result data (described later). The memory 22 stores, for example, the robot configuration information and object information in advance. The memory 22 may also store, for example, picking success rate information and takt time information obtained as calculation results, or picking result data obtained from an external device.
[0041] The input device 23 may include various buttons, keys, a keyboard, a touch panel, a microphone, or other input devices. The input device 23 accepts input of various data or information. The input device 23 is operated by, for example, an administrator who manages the upper level management device 20.
[0042] The communication device 24 communicates various data or information according to a wired or wireless communication method. The communication device 24 may be communicatively connected to the network NT. The communication method used by the communication device 24 may include a local area network (Local Area Network), a wide area network (WAN), a mobile phone network, or power line communication. The communication device 24 communicates with external devices (e.g., the warehouse management apparatus 10 and the robot control system 30). For example, the communication device 24 receives picking instruction data from the warehouse management apparatus 10. For example, the communication device 24 transmits the picking instruction data to the robot control system 30 and receives picking result data from the robot control system 30.
[0043] The input / output interface 25 inputs and outputs information and data between the processor 21 , the memory 22 , the input device 23 , and the communication device 24 .
[0044] 10 is a block diagram showing an example of the configuration of a robot control system 30. The robot control system 30 includes a processor 31, a memory 32, an input device 33, a communication device 34, and an input / output interface 35.
[0045] The processor 31 may be configured using, for example, a CPU or a DSP. The processor 31 may also be configured using various integrated circuits (for example, an LSI or an FPGA). The processor 31 realizes various functions by executing programs stored in the memory 32. The processor 31 comprehensively controls each part of the robot control system 30 and performs various processes.
[0046] The processor 31 controls the operation of facilities or equipment in the warehouse (e.g., the transport robot 40C, the picking robot 40P, and the camera 60) via the communication device 34. For example, the processor 31 may control the transport of bins 70 by the transport robot 40C by controlling the travel of the transport robot 40C. The processor 31 may control the picking work by the picking robot 40P by controlling the operation of the arm and hand of the picking robot 40P. The processor 31 may control the picking work based on picking instruction data from the upper management device 20.
[0047] The processor 31 acquires various information via the input device 33 or the communication device 34. For example, the processor 31 acquires captured images captured by the camera 60 and detection information detected by a sensor. The processor may detect various events based on the acquired captured images or detection information. For example, the processor 31 may recognize whether or not a bin 70 has arrived at each picking station PS, the coordinates at which the bin 70 is located in the picking station, and information about the items stored inside the bin 70 (e.g., the presence, shape, weight, material, and size of the item). The processor 31 may generate at least a portion of the picking result data based on the recognized information.
[0048] The memory 32 includes a primary storage device (e.g., RAM or ROM). The memory 32 may include a secondary storage device (e.g., HDD or SSD) or a tertiary storage device (e.g., optical disk or SD card). The memory 32 may also be an external storage medium, or may be detachable from the robot control system 30. The memory 32 stores various types of data, information, programs, etc.
[0049] The input device 33 may include various buttons, keys, a keyboard, a touch panel, a microphone, a sensor, or other input devices. The input device 33 accepts input of various data, information, and the like. The input device 33 may be operated, for example, by an administrator or an operator 45 who manages the robot control system 30. For example, a sensor may be provided for each picking robot 40P inside or around the picking robot 40P. For example, a sensor may be provided for each transport robot 40C inside or around the transport robot 40C.
[0050] The communication device 34 communicates various data or information according to a wired or wireless communication method. The communication method used by the communication device 34 may include a LAN, a WAN, a mobile phone network, or power line communication. The communication device 34 communicates with an external device (e.g., the upper management device 20).
[0051] The communication device 34 is communicatively connected to the camera 60, the picking robot 40P, the transport robot 40C, etc., via wired or wireless communication. The communication device 34 sends imaging instructions to the camera 60 and acquires images captured by the camera 60 from the camera 60. The communication device 34 sends operation instructions to each picking robot 40P for operating the robot arm or hand, etc. The communication device 34 acquires information such as the position, angle, or posture of the robot arm or hand, etc., from each picking robot 40P. The communication device 34 sends a transport instruction for a bin 70 to the transport robot 40C and acquires information such as the current position from the transport robot 40C. The communication device 34 is also connected to a network NT and is communicatively connected to, for example, the warehouse management apparatus 10 via the network NT. The communication device 34 may also be communicatively connected to the camera 60, the picking robot 40P, and the transport robot 40C via the network NT.
[0052] The input / output interface 35 inputs and outputs information and data between the processor 31, the memory 32, the input device 33, and the communication device 34.
[0053] It should be noted that only one robot control system 30 may be provided, or multiple robot control systems 30 may be provided, or one robot control system 30 may be provided for each piece of equipment in the warehouse, such as the robot device 40.
[0054] <Details of Information Handled by Upper Management Device> Next, details of information handled by the upper management device will be described.
[0055] FIG. 11 is a diagram showing an example of picking instruction data I1. The picking instruction data I1 is instruction information related to picking issued by the warehouse management device 10. The picking instruction data I1 includes information on a task (work) ID, a task type, a storage bin ID, an output bin ID, and a time. The task ID is a unique ID (identification information). The task type is information indicating the work content to be performed by the robot device 40 or the worker 45. The work content includes information such as the ID of the object to be picked and the number of objects to be picked for each object. The storage bin ID is the ID of the storage bin 71 transported from the storage shelf 51. The output bin ID is the ID of the output bin. The time information is the time when the picking instruction data was issued.
[0056] FIG. 12 is a diagram showing an example of robot configuration information I2. The robot configuration information I2 is stored in the robot configuration database 20D1. The robot configuration information I2 includes information on a structure type ID, a hand type ID, and robot installation coordinates. The structure type ID is information indicating the type of structure of the picking robot 40P (e.g., Cartesian robot, vertical articulated robot, or other structure type). The hand type ID is information indicating the type of hand (e.g., suction, two-fingered, multi-fingered, or other hand type). The robot installation coordinate information is information indicating the position where the picking robot is installed, and is represented by X and Y coordinates, such as (X, Y) = (12, 3).
[0057] 13 is a diagram showing an example of object information I3. The object information I3 is stored in the object database 20D2. The object information I3 stores information on the shape, material, weight, and size of the object 80. The shape of the object 80 is, for example, a box, a cylinder, a bag, or the like. The material of the object 80 is, for example, paper, metal, plastic, or the like.
[0058] FIG. 14 is a diagram illustrating an example of picking success rate information I4. The picking success rate information I4 includes information on the picking success rate for each object category and each robot ID. The picking success rate indicates the probability that the picking operation of an object has been successful or will be successful. The picking success rate may be stored in advance in the memory 22 for each object category and each robot ID. The picking success rate may be calculated by the processor 21 for each object category and each robot ID and stored as a calculation result in the memory 22. The robot ID is identification information indicating the type of picking robot 40P. The type of picking robot may be determined, for example, by hand type or by a combination of hand type and structural type. The object category is classified according to characteristics of the object 80 that may affect the picking operation (e.g., shape, room, weight, size). Since the object category is determined for each object, it can be said that the picking success rate is determined for each object and each picking robot 40P. Note that the object categories may not be categorized by characteristics, but may be categorized by the type of each object.
[0059] In FIG. 14, information on the picking success rate based on the robot ID (e.g., ID1, ID2, ID3) and the object category (e.g., A, B, C, D) is stored. Robot ID 1 indicates, for example, a suction type. Robot ID 2 indicates, for example, a two-finger type. Robot ID 3 indicates, for example, a three-finger type. Furthermore, picking success rate information I4 in FIG. 14 can be used as a predicted value when picking work is actually performed.
[0060] 15 is a diagram showing an example of takt time information I5. The takt time information I5 includes information on takt time for each object category and for each robot ID. The takt time may be stored in advance in the memory 22 for each object category and for each robot ID. The takt time may be calculated by the processor 21 for each object category and for each robot ID, and stored as the calculation result in the memory 22. Since the object category is determined for each object, it can be said that the takt time is determined for each object and for each picking robot 40P.
[0061] The takt time in FIG. 15 is the time required for a picking operation. The takt time here may be the time from when picking up a specific object 80 from a storage bin 71 begins to when the object 80 is moved and placed in an outgoing bin 72. In other words, it may be the time required to transfer one object from a storage bin 71 to an outgoing bin 72. The takt time here may also be the time from when the first object 80 is picked up from a storage bin 71 to when the last object is placed in an outgoing bin 72, for all objects 80 specified in the picking instruction data. In other words, it may be the time from when the placement in one outgoing bin 72 begins to when the last object is placed in the outgoing bin 72. The takt time here may also be the time from when the picking instruction data is acquired to when the last object is placed in the outgoing bin 72 specified in the picking instruction data. In this case, the takt time may include the time required to move the bin 70.
[0062] 15, information on takt time based on the robot ID (e.g., 1, 2, 3) and the object category (e.g., A, B, C, D) is stored. Furthermore, takt time information I5 in Fig. 15 can be used as a predicted value when picking work is actually performed.
[0063] The object category includes a category of box-shaped and lightweight objects, such as boxes containing medicine. The object category also includes a category of box-shaped and heavy objects, such as cardboard boxes containing plastic bottles of drinking water. The object category also includes a category of bag-shaped and lightweight objects, such as towels. The object category also includes a category of bag-shaped and heavy objects, such as bags containing sugar. The object category also includes a category of irregular shapes, such as bags with irregular shapes.
[0064] For example, if the target object has a simple shape such as a box, object recognition based on captured images is easy, the recognition speed is high, and it is easy to grasp with a hand, so the takt time tends to be short. On the other hand, if the target object has an irregular shape, object recognition based on captured images is difficult, the recognition speed is slow, and approaching with an arm and grasping with a hand must be done carefully, so the takt time tends to be long.
[0065] FIG. 16 is a diagram showing an example of picking result data I6. The picking result data I6 is data obtained as a result of performing a picking operation. The picking result data I6 includes information such as a task ID, a status, a storage bin ID, an output bin ID, storage bin coordinates, output bin coordinates, a robot ID, a bin movement time, a takt time, and a time. The storage bin ID here is the ID of the storage bin 71 transported from the storage shelf 51. The output bin ID here is the ID of the output bin 72 transported from the storage shelf 51. The storage bin coordinates here are the coordinates of the position where the storage bin 71 arrives at the destination picking station PS and is placed there. The output bin coordinates here are the coordinates of the position where the output bin 72 arrives at the destination picking station PS and is placed there. The robot ID here is the ID of the picking robot 40P that performed the picking operation of the target object 80. The bin movement time here is the time required from the time the picking instruction data I1 is received to the time the movement of the bin 70 is completed. The takt time here is the actual time required for the picking operation (pick and place), that is, the actual measured value of the takt time. The time information is information indicating the time when the picking result data I6 was issued.
[0066] The picking result data I6 is derived (for example, detected or calculated) by the robot control system 30 and transmitted to the host management device 20, that is, fed back as information on the result of the picking instruction data. The host management device 20 acquires the picking result data I6 from the robot control system 30 and stores the picking result data I6 in the memory 22. Furthermore, the processor 21 of the host management device 20 may update the picking success rate information and the takt time information based on the fed back picking result data I6.
[0067] 17 is a diagram showing an example of storage bin coordinates and output bin coordinates. In FIG. 17, for example, three storage bins 71 and one output bin 72 are arranged around a picking robot 40PC arranged at a picking station PS12. The storage bin coordinates of the three storage bins 71 are (X, Y) = (20, 2), (20, 3), and (21, 3), respectively. The output bin coordinates of the one output bin 72 are (X, Y) = (21, 2).
[0068] <Operation of Warehouse Management System> FIG. 18 is a flowchart showing an example of the operation of the upper level management device 20.
[0069] The communication device 24 receives picking instruction data from the warehouse management apparatus 10 (S11). The processor 21 calculates the picking success rate and takt time for each object category and each picking robot based on the picking instruction data, robot configuration information, and object information (S12). For example, the processor 21 calculates the picking success rate and takt time when picking the objects specified in the picking instruction data through a simulation. Note that the picking success rate and takt time do not need to be calculated every time, and may be calculated using data recorded in the memory 22.
[0070] The robot control system 30 manages information related to picking work for each picking robot 40P. The processor 31 recognizes the task amount for each picking robot 40P, for example, using a sensor or the like as the input device 33. The task amount is, for example, the amount of tasks to be performed by the picking robot 40P (e.g., the number of objects that need to be picked). For example, the robot control system 30 can recognize the number of remaining objects for each picking robot 40P based on the number of objects instructed to be picked by the picking robot 40P and the number of objects that have already been picked, which is derived based on detection information from the sensor of the picking robot 40P and images captured by the camera 60. The processor 31 transmits information about the task amount for each picking robot 40P to the host management device 20 via the communication device 34. The processor 21 of the host management device 20 acquires information about the task amount for each picking robot 40P via the communication device 24. Note that the processor 21 of the host management device 20 itself may recognize the task amount for each picking robot 40P.
[0071] The processor 21 executes an allocation process to allocate the destination of the bin 70 to one of the plurality of picking robots 40P based on the picking success rate and takt time obtained in step S12 and the task volume (S13). The allocation process is synonymous with the process of determining the picking robot 40P that will perform the picking operation of the target object 80 specified in the picking instruction data. Details of the allocation process will be described later.
[0072] The processor 21 instructs the transport robot 40C to place the storage bin 71 storing the object specified in the picking instruction data on the destination picking robot 40P (S14). In this case, the processor 21 may instruct the transport robot 40C to transport the storage bin 71 from its storage position to a target placement position for the picking work based on the storage bin ID. The target placement position for the storage bin 71 here is the picking station PS where the destination picking robot 40P is located, and is in the vicinity of this picking robot 40P.
[0073] The processor 21 instructs the transport robot 40C to place the output bin 72, which will deliver the target object 80 specified in the picking instruction data, on the destination picking robot 40P (S14). In this case, the processor 21 instructs the transport robot 40C to transport the output bin 72 from its storage position to the target placement position for the picking work, based on the output bin ID, via the communication device 24. The target placement position for the output bin 72 here is the picking station PS where the destination picking robot 40P is located, and is in the vicinity of this picking robot 40P. In steps S13 and S14, the storage bin 71 and the output bin 72 are transported to the same picking station PS.
[0074] The processor 21 determines whether or not the transport of the storage bin 71 and the output bin 72 to the predetermined placement positions has been completed (S15). In this case, the processor 21 may recognize that the transport of the storage bin 71 and the output bin 72 to the predetermined placement positions has been completed by receiving arrival information indicating that the transport robot 40C has arrived at the predetermined placement position via the communication device 24. The processor 21 may also obtain an image from the camera 60 via the communication device 24 and recognize that the transport to the predetermined placement positions has been completed based on the image.
[0075] If the transport of the storage bin 71 and the delivery bin 72 to the predetermined placement positions has not been completed (No in step S15), the processor 21 executes the process of step S15 again. In other words, the processor 21 waits until the transport of the storage bin 71 and the delivery bin 72 to the predetermined placement positions has been completed.
[0076] When the transportation of the storage bin 71 and the output bin 72 to their designated locations is completed (Yes in step S15), the processor 21 instructs the picking robot 40P located at the destination picking station PS via the communication device 24 to perform the picking work of the target item 80 from the storage bin 71 to the output bin 72 (S16).
[0077] At the time of step S14, the processor 21 may have sent a picking operation instruction to the picking robot 40P at the destination (allocation destination) via the communication device 24 and the robot control system 30.
[0078] In this case, the processor 31 of the robot control system 30 may acquire, via the communication device 34, notification information of the completion of transfer from the transfer robot 40C and detection information of the completion of transfer by the transfer robot 40C detected by a sensor serving as the input device 33 (i.e., information that a storage bin 71 or an output bin 72 is detected in the vicinity of the picking robot 40P). Based on the acquired information, the processor 31 determines the timing for the picking robot 40P to pick the target item from the storage bin 71. Then, the communication device 34 may notify the picking robot 40P at the transfer destination of the picking timing. This allows the picking robot 40P to pick the target item at the appropriate time even if a picking operation instruction is issued earlier.
[0079] The picking robot 40P at the delivery destination picks up the object in accordance with the picking instruction from the host management device 20. The picking operation is imaged by the camera 60. The processor 31 of the robot control system 30 determines whether the picking robot 40P has successfully completed the picking operation based on the image captured by the camera 60 (S17). For example, if the processor 31 recognizes, as a result of image recognition of the image captured by the camera 60, that the object stored in the storage bin 71 has been moved and stored in the outgoing bin 72, the processor 31 determines that the picking operation has been successful. The communication device 34 transmits picking result data including picking success / failure information indicating the success or failure of the picking operation to the host management device 20. The processor 21 of the host management device 20 may then determine whether the picking operation has been successful by receiving the picking result data via the communication device 24.
[0080] Alternatively, the robot control system 30 may use a sensor to detect that the picking operation by the picking robot 40P at the destination has been completed, and transmit this detection information to the host management device 20. The processor 21 of the host management device 20 may then receive the picking operation completion information via the communication device 24 and determine that the picking operation has been successful.
[0081] If it is determined that the picking operation of the target object has been successful (Yes in step S17), the processor 21 instructs the transport robot 40C via the communication device 24 to transport the storage bin 71 and the output bin 72 to designated positions (S18). The designated position for the storage bin 71 here is, for example, any position on the storage shelf 51. The designated position for the output bin 72 here is, for example, any position in the output station.
[0082] On the other hand, if it is determined that the picking of the object has failed (No in step S17), the processor 21 proceeds to step S16 until the picking has failed N times. That is, in step S16, the processor 21 repeats the picking of the object a maximum of N times. If the picking of the object has failed N times (No in step S17 for the Nth time), the processor 21 instructs the transport robot 40C via the communication device 24 to transport the storage bin 71 in which the object whose picking has failed is stored and the output bin 72 into which the object will be transferred and stored to the picking station PS0, which is a human work area (S19).
[0083] When the picking operation of the target object fails N times, for example, it is possible that the result of the simulation for deriving the picking index value, which will be described later, in the allocation process of step S13 is incorrect.
[0084] After step S19, the worker 45 picks the object at the picking station PS0. At this time, the processor 21 transmits work instructions for the picking work to a display or the like installed in the work area (picking station PS0) of the worker 45 via the communication device 24. The display receives and displays the work instructions for the picking work. This allows the worker 45 to check detailed information about the picking work of the object.
[0085] FIG. 19 is a flowchart showing an example of the details of the allocation process in step S13 of FIG.
[0086] The processor 21 of the upper management device 20 determines the priority of the picking robots 40P to which the bins 70 are assigned based on the picking success rate and takt time obtained in step S11. In this case, the processor 21 may determine the priority so that the smaller the picking index value (= takt time / picking success rate), which is the value obtained by dividing the takt time by the picking success rate, the higher the priority. The processor 21 may determine the picking robot 40P to which the bins 70 are assigned based on the priority and task volume of the picking robot 40P. Therefore, if the task volume of the picking robot 40P to be assigned (e.g., high priority) is large, the processor 21 may assign the bins 70 to another picking robot 40P that can pick the same or similar objects.
[0087] The processor 21 sets the picking robot 40P having the highest priority as the allocation destination (for example, the picking robot 40P having a suction hand) as the picking robot 40P to be allocated (S21). The processor 21 determines whether the task amount of the picking robot 40P set as the allocation destination is equal to or greater than a predetermined amount (S22).
[0088] If the task amount is less than the predetermined amount (No in step S22), the processor 21 determines the picking robot 40P set as the allocation destination as the allocation destination picking robot 40P (S23).
[0089] If the task volume of the picking robot 40P set as the allocation destination is equal to or greater than a predetermined volume (Yes in step S22), the processor 21 determines whether the picking robot 40P with the next (e.g., second) priority (e.g., a picking robot 40P with two fingers) can pick the object that the set picking robot 40P was scheduled to pick (S24). Whether picking is possible here may be determined, for example, by whether the picking success rate of the same object or objects with similar characteristics is equal to or greater than a predetermined value.
[0090] If the picking robot 40P with the next highest priority is capable of picking (Yes in step S24), the processor 21 sets the picking robot 40P with the next highest priority as the picking robot 40P to which the item is to be assigned (S25). Then, the process proceeds to step S22.
[0091] If the picking robot 40P with the next highest priority is unable to pick the item (No in step S24), the processor 21 determines the picking robot 40P set as the transfer destination as the picking robot 40P to be assigned (S23).
[0092] 18 and 19 , the host management device 20 can determine the picking robot 40P to which the bin 70 is to be assigned based on evaluation indices (e.g., picking success rate, takt time) related to the picking work of each picking robot 40P. Therefore, the host management device 20 can determine the picking robot 40P to which the bin 70 is to be assigned that is estimated to be capable of picking quickly and accurately.
[0093] Furthermore, the host management device 20 can determine the picking robot 40P to which the task is to be assigned, taking into account the task volume. For example, the host management device 20 can set (provisionally determine) the picking robot 40P to which the task is to be assigned based on the picking index value, and then determine (formally determine) the picking robot 40P to which the task is to be assigned, taking into account the task volume of the set picking robot 40P. In other words, if a picking robot 40P has a large task volume to perform, the picking task can be assigned to another picking robot 40P that is capable of picking the target object. Therefore, the host management device 20 can avoid the picking robot 40P initially set as the assigned destination from having to wait for the picking task. Therefore, the host management device 20 can shorten the overall takt time required to pick all of the target objects.
[0094] When the processor 21 of the host management device 20 calculates the above-mentioned picking success rate and takt time, the processor 21 may store the picking success rate and takt time in the memory 22 so that they can be used for the next and subsequent allocation of bins 70. The processor 21 may also store past performance values of the picking success rate and takt time in the memory 22 so that they can be used for the allocation of bins 70 at a later time. In these cases, the host management device 20 does not need to calculate the picking success rate and takt time when allocating bins 70.
[0095] Next, another example of a case where picking work by the picking robot 40P is difficult will be described.
[0096] Here, it is assumed that the picking robot 40P set as the allocation destination is unable to pick up the target item specified in the picking instruction data. Here, it is assumed that none of the picking robots 40P can pick the target item, resulting in a picking success rate of 0%.
[0097] If none of the picking robots 40P has a picking success rate of 0%, the picking index value (takt time / picking success rate) cannot be obtained. Therefore, there is no picking robot 40P with the smallest picking index value. In this case, the processor 21 of the upper management device 20 determines the operator 45 as the picking means to which the robots are assigned.
[0098] The processor 21 instructs the transport robot 40C via the communication device 24 to transport the storage bin 71 and the output bin 72 to the position (picking station PS0) of the operator 45. This process corresponds to step S19 in Fig. 18. Thereafter, the operator 45 picks up the objects at the picking station PS0.
[0099] <Movement of Bin> FIG. 20 is a diagram showing an example of movement of the bin 70 during picking work.
[0100] 20, the multiple storage bins 71 are referred to as "storage bin x" (x is a natural number) and are also simply referred to as "storage x." Also, in FIG. 20, the output bin 72 is also simply referred to as "output." In the initial state, storage bin 1, storage bin 2, storage bin 3, and output bin 72 are arranged in a 2x2 pattern in the bin arrangement area BR around the picking robot 40.
[0101] First, in state A, a transfer (picking operation) from storage bin 1 to output bin 72 is performed.
[0102] In state B, the storage bin 1 from which the object has been picked moves away to the negative side in the X direction, and a new storage bin 4 approaches the position where storage bin 1 was located from the positive side in the Y direction and is placed in the position of the original storage bin 1. While storage bin 1 and storage bin 4 are moving in this manner, a picking operation from storage bin 2 to output bin 72 is performed.
[0103] In state C, the storage bin 2 from which the object has been picked moves away in the positive X direction, and a new storage bin 5 approaches the position where the storage bin 2 was located from the positive Y direction and is placed in the position of the original storage bin 2. While the storage bin 2 and storage bin 5 are moving in this manner, a picking operation is performed from the storage bin 3 to the output bin 72.
[0104] In this manner, in this embodiment, the movement of one or more storage bins 71 and the picking operation using one or more other storage bins 71 and output bins 72 can be performed at the same time, allowing for efficient transport of bins 70 and picking operations. Therefore, the warehouse management system 5 can reduce the total time, including the bin movement time and takt time, when picking items from multiple storage bins 71 to output bins 72.
[0105] The warehouse management system 5 according to the first embodiment can appropriately allocate bins 70 to multiple picking robots 40P. In an automated warehouse having two or more types of picking robots 40P with different configurations capable of picking and movable bins 70, the warehouse management system 5 can improve the coverage of pickable objects and shorten the picking time. In this case, the host management device 20 can minimize one or multiple work takts based on the picking instruction data (such as the storage bin, shipping bin, and quantity of the object) and the robot configuration, robot placement, and robot picking evaluation indicators (grasping success rate and work takt time), and output the data to appropriately control the placement of the movable bins 70.
[0106] (Background to the development of the second embodiment) The information processing method of Patent Document 1 does not take into consideration how the shelves transported by the automated guided vehicle are positioned relative to the picking means performing the picking operation. Therefore, when there are multiple shelves to be used for the picking operation, the time required for the picking operation may be long depending on the relative positions of the multiple shelves.
[0107] In the second embodiment, a bin placement control method and a bin placement control device are described that can shorten the time required for picking work, for example, when performing picking work to move an object from a storage bin to an outgoing bin using a picking robot.
[0108] Second Embodiment In a second embodiment, a warehouse management system controls the placement of each bin transported to a picking station. In this embodiment, the same matters as those described in the first embodiment will not be described or will be simplified.
[0109] <Configuration of Warehouse Management System> The warehouse management system 5A in the second embodiment has the same configuration as the warehouse management system 5 in the first embodiment. Note that the warehouse management system 5A has a host management device 20A instead of the host management device 20, and a robot control system 30A instead of the robot control system 30.
[0110] 21 is a block diagram showing an example of the configuration of the host management device 20A of the second embodiment. The host management device 20A has a configuration similar to that of the host management device 20 of the first embodiment. Note that the host management device 20A includes a processor 21A instead of the processor 21.
[0111] The processor 21A has the same functions as the processor 21 in the first embodiment. The processor 21A also controls the placement of bins 70 for a predetermined picking robot 40P. In this case, the processor 21A determines the positional relationship between the storage bin 71 and the output bin 72 based on, for example, the characteristics of the object, the number and placement state of the items placed in the bin 70, or the placement position of the object in the storage bin 71 and the possible position of the object after movement within the output bin 72. In this case, the processor 21A may also calculate the movement distance of the hand of the picking robot based on the placement position of the object in the storage bin 71 and the possible position of the object after movement within the output bin 72, and determine this positional relationship based on the movement distance of the hand.
[0112] The processor 21A controls the placement of the storage bin 71 and the output bin 72 relative to the picking robot 40P based on the determined positional relationship. For example, the processor 21A determines the placement positions of the storage bin 71 and the output bin 72 relative to the picking robot 40P. These placement positions are the placement positions of the storage bin 71 and the output bin 72 in the bin placement area BR of the picking station PS where the picking robot 40P is located. The placement position of the storage bin 71 is defined by storage bin coordinates, and the placement position of the output bin 72 is defined by output bin coordinates.
[0113] The predetermined picking robot 40P may be the destination picking robot 40P determined in the first embodiment, or may be the destination picking robot 40P determined by another method. The characteristics of the object are, for example, the shape, material, weight, size, etc. included in the object information I3 shown in FIG.
[0114] The processor 21A may acquire captured images from the camera 60 and may acquire various types of detection information from the sensors via the communication device 24. The processor 21A recognizes the arrangement of items inside the bins 70 (e.g., the storage bin 71 and the output bin 72) based on the captured images or the detection information. Note that the recognition of the arrangement of items based on the captured images or the detection information described here may be performed by the robot control system 30A. In this case, the processor 21A may recognize the arrangement of items inside the bins 70 by acquiring recognition information including the results of this recognition from the robot control system 30A via the communication device 24.
[0115] The processor 21A updates the picking instruction data I1 by adding the storage bin coordinates and output bin coordinates based on the determined placement positions of the storage bin 71 and output bin 72, and generates picking instruction data I1A.
[0116] 22 is a block diagram showing an example of the configuration of a robot control system 30A according to the second embodiment. The robot control system 30A has a configuration similar to that of the robot control system 30 according to the first embodiment. However, the robot control system 30A includes a processor 31A instead of the processor 31.
[0117] The processor 31A has the same functions as the processor 31 of the first embodiment. The processor 31A also recognizes, for example, the arrangement state of items in the bins 70 based on the captured image acquired from the camera 60 or the detection information acquired from the sensor. Information on the recognition result is transmitted as recognition information to the upper management device 20A by the communication device 34.
[0118] Figure 23 is a diagram showing updated picking instruction data I1A. In Figure 23, descriptions of items similar to those in picking instruction data I1 shown in Figure 4 are omitted or simplified. Picking instruction data I1A includes information such as a task ID, a task type, storage bin coordinates, output bin coordinates, and time. The storage bin coordinates are the coordinates of the position where storage bin 71 is to be placed upon arrival at the destination picking station PS. The output bin coordinates are the coordinates of the position where output bin 72 is to be placed upon arrival at the destination picking station PS.
[0119] <Operation of Warehouse Management System> Next, an example of the operation of a picking operation in this embodiment will be described.
[0120] The picking operation performed by the picking robot 40P can be broken down into the following processes: The picking operation is performed by the picking robot 40P according to control instructions from the robot control system 30, for example. The picking operation includes, for example, picking processes such as recognizing the contents of the picking instruction data, recognizing the object to be picked, moving the arm (hand) to the object in the storage bin 71, waiting for the vibration of the arm to settle after the movement, and picking (e.g., suction or grasping) the object with the hand. The picking operation also includes, for placing processes such as recognizing the possible placement position of the picked object in the output bin 72, moving the arm (hand) to the possible placement position of the object in the output bin 72, waiting for the vibration of the arm to settle after the movement, and placing (placing) the object in the possible placement position with the hand. The arm movement includes movement in the XY directions and movement in the Z direction (lowering and raising). The hand is attached to the tip of the arm and therefore operates in conjunction with the movement of the arm. The hand can also operate independently of the arm.
[0121] Of the detailed processes in the above picking operation, picking, arm (hand) movement, and placing take relatively long. In this embodiment, the warehouse management system 5 at least reduces the movement time required for the hand holding the object during the picking operation. The hand movement speed is controlled (also called trapezoidal control) so that it gradually increases from zero at the start of the movement to a target speed and gradually decreases from the target speed to zero at the end of the movement. Factors that affect the hand movement time include, for example, how the object is placed in the outgoing bin 72, the size of the object, and the weight of the object.
[0122] The movement speed of the hand in the X and Y directions may differ depending on how the object is placed in the output bin 72. The way the object is placed in the output bin 72 refers to the positional relationship between the placement position of the object in the storage bin 71 and the possible placement position of the object after it is moved in the output bin 72. For example, the longer the distance from the placement position of the object in the storage bin 71 to the possible placement position of the object in the output bin 72, the longer the movement distance of the hand in the X and Y directions and the longer the movement time of the hand in the X and Y directions. On the other hand, the shorter the distance from the placement position of the object in the storage bin 71 to the possible placement position of the object in the output bin 72, the shorter the movement distance of the hand in the X and Y directions and the shorter the movement time of the hand in the X and Y directions.
[0123] 24 is a diagram showing an image of the hand movement time in the X and Y directions depending on the arrangement relationship between the storage bins 71 and the output bins 72. In arrangement pattern A in Fig. 24, the storage bins 71 and the output bins 72 are arranged side by side in the X direction, and the hand must move the object 80 a long distance, passing over other items 85. In arrangement pattern B, the storage bins 71 and the output bins 72 are arranged side by side in the diagonal direction, and the hand only needs to move the object 80 a short distance without passing over other items 85.
[0124] The movement time of the hand in the Z direction may vary depending on the size of the object or the number of items in the bin 70. The larger the size of the object or the greater the number of items in the storage bin 71, the faster the movement speed of the arm in the Z direction, and therefore the shorter the movement time of the arm. This is because when items are stacked in the Z direction, the movement distance of the arm in the Z direction is shorter. Similarly, when there are a large number of items in the output bin 72, the movement time of the arm in the Z direction is shorter. This is because the objects are stacked in the Z direction. On the other hand, the smaller the size of the object or the fewer the number of items in the storage bin 71 or the fewer the number of items in the output bin 72, the faster the movement speed of the arm in the Z direction.
[0125] 25 is a diagram showing an image of the hand movement speed in the Z direction. In Fig. 25, when the object is placed on another object 85, the hand movement distance becomes shorter and the speed becomes higher, and when the object is not placed on another object 85, the hand movement distance becomes longer.
[0126] For example, based on the recognized item arrangement state, the processor 21 determines whether the object 80 is stacked on top of the item 85 in the storage bin 71, i.e., whether the object 80 is placed at a high position in the Z direction. If the object 80 is placed at a high position, even if the storage bin 71 in which the object 80 is stored and the output bin 72 are placed diagonally rather than side by side in the X or Y direction, an increase in the time required for the picking operation can be suppressed. Similarly, based on the recognized item arrangement state, the processor 21 determines whether the object 80 can be stacked on top of the item 85 in the output bin 72, i.e., whether the object 80 can be placed at a high position in the Z direction. If the object 80 can be placed at a high position, even if the storage bin 71 and the output bin 72 in which the object 80 is stored are placed diagonally rather than side by side in the X or Y direction, an increase in the time required for the picking operation can be suppressed.
[0127] The time it takes for the hand to move in each of the X, Y, and Z directions when the hand has picked up the object may vary depending on the weight of the object. The heavier the object, the slower the hand's movement speed in the X, Y, and Z directions when the object has been picked, and therefore the longer the hand's movement time. This is because the heavier the weight, the smaller the acceleration in the trapezoidal control described above. On the other hand, the lighter the object, the faster the hand's movement speed in each of the X, Y, and Z directions when the object has been picked, and therefore the shorter the arm's movement time.
[0128] FIG. 26 is a diagram illustrating the movement of objects according to their characteristics. In FIG. 26 , the host management device 20 shortens the movement distance of heavy objects compared to light objects, thereby shortening the hand movement time and reducing the takt time. The same applies to objects that are not heavy in weight but are large in size, made of a slippery material, or have a simple shape. In this case, the host management device 20 can prevent an increase in the picking time by arranging the storage bin 71 and the shipping bin 72 close to each other, for example, adjacent in the X or Y direction. On the other hand, if the objects are light in weight, small in size, made of a non-slip material, or have a complex shape, the host management device 20 can increase the hand movement speed and reduce the hand movement time. Therefore, even if the storage bin 71 and the shipping bin 72 are placed somewhat farther apart, for example, diagonally, an increase in the picking time can be prevented.
[0129] FIG. 27 is a flowchart showing an example of the operation of the upper level management device 20.
[0130] At the start of the process in FIG. 27, it is assumed that each bin 70 is located near the picking robot 40P that will perform the picking operation.
[0131] The processor 21 acquires an image captured by the camera 60 via the communication device 24. This captured image shows the items in the storage bin 71. Based on the captured image, the processor 21 recognizes the arrangement of the items in the storage bin 71. At this time, the processor 21 recognizes the position of the target object in the storage bin 71 (S31).
[0132] The processor 21 acquires an image captured by the camera 60 via the communication device 24. This captured image shows the items in the output bin 72. Based on the captured image, the processor 21 recognizes the arrangement of the items in the output bin 72. At this time, the processor 21 recognizes a position in the output bin 72 where the object can be placed (S32).
[0133] The processor 21 determines the respective positions of the storage bins 71 and the output bins 72 in the bin placement area BR of the picking station PS based on the arrangement of the items in the storage bins 71 and the arrangement of the items in the output bins 72. In this case, the respective positions of the storage bins 71 and the output bins 72 in the bin placement area BR of the picking station PS may be determined based on the arrangement position of the object in the storage bin 71 and the possible position of the object in the output bin 72. In this case, the processor 21 may, as an example, calculate the shortest arrangement that minimizes the moving distance from the storage bin 71 to the output bin 72 when the object is picked, and determine the respective positions of the storage bins 71 and the output bins 72 corresponding to the shortest arrangement (S33). Details of the shortest arrangement will be described later.
[0134] The processor 21 instructs the transport robot 40C via the communication device 24 to transport the storage bin 71 and the output bin 72 so that they are placed at the determined placement positions (S34).
[0135] When the processor 21 recognizes that the storage bin 71 and the output bin 72 are placed in the determined placement positions, it instructs the execution of a picking operation to transfer the object from the storage bin 71 to the output bin 72 (S35). Note that the hand of the picking robot 40P may or may not return to its initial position (e.g., the center position of the picking robot 40P) after each picking operation is completed.
[0136] Next, the details of the shortest arrangement will be described.
[0137] FIG. 28 is a top view of the interior of the storage bin 71 and the output bin 72. In FIG. 28, one item 85 is stored in the storage bin 71, and five items are stored in the output bin 72. As an example, the storage bin 71 and the output bin 72 can each accommodate two items in the X direction and three items in the Y direction, respectively, in a planar manner (without vertical overlapping). In this case, the item 85, which is the target object 80 arranged at the arrangement position p1 in the upper left of the storage bin 71 in FIG. 28, is picked up and moved to the arrangement position p2, which is the space at the lower right of the output bin 72, where it is lowered and stored. The positional relationship between the storage bin 71 and the output bin 72 may be, for example, the arrangement pattern shown in FIG. 29.
[0138] The placement position p1 may be recognized by the processor 21, for example, based on an image of the interior of the storage bin 71 and object information. For example, the processor 21A may determine the presence or absence of the object specified in the picking instruction data based on various characteristics such as the size of the object, and then determine the placement position p1 of the object. The possible placement position p2 may be recognized by the processor 21, for example, based on an image of the interior of the output bin 72 and object information. For example, the processor 21A may determine the possible placement position p2 based on various characteristics such as the item placement state (e.g., empty space) and the size of the object. For example, if an object of a predetermined size can fit into the empty space in the output bin 72, the processor 21A may determine the position of this empty space as the possible placement position p2. The placement position p1 and the possible placement position p2 may include a position component in the Z direction.
[0139] Fig. 29 is a diagram showing an example of an arrangement pattern for arranging storage bins 71 and output bins 72 in the bin arrangement area BR. In Fig. 29, the bin arrangement area BR is a rectangular area in which two bins 70 can be arranged side by side in the X direction and two in the Y direction. The processor 21 assumes a plurality of arrangement patterns for arranging the storage bins 71 and output bins 72 in the bin arrangement area BR. Fig. 29 shows arrangement patterns PT1, PT2, and PT3.
[0140] In arrangement pattern PT1, the storage bin 71 in the arrangement state shown in Fig. 28 is arranged in the upper right area BR2 of the bin arrangement area BR, and the output bin 72 in the arrangement state shown in Fig. 28 is arranged in the upper left area BR1 of the bin arrangement area BR. In this case, the distance in the XY plane between the arrangement position p1 within the storage bin 71 and the possible arrangement position p2 within the output bin 72 is distance d1.
[0141] In arrangement pattern PT2, the storage bin 71 in the arrangement state shown in Fig. 28 is arranged in the lower left area BR3 of the bin arrangement area BR, and the output bin 72 in the arrangement state shown in Fig. 28 is arranged in the upper left area BR1 of the bin arrangement area BR. In this case, the distance in the XY plane between the arrangement position p1 within the storage bin 71 and the possible arrangement position p2 within the output bin 72 is distance d2.
[0142] In arrangement pattern PT3, the storage bin 71 in the arrangement state shown in Fig. 28 is arranged in area BR4 at the bottom right of the bin arrangement area BR, and the output bin 72 in the arrangement state shown in Fig. 28 is arranged in area BR1 at the top left of the bin arrangement area BR. In this case, the distance in the XY plane between the arrangement position p1 within the storage bin 71 and the possible arrangement position p2 within the output bin 72 is distance d3.
[0143] Of the distances d1 to d3 that the storage bins 71 can take relative to the output bins 72 in the bin placement area BR in the placement patterns PT1 to PT3, the distance d2 is the shortest. Therefore, the placement pattern PT2 for the distance d2 is determined as the shortest placement. In this way, the processor 21 calculates the shortest placement that will result in the shortest movement distance of the object in step S33.
[0144] 30 is a diagram showing an example of the flow of movement of the hand and the object during picking. In FIG. 30, it is assumed that the hand 41 returns to the initial position every time a picking operation is completed.
[0145] In a picking operation in the arrangement pattern PT2 of Fig. 29 , first, in state A, the hand 41, which is in the initial position, moves toward the arrangement position p1 of the object 80 in the storage bin 71. Next, in state B, the hand 41 picks the object 80. Next, in state C, the picked object 80 is moved to the available arrangement position p2 of the output bin 73. Next, in state D, the object 80 is lowered and placed at the available arrangement position p2 of the output bin 73, and the hand 41 is returned to the initial position. Therefore, when determining the shortest arrangement in step S33 of Fig. 27 , instead of determining the shortest movement distance of the object 80 (i.e., the hand without considering the reference position), an arrangement pattern may be determined that results in the shortest movement distance of the hand 41 taking into account the initial position during the picking operation.
[0146] Further, a supplementary explanation will be given regarding this embodiment.
[0147] In this embodiment, the warehouse management system 5A utilizes at least one of the object information and the placement status of the bins 70 to control the placement of the bins 70, i.e., based on at least one of the object information and the placement status of the bins 70. When utilizing the object information, the processor 21A of the upper management device 20A places the objects so that, for example, the distance traveled by the objects is short for heavy objects. Similarly, when utilizing the placement status of the bins 70, the processor 21A places the objects so that, for example, the distance traveled by the objects is short for heavy objects. The same applies when utilizing both the object information and the placement status of the bins 70.
[0148] Furthermore, when multiple storage bins 71 are present in the placement control of bins 70, it may be impossible to place a specific storage bin 71 at the desired placement position within the bin placement area BR because another storage bin 71 is already placed or planned to be placed there. The desired placement position is, for example, the placement position with the shortest takt time (the time required for picking work). In this case, the processor 21A may select the placement position for the specific storage bin 71 with the next best takt time, rather than the optimal placement position.
[0149] Furthermore, when processor 21A specifies the placement positions of multiple storage bins 71 and output bins 72 at approximately the same time, processor 21A may calculate the takt time for each storage bin 71 and output bin 72. Then, processor 21A may specify the placement positions of the storage bins 71 and output bins 72 so as to shorten the takt time as a whole for a series of picking operations based on the picking instruction data (for example, picking operations in response to one shipping instruction).
[0150] The warehouse management system 5A of this embodiment can optimize the arrangement of storage bins 71 relative to output bins 72 based on the weight of the picking target, the size of the target, the number of targets in the bin 70, or the manner in which the target is placed in the output bin 72, as specified in the picking instruction data. The warehouse management system 5A controls the operation of the picking robot 40P to smoothly perform the picking operation (e.g., picking the target from the highest position in the Z direction, placing the target in an empty space) when each bin 70 is optimally arranged. Therefore, the warehouse management system 5A can minimize the time required for the operation of the arm or hand of the picking robot 40P, shorten the takt time during the picking operation of the picking robot 40P, and speed up the picking operation.
[0151] As an example, suppose that picking is performed on the same output bin 72 from a storage bin 71 located in area BR1 and a storage bin 71 located in area BR2 within the bin placement area BR. In this case, because picking is performed from different storage bins 71, the arm must approach the different storage bins 71. This increases the arm's travel distance, which tends to increase the arm's travel time. In this case, the storage bin 71 located in area BR1 may move to area BR2 without leaving the bin placement area BR. The processor 21 of the upper management device 20 may select the option that requires the shortest time between performing the picking while the storage bin 71 or output bin 72 is moving within the bin placement area BR and performing the picking by having the arm approach a different storage bin 71. The processor 21 may be able to calculate the required time for each option through simulation.
[0152] In this embodiment, the processor 21A of the host management device 20A mainly executes the processing related to the bin placement control, but this is not limited to this. For example, the processor 31A of the robot control system 30A may mainly execute the processing related to the bin placement control.
[0153] (Summary of the embodiment) As described above, the present disclosure describes at least the following matters. Note that, in parentheses, examples of components corresponding to the above-described embodiment are shown, but the present disclosure is not limited to these.
[0154] (Item 1) A bin placement control method for controlling the placement of bins (bins 70) relative to a picking robot (picking robot 40P) that performs picking work on an object (object 80), wherein the bins include a storage bin (storage bin 71) in which the object is stored before the picking work and an output bin (output bin 72) in which the object is stored after the picking work, the bin placement control method comprising the steps of: acquiring object information (object information I3) related to the object; determining a positional relationship between the storage bin and the output bin based on the object information; and controlling the placement of the storage bin and the output bin relative to the picking robot based on the determined positional relationship.
[0155] This allows the bin placement control method to determine the positional relationship between the storage bin and the output bin, taking into account that the movement time of the object may vary depending on the characteristics of the object. Therefore, when a picking operation is performed using a picking robot to move the object from the storage bin to the output bin, the bin placement control method can shorten the time required for the picking operation.
[0156] (Item 2) The bin arrangement control method according to Item 1, wherein the object information includes at least one of weight information indicating a weight of the object, size information indicating a size of the object, shape information indicating a shape of the object, and material information indicating a material of the object.
[0157] As a result, the bin placement control method can determine the positional relationship taking into account that the movement time of the object may vary depending on the weight, size, shape, or material of the object. For example, when the object is small, the bin placement control method can increase the hand movement speed so that the object is less likely to come into contact with other objects during picking. On the other hand, when the object is large, the bin placement control method can decrease the hand movement speed to move the object carefully because the object is more likely to come into contact with other objects during picking. Therefore, by taking into account the weight and size of the object, the bin placement control method can determine the positional relationship so that the efficiency of the picking operation for each object is improved.
[0158] (Item 3) A bin placement control method for controlling the placement of bins relative to a picking robot that performs picking work on an object, wherein the bins include a storage bin in which the object is stored before the picking work and an output bin in which the object is stored after the picking work, the bin placement control method comprising the steps of: acquiring a first image of the interior of the storage bin with a camera (camera 60); acquiring a second image of the interior of the output bin with the camera; recognizing a first arrangement state that is the arrangement state of items inside the storage bin based on the first image; recognizing a second arrangement state that is the arrangement state of items inside the output bin based on the second image; determining a positional relationship between the storage bin and the output bin based on the first arrangement state and the second arrangement state; and controlling the placement of the storage bin and the output bin relative to the picking robot based on the determined positional relationship.
[0159] This allows the bin placement control method to determine the positional relationship between storage bins and shipping bins, taking into account that the movement time of the object may vary depending on the arrangement of the items. Therefore, the bin placement control method can shorten the time required for picking operations when a picking robot is used to move an object from a storage bin to an outgoing bin. For example, if it is recognized that there are a large number of items based on the arrangement, the object may be placed at a relatively shallow position in the storage bin, and the object may be scheduled to be placed at a relatively shallow position in the shipping bin. Therefore, it is not necessary for the hand of the picking robot to approach a relatively deep position. In this case, the movement time of the object during the picking operation may be shortened. The bin placement control method can determine the positional relationship, taking this into account.
[0160] (Item 4) The bin placement control method of claim 3, wherein the step of recognizing the first placement state includes a step of recognizing the placement position (placement position p1) of the object inside the storage bin based on the first image and the object information, the step of recognizing the second placement state includes a step of recognizing a possible placement position (placement position p2) of the object inside the output bin based on the second image and the object information, and the step of determining the positional relationship includes a step of determining the positional relationship based on the placement position and the possible placement position.
[0161] This allows the bin placement control method to determine the placement position of the object in the storage bin and the possible placement position of the object in the output bin based on image analysis of the first and second images captured by the camera and the object information. Therefore, by making the placement position and the possible placement position as close as possible, the bin placement control method can shorten the movement distance of the picking robot's hand when picking an object, which means it can shorten the time required for the picking operation.
[0162] (Item 5) The bin placement control method according to Item 4, wherein the placement position includes a position in the height direction (Z direction) inside the storage bin, and the possible placement position includes a position in the height direction inside the delivery bin.
[0163] The higher the position of the object in the bin, the less vertical movement of the hand is required, and the shorter the object's movement time. Conversely, the lower the position of the object in the bin, the more vertical movement of the hand is required, and the longer the object's movement time. Therefore, the bin placement control method determines the positional relationship between the storage bin and the delivery bin taking into account the vertical position of the object in the bin, thereby achieving a placement relationship that can shorten the object's movement time.
[0164] (Item 6) The bin placement control method described in Item 4 or 5, wherein the step of determining the positional relationship includes a step of calculating the movement distance of the hand (hand 41) of the picking robot based on the placement position and the possible placement position, and a step of determining the positional relationship between the storage bin and the output bin based on the movement distance of the hand.
[0165] This allows the bin placement control method to determine the positional relationship between the storage bin and the delivery bin based on the movement distance of the hand, which is equivalent to the movement distance of the object.
[0166] (Item 7) The bin arrangement control method according to Item 6, wherein the step of calculating the movement distance of the hand includes the step of calculating the movement distance of the hand based on the arrangement position, the possible arrangement position, and a reference position (initial position) of the hand.
[0167] As a result, the bin placement control method can derive the movement time of the object with high accuracy even when the hand moves based on the reference position of the hand.
[0168] (Item 8) A bin placement control device (host management device 20A) that includes a processor (processor 21A) and controls the placement of bins relative to a picking robot that performs picking work on objects, wherein the bins include a storage bin in which the object is stored before the picking work and an output bin in which the object is stored after the picking work, and the processor acquires object information regarding the object, determines a positional relationship between the storage bin and the output bin based on the object information, and controls the placement of the storage bin and the output bin relative to the picking robot based on the determined positional relationship.
[0169] As a result, the bin placement control method can achieve the same effect as item 1.
[0170] (Item 9) A bin placement control device having a processor and controlling the placement of bins relative to a picking robot that performs picking work for an object, wherein the bins include a storage bin in which the object is stored before the picking work and an output bin in which the object is stored after the picking work, wherein the processor: acquires a first image of the inside of the storage bin using a camera; acquires a second image of the inside of the output bin using the camera; recognizes a first arrangement state that is the arrangement state of items inside the storage bin based on the first image; recognizes a second arrangement state that is the arrangement state of items inside the output bin based on the second image; determines a positional relationship between the storage bin and the output bin based on the first arrangement state and the second arrangement state; and controls the placement of the storage bin and the output bin relative to the picking robot based on the determined positional relationship.
[0171] As a result, the bin placement control method can achieve the same effect as item 3.
[0172] Although various embodiments have been described above with reference to the drawings, it goes without saying that the present disclosure is not limited to such examples. It is clear that a person skilled in the art can conceive of various modifications or alterations within the scope of the claims, and it is understood that these also naturally fall within the technical scope of the present disclosure. Furthermore, the components of the above-described embodiments may be combined in any manner without departing from the spirit of the invention.
[0173] In addition, the above embodiment may also be applicable to a program that realizes the functions of the bin placement control method, which is supplied to a computer (e.g., upper management device 20) via a network or various storage media, and which is read and executed by the processor of this computer, as well as to the storage media on which this program is stored.
[0174] The present disclosure is useful for a bin placement control method and a bin placement control device that can reduce the time required for picking work when a picking robot is used to move items from storage bins to delivery bins.
[0175] 5 Warehouse management system 10 Warehouse management device 20, 20A Upper management device 21, 21A Processor 22 Memory 23 Input device 24 Communication device 25 Input / output interface 30, 30A Robot control system 31, 31A Processor 32 Memory 33 Input device 34 Communication device 35 Input / output interface 40 Robot device 40C Transport robot 40P Picking robot 41 Hand 45 Worker 50 Warehouse 60 Camera 70 Bin 71 Storage bin 72 Outgoing bin 80 Target object 85 Article BR Bin placement area PS Picking station p1 Placement position p2 Possible placement position
Claims
1. A bin placement control method for controlling the placement of bins relative to a picking robot performing picking work for an object, wherein the bins include a storage bin in which the object is stored before the picking work and an output bin in which the object is stored after the picking work, the bin placement control method having the steps of: acquiring object information regarding the object; determining a positional relationship between the storage bin and the output bin based on the object information; and controlling the placement of the storage bin and the output bin relative to the picking robot based on the determined positional relationship.
2. The bin placement control method of claim 1, wherein the object information includes at least one of weight information indicating a weight of the object, size information indicating a size of the object, shape information indicating a shape of the object, and material information indicating a material of the object.
3. A bin placement control method for controlling the placement of bins relative to a picking robot which picks up an object, the bins including a storage bin in which the object is stored before the picking operation and an output bin in which the object is stored after the picking operation, the bin placement control method comprising the steps of: acquiring a first image of the interior of the storage bin by a camera; acquiring a second image of the interior of the output bin by the camera; recognizing a first arrangement state which is the arrangement state of items inside the storage bin based on the first image; recognizing a second arrangement state which is the arrangement state of items inside the output bin based on the second image; determining a positional relationship between the storage bin and the output bin based on the first arrangement state and the second arrangement state; and controlling the placement of the storage bin and the output bin relative to the picking robot based on the determined positional relationship.
4. The bin placement control method of claim 3, further comprising a step of acquiring object information regarding the object, wherein the step of recognizing the first placement state includes a step of recognizing a placement position of the object within the storage bin based on the first image and the object information, the step of recognizing the second placement state includes a step of recognizing a possible placement position of the object within the output bin based on the second image and the object information, and the step of determining the positional relationship includes a step of determining the positional relationship based on the placement position and the possible placement position.
5. The bin placement control method according to claim 4, wherein the placement position includes a height position inside the storage bin, and the possible placement position includes a height position inside the output bin.
6. The bin placement control method of claim 4, wherein the step of determining the positional relationship includes the steps of: calculating a moving distance of the hand of the picking robot based on the placement position and the possible placement position; and determining the positional relationship based on the moving distance of the hand.
7. The bin placement control method according to claim 6, wherein the step of calculating the moving distance of the hand includes a step of calculating the moving distance of the hand based on the placement position, the possible placement position, and a reference position of the hand.
8. A bin placement control device having a processor and controlling the placement of bins relative to a picking robot performing picking work for an object, wherein the bins include a storage bin in which the object is stored before the picking work and an output bin in which the object is stored after the picking work, wherein the processor acquires object information regarding the object, determines a positional relationship between the storage bin and the output bin based on the object information, and controls the placement of the storage bin and the output bin relative to the picking robot based on the determined positional relationship.
9. A bin placement control device having a processor and controlling the placement of bins relative to a picking robot performing picking work for an object, wherein the bins include a storage bin in which the object is stored before the picking work and an output bin in which the object is stored after the picking work, wherein the processor: acquires a first image of the inside of the storage bin by a camera; acquires a second image of the inside of the output bin by the camera; recognizes a first arrangement state which is the arrangement state of items inside the storage bin based on the first image; recognizes a second arrangement state which is the arrangement state of items inside the output bin based on the second image; determines a positional relationship between the storage bin and the output bin based on the first arrangement state and the second arrangement state; and controls the placement of the storage bin and the output bin relative to the picking robot based on the determined positional relationship.
Citation Information
Patent Citations
Picking facility and physical distribution facility
JP2018087083A
Article transport system
JP2020050479A
Kitting Machine
JP2022501287A
