Warehouse system and notification method for article input instruction

The warehouse system addresses inefficiencies in automated warehouses by providing recommendations for product placement based on attributes and robot capabilities, optimizing human-robot collaboration and enhancing picking efficiency.

WO2024247784A1PCT designated stage expired Publication Date: 2024-12-05PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/018474
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-31
Filing Date
2024-05-20
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Automated warehouses face inefficiencies in picking operations due to variations in product shapes and attributes, affecting robot grasping success rates, which necessitates improved human-robot collaboration for efficient product placement in storage bins.

Method used

A warehouse system that generates and notifies recommendations for the arrangement and posture of products in storage bins based on product attributes and robot capabilities, enhancing the efficiency of both human and robot picking operations by optimizing product placement for downstream robot handling.

Benefits of technology

Improves the efficiency of picking operations by ensuring products are placed in a manner that maximizes robot success rates, enhancing overall warehouse productivity and reducing manual workload.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024018474_05122024_PF_FP_ABST
    Figure JP2024018474_05122024_PF_FP_ABST
Patent Text Reader

Abstract

This warehouse system that instructs an operator to input an article into a storage bin includes: a generation unit that generates, on the basis of the state in the storage bin and information on an article to be newly inputted into the storage bin, a recommendation indicating the arrangement and / or posture of the article to be newly inputted into the storage bin; and a notification unit that gives notification of an input instruction including the recommendation generated by the generation unit.
Need to check novelty before this filing date? Find Prior Art

Description

Warehouse system and method for notifying instructions for putting in goods

[0001] The present disclosure relates to a warehouse system and a method for notifying an instruction to deposit an item.

[0002] In recent years, automated warehouses for receiving and shipping packaged goods have become widespread. For example, Patent Literature 1 discloses the configuration of a picking system for saving labor in the process of picking goods into containers transported from upstream to downstream by having a simple robot and a worker work together.

[0003] Japanese Patent Application Laid-Open No. 2020-203786

[0004] The present disclosure has been devised in view of the above-described conventional situation, and aims to achieve improved work efficiency related to picking work by workers and robots in warehouses.

[0005] The present disclosure provides a warehouse system that instructs workers to place items into a storage bin, the warehouse system having: a generation unit that generates a recommendation indicating at least one of the placement and posture of the newly placed item in the storage bin based on the state of the storage bin and information about the item to be newly placed into the storage bin; and a notification unit that notifies the worker of a placement instruction including the recommendation generated by the generation unit.

[0006] The present disclosure also provides a method for notifying instructions to put items into storage, comprising: a generation step in which a processor and a memory work together to generate a recommendation indicating at least one of the placement and posture of an item to be newly put into a storage bin based on the state of the storage bin in which the item is stored and information about the item to be newly put into the storage bin; and a notification step in which a drop-off instruction including the recommendation generated in the generation step is notified.

[0007] According to the present disclosure, it is possible to improve the efficiency of picking work by workers and robots in a warehouse.

[0008] FIG. 1 is a block diagram showing an example of a system configuration according to an embodiment of the present invention; FIG. 2 is a block diagram showing an example of a configuration of an information processing device that can be used in a system according to an embodiment of the present invention; FIG. 3 is a schematic diagram showing an example of a configuration inside a warehouse according to an embodiment of the present invention; FIG. 4 is a table showing an example of a data configuration according to an embodiment of the present invention; FIG. 5 is a table showing an example of a data configuration according to an embodiment of the present invention;

[0009] (Background to the Contents of Each Embodiment) Warehouses that handle receiving, storing, packaging, shipping, and the like of packages require automation using robots and the like to reduce the manual workload. With the recent increase in packages, further efficiency improvements in a series of operations are required. In such warehouses, items (hereinafter also referred to as "products") with various shapes, attributes, and other characteristics are handled, so it is necessary for people and robots to share and perform tasks while taking into consideration the characteristics of the products. One such task is picking, based on shipping instructions, from a storage unit where products are stored (hereinafter referred to as a "storage bin") to a storage unit (hereinafter referred to as a "shipping bin") that will store one or more products to be shipped.

[0010] Robots, which are the main operators performing picking work, have strengths and weaknesses when it comes to picking work. For example, even for the same product, the success rate of a robot's grasping varies depending on the product's posture and orientation. Therefore, making the product easy for a robot to grasp leads to more efficient picking work. In a series of work processes within a warehouse, the work process for goods progresses from upstream to downstream. In this case, it is desirable for upstream human work processes before the robot performs the picking work to take into account the robot's picking work downstream.

[0011] Therefore, in the following embodiments, an example of a system and a control method for appropriately performing work by humans in the upstream process will be described in order to realize efficient picking work by a robot.

[0012] Hereinafter, with reference to the drawings as appropriate, detailed descriptions of embodiments that specifically disclose systems and control methods according to the present disclosure will be provided. However, unnecessary detailed descriptions may be omitted. For example, detailed descriptions of well-known matters or redundant descriptions of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter recited in the claims.

[0013] <First Embodiment> [System Configuration] Fig. 1 is a block diagram showing an overall overview of a warehouse system 1 according to this embodiment. Note that the system configuration shown in Fig. 1 is an example, and one system may be divided into multiple systems, or multiple systems may be integrated into one system. Also, one system or device shown in Fig. 1 may be provided multiple times. Furthermore, the processing entities shown below are an example, and some of the functions of one system may be realized as functions of another system.

[0014] The warehouse system 1 includes a warehouse management system 100, a warehouse operations management system 200, warehouse control systems 300, 400, and 500, a robot 600, an automated warehouse 700, an automated guided vehicle 800, and an operation terminal 900. Each component of the warehouse system 1 is configured to be able to communicate with each other via a network. The warehouse management system 100 is a system that manages and controls logistics within a warehouse and is positioned at the highest level in the configuration example shown in FIG. 1 . The warehouse management system 100 manages, for example, inventory management of items within the warehouse, as well as the inflow and outflow (receiving and shipping) and movement of items. The warehouse management system is sometimes referred to as a WMS (Warehouse Management System). The warehouse management system 100 may be configured to be able to communicate with external systems not shown in FIG. 1 to acquire and manage instructions related to the inflow and outflow of goods, product information, information about warehouse equipment such as robots, and information about workers.

[0015] The warehouse operations management system 200 is a system that manages and controls work within a warehouse, and in the example configuration shown in Fig. 1, is positioned below the warehouse management system 100. The warehouse operations management system is sometimes referred to as a WES (Warehouse Execution System). The warehouse operations management system 200 comprehensively controls, for example, the work content of various work entities within the warehouse and the equipment within the warehouse.

[0016] The warehouse control systems 300, 400, and 500 manage and control various pieces of equipment in the warehouse. The warehouse control system may also be referred to as a WCS (warehouse control system). In the example configuration shown in FIG. 1 , the warehouse control systems 300, 400, and 500 manage and control the robot 600, the automated warehouse 700, and the automated guided vehicle 800, respectively. The robot 600 is equipped with, for example, a direct-travel mechanism or a multi-axis arm and is configured to be able to hold products at its tip. The tip of the robot 600 may have, for example, a suction mechanism or a multi-fingered gripping mechanism, but is not particularly limited thereto. Multiple types of robots 600 may be installed in the warehouse to accommodate picking operations for various products. Furthermore, a camera may be installed around the robot 600 to capture images of the surrounding area, particularly images of bins placed nearby.

[0017] The automated warehouse 700 is configured to be able to store multiple bins, and transports the bins using an automated guided vehicle 800 as required. Note that the method of transporting the bins is not limited to using the automated guided vehicle 800. For example, the bins may be transported using a belt conveyor or the like. The automated warehouse 700 is configured, for example, with a lattice frame so that multiple bins can be stored. Examples of bins stored in the automated warehouse 700 include storage bins for storing products. The storage bins may also include empty bins that do not contain any products, or bins for which no products have been determined to be stored. Note that the bins used in the automated warehouse 700 also include shipping bins for bundling products together before shipping. The shapes and dimensions of the storage bins and shipping bins may differ, but they are configured to be transportable by the automated guided vehicle 800, and will be described here as having the same rectangular box-shaped configuration.

[0018] Automated guided vehicle 800 is a vehicle for transporting bins to a predetermined location, and automatically moves or waits based on instructions. Automated guided vehicle 800 may be configured to detachably mount bins on its top, or may be configured to transport bins by pushing or pulling them. Automated guided vehicle 800 is configured to include, for example, a traveling unit for performing operations related to movement, sensors for acquiring peripheral information, and a communication unit for transmitting and receiving data to and from warehouse control system 300, etc.

[0019] The operation terminal 900 is an information processing device configured to be usable by workers both inside and outside the warehouse. The operation terminal 900 may be, for example, a stationary information processing device such as a PC (Personal Computer), or may be a mobile terminal such as a tablet terminal, POS terminal, handheld terminal, or smartphone. The operation terminal 900 transmits and receives data to and from the warehouse management system 100, warehouse operations management system 200, warehouse control systems 300, 400, and 500, and is used to receive notifications from each system and to configure and operate each system.

[0020] (Hardware Configuration Example) Each system shown in FIG. 1 may be configured as an on-premise server device at a base where a warehouse is located, or may be configured as a cloud-based system on a network. FIG. 2 is a diagram showing an example of the hardware configuration of an information processing device that can be used as a device constituting each system. Here, the devices constituting each system are described as having the same configuration, but some components may be omitted or other components may be added depending on the functions provided. An example of a component that may be added is a barcode reader used to acquire information from barcodes attached to products and bins in the warehouse.

[0021] The information processing device 10 includes a processing device 11, a storage device 12, a communication device 13, an input device 14, an image acquisition unit 15, an external interface 16, and a display device 17. Each component is configured to be able to communicate via an internal interface 18. The processing device 11 may be configured using, for example, a central processing unit (CPU), a graphic processing unit (GPU), a micro processing unit (MPU), a digital signal processor (DSP), or a field-programmable gate array (FPGA). The processing device 11 realizes various functions described below by, for example, referencing various databases (hereinafter, referred to as DBs) stored in the storage device 12 or reading programs. The storage device 12 is a storage unit for storing various data, programs, etc., and may be composed of volatile / non-volatile storage devices such as RAM (Random Access Memory), ROM (Read Only Memory), and HDD (Hard Disk Drive).

[0022] The communication device 13 is an interface for communicating with external devices via the network 35. There are no particular limitations on the communication standards that can be supported by the communication device 13, and the communication standards may be wired or wireless. The communication device 13 may also be capable of supporting multiple communication standards. Therefore, the network 35 may be configured by combining networks based on multiple communication standards.

[0023] The input device 14 accepts operations and instructions from warehouse users (e.g., managers and workers). The input device 14 may be composed of a mouse, a keyboard, a touch panel display, etc. The image acquisition unit 15 is an interface for acquiring images of the warehouse interior from cameras 30 installed in the warehouse. The external interface 16 is an interface for communicating with an external system 20. The external system 20 may be communicatively connected via the communication device 13 and a network 35. The external system 20 is not limited to the systems shown in FIG. 1 , and may be another system. The display device 17 displays various user interfaces to the user. The display device 17 may be composed of a liquid crystal display, a touch panel display, a lamp, etc.

[0024] 3 is a conceptual diagram showing an example of the configuration inside a warehouse of the warehouse system 1 according to this embodiment. An automated warehouse 700 and one or more robots 600 are installed inside the warehouse. Also, a plurality of automated guided vehicles 800 that transport bins are arranged in a drivable manner inside the warehouse.

[0025] A work area 830 is configured around the automated warehouse 700 where a worker 850, who will be the main operator of the picking work, will work. A work area is also provided where the robot 600 will work. A bin arrangement is determined to make it more efficient for the operator to move products from the storage bins to the shipping bins. Furthermore, from the perspective of improving the efficiency of the entire shipping work, if it is desirable to temporarily wait for a bin instead of moving it into the automated warehouse 700, a waiting area 840 is provided for waiting the bin. Hereinafter, the area where picking work is performed may be referred to as a picking station.

[0026] 3 shows an example in which one area for the human worker 850 to work and one area for the robot 600 to work are provided, but this is not limiting. Multiple areas of each type may be provided. Alternatively, only one area for the human worker or one area for the robot to work may be provided. Furthermore, although an example in which the robot 600 equipped with a direct mechanism is provided is shown, a robot equipped with a multi-axis arm may also be provided.

[0027] In this embodiment, the description will be made assuming the receiving stage in which new products from outside are stored in storage bins 810 within the warehouse system 1. After the receiving operation, the storage bins 810 containing the products are stored in the automated warehouse 700. Then, in the shipping stage, which is a downstream process, shipping work, for example, picking of products from the storage bins 810 to shipping bins 820, is performed by people or robots. Therefore, in this embodiment, the processing during receiving work will be described assuming picking work by a robot in the downstream process.

[0028] In this embodiment, receiving work is performed by a person or a robot 600 storing newly arrived products in a storage bin 810. As an area where receiving work is performed, for example, a work area such as the work area 830 in FIG. 3 is set. In this work area, one or more storage bins 810 and a group of newly arrived products are arranged around an area for the worker (person or robot). An operation terminal 900 is also installed in the work area where the person works. In the following explanation, the work of storing products in a storage bin is also referred to as "putting in."

[0029] [Data Structure Example] An example of the data structure according to this embodiment will be described using Figures 4 and 5. Here, the description will focus on one arrival instruction. One arrival instruction can include multiple products. Since this information is included in one arrival instruction, one arrival instruction is divided into sections for each product.

[0030] 4A shows an example of the structure of arrival information 40, which shows records for each item in a single arrival instruction, where three items, A, B, and C, are designated as items to be shipped. Each record includes the following fields: an arrival item ID 40a, a quantity 40b, and an expected arrival date 40c.

[0031] FIG. 4B includes the following items for each record of the arrival information 40 shown in FIG. 4A: person in charge of putting 41d, bin information 41e, putting-in preparation completion status 41f, and putting-in completion status 41g.

[0032] The input person 41d indicates the worker who inputs the products into the storage bins. The input person 41d may further include information on the work area where the worker performs the work. In the example of FIG. 4(b), each record is assigned to either a robot or a person. The bin information 41e indicates the identification information of the storage bin in the work area and its placement in the work area. The input preparation completion status 41f indicates whether the worker has completed preparations for the input work, i.e., whether the worker has determined the bin placement and installed the bins in the work area. The input completion status 41g indicates whether the worker has completed the input work.

[0033] FIG. 5( a) shows an example of the data structure of product information, which is an example of item information. The product information 50 includes a product ID 50a, a product classification 50b, dimensions 50c, weight 50d, inventory quantity 50e, product attribute information 50f, product attribute information 50g, and a storage bin 50h. The product ID 50a is identification information for uniquely identifying a product. The product classification 50b indicates a predefined product classification. The product classification may indicate a commercial classification such as food or furniture. The dimensions 50c indicate the product dimensions. The inventory quantity 50e indicates the inventory quantity of the product in the warehouse. Note that the same product may be stored in different storage bins, in which case the total inventory quantity may be displayed. Alternatively, the inventory quantity may be displayed for each storage bin in which the same product is stored.

[0034] Product attribute information 50f indicates information regarding attributes related to the outer shape of the product. For example, classification may be defined based on the product's surface shape, softness, material, etc. Product attribute information 50g indicates information regarding the attributes of the product, and attribute information different from product attribute information 50f may be set. For example, information other than the product's outer shape may be set. Note that product attribute information 50f and product attribute information 50g do not need to be set separately and may be defined together. For convenience, product attribute information 50f is also referred to as the "first product attribute" and product attribute information 50g is also referred to as the "second product attribute." Furthermore, although examples of two product attributes are given, more detailed classifications and hierarchies of product attributes may also be set. Storage storage bin 50h is identification information for uniquely identifying the storage bin in which the product is stored.

[0035] FIG. 5B shows an example of the data configuration of work area information related to a work area where an input operation is performed. The work area information 51 includes a work area ID 51a, a worker 51b, an arm configuration 51c, and a tip configuration 51d. The work area ID 51a is identification information for uniquely identifying the work area where the input operation is performed. The worker 51b indicates the worker performing the input operation in the work area. For example, if the worker is a human, "Worker" is set, and if the worker is a robot, the worker's identification information is set. The arm configuration 51c is set to information regarding the configuration of the arm if the worker in the work area is a robot. Examples of the robot arm configuration include a multi-joint type and a straight-type. The tip configuration 51d is set to information regarding the configuration of the tip of the robot if the worker in the work area is a robot. Examples of the configuration of the robot's tip include a suction type and a multi-fingered hand type.

[0036] [Notification Contents to Worker] Fig. 6 is a diagram showing an example of the configuration of data that defines instructions to the worker performing the insertion work according to the attributes of the products to be inserted in this embodiment. As described above, operation terminals 900 are installed around the work area so that they can be used, and information related to the insertion work is notified to the worker. This information includes the type and number of products to be inserted, information about the storage bin into which the products will be inserted, as well as the method for inserting the products. In this embodiment, the desired method for inserting products into the storage bin according to the attributes of the products is defined in advance, and instructions are given to the worker based on this.

[0037] FIG. 6( a) shows an example of instruction definition data 60 indicating instruction content defined corresponding to the value of the product attribute information 50f shown in FIG. 5( a), i.e., the first product attribute. The first product attribute is based on an attribute related to the product's external shape. The instruction definition data 60 defines instructions assuming that a robot will pick up products from storage bins in a process downstream of the receiving operation. The instruction definition data 60 includes the following items: product attribute information 60a, corresponding robot type 60b, and instruction content 60c to the worker. The product attribute information 60a indicates the attribute of the external shape of each product and corresponds to the value of the product attribute information 50f shown in FIG. 5( a). The corresponding robot type 60b indicates the type of robot 600 that can grasp the product. Here, the configuration of the tip of the robot 600 is shown. The instruction content 60c indicates the instruction content to be communicated when a person performs the receiving operation of the corresponding product.

[0038] For example, instructions include, if the product has a flat surface, placing the flat surface in the storage bin so that it faces upwards, assuming a downstream suction-type robot, or, if the product has a cylindrical shape, placing the cylindrical side so that it can be grasped by the side.

[0039] FIG. 6(b) shows an example of instruction definition data 61 indicating instruction details defined in correspondence with the product attribute information 50g shown in FIG. 5(a), i.e., the value of the second product attribute. The second product attribute is based on an attribute other than the product's external shape. The instruction definition data 61 may define instructions assuming that work other than picking work will be performed in a process downstream of the receiving work. The instruction definition data 61 includes items of product attribute information 61a and instruction details 61b to the worker. The product attribute information 60a indicates attributes other than the external shape of each product and corresponds to the value of the product attribute information 50g shown in FIG. 5(a). The instruction details 61b indicate instruction details to be notified when a person performs the receiving work for the relevant product.

[0040] For example, if a product is to be photographed with a camera, the instructions may include an instruction to position the product so that the larger surface of the product faces the camera. Similarly, if the product has a label attached, the instructions may include an instruction to position the label so that the label faces the camera.

[0041] 6 is an example, and may be changed depending on the content of the downstream process, the functions of the robot 600 or other devices (e.g., camera 30) performing the work in the downstream process, etc. Also, the worker may be able to change the instruction content at will. Furthermore, with regard to the instruction content corresponding to each product attribute, priorities may be assigned to the product attributes, and instruction content may be selected based on the product attribute with a higher priority.

[0042] [Processing Flow] The receiving operation processing according to this embodiment will be described below with reference to Fig. 7. Fig. 7 is a flowchart for explaining the flow of processing when goods are received by the warehouse operations management system 200 in the warehouse system 1 according to this embodiment. Note that in this example, the processing is performed by the warehouse operations management system 200, but some functions may be performed by other systems.

[0043] The warehouse operations management system 200 receives a receiving instruction from the warehouse management system 100, which is a higher-level system (step S701).

[0044] The warehouse operations management system 200 breaks down the receiving instruction received in step S701 into individual products and registers each product as an input operation (step S702). As a result of this process, receiving information such as that shown in FIG. 4(a) is generated.

[0045] The warehouse operations management system 200 sorts the input tasks for each product generated in step S702 to the workers who will perform the input tasks, i.e., assigns the tasks to people or robots (step S703). The sorting here may be performed based on, for example, the operating rate of each work area or the characteristics of the incoming products (number, weight, dimensions, etc.).

[0046] The warehouse operations management system 200 instructs the automated warehouse 700 and the automated guided vehicle 800 via the warehouse control systems 400 and 500 to place storage bins into which the products will be placed in the work areas of the workers sorted in step S703 (step S704). At this time, the warehouse operations management system 200 may also determine where in the work area the storage bins will be placed.

[0047] The warehouse operations management system 200 determines whether the worker classified in step S703 for each input task is a human (step S705). This determination is made based on the arrival information 41 as shown in FIG. 4(b). If the worker is a human (step S705: YES), the warehouse operations management system 200 proceeds to step S706. On the other hand, if the worker is not a human, i.e., a robot (step S705: NO), the warehouse operations management system 200 proceeds to step S719.

[0048] The warehouse operations management system 200 refers to the work settings (step S706). The work settings may include settings regarding whether or not recommendations are required for the worker in charge of the work, and settings regarding the worker's work schedule. Furthermore, work settings may be made to indicate that the input work should be completed early. These settings may be set in advance by the user (manager or worker). In this embodiment, recommendations include information regarding how to store products in storage bins according to the contents of the instruction definition data shown in FIG. 6.

[0049] Based on the settings referenced in step S706, the warehouse operations management system 200 determines whether or not it is necessary to provide a recommendation to the worker in charge of the work via the operation terminal 900 (step S707). For example, if the worker has relatively ample time to perform the input work based on the worker's work schedule, the warehouse operations management system 200 may determine that a recommendation should be provided. In this case, the system encourages the worker to store the products for more efficient work, assuming that the work will be performed by the downstream robot 600. If the worker has set a setting that a recommendation is not necessary, the system may determine that a recommendation is not necessary. If a recommendation is necessary (step S707: YES), the warehouse operations management system 200 proceeds to step S710. On the other hand, if a recommendation is not necessary (step S707: NO), the warehouse operations management system 200 proceeds to step S708.

[0050] The warehouse operations management system 200 issues an instruction to the operation terminal 900 used by the worker to input the products (step S708). At this time, the input instruction does not include any recommendations. Therefore, the worker can input the products into the storage bin in any position or arrangement, which improves the worker's work efficiency.

[0051] The warehouse operations management system 200 determines whether the manual input of the goods has been completed (step S709). This determination may be made based on information input by the worker operating the operation terminal 900 when the input is complete. If the input is completed (step S709: YES), the processing of the warehouse operations management system 200 proceeds to step S725. On the other hand, if the input is not completed (step S709: NO), the processing of the warehouse operations management system 200 returns to step S708 and waits. At this time, the warehouse operations management system 200 may update the screen of the operation terminal 900 to prompt the worker to perform the input.

[0052] The warehouse operations management system 200 acquires an image of the storage bin into which the goods are to be dropped (step S710). The image of the storage bin may be acquired via a camera 30 installed around the work area.

[0053] The warehouse operations management system 200 analyzes the image acquired in step S710 to determine the current position and posture of the product in the storage bin, and to identify positions where new products can be added (step S711).

[0054] Based on the result of the image analysis in step S711, the warehouse operations management system 200 derives the product placement position where new products can be added to the storage bin (step S712).

[0055] The warehouse operations management system 200 generates a recommendation for inserting the product based on the product placement position derived in step S712 and the various information shown in Figures 5 and 6 (step S713). For example, as shown in Figure 6, the recommendation may include the posture and state of the product at the time of insertion. Furthermore, the recommendation may include a placement position determined to prioritize placement in a position close to the center of the storage bin among the free space within the storage bin. If the product is placed in a corner of the storage bin, it may be difficult to grasp the product if the bin rotates before the picking operation. For example, if the product is placed too far from the robot, the robot's joints may be overextended, or if the product is placed too close to the robot, the side of the bin may restrict the robot's trajectory. Therefore, if a position close to the center of the storage bin is available, placing the product in that position increases the likelihood of efficient picking. Furthermore, the recommendation may include instructions to encourage tasks such as inserting cushioning material or dividers between products in the storage bin or leaving a certain amount of space between them. When multiple products of the same type are to be placed in one storage bin, the order in which they are placed may also be included in the recommendation.

[0056] The warehouse operations management system 200 issues a product input instruction, including the recommendation generated in step S713, to the operation terminal 900 used by the worker (step S714). This allows the worker to refer to the recommendation via the operation terminal 900 and input products for more efficient work, assuming the work to be performed by the downstream robot 600. Note that the method of providing the recommendation is not limited to via the display unit (not shown) of the operation terminal 900, and may also be, for example, displayed using a projector or speaker to notify the worker of the input position relative to the storage bin.

[0057] The warehouse operations management system 200 determines whether the manual input of the products has been completed (step S715). This determination may be made based on information input by the worker operating the operation terminal 900 when the input is complete. If the input is completed (step S715: YES), the processing of the warehouse operations management system 200 proceeds to step S716. On the other hand, if the input is not completed (step S715: NO), the processing of the warehouse operations management system 200 returns to step S714 and waits. At this time, the warehouse operations management system 200 may update the screen of the operation terminal 900 to prompt the worker to perform the input.

[0058] The warehouse operations management system 200 acquires an image of the storage bin after the products have been placed in it (step S716). The image of the storage bin may be acquired via a camera 30 installed around the work area.

[0059] The warehouse operations management system 200 analyzes the image acquired in step S716 and identifies the current arrangement and posture of the product in the storage bin, as well as the storage position of the product (step S717).

[0060] Based on the results of the image analysis in step S717 and the content of the recommendation generated in step S713, the warehouse operations management system 200 determines whether the storage bins have been loaded in accordance with the recommendation (step S718). If the loading has been performed in accordance with the recommendation (step S718: YES), the processing of the warehouse operations management system 200 proceeds to step S725. On the other hand, if the loading has not been performed in accordance with the recommendation (step S718: NO), the processing of the warehouse operations management system 200 returns to step S714, where the warehouse operations management system 200 prompts the user to adjust the loading status of the products. In this case, the warehouse operations management system 200 may be configured to output the recommendation again.

[0061] Note that the state in which the recommended items have been inserted is not limited to a complete match between the content of the recommendation and the results of image analysis. For example, it may be determined that the recommended items have not been inserted only when predetermined insertion conditions, such as posture and placement, are not met. Furthermore, the information used to determine whether the recommended items have been inserted is not limited to two-dimensional images. For example, whether the recommended items have been inserted may be determined using three-dimensional data, weight, etc. obtained by scanning the storage bin with LiDAR or the like. Using three-dimensional data, it is possible to determine whether the plane, etc., is facing upward, and using weight, etc., it is possible to determine whether the number of items inserted into the storage bin is as specified. Furthermore, it may be possible to determine whether the sides and number of items are as specified by using a device such as a barcode reader to confirm whether the specified number of barcode faces can be recognized.

[0062] The warehouse operations management system 200 acquires an image of the storage bin into which the goods are to be dropped (step S719). The image of the storage bin may be acquired via a camera 30 installed around the work area.

[0063] The warehouse operations management system 200 analyzes the image acquired in step S719 to determine the current position and orientation of the products in the storage bins, and to identify positions where new products can be added (step S720). The analysis content here may be the same as or different from the process in step S711.

[0064] Based on the results of the image analysis in step S720, the warehouse operations management system 200 determines whether the robot 600 is in a state where it is possible to add new items to the storage bin (step S721). An example of a state where the robot 600 is not in a state where it is possible to add items is when the items are not stored in an orderly manner and no free space can be identified. The conditions used for this determination are not particularly limited and may be changed depending on, for example, the characteristics of the items stored in the storage bin. If the robot 600 is in a state where it is possible to add new items to the storage bin (step S721: YES), the warehouse operations management system 200 proceeds to step S724. On the other hand, if the robot 600 is not in a state where it is possible to add new items to the storage bin (step S721: NO), the warehouse operations management system 200 proceeds to step S722.

[0065] The warehouse operations management system 200 changes the operator from a robot to a human and instructs the rearrangement of the storage bin (step S722). At this time, the warehouse operations management system 200 transmits an input instruction to the operation terminal 900 that can be used by the worker who has been changed to the operator of the work. Note that if there are multiple work areas that can be input by humans, the worker to be assigned may be determined based on the operating rate of each work area.

[0066] The warehouse operations management system 200 transmits an instruction to input the product to the robot 600 via the warehouse control system 300 (step S723).

[0067] The warehouse operations management system 200 determines whether the robot 600 has completed the input of the products (step S724). This determination may be made based on a completion notification received via the warehouse control system 300. If the robot 600 has completed the input of the products (step S724: YES), the processing of the warehouse operations management system 200 proceeds to step S725. On the other hand, if the robot 600 has not completed the input of the products (step S724: NO), the processing of the warehouse operations management system 200 returns to step S723 and enters standby mode. At this time, the warehouse operations management system 200 may be configured to resend the input instruction to the warehouse control system 300.

[0068] The warehouse operations management system 200 instructs the warehouse control systems 400 and 500 to store the storage bins into which the products have been added in the automated warehouse 700 (step S725), and then ends this processing flow.

[0069] This process flow is executed every time new products arrive at the warehouse. In addition, processes downstream of the receiving process, such as shipping, are executed simultaneously with this process flow.

[0070] As described above, a warehouse system (e.g., 1) according to the present embodiment is a warehouse system that instructs a worker to place an item in a storage bin (e.g., 810). The warehouse system includes a generation unit (e.g., 200, 10, 11) that generates a recommendation for at least one of the placement and posture of an item to be newly placed in the storage bin based on the state of the storage bin and information about the item to be newly placed in the storage bin, and a notification unit (e.g., 200, 10, 11, 900) that notifies the worker of a placement instruction including the recommendation generated by the generation unit. This configuration makes it possible to improve the efficiency of picking work by workers and robots in the warehouse. In particular, in a series of work in the warehouse, products can be placed in appropriate storage bins upstream, taking into account the work of a robot downstream. This makes it possible to improve the efficiency of picking work by robots downstream.

[0071] The placement and orientation of the recommendations are determined based on the configuration of the robot (e.g., 600) that picks items from the storage bins. This configuration allows items to be placed in the storage bins with the robot downstream picking the items from the storage bins in mind.

[0072] The arrangement and orientation of the recommendation are determined based on the attributes of the outer shape of the product. This configuration makes it possible to present recommendations for placing products into storage bins based on the attributes of the outer shape of the product.

[0073] The system further includes a determination unit (e.g., 200, 10, 11) that determines whether the state of the storage bin into which the worker placed the item in response to the placement instruction from the notification unit is in line with the recommendation included in the placement instruction. If the determination unit determines that the state is not in line with the recommendation, the notification unit again notifies the worker of the placement instruction including the recommendation. This configuration makes it possible to prompt the worker to adjust the placement and posture of the items in the storage bin if the items are not being placed in line with the recommendation. This enables the robot downstream to pick items from the storage bins and more appropriately place items into the storage bins.

[0074] The system further includes a decision unit (e.g., 200, 10, 11) that decides whether to notify the recommendation based on the work settings of the worker who submits the recommendation, and if the notification unit determines not to notify the recommendation, it notifies the user of an input instruction that does not include the recommendation. This configuration makes it possible to switch the notification of recommendations according to the user's settings.

[0075] (Other Modifications) The present disclosure also applies to programs and storage media that realize the functions of the device of the above-mentioned embodiments, which are supplied to the device via a network or various storage media, and that are read and executed by a computer within the device.

[0076] In the above embodiment, the instructions to the worker include information regarding the placement or orientation of the products in the bin. However, the instructions are not limited to these. For example, instructions may also be given regarding the handling of the products themselves, such as instructions to handle fragile items carefully or instructions regarding the order in which items should be loaded from bottom to top. In this case, the handling of the products themselves may be specified as the preferred method of loading the products into the storage bin.

[0077] The example of the data structure of the product information in the above embodiment is just an example, and each piece of information may be provided from a separate database. For example, information used mainly in the warehouse and information used outside the warehouse, such as in a retail store, may be provided from different databases. An example of information used mainly in the warehouse is information about storage bins. An example of information used outside the warehouse is a product ID for uniquely identifying a product. Here, the information used outside the warehouse may be obtained from a database provided by an entity other than the entity operating the warehouse, such as a retail store or a product manufacturer.

[0078] Note that if the database provided by an entity other than the entity operating the warehouse is intended for the purpose of managing in-store sales, etc., the product information in the database may not include the product attributes used in the above-described embodiments, such as product shape and material. In this case, the product attributes used in the above-described embodiments may be acquired by referencing a database in which product names and information on three-dimensional shapes of products or two-dimensional images, etc. are associated based on the product names, etc., included in the product information. Note that when two-dimensional images are used, the presence or absence of flat surfaces and their shapes may be estimated from highlight and shadow information.

[0079] In the above embodiment, the robot type is classified according to the configuration of the tip of the robot. However, the robot type may also be classified according to other information related to the robot configuration. For example, the robot may be defined using information such as the robot's motion error or the cross-sectional area of ​​the object it can grasp. By taking this information into consideration, it is possible to instruct the robot to increase the spacing between objects to reduce the effect of error, or to position the objects with the narrow side facing upward. In other words, the robot type may be classified according to various physical or logical configurations of the robot involved in grasping objects.

[0080] In the above embodiment, an example of a recommendation assuming picking work by a robot in a downstream process has been described. This is not a limitation, and recommendations may also be made assuming human picking work in a downstream process. For example, when a human performs the work, a gap large enough to allow a hand to reach in to grasp the product is required, so it is conceivable to issue a loading instruction that includes a recommendation to provide such a gap. Furthermore, the content of the recommendation may be changed based on information about the person's attributes, such as the person's physique, muscle strength, experience, and available assistive devices. Such operations can be realized by using information about the person's attributes instead of the type of robot in the above embodiment.

[0081] In the above embodiments, the objects of the receiving operation are not limited to "products" that are commercially distributed. The configurations of the above embodiments can be applied to the receiving operation of general items that may not be considered "products," such as non-sale items and parts.

[0082] Although various embodiments have been described above with reference to the drawings, it goes without saying that the present disclosure is not limited to these examples. It is clear to those skilled in the art that various modifications, alterations, substitutions, additions, deletions, and equivalents may be made within the scope of the claims, and it is understood that these also fall within the technical scope of the present disclosure. Furthermore, the components of the various embodiments described above may be combined in any manner without departing from the spirit of the invention.

[0083] (Additional Notes) The above description of the embodiments discloses the following techniques.

[0084] (Technology 1) A warehouse system that instructs workers to place items into storage bins, the warehouse system having: a generation unit that generates recommendations for at least one of the placement and posture of the newly placed item in the storage bin based on the state within the storage bin and information about the item to be newly placed in the storage bin; and a notification unit that notifies the worker of a placement instruction that includes the recommendation generated by the generation unit.

[0085] This configuration makes it possible to improve the efficiency of picking work by workers and robots in the warehouse. In particular, in a series of work in the warehouse, products can be placed in appropriate storage bins upstream, taking into account the work of downstream robots. This makes it possible to improve the efficiency of picking work by downstream robots.

[0086] (Technology 2) The warehouse system according to Technology 1, wherein the placement and orientation indicated in the recommendation are determined based on a configuration of a robot that retrieves items from the storage bin.

[0087] This configuration makes it possible to place products into the storage bins, assuming that a robot will be performing picking operations on the downstream side.

[0088] (Technology 3) The warehouse system according to Technology 1 or Technology 2, wherein the arrangement and orientation indicated in the recommendation are defined based on attributes of the outer shape of the item.

[0089] This configuration makes it possible to present recommendations for placing products into storage bins based on the attributes of the product's external shape.

[0090] (Technology 4) A warehouse system according to any one of Technology 1 to Technology 3, further comprising a judgment unit that judges whether the state of the storage bin into which an item has been placed by a worker in response to a placement instruction from the notification unit is in line with a recommendation included in the placement instruction, and if the judgment unit determines that the state is not in line with the recommendation, the notification unit again notifies the placement instruction including the recommendation.

[0091] This configuration makes it possible to prompt adjustment of the product placement and posture in the storage bin when the product placement is not in line with the recommendation. This enables more appropriate placement of products in the storage bin, assuming a robot that picks products from the storage bin downstream.

[0092] (Technology 5) A warehouse system according to any one of Technology 1 to Technology 4, further comprising a decision unit that decides whether or not to notify the recommendation based on the work settings of the worker performing the input, and when the notification unit decides not to notify the recommendation, it notifies an input instruction that does not include the recommendation.

[0093] This configuration makes it possible to switch recommendation notifications according to user settings.

[0094] (Technology 6) A method for notifying instructions to put items into storage, comprising: a generation step in which a processor and a memory cooperate to generate a recommendation for at least one of the placement and posture of an item to be newly put into a storage bin based on the state of the storage bin in which the item is stored and information about the item to be newly put into the storage bin; and a notification step in which a drop-off instruction including the recommendation generated in the generation step is notified.

[0095] This configuration makes it possible to improve the efficiency of picking work by workers and robots in the warehouse. In particular, in a series of work in the warehouse, products can be placed in appropriate storage bins upstream, taking into account the work of downstream robots. This makes it possible to improve the efficiency of picking work by downstream robots.

[0096] The present disclosure is useful for a warehouse system and a method for notifying instructions to put in goods during receiving work.

[0097] DESCRIPTION OF SYMBOLS 1...Warehouse system 10...Information processing device 11...Processing device 12...Storage device 13...Communication device 14...Input device 15...Image acquisition unit 16...External interface 17...Display device 18...Internal interface 20...External system 30...Camera 35...Network 100...Warehouse management system 200...Warehouse operation management system 300, 400, 500...Warehouse control system 600...Robot 700...Automated warehouse 800...Automated guided vehicle 900...Operation terminal

Claims

1. A warehouse system that instructs a worker to place items into a storage bin, the warehouse system having: a generation unit that generates a recommendation indicating at least one of the placement and posture of the newly placed item in the storage bin based on the condition inside the storage bin and information about the item to be newly placed into the storage bin; and a notification unit that notifies the worker of a placement instruction including the recommendation generated by the generation unit.

2. The warehouse system of claim 1, wherein the placement and posture indicated in the recommendation are determined based on a configuration of a robot that retrieves items from the storage bin.

3. The warehouse system of claim 1, wherein the arrangement and posture indicated in the recommendation are determined based on attributes of the external shape of the newly inserted item.

4. The warehouse system of claim 1, further comprising a judgment unit that judges whether the state within the storage bin after the notification unit has notified the input instruction is in accordance with the recommendation included in the input instruction, and when the judgment unit judges that the state is not in accordance with the recommendation, the notification unit again notifies the input instruction including the recommendation.

5. The warehouse system of claim 1, further comprising a decision unit that decides whether or not to notify the recommendation based on the work settings of the worker, wherein the notification unit notifies an input instruction including the recommendation if it is decided to notify the recommendation, and notifies an input instruction not including the recommendation if it is decided not to notify the recommendation.

6. A method for notifying instructions to insert items, comprising: a generation step in which a processor and a memory cooperate to generate a recommendation indicating at least one of the placement and posture of a newly inserted item in a storage bin based on the condition within the storage bin in which the items are stored and information about the item to be newly inserted into the storage bin; and a notification step of notifying an insertion instruction including the recommendation generated in the generation step.

Citation Information

Patent Citations

  • Picking system

    JP2016188123A

  • Packaging materials as sorting items

    JP2016532608A

  • Arrangement support system, arrangement support method and program

    JP2019104625A

  • Box packing assistance device, box packing assistance method and box packing assistance system

    JP2023000842A