Picking system and method for controlling picking robot

The picking system automates the selection of holding units based on article information, addressing the inefficiency of manual unit specification in conventional robots, thereby improving operational speed and reducing worker burden.

JP2024165619AInactive Publication Date: 2024-11-28HITACHI LTD

Patent Information

Application Number
JP2023081966
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-18
Publication Date
2024-11-28
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Conventional picking robots require manual specification of holding units for each item, which becomes impractical in distribution warehouses handling thousands of item types, leading to significant operational burden.

Method used

A picking system and method that automatically selects the appropriate holding unit for an item based on article information, using a robot hand with suction and grip parts, and a control unit that switches methods according to article type.

Benefits of technology

Enables efficient and quick picking operations without manual unit specification, reducing operator workload and enhancing operational efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024165619000001_ABST
    Figure 2024165619000001_ABST
Patent Text Reader

Abstract

To quickly perform picking work without requiring a worker to regulate a unit used for each article.SOLUTION: A picking system includes: a picking robot 10 having a robot hand 12 having a suction part 122 for sucking an article and a gripping part 124 for gripping the article; and a control part 50 for performing control of a picking work by the picking robot 10. The control part 50 switches a picking method by the robot hand 12, according to article information on the article as a picking object.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a picking system and a control method for a picking robot. [Background technology]

[0002] In logistics warehouses, it is necessary to sort items according to delivery destinations according to orders. To automate this task, so-called picking robots have been put to practical use. Picking robots are robots that automate the picking task for shipping items. Picking robots are equipped with robotic hands that hold items to be shipped.

[0003] Among picking robots, there are picking robots equipped with a robot hand having multiple holding units so that they can pick up items of various shapes handled in warehouses (see, for example, Patent Document 1). This type of picking robot can handle picking of items of various shapes by using multiple holding units appropriately.

[0004] Patent document 1 discloses a technology that "has a clamping unit and a suction unit, and by rotating the clamping unit and the suction unit, it is possible to switch which of the clamping unit and the suction unit is used to hold the object to be held." [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2023-015567 A Summary of the Invention [Problem to be solved by the invention]

[0006] In the above-mentioned conventional technology, the clamping unit and the suction unit can be rotated to switch which unit is used to hold the object to be held. However, in the conventional technology, it is generally necessary for an operator to specify which unit is to be used for each item. Therefore, in a logistics warehouse that may handle tens of thousands of types of items, if an operator were to specify which unit to use for each item, there is a problem that the amount of work required would be enormous.

[0007] The present invention has been made in consideration of the above circumstances, and aims to provide a picking system and a control method for a picking robot that enable workers to quickly perform picking work without having to specify the unit to be used for each item. [Means for solving the problem]

[0008] To solve the above problems, the picking system of the present invention comprises a picking robot equipped with a robot hand having a suction portion for suctioning items and a gripping portion for gripping the items, and a control unit that controls the picking work by the picking robot, and the control unit switches the picking method used by the robot hand depending on item information regarding the item to be picked.

[0009] In addition, the control method for a picking robot of the present invention for solving the above-mentioned problems is a control method for a picking robot equipped with a robot hand having a suction portion for suctioning an item and a gripping portion for gripping the item, and switches the picking method used by the robot hand depending on item information regarding the item to be picked. Effect of the Invention

[0010] According to the present invention, there is no need for a worker to specify the unit to be used for each item, and picking work can be performed quickly.

[0011] Problems, configurations, and effects other than those described above will become apparent from the following description of the mode for carrying out the invention (hereinafter, referred to as an embodiment). [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a schematic diagram showing an outline of a system configuration of a picking system. [Diagram 2] FIG. 13 is a front view showing the telescopic mechanism of the robot hand in an extended state. [Diagram 3] 1 is a block diagram showing an example of the configuration of a control system of a picking system according to a first embodiment of the present invention. FIG. [Figure 4] FIG. 11 is a diagram showing an example of item information related to an item to be picked. [Diagram 5] FIG. 4 is a diagram showing an example of item information data. [Figure 6] FIG. 13 is a diagram showing an example of an article information registration screen. [Figure 7] FIG. 13 is a diagram showing an example of upper limit data for acceleration, speed, and route altitude for each handling precaution. [Figure 8] FIG. 13 is a diagram showing an example of an operation plan result display screen. [Figure 9] 4 is a flowchart showing an example of basic processing of a picking robot control method executed in the picking system according to the first embodiment of the present invention. [Figure 10] 11 is a flowchart (part 1) illustrating an example of a process for selecting a picking method based on process definition data for each shape type, item information, and item shape. [Figure 11] 13 is a flowchart (part 2) illustrating an example of a process for selecting a picking method based on process definition data for each shape type, item information, and item shape. [Figure 12] 13 is a flowchart illustrating an example of a process for planning a transport operation of a picking robot. [Figure 13] FIG. 11 is a block diagram showing an example of the configuration of a control system of a picking system according to a second embodiment of the present invention. [Figure 14] 11 is a diagram illustrating an example of recognition processing information for each shape type. FIG. [Figure 15] 13 is a flowchart showing an example of a process for managing item information by a warehouse management system. [Figure 16] 13 is a flowchart illustrating an example of a process when item information is managed only by a picking system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functions or configurations are designated by the same reference numerals, and redundant explanations will be omitted.

[0014] <Outline of the picking system configuration> [System Configuration] 1 is a schematic diagram showing the system configuration of a picking system 1. As shown in FIG. 1, the picking system 1 includes a picking robot 10, an input conveyor 20, an output conveyor 30, an imaging device 40, and a control unit 50.

[0015] The picking robot 10 is composed of a transport robot 11 equipped with a robot hand 12. In other words, the transport robot 11 equipped with the robot hand 12 is referred to as the picking robot 10.

[0016] The carry-in conveyor 20 carries the items 100 stored in the storage cardboard boxes 110 into the working area of ​​the picking robot 10. The picking robot 10 picks up the items 100 in the storage cardboard boxes 110 carried into the working area by the carry-in conveyor 20, and transfers them to the carry-out container 60 on the carry-out conveyor 30.

[0017] The output conveyor 30 outputs the items 100 transferred to the output container 60 by the picking robot 10 to a pre-designated location. The imaging device 40 is composed of a camera, a distance sensor, etc., and captures an image of the inside of the storage cardboard box 110 in order to recognize the shape of the items 100 stored in the storage cardboard box 110, etc.

[0018] The control unit 50 includes a calculation device 51, an information storage device 52, an input device 53, and an output device .

[0019] In the control unit 50, the arithmetic device 51 is configured by, for example, a CPU (Central Processing Unit) and performs picking control of the picking robot 10, carry-in control of the carry-in conveyor 20, carry-out control of the carry-out conveyor 30, photography control of the imaging device 40, and the like.

[0020] The information storage device 52 is a non-volatile storage device such as a hard disk drive (HDD), a solid state drive (SSD), or a flash memory capable of storing digital information, or a memory device such as a random access memory (RAM) or a read only memory (ROM).

[0021] The input device 53 includes a keyboard, a mouse, a touch panel, and the like, and is used by a user (eg, a line construction worker) to input various information related to the picking work by the picking robot 10 and the like.

[0022] The output device 54 is, for example, a display device such as a liquid crystal display or an organic EL display, and displays and outputs various information related to the picking work performed by the picking robot 10 to a user (for example, a line construction person).

[0023] [About the robot hand] Fig. 2 is a front view showing the extended state of the telescopic mechanism of the robot hand 12. As shown in Fig. 2, the robot hand 12 has a hand main body 121, an adsorption part 122, a telescopic mechanism 123, a gripping part 124, a gripping driving part 125, and driving force transmission mechanisms 126A and 126B.

[0024] The hand main body 121 is attached to the transport robot 11. The suction part 122 is made of a suction pad and sucks the article 100. The extension mechanism 123 extends and retracts the suction part 122 in the axial direction of the hand main body 121 (the vertical direction in the figure). The gripper 124 is made of a first gripper 124A and a second gripper 124B. The driving force transmission mechanisms 126A and 126B support the first gripper 124A and the second gripper 124B movably in a direction perpendicular to the axial direction of the hand main body 121 (the horizontal direction in the figure), and transmit the driving force of the gripper drive part 125 to the first gripper 124A and the second gripper 124B.

[0025] According to the robot hand 12 having the above configuration, for example, the item 100 can be transferred by adsorbing and picking it up using only the suction unit 122. Also, the item 100 can be transferred by gripping and picking it up by using the gripper 124 so as to sandwich it from both sides with the first gripper 124A and the second gripper 124B. Furthermore, by using both the suction unit 122 and the gripper 124 to adsorb and lift the item 100 with the suction unit 122 and then sandwiching it from both sides with the first gripper 124A and the second gripper 124B, the item 100 can be picked up and transferred in a more stable state.

[0026] The suction portion 122 may be configured to include suction pads of a plurality of sizes. The gripping portion 124 is not limited to having two gripping portions (124A, 124B) and may be configured to include three or more gripping portions.

[0027] In the robot hand 12 configured as above, suction by the suction unit 122, gripping by the gripper 124, or suction and gripping by both the suction unit 122 and the gripper 124 are examples of picking techniques for picking the item 100. The robot hand 12 of this configuration example is a robot hand configured to be able to select any one of the techniques of suction by the suction unit 122, gripping by the gripper 124, or suction and gripping by both the suction unit 122 and the gripper 124 as the picking technique for the item 100 to be picked.

[0028] <First embodiment> [Picking system configuration example] FIG. 3 is a block diagram showing an example of the configuration of a control system of the picking system according to the first embodiment of the present invention.

[0029] (Control unit) The control unit 50 includes an arithmetic unit 51, an information storage device 52, an input device 53, and an output device 54, as well as an input / output interface control unit 55 and a communication unit 56. The arithmetic unit 51, the information storage device 52, the input device 53, the output device 54, the input / output interface control unit 55, and the communication unit 56 are configured to be able to communicate with each other via a bus line 57.

[0030] (computing device) The arithmetic device 51 has functional units, an input receiving unit 511, a picking method selecting unit 512, an operation plan calculating unit 513, and an output processing unit 514, and has a function of calculating values ​​necessary for the overall processing of the picking system 1. Each functional unit included in the arithmetic device 51 is realized by a program that causes the arithmetic device 51 to perform each process. This program is stored in the information storage device 52 and executed by the arithmetic device 51.

[0031] In the arithmetic device 51, the input reception unit 511 is a functional unit that receives input of various information input via the input device 53 or the communication unit 56. For example, the input reception unit 511 receives input of item information related to an item to be picked from the input device 53 or an external device (not shown) connected via a predetermined communication network N such as the Internet.

[0032] The item information on the item to be picked includes information such as a shape type that specifies the type of the item, and handling information on how to handle the item when transporting it. Details of the item information will be described later. The input reception unit 511 transfers the item information received from the input device 53 or an external device to a corresponding predetermined function unit.

[0033] The picking method selection unit 512 is a functional unit that selects which picking method to use for an item based on the shape type that specifies the type of item from the item information provided by the input receiving unit 511 and the processing definition data for each shape type.

[0034] The motion plan calculation unit 513 is a functional unit that creates a motion plan based on handling information regarding the handling of an item when transporting it, among other item information, so as not to exceed the upper limits of speed, acceleration, and altitude associated with the handling information.

[0035] The output processing unit 514 is a functional unit that generates screen information to be displayed on the display device when the output device 54 is, for example, a display device. For example, the output processing unit 514 creates input screen information for accepting input of item information from a user, screen information showing a selection result of a picking method, an operation plan result, etc., and displays it on the display device.

[0036] (information storage device) The information storage device 52 is a functional unit that stores predetermined information related to the control of the picking system 1, particularly the picking robot 10. Specifically, the information storage device 52 has a data storage unit 521 that stores processing definition data for each shape type of the item to be picked, a data storage unit 522 that stores item information related to the item to be picked, and a data storage unit 523 that stores each upper limit data of acceleration, speed, and route altitude for each handling precaution.

[0037] The process definition data for each shape type stored in the data storage unit 521 is data for changing the picking method and operation plan of the picking robot 10 according to the shape type of the item to be picked, and is expressed in the form of a table or a flowchart. Specific examples of the process definition data for each shape type of item will be described later.

[0038] The item information stored in the data storage unit 522 is data related to items to be picked, and has information for each item management unit. An example of an item management unit is SKU (Stock Keeping Unit). SKU is the smallest management unit when managing inventory. Even if the items are the same type, if they have different sizes, colors, packaging forms, etc., they are managed using different SKUs.

[0039] (Input Device) The input device 53 is made up of input devices such as a keyboard, a mouse, a touch panel, a barcode sensor, etc. A user (e.g., a line construction worker) operates the input device 53 to input various information related to the picking work by the picking robot 10. The barcode sensor can read identification information such as a barcode attached to the storage cardboard box 110 (see FIG. 1).

[0040] (Output device) The output device 54 is, for example, a display device such as a liquid crystal display or an organic EL display, and displays and outputs various information related to the picking work performed by the picking robot 10 to a user (for example, a line construction person).

[0041] Here, the configuration in which the output device 54 is provided within the picking system 1 has been exemplified, but it may also be provided in an external device of the picking system 1. In addition, the output device 54 is not limited to a display device, and may be a printing device such as a printer, or an audio output device such as a speaker.

[0042] (Input / output interface control unit) The input / output interface control unit 55 is a functional unit that controls communication between the input device 53 and output device 54 within the control unit 50, and the transport robot 11, the load conveyor 20, the load conveyor 30, the imaging device 40, and the robot hand 12 outside the control unit 50.

[0043] (Communications Department) The communication unit 56 is a functional unit that communicates with an external device (not shown) via a predetermined communication network N such as the Internet.

[0044] [Goods information] Fig. 4 is a diagram showing an example of item information related to an item to be picked. As shown in Fig. 4, the item information includes an SKU ID 5221, which is a unique ID for each SKU that is a management unit of the item, and an item name 5222, which is the name of the item, and is linked to the item's shape type 5223 that specifies the type of item, and handling information 5224. The handling information 5224 includes picking method designation information 5225 and handling precautions 5226.

[0045] The SKU ID 5221 and the item name 5222 may be obtained from a warehouse management system (WMS) that manages the item location, inventory, and incoming and outgoing goods in a warehouse. The shape type 5223 and the handling information 5224 may be input by an operator on an item information registration screen (see FIG. 6) described later.

[0046] 5 is a diagram showing an example of product information data. The product information data includes, for example, product information type 5227 and data example 5228. Of the product information, shape type 5223 that specifies the type of product is a type name related to the external shape of the product, and data example 5228 can include bag, box, cylinder, sphere, etc.

[0047] The handling information 5224 includes picking method designation information and handling precautions. The picking method designation information is data for directly designating which picking method is to be used to perform the picking work among the picking methods available to the robot hand 12. Examples of the data 5228 include suction by the suction unit 122, gripping by the gripping unit 124, suction and gripping by both the suction unit 122 and the gripping unit 124, etc.

[0048] The handling precautions in the handling information 5224 are data that specify the nature of the item and how it should be handled, and are information that indicates the strength of the packaging and the nature of the contents, which cannot be determined from the external shape of the item alone. Examples of data 5228 include fragile items, soft items, and dangerous items.

[0049] [Item information registration screen] Fig. 6 is a diagram showing an example of an item information registration screen. As shown in Fig. 6, an SKU ID 5221 and an item name 5222 are displayed on the item information registration screen. On the item information registration screen, the worker can input a shape type 5223, picking method designation information 5225, and handling precautions 5226 for the item with the SKU ID 5221. By pressing a registration button 5230, the input data is registered as item information and is stored in the data storage unit 522 of the information storage device 52.

[0050] 7 is a diagram showing an example of upper limit data for acceleration, speed, and route altitude for each handling instruction. The upper limit data for acceleration, speed, and route altitude for each handling instruction holds an acceleration upper limit 5233, a speed upper limit 5234, and an altitude upper limit 5235 in association with a handling instruction 5231 and a shape type 5232. When a handling instruction 5231 is specified for each item in the item information, the operation of the picking robot 10 is planned so as not to exceed the upper limits by referring to the upper limit data for acceleration, speed, and route altitude for each handling instruction 5231.

[0051] [Motion plan result display screen] Next, a description will be given of the operation plan result display screen created by the output processing unit 514. Fig. 8 is a diagram showing an example of the operation plan result display screen.

[0052] 8, the operation plan result display screen displays the processing results of the picking method selection unit 512 and the operation plan calculation unit 513 in Fig. 3. For example, when a picking method for an item is selected by the picking method selection unit 512 and then a transport operation is calculated by the operation plan calculation unit 513, or when an instruction to display the operation plan result display screen is received from the user via the input reception unit 511, the output processing unit 514 generates information for the operation plan result display screen and displays it on the display unit of the output device 54.

[0053] As shown in FIG. 8, the operation plan result display screen has an item information display area 401 for an item to be picked, and a selected picking method / operation plan display area 402.

[0054] The item information display area 401 for the item to be picked displays the SKU ID 5221, item name 5222, shape type 5223, picking method specification information 5225, and handling precautions 5226 of the target item used in the picking method selection and operation plan calculation. The item information display area 401 further displays information on upper acceleration limit 5233, upper speed limit 5234, and upper altitude limit 5235 defined from the shape type 5223 and handling precautions 5226.

[0055] The recognition result display area 403 within the item information display area 401 displays the item shape (recognition result) recognized based on the image captured by the imaging device 40 and the grasping point (grasping position) selected by the picking method selection unit 512, superimposed on the object shape (recognition result) captured by the imaging device 40 and recognized based on the image capture results.

[0056] The picking method / motion plan display area 402 displays a picking method 404 for the item selected in a picking method selection unit 512, a transport path 405 calculated by a motion plan calculation unit 513, and a maximum acceleration 406, a maximum speed 407, and a maximum height 408 when the picking robot 10 operates on the transport path 405.

[0057] The user (worker) can check whether the picking method 404 for the item displayed in the selected picking method / motion plan display area 402 is appropriate, and whether the maximum acceleration 406, maximum speed 407, and maximum altitude 408 when moving along the transport path 405 do not exceed the acceleration upper limit 5233, speed upper limit 5234, and altitude upper limit 5235. If the check shows that the method is inappropriate, the user can correct the item information on the item information registration screen shown in Fig. 6 and re-execute the processing of the picking method selection unit 512 and the motion plan calculation unit 513 to correct the plan.

[0058] <Control method for picking robot> Next, a control method for a picking robot according to an embodiment of the present invention, which is executed in the picking system 1 having the above configuration, will be described.

[0059] [Basic processing] FIG. 9 is a flowchart showing an example of a basic process of the control method for the picking robot 10 executed in the picking system 1 according to the first embodiment of the present invention.

[0060] The basic processing of the control method for the picking robot 10 executed in the picking system 1 shown in FIG. 1 is executed under the control of a calculation device 51 constituted by, for example, a CPU.

[0061] This process is initiated, for example, when a storage cardboard box 110 passes on the input conveyor 20, by the input device 53 including a barcode sensor reading identification information, such as a barcode, attached to the storage cardboard box 110 and issuing an execution instruction to the calculation device 51.

[0062] When the calculation device 51 receives an execution instruction from the input device 53, it acquires the SKU ID of the item 100 from identification information such as a barcode attached to the storage cardboard box 110, and acquires item information corresponding to the SKU ID (step S11).

[0063] Next, the computing device 51 activates the imaging device 40, such as a camera or a distance sensor, and captures an image of the article 100 in the storage cardboard box 110 using the imaging device 40 (step S21). It is assumed here that the storage cardboard box 110 contains a plurality of articles 100 of the same SKU. In step S21, information on the shape, position, orientation, and center of gravity of the article 100 can be extracted from the image information and distance information captured by the imaging device 40.

[0064] Next, the computing device 51 extracts gripping point candidates based on the shape, position, orientation, and center of gravity of the article 100 from image information and distance information captured by the imaging device 40 (step S31). Here, a process is performed to recognize the shape of each article 100 from the captured image data of the articles 100 in the storage cardboard box 110 as if they were cut into pieces.

[0065] The gripping point candidates based on the shape, position, orientation, and center of gravity of the article 100 can be obtained by matching master data that defines the features of the recognition target with the feature points of the recognition target extracted from the image of the photographed result using a well-known technique (for example, a technique described in Japanese Patent No. 7186128). Alternatively, as in a well-known technique (for example, a technique described in Japanese Patent Publication No. 2022-181142), they may be extracted from the photographed result using a similar pattern obtained from a past recognition result.

[0066] Next, the arithmetic unit 51 selects an item picking method based on the process definition data for each item shape type stored in the data storage unit 521 of the information storage device 52, the item information stored in the data storage unit 522, and the item shape extracted in step S21 (step S41). The process of step S41 will be described in detail later.

[0067] Next, the arithmetic device 51 selects one of the multiple items 100 with the highest priority based on the item picking method and item information of the item selected in step S41, and plans the transport operation of the picking robot 10 (step S51). The process of step S51 will be described in detail later.

[0068] Next, the arithmetic device 51 executes an operation of picking one article 100 from the storage cardboard box 110 and transferring it to the output container 60 on the output conveyor 30 based on the operation plan in step S51 (step S61).

[0069] Next, the arithmetic device 51 determines whether the number of items 100 transported from the storage cardboard box 110 reaches a designated number, i.e., whether the designated number of items 100 have been transported (step S71), and if the designated number has been reached (YES in S71), ends a series of processes for controlling the picking robot 10. If the designated number has not been reached (NO in S71), the process returns to step S21, and the process is repeated, starting with photographing the items 100 in the storage cardboard box 110, until the designated number has been transported.

[0070] The above-mentioned series of processes for controlling the picking robot 10 makes it possible to switch the picking method of the robot hand 12 depending on the item information on the item to be picked. This eliminates the need for the operator to specify the unit to be used for each item for the robot hand 12, thereby enabling the picking work to be performed quickly.

[0071] [Picking method selection process] Next, the specific processing of step S41 in FIG. 9, in which an item picking method is selected based on the processing definition data for each item shape type, the item information, and the item shape extracted in step S21, will be described with reference to FIG. 10 and FIG. 11.

[0072] FIG. 10 is a flowchart (part 1) showing an example of a process for selecting a picking method based on processing definition data for each shape type, item information, and item shape, and FIG. 11 is a flowchart (part 2) showing an example of a process for selecting a picking method based on processing definition data for each shape type, item information, and item shape.

[0073] The process definition data for each shape type stored in the data storage unit 521 shown in Fig. 3 is data that defines a method for determining a picking method for an item based on the shape type of the item. The process definition data for each shape type of the item can be expressed in the form of, for example, a correspondence table between shape types and picking methods, or a flowchart that determines the shape type and changes the process. In this embodiment, an example is shown in which the process definition data for each shape type is expressed in the form of a flowchart.

[0074] (Processing of the flowchart in Fig. 10) 4 from the item information for each SKU acquired in step S11 (step S411), and then determines whether or not a picking method has been designated (step S412). In this determination process, if a picking method has been designated (YES in S412), the calculation device 51 sets the designated picking method as the selection result (step S413), and ends the process for selecting a picking method.

[0075] In the judgment process of step S412, if a picking method is not specified (NO in S412), the calculation device 51 determines whether or not the shape type 5223 is registered (step S414), and if the shape type 5223 is not registered (NO in S414), it proceeds to the processing of the flowchart of Figure 11.

[0076] In the determination process of step S414, if the shape type 5223 is registered (YES in S414) and the shape type 5223 is "bag" (step S415), the calculation device 51 determines that picking by suction only is a selection result (step S416).

[0077] Next, if the robot hand 12 is equipped with suction pads of multiple sizes, the arithmetic device 51 extracts a substantially planar area from the shape of the article 100 extracted in step S31 (step S417), selects the maximum suction pad diameter that fits into the substantially planar area (step S418), and then ends the process for selecting the picking method. By the process of step S418, it is possible to specify which suction pad to use among the multiple sizes of suction pads in the robot hand 12.

[0078] In the judgment process of step S414, if the shape type 5223 is registered (YES in S414) and the shape type 5223 is "box" (step S419), the calculation device 51 first calculates the dimensions of the planar area from the shape of the item 100 extracted in step S31 (step S420), and then selects the maximum suction pad diameter that fits into the plane (step S421).

[0079] Next, the arithmetic device 51 determines whether the gripping parts 124 (first gripping part 124A and second gripping part 124B) can hold the box (step S422). Specifically, by comparing the maximum opening width of the gripping parts 124 with the short side distance of the planar dimension calculated from the shape of the article 100 extracted in step S31, it is possible to determine whether the gripping parts 124 can hold the box.

[0080] Then, if the maximum opening width of the gripping portion 124 is greater than the short side distance of the planar dimension, the calculation device 51 determines that the gripping portion 124 can grip the box (YES in S422), selects "suction and gripping" as the picking method (step S423), and then terminates the process for selecting the picking method.

[0081] In addition, if the maximum opening width of the gripping portion 124 is less than or equal to the short side distance of the planar dimension, the gripping portion 124 cannot grip the box, so the calculation device 51 selects "suction only" as the picking method (step S424) and uses the suction pad with the maximum suction pad diameter determined in step S421.

[0082] In the judgment process of step S414, if the shape type 5223 is registered (YES in S414) and the shape type 5223 is “cylinder” or “sphere” (step S425), the calculation device 51 first calculates the radius of the cylinder or sphere from the shape of the article 100 extracted in step S31 (step S426).

[0083] Next, the arithmetic device 51 judges whether or not the cylinder / sphere can be attracted by the attraction unit 122 (step S427). Specifically, by comparing the radius at which the attraction unit 122 can attract the cylinder / sphere with the radius of the cylinder / sphere calculated in step S426, it can be judged whether or not the attraction unit 122 can attract the cylinder / sphere. For example, if the radius at which the attraction unit 122 can attract the cylinder / sphere is larger than the radius calculated in step S426, it is judged that the attraction unit 122 can attract the cylinder / sphere.

[0084] When it is determined in the determination process of step S427 that the suction unit 122 can suction the cylinder / sphere (YES in S427), the calculation device 51 determines whether the cylinder / sphere can be held by the gripping unit 124 (step S428). Specifically, it is possible to determine whether the cylinder / sphere can be held by the gripping unit 124 by comparing the maximum opening width of the gripping unit 124 with the diameter calculated from the radius of the cylinder / sphere calculated in step S426.

[0085] If the calculation device 51 determines in the judgment process of step S428 that the maximum opening width of the gripping portion 124 is greater than the diameter of the cylinder / sphere and that the gripping portion 124 can hold the cylinder / sphere (YES in S428), it selects "suction and gripping" as the picking method (step S429), and then terminates the process for selecting the picking method.

[0086] Furthermore, if the calculation device 51 determines in the judgment process of step S428 that the maximum opening width of the gripping portion 124 is less than the diameter of the cylinder or sphere and the gripping portion 124 cannot grip the cylinder or sphere (NO in S428), it selects "suction only" as the picking method (step S430), and then terminates the process for selecting the picking method.

[0087] When it is determined in the determination process of step S427 that the suction unit 122 cannot suction the cylinder / sphere (NO in S427), the calculation device 51 determines whether the cylinder / sphere can be held by the gripping unit 124 (step S431). Specifically, it is possible to determine whether the cylinder / sphere can be held by the gripping unit 124 by comparing the maximum open width of the gripping unit 124 with the diameter calculated from the radius of the cylinder / sphere calculated in step S426.

[0088] If the calculation device 51 determines in the judgment process of step S431 that the maximum opening width of the gripping portion 124 is greater than the diameter of the cylinder / sphere and that the gripping portion 124 can clamp the cylinder / sphere (YES in S431), it selects "gripping only" as the picking method (step S431), and then terminates the process for selecting the picking method.

[0089] Furthermore, in the judgment process of step S431, if the maximum opening width of the gripper 124 is equal to or smaller than the diameter of the cylinder or sphere, the arithmetic device 51 judges that the gripper 124 cannot hold the cylinder or sphere (NO in S431). Then, since neither the suction unit 122 nor the gripper 124 can pick the cylinder or sphere, it determines that "picking is not possible" (step S433), and thereafter ends the process for selecting a picking method. In this case, picking is not performed by the picking robot 10, but by a worker, for example.

[0090] (Processing of the flowchart in Fig. 11) Next, the process to be performed in the case where the shape type is not registered in the determination process of step S414 (NO in S414) will be described with reference to the flowchart of FIG.

[0091] If the shape type is not registered, a picking method is selected based on the information of the gripping point candidates based on the shape, position, orientation, and center of gravity of the article extracted in step S31 from the image capture result of the imaging device 40. Here, it is assumed that the shape of the article is expressed in the form of a polygon, which is planar data of a polygon. For example, the shape information is stored in a data format such as STL.

[0092] The calculation device 51 first acquires a polygon near the gripping point candidate based on the center of gravity of the item extracted in step S31 (step S441), and then calculates the curvature near the gripping point from the vertex coordinates of the acquired polygon (step S442).

[0093] Next, when the threshold value for determining whether the area near the gripping point candidate is a plane from the curvature is ε, the calculation device 51 determines whether the curvature near the gripping point is smaller than the threshold value ε (step S443), and if the curvature is smaller than the threshold value ε (YES in S443), it determines that the area near the gripping point candidate is a plane, and calculates the planar dimensions from the object shape extracted in step S21 (step S444).

[0094] Next, the calculation device 51 selects the maximum suction pad diameter that falls within the calculated planar dimensions (step S445), and then determines whether the gripper 124 can grip the article 100 (step S446). Specifically, by comparing the maximum opening width of the gripper 124 with the short side distance of the planar dimensions, it is possible to determine whether the gripper 124 can grip a box.

[0095] Then, if the maximum opening width of the gripping portion 124 is greater than the short side distance of the planar dimension, the calculation device 51 determines that the gripping portion 124 can grip the box (YES in S446), selects "suction and grip" as the picking method (step S447), and then terminates the process for selecting the picking method.

[0096] In addition, if the maximum opening width of the gripping portion 124 is less than or equal to the short side distance of the planar dimensions, the gripping portion 124 cannot grip the box, so the calculation device 51 selects "suction only" as the picking method (step S448) and uses the suction pad with the maximum suction pad diameter determined in step S445.

[0097] If the calculation device 51 determines in the judgment process of step S443 that the curvature near the gripping point is equal to or greater than the threshold value ε (NO in S443), it determines that the area near the gripping point candidate is a cylindrical or spherical surface, and calculates the radius of the cylinder or sphere from the article shape extracted in step S21 (step S449).

[0098] Next, the arithmetic device 51 determines whether or not the vicinity of the gripping point candidate, which is a cylindrical or spherical surface, can be attracted by the suction unit 122 (step S450). Specifically, the arithmetic device 51 can determine whether or not the suction unit 122 can attract the object by comparing the radius at which the suction unit 122 can attract the object with the radius of the cylinder or sphere calculated in step S449. For example, if the radius at which the suction unit 122 can attract the object is larger than the radius calculated in step S449, it is determined that the suction unit 122 can attract the object.

[0099] When it is determined in the determination process of step S450 that the suction unit 122 can suction the cylinder / sphere (YES in S450), the calculation device 51 determines whether the cylinder / sphere can be held by the gripping unit 124 (step S451). Specifically, it is possible to determine whether the cylinder / sphere can be held by the gripping unit 124 by comparing the maximum opening width of the gripping unit 124 with the diameter calculated from the radius of the cylinder / sphere calculated in step S449.

[0100] If the calculation device 51 determines in the judgment process of step S451 that the maximum opening width of the gripping portion 124 is greater than the diameter of the cylinder / sphere and that the gripping portion 124 can hold the cylinder / sphere (YES in S451), it selects "suction and gripping" as the picking method (step S452), and then terminates the process for selecting the picking method.

[0101] Furthermore, if the calculation device 51 determines in the judgment process of step S451 that the maximum opening width of the gripping portion 124 is less than the diameter of the cylinder or sphere and the gripping portion 124 cannot grip the cylinder or sphere (NO in S451), it selects "suction only" as the picking method (step S453), and then terminates the process for selecting the picking method.

[0102] When it is determined in the determination process of step S450 that the suction unit 122 cannot suction the cylinder / sphere (NO in S450), the calculation device 51 determines whether the cylinder / sphere can be held by the gripping unit 124 (step S454). Specifically, it is possible to determine whether the cylinder / sphere can be held by the gripping unit 124 by comparing the maximum opening width of the gripping unit 124 with the diameter calculated from the radius of the cylinder / sphere calculated in step S449.

[0103] If the calculation device 51 determines in the judgment process of step S454 that the maximum opening width of the gripping portion 124 is greater than the diameter of the cylinder / sphere and that the gripping portion 124 can clamp the cylinder / sphere (YES in S454), it selects "gripping only" as the picking method (step S455), and then terminates the process for selecting the picking method.

[0104] Furthermore, in the judgment process of step S454, if the maximum opening width of the gripping parts 124 is equal to or less than the diameter of the cylinder / sphere, the arithmetic device 51 judges that the gripping parts 124 cannot hold the cylinder / sphere (NO in S454). Then, since neither the suction part 122 nor the gripping parts 124 can pick the cylinder / sphere, it determines that "picking is not possible" (step S456), and thereafter ends the process for selecting a picking method. In this case, the item will be picked by a worker, not by the picking robot 10.

[0105] The picking method selected in the process of the flowchart in Fig. 11 may be retained as picking method designation information 5225 for item 100 of the SKU ID in the item information on the item to be picked shown in Fig. 4. Also, in the determination process of step S443, if the curvature near the gripping point is 0, the picking method may be retained as "box", and if the curvature near the gripping point is not 0, the picking method may be retained as "cylinder" or "sphere" as shape type 5223 in the item information.

[0106] In this way, by storing picking method designation information 5225 for the SKU ID or shape type 5223, it can be determined that a picking method has been designated (step S412) or that shape type information is present (step S414) in the second and subsequent picking method selection processes for the same SKU ID (processing of the flowchart in FIG. 10). This is expected to reduce the calculation time in the processing of the flowchart in FIG. 11 compared to the case of calculating the shape and curvature.

[0107] Through the above series of processes, in the picking operation of item 100, a picking method such as suction by suction unit 122, gripping by gripping unit 124, or suction and gripping by both suction unit 122 and gripping unit 124 can be selected based on the processing definition data for each shape type of item 100, the item information, and the item shape extracted from the image capture results of imaging device 40 in step S21.

[0108] [Transport operation planning] Next, the process for planning the transport operation of the picking robot 10, i.e., the specific process of step S51 in Fig. 9, will be described with reference to Fig. 12. Fig. 12 is a flowchart showing an example of the process for performing the transport operation of the picking robot 10. This process is executed by the operation plan calculation unit 513 shown in Fig. 3 under the control of the arithmetic device 51.

[0109] The calculation device 51 first calculates the transport priority of multiple items 100 in the storage cardboard box 110 based on the position and grasping point of each item extracted in step S31 of Figure 9, and the picking method selected in the processing of Figure 10 (step S511).

[0110] As described above, the process of step S511 is a process for determining which item 100 in the storage cardboard box 110 is to be transported since it is assumed that the storage cardboard box 110 contains a plurality of items 100 of the same SKU. The transport priority can be determined by a calculation method such as giving priority to the item closest to the current position of the transport robot 11, or giving priority to the item placed at the top of the group of items.

[0111] Next, the arithmetic device 51 selects the item 100 with the highest priority from among the storage boxes 110 (step S512). After that, a series of operations for picking, transporting, and setting the item from the standby position of the transport robot 11 is planned for the selected item 100.

[0112] The calculation device 51 first plans the robot operation from the waiting position of the transport robot 11 to the grasping point of the item 100 with the highest priority (step S513), and then plans the picking operation at the grasping point according to the picking method selected in the processing of Figure 10 (step S514).

[0113] Next, the calculation device 51 refers to the data of the upper acceleration limit, the upper speed limit, and the upper altitude limit of the route for each handling instruction shown in FIG. 7, and obtains the upper limit values ​​of the upper acceleration limit 5233, the upper speed limit 5234, and the upper altitude limit 5235 from the handling instructions 5231 of the SKU ID and the shape type 5232 (step S515).

[0114] Next, the calculation device 51 makes a motion plan from the gripping point to the set position of the article so that the acceleration, speed, and altitude do not exceed the upper limit values ​​of the acceleration upper limit 5233, the speed upper limit 5234, and the altitude upper limit 5235 at each via point (step S516).

[0115] Next, the calculation device 51 plans installation operations at the installation position according to the selected picking method (step S517), then plans the robot operations from the installation position to the waiting position (step S518), and completes a series of processes for planning the transport operations of the picking robot 10.

[0116] By the motion plan according to the above-mentioned series of processes, a motion plan is created for transporting one item to the installation location in accordance with the handling precautions 5231 and the selected picking method. The result of this motion plan is displayed on the motion plan result display screen shown in Fig. 8, and the worker can confirm and correct it.

[0117] Thereafter, in accordance with this operation plan, in step S61 of Fig. 9, an operation of picking and transporting one item 100 from the storage cardboard box 110 is executed. Then, in step S71 of Fig. 9, this process is repeated for a specified number of items 100 in the storage cardboard box 110, thereby completing the picking work for the order.

[0118] The picking system 1 according to the first embodiment and the control method for the picking robot in the picking system 1 have been described above.

[0119] According to such a picking system 1 or picking robot control method, when using a robot hand 12 capable of multiple picking methods, it is possible to automatically select an appropriate picking method and operation plan based on the article shape, packaging strength, fragility, stability, etc. This makes it possible to transfer articles at high speed while reducing the risk of damage to the articles through stable picking.

[0120] The present invention is not limited to the first embodiment described above. Various modifications of the first embodiment described above are possible within the scope of the technical idea of ​​the present invention. For example, the photographing process in step S21 of FIG. 9 and the process of extracting gripping point candidates based on the shape, position, orientation, and center of gravity of the item in step S31 of FIG. 9 may be changed according to the shape type 5223. Also, item information regarding the item to be picked may be updated according to the result of executing the operation planned in the process of FIG. 12.

[0121] <Second embodiment> [Picking system configuration example] FIG. 13 is a block diagram showing an example of the configuration of a picking system according to the second embodiment of the present invention.

[0122] The calculation device 51 has the functional units of an input receiving unit 511, a picking method selection unit 512, an operation plan calculation unit 513, and an output processing unit 514, as well as the functional units of a recognition method calculation unit 515 that specifies an item recognition processing method for each item shape type, and an item information update calculation unit 516 that specifies the basic shape and gripping point of the item.

[0123] The information storage device 52 has a data storage section 521 for storing processing definition data for each shape type of item, a data storage section 522 for storing item information related to the items, and a data storage section 523 for storing upper limit data for acceleration, speed, and route altitude for each handling precaution, as well as a data storage section 524 for storing recognition processing information for each shape type of item.

[0124] (Recognition processing information for each object shape type) 14 is a diagram showing an example of recognition processing information for each article shape type. The recognition processing information for each article shape type has a recognition processing name 342 and information on the basic shape and gripping point 343 of the article, linked to a shape type 341. In the calculation device 51, the recognition method calculation unit 515 specifies an article recognition processing method for each article shape type 341, and the article information update calculation unit 516 specifies the basic shape and gripping point of the article.

[0125] For example, when the shape type 341 is a bag, by specifying the recognition processing method as "rule-based processing", it is possible to change the imaging type of the imaging device 40 according to the "rule-based processing", the amount of light at the time of imaging, or the threshold value of the processing of step S31 in Figure 9, i.e., the threshold value of the processing to extract candidate gripping points based on the shape, position, orientation, and center of gravity of the item.

[0126] Also, as the basic shape, for example, a basic shape for each shape type in a three-dimensional shape format such as STL data format and the gripping point position for that shape can be stored in advance. By using this basic shape and gripping point, in the process of step S31 in Fig. 9, i.e., the process of extracting gripping point candidates based on the shape, position, orientation, and center of gravity of the article, the basic shape of the article can be matched with the shape of the article photographed by the imaging device 40 to identify the gripping point at the time of picking.

[0127] Furthermore, for example, when the shape type 341 is a box, if the recognition processing method is designated as "category-based processing", it is possible to change the type of imaging device 40 and the amount of light used when capturing images, or to specify the dimensional points that need to be extracted in the process of extracting candidate gripping points based on the shape, position, orientation, and center of gravity of the article (the process of step S31 in FIG. 9).

[0128] [Item information update process] Next, a process of updating item information related to items to be picked according to the results of executing the operations planned in the process of Fig. 12 will be described. There are two possible cases for this item information update process: one in which the item information is managed by a warehouse management system (WMS) and one in which the item information is managed only by the picking system 1.

[0129] Here, a warehouse management system (WMS) is a system that supports the management of warehouse operations such as location management, inventory changes associated with incoming and outgoing goods, and the creation of delivery notes. A warehouse management system can not only standardize and streamline operations, but also reduce costs and strengthen inventory management.

[0130] [Manage product information with a warehouse management system] FIG. 15 is a flowchart showing an example of a process for managing item information by a warehouse management system.

[0131] When the item information is managed by a warehouse management system, before starting the process of operating the picking robot 10 in FIG. 9, the item information registered in the warehouse management system and the data on the upper acceleration limit, upper speed limit, and upper altitude limit of the route for each handling precaution are obtained and stored in the information storage device 52 (step S711).

[0132] Next, in the picking system 1, the arithmetic device 51 inputs handling information (step S712), and then inputs shape information or calculates it according to the process definition data for each shape type in the process of FIG. 10 (step S713).

[0133] Next, the operation is planned in the process of Fig. 12 and the transport operation is executed. At this time, if the transport fails as a result of executing the operation in the process of Fig. 12, the calculation device 51 changes the acceleration, speed, and upper altitude limit of the route and plans the operation again (step S714). Specifically, the upper acceleration limit, the upper speed limit, and the upper altitude limit of the route are set low to replan the operation so as to transport more stably.

[0134] If the transport is successful as a result of this replanning, the calculation device 51 changes the upper acceleration limit 5233, the upper speed limit 5234, and the upper altitude limit 5235 for the SKU ID in question, which are contained in the data for the upper acceleration limit, the upper speed limit, and the upper altitude limit of the route for each handling precaution, to the parameters for when the transport was successful (step S715).

[0135] Then, the arithmetic device 51 updates the item information registered in the warehouse management system, and each data of the upper limit of acceleration, the upper limit of speed, and the upper limit of altitude of the route for each handling precaution (step S716).

[0136] [Item information is managed solely by the picking system] FIG. 16 is a flowchart showing an example of a process in which item information is managed only by the picking system.

[0137] When item information is managed only by the picking system 1, the calculation device 51 acquires the item information stored in the information storage device 52, as well as the data on the upper acceleration limit, upper speed limit, and upper altitude limit of the route for each handling precaution (step S811).

[0138] Then, the arithmetic device 51 executes each process from step S812 to step S815 in order. Each process from step S812 to step S815 is the same as the process from step S712 to step S715 when the article information is managed by a warehouse management system. That is, if the operation is executed and the conveyance fails, the upper limit values ​​are changed and replanned, and the upper limit of acceleration 5233, the upper limit of speed 5234, and the upper limit of altitude 5235 for the SKU ID in the data of the upper limit of acceleration, the upper limit of speed, and the upper limit of altitude of the route for each handling precaution are changed to the parameters for successful conveyance.

[0139] Finally, the arithmetic device 51 updates the article information stored in the information storage device 52, and each of the data on the upper limit of acceleration, the upper limit of speed, and the upper limit of altitude of the route for each handling precaution (step S816).

[0140] <Modification> The present invention is not limited to the above-described embodiment, and various other applications and modifications are possible without departing from the gist of the present invention as described in the claims. For example, the above-described embodiment describes the system configuration in detail and specifically in order to explain the present invention in an easy-to-understand manner, and is not necessarily limited to a system having all of the described configurations. In addition, it is also possible to add, delete, or replace part of the configuration of this embodiment with other configurations. [Explanation of symbols]

[0141] 1...picking system, 10...picking robot, 11...transport robot, 12...robot hand, 20...input conveyor, 30...output conveyor, 40...imaging device, 50...control unit, 51...arithmetic unit, 52...information storage device, 53...input device, 54...output device, 55...input / output interface control unit, 56...communication unit, 57...bus line, 60...output container, 110...storage cardboard, 121...hand main body, 122...suction unit, 123...extension mechanism, 124...gripping unit, 124A...first gripping unit, 124B...second gripping unit, 125...gripping drive unit, 126A, 126B...driving force transmission mechanism, 511...input reception unit, 512...picking method selection unit, 513...motion plan calculation unit, 514...output processing unit, 515...recognition method calculation unit, 516...item information update calculation unit

Claims

1. a picking robot including a robot hand having a suction portion for suctioning an item and a gripping portion for gripping the item; A control unit that controls a picking operation by the picking robot; Equipped with The control unit switches a picking method by the robot hand in accordance with item information related to an item to be picked. Picking system.

2. The control unit sets, according to the item information, one of the following picking methods: suction by the suction unit, gripping by the gripping unit, or suction and gripping by both the suction unit and the gripping unit. The picking system according to claim 1 .

3. The article information includes shape type information that specifies the type of the article, and handling information regarding how to handle the article when transporting it. The picking system according to claim 2 .

4. The item information includes handling information, shape type information, and picking method designation information that indicate the characteristics of the item for each type of item. The picking system according to claim 3.

5. Further, a photographing device is provided for photographing an item to be picked, The control unit acquires a gripping point candidate based on a shape, a position, a posture, and a center of gravity of an article from a photographing result of the imaging device, and selects the picking method according to a shape in the vicinity of the gripping point candidate. The picking system according to claim 3.

6. The processing definition data for each shape type of the article is included, The control unit selects the picking method based on the process definition data, the item information, and an item shape extracted from the image capture result of the imaging device. The picking system according to claim 5.

7. Further, a photographing device is provided for photographing an item to be picked, The recognition processing information is provided for each shape type including the basic shape of the article, The control unit matches a basic shape of the article with a shape photographed by the photographing device to specify a gripping point at the time of picking. The picking system according to claim 3.

8. A method for controlling a picking robot equipped with a robot hand having a suction portion that sucks an item and a gripping portion that grips the item, comprising: A picking method by the robot hand is switched according to item information regarding the item to be picked. A method for controlling a picking robot.

Citation Information

Patent Citations

  • Robot picking system and picking method by robot

    JP2023015567A

Cited By

  • Hybrid gripper control system and hybrid gripper control method using same

    WO2026121650A1