Control device and control method for robot system

The control device and method for robot systems optimize pallet handling by coordinating robot operations using data acquisition and control sequences, addressing the lack of sophistication in existing systems to automate complex tasks and improve storage efficiency.

JP7579529B2Active Publication Date: 2024-11-08MUJIN INC
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
JP2020016803
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-05-31
Filing Date
2020-02-04
Publication Date
2024-11-08
Estimated Expiration
2039-11-19

AI Technical Summary

Technical Problem

Existing robot systems lack the sophistication to perform complex tasks, requiring human intervention for efficient handling and storage of objects with varying attributes, leading to insufficient automation and functionality.

Method used

A control device and method for a robot system that includes a robot controller, data storage, and sensors to manage and coordinate the loading and unloading of objects onto pallets, utilizing data acquisition and control sequences to optimize pallet utilization and handling efficiency, even with mixed SKU loads.

Benefits of technology

Enhances the automation and sophistication of robot systems by improving pallet loading rates, reducing waste, and increasing storage efficiency through coordinated unit operations and accurate object identification.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007579529000001
    Figure 0007579529000001
  • Figure 0007579529000002
    Figure 0007579529000002
  • Figure 0007579529000003
    Figure 0007579529000003
Patent Text Reader

Abstract

To enhance handling and storage efficiency for operation objects of different attributes.SOLUTION: A controller for a robotic system including an operation robot to manipulate an operation object to load the operation object onto a pallet and / or unload the operation object from the pallet comprises: a data acquiring unit for acquiring first data including information about the operation object and information about the pallet before loading the operation object onto the pallet and / or unloading the operation object from the pallet; a data storage unit for storing the first data; and a robot control unit for, e.g., creating a control sequence for loading the operation object onto the pallet and / or unloading the operation object from the pallet based on the first data before loading the operation object onto the pallet and / or unloading the operation object from the pallet, and instructing the robot to execute a task for loading the operation object onto the pallet and / or unloading the operation object from the pallet based on the control sequence.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure generally relates to a robot system, and more particularly to a control device, a control method, a logistics system, a program, and a recording medium for a robot system that manipulates an object such as an article. [Background technology]

[0002] Many robots (e.g., machines configured to perform physical actions automatically / independently) are now widely used in many fields due to their ever-improving performance and decreasing cost. For example, robots can be used to perform various tasks, such as maneuvering and moving objects in manufacturing, assembly, packaging, transporting, conveying, shipping, etc. In performing tasks, robots can repeat human actions, thereby replacing or reducing dangerous or repetitive tasks performed by humans.

[0003] As an example of a system using such a robot (robot system), Patent Document 1 proposes an automated logistics system that includes a transport container storage mechanism that temporarily stores transport containers, and an automatic item sending mechanism that automatically collects items in the transport container into a shipping container based on shipping information, in order to automate and reduce the labor required for the process from receiving to shipping items. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2018-167950 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, despite technological advances, robots often lack the sophistication required to replicate human involvement to perform larger and / or more complex tasks. As a result, automation and sophistication in robotic systems are still insufficient, and there are many tasks for which it is difficult to replace human involvement, and it has been difficult to sufficiently improve, for example, the ease of handling and storage efficiency of objects with different attributes. Thus, there remains a need for technological improvements to manage various actions and / or interactions between robots and further promote automation and sophistication of robotic systems. Thus, the present disclosure aims to provide a control device and a control method for a robotic system that can realize advanced cooperation between units including robots and can sufficiently improve, for example, the ease of handling and storage efficiency of objects with different attributes. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems, the present invention employs the following configuration.

[0007] [1] In other words, the control device according to the present disclosure is a device for controlling a robot system including an operating robot that operates an operation object to load the operation object onto a pallet (palletizing) and / or unload the operation object from a pallet (depalletizing), such as a palletizing robot, depalletizing robot, piece picking robot, fetching robot, devanning robot, or the like, for operating an item using a robot arm and an end effector, etc. The control device includes: (1) a data acquisition unit that acquires first data including information about the operation object and information about the pallet before loading the operation object onto the pallet and / or unloading the operation object from the pallet; (2) a data storage unit that stores the first data; and (3) a robot control unit that creates or acquires a control sequence for loading the operation object onto the pallet and / or unloading the operation object from the pallet based on the first data before loading the operation object onto the pallet and / or unloading the operation object from the pallet, and commands the operation robot to execute a task for loading the operation object onto the pallet and / or unloading the operation object from the pallet based on the control sequence.

[0008] Here, the term "operation target" refers to an object operated by an operating robot provided in a robot system, and includes, for example, one or more items, and containers such as bins, containers, and boxes in which the items are placed or stored. The containers may be packed or unpacked, and a part of the container (for example, the top surface) may be open. In other embodiments and examples, the term "operation target" may be a concept including shelves, pallets, conveyors, and other temporary storage areas. Furthermore, a "pallet" refers to a loading platform having a surface on which a unit quantity of items is loaded in order to load, transport, and store the items, and examples of such a loading platform include a flat pallet, a box pallet, and a post pallet, and may or may not have an insertion port for a fork or the like. Furthermore, "information about an item" and "information about a pallet" refer to information associated with identification information of an item and information associated with identification information of a pallet, respectively. Furthermore, a "control sequence" refers to a sequence of operations that is preset when controlling one or more units provided in a robot system to execute individual tasks (a robot is a type of "unit"). Furthermore, "before" refers to a point in time or an earlier point in time, and "after" refers to a point in time or an earlier point in time.

[0009] In addition, the "information about the operation target" includes at least the location information of the operation target and the "Stock Keeping Unit (SKU)" information of the operation target. The "Stock Keeping Unit (SKU)" refers to the smallest management unit when ordering and managing the inventory of the operation target. For example, even the same operation target can be distinguished by differences in attributes such as packaging, number of pieces, and content volume, and the operation target can be classified into units smaller than the operation target unit by SKU. For example, if the operation target is an item of clothing and the same clothing has three colors and four sizes, S, M, L, and LL, it is considered to have "12 SKUs." Note that SKUs can be freely set by businesses, and SKUs may be set without distinguishing between colors and sizes. However, it is generally considered that SKUs should be distinguished and managed in the following cases (Distribution System Development Center: GTIN Setting Guidelines ~GTIN Allocation Guidelines Revised Edition~ December 2018 Edition, p. 10).

[0010] When there are elements in the transaction that require the item to be distinguished as a separate item - When you want to appeal to consumers the differences in your products - If you want to analyze product sales separately (example) - Different sizes: large bag, medium bag, small bag - When the net content (weight, capacity, quantity, etc.) is different: 100g, 200g, 500ml, 650ml - Different packaging formats: bagged, canned, bottled Different colors: Pink, Blue, White · Different flavors: curry flavor, barbecue flavor - Different scents: Jasmine, Bouquet * Sales units may vary: 3 pieces, 5 pieces, 15 pieces Set products with different contents (combinations): Set of 2 seasonings and 3 bottles of cooking oil, Set of 3 seasonings and 2 bottles of cooking oil

[0011] According to this configuration, before stacking the operation object on a pallet and / or unloading the operation object from the pallet, information on each of the operation object and the pallet is grasped, and a task is executed based on a control sequence that is created based on the first data including the information. Therefore, the operation of stacking the operation object on a pallet and / or unloading the operation object from the pallet can be efficiently and smoothly performed.

[0012] [2] In the above configuration, the data acquisition unit may acquire second data including information about the operation object and information about the pallet after loading of the operation object onto the pallet and / or unloading of the operation object from the pallet, and the data storage unit may be configured to store the second data.

[0013] According to this configuration, after the operation object is loaded onto the pallet and / or the operation object is unloaded from the pallet, information on each of the operation object and the pallet can be obtained. This makes it possible to reliably grasp and track the state or condition of the pallet after the operation object is loaded onto and / or unloaded from the pallet.

[0014] [3] In the above configuration, the robot control unit may be configured to create or acquire the control sequence based on the first data and / or the second data so as to load multiple types of operation objects having different SKUs onto the pallet.

[0015] According to this configuration, the operation targets to be loaded onto the pallet and the SKUs of the operation targets loaded onto the pallet can be grasped from the first data and the second data, so that even if operation targets with different SKUs are loaded onto the same pallet (so-called mixed loading), it is possible to monitor and track the loading status of these operation targets. Therefore, it is possible to increase the loading rate of the pallet and improve the utilization efficiency of the pallet. In addition, since the filling information / vacancy information of the pallet can be grasped, in the next step, it is possible to efficiently select a pallet when loading the operation targets onto the pallet and / or unloading the operation targets from the pallet. Furthermore, it is possible to prevent the wasted space on the pallet from being fragmented (defragmentation), and it is possible to further facilitate the centralized management of the position information of the operation targets and the pallet.

[0016] [4] In the above configuration, the control sequence may be created or acquired so that the arrangement of the operation objects having the same or similar stock keeping unit (SKU) on the pallet is consolidated based on the first data and the second data. Here, "similar" means that a predetermined number or more of attributes that define the SKU (such as color and size as described above) are common. This configuration also includes a case where only operation objects having the same or similar SKU are loaded on the same pallet (so-called single loading), and a case where operation objects having different SKUs are loaded on the same pallet (so-called mixed loading), and in the case of mixed loading, operation objects having the same or similar SKU can be consolidated and loaded (for example, stacked vertically, etc.).

[0017] According to this configuration, the SKUs of the operation objects to be loaded onto the pallet and the operation objects loaded onto the pallet can be ascertained from the first data and the second data, making it easier to aggregate and place operation objects having the same or similar SKUs on the pallet. As a result, regardless of whether the operation objects are single-loaded or mixed-loaded, the loading rate of the pallet can be increased and the utilization efficiency of the pallet can be improved. In addition, since operation objects having the same or similar SKUs are aggregated, the next step of loading the operation objects onto the pallet and / or selecting a pallet when unloading the operation objects from the pallet can be efficiently performed.

[0018] [5] In the above configuration, the robot control unit may be configured to calculate an index indicating the ease of handling when unloading the operation object from the pallet based on the second data, and to create or acquire the control sequence including the identification of the operation object and the pallet on which the operation object is loaded based on the index. Here, "handleability" indicates the difficulty of the task of operating the operation object by the robot, and is not particularly limited, but specifically includes, for example, the difficulty of the operation robot gripping the operation object loaded on the pallet, the difficulty of moving the operation object gripped by the operation robot (complexity of the path, etc.), etc. In addition, the "index" may be quantitatively quantified, or may be qualitatively, for example, ranked, etc.

[0019] According to this configuration, when there are multiple candidates for the operation target to be unloaded, a pallet loaded with the operation target that is easy for the operating robot to operate and the operation target can be selected based on an index indicating handleability. This makes it easier for the robot to more reliably grasp and move the operation target to be unloaded, thereby improving work efficiency and work accuracy (success rate).

[0020] [6] In the above configuration, the data storage unit may be configured to store position information (placement information) of the multiple operation objects on the pallet on an operation object basis or on a pallet basis, and as two-dimensional information or three-dimensional information.

[0021] According to this configuration, the positions of the operation targets placed on the pallet can be grasped for each operation target or for each layer. In addition, the arrangement of the multiple operation targets stacked on the pallet can be managed in a unified manner as two-dimensional information or three-dimensional information. Therefore, for example, by identifying one operation target, it is possible to identify all the operation targets loaded on the pallet at once. As a result, for example, the number of work steps required for inventory management and stocktaking can be reduced, improving work efficiency.

[0022] [7] In the above configuration, the robot system may further include a sensor that captures an image of the object to be operated or the pallet on which the object to be operated is loaded, and the robot control unit may be configured to create or acquire the control sequence for loading the object to be operated on the pallet so that the sensor can measure identification information of the object to be operated (an identification code or an identification tag representing the identification information).

[0023] According to this configuration, even when the operation target is loaded on the pallet, the identification information of the operation target can be measured and confirmed by a sensor. In this case, if the identification information of the operation target is attached at least to the side, the identification information can be exposed so as to be visible even when the operation target is stacked on the pallet, so that the identification information attached to the operation target can be easily recognized by, for example, capturing an image of the identification information with a sensor such as a camera. Therefore, even when the operation target is loaded on the pallet, the operation target can be easily identified and specified. At this time, if the position information of multiple operation targets on the pallet is stored as two-dimensional information or three-dimensional information as described in [6] above, by specifying one operation target, the operation targets loaded on the pallet can be more easily specified collectively by pallet. As a result, the efficiency of inventory management and stocktaking can be further improved.

[0024] [8] In the above configuration, the robot control unit may be configured to determine that loading of the operation object onto the pallet and / or unloading of the operation object from the pallet is completed before loading of the operation object onto the pallet and / or unloading of the operation object from the pallet is completed.

[0025] According to this configuration, it is possible to determine the completion of loading and / or unloading of the operation target onto the pallet before the loading and / or unloading of the operation target from the pallet is completed. Therefore, the operation of the task to be executed as the next step can be started smoothly and timely, preventing the occurrence of work delays and enabling a high level of cooperation between units.

[0026] [9] In the above configuration, the data acquisition unit may be configured to acquire actual measured values ​​or estimated values ​​of information related to the operation object and / or information related to the pallet. This makes it possible to confirm the position of the operation object on / off the pallet, the position of the pallet, and the position of the identification information attached to the operation object by actually measuring it with a sensor such as a camera, or to estimate it based on master data without actually measuring it.

[0027]

[10] Furthermore, a logistics system according to the present disclosure includes a control device having the above-described configurations and a robot system including the operation robot.

[0028]

[11] In the above configuration, the control device may be configured to identify the robot system and an area associated with the robot system, and calculate tasks (including unit tasks and tasks formed by combining multiple unit tasks) based on the control sequence, the tasks including tasks related to the transportation of the pallet by the robot system and the manipulation of the object, as well as multiple tasks executed by the robot system across adjacent and / or overlapping areas.

[0029]

[12] Furthermore, the program according to the present disclosure is configured as a program for causing a computer to function as a control device for each of the above configurations.

[0030]

[13] Furthermore, a recording medium according to the present disclosure is configured as a non-transitory computer-readable recording medium having the above program recorded thereon.

[0031]

[14] A control method according to the present disclosure is a control method for a robot system including an operating robot that operates an operating object to load the operating object onto a pallet and / or unload the operating object from a pallet, the control method being executed by a control device having a data acquisition unit, a data storage unit, and a robot control unit, and (1) the data acquisition unit acquires first data including information on the operating object and information on the pallet before loading the operating object onto the pallet and / or unloading the operating object from the pallet, (2) the data storage unit stores the first data, and (3) the robot control unit creates or acquires a control sequence for loading the operating object onto the pallet and / or unloading the operating object from the pallet based on the first data before loading the operating object onto the pallet and / or unloading the operating object from the pallet, and commands the operating robot to execute a task for loading the operating object onto the pallet and / or unloading the operating object from the pallet based on the control sequence. [Brief description of the drawings]

[0032] [Figure 1] FIG. 1 is a schematic flow diagram illustrating an exemplary task sequence in which a robotic system may operate according to an embodiment of the present disclosure. [Diagram 2] 1A and 1B are perspective views that diagrammatically illustrate an exterior of an exemplary transport robot in accordance with one or more embodiments of the present disclosure. [Diagram 3]FIG. 1 is a perspective view illustrating a schematic appearance of an exemplary operational robot in accordance with one or more embodiments of the present disclosure. [Figure 4] 1A and 1B are perspective views that generally illustrate the appearance of an exemplary operational robot in one or more embodiments of the present disclosure. [Diagram 5] FIG. 2 is a block diagram illustrating an example of a hardware configuration and a functional configuration of a robot system according to an embodiment of the present disclosure. [Figure 6] 1 is a front view (partial functional configuration diagram) showing an example of a flow of work executed by a robot system according to an embodiment of the present disclosure, and an example of a functional configuration of a control device provided in the robot system. FIG. [Figure 7] FIG. 11 is a flow diagram illustrating an example of a procedure for operating a robot system according to an embodiment of the present disclosure to execute a first task. [Figure 8] FIG. 11 is a flow diagram illustrating an example of a procedure for operating the robot system according to the embodiment of the present disclosure to perform a second task. [Figure 9] FIG. 1 is a schematic plan view illustrating an exemplary environment in which a robotic system according to an embodiment of the present disclosure may operate. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0033] According to the present disclosure, there are provided a robot system in which multiple units (e.g., various robots, various devices, and control devices provided integrally or separately therefrom) are highly integrated, a control device thereof, a logistics system including the same, and a method therefor, etc. That is, a robot system according to an embodiment of the present disclosure is, for example, an integrated system that can autonomously execute one or more tasks.

[0034] Here, "task" may include, for example, a task for a robot or the like to access the operation objects, a task for moving, storing, safekeeping, retrieving, organizing, etc., the operation objects from one location to another, a task for classifying the operation objects into multiple groups, a task for imaging, observing, and managing the operation objects, etc.

[0035] Furthermore, a "task" may include a combination of a plurality of tasks executed in the warehousing of operation objects in a logistics system (receiving, transporting, loading (palletizing), unloading (depalletizing), storing, etc.), replenishment of operation objects (opening, filling, refilling, etc.), and release of operation objects (removal, picking up, packing, loading, palletizing, etc.). Furthermore, a "task" may include, for example, grasping or lifting an operation object at a designated position, moving it along a designated route, and releasing, lowering, or placing it at a designated position in order to rearrange, change, replace, etc., the operation object.

[0036] Furthermore, the robot system according to the present disclosure can access the operation target via a plurality of units such as robots, and thus the robot system can automate the work of the warehousing process, replenishment process, and outgoing process of the operation target. Furthermore, the robot system according to the present disclosure can appropriately classify (group) the operation targets based on, for example, differences in SKUs, move or place them at a target position or a designated location, access the operation targets, and rearrange or reclassify them at that location or to another location, and rearrange or replace them according to the characteristics of the operation targets. In this case, the robot system can read one or more identification information (e.g., a barcode or a Quick Response (QR) Code (registered trademark), etc.) attached to one or more specific positions or surfaces of the operation target and compare it with master data as necessary to identify and / or specify the operation target and obtain information associated with the item, etc.

[0037] Furthermore, the robot system according to the present disclosure may include a sensor such as an image sensor for identifying the position and state (e.g., orientation, etc.) of the operation target and / or the surrounding environment of the operation target. The image sensor can acquire images of the work positions (e.g., pick-up position, drop position, position along the path, etc. of the operation target) in the tasks executed by each unit of the robot system, and images of the operation target at each position. Furthermore, the robot system according to the present disclosure may process images of the operation target according to a predetermined order (e.g., from the top to the bottom of the operation target, from the outer edge, from the inside, etc.). In this case, the state or situation of the operation target may be appropriately determined by identifying or classifying the outer shape or environment of the operation target based on, for example, the color, brightness, or changes in the values ​​of adjacent pixels in the image of the operation target.

[0038] The robot system according to the present disclosure can acquire and execute control sequences for executing tasks such as accessing and operating an object to be operated, and tasks such as transporting, moving, placing, and storing the object to be operated. Such control sequences may include combinations of basic control sequences for driving the operating mechanisms of each unit. The robot system can create or acquire control sequences for executing various tasks by, for example, motion planning, machine learning such as deep learning, and the like.

[0039] Here, for example, in a conventional robot system used in a typical logistics system, when performing tasks related to the storage, replenishment, and release of an operation target, it is not possible to perform advanced interactions between multiple units sufficiently, and the assistance of an operator is often indispensable between different tasks that are performed consecutively. In addition, for example, in a conventional robot system, it is possible to access an operation target in response to an order, but it is often necessary for an operator to classify or sequence the ordered items. Furthermore, in a conventional robot system, for example, when changing a unit that operates an operation target or changing an operation procedure of an operation target, it is often difficult to change them through autonomous dialogue between units. In particular, when a unit that requires work including a task that requires the intervention or assistance of an operator is included, it is extremely difficult to autonomously or automatically change the control sequence. Furthermore, in the past, when loading operation targets on a pallet, it was difficult to automate the task of mixing operation targets with different SKUs on the same pallet, and the intervention of an operator was required, which hindered the full automation of a logistics system.

[0040] Furthermore, in conventional robot systems, a task such as grasping an object to be operated at a certain position, moving it to another position in that state, and releasing it is executed as a basic control sequence. However, such basic operations alone cannot be said to have sufficiently improved the storage efficiency of the object to be operated and the work efficiency of each unit. In particular, from the viewpoint of improving the storage efficiency of the object to be operated, there are cases where intervention or support by an operator (adjustment, redoing, supplementation, system shutdown, etc.) is required.

[0041] In contrast, the robot system according to the present disclosure in various embodiments exemplified below, unlike the conventional ones, can adjust and control the interaction between separate units (e.g., an operation robot and a transport robot, etc.) to execute a task, and can cooperate with the different units. This reduces the intervention and assistance of an operator that was previously required, and can improve the storage efficiency, work efficiency, and economy of the operation targets. In addition, by acquiring and managing information about the operation targets and pallets at appropriate times when palletizing and depalletizing the operation targets, it is possible to automate the task of mixing operation targets with different SKUs on the same pallet.

[0042] In addition, the robot system according to the present disclosure can reliably identify the motion area, motion path, position or state of the target, or a combination thereof, for each unit, and can execute tasks executed by different units smoothly and cross-sectionally. In addition, in this case, the storage efficiency of the target can be optimized based on shape information, identification information, position information, etc. of the target, so that the space utilization efficiency can be further improved. To this end, the robot system according to the present disclosure can create or obtain a suitable control sequence that can realize a highly coordinated operation of each unit based on one or more algorithms that order the tasks of different units, one or more protocols that control the interaction between the units, and information on the state of the target, and execute the control sequence.

[0043] Hereinafter, an embodiment according to an example of the present disclosure will be described with reference to the drawings. However, the embodiment described below is merely an example, and is not intended to exclude the application of various modifications and technologies not specified below. That is, an example of the present disclosure can be implemented by various modifications within the scope of its purpose. In addition, in the description of the drawings below, the same or similar parts are given the same or similar symbols, and the drawings are schematic and do not necessarily match the actual dimensions, ratios, etc. Furthermore, there may be parts in which the dimensional relationship and ratios differ between the drawings. In addition, it goes without saying that the embodiments described below are some embodiments of the present disclosure, and not all embodiments. Furthermore, other embodiments that can be obtained by a person skilled in the art without requiring creative acts based on the embodiments of the present disclosure are all included in the scope of protection of the present disclosure.

[0044] Also, in each embodiment, the technology introduced herein may be implemented without those specific details. Moreover, well-known functions, such as specific functions or routines, are not described in detail to avoid unnecessarily obscuring the present disclosure. Also, well-known structures or processes often associated with robotic systems and subsystems may not be described in detail for the purpose of clarity. References herein to "an embodiment," "one embodiment," and the like mean that the particular feature, structure, material, or characteristic described is included in at least one embodiment of the present disclosure. Thus, appearances of such phrases herein do not necessarily all refer to the same embodiment. However, such references are not necessarily mutually exclusive. Moreover, particular features, structures, materials, or characteristics may be combined in any suitable manner in one or more embodiments. It should be understood that the various embodiments shown are merely illustrative representations and are not necessarily drawn to scale.

[0045] Additionally, many embodiments or aspects of the present disclosure may take the form of computer-executable or controller-executable instructions, including processes, steps, routines, blocks, etc., executed by a programmable computer or controller. Those skilled in the relevant art will appreciate that the techniques of the present disclosure may be implemented in computer or controller systems other than those shown in the embodiments. The techniques described herein may be implemented in a special purpose computer or data processor that is programmed, configured, or constructed to execute one or more computer-executable instructions described below.

[0046] Thus, the terms "computer" and "controller" as generally used herein include any data processor, including Internet appliances and handheld devices, including palmtop computers, wearable computers, cellular or mobile telephones, multiple processor systems, processor-based or programmable consumer electronics appliances, network computers, minicomputers, etc. Information manipulated by these computers and controllers may be provided to any suitable display medium, including, for example, a liquid crystal display (LCD).

[0047] Instructions for performing computer or controller executable operations may be stored on any suitable computer-readable non-transitory storage medium, including hardware, firmware, or a combination of hardware and firmware, and may be contained in any suitable memory device, including, for example, a flash drive, and / or other suitable media.

[0048] The terms "coupled" and "connected" and the like may be used to describe a structural relationship between components. However, these terms are not intended to be synonymous with each other. Specifically, in certain embodiments, "connected" may be used to indicate that two or more elements are in direct contact with each other. Unless otherwise clear from the context, the term "coupled" may be used to indicate that two or more elements are in direct or indirect contact with each other (with other intervening elements between them), or that two or more elements cooperate or interact with each other (e.g., in a causal relationship, such as with respect to signal transmission / reception or function calls), or both.

[0049] [Example of application] 1 is a schematic flow diagram showing an exemplary operation sequence of a logistics system including a robot system according to an embodiment of the present disclosure. The operation sequence includes, for example, an in-stock process P10 for receiving operation objects (in this embodiment, for example, containers such as carton boxes containing items) into a logistics center or the like, a replenishment process P20 for replenishing and storing operation objects placed on, for example, pallets, on, for example, racks, and a shipping process P30 for picking up ordered items from the operation objects replenishing and storing them on the racks and shipping them out of the warehouse.

[0050] In the warehousing process P10, first in step S101, the operation object brought in by a vehicle or the like is received and unloaded using, for example, a devanning robot. In step S102, the operation object is transported by a conveyor or the like to a waiting position for a pallet for transfer, for example, using a sorting system. Next, in step S103, the transported operation object is stacked on an appropriate pallet by, for example, a palletizing robot.

[0051] In the replenishment process P20, in step S104, the pallet on which the operation object is loaded is transported to a position for unpacking the operation object, for example, using a pallet AGV (automated guided vehicle configured to mount or lift and move a pallet), and the operation object is unpacked from the pallet by, for example, a depalletizing robot. In step S105, the operation object is unpacked by cutting (top cutting) the top surface of the operation object to open the top surface, for example, using a top cutting machine, and the operation object is transported to a standby position of a storage rack by a conveyor or the like. Next, in step S106, the operation object is stored in an appropriate position on the rack, for example, using a fetching robot, and is transported to a storage position on the rack by, for example, a rack AGV (automated guided vehicle configured to mount or lift and move a rack), and is stored in an appropriate state.

[0052] In the outgoing process P30, when an order for an item is received, in step S107, a rack containing the operation object containing the ordered item is transported to a pick-up position, for example, using a rack AGV, and the desired operation object is picked up from the rack, for example, by a fetching robot. In step S108, the ordered item is picked up from the operation object, for example, by a piece-picking robot, and transferred to a shipping container or the like. Then, in step S109, the shipping container or the like is packed, for example, using a packing machine, and in step S110, the packed shipping container is loaded onto, for example, an appropriate cart or vehicle, and is outgoing (shipped).

[0053] As such, the robot system according to an embodiment of the present disclosure may include a de-vanning robot, a palletizing robot, a fetching robot, a piece-picking robot, a packing machine, etc. as an operation robot that is a transfer / sorting unit configured to perform an operation for moving an operation target between different locations. In addition, the robot system according to an embodiment of the present disclosure may include a sorting system, a pallet AGV, a rack AGV, etc. as a transport robot that is a transport unit.

[0054] 2(A) and (B) are perspective views that are schematic diagrams illustrating the exterior of exemplary transport robots 11 and 12 in one or more embodiments of the present disclosure. The transport robots 11 and 12 may include mobile / wheeled robots such as rack AGVs configured to transport pallets between predetermined positions. For example, the transport robots 11 and 12 may have external dimensions that enable them to move under and / or between pallets. The transport robots 11 and 12 may also include lifting mechanisms (forks) configured to lift the pallets from the ground (transport path surface).

[0055] The transport robots 11 and 12 can be guided and steered (navigated) by various mechanisms. For example, the transport robots 11 and 12 can move on their own to follow a predetermined path, for example, a floor marking (e.g., paint, tape, etc.), based on a command from a control device of the robot system in the embodiment of the present disclosure. The transport robots 11 and 12 can also calculate a current position via a mapping / positioning mechanism (e.g., a dead reckoning system, a laser-based system, and / or a wireless communication signal-based system), and can move along a specified path and route based on the current position.

[0056] In addition, the robot system in the embodiment of the present disclosure can transmit the target position of the pallet to be transported, the holding position of the pallet, the identification information of the pallet, the path, the motion plan, or a combination thereof, to the transport robot 11, 12, for example, via a control device as a standalone device or part of another unit. Based on the communication command information, the transport robot 11, 12 can execute a task such as moving to the holding position of the pallet to be transported, lifting the pallet, transporting the pallet to a specified position, and / or placing the pallet at a specified position. Furthermore, the transport robot 11, 12 can execute or complete a task by returning the pallet to be transported, for example, to the original holding position or a different storage position.

[0057] 3 and 4 are respectively a perspective view and a side view that show a schematic external view of an exemplary manipulation robot 13, 14 in one or more embodiments of the present disclosure. The manipulation robot 13, 14 may include, for example, a robot configured to transfer a manipulation target 16 (see FIG. 4) between predetermined positions. For example, the manipulation robot 13, 14 has structural members such as a gripper that can grip the manipulation target by reduced pressure or vacuum suction, a hand-type end effector 131, 141 for picking, and a robot arm 132, 142 to which the end effector is attached. This allows the manipulation robot 13, 14 to grip the manipulation target from above or laterally. In addition, the manipulation robot 13, 14 may be fixed at a predetermined position or may be movably provided. In addition, the end effector 141 of the manipulation robot 14 may have a plate-shaped guide or the like for supporting (holding) the manipulation target 16 from below, like a so-called debanning gripper, and functions suitably as a debanning robot or a fetching robot.

[0058] The operation robots 13 and 14 can be driven based on, for example, a command from a control device of the robot system in the embodiment of the present disclosure. The operation robots 13 and 14 can also calculate the current position of the operation target, and can operate the operation target along a specified path and route based on the current position. The robot system in the embodiment of the present disclosure can transmit the target position and pick-up position of the operation target, the identification information of the operation target, the path, the motion plan, or a combination thereof, to the operation robots 13 and 14, for example, via a control device as a standalone device or as part of another unit. Based on the communication command information, the operation robots 13 and 14 can perform tasks such as moving the end effectors 131 and 141 to a gripping position of the operation target, gripping and lifting the operation target, transporting it to a specified position, and / or placing it at a specified position.

[0059] [Configuration example] 5 is a block diagram showing an example of a hardware configuration and a functional configuration of a robot system according to an embodiment of the present disclosure. For example, the robot system 500 may include electronic / electrical devices such as a processor 502, a storage device 504, a communication device 506, an input-output device 508, an actuation device 512, a transport motor 514, a sensor 516, or a combination thereof. The robot system 500 may include one or more of each of these elements and devices.

[0060] Additionally, each of these elements and devices may be coupled to one another via wired and / or wireless connections. For example, the robotic system 500 may include a bus such as a system bus, a Peripheral Component Interconnect (PCI) bus or a PCI-Express bus, a HyperTransport or an Industry Standard Architecture (ISA) bus, a Small Computer System Interface (SCSI) bus, a Universal Serial Bus (USB), an IIC (I2C) bus, or an Institute of Electrical and Electronics Engineers (IEEE) Standard 1394 bus (also known as "Firewire").

[0061] The robotic system 500 may also include, for example, bridges, adapters, controllers, or other signal-related devices to provide wired connections between devices. Wireless connections may be based on, for example, cellular communication protocols (e.g., 3G, 4G, LTE, 5G, etc.), wireless local area network (LAN) protocols (e.g., wireless fidelity (WIFI)), peer-to-peer or device-to-device communication protocols (e.g., Bluetooth, Near-Field Communication (NFC), etc.), Internet of Things (IoT) protocols (e.g., NB-IoT, LTE-M, etc.), and / or other wireless communication protocols.

[0062] The processor 502 may include a data processor (e.g., a central processing unit (CPU), a special purpose computer, and / or an on-board server) configured to execute instructions (e.g., software instructions) stored in a storage device 504 (e.g., a computer memory). The processor 502 may execute program instructions to control / interact with other devices, thereby causing the robotic system 500 to perform various actions, operations, and / or manipulations in a task.

[0063] Storage device 504 may include a non-transitory computer-readable medium having program instructions (e.g., software) stored thereon. Some examples of storage device 504 include volatile memory (e.g., cache and / or random access memory (RAM)), non-volatile memory (e.g., flash memory and / or magnetic disk drives), portable memory drives, cloud storage devices, etc.

[0064] In some embodiments, the storage device 504 can further store and access processing results, predetermined data, predetermined thresholds, predetermined parameters, etc. For example, the storage device 504 can store master data 552 including information data associated with an object that can be operated by the robot system 500.

[0065] The master data 552 may include dimensions, shapes (e.g., computer-generated templates of possible states, computer-generated models for recognizing the objects in different states, etc.), color schemes, images, identification information (e.g., bar codes, Quick Response (QR) codes, logos, etc., expected locations, etc.), expected weights, or combinations thereof, for objects to be manipulated by the robotic system 500. The master data 552 may also include relevant information regarding the objects and their manipulation, such as the location of the center of mass (center of gravity) of each object, expected sensor measurements (e.g., forces, torques, pressures, contact metrics, various measurements thereof, etc.) in response to one or more actions / movements, or combinations thereof.

[0066] Also, for example, the storage device 504 can store object tracking data 554 regarding tracking of objects by the robotic system 500. The object tracking data 554 can include a log of objects that have been scanned or manipulated. The object tracking data 554 can also include image data (e.g., photographs, point clouds, live video feeds, etc.) of the objects at one or more locations (e.g., designated pick-up or drop locations and / or locations on a conveyor belt), and the location and / or state (e.g., orientation) of the objects at the one or more locations.

[0067] The communication device 506 may include circuitry configured to communicate with external or remote devices over a network. For example, the communication device 506 may include a receiver, a transmitter, a conditioner / demodulator (modem), a signal detector, a signal encoder / decoder, a connector port, a network card, etc. The communication device 506 may be configured to transmit, receive, and / or process electrical signals according to one or more communication protocols (e.g., Internet Protocol (IP), wireless communication protocols, etc.). The robotic system 500 may use the communication device 506 to exchange information between units of the robotic system 500 and / or with systems / equipment external to the robotic system 500, for purposes such as data collection, analysis, reporting, troubleshooting, etc.

[0068] The input-output devices 508 may include user interface devices configured to communicate information to and / or receive information from an operator. For example, the input-output devices 508 may include a display 510 and / or other output devices, such as a speaker, haptic circuitry, or tactile feedback devices, for communicating information to an operator. The input-output devices 508 may also include control or receiving devices, such as a keyboard, mouse, touch screen, microphone, user interface (UI) sensors (e.g., a camera for receiving motion commands), wearable input devices, etc. The robotic system 500 may use the input-output devices 508 to interact with an operator in performing a task, action, operation, manipulation, or combination thereof performed by the robotic system 500.

[0069] Suitable units in the robotic system 500 may include structural members connected at joints for movement (e.g., rotation and / or translation), such as end effectors configured to pick up, grip, rotate (spin), weld, etc., and robotic arms configured to manipulate the end effectors (see also, e.g., FIGS. 3 and 4). The robotic system 500 may also include actuation devices 512 (e.g., motors, actuators, wires, artificial muscles, electroactive polymers, etc.) configured to drive or manipulate (e.g., displace and / or orient) the structural members at or around the joints, and transport motors 514 configured to transport the units from one position to another.

[0070] The robotic system 500 may include sensors 516 for obtaining information used to drive or steer the structural members and / or perform a transport task of each unit, etc. The sensors 516 may include various devices configured to detect or measure one or more physical characteristics of the robotic system 500 (e.g., the state, condition, position, etc. of one or more joints or structural members) and / or characteristics of the surrounding environment. Such sensors 516 may include accelerometers, gyroscopes, force sensors, strain gauges, torque sensors, etc., as well as imaging sensors 522, position sensors 524, contact sensors 526, etc.

[0071] The sensors 516 can include one or more imaging sensors 522 configured to detect the surrounding environment, such as visible and / or infrared cameras, two-dimensional and / or three-dimensional imaging cameras (2D vision and / or 3D vision), ranging devices such as lidar or radar, etc. The imaging sensors 522 can generate representation data, such as digital images and / or point clouds, that can be used to control units and controls, for example, in automated inspection, robotic guidance, or other robotic applications.

[0072] The robot system 500 can acquire and analyze images of a designated area (e.g., an area including a gripping position, a pick-up position, a drop position, and other work positions of the operation object) to identify each position in order to operate the operation object. For example, the image sensor 522 can include the above-mentioned camera, a distance measuring device, and the like configured to generate image data and distance data of the designated area. The robot system 500 can determine, for example, a gripping position, a pick-up position, a drop position, and other work positions of the operation object based on the acquired image and / or distance measurement data. Note that the work may include scanning the operation object to log the operation object during transportation / receiving. In this case, the image sensor 522 can include one or more scanners (e.g., a barcode scanner and / or a QR code scanner (registered trademark)) configured to scan the identification information of the operation object during transportation of the operation object.

[0073] The sensors 516 may also include position sensors 524, such as position encoders, potentiometers, etc., configured to detect positions of the above structural members (e.g., robot arms and / or end effectors) and / or joints in each unit of the robot system 500. The robot system 500 may use the position sensors 524 to track the positions and / or states (such as orientations) of the structural members and / or joints while performing operations in a task.

[0074] Further, the sensors 516 may include contact sensors 526, such as pressure sensors, force sensors, strain gauges, piezoresistive / piezoelectric sensors, capacitive sensors, elasto-resistive sensors, other tactile sensors, etc., configured to measure a characteristic associated with direct contact between physical structures or surfaces. The contact sensors 526 may measure a characteristic corresponding to, for example, a gripping operation of the end effector on the object. Thus, the contact sensors 526 may be configured to detect a physical quantity corresponding to the degree of contact or attachment between the object and the gripper, and may output a quantified measurement (e.g., force, torque, pressure, contact metrics, various measurements thereof, etc.). It is noted that the contact metrics may include one or more force or torque readings related to the force applied by the end effector to the object.

[0075] In the above and following descriptions, the robotic system 500 is described as an example in a warehouse or logistics system, but is not limited thereto, and can be configured to perform various tasks in other environments / purposes to perform manufacturing, assembly, packaging, health care, and / or other types of automation operations. The robotic system 500 can also include other units, such as manipulators, service robots, modular robots, etc., that are not shown. The robotic system 500 can also operate, for example, in a warehouse or distribution / transportation hub and include various unloading / loading robots for transferring objects from cage carts or pallets to conveyors or other pallets, sorting systems, unpacking robots for unpacking objects, top cutting machines, container switching robots for transferring objects from one container to another, packaging robots for packaging objects, packing machines, or combinations thereof.

[0076] [Example] 6 is a front view (partial functional configuration diagram) showing an example of a flow of work executed by a robot system according to an embodiment of the present disclosure and an example of a functional configuration of a control device provided in the robot system. The robot system 600 in this embodiment is provided, for example, in a warehouse or the like that is a warehousing, replenishment, storage, and shipping base of a logistics system, and may include a control device 610 as a device that adjusts and controls the operation of each unit in the robot system 600. In addition, the robot system 600 can be said to be a system that is particularly suitable for loading operation targets onto a pallet and unloading operation targets from a pallet in the warehousing process P10 shown in FIG. 1.

[0077] As described above, the control device 610 is configured as a standalone device or a part of another unit, and can adjust and control the operations of units such as the transport robots 11 and 12 (illustrated as the transport robot 11 in FIG. 6; the same applies below) and the operation robots 13 and 14 (illustrated as the operation robot 13 having a hand-type end effector for picking instead of a gripper in FIG. 6; the same applies below), as well as units such as other robots and transport means, in tasks performed by these units. More specifically, the control device 610 is connected to the transport robot 11, the operation robot 13, and the sensors 516 including the image sensor 522, and is also connected to a warehouse management system (WMS: Warehouse Management System), other higher-level systems, and / or external systems, not shown, as necessary.

[0078] 5 , the control device 610 is mainly composed of the processor 502, the storage device 504, and the communication device 506. In particular, the processor 502 can function as the data acquisition unit 612 and the robot control unit 616, and the storage device 504 can function as the data storage unit 614. The robot system 600 can be configured to execute a first task for loading the operation object 16 onto the pallet 15 and / or a second task for unloading the operation object 16 from the pallet 15.

[0079] [1st task: Loading operation target 16 onto pallet 15] In the first task, the following tasks A1 to A5 are executed in a suitable order and at a suitable timing in combination. A1: The pallet 15 stored in the storage area 101 is transported by the transport robot 11 from its storage position to the access position 601 (stop position SL) in the classification area 103. A2: The operation target 16 temporarily placed on, for example, the transfer position 602 (transfer position OL) on the conveyor in the sorting area 103 is picked up and grasped by the operation robot 13. A3: The grasped operation target 16 is moved from the transfer position 602 to the access position 601. A4: The operation target 16 is loaded into a designated vacant position on the pallet 15 held by the stationary transport robot 11. A5: The pallet 15 on which the operation object 16 is loaded is returned by the transport robot 11 from the access position 601 to a storage position in the storage area 101.

[0080] In this embodiment, an example will be described in which the pallet 15 on which the operation target 16 is to be loaded is held and moved by the transport robot 11, but the present invention is not limited to this. For example, the operation target 16 may be loaded and unloaded in a state where the pallet 15, which is configured so that it cannot be placed on the transport robot 11, is placed on the ground, and the pallet 15 may be moved by a transport means (such as a forklift) different from the transport robot 15. In addition, the operation target 16 may be loaded and unloaded in a state where the pallet 15 is placed on a conveyor, which is another transport means, and the pallet 15 may be transported to a predetermined point along a transport path defined by the conveyor, and finally moved from the conveyor by a different transport means (such as a forklift).

[0081] 7 is a flow diagram showing an example of a procedure for operating the robot system according to an embodiment of the present disclosure to execute a first task. First, in block 701, the data acquisition unit 612 acquires first data including, for example, information on the operation target 16 before executing task A1 and information on each pallet 15, and the data storage unit 614 stores the first data in association with the operation target 16 and the pallet 15.

[0082] For example, the data acquisition unit 612 can acquire information about the operation target 16, such as identification information, position information, shape information, weight, and center of mass, based on the result of processing the image data of the operation target 16 temporarily placed on the transfer position 602 of the classification area 103 by an image sensor 522 such as a 3D vision, and the master data 552 as necessary. Alternatively, the information about the operation target 16 and the pallet 15 can be estimated or identified from the tracking information of the operation target 16 and the pallet 15 in the master data 552. In addition, as a method for identifying / tracking the operation target 16, for example, the methods described in Japanese Patent Application No. 2019-118678, Japanese Patent Application No. 2019-080213, U.S. Patent Application No. 16 / 258,120, etc. by the present applicant can be applied. Alternatively, the data acquisition unit 612 can acquire information about the operation target 16 from a higher-level system such as a WMS. In this case, information about the operation target 16 can be acquired in advance before the operation target 16 is placed at the transfer position 602.

[0083] Next, in block 702, the robot control unit 616 determines the pallet 15 on which to stack the operation objects 16 based on information on the operation objects 16 and information on each pallet 15 stored in the storage area 101. Then, based on information on the operation objects 16 (SKU, size, shape, weight, quantity, etc.) and information on the pallet 15 (size, shape, free area, load capacity, quantity, information on operation objects 16 already stacked, such as planar and height positions of operation objects 16 already stacked, etc.), it is possible to select suitable candidates for pallets 15 for, for example, consolidating the operation objects 16 as much as possible by SKU while increasing the storage efficiency in the entire warehouse.

[0084] In this case, the arrangement of the operation objects 16 having the same or similar SKU on the pallet 15 may be consolidated, and only such operation objects 16 may be loaded (single loading) on ​​the pallet 15, or a plurality of types of operation objects 16 having different SKUs may be loaded (mixed loading) on ​​the pallet. These can be appropriately selected depending on the use form of the pallet 15. For example, when the operation objects 16 are temporarily loaded on the pallet 15 (temporary placement), in addition to the above information, the operability of the operation objects 16 after the temporary placement (e.g., ease of unloading the ordered products, etc.) can be taken into consideration, and control can be performed such that single loading / mixed loading on each pallet 15 is selected, and the operation objects 16 to be loaded on the pallet 15 are appropriately selected, and the loading order of each operation object 16 is appropriately determined. Furthermore, one or more optimal pallets 15 can be selected in consideration of the transport route to the classification area 103 of the pallet 15 on which the operation objects 16 are loaded.

[0085] Based on the above information, and regardless of whether the operation objects 16 are temporarily placed or not, and in either the single or mixed loading, the operation objects 16 can be selected and stacked on the pallet 15, taking into consideration, for example, information on the pallet 15 (particularly, free area, planar surface, height position, etc.). Furthermore, for example, control can be performed by adjusting the ratio of single loading and mixed loading, or adjusting the degree of mixing on each pallet 15 in the case of mixed loading, taking into consideration information (conditions) on the operation objects 16 to be stored. Also, a plurality of pallets 15 on which the operation objects 16 can be loaded may be arranged, and loading operations on these pallets 15 may be performed in parallel, or a pallet 15 with more preferable conditions may be selected to further improve the work efficiency. Furthermore, the operation objects 16 may be temporarily placed on another temporary storage means or temporary storage area before being directly loaded on the pallet 15.

[0086] Next, in block 703, the robot control unit 616 creates or acquires, for example, by machine learning, a control sequence including designation of a transport robot 11 for transporting the determined one or more pallets 15 from the storage area 101 to the access position 601 in the sorting area 103 and a transport path of the pallet 15 by each transport robot 11. Based on the control sequence, the robot control unit 616 commands the designated transport robot 11 to execute task A1 for transporting the pallet 15 to the access position 601.

[0087] Simultaneously with task A1, or before or after task A1, in block 704, the robot control unit 616 creates or acquires, for example, by machine learning or the like, a control sequence for, for example, picking up and gripping the operation target 16 temporarily placed at the transfer position 602 by the operation robot 13 and moving it from the transfer position 602 to the access position 601, based on information about the operation target 16. The robot control unit 616 commands the operation robot 13 to execute tasks A2 and A3 for gripping the operation target 16 by the operation robot 13 and moving it to the access position 601, based on the control sequence.

[0088] The timing for executing these tasks A2 and A3 is not particularly limited, and for example, the robot control unit 616 may instruct the operation robot 13 to execute at least a part of the operations in the above control sequence before the pallet 15 reaches the access position 601. In this case, the operation robot 13 can complete gripping of the operation target 16 and moving it to the access position 601 before the pallet 15 reaches the access position 601, and immediately after the arrival of the pallet 15, execute task A4 of stacking the operation target 16 on the pallet.

[0089] Next, in block 705, the control device 610, as necessary, captures the operation target 16 and the pallet 15 at the access position 601 by the imaging sensor 522 such as a 3D vision, and processes the image data to confirm the state and status of the operation target 16 and the pallet 15. In block 705, the robot control unit 616 further creates or acquires, for example, by machine learning, a control sequence including a position on the pallet 15 for stacking the operation target 16 and a movement path of the operation target 16 to that position based on information on the operation target 16 and information on the pallet 15 (particularly, the loading status and aggregation status of the operation target 16 on the pallet, and the vacancy status on the pallet 15). Based on the control sequence, the robot control unit 616 commands the operation robot 13 to execute task A4 for dropping the operation target 16 at a designated vacant position on the pallet 15 held by the stationary transport robot 11.

[0090] At this time, the robot control unit 616 can set, for example, an arbitrary position on the pallet 15 held by the transport robot 11 stopped at the access position 601 as the reference coordinate when the operation robot 13 accesses the pallet 15. The rest position of the pallet 15 can be calculated based on the access position 601 where the transport robot 11 holding the pallet 15 stops, but the position of the pallet 15 on the transport robot 11 may deviate from the standard position. Therefore, the control device 610 calculates the positions of the transport robot 11 and the pallet 15 from the image data of the pallet 15 at the access position 601, and the data acquisition unit 612 can acquire relative position information between the transport robot 11 and the pallet 15. Then, the robot control unit 616 corrects the position information of the pallet 15 at the access position 601 based on the relative position information between them, and preferably creates or acquires a control sequence for task A4 based on the corrected position information of the pallet 15 by, for example, machine learning or the like.

[0091] After the loading of the operation objects 16 onto the pallet 15 is thus completed, in block 706, the robot control unit 616 creates or acquires, for example, by machine learning, a control sequence including a transport path for returning the pallet 15 on which the operation objects 16 are loaded, from the access position 601 to a storage position in the storage area 101 by the transport robot 11. Based on the control sequence, the robot control unit 616 commands the transport robot 11 to execute task A5 for transporting and returning the pallet 15 to the storage area 101.

[0092] After the first task of loading the operation object 16 onto the pallet 15 is completed, in block 707, the data acquisition unit 612 acquires second data including information about the pallet 15 on which the operation object 16 is loaded and information about the loading position of the operation object 16 on the pallet 15, and the data storage unit 614 stores the second data in association with the operation object 16 and the pallet 15.

[0093] The robot control unit 616 can create or acquire a control sequence based on the second data so that the operation objects 16 are arranged in a concentrated manner on the pallet 15, in other words, so that the operation objects 16 are stored densely to minimize unnecessary space, when the operation objects 16 are stacked on the pallet 15 from the next time onward. In this case, the robot control unit 616 can also create or acquire a control sequence based on the characteristics of the operation objects 16, for example, so that operation objects 16 having the same or similar SKU are gathered together, or operation objects 16 having the same or similar shape and dimensions are stored in a concentrated manner. The second data related to the loading status of the operation objects 16 on the pallet 15 thus acquired is updated for each operation object 16 and for each stacking operation of the operation objects 16, and can be used appropriately in the second task (unloading the operation objects 16 from the pallet 15) described later.

[0094] Furthermore, based on the second data thus obtained, the data storage unit 614 can store position (arrangement) information of multiple operation objects 16 on the pallet 15 as two-dimensional information for each operation object 16 or for each layer of the pallet 15, or as three-dimensional information for the entire pallet 15.

[0095] Furthermore, the operation target 16 may have an identification code or an identification tag as identification information, for example, on its side. In this way, even when the operation targets 16 are stacked on the pallet 15, the identification information of the operation targets 16 can be exposed so as to be visible from the outside of the pallet 15. Then, by confirming the identification information of the operation targets 16 using the imaging sensor 522 or the like, it is possible to easily identify and specify the operation targets 16 even when they are still loaded on the pallet 15. In this case, if the position information of the multiple operation targets 16 on the pallet 15 is stored as two-dimensional information or three-dimensional information as described above, by identifying one operation target 16, it is possible to easily identify the operation targets 16 loaded on the pallet 15 by layer on the pallet 15 or by pallet 15. In addition, the image sensor 522 can be configured to capture an image of the pallet 15 when the transport robot 11 holding the pallet 15 is stationary or when the transport robot 11 holding the pallet 15 is moving, i.e., when the pallet 15 is either stationary or moving.

[0096] Furthermore, the robot control unit 616 may be configured to determine that the loading of the operation targets 16 onto the pallet 15 is complete before the loading work (task A4) of the operation targets 16 onto the pallet 15 is actually completed. For example, it can be determined that the loading of the operation targets 16 is complete when all or most of the operation targets 16 have moved onto the pallet 15 or when part of the operation targets 16 has come into contact with the pallet 15 or the operation targets 16 that are already loaded, based on the operating state of the end effector of the operation robot 13 or by tracking the movement of the operation targets 16 with the image sensor 522.

[0097] The robot system 600 can perform a first task (loading the operation object 16 onto the pallet 15) and a second task (unloading the operation object 16 from the pallet 15) by combining unit tasks B1 to B5 shown below in an appropriate order and at an appropriate timing.

[0098] [Second task: Unloading operation target 16 from pallet 15] In the second task, the following tasks B1 to B5 are executed in a suitable combination in a suitable order and at a suitable timing. B1: The pallet 15, which is stored in the storage area 101 and on which the operation target 16 is loaded, is transported by the transport robot 11 from its storage position to the access position 601 (stop position SL) in the sorting area 103. B2: The operation target 16 on the pallet 15 held by the transport robot 11 stationary at the access position 601 is, for example, picked up and grasped by the operation robot 13. B3: The grasped operation target 16 is moved from the access position 601 to the transfer position 602. B4: The operation target 16 is dropped at the transfer position 602 and temporarily placed there. B5: The rack 15 on which the operation target 16 has been unloaded is returned by the transport robot 11 from the access position 601 to a storage position in the storage area 101.

[0099] As in the description of the first task, in this embodiment, an example will be described in which the transfer robot 11 holds and moves the pallet 15, which is the unloading target of the operation target 16, but the present invention is not limited to this.

[0100] 8 is a flow diagram showing an example of a procedure for operating the robot system according to an embodiment of the present disclosure to execute the second task. First, in block 801, the data acquisition unit 612 acquires first data including, for example, information on the operation target 16 before executing task B1 and information on each pallet 15, and the data storage unit 614 stores the first data in association with the operation target 16 and the pallet 15.

[0101] For example, the data acquisition unit 612 can acquire information on the operation target 16, such as identification information, position information, shape information, weight, center of mass, etc., and identification information and storage position information of the pallet 15 on which the operation target 16 is loaded, based on the second data stored in the data storage unit 614 and, if necessary, the master data 552. Then, in block 802, the robot control unit 616 can select a pallet 15 for unloading the operation target 16 based on the information on the operation target 16 and the information on each pallet 15 stored in the storage area 101, and determine one or more optimal pallets 15 in consideration of the transport route to the sorting area 103, etc.

[0102] Next, in block 803, the robot control unit 616 creates or acquires, for example, by machine learning, a control sequence including designation of a transport robot 11 for transporting the determined one or more pallets 15 from the storage area 101 to the access position 601 in the sorting area 103 and a transport path of the pallet 15 by each transport robot 11. Based on the control sequence, the robot control unit 616 commands the designated transport robot 11 to execute task B1 for transporting the pallet 15 to the access position 601.

[0103] When the end effector of the operation robot 13 is not at the access position 601, simultaneously with task B1 or before or after task B1, the robot control unit 616 commands the operation robot 13 to execute a task of moving the end effector of the operation robot 13 to the access position 601. In this case, by completing the movement of the operation robot 13 before the pallet 15 reaches the access position 601, it is possible to execute task B2 of unloading the operation target 16 from the pallet 15 immediately after the arrival of the pallet 15.

[0104] When the transport robot 11 arrives at the access position 601, in block 804, the control device 610 uses the imaging sensor 522, such as a 3D vision, to capture the operation target 16 and the pallet 15 at the access position 601, and processes the image data to confirm the state and status of the operation target 16 and the pallet 15. In block 804, the robot control unit 616 further creates or acquires, for example, by machine learning, a control sequence for picking up the operation target 16 and moving it from the access position 601 to the transfer position 602, including the designation of the position of the operation target 16 on the pallet 15 and the movement path of the end effector to that position, based on information on the operation target 16 and information on the pallet 15 (particularly, the loading status and aggregation status of the operation target 16 on the pallet). Based on the control sequence, the robot control unit 616 instructs the operation robot 13 to execute tasks B2 and B3 for grasping the operation object 16 on the pallet 15 held by the transport robot 11, which is stationary at the access position 601, and moving it to the transfer position 602.

[0105] In this case, an index indicating the ease of handling when unloading the operation object 16 from the pallet 15 may be calculated based on the information on the operation object 16 and the information on the pallet 15 (second data), and / or the processing result of the image data. Then, based on the index indicating the ease of handling, a control sequence including identification of the operation object 16 and the pallet 15 on which the operation object 16 is loaded may be created or acquired by, for example, machine learning or the like.

[0106] Furthermore, at this time, similarly to the first task, the control device 610 calculates the positions of the transport robot 11 and the pallet 15 from image data of the pallet 15 at the access position 601, and the data acquisition unit 612 can acquire relative position information between the transport robot 11 and the pallet 15. Then, the robot control unit 616 corrects the position information of the pallet 15 at the access position 601 based on the relative position information between the two, and preferably creates or acquires a control sequence for task B2 based on the corrected position information of the pallet 15 by, for example, machine learning.

[0107] Next, in block 805, the control device 610, as necessary, uses the imaging sensor 522 such as a 3D vision to capture the image of the operation target 16 held at the transfer position 602 and the transfer position 602 (for example, on a conveyor, a final position, etc.), and processes the image data to confirm the state and situation of the operation target 16 and the transfer position 602. In block 805, the robot control unit 616 further creates or acquires a control sequence including a designated position to which the operation target 16 is transferred and a movement path of the operation target 16 to the designated position, for example, by machine learning. Based on the control sequence, the robot control unit 616 commands the operation robot 13 to execute task B4 for dropping the operation target 16 at the designated position in the transfer position 602. Note that, when the operation target 16 is directly transferred to a container or the like prepared at the transfer position 602, the imaging sensor 522 may be used to confirm the vacancy status of the container to improve storage efficiency.

[0108] After the unloading of the operation target 16 from the pallet 15 is thus completed, in block 806, the robot control unit 616 creates or acquires, for example by machine learning, a control sequence including a transport path for returning the pallet 15, on which the operation target 16 has been unloaded, from the access position 601 to a storage position in the storage area 101 by the transport robot 11. Based on the control sequence, the robot control unit 616 commands the transport robot 11 to execute task B5 for transporting the pallet 15 to the storage area 101.

[0109] After the second task of unloading the operation objects 16 from the pallet 15 is completed, in block 807, the data acquisition unit 612 acquires second data including information on the pallet 15 on which the operation object 16 has been unloaded and information on the loading positions of other operation objects 16 loaded on the pallet 15, and the data storage unit 614 stores the second data in association with the operation object 16 and the pallet 15. In this manner, the second data on the loading status of the operation objects 16 on the pallet 15 is updated for each operation object 16 and for each unloading operation of the operation object 16. Also, similar to the first task, the data storage unit 614 can store position information of the multiple operation objects 16 on the pallet 15 based on the second data, for each operation object 16 or pallet 15, and can store the information as two-dimensional information or three-dimensional information.

[0110] Also, similarly to the first task, if the operation target 16 has identification information, for example, on its side, the identification information of the operation target 16 can be confirmed by the image sensor 522 even when the operation target 16 is stacked on the pallet 15, and the operation target 16 can be easily identified by actual measurement even when the operation target 16 remains stacked on the pallet 15. Furthermore, the image sensor 522 can be configured to capture an image of the rack 15 when the transport robot 11 holding the pallet 15 is stationary or when the transport robot 11 holding the pallet 15 is moving.

[0111] The robot control unit 616 may be configured to determine that the unloading of the operation target 16 from the pallet 15 is completed before the unloading work (task B2) of the operation target 16 from the pallet 15 is actually completed. For example, it can be determined that the unloading of the operation target 16 is completed when all or most of the operation target 16 has moved outside the pallet 15, or when all or part of the operation target 16 has moved away from the pallet 15 or the operation target 16 loaded underneath, by tracking the movement of the operation target 16 based on the operating state of the end effector of the operation robot 13 or by the image sensor 522.

[0112] According to the control device 610 and the control method of the robot system 500, 600 configured as described above, before stacking the operation object 16 on the pallet 15 or before unloading the operation object 16 from the pallet 15, information on each of the operation object 16 and the pallet 15 is grasped, and tasks (first and second tasks) based on a control sequence created or acquired, for example, by machine learning based on the first data including the information are executed. This makes it possible to efficiently and smoothly perform the operation of stacking the operation object 16 on the pallet 15 or the operation of unloading the operation object 16 from the pallet 15. In addition, at that time, it is possible to realize advanced cooperation between units (for example, the transport robot 11 and the operation robot 13) in the robot system 500, 600, and thereby to improve the functionality of the robot system 500, 600.

[0113] [Other application examples] 9 is a schematic plan view showing an exemplary environment in which a robot system according to an embodiment of the present disclosure can operate. Like the robot system 600, the robot system 100 can be installed in, for example, a warehouse or the like that is a warehousing, replenishment, storage, and shipping base of a logistics system. The robot system 100 can be configured to perform or execute one or more tasks and / or a task that is a combination of a plurality of appropriate tasks. These tasks can be suitably performed or executed by the robot system 100 including one or more units (for example, various robots, various devices, control devices provided integrally or separately therewith, etc.).

[0114] As shown in FIG. 9, the robot system 100 may include one or more transport robots 11, 12 (e.g., pallet AGVs) as transport units, one or more operation robots 13 (e.g., piece-picking robots) as transfer / sorting units configured to move operation objects between different locations, and their control devices (not shown in FIG. 9A).

[0115] The tasks executed by the robot system 100 may be configured to be combined so that each unit executes individual tasks in an appropriate order to achieve a predetermined purpose, or each unit may be configured to appropriately select and execute various different tasks. In the robot system 100, each unit may execute one or more tasks to access various different items stored in the storage area 101 and distributed in a state in which they are stored on pallets 15 or containers 16, and / or various different items classified based on a predetermined storage order or packing order, or item characteristics (SKU, etc.).

[0116] The transport robot 11 can perform a task of transporting, for example, a pallet 15 on which containers 16 containing ordered items are stacked between a storage area 101 and a transport area 102. Meanwhile, the transport robot 12 can take out (pick up) the containers 16 containing ordered items from the transported rack 15. Also, the transport robot 12 can perform a task of transporting the containers 16 between the transport area 102 and a sorting area 103 (an area for grouping items: a stop position SL of the containers 16 in FIG. 9). Meanwhile, the operation robot 13 can perform a task of picking up the ordered items from the containers 16 in the sorting area 103 and moving them to a transfer position OL (for example, a container or box in which the ordered items are packed, a conveyor or temporary storage area on which they are placed, etc.) and / or another shipping container, etc.

[0117] When performing a task, for example, when a shipping order is issued, when stored items are rearranged, when items are replenished, etc., the robot system 100 can identify different areas in which each unit and / or a group of grouped units operate. For example, the robot system 100 can identify a storage area 101 in which the transport robot 11 operates, a transport area 102 in which the transport robot 12 operates, and a sorting area 103 in which the transport robot 12 and / or the operation robot 13 operate. Note that the areas in which the transport robots 11, 12, and the operation robot 13 operate are not limited to the above, and for example, the transport robot 11 may further operate in the transport area 102 and the transport robot 12 may further operate in the storage area 101 according to an appropriate control sequence.

[0118] In addition, the areas in which the units operate may be adjacent to each other or may partially overlap each other. For example, the storage area 101 may be adjacent to the transport area 102, and the transport area 102 may partially overlap the classification area 103. In this case, the transport robots 11 and 12 can operate in separate areas by accessing the pallets 15 in the transport area 102, for example, as shown in FIG. 9. As a result, the robot system 100 can reduce the possibility of potential collisions between different types of units and / or the possibility of them becoming obstacles to each other. Note that the operation robot 13 can be fixedly disposed at a predetermined position, and in this case, the transport robot 12 can easily enter the classification area 103 without colliding with other units or causing congestion during movement.

[0119] Furthermore, the robot system 100 can use an appropriate path to guide and steer transport units such as the transport robots 11 and 12. For example, the robot system 100 can use a first path P1 for steering one or more transport robots 11 and / or a second path P2 for steering one or more transport robots 12. Note that the first path P1 and the second path P2 may be set to be separated by a distance or space so as not to overlap with each other, as shown in Fig. 9, for example, but are not limited to this.

[0120] The first path P1 and the second path P2 may also be provided with floor markings (e.g., paint, tape, etc.) that transport units such as the transport robots 11 and 12 can follow when moving autonomously. This allows the robot system 100 to identify the shape / position of the floor markings and use the identified information when instructing the transport units on route calculation and / or ordering of positions (e.g., pick-up positions and / or drop positions of transport objects). Furthermore, the first path P1 and the second path P2 may include a series of links (e.g., paths between pallets 15) and nodes (e.g., intersecting positions of routes or designated positions when changing the direction of movement).

[0121] The robot system 100 can also calculate routes for transport units such as the transport robots 11 and 12 to move between pick-up and drop positions of transported objects efficiently and without interfering with other units. The transport units can calculate their current positions within the routes, for example using a position / navigation system, and move along the specified routes and routes based on their current positions.

[0122] As described above, the robot system 100 can set a task as a series of tasks to be performed by multiple units, and can adjust and control each unit based on the characteristics of each task so as to optimize the execution of the integrated task. For example, adjustments can be made to define a range of operations that requires multiple units, or to define a range of operations that spans multiple specified areas.

[0123] For example, to fulfill a shipping order, a task may be configured and executed to identify the storage location of the ordered items in the storage area 101, such as a pallet 15 on which the items are loaded, or a pallet 15 on which a container 16 containing the ordered items is loaded, transport the pallet 15 to the conveying area 102, transport the container 16 from the pallet 15 to the sorting area 103, transfer the ordered items from the container 16 to a target location, such as a shipping container and / or conveyor, return the container 16 to the pallet 15, return the pallet 15 to the storage area 101, or any suitable combination of these tasks, in order to fulfill the order.

[0124] In addition, to accommodate the receipt or replenishment of goods, available storage locations can be determined, for example, according to a demand forecast, by determining a container 16 capable of storing the goods and a pallet 15 on which the container 16 can be loaded as the storage location for the goods, storing the received or replenished goods in the container 16, loading the container 16 containing the received or replenished goods onto the pallet 15, transporting the pallet 15 to a corresponding predetermined storage location, or setting and executing a task that performs an appropriate combination of these tasks.

[0125] Furthermore, in order to operate each unit, the robot system 100 can generate, for example, a command for operating an actuator in each unit, a setting condition, an operation plan, a position, identification information, a path, a current unit position, status and progress information, or a combination thereof. The generated information can be communicated between each unit, and the generated various information can be shared between the control device and each unit to execute a task.

[0126] In the above explanation of the robot system 100, the state in which a task related to the outflow (shipment) of goods is being executed has been mainly described. However, when executing a task related to the inflow or replenishment of goods, it is basically possible to create or obtain a control sequence for operating the robot system 100 by, for example, machine learning in the reverse order to that described above, and execute a task based on that control sequence.

[0127] Although the embodiment as an example of the present disclosure has been described in detail above, the above description merely shows an example of the present disclosure in every respect, and is intended to facilitate understanding of the present invention, and is not intended to limit the present invention. Furthermore, it goes without saying that various improvements and modifications can be made without departing from the scope of the present disclosure, and each element of the embodiment, as well as its arrangement, material, conditions, shape, size, etc., are not limited to those exemplified or specific ones, and can be changed as appropriate.

[0128] In other words, the embodiments according to the present disclosure do not exclude other configurations, nor do they limit the present disclosure to the above-mentioned embodiments. Various modifications equivalent to the above-mentioned embodiments according to the present disclosure are possible within the scope of the present disclosure. For example, the order of execution of processes, steps, routines, or blocks may be executed in a different order according to alternative implementations within the scope of the present disclosure, and some processes, steps, routines, or blocks may be deleted, moved, added, subdivided, combined, and / or modified within the scope of the present disclosure. Also, each of these processes, steps, routines, or blocks may be executed in various different ways. Furthermore, even if processes, steps, routines, or blocks are executed sequentially in the above-mentioned embodiments, the processes, steps, routines, or blocks may be executed in parallel or may be executed non-sequentially at different times. Furthermore, certain numbers shown herein may have different values ​​or ranges.

[0129] Moreover, the above-mentioned embodiment is not limited as a "best mode" that can be envisaged as a specific example of the present disclosure, and may be implemented in many alternative ways. Furthermore, the details of the above-mentioned embodiment may vary significantly in its specific implementation, but still be included in the technology of the present disclosure. In addition, a specific term used in describing a particular feature or aspect of the present disclosure is not limited to the specific characteristic, feature, or aspect of the present disclosure with which the term is associated, or to a particular embodiment, and thus the present invention is not limited in a particular sense except as provided by the claims. Furthermore, the present invention is defined in any number of claim forms, but it goes without saying that various aspects are envisaged within the scope of the present disclosure. [Explanation of symbols]

[0130] 11, 12...Transport robot, 13, 14...Operation robot, 15...Pallet, 16...Operation object, container, 40...Vehicle, 100, 500, 600...Robot system, 101...Storage area, 102...Transport area, 103...Sorting area, 131, 141...End effector, 132, 142...Robot arm, 502...Processor, 504...Storage device, 506...Communication device, 508...Input-output device, 510... Display, 512...actuating device, 514...transfer motor, 516...sensor, 522...imaging sensor, 524...position sensor, 526...contact sensor, 552...master data, 554...object tracking data, 601...access position, 602...transfer position, 610...control device, 612...data acquisition unit, 614...data storage unit, 616...robot control unit, OL...transfer position, P1...first path, P2...second path, SL...stop position.

Claims

1. A control device for an operation robot that operates an operation object, a data acquisition unit that acquires first data including information on the operation object and information on the pallet before loading the operation object onto the pallet and / or unloading the operation object from the pallet, and acquires second data including information on the operation object and information on the pallet after loading the operation object onto the pallet and / or unloading the operation object from the pallet; a robot control unit that creates or acquires a control sequence for loading the operation object onto the pallet and / or unloading the operation object from the pallet before loading the operation object onto the pallet and / or unloading the operation object from the pallet, and creates a command to the operation robot to execute a task for loading the operation object onto the pallet and / or unloading the operation object from the pallet based on the control sequence; Equipped with The robot control unit creates or acquires the control sequence for loading at least some of the multiple operation objects onto the pallet by loading them individually or mixed depending on the usage form of the pallet, based on the first data and / or the second data, and the inventory management units of the multiple operation objects.

2. the robot control unit calculates an index indicating the ease of handling when unloading the operation object from the pallet based on the second data, and creates or acquires the control sequence including identification of the operation object and the pallet on which the operation object is loaded based on the index. The control device according to claim 1 .

3. The apparatus further includes a data storage unit that stores position information regarding the plurality of operation objects on the pallet as two-dimensional information or three-dimensional information for each operation object or each pallet. The control device according to claim 1 .

4. the robot control unit creates or acquires the control sequence for stacking the operation object on the pallet so that a sensor can measure an identification code or an identification tag of the operation object after the operation object is stacked on the pallet; The sensor is configured to capture an image of the operation object or the pallet on which the operation object is loaded. The control device according to claim 1 .

5. The data acquisition unit acquires actual measured values ​​or estimated values ​​of information related to the operation object and / or information related to the pallet. The control device according to claim 1 .

6. The robot control unit determines that loading of the operation object onto the pallet and / or unloading of the operation object from the pallet is completed before loading of the operation object onto the pallet and / or unloading of the operation object from the pallet is actually completed. The control device according to claim 1 .

7. The control device identifies a robot system including the manipulation robot and an area associated with the robot system, and calculates a task based on the control sequence; The tasks include tasks related to the transportation of the pallet and the manipulation of the object by the robotic system, and a plurality of tasks performed by the robotic system across adjacent and / or overlapping regions. The control device according to claim 1 .

8. A non-transitory computer-readable recording medium having processor instructions for causing a computer to execute a control method for a robot system including an operating robot that operates an operating object, The control method includes: acquiring first data including information on the operation object and information on the pallet before loading the operation object onto a pallet and / or unloading the operation object from the pallet, and acquiring second data including information on the operation object and information on the pallet after loading the operation object onto the pallet and / or unloading the operation object from the pallet; creating or acquiring a control sequence for loading the operation object onto the pallet and / or unloading the operation object from the pallet before loading the operation object onto the pallet and / or unloading the operation object from the pallet; creating an instruction for the operation robot to execute a task for loading the operation object onto the pallet and / or unloading the operation object from the pallet based on the control sequence; and creating or acquiring the control sequence for loading at least a portion of the plurality of operation objects onto the pallet by single loading or mixed loading according to a usage form of the pallet, based on the first data and / or the second data and an inventory management unit of the plurality of operation objects; A non-transitory computer-readable recording medium comprising:

9. The control method further includes calculating an index indicating handleability when unloading the operation object from the pallet based on the second data, and creating or acquiring the control sequence including identification of the operation object and the pallet on which the operation object is loaded based on the index. The non-transitory computer-readable recording medium of claim 8.

10. The control method further includes storing position information regarding the plurality of operation objects on the pallet for each operation object or each pallet as two-dimensional information or three-dimensional information. The non-transitory computer-readable recording medium of claim 8.

11. The control method further includes creating or acquiring the control sequence for loading the operation object onto the pallet so that a sensor can measure an identification code or an identification tag of the operation object after the operation object is loaded onto the pallet. The non-transitory computer-readable recording medium of claim 8.

12. The control method further includes acquiring information about the operation object and / or information about the pallet, the information being an actual measurement value or an estimated value. The non-transitory computer-readable recording medium of claim 8.

13. A control method for a robot system including an operating robot that operates an operation target, the method being executed by a control device having a data acquisition unit and a robot control unit, the data acquisition unit acquires first data including information on the operation object and information on the pallet before loading the operation object onto the pallet and / or unloading the operation object from the pallet, and acquires second data including information on the operation object and information on the pallet after loading the operation object onto the pallet and / or unloading the operation object from the pallet, the robot control unit creates or acquires a control sequence for loading the operation object onto the pallet and / or unloading the operation object from the pallet before loading the operation object onto the pallet and / or unloading the operation object from the pallet; the robot control unit creates a command to the operation robot to execute a task for loading the operation object onto the pallet and / or unloading the operation object from the pallet based on the control sequence; the robot control unit creates or acquires the control sequence for loading at least a portion of the plurality of operation objects onto the pallet by loading them singly or mixedly according to a usage form of the pallet, based on the first data and / or the second data and an inventory management unit of the plurality of operation objects; Control methods.

14. the robot control unit calculates an index indicating the ease of handling when unloading the operation object from the pallet based on the second data, and creates or acquires the control sequence including identification of the operation object and the pallet on which the operation object is loaded based on the index; The control method according to claim 13.

15. a data storage unit stores position information on the plurality of operation objects on the pallet as two-dimensional information or three-dimensional information for each operation object or each pallet; The control method according to claim 13.

16. the robot control unit creates or acquires the control sequence for stacking the operation object on the pallet so that a sensor can measure an identification code or an identification tag of the operation object after the operation object is stacked on the pallet; The control method according to claim 13.

17. The data acquisition unit acquires actual measured values ​​or estimated values ​​of information related to the operation object and / or information related to the pallet. The control method according to claim 13.

18. The control device identifies a robot system including the manipulation robot and an area associated with the robot system, and calculates a task based on the control sequence; The tasks include tasks related to the transportation of the pallet and the manipulation of the object by the robotic system, and a plurality of tasks performed by the robotic system across adjacent and / or overlapping regions. The control method according to claim 13.

Citation Information

Patent Citations

  • Automatic stowage system for goods

    JP1987251811A

  • Depalletize system

    JP2002154616A

  • Delivery center

    JP2002154620A

  • Object stacking method and facility for it

    JP2004307111A

  • Stack pattern computing apparatus and stacking system

    JP2018052691A