Stacking robot control method and device, electronic equipment and storage medium

By generating and updating the recipe queue through a user interface, the problem of insufficient flexibility of palletizing robots is solved, and visual control and real-time correction of erroneous behavior are achieved, thereby improving work efficiency and product quality.

CN118927250APending Publication Date: 2024-11-12OPTUS INTELLIGENT PACKAGING SYSTEM (FOSHAN) CO LTD

Patent Information

Application Number
CN202411076766.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-07
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

Palletizing robots lack flexibility and are difficult to change their behavior rules, resulting in low work efficiency. Furthermore, the lack of in-depth analysis of the information of the grasped items affects product quality control.

Method used

A method for controlling a palletizing robot is provided, which generates and updates a recipe queue through a user interface, allows users to customize palletizing recipes, enables visual control, executes tasks according to target recipes, and monitors and corrects erroneous behaviors in real time.

Benefits of technology

It improves the flexibility and efficiency of palletizing robots, enhances control over product quality, and reduces the generation of defective products.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118927250A_ABST
    Figure CN118927250A_ABST
Patent Text Reader

Abstract

The method is mainly applied to the technical field of intelligent robots. The invention discloses a palletizing robot control method and device, electronic equipment and a storage medium, and the method comprises the steps that in response to a user login request, a first interface is displayed, and a formula queue is generated on the first interface; at least one stacking formula is obtained, a formula queue is updated according to the stacking formula, and the formula queue comprises a plurality of sorted stacking formulas; screening the plurality of sorted stacking formulas to obtain a target formula; based on the target formula, the palletizing robot is controlled to complete the current task; and when a notification that the current task is completed is received, updating the formula queue, and executing the step of screening the plurality of sorted stacking formulas to obtain a target formula until the formula queue is in a state of not including the target formula. The flexibility and the working efficiency of the robot palletizer can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent robots, and in particular to a control method, device, electronic equipment and storage medium for a palletizing robot. Background Art

[0002] With the increase in labor costs and the improvement of product quality requirements, companies are increasingly inclined to use automated equipment to replace manual labor to reduce costs and improve production efficiency. From early simple mechanical automation to modern intelligent automation, technology has continued to evolve, and robotics technology has gradually matured and been widely used in various industrial fields. The currently actively developing Industry 4.0 emphasizes intelligent and networked production methods. Among them, robots, as representatives of intelligence, are increasingly playing a prominent role in automated production lines. Palletizing robots are not only limited to the automation of mechanical movements, but also integrate advanced technologies such as computer vision, artificial intelligence, and the Internet of Things to achieve more advanced automation functions.

[0003] In the technical field related to palletizing robots, although the ability of palletizing robots to grab heavy objects is constantly improving, palletizing robots still lack flexibility, which is reflected in the fact that palletizing robots are too automated. Palletizing robots usually find it difficult to change their behavioral rules after the program is set, and their ability to solve problems flexibly is very weak, which leads to reduced work efficiency of palletizing robots. Summary of the invention

[0004] The present invention provides a control method, device, electronic equipment and storage medium for a palletizing robot, which can improve the flexibility and working efficiency of the palletizing robot.

[0005] In a first aspect, the present invention provides a palletizing robot control method, the method comprising: In response to a user login request, displaying a first interface and generating a recipe queue on the first interface; Obtain at least one palletizing recipe, and update the recipe queue according to the palletizing recipe, wherein the recipe queue includes a plurality of sorted palletizing recipes; Screening the plurality of sorted palletizing recipes to obtain a target recipe; Based on the target recipe, control the palletizing robot to complete the current task; When the notification that the current task has been completed is received, the recipe queue is updated, and the step of screening the plurality of sorted palletizing recipes to obtain a target recipe is performed until the recipe queue is in a state where the target recipe is not included.

[0006] Optionally, controlling the palletizing robot to complete the current task based on the target recipe includes: Controlling the palletizing robot to grab the palletized objects and obtain the item information of the palletized objects; When the object information meets the first requirement included in the target formula, according to the position information included in the target formula, the palletizing robot is controlled to place the palletized object at the position corresponding to the position information, and the updated palletizing quantity at the position is displayed through a second interface; Determine whether the updated palletizing quantity in the position meets the second requirement included in the target formula; if so, determine that the current task has been completed; if not, execute the step of controlling the palletizing robot to grab the palletizing object and obtain the item information of the palletizing object.

[0007] Optionally, controlling the palletizing robot to grab the palletized objects and obtain the item information of the palletized objects includes: When the palletizing robot grabs the palletizing objects, the current state of the palletizing robot is displayed through the third interface. If the information of the objects grabbed by the palletizing robot is received, the current state is a state of normal task execution; if the information of the objects grabbed by the palletizing robot is not received, the current state is a state of task execution error.

[0008] Optionally, the step of obtaining the palletizing formula in the method includes: Generate and display virtual palletizing objects and virtual palletizing objects on a fourth interface according to the size parameters of the palletizing objects and the size parameters of the pallet input by the user, wherein the virtual palletizing objects are stacked on the virtual pallet; If the size parameter of the palletizing object is greater than the size parameter of the pallet, a notification that the palletizing object and the pallet do not match is issued through the fourth interface; if the size parameter of the palletizing object is less than the size parameter of the pallet, the palletizing formula is generated based on the positional relationship between the virtual palletizing object and the virtual pallet.

[0009] Optionally, the step of obtaining the palletizing formula in the method includes: When the size parameter of the palletized object is smaller than the size parameter of the pallet, in response to a user's request to move the palletized object, determining a virtual palletized object to be moved; The position coordinates input by the user are obtained. When the position coordinates input by the user are within a preset boundary, the relative position between the virtual palletizing object to be moved and the virtual pallet is updated and displayed, and based on the positional relationship between the virtual palletizing object and the virtual pallet, the palletizing formula is generated, wherein the area of ​​the preset boundary is the area of ​​the virtual pallet.

[0010] Optionally, the step of obtaining the palletizing formula in the method includes: Generate a stacking rule corresponding to each stacking layer according to the number of stacking layers input by the user, wherein the stacking rule includes a limited stacking area of ​​the stacked objects in each stacking layer; In response to a user's request to place a stacked object, determining a current stacking layer; According to the number of palletizing objects input by the user, a plurality of virtual palletizing objects are generated on the current palletizing layer, and the plurality of virtual palletizing objects and the palletizing area including the plurality of virtual palletizing objects are displayed through a fifth interface; When the stacking area is different from the limited stacking area, another stacking layer is used as the current stacking layer, and the steps of generating a plurality of virtual stacking objects in the current stacking layer according to the number of stacking objects input by the user, and displaying the plurality of virtual stacking objects and the stacking area including the plurality of virtual stacking objects through a fifth interface are performed; When the stacking area of ​​each stacking layer is the same as the limited stacking area or a request to stop stacking is received from the user, the stacking recipe is generated based on the number of stacking areas and stacked objects in each stacking layer.

[0011] Optionally, generating a plurality of virtual palletizing objects on the current palletizing layer according to the number of palletizing objects input by the user, and displaying the plurality of virtual palletizing objects and the palletizing area including the plurality of virtual palletizing objects through a fifth interface includes: In response to a user's request to add a stacking object, generating and displaying a target virtual stacking object through the fifth interface; When an instruction to adjust the target virtual stacking object is detected, the placement direction of the target virtual stacking object is adjusted according to the orientation information input by the user, and the adjusted target virtual stacking object is displayed through the sixth interface; Based on the adjusted target virtual palletizing objects, the number of virtual palletizing objects in the fifth interface is updated and the stacking area is updated.

[0012] In a second aspect, the present invention provides a palletizing robot control device, the device comprising: A display module, configured to display a first interface in response to a user login request, and generate a recipe queue on the first interface; An acquisition module, used for acquiring at least one palletizing recipe and updating the recipe queue according to the palletizing recipe, wherein the recipe queue includes a plurality of sorted palletizing recipes; A selection module, used for screening the plurality of sorted palletizing recipes to obtain a target recipe; An execution module, used for controlling the palletizing robot to complete the current task based on the target recipe; An updating module is used to update the recipe queue when receiving a notification that the current task has been completed, and execute the step of screening the plurality of sorted palletizing recipes to obtain a target recipe until the recipe queue is in a state where the target recipe is not included.

[0013] In a third aspect, the present invention provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the control method of the palletizing robot as described in any one of the above items when executing the computer program.

[0014] In a fourth aspect, the present invention provides a computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the control method of the palletizing robot as described in any one of the above items.

[0015] The present invention has at least the following beneficial effects: In the technical solution of the present application, the user can log in through the interactive platform, and in response to the user's login request, the first interface is displayed, and a recipe queue is generated on the first interface, so the user can observe the recipe queue and the palletizing recipe in the recipe queue for controlling the palletizing robot through the first interface, so that the behavior rules required for the palletizing robot to perform tasks are visualized through the first interface. After the user logs in, the user can add new palletizing recipes or adjust historical palletizing recipes to update the recipe queue, and then automatically select the target recipe from the updated recipe queue, and control the palletizing robot to complete the current task based on the target recipe, thereby realizing that the user can control the palletizing robot to perform the palletizing task by operating on the visualized first interface, improving operability and reducing control difficulty. During the process of the palletizing robot performing the current task of palletizing work, the palletizing robot will only perform the current task according to one target recipe at a time. When a current task is completed, the palletizing robot will perform a new task according to the next palletizing recipe in the recipe queue. Therefore, the palletizing robot will not only perform tasks under the constraints of the same behavioral rules at work, but will change its behavior according to each different palletizing recipe, which greatly improves the work flexibility. Moreover, the palletizing robot can also correct the erroneous and inefficient behaviors that occur during the execution of the task under the intervention of artificially increasing and adjusting the palletizing recipe, thereby helping to improve the work efficiency of the palletizing robot. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The accompanying drawings are used to provide a further understanding of the technical solution of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the technical solution of the present invention and do not constitute a limitation on the technical solution of the present invention.

[0017] Figure 1 It is a flow chart of steps of a control method of a palletizing robot; Figure 2 is a flowchart of the specific steps of step S400 in the control method of a palletizing robot; Figure 3 It is a structural schematic diagram of a palletizing robot control device; Figure 4 It is a schematic diagram of the hardware structure of an electronic device. DETAILED DESCRIPTION

[0018] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0019] In the technical field related to palletizing robots, although the ability of palletizing robots to grab heavy objects is constantly improving, palletizing robots still lack flexibility, which is reflected in the fact that the palletizing robots themselves cannot know the information of the heavy objects they grab, and because the palletizing robots are too automated, it is usually difficult for the palletizing robots to change their behavior rules after setting the program. For example, when it detects that the box has not been successfully grabbed, the palletizing robot will only return to the original position to grab it again, and its ability to solve problems flexibly is very weak, which leads to a decrease in the work efficiency of the palletizing robot. For another example, the negative pressure detector is only used to detect whether the robot has successfully grabbed the box, but cannot provide more information about the status of the box, such as the weight and size of the box. There is a lack of in-depth analysis and utilization of the data during the grabbing process, and it cannot provide sufficient data support for production optimization. Since the weight of the box cannot be detected, this limits the control of product quality and may cause unqualified products to enter the market.

[0020] In order to solve the above technical problems, the present invention provides a technical solution for a palletizing robot control method, device, electronic device and storage medium. In the technical solution of the present application, a user can log in through an interactive platform, and in response to a user login request, a first interface is displayed, and a recipe queue is generated on the first interface, so that the user can observe the recipe queue and the palletizing recipe in the recipe queue for controlling the palletizing robot through the first interface, thereby visualizing the behavior rules required for the palletizing robot to perform tasks through the first interface. After the user logs in, the user can add new palletizing recipes or adjust historical palletizing recipes to update the recipe queue, and then automatically select the target recipe from the updated recipe queue, and control the palletizing robot to complete the current task based on the target recipe, thereby realizing that the user can control the palletizing robot to perform the palletizing task by operating on the visualized first interface, thereby improving operability and reducing control difficulty. During the process of the palletizing robot performing the current task of palletizing work, the palletizing robot will only perform the current task according to one target recipe at a time. When a current task is completed, the palletizing robot will perform a new task according to the next palletizing recipe in the recipe queue. Therefore, the palletizing robot will not only perform tasks under the constraints of the same behavioral rules at work, but will change its behavior according to each different palletizing recipe, which greatly improves the work flexibility. Moreover, the palletizing robot can also correct the erroneous and inefficient behaviors that occur during the execution of the task under the intervention of artificially increasing and adjusting the palletizing recipe, thereby helping to improve the work efficiency of the palletizing robot.

[0021] In this technical solution, the hardware equipment for executing this technical solution at least includes: a palletizing robot with multiple joints for grabbing and placing boxes; a sensor system including a force sensor and a position sensor for monitoring the state of the robot arm; a control system including a motion controller and a sensor interface for processing sensor data and controlling the palletizing robot to perform actions; a human-computer interaction interface for inputting parameters and monitoring system status; and an exception handling system for detecting abnormal situations and triggering alarms.

[0022] Please refer to Figure 1 , Figure 1 The invention is a flow chart of steps of a control method of a palletizing robot.

[0023] In a first aspect, this embodiment provides 1. A control method for a palletizing robot, the method comprising: S100. In response to a user login request, display a first interface and generate a recipe queue on the first interface.

[0024] S200, obtaining at least one palletizing recipe, and updating a recipe queue according to the palletizing recipe, wherein the recipe queue includes a plurality of sorted palletizing recipes.

[0025] S300, screening multiple sorted palletizing recipes to obtain a target recipe.

[0026] S400, based on the target recipe, controls the palletizing robot to complete the current task.

[0027] S500. When receiving a notification that the current task has been completed, the recipe queue is updated, and steps S300-S400 are repeatedly executed until the recipe queue is in a state where the target recipe is not included.

[0028] In step S100 of some embodiments, the user can log in to the account through an interactive interface such as a software platform or application. In response to the user login request, if the login is successful, the first interface is displayed and a recipe queue is generated on the first interface, otherwise, a login error message is displayed.

[0029] In step S200 of some embodiments, the method of obtaining the palletizing formula may be the palletizing formula input by the user through the first interface, or the palletizing formula called from the preset database. In addition, the palletizing formula input by the user may be written into the preset database for later calling from the preset database.

[0030] It is understandable that, in response to a user login request, when the first interface is displayed, there is already a recipe queue in the first interface, and the recipe queue includes at least one palletizing recipe, which means that the palletizing recipe has been arranged before to control each task to be performed next by the palletizing robot according to each palletizing recipe. Another case is that the recipe queue in the first interface may be an empty recipe queue, that is, there is no palletizing recipe in the empty recipe queue. At this time, a new palletizing recipe needs to be obtained and added to the recipe queue. Alternatively, there is no palletizing recipe in the first interface, that is, any recipe queue needs to obtain a new palletizing recipe and generate a recipe queue with the new palletizing recipe.

[0031] In step S300 of some embodiments, each palletizing recipe in the recipe queue is sorted in chronological order, that is, each palletizing recipe is sorted in chronological order according to the time point when each palletizing recipe is added to the recipe queue. When screening the target palletizing recipe, the earlier palletizing recipe in the recipe queue is used as the target recipe, and a target recipe is determined each time in chronological order. In other embodiments, the palletizing recipes sorted in chronological order can also carry a priority identifier, and the palletizing recipe carrying the priority identifier is used as the target recipe. When there is no palletizing recipe carrying the priority identifier in the recipe queue, the palletizing robot stops working, or the palletizing recipes that do not carry the priority identifier are determined as the target recipe one by one in chronological order.

[0032] It can be understood that the palletizing recipe and the target recipe are both a control program for controlling the palletizing robot, which sets each process, step, and action of the palletizing robot in the process of performing the current task.

[0033] It can be understood that, in step S500 of a specific embodiment, for example, the recipe queue includes palletizing recipe A and palletizing recipe B, and in chronological order, palletizing recipe A is before palletizing recipe B, then palletizing recipe A is determined as the target recipe, and then after the palletizing robot completes the task according to palletizing recipe A, the recipe queue deletes palletizing recipe A, and determines palletizing recipe B as the target recipe. After the palletizing robot performs the task according to palletizing recipe B and completes it, the recipe queue deletes palletizing recipe B, and there is no palletizing recipe in the recipe queue, that is, the recipe queue is in a state of not including the target recipe. At this time, the target recipe is no longer selected from the recipe queue, and the palletizing robot is controlled to stop working, the process ends and the user is prompted.

[0034] In step S500 of some embodiments, when there is no palletizing recipe in the recipe queue, the recipe queue is in a state of not including the target recipe. In other embodiments, the recipe queue includes at least a palletizing recipe, but no palletizing recipe in the recipe queue meets the conditions as the target palletizing recipe. In this case, the recipe queue is still in a state of not including the target recipe.

[0035] This embodiment provides an easy-to-operate human-machine interaction interface - a first interface, which allows the user to customize the palletizing recipe according to different production requirements, so as to control the palletizing robot according to the palletizing recipe, which is beneficial to increasing the flexibility and adaptability of the palletizing robot.

[0036] Please refer to Figure 2 , Figure 2 The present invention is a flowchart of the specific steps of step S400 in the control method of a palletizing robot.

[0037] In some embodiments, step S400 includes: S410: Control the palletizing robot to grab the palletizing objects and obtain the object information of the palletizing objects.

[0038] S420. When the object information meets the first requirement included in the target formula, the palletizing robot is controlled to place the palletized object at the position corresponding to the position information according to the position information included in the target formula, and the updated palletizing quantity in the position is displayed through the second interface.

[0039] S430, determining whether the updated palletizing quantity in the position meets the second requirement included in the target recipe, if so, determining that the current task has been completed, if not, repeating steps S410-S420.

[0040] In step S410 of some embodiments, the item information includes the weight, size, color, material, etc. of the palletized objects. The first requirement may be any one of the weight, size, color, and material of the palletized objects, or a combination of any multiple of the weight, size, color, and material of the palletized objects (if any one of the requirements is not met, the first requirement is not met).

[0041] In step S420 of some embodiments, when the item information does not meet the first requirement included in the target formula, the palletizing robot is controlled to place the palletized items as defective products at a preset position, and after updating the number of defective products, the number of defective products is displayed through a second interface.

[0042] This embodiment can not only identify unqualified palletized objects, but also automatically place these unqualified palletized objects at preset positions. This mechanism improves production efficiency and reduces manual intervention.

[0043] It is understandable that unqualified palletized objects are placed in the preset position based on judgment. These unqualified palletized objects may be caused by the carton sealing machine not sealing the box properly due to the tape, resulting in the goods falling when the palletizing machine grabs the box, so the unqualified boxes are placed in the preset position.

[0044] For example, by providing a weighing sensor for the palletizing robot, the palletizing robot obtains the weight of the palletizing objects through the weighing sensor, and then reports the weight of the palletizing objects to the system platform, and then compares the weight of the palletizing objects with the first requirement (the first requirement is the standard weight range at this time). When the weight of the palletizing objects is within the standard weight range, the palletizing robot is controlled to place the palletizing objects at the position corresponding to the position information according to the position information included in the target recipe, and records and updates the number of pallets at the position through a qualified palletizing quantity counter, and displays the number of pallets at the position on the second interface to show it to the user; when the weight of the palletizing objects is not within the standard weight range, the palletizing robot is controlled to place the palletizing objects that do not meet the weight standard as unqualified products at a preset position (which can be the original position of the palletizing objects, or the unqualified palletizing object stacking area of ​​the specified coordinates set in the palletizing recipe), and records and updates the unqualified number of pallets through an unqualified palletizing quantity counter, and displays the unqualified number of pallets on the second interface to show it to the user.

[0045] In a preferred embodiment, a weighing sensor is provided at the end of the mechanical arm of the palletizing robot for detecting the weight of the box in real time. In the process of grabbing the palletizing objects, the palletizing robot will first weigh the weight when there is no material to be picked up. Each time it is ready to pick up materials, it will first reset the current weight to zero, and then weigh the weight of the palletizing objects. When the palletizing robot grabs the palletizing objects, it will first return to a certain distance above the picking point, wait for 500 milliseconds, and then weigh the weight of the palletizing objects currently grabbed. The actual weight of the palletizing objects is obtained by subtracting the weight of the palletizing robot when no materials are picked up from the weight of the palletizing objects currently grabbed, thereby achieving accurate measurement.

[0046] In step S430 of some embodiments, the second requirement can be a certain quantity value or a range of quantity values. If the second requirement is met, the current task is completed, and the palletizing robot starts to perform another task according to the next palletizing formula, and re-executes a series of steps such as grabbing the palletizing object, obtaining the item information of the palletizing object, judging whether the item information meets the first requirement, and placing the palletizing object; if the second requirement is not met, the palletizing robot grabs another palletizing object, and executes a series of steps such as obtaining the item information of the palletizing object, judging whether the item information meets the first requirement, and placing the palletizing object.

[0047] It can be understood that this embodiment can automatically determine whether the stacked objects meet the quality standards, which is beneficial to improving the accuracy and reliability of the task execution process.

[0048] In some embodiments, step S410 includes: When the palletizing robot grabs the palletizing objects, the current status of the palletizing robot is displayed through the third interface. If the information of the objects grabbed by the palletizing robot is received, the current status is the status of normal task execution. If the information of the objects grabbed by the palletizing robot is not received, the current status is the status of task execution error.

[0049] It is understandable that when the palletizing robot grabs the palletizing objects, special situations may occur, such as the grasped objects falling or not being able to grab the objects, which are recorded as the task execution error state of the palletizing robot. At this time, the current state of the palletizing robot is displayed on the third interface to show it to the user, which is conducive to manual intervention in the work of the palletizing robot, so as to solve the problems that the palletizing robot cannot solve as soon as possible.

[0050] In some embodiments, the step of obtaining a palletizing formula in a palletizing robot control method includes: Based on the size parameters of the palletizing objects and the size parameters of the pallet input by the user, virtual palletizing objects and virtual pallets are generated and displayed on the fourth interface, wherein the virtual palletizing objects are stacked on the virtual pallet; if the size parameters of the palletizing objects are larger than the size parameters of the pallet, a notification that the palletizing objects and the pallet do not match is issued through the fourth interface; if the size parameters of the palletizing objects are smaller than the size parameters of the pallet, a palletizing recipe is generated based on the positional relationship between the virtual palletizing objects and the virtual pallet.

[0051] In this embodiment, after the user clicks the recipe button, he can input the size parameters of the palletizing objects and the size parameters of the pallet, and then see the actual pallet displaying the virtual pallet size and the virtual pallet size on the screen through the fourth interface, as well as the relative size and relative position between the virtual pallet and the virtual pallet, thereby simplifying the user configuration parameter operation and more intuitively feeding back the user input configuration parameters in a visual manner, which is conducive to the user to better understand the actual situation of the palletizing task.

[0052] In some embodiments, the step of obtaining a palletizing formula in a palletizing robot control method includes: When the size parameters of the palletizing objects are smaller than the size parameters of the pallet, in response to the user's request to move the palletizing objects, the virtual palletizing objects to be moved are determined; the position coordinates input by the user are obtained, and when the position coordinates input by the user are within the preset boundary, the relative position between the virtual palletizing objects to be moved and the virtual pallet is updated and displayed, and based on the positional relationship between the virtual palletizing objects and the virtual pallet, a palletizing recipe is generated, wherein the area of ​​the preset boundary is the area of ​​the virtual pallet.

[0053] In this embodiment, the user can select the virtual palletizing object to be moved through the human-computer interaction device, for example, by manually dragging the box on the screen to update the position of the virtual palletizing object, or manually input the coordinates of the box to update the position of the virtual palletizing object. After obtaining the position coordinates input by the user, it is automatically determined whether the position coordinates input by the user are within the virtual pallet, and at the same time, the relative position between the virtual palletizing object to be moved and the virtual pallet is updated and displayed on the fourth interface, so that the user can see the relative position between the virtual palletizing object and the virtual pallet. The relative position between the virtual palletizing object and the virtual pallet generates a palletizing formula to control the palletizing robot, so that the palletizing robot will place the real palletizing object at the specified position on the real pallet according to the coordinate information of the virtual palletizing object. The configuration parameters input by the user are more intuitively fed back in a visual way, which is conducive to the user to better understand the actual situation of the palletizing task.

[0054] In some embodiments, the step of obtaining a palletizing formula in a palletizing robot control method includes: Generate a stacking rule corresponding to each stacking layer according to the number of stacking layers input by the user, wherein the stacking rule includes a limited stacking area for the stacking objects in each stacking layer; determine the current stacking layer in response to a user's request to place the stacking objects; generate a plurality of virtual stacking objects in the current stacking layer according to the number of stacking objects input by the user, and display the plurality of virtual stacking objects and the stacking area including the plurality of virtual stacking objects through a fifth interface; when the stacking area is different from the limited stacking area, take another stacking layer as the current stacking layer, and execute the steps of generating a plurality of virtual stacking objects in the current stacking layer according to the number of stacking objects input by the user, and displaying the plurality of virtual stacking objects and the stacking area including the plurality of virtual stacking objects through a fifth interface; when the stacking area of ​​each stacking layer is the same as the limited stacking area or a user's request to stop stacking is received, generate a stacking recipe based on the number of stacking areas and stacking objects in each stacking layer.

[0055] In this embodiment, the user can set the number of stacking layers through input operations, and then automatically generate the stacking rules corresponding to each stacking layer to limit the number of stacking objects in each stacking layer and the stacking area. According to the stacking formula of the set stacking layer, the stacking robot can be controlled to add 1 to the number of stacking objects placed after each stacking object is placed. The same is true for each stacking layer. If the number of stacking objects in the stacking layer has reached the upper limit (such as 4), the number of stacked layers displayed on the fifth interface will also be +1. If an unexpected situation occurs and the stacking of the nth layer and the nth box is not successfully stacked and the program is stopped, the user can see the nth layer and the nth box that are currently stacked through the fifth interface, and directly click the start button to allow the stacking robot to continue to place the stacking objects that were not placed due to some problem.

[0056] It is understandable that the stacking rules corresponding to the stacking layers define the limited stacking area of ​​the stacking objects in the stacking layers. That is, in the stacking rules of some embodiments, because the number of stacking objects in each stacking layer is different, it will cause the boxes to be stacked unsteadily when placed, so the number of stacking objects in each stacking layer is the same. The stacking formula generated based on this rule can control the number of layers in which the stacking robot stacks the stacking objects and the number of stacking objects in each layer according to the set number of stacking layers and the number of stacking objects in each stacking layer. In the stacking rules of other embodiments, considering that even if the number of stacked objects in each stacking layer is the same, an unstable situation may occur, in view of this situation, a stacking rule requires that the limited stacking area of ​​each layer be the same, otherwise it will be unstable. For example, if in layer A, stacked objects can only be placed in the central position of layer A as a limited stacking area, and the area of ​​the limited stacking area limits the total area of ​​the stacked objects (for example, the number of stacked objects and the area of ​​each stacked object), then in this stacking rule, the limited stacking area of ​​layer B is also in the central position of layer B, and the area of ​​the limited stacking area of ​​layer B is the same as the area of ​​the limited stacking area of ​​layer A.

[0057] In some embodiments, after the user sets the stacking layer, he can select one of the stacking layers as the current stacking layer through the human-computer interaction device in the fifth interface, and then enter the number of stacking objects set by the user in the current stacking layer. For example, the user sets two stacking layers, and the user selects layer A to add 4 virtual stacking objects. At the same time, the user can see the added 4 virtual stacking objects, that is, their placement positions, through the fifth interface (the user can adjust the placement positions by moving the stacking objects in the above embodiment), and when the number and placement of the stacking objects are within the limited stacking area of ​​layer A, the user can reselect another stacking layer (such as layer B) to re-add virtual stacking objects. However, when the user's stacking area in layer A (the area formed by the number and placement positions of the added stacking objects) is different from the limited stacking area of ​​layer A, it automatically jumps to layer B, and continues to add virtual stacking objects and adjust their positions. When the stacking area of ​​each stacking layer is the same as the limited stacking area (that is, each stacking layer has been fully filled with virtual stacking objects in its limited stacking area) or the user stops adding virtual stacking objects, a stacking recipe is generated based on the stacking layers that have been placed and the stacking objects in each stacking layer.

[0058] This embodiment more intuitively feeds back the configuration parameters input by the user in a visual manner, thereby helping the user to better understand the actual situation of the depalletizing task.

[0059] In some embodiments, the specific method of generating and displaying multiple virtual stacking objects and stacking areas on the fifth interface may be: In response to a user's request to add a stacking object, a target virtual stacking object is generated and displayed through the fifth interface; when an instruction to adjust the target virtual stacking object is detected, the placement direction of the target virtual stacking object is adjusted according to the orientation information input by the user, and the adjusted target virtual stacking object is displayed through the sixth interface; based on the adjusted target virtual stacking object, the number of virtual stacking objects in the fifth interface is updated and the stacking area is updated.

[0060] In this embodiment, the user can input the quantity to generate virtual palletizing objects, or manually click to generate multiple virtual palletizing objects one by one, and the fifth interface generates and displays these virtual palletizing objects. Each virtual palletizing object is a virtual button. When the user clicks to select a virtual palletizing object as the target virtual palletizing object through an input device (such as a touch screen), the sixth interface is displayed, and the user slides and selects the target virtual palletizing object to adjust the target virtual palletizing object, and simultaneously inputs the orientation information. When the instruction to adjust the target virtual palletizing object is detected, the placement direction of the target virtual palletizing object is adjusted according to the orientation information input by the user, so that the virtual palletizing object becomes horizontally placed and vertically placed (different placement methods affect the area occupied by the virtual palletizing object in the stacking layer). During the user adjustment process, the user can observe the changes in the placement direction of the adjusted target virtual palletizing object through the sixth interface, so as to more intuitively feedback the configuration parameters input by the user in a visual way, which is conducive to the user to better understand the actual situation of the palletizing task.

[0061] See also Figure 3 , Figure 3 The present invention is a structural schematic diagram of a palletizing robot control device.

[0062] In a second aspect, this embodiment provides a palletizing robot control device comprising: The display module 301 is used to display a first interface in response to a user login request and generate a recipe queue on the first interface; An acquisition module 302 is used to acquire at least one palletizing recipe and update a recipe queue according to the palletizing recipe, wherein the recipe queue includes a plurality of sorted palletizing recipes; A selection module 303 is used to screen a plurality of sorted palletizing recipes to obtain a target recipe; An execution module 304 is used to control the palletizing robot to complete the current task based on the target recipe; The updating module 305 is used to update the recipe queue when receiving a notification that the current task has been completed, and perform the step of screening multiple sorted palletizing recipes to obtain a target recipe until the recipe queue is in a state where the target recipe is not included.

[0063] It will be appreciated by those skilled in the art that all or some of the steps and devices in the methods disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or transient medium). As known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer. It is well known to those skilled in the art that communication media generally contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and may include any information delivery media. It can be understood that the contents of the above method embodiments are all applicable to the present device embodiments, the functions specifically implemented by the present device embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0064] In a third aspect, an embodiment of the present application provides an electronic device, the electronic device comprising a memory and a processor, the memory storing a computer program, and the processor implementing any of the above palletizing robot control methods when executing the computer program.

[0065] refer to Figure 4 , Figure 4 The hardware structure of an electronic device of another embodiment is illustrated, and the electronic device includes: The processor 401 may be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application; The processor 402 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The processor 402 can store operating devices and other applications. When the technical solution provided in the embodiment of this specification is implemented by software or firmware, the relevant program code is stored in the processor 402, and the processor 401 is called to execute the control method of the palletizing robot in the embodiment of this application; Input / output interface 403, used to implement information input and output; Communication interface 404, used to realize communication interaction between the device and other devices, which can be realized through wired mode (such as USB, network cable, etc.) or wireless mode (such as mobile network, WIFI, Bluetooth, etc.); Bus 405 , which transmits information between various components of the device (e.g., processor 401 , processor 402 , input / output interface 403 , and communication interface 404 ); The processor 401 , the processor 402 , the input / output interface 403 and the communication interface 404 are connected to each other in communication within the device via the bus 405 .

[0066] It can be understood that the contents of the above method embodiments are all applicable to the electronic device embodiment, the functions specifically implemented by the electronic device embodiment are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0067] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a program executable by a processor, and the program executable by the processor is used to implement the control method of the palletizing robot as described in any one of the above specific embodiments when executed by the processor.

[0068] An embodiment of the present application also discloses a computer program product, including a computer program or computer instructions, wherein the computer program or computer instructions are stored in a computer-readable storage medium, a processor of a computer device reads the computer program or computer instructions from the computer-readable storage medium, and the processor executes the computer program or computer instructions, so that the computer device executes the palletizing robot control method described in any of the previous embodiments.

[0069] It can be understood that the contents of the above method embodiments are all applicable to the present storage medium embodiments, the functions specifically implemented by the present storage medium embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0070] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein, for example. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0071] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0072] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0073] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0074] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0075] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store program codes.

[0076] Although the description of the present application has been quite detailed and specifically describes several described embodiments, it is not intended to be limited to any of these details or embodiments or any particular embodiment, but should be regarded as providing a broad possible interpretation of these claims by reference to the attached claims, taking into account the prior art, so as to effectively cover the intended scope of the present application. In addition, the above description of the present application is based on the embodiments foreseeable by the inventor, and its purpose is to provide a useful description, and those non-substantial changes to the present application that have not yet been foreseen may still represent equivalent changes to the present application.

Claims

1. A palletizing robot control method, characterized in that: The method comprises: In response to a user login request, displaying a first interface and generating a recipe queue on the first interface; Obtain at least one palletizing recipe, and update the recipe queue according to the palletizing recipe, wherein the recipe queue includes a plurality of sorted palletizing recipes; Screening the plurality of sorted palletizing recipes to obtain a target recipe; Based on the target recipe, control the palletizing robot to complete the current task; When the notification that the current task has been completed is received, the recipe queue is updated, and the step of screening the plurality of sorted palletizing recipes to obtain a target recipe is performed until the recipe queue is in a state where the target recipe is not included.

2. A palletizing robot control method according to claim 1, characterized in that: Based on the target recipe, controlling the palletizing robot to complete the current task includes: Controlling the palletizing robot to grab the palletized objects and obtain the item information of the palletized objects; When the object information meets the first requirement included in the target formula, according to the position information included in the target formula, the palletizing robot is controlled to place the palletized object at the position corresponding to the position information, and the updated palletizing quantity at the position is displayed through a second interface; Determine whether the updated palletizing quantity in the position meets the second requirement included in the target formula; if so, determine that the current task has been completed; if not, execute the step of controlling the palletizing robot to grab the palletizing object and obtain the item information of the palletizing object.

3. A palletizing robot control method according to claim 2, characterized in that: The controlling the palletizing robot to grasp the palletized objects and obtain the item information of the palletized objects comprises: When the palletizing robot grabs the palletizing objects, the current state of the palletizing robot is displayed through the third interface. If the information of the objects grabbed by the palletizing robot is received, the current state is a state of normal task execution; if the information of the objects grabbed by the palletizing robot is not received, the current state is a state of task execution error.

4. A palletizing robot control method according to any one of claims 1 to 3, characterized in that: The step of obtaining the palletizing formula in the method comprises: Generate and display virtual palletizing objects and virtual palletizing objects on a fourth interface according to the size parameters of the palletizing objects and the size parameters of the pallet input by the user, wherein the virtual palletizing objects are stacked on the virtual pallet; If the size parameter of the palletizing object is greater than the size parameter of the pallet, a notification that the palletizing object and the pallet do not match is issued through the fourth interface; if the size parameter of the palletizing object is less than the size parameter of the pallet, the palletizing formula is generated based on the positional relationship between the virtual palletizing object and the virtual pallet.

5. A palletizing robot control method according to claim 4, characterized in that: The step of obtaining the palletizing formula in the method comprises: When the size parameter of the palletized object is smaller than the size parameter of the pallet, in response to a user's request to move the palletized object, determining a virtual palletized object to be moved; The position coordinates input by the user are obtained. When the position coordinates input by the user are within a preset boundary, the relative position between the virtual palletizing object to be moved and the virtual pallet is updated and displayed, and based on the positional relationship between the virtual palletizing object and the virtual pallet, the palletizing formula is generated, wherein the area of ​​the preset boundary is the area of ​​the virtual pallet.

6. A palletizing robot control method according to any one of claims 1 to 3, characterized in that: The step of obtaining the palletizing formula in the method comprises: Generate a stacking rule corresponding to each stacking layer according to the number of stacking layers input by the user, wherein the stacking rule includes a limited stacking area of ​​the stacked objects in each stacking layer; In response to a user's request to place a stacked object, determining a current stacking layer; According to the number of palletizing objects input by the user, a plurality of virtual palletizing objects are generated on the current palletizing layer, and the plurality of virtual palletizing objects and the palletizing area including the plurality of virtual palletizing objects are displayed through a fifth interface; When the stacking area is different from the limited stacking area, another stacking layer is used as the current stacking layer, and the steps of generating a plurality of virtual stacking objects in the current stacking layer according to the number of stacking objects input by the user, and displaying the plurality of virtual stacking objects and the stacking area including the plurality of virtual stacking objects through a fifth interface are performed; When the stacking area of ​​each stacking layer is the same as the limited stacking area or a request to stop stacking is received from the user, the stacking recipe is generated based on the number of stacking areas and stacked objects in each stacking layer.

7. A palletizing robot control method according to claim 6, characterized in that: According to the number of palletizing objects input by the user, a plurality of virtual palletizing objects are generated in the current palletizing layer, and the plurality of virtual palletizing objects and the palletizing area including the plurality of virtual palletizing objects are displayed through a fifth interface, including: In response to a user's request to add a stacking object, generating and displaying a target virtual stacking object through the fifth interface; When an instruction to adjust the target virtual stacking object is detected, the placement direction of the target virtual stacking object is adjusted according to the orientation information input by the user, and the adjusted target virtual stacking object is displayed through the sixth interface; Based on the adjusted target virtual palletizing objects, the number of virtual palletizing objects in the fifth interface is updated and the stacking area is updated.

8. A palletizing robot control device, characterized in that: The device comprises: A display module, configured to display a first interface in response to a user login request, and generate a recipe queue on the first interface; An acquisition module, used for acquiring at least one palletizing recipe and updating the recipe queue according to the palletizing recipe, wherein the recipe queue includes a plurality of sorted palletizing recipes; A selection module, used for screening the plurality of sorted palletizing recipes to obtain a target recipe; An execution module, used for controlling the palletizing robot to complete the current task based on the target recipe; An updating module is used to update the recipe queue when receiving a notification that the current task has been completed, and execute the step of screening the plurality of sorted palletizing recipes to obtain a target recipe until the recipe queue is in a state where the target recipe is not included.

9. An electronic device, characterized in that: The electronic device comprises a memory and a processor, the memory stores a computer program, and the processor implements the control method of the palletizing robot according to any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the palletizing robot control method according to any one of claims 1 to 7 is implemented.

Citation Information

Patent Citations

  • Robotic system for palletizing packages using real-time placement simulation

    CN112009923A

  • Package stacking method and terminal

    CN113086659A

  • Robotic system for palletizing packages using real-time placement simulation

    US10647528B1

  • Palletizer Human-Machine Interface (HMI) for Custom Pattern Preview

    US20180217576A1

Cited By

  • Automatic boxing and stacking system

    CN119578854A

  • An automatic packing and palletizing system

    CN119578854B