Carrying strategy determination method and device, computer equipment and storage medium
By matching the attributes of the materials to be stacked and the information of the palletized storage area, the handling strategies of target materials and candidate materials are determined, and the problem of low palletization efficiency caused by many items and different shapes in traditional stacking technology is solved, achieving more efficient coding Stacking operation.
Patent Information
- Application Number
- CN202411222134.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-02
- Publication Date
- 2024-12-06
AI Technical Summary
When traditional robot plating technology deals with items of different sources and shapes, it needs to be identified separately, and each palletization time is long and the efficiency is low.
By obtaining the attribute information of the materials to be palletized and the spatial information of the palletized storage area, matching the handling priority conditions, determining the priority of the target materials and candidate materials, and determining the handling strategy based on its attributes and spatial information, reducing the number of times of transport strategy generation, Improve palletizing efficiency.
The overall palletization efficiency of multiple materials to be stacked is improved, the number of material identification is reduced, the generation of handling strategies is optimized, and the palletization efficiency and space utilization are improved.
Smart Images

Figure CN119090310A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of intelligent palletizing technology, and in particular to a method, device, computer equipment, storage medium and computer program product for determining a handling strategy. Background Art
[0002] With the development of production technology, different factories and different customer needs have led to the emergence of a variety of intelligent palletizing solutions that rely on robots.
[0003] When dealing with items of different sources and shapes, traditional robotic stacking technology can only identify and stack one item at a time. Individual identification is required before each stacking, resulting in the stacking process taking too long and low efficiency. Summary of the invention
[0004] Based on this, it is necessary to provide a method, device, computer equipment, computer-readable storage medium and computer program product for determining a handling strategy that can improve palletizing efficiency in response to the above technical problems.
[0005] In the first aspect, the present application provides a method for determining a handling strategy. The method includes: obtaining the attribute information of each of the multiple materials to be palletized temporarily stored in the palletizing buffer area, and the space information of the palletizing storage area; matching the handling priority conditions configured for palletizing handling with the attribute information of each of the materials to be palletized, respectively, to obtain the priority of each of the materials to be palletized; determining the material to be palletized with the highest priority as the target material, and determining the material to be palletized with the second highest priority as the candidate material; based on the attribute information of the target material and the candidate material, and the space information, determining the handling strategies of the target material and the candidate material.
[0006] In one of the embodiments, the method of determining the respective handling strategies of the target material and the candidate material based on their respective attribute information and the spatial information includes: determining the handling strategy of the target material based on the attribute information of the target material and the spatial information; simulating the handling of the target material according to the handling strategy of the target material to determine an expected handling result of the target material; and determining the handling strategy of the candidate material based on the expected handling result and the attribute information of the candidate material.
[0007] In one of the embodiments, the method further includes: controlling the robot to transport the target material to the palletizing storage area according to the transport strategy of the target material; and controlling the robot to transport the candidate material to the palletizing storage area based on the priority and transport strategy of the candidate material.
[0008] In one of the embodiments, based on the priority and handling strategy of the candidate material, controlling the robot to transport the candidate material to the palletizing storage area includes: when detecting that the palletizing buffer area receives a new material, acquiring the attribute information of the new material; matching the attribute information of the new material with the handling priority condition to determine the priority of the new material; if the priority of the new material is higher than that of the candidate material, determining the new material as a new target material, and returning to the step of determining the respective handling strategies of the target material and the candidate material based on their respective attribute information and the spatial information; if the priority of the new material is not higher than that of the candidate material, controlling the robot to transport the candidate material to the palletizing storage area according to the handling strategy of the candidate material.
[0009] In one of the embodiments, the attribute information includes material size; the acquiring of the attribute information of each of the multiple materials to be palletized temporarily stored in the palletizing buffer area includes: acquiring a material image of each of the multiple materials to be palletized temporarily stored in the palletizing buffer area; determining a size error of the material image based on camera parameters of a robot's visual camera; and correcting the size information represented by each of the material images according to the size error to determine the material size of each of the materials to be palletized.
[0010] In one of the embodiments, based on the attribute information of the target material and the spatial information, a handling strategy for the target material is determined, including: parsing the spatial information to determine available storage points from the palletizing storage area; extracting the material size of the target material from the attribute information to determine a plurality of candidate point spaces that match the material size; each of the candidate point spaces includes a plurality of continuous available storage points; screening a target point space that meets collision test conditions in each of the candidate point spaces; and determining the handling strategy for the target material based on the central storage point of the target point space.
[0011] In the second aspect, the present application also provides a device for determining a handling strategy. The device includes: an acquisition module for acquiring the attribute information of each of the multiple materials to be stacked temporarily stored in the stacking buffer area, and the space information of the stacking storage area; a matching module for matching the handling priority conditions configured for stacking handling with the attribute information of each of the materials to be stacked, respectively, to obtain the priority of each of the materials to be stacked; a material determination module for determining the material to be stacked with the highest priority as the target material, and the material to be stacked with the second highest priority as the candidate material; a strategy determination module for determining the handling strategies of the target material and the candidate material based on their attribute information and the space information.
[0012] In a third aspect, the present application further provides a computer device. The computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:
[0013] Acquire the attribute information of each of the multiple materials to be palletized temporarily stored in the palletizing buffer area, and the space information of the palletizing storage area; match the handling priority conditions configured for palletizing handling with the attribute information of each of the materials to be palletized, respectively, to obtain the priority of each of the materials to be palletized; determine the material to be palletized with the highest priority as the target material, and determine the material to be palletized with the second highest priority as the candidate material; determine the handling strategies of the target material and the candidate material based on the attribute information of each of the target material and the candidate material, and the space information.
[0014] In a fourth aspect, the present application further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the following steps are implemented:
[0015] Acquire the attribute information of each of the multiple materials to be palletized temporarily stored in the palletizing buffer area, and the space information of the palletizing storage area; match the handling priority conditions configured for palletizing handling with the attribute information of each of the materials to be palletized, respectively, to obtain the priority of each of the materials to be palletized; determine the material to be palletized with the highest priority as the target material, and determine the material to be palletized with the second highest priority as the candidate material; determine the handling strategies of the target material and the candidate material based on the attribute information of each of the target material and the candidate material, and the space information.
[0016] In a fifth aspect, the present application further provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by a processor, the following steps are implemented:
[0017] Acquire the attribute information of each of the multiple materials to be palletized temporarily stored in the palletizing buffer area, and the space information of the palletizing storage area; match the handling priority conditions configured for palletizing handling with the attribute information of each of the materials to be palletized, respectively, to obtain the priority of each of the materials to be palletized; determine the material to be palletized with the highest priority as the target material, and determine the material to be palletized with the second highest priority as the candidate material; determine the handling strategies of the target material and the candidate material based on the attribute information of each of the target material and the candidate material, and the space information.
[0018] The above-mentioned method, device, computer equipment, storage medium and computer program product for determining the handling strategy obtain the attribute information of each of the multiple materials to be palletized temporarily stored in the palletizing buffer area, as well as the spatial information of the palletizing storage area, and match the handling priority conditions configured for palletizing handling with the attribute information of each material to be palletized, respectively, to obtain the priority of each material to be palletized, determine the material to be palletized with the highest priority as the target material, determine the material to be palletized with the second highest priority as the candidate material, and determine the target material and the candidate material at the same time, providing a basis for the subsequent simultaneous determination of the handling strategies of the target material and the candidate material. Based on the attribute information and spatial information of the target material and the candidate material, the handling strategies of the target material and the candidate material are determined. The above method is used to simultaneously determine the handling strategies of the target material and the candidate material, which reduces the number of times the handling strategies are generated and improves the overall palletizing efficiency of multiple materials to be palletized. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] FIG1 is an application environment diagram of a method for determining a transport strategy in one embodiment;
[0020] FIG2 is a schematic flow chart of a method for determining a transport strategy in one embodiment;
[0021] FIG3 is a schematic flow chart of a method for transporting disordered mixed materials using a multi-box forward-looking algorithm based on a collaborative robot in one embodiment;
[0022] FIG4 is a structural block diagram of a transport strategy determination device in one embodiment;
[0023] FIG. 5 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION
[0024] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0025] The method for determining a handling strategy provided in an embodiment of the present application can be applied in an application environment as shown in FIG1 . The robot terminal 102 communicates with the server 104 via a network. The data storage system can store data that the server 104 needs to process. The data storage system can be integrated on the server 104, or placed on a cloud or other network server.
[0026] The robot terminal 102 obtains the attribute information of each of the multiple materials to be palletized temporarily stored in the palletizing buffer area and the space information of the palletizing storage area from the server 104. The robot terminal 102 matches the handling priority conditions configured for palletizing handling with the attribute information of each material to be palletized, and obtains the priority of each material to be palletized. The robot terminal 102 determines the material to be palletized with the highest priority as the target material, and determines the material to be palletized with the second highest priority as the candidate material. The robot terminal 102 determines the handling strategies of the target material and the candidate material based on their attribute information and space information. Among them, the robot terminal 102 can also directly obtain the attribute information of each of the multiple materials to be palletized temporarily stored in the palletizing buffer area and the space information of the palletizing storage area.
[0027] The robot terminal 102 may be a terminal preset on a robot device with image acquisition capability, such as a handling robot, a palletizing robot, etc. The server 104 may be implemented as an independent server or a server cluster composed of multiple servers.
[0028] In one embodiment, as shown in FIG. 2 , a method for determining a handling strategy is provided, which is described by taking the method applied to the robot terminal in FIG. 1 as an example, including:
[0029] S202, obtaining attribute information of each of a plurality of materials to be palletized that are temporarily stored in a palletizing buffer area, and space information of a palletizing storage area.
[0030] Among them, the material to be stacked represents a material with a certain shape. For different stacking tasks, the material to be stacked represents different types of materials. It can be understood that the parameter information of multiple materials to be stacked is relatively close to each other. For example, the material to be stacked can be a carton, and multiple materials to be stacked can be cartons of similar models, sizes or weights.
[0031] The materials to be palletized may also be other materials with a certain shape. It is understandable that the materials to be palletized may be determined according to the production characteristics of the factory. For example, for a carton factory, the materials to be palletized may be cartons, and for a mold processing factory, the materials to be palletized may be products processed by molds.
[0032] Among them, the palletizing buffer area represents the temporary storage point and cache point of each material to be palletized. The palletizing buffer area is generally located between the product line and the palletizing storage area. The palletizing buffer area can represent a certain area of the factory. There are generally multiple materials to be palletized in the palletizing storage area. The multiple materials to be palletized can be in a flat state, and the multiple materials to be palletized can also be in a superimposed state. In order to facilitate the handling of each material to be palletized, the multiple materials to be palletized in the palletizing buffer area can be arranged in an equidistant flat state. Exemplarily, the materials to be palletized are transported to the palletizing storage area by a handling robot or a palletizing robot.
[0033] The palletizing storage area refers to the long-term storage point or storage point of each material to be palletized. The palletizing storage area can be a specific area of the factory, for example, a plane on the ground or a bracket or a storage container. The materials to be palletized in the palletizing storage area can be stacked. Specifically, the materials to be palletized can be stacked into different shapes according to customer needs, for example, a pyramid shape, a dense arrangement shape, a rectangular arrangement shape, etc.
[0034] Specifically, by obtaining the customer's preferred handling type, the corresponding type of materials to be palletized are handled preferentially. If the customer's preferred handling type is to handle materials with larger volumes, the materials with larger volumes are handled preferentially; if the customer's preferred handling type is to handle materials with larger weights, the materials with larger weights are handled preferentially; if the customer's preferred handling type is to handle materials with target material models, the materials with target material models are handled preferentially.
[0035] The attribute information represents the inherent material information of the material to be palletized, such as the material size, material weight, material type, etc. Taking cartons as an example, the material information of the cartons includes the size, shape, weight, model, etc. of the cartons.
[0036] The spatial information indicates the size of the space in the palletizing storage area. Specifically, the spatial information may be the area and volume of the palletizing storage area that can be used to store the materials to be palletized.
[0037] S204, matching the transport priority conditions configured for palletizing transport with the attribute information of each material to be palletized, to obtain the priority of each material to be palletized.
[0038] Among them, the handling priority condition can be a condition set for different aspects of palletizing and handling, for example, the priority condition set for the material size of palletizing and handling is specifically expressed as giving priority to handling larger sizes. For another example, the priority condition set for the material weight of palletizing and handling is specifically expressed as giving priority to handling larger weights. For another example, the priority condition set for the material type of palletizing and handling is specifically expressed as giving priority to handling the target material type. It should be noted that a handling priority condition can also be a condition set for multiple aspects of palletizing and handling, for example, a priority condition set jointly for the material size of palletizing and handling and the material weight of palletizing and handling.
[0039] Among them, palletizing and handling can rely on a dedicated handling robot or palletizing robot, and the number of handling robots or palletizing robots can be multiple, that is, multiple collaborative robots are used to jointly complete the handling and palletizing of the materials to be palletized. Specifically, due to the joint limit of the robot, the robot can be controlled to carry the materials to be palletized from the palletizing buffer area to the palletizing storage area, and after adjusting the posture of the robot, the robot can be used to adjust the direction of the materials to be palletized to complete the palletizing of the materials to be palletized.
[0040] The priority of the material to be palletized represents the matching degree between the attribute information of the material to be palletized and the handling priority condition. The higher the priority, the higher the matching degree. Conversely, the lower the priority. It can be understood that the priority can represent the order of handling of each material to be palletized.
[0041] S206, determining the to-be-palletized material with the highest priority as the target material, and determining the to-be-palletized material with the second highest priority as the candidate material.
[0042] Among them, the target material means that the material is the first in the transportation order among multiple materials to be stacked. In other words, if a material to be stacked is the target material, it is necessary to control the robot to carry and stack the material to be stacked at the first time.
[0043] Among them, the candidate material means that the material is the second in the transportation order among multiple materials to be stacked. When the target material corresponding to the first one is transported, and no other materials are added to the buffer area, the candidate material is transported.
[0044] Specifically, compared with identifying one material and transporting one material, by determining the material to be stacked with the highest priority as the target material, and the material to be stacked with the second highest priority as the candidate material, it is convenient to simultaneously determine the respective transport strategies of the target material and the candidate material, thereby reducing the number of times the transport strategies are generated and improving the overall transport efficiency of multiple materials to be stacked.
[0045] It should be noted that there can be multiple candidate materials. Specifically, the material to be palletized with the highest priority is determined as the target material, and the material to be palletized with the second highest priority, the material to be palletized with the third highest priority, and so on are determined as the first candidate material and the second candidate material, respectively. In this way, the handling order of multiple materials to be palletized is determined at the same time, which greatly reduces the number of material identification times and helps to improve the handling efficiency.
[0046] S208: Determine the transport strategies of the target material and the candidate material based on their respective attribute information and space information.
[0047] The transport strategy represents how to transport the materials to be palletized from the palletizing buffer area to the palletizing storage area.
[0048] Specifically, the transport strategy may include a transport starting point, a transport end point, a transport path, and the like.
[0049] Among them, the starting point of transportation can be the center point of the material to be stacked in the stacking buffer area, the end point of transportation can be the center point of the material to be stacked in the stacking storage area, and the transportation path can be the path passed by the center point of the material to be stacked, or it can refer to the path passed by the end of the robot.
[0050] Specifically, the robot is controlled to carry and palletize the target material based on the handling strategy of the target material, and the robot is controlled to carry and palletize the candidate material based on the handling strategy of the candidate material.
[0051] In the above-mentioned method for determining the handling strategy, the attribute information of each of the multiple materials to be palletized temporarily stored in the palletizing buffer area and the spatial information of the palletizing storage area are obtained, and the handling priority conditions configured for palletizing handling are matched with the attribute information of each material to be palletized to obtain the priority of each material to be palletized, and the material to be palletized with the highest priority is determined as the target material, and the material to be palletized with the second highest priority is determined as the candidate material. The target material and the candidate material are determined at the same time, providing a basis for the subsequent simultaneous determination of the handling strategies of the target material and the candidate material. Based on the attribute information and spatial information of the target material and the candidate material, the handling strategies of the target material and the candidate material are determined. The above method is used to simultaneously determine the handling strategies of the target material and the candidate material, which reduces the number of times the handling strategies are generated and improves the overall palletizing efficiency of multiple materials to be palletized.
[0052] In one embodiment, based on the attribute information and spatial information of each of the target material and the candidate material, the handling strategies of the target material and the candidate material are determined, including: determining the handling strategy of the target material based on the attribute information and spatial information of the target material, simulating the handling of the target material according to the handling strategy of the target material to determine the expected handling result of the target material, and determining the handling strategy of the candidate material based on the expected handling result and the attribute information of the candidate material.
[0053] The space information indicates the size of the space in the palletizing storage area. Specifically, the space information may indicate the size of the available space and the available space position in the palletizing storage area. Specifically, the attribute information may indicate the material size of the target material.
[0054] Specifically, the handling strategy of the target material is determined according to information such as the material size of the target material, the size of the available space in the palletizing storage area, and the available space position.
[0055] The handling simulation can be a real-time simulation of the handling strategy of the target material in three-dimensional space to obtain the expected handling result of the target material.
[0056] The expected handling result includes the expected position of the target material in the palletizing storage area. The expected position can be represented by the center point of the target material in the palletizing storage area.
[0057] Specifically, based on the expected position and the material size, material shape and other information of the candidate material, the handling strategy of the candidate material is determined. Specifically, after the handling strategy of the candidate material is determined, the handling strategy of the candidate material can be subjected to a collision test with the handling strategy of the target material, that is, to detect whether the expected position of the candidate material in the palletizing storage area conflicts with the expected position of the target material in the palletizing storage area, and the position of other materials in the palletizing storage area. If there is a conflict, the handling strategy is regenerated. Specifically, after the handling strategy of the candidate material is determined, it can also be determined whether the expected position of the candidate material in the palletizing storage area is in close contact with the expected position of the target material in the palletizing storage area, and the position of other materials in the palletizing storage area. If not, the handling strategy is regenerated.
[0058] In this embodiment, based on the attribute information and spatial information of the target material, the handling strategy of the target material is determined, and the target material is simulated for handling according to the handling strategy of the target material to determine the expected handling result of the target material. Based on the expected handling result and the attribute information of the candidate materials, the handling strategy of the candidate materials is determined, and the handling of the target material is simulated according to the handling strategy of the target material. This avoids material position conflicts, improves the compactness of the arrangement of materials, and improves space utilization.
[0059] In one embodiment, the method for determining a handling strategy further includes: controlling the robot to transport the target material to the palletizing storage area according to the handling strategy of the target material, and controlling the robot to transport the candidate material to the palletizing storage area based on the priority and handling strategy of the candidate material.
[0060] The transport strategy includes the transport starting point, transport ending point, transport path, etc.
[0061] Among them, the starting point of transportation can be the center point of the material to be stacked in the stacking buffer area, the end point of transportation can be the center point of the material to be stacked in the stacking storage area, and the transportation path can be the path passed by the center point of the material to be stacked, or it can refer to the path passed by the end of the robot.
[0062] Specifically, the robot is controlled to move the target material from the transport starting point through the transport path to the transport end point, and the transport of the target material is completed. At this time, the target material arrives at the palletizing storage area. After the target material arrives at the palletizing storage area, the robot is reset to the initial position and is ready to enter the next transport process. It should be noted that the process of controlling the robot to move the target material from the transport starting point to the transport end point involves the transport operation of the target material and the palletizing operation of the target material.
[0063] Specifically, if the priority of the candidate material is the highest among the priorities of the materials to be palletized, the robot is controlled to carry the candidate material to the palletizing storage area based on the handling strategy of the candidate material. If the priority of the candidate material is not the highest among the priorities of the materials to be palletized, the material to be palletized with the highest priority is selected from the materials to be palletized according to their respective priorities, and the material to be palletized is carried preferentially.
[0064] In this embodiment, according to the handling strategy of the target material, the robot is controlled to transport the target material to the palletizing storage area. Based on the priority and handling strategy of the candidate materials, the robot is controlled to transport the candidate materials to the palletizing storage area. At the same time, the handling strategies of the target material and the candidate materials are determined respectively, which reduces the number of times the handling strategies are generated and improves the overall palletizing efficiency of multiple materials to be palletized.
[0065] In one embodiment, based on the priority and handling strategy of the candidate materials, the robot is controlled to transport the candidate materials to the palletizing storage area, including: when it is detected that the palletizing buffer area receives a new material, the attribute information of the new material is obtained, the attribute information of the new material is matched with the handling priority condition, and the priority of the new material is determined; if the priority of the new material is higher than that of the candidate material, the new material is determined as a new target material, and the step of determining the handling strategy of the target material and the candidate material based on their respective attribute information and spatial information is returned; if the priority of the new material is not higher than that of the candidate material, the robot is controlled to transport the candidate material to the palletizing storage area according to the handling strategy of the candidate material.
[0066] Among them, detecting that the palletizing buffer area receives a new material indicates that the target material has left the palletizing buffer area, a new material has been added to the palletizing buffer area, and a signal of the arrival of the new material has been received. Specifically, it is possible to determine whether the palletizing buffer area receives a new material by detecting a switch, such as an infrared sensor, a proximity switch, etc. It is also possible to determine whether the palletizing buffer area receives a new material by image recognition, by judging the image taken by the visual camera.
[0067] Specifically, if the priority of the new material is higher than that of the candidate material, the new material will be determined as the new target material, and the steps of determining the handling strategies of the target material and the candidate material based on their respective attribute information and spatial information will be returned to obtain the handling strategy of the new material. Based on the handling strategy of the new material, the robot will be controlled to transport the new material to the palletizing storage area.
[0068] Specifically, if the priority of the new material is not higher than that of the candidate material, the robot is controlled to transport the candidate material to the palletizing storage area according to the transport strategy of the candidate material.
[0069] In this embodiment, when it is detected that the palletizing buffer area receives a new material, the attribute information of the new material is obtained, the attribute information of the new material is matched with the handling priority conditions, and the priority of the new material is determined. If the priority of the new material is higher than that of the candidate material, the new material is determined as the new target material, and the step of determining the handling strategies of the target material and the candidate material based on their respective attribute information and spatial information is returned. If the priority of the new material is not higher than that of the candidate material, the robot is controlled to transport the candidate material to the palletizing storage area according to the handling strategy of the candidate material. In the scenario of timely replenishment of materials, the handling strategy of the new material is determined, which helps to improve the overall palletizing and handling efficiency.
[0070] In one embodiment, the attribute information includes material size, and obtaining the attribute information of each of the multiple materials to be palletized temporarily stored in the palletizing buffer area includes: obtaining the material image of each of the multiple materials to be palletized temporarily stored in the palletizing buffer area, determining the size error of the material image based on the camera parameters of the robot's visual camera, and correcting the size information represented by each material image according to the size error to determine the material size of each material to be palletized.
[0071] The material image may be an image obtained by photographing the material to be palletized. Specifically, the material image may be obtained by photographing the material to be palletized using a visual camera or other camera with image recognition capability. The visual camera or other camera with image recognition capability may be fixedly installed at a certain position, or may be installed on a robot, specifically at the end of the robot.
[0072] It should be noted that in order to avoid collision of the materials to be stacked during the transportation process, the material size in the material image of the materials to be stacked can be appropriately increased.
[0073] The camera parameters of the visual camera include necessary parameters such as the internal and external parameters of the visual camera. The size error of the material image represents the image distortion correction value of the image taken by the visual camera. Specifically, the material image can be corrected according to the image distortion correction value to obtain the material size of the material to be palletized.
[0074] The image correction value may be a gradient correction value. For example, if the size information represented by the material image is any value between 18 and 20 cm in length, the aforementioned value may be corrected to be greater than or equal to 20 cm according to the correction value. If the size information represented by the material image is any value between 15 and 18 cm in length, the aforementioned value may be corrected to be greater than or equal to 18 cm according to the correction value.
[0075] In this way, collisions between the materials to be palletized when being transported by the robot can be avoided to a certain extent.
[0076] In this embodiment, the attribute information includes material size, and the material image of each of the multiple materials to be stacked temporarily stored in the stacking buffer area is obtained. Based on the camera parameters of the robot's visual camera, the size error of the material image is determined, and the size information represented by each material image is corrected according to the size error to determine the material size of each material to be stacked. The material size of the material to be stacked is greater than or equal to the size information represented by the material image, which to a certain extent avoids collisions between the materials to be stacked when being transported by the robot.
[0077] In one embodiment, based on the attribute information and spatial information of the target material, a handling strategy for the target material is determined, including: parsing the spatial information, determining available storage points from the palletizing storage area, extracting the material size of the target material from the attribute information, determining multiple candidate point spaces that match the material size, each candidate point space including multiple continuous available storage points, screening target point spaces that meet collision test conditions in each candidate point space, and determining the handling strategy for the target material based on the central storage point of the target point space.
[0078] The spatial information includes a plurality of storage points, each of which may be a dense point arranged in a matrix. Specifically, the distance between a storage point and an adjacent storage point may be 5 cm.
[0079] Among them, based on the material size, it can be determined how many available storage points the target material needs to occupy.
[0080] Specifically, based on the material size of the target material and the number of available storage locations, the number of available storage locations occupied by the target material is determined, and further, based on the number of available storage locations occupied, multiple candidate location spaces matching the material size are determined, wherein each candidate location space includes multiple continuous available storage locations.
[0081] Among them, the candidate point space may conflict with the occupied points in the palletizing storage area. Specifically, the closed space formed by the available storage points in the candidate point space conflicts with other occupied storage points, that is, other occupied storage points are located in the candidate point space or in the closed space.
[0082] Specifically, if no other occupied storage points are located in the candidate point space or the closed space, it is considered that the candidate point space passes the collision test, and the candidate point space is determined as the target point space.
[0083] Furthermore, the candidate point spaces that have passed the collision test can be further screened, and the candidate point spaces that have multiple occupied storage points around them can be determined as target point spaces. In this way, the space can be effectively used and the space utilization rate can be improved.
[0084] The central storage point refers to the storage point at the center of the target point space. The central storage point is determined as the path end point, and then the handling strategy of the target material including the path end point is obtained.
[0085] In this embodiment, by analyzing the spatial information, the available storage points are determined from the palletizing storage area, the material size of the target material is extracted from the attribute information, and multiple candidate point spaces matching the material size are determined. Each candidate point space includes multiple continuous available storage points. The target point space that meets the collision test conditions is screened in each candidate point space, and the handling strategy of the target material is determined based on the central storage point of the target point space. This avoids collisions while effectively utilizing the space and improving space utilization.
[0086] In one embodiment, as shown in FIG3 , a flow chart of a method for handling disorderly mixed multi-boxes using a collaborative robot-based forward-looking algorithm includes:
[0087] S302, obtaining attribute information of each of a plurality of materials to be palletized that are temporarily stored in a palletizing buffer area, and space information of a palletizing storage area.
[0088] Among them, obtaining the attribute information of each of the multiple materials to be palletized temporarily stored in the palletizing buffer area includes: obtaining the material image of each of the multiple materials to be palletized temporarily stored in the palletizing buffer area; determining the size error of the material image based on the camera parameters of the robot's visual camera; and correcting the size information represented by each material image according to the size error to determine the material size of each material to be palletized.
[0089] S304, matching the handling priority conditions configured for palletizing with the attribute information of each material to be palletized, to obtain the priority of each material to be palletized.
[0090] S306, determining the to-be-palletized material with the highest priority as the target material, and determining the to-be-palletized material with the second highest priority as the candidate material.
[0091] S308, analyzing the spatial information of the palletizing storage area, and determining available storage points in the palletizing storage area.
[0092] S310, extracting the material size of the target material from the attribute information, and determining a plurality of candidate point spaces matching the material size.
[0093] Each candidate point space includes a plurality of continuous available storage points.
[0094] S312: Select a target point space that meets the collision test conditions from among the candidate point spaces.
[0095] S314, determining a target material handling strategy based on the central storage point in the target point space.
[0096] S316, simulating the transportation of the target material according to the transportation strategy of the target material to determine the expected transportation result of the target material.
[0097] S318, determining a transportation strategy for the candidate material based on the expected transportation result and the attribute information of the candidate material.
[0098] S320, according to the handling strategy of the target material, controlling the robot to carry the target material to the palletizing storage area.
[0099] S322, determine whether the palletizing buffer area receives new materials, if so, execute S324, if not, execute S330.
[0100] S324, when it is detected that the palletizing buffer area receives a new material, obtaining attribute information of the new material;
[0101] S326, matching the attribute information of the new material with the handling priority condition to determine the priority of the new material.
[0102] S328, determine whether the priority of the new material is higher than that of the candidate material. If so, determine the new material as the new target material and return to S308. If not, execute S330.
[0103] S330, based on the priority and handling strategy of the candidate materials, control the robot to carry the candidate materials to the palletizing storage area.
[0104] Among them, taking the box as an example of the material to be stacked, the carton handling method includes: Step 1, data acquisition: obtain the size, position information and camera recognition error of the box in the current buffer area. Step 2, storage memory: establish a three-dimensional storage space, and use the three-dimensional grid system to track and manage the occupancy status of each voxel. Step 3, data processing: according to the boxes in the available space and buffer area, use the multi-box forward-looking algorithm to simulate the stacking of multiple boxes, and give priority to the solution that can stack more boxes. Step 4, placement decision: simulate the placement process, check physical collision and stability, and calculate the optimal stacking strategy. Step 5, operation guidance: the system guides the automated robotic arm to place items based on the results output by the algorithm.
[0105] Specifically, 1. Initialize the box information in the buffer area: obtain the box information in the current buffer area through the camera, and randomly generate the initial box size and position information with camera recognition error. 2. Simulate multi-box stacking and calculation 1: (Determine the first box to be transported) According to the obtained box information and the available placement area, use the multi-box forward-looking algorithm to simulate the placement, sort the boxes according to the product of volume and weight, and calculate all optional stacking strategies for the first box after sorting. 3. Simulate multi-box stacking and calculation 2: (Determine the second box to be transported) According to the stacking strategy obtained for the first box, after simulating the placement, determine the stacking strategy for the second box after sorting, and continue to simulate all boxes in the buffer area according to this logic. 4. Simulate multi-box stacking and calculation 3: According to the processing, a stacking strategy that can stack as many boxes as possible is obtained, and the stacking plan for the first box in the strategy is output, and then the box is filled into the buffer area and the next calculation is started. 5. Control the robotic arm to stack: Control the robot to move, stack the first box and wait for the calculation results after the buffer area is updated.
[0106] The disordered mixed code algorithm allows for flexible box stacking in different environments and conditions, improving operational flexibility and efficiency. Three-dimensional storage space management: Use a three-dimensional grid system to track and manage the occupancy status of each voxel to optimize the utilization of storage space. Combining greedy algorithms and heuristic algorithms, intelligently predict the best placement and direction of different items in a specific storage environment. Through the multi-box forward-looking algorithm, the placement order of multiple boxes can be comprehensively considered, the stacking strategy can be optimized, and the overall efficiency can be improved. The feasibility of the placement plan is ensured by simulating the placement process and physical collision detection, while considering additional space to prevent oppression and keep the stack neat. The camera recognition error is taken into account in the simulation, and the box size is randomly corrected within the error range to simulate the real situation as much as possible.
[0107] In this embodiment, the attribute information of each of the multiple materials to be palletized temporarily stored in the palletizing buffer area and the spatial information of the palletizing storage area are obtained, and the handling priority conditions configured for palletizing handling are matched with the attribute information of each material to be palletized, and the priority of each material to be palletized is obtained. The material to be palletized with the highest priority is determined as the target material, and the material to be palletized with the second highest priority is determined as the candidate material. The target material and the candidate material are determined at the same time, providing a basis for the subsequent simultaneous determination of the handling strategies of the target material and the candidate material. Based on the attribute information and spatial information of the target material and the candidate material, the handling strategies of the target material and the candidate material are determined. The above method is used to simultaneously determine the handling strategies of the target material and the candidate material, which reduces the number of times the handling strategies are generated and improves the overall palletizing efficiency of multiple materials to be palletized. This method 1. Improves stacking efficiency: By simulating and looking forward to multiple boxes, the efficiency of box stacking can be significantly improved. 2. Improves storage space utilization: Through three-dimensional grid system management and optimization, the utilization of storage space can be maximized. 3. Enhances operational flexibility: The disordered mixed code algorithm allows flexible adjustment of operations under different environments and conditions, improving the adaptability of the system. 4. Optimize multi-box stacking strategy: Through the multi-box forward-looking algorithm, the placement order of multiple boxes can be comprehensively considered, the stacking strategy can be optimized, and the overall efficiency can be improved. This method is applicable to various automated warehousing and palletizing systems, especially in disordered mixed-code operations. It has significant advantages in improving the flexibility and efficiency of operations through three-dimensional grid storage space management and intelligent decision support systems. Through multi-box forward-looking, it is conducive to further improving the volume ratio.
[0108] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.
[0109] Based on the same inventive concept, the embodiment of the present application also provides a transport strategy determination device for implementing the transport strategy determination method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more embodiments of the transport strategy determination device provided below can refer to the limitations of the transport strategy determination method above, and will not be repeated here.
[0110] In one embodiment, as shown in FIG. 4 , a transport strategy determination device is provided, including: an acquisition module 402 , a matching module 404 , a material determination module 406 , and a strategy determination module 408 , wherein:
[0111] An acquisition module 402 is used to acquire attribute information of each of a plurality of materials to be palletized temporarily stored in a palletizing buffer area, and space information of a palletizing storage area;
[0112] A matching module 404 is used to match the handling priority conditions configured for palletizing with the attribute information of each material to be palletized, so as to obtain the priority of each material to be palletized;
[0113] A material determination module 406, used to determine the to-be-palletized material with the highest priority as the target material, and determine the to-be-palletized material with the second highest priority as the candidate material;
[0114] The strategy determination module 408 is used to determine the handling strategies of the target material and the candidate material based on the attribute information and spatial information of the target material and the candidate material.
[0115] In one of the embodiments, the strategy determination module 408 is also used to determine the handling strategy of the target material based on the attribute information and spatial information of the target material; simulate the handling of the target material according to the handling strategy of the target material to determine the expected handling result of the target material; and determine the handling strategy of the candidate material based on the expected handling result and the attribute information of the candidate material.
[0116] In one of the embodiments, the handling strategy determination device also includes: a handling module, used to control the robot to transport the target material to the palletizing storage area according to the handling strategy of the target material; based on the priority and handling strategy of the candidate material, control the robot to transport the candidate material to the palletizing storage area.
[0117] In one of the embodiments, the handling module is further used to obtain attribute information of the new material when it is detected that the palletizing buffer area receives the new material; match the attribute information of the new material with the handling priority conditions to determine the priority of the new material; if the priority of the new material is higher than that of the candidate material, the new material is determined as a new target material, and the step of determining the handling strategy of the target material and the candidate material based on their respective attribute information and spatial information is returned; if the priority of the new material is not higher than that of the candidate material, the robot is controlled to transport the candidate material to the palletizing storage area according to the handling strategy of the candidate material.
[0118] In one of the embodiments, the attribute information includes material size, and the acquisition module 402 is also used to obtain the attribute information of each of the multiple materials to be stacked temporarily stored in the stacking buffer area, including: obtaining the material image of each of the multiple materials to be stacked temporarily stored in the stacking buffer area; determining the size error of the material image based on the camera parameters of the robot's visual camera; and correcting the size information represented by each material image according to the size error to determine the material size of each material to be stacked.
[0119] In one of the embodiments, the strategy determination module 408 is also used to parse spatial information and determine available storage points from the palletizing storage area; extract the material size of the target material from the attribute information and determine multiple candidate point spaces that match the material size; each candidate point space includes multiple continuous available storage points; select the target point space that meets the collision test conditions in each candidate point space; and determine the handling strategy of the target material based on the central storage point of the target point space.
[0120] Each module in the above-mentioned transport strategy determination device can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.
[0121] In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be shown in FIG5. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected via a system bus, and the communication interface is connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store attribute information data and spatial information data. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, a method for determining a transport strategy is implemented.
[0122] Those skilled in the art will understand that the structure shown in FIG. 5 is merely a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.
[0123] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the above method steps are implemented when the processor executes the computer program.
[0124] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the above method steps are implemented.
[0125] In one embodiment, a computer program product is provided, comprising a computer program, which implements the above method steps when executed by a processor.
[0126] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. In addition, the acquisition, storage, processing, and transmission of data are in compliance with relevant laws and regulations.
[0127] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.
[0128] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0129] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A method for determining a transport strategy, characterized in that: The method comprises: Obtaining attribute information of each of a plurality of materials to be palletized that are temporarily stored in a palletizing buffer area, and spatial information of a palletizing storage area; Matching the handling priority conditions configured for palletizing with the attribute information of each material to be palletized, respectively, to obtain the priority of each material to be palletized; The material to be palletized with the highest priority is determined as the target material, and the material to be palletized with the second highest priority is determined as the candidate material; Based on the attribute information of the target material and the candidate material, and the space information, a transport strategy of the target material and the candidate material is determined.
2. The method according to claim 1, characterized in that The determining of the transport strategies of the target material and the candidate material based on the attribute information of the target material and the candidate material, and the space information, includes: Determining a transport strategy for the target material based on the attribute information of the target material and the spatial information; Performing simulated transportation of the target material according to the transportation strategy of the target material to determine the expected transportation result of the target material; Based on the expected transport result and the attribute information of the candidate material, a transport strategy for the candidate material is determined.
3. The method according to claim 1 or 2, characterized in that: The method further comprises: According to the handling strategy of the target material, controlling the robot to carry the target material to the palletizing storage area; Based on the priority and handling strategy of the candidate materials, the robot is controlled to carry the candidate materials to the palletizing storage area.
4. The method according to claim 3, characterized in that The controlling the robot to transport the candidate material to the palletizing storage area based on the priority and the transport strategy of the candidate material comprises: When it is detected that the palletizing buffer area receives a new material, acquiring attribute information of the new material; Matching the attribute information of the new material with the handling priority condition to determine the priority of the new material; If the priority of the new material is higher than that of the candidate material, the new material is determined as a new target material, and the process returns to the step of determining the transport strategies of the target material and the candidate material based on the attribute information of the target material and the candidate material and the spatial information. If the priority of the new material is not higher than that of the candidate material, the robot is controlled to transport the candidate material to the palletizing storage area according to the transport strategy of the candidate material.
5. The method according to claim 1, characterized in that The attribute information includes material size; The obtaining of attribute information of each of the plurality of materials to be palletized temporarily stored in the palletizing buffer area includes: Acquire material images of each of a plurality of materials to be palletized that are temporarily stored in a palletizing buffer area; Determine the dimensional error of the material image based on the camera parameters of the robot's visual camera; The size information represented by each of the material images is corrected according to the size error to determine the material size of each of the materials to be stacked.
6. The method according to claim 1, characterized in that Determining a transport strategy for the target material based on the attribute information of the target material and the spatial information includes: Analyzing the spatial information and determining available storage points from the palletizing storage area; Extracting the material size of the target material from the attribute information, and determining a plurality of candidate point spaces matching the material size; each of the candidate point spaces includes a plurality of continuous available storage points; Selecting a target point space that meets the collision test conditions from each of the candidate point spaces; Based on the central storage point of the target point space, a transportation strategy for the target material is determined.
7. A transport strategy determination device, characterized in that: The device comprises: An acquisition module is used to acquire the attribute information of each of the multiple materials to be palletized temporarily stored in the palletizing buffer area, and the space information of the palletizing storage area; A matching module, used for matching the handling priority conditions configured for palletizing with the attribute information of each material to be palletized, to obtain the priority of each material to be palletized; A material determination module, used to determine the to-be-palletized material with the highest priority as the target material, and determine the to-be-palletized material with the second highest priority as the candidate material; The strategy determination module is used to determine the handling strategy of the target material and the candidate material based on the attribute information of the target material and the candidate material and the space information.
8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
