Multi-robot cooperation method and device, electronic equipment and storage medium

Abstract

The invention relates to a multi-robot cooperation method and device, electronic equipment and a storage medium, belongs to the technical field of robot control, and is used for performing cooperative control on multiple robots based on a constructed MRVCC model. The MRVCC model comprises a virtual centroid module, a consensus algorithm module and a hierarchical strategy control module; the multi-robot cooperation method comprises the following steps: constructing a virtual centroid node shared by multiple robots based on a virtual centroid module, planning behaviors of the multiple robots based on the virtual centroid node, generating a multi-robot formation, and obtaining formation information; the behaviors of the multiple robots are coordinated based on formation information and a consensus algorithm module, and a minimum formation accumulated error is obtained; and the states of the robots in the multi-robot formation are determined, and based on the states of the robots, a hierarchical strategy control module is adopted to execute various kinds of strategy control, so that multi-robot collaborative formation and obstacle avoidance targets are completed.

Description

Technical Field

[0001] The present invention relates to the field of robot control technology, and in particular to a multi-robot collaboration method, device, electronic equipment and storage medium. Background Art

[0002] As one of the important research directions in the field of robotics, multi-robot collaborative formation control is committed to solving the problem of collaborative motion between multiple robots, including core tasks such as navigation, formation formation and maintenance, and obstacle avoidance. Research in this field is not only related to the intelligence and collaboration of the robot system, but also directly affects the actual performance of the multi-robot system in practical applications.

[0003] Multi-robot collaborative formations can be mainly divided into follower-navigator structure, hierarchical structure, and hybrid control structure. The follower-navigator structure selects a robot as the navigator to make independent decisions, and the remaining robots serve as followers. The followers can quickly respond to the navigator's instructions; the hierarchical control structure divides the multi-robot system into task planning layer, path planning layer, and motion control layer, achieving a certain degree of combination of independent control and centralized control; the hybrid control structure dynamically selects the appropriate control strategy according to the specific situation: centralized control is used in static environments, and distributed control is used in dynamic environments or when encountering obstacles.

[0004] However, the navigation structure is greatly affected by the single-point failure of the navigator during movement. If only the navigator makes independent decisions, the robustness and flexibility of the formation coordination will be reduced; the hierarchical control structure system is more complex and requires the design and implementation of multi-level control algorithms and communication mechanisms, and there are problems with information transmission and delay; the hybrid control structure is unstable or inconsistent during the switching process between the two control strategies; the above three methods have certain limitations in accuracy, formation flexibility and stability, and the applicable scenarios are relatively single. Summary of the invention

[0005] In view of this, it is necessary to provide a multi-robot collaboration method, device, electronic device and storage medium to solve the technical problem that the accuracy, flexibility and stability of multi-robot collaborative formations are limited to a certain extent.

[0006] In order to solve the above problems, the present invention provides a multi-robot collaboration method for collaboratively controlling multiple robots based on a constructed MRVCC model; the MRVCC model includes a virtual centroid module, a consensus algorithm module and a hierarchical strategy control module; The multi-robot collaboration method comprises: Based on the virtual centroid module, a virtual centroid node shared by multiple machines is constructed, and based on the virtual centroid node, the behavior of multiple robots is planned, a multi-robot formation is generated, and formation information is obtained; Coordinate the behaviors of the multiple robots based on the formation information and the consensus algorithm module, and obtain a minimum formation cumulative error; Based on the acquired radar data and odometer information, the states of the robots in the multi-robot formation are determined. Based on the states of the robots, the hierarchical strategy control module is used to execute multiple strategy controls. Based on the multiple strategy controls and the minimum formation accumulated error, the multiple robots are collaboratively controlled to complete the collaborative formation and obstacle avoidance goals of the multiple robots, wherein the multiple strategy controls include safety collaboration, obstacle avoidance decisions, and formation stability detection.

[0007] In a possible implementation, the planning of the behaviors of multiple robots based on the virtual center of mass node includes: Constructing a SAC model, obtaining a policy network and a value network of the robot, training the policy network and the value network of the robot based on the SAC model, obtaining an average return value of the robot based on the value network of the robot, determining an optimal robot policy network based on the average return value, and determining a center of mass motion model of the robot based on the optimal robot policy network; After planning the formation coordinate position of the multi-robot formation based on the virtual center of mass node, the robots are navigated based on the formation coordinate position through the center of mass motion model of the robots to meet the formation requirements and obtain the position coordinates of the robot nodes in the multi-robot formation; Determine the target formation position, determine the optimal path based on the target formation position, the position coordinates and the virtual center of mass node, and plan the behavior of the multi-robots based on the optimal path and the center of mass motion model of the multi-robots so that the multi-robot formation reaches the target formation position.

[0008] In a possible implementation, the SAC model includes an Actor network and a Critic network; and the step of training the strategy network and the value network of the robot based on the SAC model includes: Learning the mapping relationship between different states and actions of the robot based on the Actor network; The current state of the robot and the actions taken based on the current state are scored based on the Critic network.

[0009] In a possible implementation, the coordinating the behaviors of the multiple robots based on the formation information and the consensus algorithm module includes: Determine the robot nodes and the master node in the multi-robot formation, wherein the master node is a virtual centroid node; Obtaining positions of a robot node and a virtual center of mass node based on the formation information, and calculating a relative position vector of the robot node and the virtual center of mass node based on the positions of the robot node and the virtual center of mass node; Acquire the expected coordinates of the robot node, and calculate the expected relative position vector between the robot node and the virtual center of mass node based on the expected coordinates and the position of the virtual center of mass node; Determine an error between the robot node and the virtual center of mass node based on the relative position vector and the expected relative position vector, and determine a formation cumulative error based on the error between the robot node and the virtual center of mass node; Based on the formation accumulated error, the behavior of the robot nodes is coordinated through the consensus algorithm module, and the communication of the robot nodes is controlled through the virtual center of mass node to minimize the formation accumulated error of the robot formation, wherein the behavior of the robot nodes is controlled by the center of mass motion model.

[0010] In a possible implementation, controlling the communication of the robot node through the virtual center of mass node includes: Step 1: obtaining the formation position parameters of the robot nodes through the virtual center of mass node, and completing the multi-robot formation through the center of mass motion model based on the formation position parameters; Step 2: After the multi-robot formation is formed, the motion control information of the robot node is refreshed through the virtual centroid node, and the communication topic is sent to the robot node; Step 3: Acquire the topic information of the communication topic, send the topic information to the motion controller of the robot node, obtain the information of the robot node after the robot completes its own movement through the motion controller, feed back the information of the robot node to the virtual center of mass node to obtain the coordinates and expected coordinates of the robot node, and determine the formation cumulative error based on the coordinates and expected coordinates of the robot node; Step 4: After the virtual centroid node obtains the information of the robot node, steps 2 to 4 are repeated.

[0011] In a possible implementation, the calculation formula of the formation cumulative error is: , , in, is the cumulative error of the formation, The robot node and the virtual center of mass node are The error in time, for The relative position vector between the robot node and the virtual center of mass node at the moment, for The expected relative position vector of the robot node and the virtual center of mass node at the moment.

[0012] In a possible implementation, the states of the robots in the multi-robot formation are determined based on the acquired radar data and odometer information, and based on the states of the robots, the hierarchical strategy control module is used to perform multiple strategy controls, including: Preset a safe distance between the robot and the obstacle, determine the distance between the robot and the obstacle based on the radar data, compare the distance between the robot and the obstacle with the safe distance, and when the distance between the robot and the obstacle is greater than the safe distance, use the hierarchical strategy control module to perform safety coordination, wherein the robot node is guided to move through the virtual centroid node; When the distance between the robot and the obstacle is less than or equal to the safety distance, the hierarchical strategy control module is used to execute obstacle avoidance decision, wherein the movement of the robot node is controlled by the center of mass motion model of the robot node; Determine the target formation position, preset the retention time threshold of the robot and the distance threshold between the robot and the target formation position, determine the distance between the robot and the target formation position and the retention time of the robot based on the odometer information, when the distance between the robot and the target formation position is greater than the distance threshold and the retention time is greater than the retention time threshold, use the hierarchical strategy control module to perform formation stability detection, wherein the target formation position information is obtained, and based on the target formation position information, the movement of the robot node is controlled through the center of mass motion model of the robot node, so that the state of the robot reaches a stable state.

[0013] On the other hand, the present invention also provides a multi-robot collaborative device for collaboratively controlling multiple robots based on a constructed MRVCC model; the MRVCC model includes a virtual centroid module, a consensus algorithm module, and a hierarchical strategy control module; The multi-robot collaborative device comprises: A virtual centroid unit, used to construct a virtual centroid node shared by multiple machines based on the virtual centroid module, plan the behavior of multiple robots based on the virtual centroid node, generate a multi-robot formation, and obtain formation information; A consensus algorithm unit, used to coordinate the behaviors of the multiple robots based on the formation information and the consensus algorithm module, and obtain a minimum formation cumulative error; A hierarchical strategy control unit is used to determine the status of the robots in the multi-robot formation based on the acquired radar data and odometer information, and based on the status of the robots, use the hierarchical strategy control module to execute multiple strategy controls, and based on the multiple strategy controls and the minimum formation accumulated error, the multiple robots are collaboratively controlled to complete the collaborative formation and obstacle avoidance goals of the multiple robots, wherein the multiple strategy controls include safety collaboration, obstacle avoidance decision-making, and formation stability detection.

[0014] In another aspect, the present invention further provides an electronic device, comprising: a processor and a memory; The memory stores a computer-readable program executable by the processor; When the processor executes the computer-readable program, the steps in the multi-robot collaboration method described above are implemented.

[0015] On the other hand, the present invention also provides a computer-readable storage medium, which stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps in the multi-robot collaboration method as described above.

[0016] The beneficial effects of the present invention are as follows: a virtual center of mass node shared by multiple machines is constructed, and robots in a multi-robot formation obtain their own formation positions through the shared virtual center of mass, which replaces direct communication between robots, effectively reduces the communication delay caused by information interaction between robots, speeds up the response speed of the multi-robot formation, realizes precise formation, improves the accuracy of the multi-robot formation, introduces a consensus algorithm based on the multi-robot formation, regards each robot in the multi-robot formation as an independent decision-making unit, and each robot has independent perception, decision-making and execution capabilities; at the same time, each robot will promote the formation and maintenance of the formation based on the shared information in the virtual center of mass, thereby maximizing the coordination of multiple robots, and the hierarchical strategy control module executes safe coordination, obstacle avoidance decision-making and formation stability detection, so that each robot in the multi-robot formation can adopt corresponding control strategies in different states to ensure the flexibility and stability of the multi-robot formation. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 A schematic diagram of the structure of an embodiment of the MRVCC model provided by the present invention; Figure 2 A flowchart of an embodiment of the multi-robot collaboration method provided by the present invention; Figure 3 A schematic diagram of the topological structure of the virtual center of mass and robot nodes of the multi-robot collaboration method provided by the present invention; Figure 4A schematic diagram of a consensus algorithm based on center of mass control for a multi-robot collaboration method provided by the present invention; Figure 5 A schematic structural diagram of an embodiment of a multi-robot collaborative device provided by the present invention; Figure 6 A schematic structural diagram of an embodiment of an electronic device provided by the present invention. DETAILED DESCRIPTION

[0018] The preferred embodiments of the present invention are described in detail below in conjunction with the accompanying drawings, wherein the accompanying drawings constitute a part of this application and are used together with the embodiments of the present invention to illustrate the principles of the present invention, but are not used to limit the scope of the present invention.

[0019] The present invention discloses a multi-robot collaboration method, device, electronic device and storage medium, which can be used in a computer. The method, device or computer-readable storage medium involved in the present invention can be integrated with the above-mentioned device or can be relatively independent.

[0020] A specific embodiment of the present invention discloses a multi-robot collaboration method, which can be executed by a computer, specifically by one or more processors of the computer. Figure 1 As shown, the MRVCC model 100 includes a virtual centroid module 110, a consensus algorithm module 120, and a hierarchical strategy control module 130, and performs collaborative control of multiple robots based on the constructed MRVCC model; Figure 2 As shown, the multi-robot collaboration method includes: S201, constructing a virtual centroid node shared by multiple robots based on the virtual centroid module 110, planning the behavior of multiple robots based on the virtual centroid node, generating a multi-robot formation, and obtaining formation information; S202, coordinating the behaviors of multiple robots based on the formation information and the consensus algorithm module 120, and obtaining the minimum formation cumulative error; S203. Determine the status of the robots in the multi-robot formation based on the acquired radar data and odometer information. Based on the status of the robots, use the hierarchical strategy control module 130 to execute multiple strategy controls. Based on multiple strategy controls and the minimum formation cumulative error, collaborative control of the multiple robots is performed to complete the collaborative formation and obstacle avoidance goals of the multiple robots. The multiple strategy controls include safety collaboration, obstacle avoidance decisions, and formation stability detection.

[0021] Among them, the MRVCC model is a multi-robot formation model based on virtual center of mass and consensus algorithm. The MRVCC model includes a virtual center of mass module, a consensus algorithm module and a hierarchical strategy control module. The virtual center of mass module transforms the centralized control of multi-robot collaborative formation into virtual center of mass control. The virtual center of mass completes the behavior planning of robots in the effective area, realizing a high degree of coordination in the formation maintenance process. The consensus algorithm module regards each robot in the multi-machine system as an independent node with environmental perception, behavior decision-making and motion control. Each robot obtains formation information and motion control information at the virtual center of mass according to the consensus algorithm, solving the problem of asynchronous robot action execution caused by interaction delay. The consensus algorithm retains the flexibility of robot autonomous decision-making while coordinating multiple machines, and makes independent decisions according to its own situation during the formation formation process, ensuring the flexibility of real-time obstacle avoidance and the efficiency of tasks during the formation formation process.

[0022] Compared with the prior art, the multi-robot collaboration method provided in this embodiment constructs a virtual center of mass node shared by multiple machines based on a virtual center of mass module, plans the behavior of multiple robots based on the virtual center of mass node, generates a multi-robot formation, and obtains formation information, converts the centralized control of the multi-robot collaborative formation into virtual center of mass control, and realizes a high degree of collaboration in the formation maintenance process. The behavior of multiple robots is coordinated based on the formation information and the consensus algorithm module, and the minimum formation cumulative error is obtained, so that the multi-robot formation maintains a stable state. While the multi-machine collaborative scheduling is carried out, the flexibility of the robot's autonomous decision-making is retained. In the process of formation formation, independent decisions are made according to their own conditions, ensuring the flexibility of real-time obstacle avoidance and the efficiency of the task in the process of formation formation. Based on the state of the robot, a hierarchical strategy control module is used to execute multiple strategy controls. Based on multiple strategy controls and the minimum formation cumulative error, multiple robots are collaboratively controlled to complete the collaborative formation and obstacle avoidance goals of multiple robots. The robot's state is judged by the robot's perception result, and different strategy controls are adopted based on its own state perception to ensure the flexibility and stability of the multi-robot formation.

[0023] In some embodiments, in step S201, a virtual center of mass node shared by multiple machines is constructed based on a virtual center of mass module, and a topic function of the ROS (Robot Opration System) system is used to construct a virtual center of mass node shared by multiple machines, which is similar to a shared memory. The introduction of a virtual center of mass node will replace the physical navigator in the collaborative motion of multiple robots to control the action of the formation. If a virtual center of mass fails in a multi-robot system, the information of the failed node can be directly copied to a new virtual node. Compared with the physical node, which requires reinitializing the robot and reloading the information and communication records of all formation nodes, the time can be greatly shortened and the efficiency can be improved. The behavior of multiple robots is planned based on the virtual center of mass node, a multi-robot formation is generated, and formation information is obtained. First, in order to ensure the efficiency of virtual center of mass decision-making, SAC (Soft Actor) is used in an environment with obstacles. Critic) trains multiple robot policy networks and value networks at the same time, selects the policy network with the best performance as the center of mass motion model, controls the robot's behavior through the center of mass motion model, builds a SAC model, obtains the robot's policy network, trains the robot's policy network and value network based on the SAC model, obtains the robot's average return value based on the robot's value network, determines the optimal robot policy network based on the average return value, and determines the robot's center of mass motion model based on the optimal robot policy network. The process of training the robot's policy network and value network based on the SAC model can be divided into an Actor network and a Critic network. The mapping relationship between different states and actions of the robot is learned based on the Actor network, and the current state of the robot is determined based on the Critic network. and actions to take based on the current state Scoring is performed to evaluate the quality of the current Actor network; the interaction process of the robot in an environment with obstacles conforms to the Markov decision process, which can be represented by the tuple It indicates that, for The robot's status information at all times, which includes at least position information, lidar sensor data information, and speed information. for The actions taken at any time based on the current state of the robot, Adopting actions for robots The reward value obtained after the action is evaluated by the reward value. To take action After the robot Status information at all times. The robot obtains its own status information through radar data and odometer ,in, is 360-dimensional radar sensor data, is the distance between the robot’s current position and the target position, is the current orientation, is the linear velocity of the robot, is the angular velocity, the speed of the robot , the calculation formula for constraining the robot's linear velocity and angular velocity is: , in, is the maximum line speed, is the maximum angular velocity; Its reward function The calculation formula is: , in, is the difference between the current distance between the robot and the target position and the distance between the robot and the target position at the previous moment. When , the robot moves towards the target position. When , the robot is far away from the target position, The robot's laser radar sensor detects the distance between the current position and the obstacle. When the minimum distance exceeds the safety distance, When the robot is at a high probability of collision, a certain penalty is given, that is, a negative reward value. When the distance between the robot's current position and the target position is Within a certain range, it is judged that it has reached the target position and a positive reward value is given.

[0024] Secondly, after planning the formation coordinate position of the multi-robot formation based on the virtual center of mass node, the robot is navigated through the robot's center of mass motion model based on the formation coordinate position to complete the formation requirements and obtain the position coordinates of the robot nodes in the multi-robot formation. In addition to the same status information data as the robot node, the virtual center of mass node information also includes the current formation parameter information. In the formation formation stage, each robot obtains its own position coordinates in the current formation in the virtual center of mass node. When the robot Robot_i takes a certain coordinate as its target position, the virtual center of mass node extracts the current coordinate from the selection space, ensuring the exclusivity of the multi-robot system in the formation position. Each robot is navigated through the center of mass motion model obtained through its own training to complete the corresponding formation requirements.

[0025] When all robots in the current environment reach their own formation positions and meet the target formation requirements, the virtual center of mass switches to the formation holding state. Taking the regular quadrilateral and triangle formations as examples, a virtual center of mass node can be introduced at the origin. Each robot obtains formation parameters at the center of mass to achieve accurate target formation. For a schematic diagram of the topological structure of the virtual center of mass and robot nodes, please refer to Figure 3In this process, each robot randomly initializes its own position and autonomously navigates to the formation coordinate position planned by the center of mass node; in the formation formation stage, the center of mass coordinates of the multi-robots are , in a triangle formation, the three robots at the ends of the triangle , , the calculation formula of the parameter position coordinates of the three robots is: , , , In order to further reduce the communication burden within the multi-robot system, a publisher node is first initialized as the virtual center of mass, and the initial position coordinates of the virtual center of mass are defined as the origin (0,0), where / Center is the virtual center of mass, which can interact with any robot in the current multi-machine collaborative formation through topic communication. The communication speed of this method is faster than the point-to-point communication between robots, which reduces the communication delay of information transmission between robots and improves the feedback speed of robots, ensuring the execution efficiency of multi-machine collaborative tasks. Therefore, the introduction of the virtual center of mass is the basis for the current multi-machine system to maintain formation in real time.

[0026] Determine the target formation position, determine the optimal path based on the target formation position, the robot's position coordinates and the virtual center of mass node, and plan the behavior of the multi-robots based on the optimal path and the center of mass motion model of the multi-robots so that the multi-robot formation reaches the target formation position.

[0027] In some embodiments, in step S202, the behaviors of multiple robots are coordinated based on the formation information and the consensus algorithm module, and the minimum formation cumulative error is obtained to keep the multi-robot formation in a stable state. The consensus algorithm is applied to the multi-robot collaborative formation to achieve the necessary formation maintenance of the multi-robot system, that is, to coordinate the robots in the current multi-machine system to maintain a relatively stable collaborative state. The specific process is to keep the attributes or states of the robots stable through the local information exchange of the virtual center of mass, such as relative position relationship, speed, direction, etc., to promote the formation and maintenance of the formation. In this process, each robot is regarded as a node in the topological structure, and each node is connected to the virtual center of mass node by an edge. The virtual center of mass node has the same form of state information as the robot, including position coordinates, operation control data, etc., but because it is a virtual node, there is no need to avoid obstacles, so its external sensor data is not recorded. The virtual center of mass node will calculate the optimal path to the target position in the current environment and the robot motion control instructions. For a schematic diagram of the consensus algorithm based on center of mass control, please refer to Figure 4 ,like Figure 4As shown in the figure, the solid box represents the initial position of the robot, the dotted box represents the target position, the straight line represents the moving trajectory, the dot represents the virtual centroid, and the small flag represents the existing target navigation algorithm. It can only realize the independent route planning of each robot based on the target position, and does not consider the collaborative planning problem in the process of multi-robot collaborative formation. Collaborative planning still depends on the physical navigator node. After the introduction of virtual centroid control, each robot can ignore its own decision when there is no need to avoid obstacles, and only follow the behavior instructions sent by the virtual centroid node to complete the action control. This ensures the collaborative formation control of multi-robots without obstacle avoidance requirements during movement. At the same time, the centroid consensus algorithm also reduces the computing consumption caused by point-to-point multi-machine communication. Determine the robot nodes and master nodes in the multi-robot formation, where the master node is the virtual center of mass node. The virtual center of mass node / Center is used as the master node through the consensus algorithm. It mainly plays a role in the formation maintenance stage. The positions of the robot nodes and the virtual center of mass nodes are obtained based on the formation position information. The relative position vector of the robot node and the virtual center of mass node is calculated based on the positions of the robot nodes and the virtual center of mass nodes. The calculation formula is: , in, for The relative position vector between the virtual center of mass and the robot node Robot_i at the moment; for The position coordinates of the virtual centroid node at the moment, for The position coordinates of the robot node at the moment; Get the expected coordinates of the robot node, and calculate the expected relative position vector between the robot node and the virtual center of mass node based on the expected coordinates and the position of the virtual center of mass node. The calculation formula is: , in, for The expected relative position vector of the robot node and the virtual center of mass node at the moment, for The expected coordinates of the robot node at the moment; The error between the robot node and the virtual center of mass node is determined based on the relative position vector and the expected relative position vector. The cumulative error of the formation is determined based on the error between the robot node and the virtual center of mass node. The error calculation formula is: , in, The robot node and the virtual center of mass node are Error in time; The calculation formula for the cumulative error of the formation is: , in, is the accumulated error of the formation; Based on the formation cumulative error, the behavior of the robot nodes is coordinated through the consensus algorithm module, and the communication of the robot nodes is controlled through the virtual center of mass node to minimize the formation cumulative error of the robot formation. Among them, the behavior of the robot nodes is controlled by the robot's center of mass motion model. When the formation cumulative error If it converges to 0, it means that the robot always maintains the required formation during the movement and achieves the desired formation maintenance task.

[0028] The process of controlling the communication of robot nodes through the virtual center of mass node is: Step 1: Obtain the formation position parameters of the robot nodes through the virtual center of mass node. Each robot obtains its own formation position parameters at the virtual center of mass node. , and reaches the corresponding formation position through its own strategy network, and its own strategy network is a centroid motion model; Step 2: After the multi-robot formation is formed, the robot motion control information is continuously refreshed through the virtual center of mass node / Center, and the communication topic is sent to the robot node; Step 3: Robot_i receives the topic information and sends it to its own motion controller. After the motion controller controls the robot to complete its own motion, it feeds back its own information to / Center. Its own information includes The robot's coordinates at the moment , / Center refresh The expected coordinates of the robot at time , determine the formation cumulative error based on the coordinates of the robot nodes and the expected coordinates; Step 4: After the center of mass node / Center receives the new information of Robot_i, it repeats steps 2 to 4.

[0029] In some embodiments, in step S203, the virtual center of mass module provides fast communication and feedback conditions for the collaborative maintenance of each robot formation, and the consensus algorithm module provides an execution algorithm for the behavior control of each robot, but the two need to cooperate to jointly realize the formation collaborative task. At the same time, each robot also needs to independently decide on the local route planning problem of obstacle avoidance when there are obstacles. Therefore, in order to cooperate with the simultaneous execution of the virtual center of mass, consensus algorithm and autonomous obstacle avoidance, different strategy control methods are designed for different states of each robot in the multi-machine system; the state of the robot in the multi-robot formation is determined based on the acquired radar data and odometer information, and based on the state of the robot, a hierarchical strategy control module is used to execute multiple strategy controls. The multiple strategy controls include safety collaboration, obstacle avoidance decision-making and formation stability detection. First, the state of the robot in the multi-robot formation is judged, and the safe distance between the robot and the obstacle is preset. , determine the distance between the robot and the obstacle based on the radar data, and compare the distance between the robot and the obstacle with the safety distance By comparison, when the distance between the robot and the obstacle is greater than the safe distance, the robot is in a safe state, and the calculation formula for the judgment condition of its safe state is: , When the distance between the robot and the obstacle is less than or equal to the safety distance When , the robot is in the obstacle avoidance state, and the calculation formula for the obstacle avoidance state is: , Determine the target formation position, preset the robot's retention time threshold and the distance threshold between the robot and the target formation position, determine the distance between the robot and the target formation position and the robot's retention time based on the odometer information, when the distance between the robot and the target formation position is greater than the distance threshold and the retention time is greater than the retention time threshold, the robot is in an unstable state, and the calculation formula for the judgment condition of the unstable state is: , When the robot is in a safe state, the hierarchical strategy control module is used to perform safe collaboration. According to the update rules of the consensus algorithm, the cumulative error of the multi-robot formation is calculated. The cumulative error of the formation is minimized based on the consensus algorithm. The robot is guided to move in the direction of the virtual center of mass through the virtual center of mass node. Its action decision adopts the same action as the virtual center of mass to ensure the consistency of the collaborative motion, that is, ; When the robot is in the obstacle avoidance state, the hierarchical strategy control module is used to execute the obstacle avoidance decision. In the obstacle avoidance state, if the current robot continues to move in the direction of the current virtual center of mass, it will be dangerous. Therefore, the robot's action decision adopts the trained network on board itself. , guiding the robot to make decisions according to the trained network it carries, that is, controlling the movement of the robot nodes through the center of mass motion model of the robot nodes to determine the movement direction of multiple robots and avoid obstacles. This obstacle avoidance decision ensures that the robot can flexibly adjust the movement path when facing obstacles; When the robot is in an unstable state, the hierarchical strategy control module is used to perform formation stability detection. In an unstable state, the robot usually fails to reach its target formation position within a certain period of time due to current decision-making errors. The multi-robot collaborative formation falls into an unstable state and the current robot needs to subscribe to its target formation position information again. In the current state, based on the target formation position information, the robot node movement is controlled by the center of mass motion model of the robot node. The robot's action decision uses its own trained network , making independent decisions based on the formation's target position to complete the formation's requirements and restore the formation to a stable state.

[0030] The three strategy controls jointly realize the multi-robot collaborative formation process, ensuring that the robots can complete the formation maintenance task under normal circumstances, allowing the robots to change the formation shape to safely avoid the current obstacles when encountering obstacles, and the formation can be restored to a stable state after a long period of lack of communication or decision-making errors. This comprehensive guarantee mechanism enables the multi-robot collaborative formation system to reliably perform tasks in various complex scenarios, and comprehensively realizes the formation formation and maintenance, formation obstacle avoidance, and formation stability detection tasks of the multi-robot collaborative formation.

[0031] In order to better implement the multi-robot collaboration method in the embodiment of the present invention, based on the multi-robot collaboration method, correspondingly, Figure 5 As shown, the embodiment of the present invention further provides a multi-robot collaborative device, which is used to construct an MRVCC model to collaboratively control multiple robots; the MRVCC model includes a virtual centroid module, a consensus algorithm module and a hierarchical strategy control module; the multi-robot collaborative device 500 includes: A virtual centroid unit 501 is used to construct a virtual centroid node shared by multiple robots based on a virtual centroid module, plan the behavior of multiple robots based on the virtual centroid node, generate a multi-robot formation, and obtain formation information; The consensus algorithm unit 502 is used to coordinate the behaviors of multiple robots based on the formation information and the consensus algorithm module, and obtain the minimum formation cumulative error; The hierarchical strategy control unit 503 is used to determine the state of the robots in the multi-robot formation based on the acquired radar data and odometer information, and based on the state of the robots, a hierarchical strategy control module is used to execute multiple strategy controls, and based on multiple strategy controls and the minimum formation cumulative error, multiple robots are collaboratively controlled to complete the collaborative formation and obstacle avoidance goals of multiple robots, wherein the multiple strategy controls include safety collaboration, obstacle avoidance decisions, and formation stability detection.

[0032] like Figure 6 As shown, the multi-robot collaboration method, the present invention also provides an electronic device 600, which can be a computing device such as a mobile terminal, a desktop computer, a notebook, a palm computer, and a server. The electronic device 600 includes a processor 601, a memory 602, and a display 603. Figure 6 Only some components of the electronic device 600 are shown, but it should be understood that it is not required to implement all of the components shown, and more or fewer components may be implemented instead.

[0033] In some embodiments, the memory 602 may be an internal storage unit of the electronic device 600, such as a hard disk or memory of the electronic device 600. In other embodiments, the memory 602 may also be an external storage device of the electronic device 600, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device 600. Further, the memory 602 may also include both an internal storage unit of the electronic device 600 and an external storage device. The memory 602 is used to store application software and various types of data installed in the electronic device 600, such as program codes installed in the electronic device 600. The memory 602 may also be used to temporarily store data that has been output or is to be output. In one embodiment, a multi-robot collaborative program is stored in the memory 602, and the multi-robot collaborative program can be executed by the processor 601, thereby realizing the multi-robot collaborative method of each embodiment of the present invention.

[0034] In some embodiments, the processor 601 may be a central processing unit (CPU), a microprocessor or other data processing chip, used to run program codes or process data stored in the memory 602, such as a multi-robot collaborative method.

[0035] In some embodiments, the display 603 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, etc. The display 603 is used to display the identification information of the multi-robot collaborative program and to display a visual user interface. The components 601-603 of the electronic device 600 communicate with each other through a system bus.

[0036] In some embodiments, when the processor 601 executes the multi-robot collaboration program in the memory 602, each step of the multi-robot collaboration method described in the above embodiments is implemented. Since the multi-robot collaboration method has been described in detail above, it will not be repeated here.

[0037] Accordingly, an embodiment of the present application also provides a computer-readable storage medium, which is used to store computer-readable programs or instructions. When the program or instructions are executed by a processor, it can implement the steps or functions of the multi-robot collaboration method provided in the above-mentioned method embodiments.

[0038] In summary, the multi-robot collaboration method, device, electronic device and storage medium provided by the present invention are used to collaboratively control multiple robots based on the constructed MRVCC model; the MRVCC model includes a virtual center of mass module, a consensus algorithm module and a hierarchical strategy control module; the multi-robot collaboration method includes: constructing a virtual center of mass node shared by multiple machines based on the virtual center of mass module, planning the behavior of multiple robots based on the virtual center of mass node, generating a multi-robot formation, and obtaining formation information; coordinating the behavior of multiple robots based on the formation information and the consensus algorithm module, and obtaining the minimum formation cumulative error; determining the state of the robots in the multi-robot formation based on the acquired radar data and odometer information, and based on the state of the robots, using the hierarchical strategy control module to execute multiple strategy controls, and collaboratively controlling multiple robots based on multiple strategy controls and the minimum formation cumulative error to complete the collaborative formation and obstacle avoidance goals of multiple robots.

[0039] Those skilled in the art will appreciate that all or part of the processes of the above-mentioned embodiments can be implemented by instructing related hardware through a computer program, and the program can be stored in a computer-readable storage medium, wherein the computer-readable storage medium is a disk, an optical disk, a read-only storage memory, or a random access memory, etc.

[0040] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily conceived by any technician familiar with the technical field within the technical scope disclosed by the present invention should be covered within the protection scope of the present invention.

Claims

1. A multi-robot collaboration method, characterized in that: Used to perform collaborative control of multiple robots based on the constructed MRVCC model; the MRVCC model includes a virtual centroid module, a consensus algorithm module and a hierarchical strategy control module; The multi-robot collaboration method comprises: Based on the virtual centroid module, a virtual centroid node shared by multiple machines is constructed, and based on the virtual centroid node, the behavior of multiple robots is planned, a multi-robot formation is generated, and formation information is obtained; Coordinate the behaviors of the multiple robots based on the formation information and the consensus algorithm module, and obtain a minimum formation cumulative error; Based on the acquired radar data and odometer information, the states of the robots in the multi-robot formation are determined. Based on the states of the robots, the hierarchical strategy control module is used to execute multiple strategy controls. Based on the multiple strategy controls and the minimum formation accumulated error, the multiple robots are collaboratively controlled to complete the collaborative formation and obstacle avoidance goals of the multiple robots, wherein the multiple strategy controls include safety collaboration, obstacle avoidance decisions, and formation stability detection.

2. The multi-robot collaborative method according to claim 1, characterized in that: The planning of the behavior of multiple robots based on the virtual center of mass node includes: Constructing a SAC model, obtaining a policy network and a value network of the robot, training the policy network and the value network of the robot based on the SAC model, obtaining an average return value of the robot based on the value network of the robot, determining an optimal robot policy network based on the average return value, and determining a center of mass motion model of the robot based on the optimal robot policy network; After planning the formation coordinate position of the multi-robot formation based on the virtual center of mass node, the robots are navigated based on the formation coordinate position through the center of mass motion model of the robots to meet the formation requirements and obtain the position coordinates of the robot nodes in the multi-robot formation; Determine the target formation position, determine the optimal path based on the target formation position, the position coordinates and the virtual center of mass node, and plan the behavior of the multi-robots based on the optimal path and the center of mass motion model of the multi-robots so that the multi-robot formation reaches the target formation position.

3. The multi-robot collaborative method according to claim 2, characterized in that: The SAC model includes an Actor network and a Critic network; the strategy network and the value network of the robot are trained based on the SAC model, including: Learning the mapping relationship between different states and actions of the robot based on the Actor network; The current state of the robot and the action taken in the current state are scored based on the Critic network.

4. The multi-robot collaborative method according to claim 2, characterized in that: The coordinating the behaviors of the multiple robots based on the formation information and the consensus algorithm module includes: Determine the robot nodes and the master node in the multi-robot formation, wherein the master node is a virtual centroid node; Obtaining positions of a robot node and a virtual center of mass node based on the formation information, and calculating a relative position vector of the robot node and the virtual center of mass node based on the positions of the robot node and the virtual center of mass node; Acquire the expected coordinates of the robot node, and calculate the expected relative position vector between the robot node and the virtual center of mass node based on the expected coordinates and the position of the virtual center of mass node; Determine an error between the robot node and the virtual center of mass node based on the relative position vector and the expected relative position vector, and determine a formation cumulative error based on the error between the robot node and the virtual center of mass node; Based on the formation accumulated error, the behavior of the robot nodes is coordinated through the consensus algorithm module, and the communication of the robot nodes is controlled through the virtual center of mass node to minimize the formation accumulated error of the robot formation, wherein the behavior of the robot nodes is controlled by the center of mass motion model.

5. The multi-robot collaborative method according to claim 4, characterized in that: The controlling the communication of the robot node through the virtual center of mass node comprises: Step 1: obtaining the formation position parameters of the robot nodes through the virtual center of mass node, and completing the multi-robot formation through the center of mass motion model based on the formation position parameters; Step 2: After the multi-robot formation is formed, the motion control information of the robot node is refreshed through the virtual centroid node, and the communication topic is sent to the robot node; Step 3: Acquire the topic information of the communication topic, send the topic information to the motion controller of the robot node, obtain the information of the robot node after the robot completes its own movement through the motion controller, feed back the information of the robot node to the virtual center of mass node to obtain the coordinates and expected coordinates of the robot node, and determine the formation cumulative error based on the coordinates and expected coordinates of the robot node; Step 4: After the virtual centroid node obtains the information of the robot node, steps 2 to 4 are repeated.

6. The multi-robot collaborative method according to claim 5, characterized in that: The calculation formula of the formation cumulative error is: ， ， in, is the cumulative error of the formation, The robot node and the virtual center of mass node are The error in time, for The relative position vector between the robot node and the virtual center of mass node at the moment, for The expected relative position vector of the robot node and the virtual center of mass node at the moment.

7. The multi-robot collaborative method according to claim 4, characterized in that: The state of the robots in the multi-robot formation is determined based on the acquired radar data and odometer information, and based on the state of the robots, the hierarchical strategy control module is used to perform multiple strategy controls, including: Preset a safe distance between the robot and the obstacle, determine the distance between the robot and the obstacle based on the radar data, compare the distance between the robot and the obstacle with the safe distance, and when the distance between the robot and the obstacle is greater than the safe distance, use the hierarchical strategy control module to perform safety coordination, wherein the robot node is guided to move through the virtual centroid node; When the distance between the robot and the obstacle is less than or equal to the safety distance, the hierarchical strategy control module is used to execute obstacle avoidance decision, wherein the movement of the robot node is controlled by the center of mass motion model of the robot node; Determine the target formation position, preset the retention time threshold of the robot and the distance threshold between the robot and the target formation position, determine the distance between the robot and the target formation position and the retention time of the robot based on the odometer information, when the distance between the robot and the target formation position is greater than the distance threshold and the retention time is greater than the retention time threshold, use the hierarchical strategy control module to perform formation stability detection, wherein the target formation position information is obtained, and based on the target formation position information, the movement of the robot node is controlled through the center of mass motion model of the robot node, so that the state of the robot reaches a stable state.

8. A multi-robot collaborative device, characterized in that: Used to perform collaborative control of multiple robots based on the constructed MRVCC model; the MRVCC model includes a virtual centroid module, a consensus algorithm module and a hierarchical strategy control module; The multi-robot collaborative device comprises: A virtual centroid unit, used to construct a virtual centroid node shared by multiple machines based on the virtual centroid module, plan the behavior of multiple robots based on the virtual centroid node, generate a multi-robot formation, and obtain formation information; A consensus algorithm unit, used to coordinate the behaviors of the multiple robots based on the formation information and the consensus algorithm module, and obtain a minimum formation cumulative error; A hierarchical strategy control unit is used to determine the status of the robots in the multi-robot formation based on the acquired radar data and odometer information, and based on the status of the robots, use the hierarchical strategy control module to execute multiple strategy controls, and based on the multiple strategy controls and the minimum formation accumulated error, the multiple robots are collaboratively controlled to complete the collaborative formation and obstacle avoidance goals of the multiple robots, wherein the multiple strategy controls include safety collaboration, obstacle avoidance decision-making, and formation stability detection.

9. An electronic device, characterized in that: including memory and processor; The memory stores a computer-readable program executable by the processor; When the processor executes the computer-readable program, the steps in the multi-robot collaboration method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps in the multi-robot collaboration method as described in any one of claims 1-7.

Images