Robot obstacle avoidance identification method and system
By fusing data from visual sensors and wireless communication networks and combining the butterfly algorithm to optimize obstacle avoidance paths, the problem of multi-robot collaborative obstacle avoidance in complex environments was solved, achieving path optimization and reliability improvement.
Patent Information
- Application Number
- CN202410982808.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-22
- Publication Date
- 2024-11-12
AI Technical Summary
Existing robot obstacle avoidance technologies have low adaptability and reliability in complex environments, and the butterfly algorithm does not have the minimum weight value when calculating the path in multi-robot cooperative obstacle avoidance, resulting in poor path optimization performance.
By acquiring environmental images from the visual sensors carried by each robot, establishing a wireless communication network to aggregate the image set, performing data fusion and image processing, using the butterfly algorithm to optimize obstacle avoidance paths, generating motion control commands, and guiding multiple robots to collaboratively avoid obstacles.
It enables collaborative obstacle avoidance by multiple robots in complex environments, with non-overlapping paths and minimized path weights, thus improving the reliability and efficiency of obstacle avoidance.
Smart Images

Figure CN118938906A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of image recognition and path optimization, and in particular to a robot obstacle avoidance recognition method and system. Background Art
[0002] With the rapid development of robotics technology, robots are increasingly used in industries such as industry, services, and medical care. Among them, robot obstacle avoidance technology, as an important part of robot autonomous navigation and path planning, has received extensive attention and research. At present, mainstream robot obstacle avoidance technology mainly relies on various sensors, such as lidar, ultrasonic sensors, infrared sensors, and visual sensors, which perceive the surrounding environment and detect the location of obstacles. However, the limitations of a single sensor lead to its low adaptability and reliability in complex environments. In order to overcome these problems, researchers began to explore multi-sensor fusion technology to fuse data from multiple sensors to improve the accuracy of environmental perception and the reliability of obstacle avoidance.
[0003] By having robots carry multiple sensors to receive data, the adaptability and reliability of robots in complex environments can be solved. Since the simultaneous processing of multiple robots and multiple sensor data requires a lot of training of deep learning models, the location of obstacles is detected through trained images and the obstacle avoidance path is modified. Therefore, this method is not suitable for all scenarios and cannot avoid the path conflict problem of multiple robots.
[0004] In recent years, with the research of experts, biologically inspired algorithms and genetic algorithms have been introduced to solve the problem of multi-robot path conflicts, such as insect algorithms, whale algorithms, and butterfly algorithms. At present, on the one hand, the application of butterfly algorithms in robot path algorithms is basically blank, especially in the collaborative obstacle avoidance of multiple robots. On the other hand, butterfly algorithms often use the diagonal rule for path optimization, resulting in the calculation of path weights. The value is not the minimum value. Therefore, how to solve the collaborative obstacle avoidance and diagonal rule of the butterfly algorithm in multiple robots has become an urgent problem. Summary of the invention
[0005] The purpose of this section is to summarize some aspects of embodiments of the present invention and briefly introduce some preferred embodiments. Some simplifications or omissions may be made in this section and the specification abstract and the invention title of this application to avoid blurring the purpose of this section, the specification abstract and the invention title, and such simplifications or omissions cannot be used to limit the scope of the present invention.
[0006] In view of the above existing problems, the present invention is proposed. Therefore, the present invention provides a robot obstacle avoidance and recognition method to solve the problems mentioned in the background technology.
[0007] In order to solve the above technical problems, the present invention provides the following technical solutions:
[0008] In a first aspect, the present invention provides a robot obstacle avoidance and recognition method, comprising:
[0009] Acquire surrounding environment images from the visual sensors carried by each robot, and establish a wireless communication network to aggregate all environment images to form an environment image set;
[0010] Performing data fusion on the environmental image set to generate an environmental image processing model, and through a data synchronization mechanism, enabling each robot to obtain environmental images processed by other robots, wherein the processed environmental images are obtained by the environmental image processing model;
[0011] When the first robot obtains the processed environment image, it initializes its own obstacle avoidance path, and optimizes the obstacle avoidance path using the butterfly algorithm according to the obstacle avoidance path;
[0012] According to the obstacle avoidance path optimized by the first robot, motion control instructions are generated to guide the next robot to optimize the obstacle avoidance path until each robot completes the obstacle avoidance path optimization.
[0013] As a preferred solution of the robot obstacle avoidance and recognition method of the present invention, the surrounding environment image is obtained from the visual sensor carried by each robot, and a wireless communication network is established to aggregate all the environment images to form an environment image set, including:
[0014] The wireless communication network numbers the visual sensors carried by each robot, and each time a numbering operation is performed, an environmental image contained in the visual sensor is correspondingly obtained, and the environmental image obtained by the visual sensor includes at least one image;
[0015] Each robot further includes at least one central node and a parsing node in the wireless communication network, and the central node is used for data fusion of the environment image set.
[0016] As a preferred solution of the robot obstacle avoidance and recognition method of the present invention, wherein: data fusion is performed on the environmental image set to generate an environmental image processing model, including:
[0017] Remove noise and interference from the images in the environmental image set, perform image enhancement, detect local feature points in each enhanced image, match the same local feature points in different images, calculate the similarity between feature points, pair the matched local feature points, and construct feature point matching pairs;
[0018] Remove the wrongly matched feature point pairs, estimate the transformation matrix between images, perform image registration operations, and obtain the transformation matrix.
[0019] As a preferred solution of the robot obstacle avoidance and recognition method of the present invention, it also includes:
[0020] Using the transformation matrix, stitching together each environment image to generate a continuous panoramic environment image or a continuous environment image that is several times the size of the panoramic image;
[0021] A deep learning model is introduced to annotate the obstacles in the above environment images and obtain the location and size of the obstacles.
[0022] As a preferred solution of the robot obstacle avoidance and recognition method of the present invention, wherein: through a data synchronization mechanism, each robot can obtain the environment image processed by other robots, including:
[0023] Packing images with obstacle positions and sizes into data packets through the environment image processing model;
[0024] Each robot sends the data packet to the central node to other robots through the wireless network. When other robots receive the data packet, they parse and store the environment image through their own parsing nodes.
[0025] As a preferred solution of the robot obstacle avoidance and recognition method of the present invention, when the first robot obtains the processed environment image, it initializes its own obstacle avoidance path, and optimizes the obstacle avoidance path using the butterfly algorithm according to the obstacle avoidance path, including:
[0026] The stored processed environment image is converted into a grid map. During the iterative process of butterfly path optimization, it is checked whether the two adjacent grids involved in the butterfly's diagonal path are empty. If they are empty, the current obstacle avoidance path state is not modified. If they are not empty, the current obstacle avoidance path state is modified to four-way movement.
[0027] Among them, several candidate paths are generated in the iterative process of butterfly path optimization, and after conversion to a grid map, the obstacle avoidance path state is initialized to allow diagonal movement.
[0028] As a preferred solution of the robot obstacle avoidance identification method of the present invention, wherein: according to the obstacle avoidance path optimized by the first robot, a motion control instruction is generated to guide the next robot to optimize the obstacle avoidance path until each robot completes the obstacle avoidance path optimization, including:
[0029] The optimal obstacle avoidance path generated by each robot refers to the optimal obstacle avoidance path of the previous robot to obtain the optimal obstacle avoidance path of the current robot for reverse packaging. It is transmitted to the next robot through the wireless communication network, while sending motion control instructions, updating the currently stored environment image, and repeating the butterfly algorithm until all robots obtain the optimal obstacle avoidance path.
[0030] In a second aspect, the present invention provides a robot obstacle avoidance and recognition system, which comprises:
[0031] The environment image acquisition module is configured to acquire the surrounding environment image from the visual sensor carried by each robot, and establish a wireless communication network to aggregate all the environment images to form an environment image set;
[0032] An environment image processing module is configured to perform data fusion on the environment image set to generate an environment image processing model, so that each robot can obtain the environment image processed by other robots through a data synchronization mechanism, and the processed environment image is obtained by the environment image processing model;
[0033] The single robot path optimization module is configured to initialize its own obstacle avoidance path when the first robot obtains the processed environment image, and optimize the obstacle avoidance path using a butterfly algorithm according to the obstacle avoidance path;
[0034] The multi-robot collaborative path optimization module is configured to generate motion control instructions based on the obstacle avoidance path optimized by the first robot, and guide the next robot to perform obstacle avoidance path optimization until each robot completes the obstacle avoidance path optimization.
[0035] In a third aspect, the present invention provides a computer device, comprising a memory and a processor, wherein the memory stores a computer program, wherein: the processor implements any step of the above method when executing the computer program.
[0036] In a fourth aspect, the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein: the computer program implements any step of the above method when executed by a processor.
[0037] Compared with the prior art, the invention has the following beneficial effects: the present invention obtains the surrounding environment image from the visual sensor carried by each robot, and establishes a wireless communication network to aggregate all the environment images to form an environment image set, thereby forming collaborative communication between multiple robots; data fusion is performed on the environment image set to generate an environment image processing model, and through a data synchronization mechanism, each robot is able to obtain the environment image processed by other robots; when the first robot obtains the processed environment image, it initializes its own obstacle avoidance path, and according to the obstacle avoidance path, uses the butterfly algorithm to optimize the obstacle avoidance path to obtain the obstacle avoidance path of the current robot; according to the obstacle avoidance path of the current robot, motion control instructions are generated to guide the next robot to optimize the obstacle avoidance path until each robot completes the obstacle avoidance path optimization; multiple paths are simulated by the butterfly algorithm, so that the paths of each robot in different environments do not overlap; and in the iterative process of butterfly path optimization, the diagonal rule is judged to modify the initial obstacle avoidance path state, thereby minimizing the path weight value. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. Among them:
[0039] Figure 1 The following is an overall flow chart of a robot obstacle avoidance and recognition method according to an embodiment of the present invention;
[0040] Figure 2 A schematic diagram of an optimal obstacle avoidance path for a robot in a robot obstacle avoidance and recognition method according to an embodiment of the present invention;
[0041] Figure 3 A schematic diagram of the optimal obstacle avoidance path of an A* algorithm robot in a robot obstacle avoidance and recognition method according to an embodiment of the present invention;
[0042] Figure 4 This is a fitness comparison diagram of different algorithms of the robot obstacle avoidance and recognition method described in an embodiment of the present invention. DETAILED DESCRIPTION
[0043] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the drawings of the specification. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary persons in the art without creative work should fall within the scope of protection of the present invention.
[0044] In the following description, many specific details are set forth to facilitate a full understanding of the present invention, but the present invention may also be implemented in other ways different from those described herein, and those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.
[0045] Secondly, the term "one embodiment" or "embodiment" as used herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The term "in one embodiment" that appears in different places in this specification does not necessarily refer to the same embodiment, nor does it refer to a separate or selective embodiment that is mutually exclusive with other embodiments.
[0046] The present invention is described in detail with reference to schematic diagrams. When describing the embodiments of the present invention, for the sake of convenience, the cross-sectional diagrams showing the device structure will not be partially enlarged according to the general scale, and the schematic diagrams are only examples, which should not limit the scope of protection of the present invention. In addition, in actual production, the three-dimensional dimensions of length, width and depth should be included.
[0047] At the same time, in the description of the present invention, it should be noted that the directions or positional relationships indicated by the terms "upper, lower, inner and outer" are based on the directions or positional relationships shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific direction, be constructed and operated in a specific direction, and therefore cannot be understood as limiting the present invention. In addition, the terms "first, second or third" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance.
[0048] In the present invention, unless otherwise clearly specified and limited, the terms "install, connect, connect" should be understood in a broad sense, for example: it can be a fixed connection, a detachable connection or an integral connection; it can also be a mechanical connection, an electrical connection or a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
[0049] Example 1
[0050] Reference Figure 1 , which is the first embodiment of the present invention, and provides a robot obstacle avoidance and recognition method, comprising:
[0051] S1, obtain the surrounding environment image from the visual sensor carried by each robot, and establish a wireless communication network to aggregate all the environment images to form an environment image set;
[0052] Furthermore, the wireless communication network numbers the visual sensor carried by each robot, and each time a numbering operation is performed, an environmental image contained in the visual sensor is correspondingly obtained;
[0053] It should be noted that, since the visual sensor has a number in the wireless communication network, the current robot can be obtained by the number;
[0054] Specifically, the environment image acquired by the visual sensor includes at least one;
[0055] Furthermore, each robot also includes at least one central node and a resolution node in the wireless communication network;
[0056] Among them, the central node is used to perform data fusion of the environmental image set, and the parsing node is used to parse the environmental images sent by other robots and receive the optimal obstacle avoidance path from other robots;
[0057] It should be noted that since the subsequent image processing may cause the processed image to be too different from the original image, it is necessary to number all visual sensors through the wireless communication network to facilitate the deep learning model to trace the source of any environmental image;
[0058] S2, perform data fusion on the environmental image set to generate an environmental image processing model, and through a data synchronization mechanism, enable each robot to obtain environmental images processed by other robots, and the processed environmental images are obtained by the environmental image processing model;
[0059] Furthermore, the noise and interference of the images in the environmental image set are removed, and the images are enhanced. At the same time, local feature points are detected in each enhanced image, the same local feature points in different images are matched, the similarity between the feature points is calculated, the matched local feature points are paired, and feature point matching pairs are constructed;
[0060] Furthermore, the wrongly matched feature point pairs are removed, the transformation matrix between the images is estimated, and the image registration operation is performed to obtain the transformation matrix;
[0061] Furthermore, each environment image is stitched together using a transformation matrix to generate a continuous panorama environment image or a continuous environment image that is several times larger than the panorama;
[0062] Specifically, if there is no mismatched feature point pair, a continuous panoramic environment image or a continuous environment image that is several times the size of the panoramic image is directly generated;
[0063] Furthermore, a deep learning model is introduced to annotate obstacles in the environment images that generate continuous panoramas or continuous environment images that are several times larger than the panorama, and obtain the location and size of the obstacles;
[0064] It should be noted that the introduction of deep learning models is aimed at marking the location and size of obstacles in environmental images, but cannot achieve the effect of training environmental images;
[0065] Furthermore, through the data synchronization mechanism, the environment image processing model packages the images with the positions and sizes of obstacles into data packets;
[0066] Furthermore, each robot sends data packets to the central node to other robots through the wireless network. When other robots receive the data packets, they parse and store the environment image through their own parsing nodes;
[0067] Specifically, the number of parsing nodes is greater than the central nodes, and each central node is located between two robots for data exchange;
[0068] It should be noted that, through the data synchronization mechanism, each robot can know the position and size of obstacles in the current environment image of another robot;
[0069] S3, when the first robot obtains the processed environment image, it initializes its own obstacle avoidance path, and optimizes the obstacle avoidance path using the butterfly algorithm according to the obstacle avoidance path;
[0070] Furthermore, the stored processed environment image is converted into a grid map. In the iterative process of butterfly path optimization, it is checked whether the two adjacent grids involved in the diagonal path of the butterfly are empty. If they are empty, the current obstacle avoidance path state is not modified. If they are not empty, the current obstacle avoidance path state is modified to four-way movement.
[0071] Specifically, the grid map consists of several grids, which are divided into black and white, and the size of the obstacle is composed of black, and the white area is the feasible area of the butterfly path;
[0072] Specifically, the four directions of movement refer to up, down, left, and right;
[0073] Among them, several candidate paths are generated in the iterative process of butterfly path optimization, and after conversion to a grid map, the obstacle avoidance path state initialized itself is obtained to allow diagonal movement;
[0074] Furthermore, the obstacle avoidance path of the current robot is regarded as an individual butterfly, and all obstacle avoidance paths generated by it are regarded as a whole, that is, the butterfly population;
[0075] It should be noted that by judging the diagonal line and modifying the initial obstacle avoidance path state, the path weight value is minimized, and the optimal obstacle avoidance path of the current robot is obtained;
[0076] S4, generating motion control instructions according to the obstacle avoidance path optimized by the first robot, and guiding the next robot to optimize the obstacle avoidance path, until each robot completes the obstacle avoidance path optimization;
[0077] Furthermore, the optimal obstacle avoidance path generated by each robot refers to the optimal obstacle avoidance path of the previous robot, and the optimal obstacle avoidance path of the current robot is obtained for reverse packaging, and is transmitted to the next robot through the wireless communication network, while sending motion control instructions, updating the currently stored environment image, and repeating S3 until all robots obtain the optimal obstacle avoidance path;
[0078] It should be noted that by transmitting the optimal obstacle avoidance path of each robot through the wireless communication network, all robots can obtain the optimal obstacle avoidance path in different environmental images without overlapping, thus achieving the optimal collaborative obstacle avoidance path of multiple robots.
[0079] Furthermore, this embodiment also provides a robot obstacle avoidance and recognition system, comprising:
[0080] The environment image acquisition module is configured to acquire the surrounding environment image from the visual sensor carried by each robot, and establish a wireless communication network to aggregate all the environment images to form an environment image set;
[0081] An environment image processing module is configured to perform data fusion on the environment image set to generate an environment image processing model, so that each robot can obtain the environment image processed by other robots through a data synchronization mechanism, and the processed environment image is obtained by the environment image processing model;
[0082] The single robot path optimization module is configured to initialize its own obstacle avoidance path when the first robot obtains the processed environment image, and optimize the obstacle avoidance path using a butterfly algorithm according to the obstacle avoidance path;
[0083] The multi-robot collaborative path optimization module is configured to generate motion control instructions based on the obstacle avoidance path optimized by the first robot, and guide the next robot to perform obstacle avoidance path optimization until each robot completes the obstacle avoidance path optimization.
[0084] This embodiment also provides a computer device, which is applicable to the robot obstacle avoidance and recognition method, including:
[0085] Memory and processor; the memory is used to store computer executable instructions, and the processor is used to execute computer executable instructions to implement the robot obstacle avoidance and recognition method proposed in the above embodiment.
[0086] The computer device may be a terminal, and the computer device includes a processor, a memory, a communication interface, a display screen and an input device connected via a system bus. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be achieved through WIFI, an operator network, NFC (near field communication) or other technologies. The display screen of the computer device may be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device may be a touch layer covering the display screen, or a key, trackball or touchpad provided on the housing of the computer device, or an external keyboard, touchpad or mouse, etc.
[0087] This embodiment also provides a storage medium on which a computer program is stored. When the program is executed by a processor, the robot obstacle avoidance and recognition method proposed in the above embodiment is implemented.
[0088] The storage medium proposed in this embodiment and the data storage method proposed in the above embodiment belong to the same inventive concept. The technical details not fully described in this embodiment can be found in the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.
[0089] Example 2
[0090] Reference Figures 2 to 4 , which is the second embodiment of the present invention, and which provides a robot obstacle avoidance and recognition method, comprising: in order to verify the butterfly path obstacle avoidance optimization of the diagonal rule method in the present invention and the existing butterfly optimization method, the following experiments are conducted;
[0091] Experimental preparation: MATLAB (version number R2021a), take two images in the obstacle image set 750×750, where the image is an obstacle image in the same environment, and convert it into a two-dimensional grid map 20×20 in code form; In order to facilitate the experiment and intuitively feel the effect, this experiment uses two robots to compare the scheme of the present invention with the traditional butterfly optimization (A* algorithm) (can be increased according to actual needs), where the robots are equipped with high-resolution visual sensors and wireless communication modules;
[0092] Experimental results: Figure 2 and Figure 3 As shown, Figure 2 For the solution of the present invention, Figure 3It is the traditional butterfly optimization (A* algorithm); it can be seen that the path of the solution of the present invention is obviously better than the traditional butterfly optimization solution, and the present invention also compares the fitness of the commonly used Dijkstra algorithm, D* algorithm and RRT* algorithm by the number of iterations. Figure 4 It can be found that the algorithm fitness of the present invention is higher than that of other algorithms, which shows that the present invention can also achieve the optimal under the obstacle avoidance path of multi-robot collaboration.
[0093] Those skilled in the art will appreciate that the embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the application can adopt the form of complete hardware embodiments, complete software embodiments, or embodiments in combination with software and hardware. Moreover, the application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program codes. The scheme in the embodiments of the present application can be implemented in various computer languages, for example, object-oriented programming language Java and literal scripting language JavaScript, etc.
[0094] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0095] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0096] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0097] Although the preferred embodiments of the present application have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.
[0098] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.
Claims
1. A robot obstacle avoidance and recognition method, characterized in that: include: Acquire surrounding environment images from the visual sensors carried by each robot, and establish a wireless communication network to aggregate all environment images to form an environment image set; Performing data fusion on the environmental image set to generate an environmental image processing model, and through a data synchronization mechanism, enabling each robot to obtain environmental images processed by other robots, wherein the processed environmental images are obtained by the environmental image processing model; When the first robot obtains the processed environment image, it initializes its own obstacle avoidance path, and optimizes the obstacle avoidance path using the butterfly algorithm according to the obstacle avoidance path; According to the obstacle avoidance path optimized by the first robot, motion control instructions are generated to guide the next robot to optimize the obstacle avoidance path until each robot completes the obstacle avoidance path optimization.
2. The robot obstacle avoidance and recognition method according to claim 1, characterized in that: The surrounding environment images are acquired from the visual sensors carried by each robot, and a wireless communication network is established to aggregate all the environment images to form an environment image set, including: The wireless communication network numbers the visual sensors carried by each robot, and each time a numbering operation is performed, an environmental image contained in the visual sensor is correspondingly obtained, and the environmental image obtained by the visual sensor includes at least one image; Each robot further includes at least one central node and a parsing node in the wireless communication network, and the central node is used for data fusion of the environment image set.
3. The robot obstacle avoidance and recognition method according to claim 2, characterized in that: Performing data fusion on the environmental image set to generate an environmental image processing model includes: Remove noise and interference from the images in the environmental image set, perform image enhancement, detect local feature points in each enhanced image, match the same local feature points in different images, calculate the similarity between feature points, pair the matched local feature points, and construct feature point matching pairs; Remove the wrongly matched feature point pairs, estimate the transformation matrix between images, perform image registration operations, and obtain the transformation matrix.
4. The robot obstacle avoidance and recognition method according to claim 2 or 3, characterized in that: Also includes: Using the transformation matrix, stitching together each environment image to generate a continuous panoramic environment image or a continuous environment image that is several times the size of the panoramic image; A deep learning model is introduced to annotate the obstacles in the above environment images and obtain the location and size of the obstacles.
5. The robot obstacle avoidance and recognition method according to claim 4, characterized in that: Through the data synchronization mechanism, each robot can obtain the environment image processed by other robots, including: Packing images with obstacle positions and sizes into data packets through the environment image processing model; Each robot sends the data packet to the central node to other robots through the wireless network. When other robots receive the data packet, they parse and store the environment image through their own parsing nodes.
6. The robot obstacle avoidance and recognition method according to claim 5, characterized in that: When the first robot obtains the processed environment image, it initializes its own obstacle avoidance path and optimizes the obstacle avoidance path using the butterfly algorithm according to the obstacle avoidance path, including: The stored processed environment image is converted into a grid map. During the iterative process of butterfly path optimization, it is checked whether the two adjacent grids involved in the butterfly's diagonal path are empty. If they are empty, the current obstacle avoidance path state is not modified. If they are not empty, the current obstacle avoidance path state is modified to four-way movement. Among them, several candidate paths are generated in the iterative process of butterfly path optimization, and after conversion to a grid map, the obstacle avoidance path state is initialized to allow diagonal movement.
7. The robot obstacle avoidance and recognition method according to claim 6, characterized in that: Generate motion control instructions based on the obstacle avoidance path optimized by the first robot to guide the next robot to optimize the obstacle avoidance path until each robot completes the obstacle avoidance path optimization, including: The optimal obstacle avoidance path generated by each robot refers to the optimal obstacle avoidance path of the previous robot to obtain the optimal obstacle avoidance path of the current robot for reverse packaging. It is transmitted to the next robot through the wireless communication network, while sending motion control instructions, updating the currently stored environment image, and repeating the butterfly algorithm until all robots obtain the optimal obstacle avoidance path.
8. A robot obstacle avoidance and recognition system, based on the robot obstacle avoidance and recognition method according to any one of claims 1 to 7, characterized in that: include: The environment image acquisition module is configured to acquire the surrounding environment image from the visual sensor carried by each robot, and establish a wireless communication network to aggregate all the environment images to form an environment image set; An environment image processing module is configured to perform data fusion on the environment image set to generate an environment image processing model, so that each robot can obtain the environment image processed by other robots through a data synchronization mechanism, and the processed environment image is obtained by the environment image processing model; The single robot path optimization module is configured to initialize its own obstacle avoidance path when the first robot obtains the processed environment image, and optimize the obstacle avoidance path using a butterfly algorithm according to the obstacle avoidance path; The multi-robot collaborative path optimization module is configured to generate motion control instructions based on the obstacle avoidance path optimized by the first robot, and guide the next robot to perform obstacle avoidance path optimization until each robot completes the obstacle avoidance path optimization.
9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.
Citation Information
Patent Citations
Mobile robot path planning method based on improved butterfly optimization algorithm
CN113219989A
Robot multi-target path planning based on improved butterfly optimization algorithm
CN113552891A
Multi-robot path planning method and device
CN115586767A
Mobile robot path planning method based on improved butterfly optimization algorithm
CN115933669A
Multi-mobile-robot obstacle avoidance system and method based on V2X technology
CN117311362A
