Outdoor robot navigation system and method based on visual identification, terminal and storage medium
By combining real-time dynamic positioning and visual recognition technology, the problem of poor signal occlusion and light conditions of outdoor robots positioning and navigation in complex environments is solved, high-precision positioning and automatic obstacle avoidance are achieved, and the robot's tasks in complex environments are improved. Execution efficiency and security.
Patent Information
- Application Number
- CN202411000161.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-24
- Publication Date
- 2024-11-12
AI Technical Summary
Outdoor robots face problems such as GPS signal occlusion and poor lighting conditions when positioning and navigating in complex environments, resulting in reduced positioning accuracy and unstable task execution.
The outdoor robot navigation system based on visual recognition is adopted, combined with real-time dynamic positioning module and visual acquisition components, high-precision positioning is performed through GNSS signals and differential information, and environmental perception is used by lidar and cameras to realize dynamic path planning and automatic obstacle avoidance.
Ensuring high-precision positioning and safe navigation under signal occlusion and poor light conditions improves the robot's task execution efficiency and safety in complex environments.
Smart Images

Figure CN118938920A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of robot-assisted equipment, and in particular relates to an outdoor robot navigation system, method, terminal and storage medium based on visual recognition. Background Art
[0002] In the current era of rapid technological development, outdoor robots have shown great application potential in many fields such as agriculture, logistics distribution, and infrastructure inspection, bringing unprecedented efficiency improvements and cost savings to human society. However, the inherent complexity and uncertainty of the outdoor environment, especially the changing terrain, unpredictable weather conditions, and changes in light intensity, pose severe challenges to robot navigation and positioning technology. Traditionally, the Global Positioning System (GPS) has dominated outdoor robot positioning due to its wide coverage and easy deployment. However, in urban canyons, dense forests, or areas with tall buildings, GPS signals are severely blocked, resulting in a significant decrease in positioning accuracy or even complete failure, which seriously affects the robot's navigation performance and task completion rate.
[0003] On the other hand, machine vision systems, as another important means of perception, can identify features and obstacles in the environment and assist robots in positioning and avoiding obstacles. However, the effectiveness of the vision system is greatly reduced in poor lighting conditions or in bad weather. For example, at night, in fog, rain or snow, the decline in image quality directly affects the accuracy and reliability of the vision algorithm, and thus affects the operational safety and task execution capabilities of the entire robot. Therefore, there is an urgent need for a navigation system that can overcome these limitations. Summary of the invention
[0004] In view of the above-mentioned deficiencies in the prior art, the present invention provides an outdoor robot navigation system, method, terminal and storage medium based on visual recognition to solve the above-mentioned technical problems.
[0005] In a first aspect, the present invention provides an outdoor robot navigation system based on visual recognition, the navigation system being installed on an outdoor robot body, comprising:
[0006] At least one visual acquisition component, used to capture environmental image information of the area where the outdoor robot is located in real time;
[0007] Real-time dynamic positioning module, used to receive GNSS signals from satellites and differential information from base stations to perform real-time positioning of outdoor robots;
[0008] The navigation control module is connected to the visual sensor and the real-time dynamic positioning module. It performs dynamic path planning and controls the outdoor robot to drive along the planned dynamic path according to the environmental image information obtained by the visual acquisition component and the real-time dynamic positioning information provided by the real-time dynamic positioning module, and automatically avoids obstacles during driving.
[0009] Communication module, used to realize information exchange of the whole system;
[0010] The power module is used to supply power to the entire system.
[0011] A further improvement of the technical solution is that the visual acquisition component includes a laser radar installed on the top of the outdoor robot and a plurality of cameras installed on the front end of the outdoor robot.
[0012] A further improvement of the technical solution is that the real-time dynamic positioning module includes:
[0013] A GNSS receiver for receiving raw GNSS signals from multiple satellites;
[0014] A differential data receiver, used for receiving differential correction data from a reference station;
[0015] The data processing unit is used to fuse the GNSS raw data with the differential correction data to calculate the real-time position, speed and direction of the outdoor robot.
[0016] A further improvement of the technical solution is that the navigation control module includes:
[0017] An image processing unit, used for preprocessing, feature extraction and recognition of the environment image captured by the visual acquisition component;
[0018] A path planning unit, used to generate a dynamic driving path of the robot based on the environmental image recognition result and the positioning information sent by the real-time dynamic positioning module;
[0019] A control execution unit is used to control the movement direction and speed of the robot according to the planned dynamic driving path;
[0020] The obstacle detection unit is used to determine whether there are obstacles around the detection robot based on the environmental image recognition results. If there are obstacles, the judgment result will be returned to the control execution unit to adjust the dynamic driving path of the outdoor robot to achieve autonomous obstacle avoidance.
[0021] A further improvement of the technical solution is that the communication module supports wireless communication protocols, including at least one of Wi-Fi, Bluetooth, GPRS and 4G / 5G.
[0022] Further improvements of the technical solution include an inertial measurement unit and an encoder / wheel speed odometer, which are used to assist positioning and motion control.
[0023] In a second aspect, the present invention provides an outdoor robot navigation method based on visual recognition, comprising:
[0024] Start the visual acquisition component and real-time dynamic positioning module to collect three-dimensional information, image information and positioning information of the outdoor robot's surrounding environment through lidar, camera and RTK receiver;
[0025] The collected image information is used for feature extraction and object recognition based on the pre-stored machine vision algorithm, and dynamic path planning is performed in combination with the outdoor robot real-time positioning information provided by the RTK receiver;
[0026] The drive actuator drives the outdoor robot to travel along the planned dynamic path and automatically avoid obstacles when encountering them.
[0027] A further improvement of the technical solution is that the pre-stored machine vision algorithm includes a SIFT algorithm or a YOLO algorithm.
[0028] In a third aspect, the present invention provides a terminal, comprising:
[0029] processor, memory, wherein:
[0030] The memory is used to store computer programs.
[0031] The processor is used to call and run the computer program from the memory, so that the terminal executes the above-mentioned terminal method.
[0032] In a fourth aspect, the present invention provides a computer storage medium, wherein the computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the methods described in the above aspects.
[0033] The beneficial effect of the present invention is that the present invention has achieved a major breakthrough in the outdoor robot navigation system by integrating real-time dynamic positioning (RTK) and visual recognition technology. The RTK module combines GNSS signals and differential information to ensure high-precision positioning in signal-blocked environments, while the visual acquisition component enhances the robustness of environmental perception. The two work together to form a multi-source data fusion positioning framework. The navigation control module uses this fused information for intelligent dynamic path planning, enabling the robot to flexibly respond to complex environments, automatically avoid obstacles, and ensure operational safety and efficiency. In addition, the efficient communication and energy management system supports real-time data transmission and stable power supply, further improving the robot's all-weather operation capability and task execution efficiency.
[0034] In addition, the invention has a reliable design principle, a simple structure and a very broad application prospect. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0036] Figure 1 is a schematic block diagram of a system according to an embodiment of the present invention.
[0037] Figure 2 This is a schematic diagram of the structure of the robot body equipped with a navigation system.
[0038] Figure 3 is a schematic flow chart of a method according to an embodiment of the present invention.
[0039] Figure 4 A schematic diagram of the structure of a terminal provided by an embodiment of the present invention.
[0040] 110 is a real-time dynamic positioning module, 111 is a GNSS receiver, 112 is a differential data receiver, 113 is a data processing unit, 114 is an inertial measurement unit, 115 is an encoder / wheel speed odometer, 120 is a navigation control module, 121 is an image processing unit, 122 is a path planning unit, 123 is a control execution unit, 124 is an obstacle detection unit, 130 is a communication module, 140 is a power module, 150 is a visual acquisition component, 151 is a laser radar, 152 is a camera, and 160 is a remote control terminal. DETAILED DESCRIPTION
[0041] In order to enable those skilled in the art to better understand the technical solutions in the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.
[0042] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art of the present invention. The terms used in the specification of the present invention herein are only for the purpose of describing specific embodiments and are not intended to limit the present invention.
[0043] The key terms appearing in the present invention are explained below.
[0044] GNSS, Global Navigation Satellite System, is a general term that refers to satellite navigation systems developed and maintained by different countries and regions. These systems enable users to determine their precise position, speed and time by sending radio signals to the surface of the earth.
[0045] Wi-Fi, Wireless Fidelity, is a technology that allows electronic devices to connect to the Internet or local network via radio waves. Wi-Fi has become synonymous with Wireless Local Area Network (WLAN). Wi-Fi technology is based on the IEEE 802.11 series of standards, which define the physical layer and data link layer of wireless local area networks.
[0046] GPRS, General Packet Radio Service, is a data transmission technology introduced in the second generation mobile communication (2G) network, especially widely used in GSM (Global System for Mobile Communications) network. GPRS provides a data transmission mode based on packet switching. Compared with the early circuit switching data services, it can more effectively utilize network resources, achieve higher data transmission rate and better service quality.
[0047] 4G, The 4th Generation mobile communication technology, the fourth generation of mobile communication technology; 5G, The fifth generation mobile communication technology, the fifth generation of mobile communication technology; the network dial-up speed is extremely fast, and the upload speed can also reach a relatively high level, which can meet the requirements of almost all users for wireless services.
[0048] like Figure 1 and Figure 2As shown, the present invention provides an outdoor robot navigation system based on visual recognition, which is installed on the main body of the outdoor robot and includes a real-time dynamic positioning module, a navigation control module, a communication module, a power module and at least one visual acquisition component; wherein the visual acquisition component is used to capture the environmental image information of the area where the outdoor robot is located in real time; the real-time dynamic positioning module is used to receive the GNSS signal from the satellite and the differential information of the reference station to perform real-time positioning of the outdoor robot; the navigation control module is connected to the visual sensor and the real-time dynamic positioning module, and according to the environmental image information obtained by the visual acquisition component and the real-time positioning information provided by the real-time dynamic positioning module, dynamic path planning is performed and the outdoor robot is controlled to travel along the planned dynamic path, and automatic obstacle avoidance is performed during driving; the communication module is used to realize information exchange of the entire system; the power module is used to supply power to the entire system.
[0049] Specifically, the visual acquisition component includes a laser radar installed on the top of the outdoor robot and several cameras installed on the front end of the outdoor robot.
[0050] In addition, the real-time dynamic positioning module includes a GNSS receiver, a differential data receiver and a data processing unit; wherein the GNSS receiver is used to receive original GNSS signals from multiple satellites; the differential data receiver is used to receive differential correction data from a base station; the data processing unit is used to fuse the GNSS original data with the differential correction data to calculate the real-time position, speed and direction of the outdoor robot.
[0051] Since the GNSS raw data contains the pseudorange and carrier phase measurements of the satellite, as well as information such as time stamps; the pseudorange is an estimate of the distance from the receiver to the satellite, but due to ionospheric and tropospheric delays, multipath effects, etc., there are certain errors; differential correction data usually comes from differential reference stations or network RTK services; reference stations are fixed stations with known precise coordinates, which also receive the same GNSS signals and calculate the deviation from the theoretical value. These deviation information includes but is not limited to ionospheric delay, tropospheric delay, satellite orbit error, satellite clock error, etc. Therefore, the fusion of GNSS raw data and differential correction data can be achieved through one of the following differential correction algorithms: position difference: the reference station sends its position deviation, and the receiver adjusts its position calculation accordingly; pseudorange difference: the reference station sends its measured pseudorange deviation, and the receiver adjusts its own pseudorange measurement accordingly; carrier phase difference: using carrier phase measurement for differential correction, it can achieve sub-meter or even centimeter-level positioning accuracy.
[0052] To improve positioning accuracy, the system also includes an inertial measurement unit (IMU) and an encoder / wheel speed odometer, which are used to assist positioning and motion control. Among them, the inertial measurement unit (IMU) is an electronic sensor device used to measure and report the acceleration, angular rate and direction of the earth's magnetic field of an object to determine the object's attitude, direction and state of motion. IMU usually consists of the following three main types of sensors: Accelerometer: measures the linear acceleration of an object on three orthogonal axes. Accelerometers can detect gravity acceleration, so they can be used to determine the tilt angle of the device relative to the ground; Gyroscope: measures the angular velocity of an object rotating around three axes. Gyroscopes can track changes in the orientation of the device and help determine the rotation angle of the device; Magnetometer: measures the direction and strength of the earth's magnetic field, which can assist in determining the heading angle of the device (that is, the direction the device is pointing relative to the north of the earth's magnetic field). Encoders / wheel speed odometers are two types of sensors used to measure linear and rotational motion. Encoders are sensors used to measure the position or angular changes of mechanical parts, and are usually used in motors, robot joints, automation equipment and precision instruments. Wheel speed odometer is a method to estimate the position and travel distance of a vehicle or robot based on the number of wheel rotations and the rotation angle. It usually consists of an encoder mounted on the wheel axle to monitor the speed and rotation angle of the wheel. From the wheel diameter and the number of rotations, the distance traveled and the change in direction can be calculated.
[0053] In addition, the navigation control module includes an image processing unit, a path planning unit, a control execution unit and an obstacle detection unit; wherein the image processing unit is used to preprocess, extract features and identify the environmental image captured by the visual acquisition component; the path planning unit is used to generate the dynamic driving path of the robot based on the environmental image recognition result and the positioning information sent by the real-time dynamic positioning module; the control execution unit is used to control the movement direction and speed of the robot according to the planned dynamic driving path; the obstacle detection unit is used to determine whether there are obstacles around the detection robot based on the environmental image recognition result. If there are obstacles, the judgment result will be returned to the control execution unit to adjust the dynamic driving path of the outdoor robot to achieve autonomous obstacle avoidance.
[0054] Among them, the control execution unit includes a motor, a driver and a servo, which are used to control the movement and steering of the outdoor robot.
[0055] Finally, the communication module supports wireless communication protocols, including at least one of Wi-Fi, Bluetooth, GPRS and 4G / 5G. The outdoor robot body can connect to the remote control terminal through the communication module and transmit data with the remote control terminal to ensure real-time communication and command execution.
[0056] like Figure 3 As shown, the present invention provides an outdoor robot navigation method based on visual recognition, comprising:
[0057] Step 310, start the visual acquisition component and the real-time dynamic positioning module to collect three-dimensional information, image information and positioning information of the environment around the outdoor robot through the laser radar, camera and RTK receiver;
[0058] Step 320, extracting features and identifying objects from the collected image information according to a pre-stored machine vision algorithm, and performing dynamic path planning in combination with the real-time positioning information of the outdoor robot provided by the RTK receiver;
[0059] Step 330: The actuator drives the outdoor robot to travel along the planned dynamic path and automatically avoid obstacles when encountering them.
[0060] Among them, the pre-stored machine vision algorithms include SIFT algorithm or YOLO algorithm.
[0061] Before executing the machine vision algorithm, the collected environmental images need to be preprocessed. The preprocessing includes denoising, contrast enhancement, grayscale conversion and other operations to improve image quality and facilitate subsequent processing. Then, the pre-stored machine vision algorithm is used for feature extraction and object recognition. For example, the SIFT algorithm is used for feature extraction and object recognition. First, the SIFT algorithm is applied to the pre-processed environmental image to detect key points. Then, a 128-dimensional descriptor is generated for each key point. Next, the descriptor is matched with the descriptor in the pre-stored database to identify the object in the image. Finally, the identified object is determined based on the matching result and confidence assessment.
[0062] In addition, dynamic path planning is performed in combination with the real-time positioning information of the outdoor robot provided by the RTK receiver. Specifically, the A-Star algorithm is used to perform global path planning toward the target point based on the positioning data provided by the visual acquisition component and the RTK module, and the DWA algorithm is used to achieve dynamic obstacle avoidance.
[0063] Among them, the specific implementation steps of using the A-Star algorithm for global path planning are:
[0064] S11. Represent the robot's environment with a grid diagram, where each grid represents a possible position or state;
[0065] S12, set the starting point and the end point, initialize the open list and the closed list, the open list stores the nodes to be explored, and the closed list stores the explored nodes;
[0066] S13. For each node, calculate the actual cost (g value) from the starting point to the current node and the estimated cost (h value) from the current node to the target node, and the total cost f(n) = g(n) + h(n);
[0067] S14. Starting from the starting point, expand the node with the lowest cost, add its adjacent nodes to the open list, and update their cost values; repeat this process until the target node is found or the open list is empty;
[0068] S15. The target node is found. By tracing the parent node of each node and going back from the target node to the starting point, the shortest path can be obtained.
[0069] In addition, the specific implementation steps of using the DWA algorithm for dynamic obstacle avoidance are:
[0070] S21. Based on the current state of the robot (such as position, speed, acceleration), predict the set of states that the robot may reach in the future;
[0071] S21, based on defining a time window, only consider the possible situations within this window, and ignore the more distant future to reduce the amount of calculation;
[0072] S22. Use a machine vision system to detect surrounding obstacles in real time, including static obstacles and dynamic obstacles (such as pedestrians and other moving objects);
[0073] S23, based on defining a scoring function for each predicted state, taking into account factors such as the progress of reaching the target, the possibility of avoiding collisions, and the speed smoothness;
[0074] S24, the base selects the state with the highest score, and sets the control instructions of the robot to the inputs (such as speed and steering angle) required to achieve this state;
[0075] S25. Repeat the above steps in each control cycle and adjust the robot's actions in real time to cope with the changing environment.
[0076] Suppose there is an outdoor robot that needs to move from a starting position to a specific target position, and there may be obstacles and other dynamic entities along the way. First, the robot uses the A-Star algorithm for global path planning to find a preliminary path from the starting point to the end point. The robot then moves along this path while using the DWA algorithm to handle obstacles and dynamic entities that appear in real time, ensuring that the path can be adjusted in time when encountering unforeseen obstacles, avoiding collisions while staying on the global path as much as possible. In this way, the robot can complete tasks safely and efficiently in complex outdoor environments.
[0077] Figure 4A schematic diagram of the structure of a terminal 400 provided in an embodiment of the present invention. The terminal 400 can be used to execute the outdoor robot navigation method based on visual recognition provided in an embodiment of the present invention.
[0078] The terminal 400 may include: a processor 410, a memory 420 and a communication module 430. These components communicate via one or more buses. Those skilled in the art will appreciate that the server structure shown in the figure does not limit the present invention, and it may be a bus structure or a star structure, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.
[0079] The memory 420 can be used to store the execution instructions of the processor 410. The memory 420 can be implemented by any type of volatile or non-volatile storage terminal or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. When the execution instructions in the memory 420 are executed by the processor 410, the terminal 400 can perform some or all of the steps in the following method embodiments.
[0080] The processor 410 is the control center of the storage terminal, and uses various interfaces and lines to connect various parts of the entire electronic terminal. It executes various functions of the electronic terminal and / or processes data by running or executing software programs and / or modules stored in the memory 420, and calling data stored in the memory. The processor can be composed of an integrated circuit (IC), for example, it can be composed of a single packaged IC, or it can be composed of a plurality of packaged ICs with the same or different functions. For example, the processor 410 can include only a central processing unit (CPU). In an embodiment of the present invention, the CPU can be a single computing core or multiple computing cores.
[0081] The communication module 430 is used to establish a communication channel so that the storage terminal can communicate with other terminals, receive user data sent by other terminals or send user data to other terminals.
[0082] The present invention also provides a computer storage medium, wherein the computer storage medium may store a program, and when the program is executed, the program may include some or all of the steps in each embodiment provided by the present invention. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM).
[0083] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention, in essence or in other words, the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, and other media that can store program codes, including several instructions for enabling a computer terminal (which can be a personal computer, a server, or a second terminal, a network terminal, etc.) to perform all or part of the steps of the methods described in each embodiment of the present invention.
[0084] In this specification, the same or similar parts between the various embodiments can be referred to each other. In particular, for the terminal embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description in the method embodiment.
[0085] In the several embodiments provided by the present invention, it should be understood that the disclosed systems and methods can be implemented in other ways. For example, the system embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of systems or modules, which can be electrical, mechanical or other forms.
[0086] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0087] In addition, each functional module in each embodiment of the present invention may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module.
[0088] Although the present invention has been described in detail with reference to the accompanying drawings and in combination with the preferred embodiments, the present invention is not limited thereto. Without departing from the spirit and essence of the present invention, a person of ordinary skill in the art may make various equivalent modifications or substitutions to the embodiments of the present invention, and these modifications or substitutions shall be within the scope of the present invention. Any person of ordinary skill in the art may easily think of changes or substitutions within the technical scope disclosed by the present invention, and these shall be within the scope of protection of the present invention.
Claims
1. A visual recognition-based outdoor robot navigation system, the navigation system is installed on the outdoor robot body, characterized in that: include: At least one visual acquisition component, used to capture environmental image information of the area where the outdoor robot is located in real time; Real-time dynamic positioning module, used to receive GNSS signals from satellites and differential information from base stations to perform real-time positioning of outdoor robots; The navigation control module is connected to the visual sensor and the real-time dynamic positioning module. It performs dynamic path planning and controls the outdoor robot to drive along the planned dynamic path according to the environmental image information obtained by the visual acquisition component and the real-time dynamic positioning information provided by the real-time dynamic positioning module, and automatically avoids obstacles during driving. Communication module, used to realize information exchange of the whole system; The power module is used to supply power to the entire system.
2. The outdoor robot navigation system based on visual recognition according to claim 1, characterized in that: The visual acquisition components include a laser radar installed on the top of the outdoor robot and several cameras installed on the front end of the outdoor robot.
3. The outdoor robot navigation system based on visual recognition according to claim 1, characterized in that: The real-time dynamic positioning module includes: A GNSS receiver for receiving raw GNSS signals from multiple satellites; A differential data receiver, used for receiving differential correction data from a reference station; The data processing unit is used to fuse the GNSS raw data with the differential correction data to calculate the real-time position, speed and direction of the outdoor robot.
4. The outdoor robot navigation system based on visual recognition according to claim 1, characterized in that: The navigation control module includes: An image processing unit, used for preprocessing, feature extraction and recognition of the environment image captured by the visual acquisition component; A path planning unit, used to generate a dynamic driving path of the robot based on the environmental image recognition result and the positioning information sent by the real-time dynamic positioning module; A control execution unit is used to control the movement direction and speed of the robot according to the planned dynamic driving path; The obstacle detection unit is used to determine whether there are obstacles around the detection robot based on the environmental image recognition results. If there are obstacles, the judgment result will be returned to the control execution unit to adjust the dynamic driving path of the outdoor robot to achieve autonomous obstacle avoidance.
5. The outdoor robot navigation system based on visual recognition according to claim 1, characterized in that: The communication module supports wireless communication protocols, including at least one of Wi-Fi, Bluetooth, GPRS and 4G / 5G.
6. The outdoor robot navigation system based on visual recognition according to claim 1, characterized in that: It also includes an inertial measurement unit and an encoder / wheel speed odometer, which are used to assist positioning and motion control.
7. A method for outdoor robot navigation based on visual recognition, characterized in that: include: Start the visual acquisition component and real-time dynamic positioning module to collect three-dimensional information, image information and positioning information of the outdoor robot's surrounding environment through lidar, camera and RTK receiver; The collected image information is used for feature extraction and object recognition based on the pre-stored machine vision algorithm, and dynamic path planning is performed in combination with the outdoor robot real-time positioning information provided by the RTK receiver; The drive actuator drives the outdoor robot to travel along the planned dynamic path and automatically avoid obstacles when encountering them.
8. The outdoor robot navigation method based on visual recognition according to claim 7 is characterized in that: The pre-stored machine vision algorithms include SIFT algorithm or YOLO algorithm.
9. A terminal, characterized in that: include: processor; A memory for storing execution instructions of the processor; The processor is configured to execute the method according to any one of claims 7 to 8.
10. A computer-readable storage medium storing a computer program, characterized in that: When the program is executed by a processor, the method according to any one of claims 7 to 8 is implemented.
