Outdoor robot control system based on fusion positioning method

By integrating RTK, UWB and IMU units in the outdoor robot control system, combining the positioning signal attenuation model and obstacle map, the problems of positioning error accumulation and signal attenuation in complex urban road environments are solved, and high-precision and safe robot navigation are achieved.

CN120085597AActive Publication Date: 2025-06-03NANTONG UNIV +1

Patent Information

Application Number
CN202510573595.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-05-06
Publication Date
2025-06-03
Estimated Expiration
2045-05-06

AI Technical Summary

Technical Problem

In the complex urban road environment, the positioning error of the inertial navigation module accumulates with the increase of time and driving distance, and the measurement data is prone to deviation in speed bumps and pothole road surfaces, affecting the positioning accuracy. At the same time, the positioning system based on RTK, UWB and INS lags in the single judgment mechanism in urban environments, resulting in the risk of missing positioning signals and decreasing accuracy.

Method used

An outdoor robot control system based on a fusion positioning method is adopted, combined with RTK, UWB and IMU units, the road scene is judged through the positioning signal attenuation model and the positioning method is switched, and the optimal path is generated by the fusion obstacle map and the positioning signal attenuation model.

Benefits of technology

High-precision positioning of robots in complex urban road environments is achieved, avoiding the accumulation of positioning errors and the reduction in accuracy caused by signal attenuation, and ensuring navigation accuracy and safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure FT_1
    Figure FT_1
  • Figure FT_2
    Figure FT_2
  • Figure FT_3
    Figure FT_3
Patent Text Reader

Abstract

The invention discloses an outdoor robot control system based on a fusion positioning method, which comprises a positioning navigation module, an interaction module and an execution module, and is characterized in that the positioning navigation module is in data connection with the interaction module and the execution module, and the interaction module is in data connection with the execution module; according to the invention, the RTK, UWB and IMU units are fused, and all the units work cooperatively, so that the problem of continuous and accurate positioning of the traffic isolation robot in a complex urban road environment is solved; according to the method, the road scene where the robot is located is judged through the positioning signal attenuation model, precise switching of the corresponding optimal positioning method is achieved, and high-precision positioning of the traffic isolation robot is achieved; according to the invention, the positioning signal attenuation map and the obstacle map are fused into the two-factor environment map, an optimal path which can avoid obstacles and consider the positioning signal attenuation factor is generated, and navigation is carried out, so that the positioning precision and the navigation accuracy are ensured.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of robots, specifically an outdoor robot control system based on a fusion positioning method. Background Technique

[0002] With the development of technology, mobile robots are increasingly widely used in the field of intelligent transportation. In a complex traffic environment, urban roads show the characteristics of complexity and three-dimensionality, involving the switching of multiple scenarios, which poses high requirements for the positioning and navigation of mobile robots.

[0003] Currently known related technologies such as the self-moving traffic isolation robot, system and its lane isolation method proposed in the patent with the application number CN116356739A. The traffic isolation robot involved in this patent uses the longitude and latitude information calculated by the inertial navigation module to achieve positioning in the road environment, and compares the position information with the starting position or the target end point to perform path tracking and navigation. This positioning method has the following defects: its inertial navigation module calculates the position change by measuring acceleration and angular velocity, and its positioning error will continuously accumulate with the increase of time and driving distance, resulting in a gradual decrease in positioning accuracy, and when passing through speed bumps and potholed roads, it will cause deviations in the measurement data of the inertial navigation module, thereby affecting the positioning accuracy. Currently known related technologies such as the indoor and outdoor positioning system and method based on RTK, UWB and INS proposed in the patent with the application number CN118089739A. In this patent, it is proposed to select different positioning methods by judging whether it is indoors or outdoors through the RTK satellite observation number judging unit. Because the RTK satellite observation number is affected by the change of satellite geometric distribution and signal propagation delay, for the complex urban traffic application environment, the lag and incorrect judgment of this single judgment mechanism are likely to lead to untimely switching and incorrect selection of the positioning method, there is a risk of missing positioning signals and a significant decrease in accuracy, and this positioning system is only limited to obtaining positioning information, and no solution is proposed for fusing the positioning information of mobile robots with subsequent path planning and navigation. Summary of the Invention

[0004] The purpose of the present invention is to provide an outdoor robot control system based on a fusion positioning method to solve the problems raised in the above background technique.

[0005] To achieve the above purpose, the present invention provides the following technical solution: An outdoor robot control system based on a fusion positioning method, including a positioning and navigation module, an interaction module and an execution module. The positioning and navigation module establishes data connections with the interaction module and the execution module respectively, and the interaction module establishes a data connection with the execution module.

[0006] Preferably, the positioning and navigation module includes a positioning sub-module, a map construction sub-module and a decision-making and navigation sub-module.

[0007] Preferably, the positioning sub-module includes an RTK unit, a UWB unit, and an IMU unit. The RTK unit is connected to a fixed base station through a wireless network, receives differential signals, and uses a built-in high-precision algorithm to calculate and output a centimeter-level positioning result. The UWB unit serves as a positioning tag and communicates with multiple UWB base stations to obtain accurate distance information. The IMU unit integrates multiple sensors and provides real-time measurements of the robot's acceleration, angular velocity, and magnetometer. When the RTK signal is interfered with or missing, it performs combined positioning with RTK and UWB. In the positioning sub-module, an IMU data processing formula is included. The IMU data processing formula is based on the acceleration, angular velocity, and magnetometer measurements obtained by the IMU unit and processes them through the trapezoidal integration method to obtain the position information of the robot. The calculation formula is as follows: Integrate acceleration to obtain velocity. Using the trapezoidal integration method, the velocity update formula is:

[0008] where is the measured value of acceleration in the direction at time . The sampling time interval is . Assume measurements are made at discrete time ; Using the trapezoidal integration method, the displacement update formula is:

[0009] Thus, the relative displacement data is obtained. It is necessary to fuse the magnetometer and gyroscope data to estimate the heading and use Kalman filtering for fusion. Finally, the heading angle is obtained;

[0010] State transition equation:

[0011] Observation equation:

[0012] where the angle between the projection of the magnetic field on the horizontal plane and the axis is set as , the heading angle obtained by integrating the gyroscope is . In the fusion through Kalman filtering, the state variable is set, where is the fused heading angle, is the rate of change of the heading angle, is the process noise, is the measurement noise.

[0013] Preferably, the map construction sub-module includes a multi-line lidar unit and a binocular vision unit. The multi-line lidar unit is used to help the robot perceive the surrounding environment, and the binocular vision unit is used to capture and process stereo image information, providing key data for constructing a positioning signal attenuation model map and optimizing the active switching strategy of the positioning method. The two work together to achieve environmental perception, obstacle recognition, and map construction. In the map construction sub-module, the data set of the environmental perception part of the positioning signal attenuation model is as follows:

[0014] Among them, is the image frame provided by the binocular vision unit, used to detect obstacles and estimate their positions, is the point cloud data provided by the multi-line lidar, used to accurately measure the shape and height of obstacles, is the acceleration and angular velocity data provided by the IMU, used to estimate the motion state of the robot; When the map construction sub-module classifies obstacles, it calculates the weight affecting the positioning signal strength through the characteristics of obstacles and signal attenuation. The basic formula is:

[0015] Among them, is the obstacle classification weight, indicates the obstacle type, represents the weight calculation function, represents the signal type, is the signal type corresponding weight coefficient, indicates the obstacle type for the signal type attenuation degree; Considering three common obstacle types in the urban road environment, trees T, buildings B, and metal obstacles M, the following formula can be used to calculate the weight:

[0016] Thus, a positioning signal attenuation model is constructed

[0017] Among them, is the transmitted signal strength, is the predicted received signal strength at position , is the predicted attenuation function at position , which depends on the obstacle classification weight at this position and the signal propagation distance ; The map construction sub-module determines a reasonable threshold based on the test environment and multiple tests to judge the road scene where the machine is located and select the corresponding optimal positioning method. Among them, in outdoor positioning judgment, when the outdoor received signal strength is within the threshold, the robot uses RTK / INS loose combination for positioning:

[0018] In indoor positioning judgment, when the indoor received signal strength is within the threshold, the robot uses UWB / INS tight combination for positioning:

[0019] In the indoor-outdoor transition area judgment, when neither the indoor nor the outdoor received signal is within the threshold, the robot uses a combination of IMU and lidar for positioning.

[0020] Preferably, the decision-making and navigation sub-module includes a ROS main control unit and an STM32 main control unit. The ROS main control unit serves as the upper-layer decision-making center, which is used to integrate multi-source sensor data, evaluate the positioning signal strength on different paths through the positioning signal energy formula, plan the path according to the current environment and the target position, and generate navigation instructions. The STM32 main control unit serves as the lower-layer execution core, which is used to receive the navigation instructions from the ROS main control unit, convert them into motor control signals, drive the robot to move forward along the planned path, and monitor the motion state of the robot in real time and feedback it to the ROS main control unit for adjustment and optimization; in the decision-making and navigation sub-module, there are RTK / INS loose-coupling integrated navigation system and UWB / INS tight-coupling integrated navigation system. The state vector of the RTK / INS loose-coupling integrated navigation system is:

[0021] Among them, is the position error, is the velocity error, is the attitude error, which can be specifically represented by one of the Euler angle error or the quaternion error, is the gyroscope bias, is the first-order Markov error of the gyroscope, is the accelerometer error; the observation equation describes the relationship between the observation data and the system state, and the observation equation can be expressed as:

[0022] The system observation vector of the Kalman filter is:

[0023] Observation noise vector is a Gaussian white noise vector with zero mean. If the attitude is represented by Euler angles, then can be expressed as:

[0024] where is the position difference, is the velocity difference, is the attitude difference, , and are the noise components in the position difference, velocity difference, and attitude difference respectively; is the measurement matrix, and the formula is as follows:

[0025] The heat state vector of the UWB / INS tightly coupled integrated navigation system is:

[0026] where is the position error, is the velocity error, is the attitude error, which can be specifically represented by either Euler angle error or quaternion error, is the gyroscope bias, is the accelerometer error; The observation equation of UWB is:

[0027] The observation vector is:

[0028] where the UWB base station position is , the robot position is , is the observation noise vector; In the extended Kalman filter processing, the covariance prediction and state transition matrix formulas used are:

[0029] where is the estimated covariance matrix at time, is the process noise covariance matrix, , which is the Jacobian matrix of the function with respect to the state vector at ,

[0030] Among them, is the observation Jacobian matrix, is the observation noise covariance matrix, and finally high-precision positioning information of the robot is obtained , and at the same time, the biases of the accelerometer and gyroscope can also be estimated and corrected; The positioning signal energy formula is specifically:

[0031] Among them, represents the set of signal types, is the signal type 's weight coefficient, which is used to balance the contributions of different signal types to the energy map, is at the position for the signal type 's obstacle type 's classification weight, is the signal type 's reference signal strength; The decision-making and navigation sub-module overlaps and fuses the road obstacle map and the positioning signal attenuation model map to generate an optimal path that avoids obstacles and takes into account the positioning signal attenuation factor for navigation. The optimization function it constructs:

[0032] Among them, represents the coordinate sequence of the path, and are weight coefficients, which are used to balance the importance of path safety and positioning accuracy, is the overlapping cost between the path and the obstacle map, is the cost of positioning signal attenuation on the path.

[0033] Preferably, the interaction module includes a real-time monitoring sub-module and a voice broadcast communication sub-module. The real-time monitoring sub-module captures and monitors the road environment where the robot is located in real time through a high-definition camera, provides on-site monitoring records, provides real-time image information for the map construction and navigation decision-making of the robot, and assists in positioning and path planning. The voice broadcast communication sub-module is used to broadcast the traffic conditions according to real-time traffic data or the robot's own perception information, and is also used to issue warning sounds or voice prompts.

[0034] Preferably, the execution module includes a chassis motor sub-module, a telescopic arm sub-module, and a warning sub-module.

[0035] Preferably, the chassis motor sub-module includes a first motor unit, a first motor controller unit, and a first transmission unit. The first motor unit is used to convert electrical energy into mechanical energy to provide power for the movement of the robot. The first motor controller unit is used to receive motion instructions and control the rotation speed, steering, and braking of the first motor unit. The first transmission unit is used to transmit the power of the first motor unit to the drive wheels to move the robot.

[0036] Preferably, the telescopic arm sub-module includes a second motor unit, a second motor controller unit, a second transmission unit, a telescopic arm body unit, and a safety device unit. The second motor unit is used to convert electrical energy into mechanical energy and provide power for the telescopic arm body unit through the second transmission unit. The telescopic arm body unit is used to form a physical isolation. The second motor controller unit is used to receive motion instructions and control the rotation speed, steering, and braking of the second motor unit.

[0037] Preferably, the warning sub-module includes a warning light unit, a high-decibel alarm unit, and a control circuit unit. Under the action of the control circuit unit, the warning light unit and the high-decibel alarm unit emit warning signals in a dual way of vision and hearing.

[0038] Compared with the prior art, the beneficial effects of the present invention are as follows: By integrating RTK, UWB, and IMU units and utilizing the collaborative work of each unit, the present invention solves the problem of continuous precise positioning of traffic isolation robots in complex urban road environments; The present invention proposes to judge the road scene where the machine is located through a positioning signal attenuation model and realize the accurate switching of the corresponding optimal positioning method, achieving high-precision positioning of traffic isolation robots; By fusing the positioning signal attenuation map with the obstacle map into a two-factor environment map, the present invention generates an optimal path that avoids obstacles and takes into account the positioning signal attenuation factor and conducts navigation, thereby ensuring the positioning accuracy and the accuracy of navigation. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 is the system structure block diagram of the present invention; Figure 2 is the structure block diagram of the positioning and navigation module of the present invention; Figure 3 is the structure block diagram of the interaction module of the present invention; Figure 4 is the structure block diagram of the execution module of the present invention; Figure 5 is the method flow chart of the present invention; Figure 6 is the flow chart of the switching of the fusion positioning method; Figure 7 is the schematic diagram of road positioning and working environment; Figure 8 is the two-factor fusion and path planning map.

[0040] In the figure: 1. Positioning and navigation module; 11. Positioning sub-module; 111. RTK unit; 112. UWB unit; 113. IMU unit; 12. Map construction sub-module; 121. Multi-line lidar unit; 122. Binocular vision unit; 13. Decision-making and navigation sub-module; 131. ROS main control unit; 132. STM32 main control unit; 2. Interaction module; 21. Real-time monitoring sub-module; 22. Voice broadcast and communication sub-module; 3. Execution module; 31. Chassis motor sub-module; 311. First motor unit; 312. First motor controller unit; 313. First transmission unit; 32. Telescopic arm sub-module; 321. Second motor unit; 322. Second motor controller unit; 323. Second transmission unit; 324. Telescopic arm body unit; 325. Safety device unit; 33. Warning sub-module; 331. Warning light unit; 332. High-decibel alarm unit; 333. Control circuit unit. Specific implementation mode

[0041] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

[0042] Please refer to the attached Figure 1 - attached Figure 8 , an embodiment provided by the present invention: an outdoor robot control system based on a fusion positioning method, including a positioning and navigation module 1, an interaction module 2, and an execution module 3. The positioning and navigation module 1 respectively establishes a data connection with the interaction module 2 and the execution module 3, and the interaction module 2 establishes a data connection with the execution module 3; the positioning and navigation module 1 includes a positioning sub-module 11, a map construction sub-module 12, and a decision-making and navigation sub-module 13; the positioning sub-module 11 includes an RTK unit 111, a UWB unit 112, and an IMU unit 113. The RTK unit 111 is connected to a fixed base station through a wireless network, receives differential signals, and uses a built-in high-precision algorithm to calculate and output a centimeter-level positioning result. The UWB unit 112 serves as a positioning tag and communicates with multiple UWB base stations to obtain accurate distance information. The IMU unit 113 integrates multiple sensors and provides real-time acceleration, angular velocity, and magnetometer measurement values of the robot. When the RTK signal is interfered with or missing, it performs combined positioning with RTK and UWB; in the positioning sub-module 11, an IMU data processing formula is included. The IMU data processing formula is based on the acceleration, angular velocity, and magnetometer measurement values obtained by the IMU unit 113 and is processed by the trapezoidal integration method to obtain the position information of the robot. The calculation formula is as follows: The velocity is obtained by integrating the acceleration using the trapezoidal integration method. The velocity update formula is:

[0043] where is the measured value of the acceleration in the direction at time The sampling time interval is Assume the measurement is carried out at discrete time ; Using the trapezoidal integration method, the displacement update formula is:

[0044] Thus, the relative displacement data is obtained. It is necessary to fuse the magnetometer and gyroscope data to estimate the heading, and use the Kalman filter for fusion, and finally obtain the heading angle ;

[0045] State transition equation:

[0046] Observation equation:

[0047] where the angle between the projection of the magnetic field on the horizontal plane and the axis is set as The heading angle obtained by integrating the gyroscope is In the fusion through the Kalman filter, the state variable is set, where is the fused heading angle, is the rate of change of the heading angle, is the process noise, is the measurement noise; The map construction sub-module 12 includes a multi-line lidar unit 121 and a binocular vision unit 122. The multi-line lidar unit 121 is used to help the robot perceive the surrounding environment, and the binocular vision unit 122 is used to capture and process stereo image information, providing key data for constructing the positioning signal attenuation model map and optimizing the active switching strategy of the positioning method. The two cooperate to achieve environmental perception, obstacle recognition and map construction. In the map construction sub-module 12, the data set of the environmental perception part of the positioning signal attenuation model is:

[0048] where is the image frame provided by the binocular vision unit 122, which is used to detect obstacles and estimate their positions, It is the point cloud data provided by the multi-line lidar, which is used to accurately measure the shape and height of obstacles. It is the acceleration and angular velocity data provided by the IMU, which is used to estimate the motion state of the robot. When the map construction sub-module 12 classifies obstacles, it calculates the weight affecting the positioning signal strength through the characteristics of obstacles and signal attenuation. The basic formula is:

[0049] Among them, is the obstacle classification weight, indicates the obstacle type, represents the weight calculation function, represents the signal type, is the signal type corresponding weight coefficient, indicates the obstacle type for the signal type attenuation degree; Considering three common obstacle types in the urban road environment, trees T, buildings B, and metal obstacles M, the following formula can be used to calculate the weight:

[0050] Thus, a positioning signal attenuation model is constructed

[0051] Among them, is the transmitted signal strength, is the predicted received signal strength at position is the predicted attenuation function at position , which depends on the obstacle classification weight at this position and the signal propagation distance ; The map construction sub-module 12 determines a reasonable threshold according to the test environment and multiple tests to judge the road scene where the machine is located and select the corresponding optimal positioning method. Among them, in outdoor positioning judgment, when the outdoor received signal strength is within the threshold, the robot uses RTK / INS loose combination for positioning:

[0052] In indoor positioning judgment, when the indoor received signal strength is within the threshold, the robot uses UWB / INS tight combination for positioning:

[0053] ​In the determination of the indoor-outdoor transition area, when the received signals indoors and outdoors are both outside the threshold, the robot uses a combination of IMU and lidar for positioning; the decision-making and navigation sub-module 13 includes a ROS master control unit 131 and an STM32 master control unit 132. The ROS master control unit 131 serves as the upper-level decision-making center, which is used to integrate multi-source sensor data, evaluate the positioning signal strength on different paths through the positioning signal energy formula, perform path planning based on the current environment and the target position, generate navigation instructions. The STM32 master control unit 132 serves as the underlying execution core, which is used to receive the navigation instructions from the ROS master control unit 131, convert them into motor control signals, drive the robot to move forward along the planned path, and monitor the motion state of the robot in real time, and feedback to the ROS master control unit 131 for adjustment and optimization; in the decision-making and navigation sub-module 13, there is an RTK / INS loosely coupled integrated navigation system and a UWB / INS tightly coupled integrated navigation system. The state vector of the RTK / INS loosely coupled integrated navigation system is:

[0054] where is the position error, is the velocity error, is the attitude error, which can be represented by one of the Euler angle error or the quaternion error, is the gyroscope bias, is the first-order Markov error of the gyroscope, is the accelerometer error; the observation equation describes the relationship between the observed data and the system state, and the observation equation can be expressed as:

[0055] The system observation vector of the Kalman filter is:

[0056] The observation noise vector is a zero-mean Gaussian white noise vector. If the attitude is represented by Euler angles, then can be expressed as:

[0057] where is the position difference, is the velocity difference, is the attitude difference, , and are the noise components in the position difference, velocity difference, and attitude difference respectively; is the measurement matrix, and the formula is as follows:

[0058] The heating state vector of the UWB / INS tightly coupled integrated navigation system is:

[0059] where, is the position error, is the velocity error, is the attitude error, which can be specifically represented by one of the Euler angle error or the quaternion error, is the gyroscope bias, is the accelerometer error; The observation equation of UWB is:

[0060] The observation vector is:

[0061] where, the UWB base station position is and the robot position is , is the observation noise vector; In the extended Kalman filter processing, the covariance prediction and state transition matrix formulas used are:

[0062] where, is the estimated covariance matrix at time, is the process noise covariance matrix, , which is the Jacobian matrix of the function with respect to the state vector at ,

[0063] where, is the observation Jacobian matrix, is the observation noise covariance matrix, and finally the high-precision positioning information of the robot is obtained, and at the same time, the biases of the accelerometer and gyroscope can be estimated and corrected; The positioning signal energy formula is specifically:

[0064] where, represents the set of signal types, is the weight coefficient of the signal type used to balance the contributions of different signal types to the energy map, is at the position At, for the signal type of the obstacle type of the classification weight, is the reference signal strength of the signal type ; The decision-making and navigation sub-module 13 overlaps and fuses the road obstacle map with the positioning signal attenuation model map to generate an optimal path that avoids obstacles and takes into account the positioning signal attenuation factor and navigates. The optimization function it constructs is:

[0065] Among them, represents the coordinate sequence of the path, and are weight coefficients used to balance the importance of path safety and positioning accuracy, the overlapping cost of the path and the obstacle map, is the cost of positioning signal attenuation on the path; The interaction module 2 includes a real-time monitoring sub-module 21 and a voice broadcast communication sub-module 22. The real-time monitoring sub-module 21 captures and monitors the road environment where the robot is located in real time through a high-definition camera, provides on-site monitoring records, provides real-time image information for the map construction and navigation decision-making of the robot, and assists in positioning and path planning. The voice broadcast communication sub-module 22 is used to broadcast the traffic conditions according to real-time traffic data or the robot's own perception information, and is also used to emit warning sounds or voice prompts; The execution module 3 includes a chassis motor sub-module 31, a telescopic arm sub-module 32, and a warning sub-module 33; The chassis motor sub-module 31 includes a first motor unit 311, a first motor controller unit 312, and a first transmission unit 313. The first motor unit 311 is used to convert electrical energy into mechanical energy to provide power for the movement of the robot. The first motor controller unit 312 is used to receive movement instructions and control the rotation speed, steering, and braking of the first motor unit 311. The first transmission unit 313 is used to transmit the power of the first motor unit 311 to the drive wheels to make the robot move; The telescopic arm sub-module 32 includes a second motor unit 321, a second motor controller unit 322, a second transmission unit 323, a telescopic arm body unit 324, and a safety device unit 325. The second motor unit 321 is used to convert electrical energy into mechanical energy and provide power for the telescopic arm body unit 324 through the second transmission unit 323. The telescopic arm body unit 324 is used to form a physical isolation. The second motor controller unit 322 is used to receive movement instructions and control the rotation speed, steering, and braking of the second motor unit 321; The warning sub-module 33 includes a warning light unit 331, a high-decibel alarm unit 332, and a control circuit unit 333. The warning light unit 331 and the high-decibel alarm unit 332 emit warning signals in a dual way of vision and hearing under the action of the control circuit unit 333.

[0066] Working principle: When using the present invention to achieve high-precision fusion positioning and navigation of a traffic isolation robot, the following steps are adopted: Step 1, data acquisition and preliminary processing; Step 2, scene judgment and positioning method selection; Step 3, outdoor positioning; Step 4, indoor positioning; Step 5, positioning in the indoor-outdoor transition area; Step 6, path planning and navigation; specifically: Step 1, in the positioning sub-module 11, the IMU unit 113 uses the measured values of acceleration in the x, y, and z directions, angular velocity, and magnetometer measurement values obtained. In addition, for the mobile robot, the trapezoidal integration method is used to integrate the obtained acceleration and velocity data successively. First, the velocity change amount is calculated to obtain the velocity in each direction, and then the displacement in each direction is further deduced to obtain the relative displacement data; and the magnetometer and gyroscope data are fused by Kalman filter to estimate the heading; finally, the heading angle is combined with the relative displacement vector calculated by the trapezoidal integration method to deduce the movement trajectory and relative position of the robot; the multi-line lidar unit 121 scans the surrounding environment to obtain point cloud data for accurately measuring the shape, height, and position information of obstacles; the binocular vision unit 122 captures the image information of the real-time scene, simulating the human eye vision principle, and provides data support for subsequent environmental perception and the construction of the positioning signal attenuation model map; Step 2, the RTK unit 111 and the UWB unit 112 in the positioning sub-module 11 continuously obtain the positioning signal strength data respectively; the map construction sub-module 12 uses the data collected by the multi-line lidar unit 121 and the binocular vision unit 122, combines the robot motion state information provided by the IMU unit 113, and constructs a positioning signal attenuation model map; according to the detected real-time positioning signal strength combined with the positioning signal attenuation model map, the road scene where the robot is located is judged, and the ROS main control unit 131 in the decision-making and navigation sub-module 13 receives the data from the positioning sub-module 11 and the map construction sub-module 12, and selects the corresponding optimal positioning method according to the scene judgment result; if in an outdoor environment, RTK / INS loose combination is used for positioning, and enter Step 3; if in an indoor environment, UWB / INS tight combination is used for positioning, and enter Step 4; if in the indoor-outdoor transition area, a combination of IMU and lidar is used for positioning, and enter Step 5; Step 3: The RTK unit 111 establishes a connection with a fixed base station using wireless network communication, and receives differential signals containing precise position information and error correction parameters in real time. After being solved by the built-in high-precision algorithm, it outputs a positioning result with centimeter-level accuracy. When the RTK signal is blocked or interfered, the IMU unit 113 uses its own inertial navigation ability to perform loose integrated positioning with the RTK. The STM32 main control unit 132 in the decision-making and navigation sub-module 13 takes the differences in position, velocity, and attitude measured by the RTK unit 111 and those solved by the INS as observation values and inputs them into the Kalman filter for integrated navigation, and outputs the corrected position information. Step 4: The UWB unit 112, as a positioning tag, communicates and interacts with multiple UWB base stations by transmitting and receiving ultra-wideband signals, and measures and obtains the precise distance information from each base station to the tag. The IMU unit 113 provides continuous and high-precision motion state information. The ROS main control unit 131 in the decision-making and navigation sub-module 13 uses a neural network algorithm to perform intelligent error compensation on the UWB ranging data, and then obtains the high-precision positioning information of the robot based on the extended Kalman filter algorithm. Step 5: The IMU unit 113 continuously provides attitude, velocity, and relative displacement information. The multi-line lidar unit 121 scans the surrounding environment to generate point cloud data for constructing a local map and performing matching for precise positioning. The STM32 main control unit 132 in the decision-making and navigation sub-module 13 combines and processes the two sets of data to achieve precise positioning in the indoor-outdoor transition area. Step 6: The ROS main control unit 131 integrates the high-precision positioning information from different positioning methods, and comprehensively considers the obstacle map generated by the map construction sub-module 12 and the energy map of the positioning signal attenuation model. Through a specific path planning algorithm and optimization function, it generates an optimal path that not only avoids obstacles but also takes into account the positioning signal attenuation factor. The STM32 main control unit 132 receives the navigation instructions generated by the ROS main control unit 131, converts them into specific motor control signals, and drives the mobile robot to move forward along the planned path. At the same time, the STM32 main control unit 132 is responsible for monitoring the motion state of the robot, such as speed, steering angle, etc., and real-time feedbacks this information to the ROS main control unit 131 for necessary adjustment and optimization. Among them, in the interactive module 2, the real-time monitoring submodule 21 uses a high-definition camera to capture and monitor the road environment where the mobile robot is located in real time. The monitoring screen and related environmental information are transmitted to the positioning and navigation module 1 to provide real-time data support for map construction, positioning and path planning. At the same time, it also retains the monitoring records of the accident scene for traffic police personnel to facilitate subsequent accident handling. The voice broadcast communication submodule 22 conveys the current traffic conditions to the surrounding people based on real-time traffic data, the robot's own perception information and the operating status of the positioning and navigation module 1, such as road closures, diversion information, traffic congestion, etc. When the robot detects a potential dangerous situation, such as pedestrians illegally crossing the isolation area, vehicles approaching the isolation belt, etc., it immediately issues a warning sound or voice prompt to remind relevant personnel to pay attention to safety; in the execution module 3, the first motor unit 311 of the chassis motor submodule 31 is used to convert electrical energy into mechanical energy to provide power for the robot to move, the first motor controller unit 312 is used to receive motion instructions, control the speed, steering and braking of the first motor unit 311, and the first transmission unit 313 is used to transmit the power of the first motor unit 311 to the drive wheel to move the robot; the second motor unit 321 of the telescopic arm submodule 32 is used to convert electrical energy into mechanical energy, and provide power to the telescopic arm body unit 324 through the second transmission unit 323, and the telescopic arm body unit 324 is used to form physical isolation, and the second motor controller unit 322 is used to receive motion instructions and control the speed, steering and braking of the second motor unit 321; in the warning submodule 33, the warning light unit 331 and the high-decibel siren unit 332 send warning signals in both visual and auditory ways under the action of the control circuit unit 333; like Figure 7 As shown in the figure, the traffic isolation robot passes through three different road scenes from the starting point to the end point of the isolation area: the outdoor area, the indoor-outdoor transition area, and the indoor area. The outdoor area is open above the area where the traffic isolation robot is operating, without any obstructions; the indoor-outdoor transition area is where discontinuous obstructions such as shade and pedestrian bridges appear intermittently above the robot; the indoor area is where continuous and uninterrupted obstructions such as viaducts or tunnels appear above the robot; positioning and navigation are performed according to the above six steps, and scene discrimination is performed based on real-time detection and predicted received signal strength: Outdoor positioning judgment, when the outdoor receiving signal strength If it is within the threshold, the robot uses the RTK / INS combination for positioning;

[0067] Indoor positioning judgment, when the indoor receiving signal strength If it is within the threshold, the robot uses the tight combination of UWB / INS for positioning;

[0068] Indoor and outdoor transition area determination. When the received signals indoors and outdoors are both outside the threshold, the robot uses a combination of IMU and lidar for positioning; During the process of the traffic isolation robot moving from the starting point to the end point of the isolation area, RTK / INS loose integration is first used for positioning. First, it passes through the unobstructed outdoor area. When it is predicted that it is about to enter the indoor-outdoor transition area, the robot needs to switch at the positioning method switching node 1 when the RTK signal has not completely failed but has started to decay, to ensure that there is enough time to complete the smooth transition of the positioning mode; the last obtained RTK coordinates before the switch will be used as the initial coordinates, which is the benchmark for subsequent IMU and lidar integrated positioning; the IMU will start calculating the relative motion trajectory and attitude change of the robot based on this initial coordinate and the acceleration and angular velocity information measured by itself. In specific implementation, it should be noted that during the driving in the indoor-outdoor transition area, the RTK unit 111 carried by the robot still continuously receives the latitude and longitude coordinates, and judges whether the received positioning information is valid according to the number of satellites in view; when the number of satellites in view is greater than 20, it is considered that the positioning information is valid and can be used to correct the IMU and lidar integrated positioning; then, passing through the indoor-outdoor transition area, when it is predicted that it is about to enter the indoor area, the robot needs to switch at the positioning method switching node 2 when the RTK signal has not completely failed but has started to decay significantly, to ensure that there is enough time to complete the smooth transition of the positioning mode; finally, entering the indoor area under continuous occlusion of the urban viaduct, at this time, UWB and INS integrated positioning is adopted; Reasonably arranging UWB base stations in the indoor area is the key to achieving high-precision positioning; The arrangement of UWB base stations needs to follow certain principles. First, it is necessary to ensure full coverage of the indoor area. According to the size, shape and obstacle distribution of the indoor space, the base stations are evenly distributed on the surrounding walls or ceilings. The spacing between adjacent base stations should be optimized according to the actual environment, generally between 5-10 meters, to ensure that the robot can receive the signals of at least three base stations at any position in the indoor area to achieve triangulation positioning; at the same time, multiple UWB tags are equipped for the robot, and the tags should be installed at stable positions of the robot to avoid being blocked by other components to ensure the stability of signal transmission; The distance between the tag and the base station is measured by sending and receiving ultra-wideband pulse signals; INS continues to play a role in the indoor area. It can provide the acceleration and angular velocity information of the robot in real time and calculate the relative motion of the robot; Integrating UWB and INS for positioning, through data fusion algorithms, combining the high-precision position information of UWB and the continuous motion information of INS, can effectively make up for the deficiencies of a single sensor; For example, when the UWB signal is briefly lost due to certain reasons during the movement of the robot, INS can maintain the continuity of positioning, and when the UWB signal is stable, it can correct the errors accumulated by INS in time, so as to achieve high-precision and stable positioning of the robot in the indoor area until it successfully reaches the end point of the isolation area; Such as Figure 8The schematic diagram of dual-factor fusion and path planning shown, which contains various information for the path planning and navigation of traffic isolation robots; based on environmental perception, through the fusion analysis of multi-sensor data, an obstacle map and a positioning signal attenuation model energy map are constructed, and the obstacle information obtained from environmental perception and obstacle classification, as well as the signal strength and weight information of different regions obtained from the construction of the positioning signal attenuation model, are fused. The dual-factor fusion environment map obtained consists of squares, and each square represents a regional unit; some squares are marked as "Z", and these squares represent obstacle areas that the robot needs to avoid during travel to ensure safe passage; the squares marked as "2" indicate that the signal attenuation in this area is relatively strong; this means that in these areas, the intensity of positioning signals such as RTK signals and UWB signals is relatively weak, which may have a certain impact on the positioning accuracy of the robot. The squares marked as "1" indicate that the signal attenuation in this area is relatively weak, and the positioning signals are relatively strong in these areas, which is more conducive to the robot obtaining accurate positioning information; after obtaining the dual-factor fusion environment map, path planning needs to be carried out according to the map information to generate an optimal path. This path is the optimal path generated by the system after obtaining high-precision positioning information from different positioning methods such as RTK / INS, UWB / INS, and IMU + lidar combination, considering the obstacle map and the positioning signal attenuation model energy map comprehensively; as Figure 8 The path planning that comprehensively considers obstacles and positioning signal attenuation factors shown is the solid line. This path starts from the starting point. First, the path avoids the nearby obstacle areas, that is, the "Z" squares, and at the same time tries to choose the areas with relatively weak signal attenuation, that is, the "1" squares or relatively weak "2" squares to travel; for example, near the starting point, the path extends to the upper left, avoiding the obstacles below and on the left and the areas with relatively strong signal attenuation, and then winds along the areas with relatively weak signal attenuation and finally reaches the end point; the planning of this path fully considers the avoidance of obstacles and the attenuation of positioning signals, aiming to ensure that the robot can safely avoid obstacles during travel and obtain relatively good positioning signals, so as to ensure the positioning accuracy and the accuracy of navigation; in contrast, the D algorithm path planning that only considers obstacles is the dotted line. This path is planned only based on the obstacle map using the D algorithm, only considering the factor of avoiding obstacles and not considering the attenuation of positioning signals. This path starts from the starting point and extends along the direction of avoiding obstacles, but it can be seen that it passes through many areas with relatively strong signal attenuation, that is, the "2" squares; for example, in the middle part, the path directly passes through an area with relatively strong signal attenuation, which may lead to a decrease in the positioning accuracy of the robot in this area and increase the uncertainty and risk of navigation.

[0069] For those skilled in the art, it is obvious that the present invention is not limited to the details of the above-described exemplary embodiments, and the present invention can be implemented in other specific forms without departing from the spirit or basic characteristics of the present invention. Therefore, from any point of view, the embodiments should be regarded as exemplary and non-limiting. The scope of the present invention is defined by the appended claims rather than the above description. Therefore, all changes falling within the meaning and scope of the equivalent elements of the claims are intended to be embraced within the present invention. Any reference signs in the claims should not be construed as limiting the claims involved.

Claims

1. An outdoor robot control system based on a fusion positioning method, comprising a positioning and navigation module (1), an interaction module (2) and an execution module (3), characterized in that: The positioning and navigation module (1) establishes data connections with the interaction module (2) and the execution module (3) respectively, and the interaction module (2) establishes data connection with the execution module (3).

2. The outdoor robot control system based on the fusion positioning method according to claim 1 is characterized in that: The positioning and navigation module (1) comprises a positioning submodule (11), a map building submodule (12) and a decision and navigation submodule (13).

3. The outdoor robot control system based on the fusion positioning method according to claim 2 is characterized in that: The positioning submodule (11) comprises an RTK unit (111), a UWB unit (112) and an IMU unit (113). The RTK unit (111) is connected to a fixed base station via a wireless network, receives a differential signal, uses a built-in high-precision algorithm to solve, and outputs a centimeter-level positioning result. The UWB unit (112) serves as a positioning tag and communicates with multiple UWB base stations to obtain accurate distance information. The IMU unit (113) integrates multiple sensors to provide the robot's acceleration, angular velocity and magnetometer measurement values ​​in real time. When the RTK signal is interfered with or missing, combined positioning is performed with the RTK and UWB. The positioning submodule (11) includes an IMU data processing formula. The IMU data processing formula is based on the acceleration, angular velocity and magnetometer measurement values ​​obtained by the IMU unit (113). The IMU data processing formula is processed by a trapezoidal integration method to obtain the robot's position information. The calculation formula is as follows: The velocity is calculated by integrating the acceleration and using the trapezoidal integration method. The velocity update formula is: , in is The acceleration at The measured value of the direction, the sampling time interval is , assuming that in discrete time Measurements are made on Using the trapezoidal integration method, the displacement update formula is: , So as to obtain the relative displacement data , it is necessary to fuse the magnetometer and gyroscope data to estimate the heading, and use Kalman filtering for fusion to finally get the heading angle ; , State transfer equation: , Observation equation: , The projection of the magnetic field on the horizontal plane is The angle between the axes is set to , the heading angle obtained by gyroscope integration is , the state variables are set in the fusion through Kalman filter ,in is the fused heading angle, Heading angle change rate, is the process noise, is the measurement noise.

4. The outdoor robot control system based on the fusion positioning method according to claim 2 is characterized in that: The map construction submodule (12) includes a multi-line laser radar unit (121) and a binocular vision unit (122). The multi-line laser radar unit (121) is used to help the robot perceive the surrounding environment. The binocular vision unit (122) is used to capture and process stereoscopic image information to provide key data for constructing a positioning signal attenuation model map and optimizing the active switching strategy of the positioning method. The two cooperate to achieve environmental perception, obstacle recognition and map construction. In the map construction submodule (12), the data set of the environmental perception part of the positioning signal attenuation model is: , in, is an image frame provided by the binocular vision unit (122) for detecting obstacles and estimating their positions, It is point cloud data provided by multi-line laser radar, which is used to accurately measure the shape and height of obstacles. The acceleration and angular velocity data provided by the IMU are used to estimate the robot's motion state; When the map construction submodule (12) classifies obstacles, it calculates the weight of the influence on the positioning signal strength by the characteristics of obstacles and signal attenuation. The basic formula is: , in, is the obstacle classification weight, Indicates the obstacle type. represents the weight calculation function, Indicates the signal type. Is the signal type The corresponding weight coefficient is, Indicates the obstacle type For signal type Considering the three common types of obstacles in urban road environments, trees T, buildings B, and metal obstacles M, the following formula can be used to calculate the weight: , Thus, the positioning signal attenuation model is constructed: , in, is the transmitted signal strength, is in position The predicted received signal strength at is in position The predicted attenuation function at the location depends on the obstacle classification weight at that location. and signal transmission distance ; The map construction submodule (12) determines a reasonable threshold value based on the test environment and multiple tests to determine the road scene where the machine is located and select the corresponding optimal positioning method. In outdoor positioning judgment, when the outdoor received signal strength is If the position is within the threshold, the robot uses the RTK / INS combination for positioning: , In indoor positioning judgment, when the indoor receiving signal strength is If the position is within the threshold, the robot uses the tight combination of UWB / INS for positioning: , In the judgment of the indoor and outdoor transition area, when the indoor and outdoor received signals are not within the threshold, the robot uses a combination of IMU and lidar for positioning.

5. The outdoor robot control system based on the fusion positioning method according to claim 2 is characterized in that: The decision and navigation submodule (13) comprises a ROS main control unit (131) and an STM32 main control unit (132); the ROS main control unit (131) is used as an upper-layer decision center to integrate multi-source sensor data, evaluate the positioning signal strength on different paths through a positioning signal energy formula, perform path planning according to the current environment and target position, and generate navigation instructions; the STM32 main control unit (132) is used as a bottom-layer execution core to receive the navigation instructions from the ROS main control unit (131), convert them into motor control signals, drive the robot to move forward along the planned path, and monitor the robot's motion state in real time, and feed back to the ROS main control unit (131) for adjustment and optimization; in the decision and navigation submodule (13), an RTK / INS loosely coupled integrated navigation system and a UWB / INS tightly coupled integrated navigation system are included, and the state vector of the RTK / INS loosely coupled integrated navigation system is: , in, is the position error, is the speed error, is the attitude error, which can be expressed by either Euler angle error or quaternion error. is the gyro bias, is the gyroscope first-order Markov error, is the accelerometer error; the observation equation describes the relationship between the observation data and the system state, and the observation equation can be expressed as: , System observation vector of Kalman filter for: , Observation noise vector is a zero-mean Gaussian white noise vector, and the posture is expressed by Euler angles. It can be expressed as: , in, is the position difference, is the speed difference, is the attitude difference, , and They are the noise components in the position difference, velocity difference and attitude difference respectively; is the measurement matrix, and the formula is as follows: , The heating state vector of the UWB / INS tightly coupled integrated navigation system is: , in, is the position error, is the speed error, is the attitude error, which can be expressed by either Euler angle error or quaternion error. is the gyroscope bias, is the accelerometer error; The observation equation of UWB is: , The observation vector is: , Among them, the location of UWB base station is , the robot position is , is the observation noise vector; The covariance prediction and state transfer matrix formula used in the extended Kalman filter processing is: , in, yes The estimated covariance matrix at time , is the process noise covariance matrix, , it is Function about the state vector exist The Jacobian matrix at , , in, is the observation Jacobian matrix, is the observation noise covariance matrix, and finally the robot's high-precision positioning information is obtained , and can also estimate and correct the deviations of the accelerometer and gyroscope; The positioning signal energy formula is as follows: , in, Represents a collection of signal types, Is the signal type The weight coefficient is used to balance the contribution of different signal types to the energy map. is in position For signal type Obstacle type The classification weights, Is the signal type The reference signal strength; The decision and navigation submodule (13) overlaps and fuses the road obstacle map with the positioning signal attenuation model map to generate an optimal path that avoids obstacles and takes into account the positioning signal attenuation factor and navigates. The optimization function it constructs is: , in, A sequence of coordinates representing a path, and is a weight coefficient used to balance the importance of path safety and positioning accuracy. The overlap cost of the path with the obstacle map, is the cost of positioning signal attenuation on the path.

6. The outdoor robot control system based on the fusion positioning method according to claim 1 is characterized in that: The interactive module (2) comprises a real-time monitoring submodule (21) and a voice broadcast communication submodule (22). The real-time monitoring submodule (21) uses a high-definition camera to capture and monitor the road environment in which the robot is located in real time, provides on-site monitoring records, and provides real-time image information for the robot's map construction and navigation decision-making, assisting positioning and path planning. The voice broadcast communication submodule (22) is used to broadcast traffic conditions based on real-time traffic data or the robot's own perception information, and is also used to issue warning sounds or voice prompts.

7. The outdoor robot control system based on the fusion positioning method according to claim 1 is characterized in that: The execution module (3) comprises a chassis motor submodule (31), a telescopic arm submodule (32) and a warning submodule (33).

8. The outdoor robot control system based on the fusion positioning method according to claim 7 is characterized in that: The chassis motor submodule (31) comprises a first motor unit (311), a first motor controller unit (312) and a first transmission unit (313); the first motor unit (311) is used to convert electrical energy into mechanical energy to provide power for the movement of the robot; the first motor controller unit (312) is used to receive motion instructions and control the speed, steering and braking of the first motor unit (311); and the first transmission unit (313) is used to transmit the power of the first motor unit (311) to the drive wheel to move the robot.

9. The outdoor robot control system based on the fusion positioning method according to claim 7 is characterized in that: The telescopic arm submodule (32) comprises a second motor unit (321), a second motor controller unit (322), a second transmission unit (323), a telescopic arm unit (324) and a safety device unit (325); the second motor unit (321) is used to convert electrical energy into mechanical energy, and to provide power to the telescopic arm unit (324) through the second transmission unit (323); the telescopic arm unit (324) is used to form physical isolation; and the second motor controller unit (322) is used to receive motion instructions and control the rotation speed, steering and braking of the second motor unit (321).

10. The outdoor robot control system based on the fusion positioning method according to claim 7, characterized in that: The warning submodule (33) comprises a warning light unit (331), a high-decibel siren unit (332) and a control circuit unit (333); the warning light unit (331) and the high-decibel siren unit (332) emit warning signals in both visual and auditory ways under the action of the control circuit unit (333).

Citation Information

Patent Citations

  • Self-moving traffic isolation robot, system and lane isolation method thereof

    CN116356739A

  • Indoor AGV (automatic guided vehicle) navigation control method based on UWB (ultra-wide bandwidth) positioning and dead reckoning

    CN108844543A

  • RTK / UWB / IMU-based multi-unit cooperation indoor and outdoor positioning method

    CN114964221A

  • Robot positioning and navigation system and method based on fusion of multiple positioning sensors

    CN117760407A

  • Indoor and outdoor positioning system and method based on RTK, UWB and INS

    CN118089739A

Cited By

  • Power grid facility intelligent inspection system and method based on unmanned aerial vehicle and Beidou technology

    CN121028838A

  • An unmanned aerial vehicle and Beidou technology-based power grid facility intelligent inspection system and method

    CN121028838B

  • Novel AGV trolley for accurate positioning and navigation of construction site

    CN121430573A

  • Outdoor cleaning robot and positioning state evaluation and control triggering method thereof

    CN121455037A