Positioning method and system based on multi-sensor fusion
By optimizing the multi-sensor data fusion strategy, obtaining the initial environmental feature set and performing feature point extraction and hierarchical analysis in the dynamic perception range, combined with the excitation and interference compensation of dynamic interference sources, the accuracy and stability problems of the multi-sensor fusion positioning method in complex environments are solved, and efficient position calibration and system adaptability are improved.
Patent Information
- Application Number
- CN202511166088.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-08-20
- Publication Date
- 2025-10-10
- Estimated Expiration
- 2045-08-20
AI Technical Summary
Existing multi-sensor fusion positioning methods have problems with insufficient sensor data fusion accuracy, real-time performance, adaptability and robustness in complex environments. In particular, the uncertainty and noise interference of sensor data in dynamic environments affect positioning accuracy and system stability. In addition, the sensor calibration and initialization are highly complex, which limits its flexibility and universality in practical applications.
By obtaining the initial environmental feature set of the target scene, setting the dynamic perception range, extracting feature points, performing multi-sensor data collection and hierarchical analysis, generating a comprehensive positioning model, using dynamic interference sources for stimulation, drawing interference response curves and performing regional division and interference compensation, and finally performing position calibration, the sensor data fusion strategy is optimized to improve the real-time and robustness of the system.
It improves the adaptability of the positioning system in complex environments, enhances positioning accuracy and system stability, simplifies the sensor calibration process, and improves the real-time and robustness of the system.
Smart Images

Figure CN120760728A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the field of positioning and navigation technology, and specifically relates to a positioning method and system based on multi-sensor fusion. Background Art
[0002] With the rapid development of multi-sensor fusion positioning technology, positioning methods and systems based on the fusion of multiple sensor data are increasingly being used in fields such as navigation, robotics, and autonomous driving. By integrating data from different sensors, these technologies can significantly improve positioning accuracy and robustness, meeting the demand for high-precision positioning in complex scenarios. However, existing multi-sensor fusion positioning methods still have certain shortcomings in terms of sensor data fusion accuracy, real-time performance, adaptability to complex environments, and system robustness, which affect the overall performance and applicability of positioning systems.
[0003] After searching, the patent document with publication number CN106595635B discloses an AGV positioning method that integrates data from multiple positioning sensors. Its publication date is December 8, 2020. This patent achieves high-precision positioning of AGV by integrating data from three sensors: laser sensor plus reflective strip, camera identification code tape, and motor encoder feedback value. However, in this technical solution, the priority setting of sensor data depends on specific scenarios, which may lead to a decrease in positioning accuracy in dynamic or complex environments. In addition, this method has high requirements for the sensor calibration and initialization process, which increases the complexity and implementation difficulty of the system, and limits its flexibility and universality in practical applications.
[0004] Another patent document with publication number CN116295355B discloses a mapping and positioning method based on multi-sensor fusion, and its publication date is June 17, 2025. This patent realizes real-time mapping and positioning of mobile robots by combining three sensors: LocalSense, 2D lidar, and RGB camera. However, this technical solution uses block processing and convolutional autoencoder compression when processing RGB images. This process may introduce additional time delays, thereby affecting the real-time performance of the system. In addition, this method has high requirements for the synchronization of data from different sensors. In the case of inconsistent timestamps of multi-sensor data, it may lead to increased positioning errors, further weakening the robustness and reliability of the system.
[0005] The above issues indicate that existing multi-sensor fusion positioning methods still have certain deficiencies in terms of adaptability, real-time performance, data synchronization, and system robustness in complex environments. In particular, in dynamically changing environments, sensor data uncertainty, noise interference, and time synchronization issues can significantly affect positioning accuracy and system stability. Furthermore, the existing technology's heavy reliance on sensor calibration and initialization increases system complexity and implementation difficulty, limiting its widespread application in practical scenarios. Therefore, there is an urgent need for a new multi-sensor fusion-based positioning method and system to optimize sensor data fusion strategies, improve system real-time performance and robustness, and enhance its adaptability in complex environments, thereby meeting the high-precision, high-efficiency, and high-reliability requirements of modern positioning systems. Summary of the Invention
[0006] The present invention provides a positioning method and system based on multi-sensor fusion, the main purpose of which is to optimize the sensor data fusion strategy, improve the real-time and robustness of the system, and enhance its adaptability in complex environments. In order to achieve the above purpose, the present invention provides a positioning method based on multi-sensor fusion, including: obtaining an initial environmental feature set of the target scene, setting a dynamic perception range based on the initial environmental feature set, and extracting feature points in sequence within the dynamic perception range; based on the feature points, performing data collection on a pre-constructed multi-sensor integration framework to obtain a synchronous perception data set; performing hierarchical analysis on the synchronous perception data set to obtain basic position information and environmental interference information, and generating a comprehensive positioning model based on the basic position information and environmental interference information; using the comprehensive positioning model, performing preliminary position calibration on a pre-constructed positioning device to obtain a preliminary calibrated device; through a preset dynamic interference source The multi-sensor integrated framework is continuously stimulated to obtain a change interference feature set and a change response feature set; an original interference response curve is drawn based on the change interference feature set and the change response feature set, and the original interference response curve is divided into regions to obtain a stable region set and a fluctuating region set; a fluctuation factor set of the fluctuating region set is identified, and dynamic interference compensation is performed based on the fluctuation factor set and the stable region set to obtain a compensation response set; a compensation interference set corresponding to the compensation response set is identified, and a compensation interference response curve is drawn based on the compensation response set and the compensation interference set; the preliminary calibration device is finally calibrated using the compensation interference response curve to obtain a fully calibrated device.
[0007] Optionally, setting the dynamic perception range based on the initial environmental feature set includes: setting the number of perception divisions according to the initial environmental feature set; identifying the maximum environmental feature value and the minimum environmental feature value of the initial environmental feature set, and calculating the division step based on the number of perception divisions, the maximum environmental feature value and the minimum environmental feature value to obtain the perception division step, wherein the perception division step is expressed as: performing node division on the initial environmental feature set based on the perception division step to obtain the dynamic perception range.
[0008] Optionally, the generation of a comprehensive positioning model based on basic position information and environmental interference information includes: setting standard environmental conditions, and determining the target position offset based on the standard environmental conditions, basic position information and environmental interference information; using a pre-built environmental monitoring module to measure the real-time environmental parameters of the multi-sensor integration framework, setting correction weights for the real-time environmental parameters, identifying the core sensors in the multi-sensor integration framework, and determining the sensor sensitivity and sensor error range based on the core sensors; querying environmental parameter baseline values, and generating a comprehensive positioning model based on the environmental parameter baseline values, sensor sensitivity, target position offset, standard environmental conditions, real-time environmental parameters and correction weights.
[0009] Optionally, the use of the comprehensive positioning model to perform preliminary position calibration on a pre-built positioning device to obtain a preliminary calibrated device includes: calculating a position deviation set between the comprehensive positioning model and the actual position information; extracting position deviations in the position deviation set in sequence to determine whether the position deviation is greater than a preset standard deviation threshold; if the position deviation is greater than the standard deviation threshold, recording the position deviation as a compensated position deviation, identifying a core sensor error corresponding to the compensated position deviation, pairing the core sensor error and the compensated position deviation to obtain a compensated position deviation group; summarizing the compensated position deviation groups to obtain a compensated position deviation group set, and performing position deviation calibration on the positioning device according to the compensated position deviation group set to obtain a preliminary calibrated device.
[0010] Optionally, the multi-sensor integration framework is continuously stimulated by a preset dynamic interference source to obtain a changing interference feature set and a changing response feature set, including: setting an initial excitation intensity and an initial excitation duration; based on the initial excitation intensity and the initial excitation duration, the multi-sensor integration framework is stimulated by a dynamic interference source to obtain an initial perception data set; according to a preset data sampling frequency and a data sampling duration, parameters are extracted from the initial perception data set to obtain an initial interference feature set and an initial response feature set; the average interference value and the average response value of the initial interference feature set and the initial response feature set are respectively calculated, and an interference difference is calculated according to the average interference value and a preset historical interference value to determine whether the interference difference is greater than a preset interference threshold; if the interference difference is greater than the interference threshold, the historical interference value and the multi-sensor integration framework are respectively updated using the average interference value and the initial perception data set, and the dynamic interference source based on the initial excitation intensity and the initial excitation duration is returned. The invention relates to a step of stimulating a multi-sensor integration framework with a dynamic interference source; if the interference difference is not greater than the interference threshold, recording the average interference value and the average response value as the target interference value and the target response value respectively; using the target interference value and the target response value to supplement the pre-constructed initial change interference set and the initial change response set respectively, to obtain a target change interference set and a target change response set; obtaining the target sampling number of the target change interference set, and judging whether the target sampling number is greater than the preset standard sampling number; if the target sampling number is not greater than the standard sampling number, using the target change interference set and the target change response set to update the initial change interference set and the initial change response set respectively, and returning to the step of stimulating the multi-sensor integration framework with a dynamic interference source based on the initial excitation intensity and the initial excitation duration; if the target sampling number is greater than the standard sampling number, recording the target change interference set and the target change response set as the change interference feature set and the change response feature set respectively.
[0011] Optionally, the region division of the original interference response curve to obtain a stable region set and a fluctuating region set includes: artificially performing a preliminary division of the original interference response curve to obtain a preliminary divided region set; performing the following operations on each preliminary divided region in the preliminary divided region set: identifying a boundary point set of the preliminary divided region, extracting boundary points from the boundary point set in sequence, identifying adjacent boundary points of the boundary points, and calculating boundary slopes of the boundary points and the adjacent boundary points; summarizing the boundary slopes to obtain a boundary slope set, and calculating a regional fluctuation factor of the boundary slope set; judging whether the regional fluctuation factor is greater than a preset fluctuation threshold; if the regional fluctuation factor is not greater than the fluctuation threshold, recording the preliminary divided region as a stable region; if the regional fluctuation factor is greater than the fluctuation threshold, recording the preliminary divided region as a fluctuating region; summarizing the stable regions and fluctuating regions respectively to obtain a stable region set and a fluctuating region set.
[0012] Optionally, dynamic interference compensation is performed according to the fluctuation factor set and the stable area set to obtain a compensation response set, including: performing the following operations on each fluctuation factor in the fluctuation factor set: identifying the fluctuation area to be processed corresponding to the fluctuation factor; extracting the central fluctuation point of the fluctuation area to be processed, and dividing the fluctuation area to be processed based on the central fluctuation point to obtain a same-family fluctuation area set; extracting the same-family fluctuation areas in the same-family fluctuation area set in turn, identifying the same-family fluctuation point set of the same-family fluctuation area, and calculating the same-family fluctuation factor of the same-family fluctuation point set; judging whether the same-family fluctuation factor is greater than the fluctuation threshold; if the same-family fluctuation factor is not greater than the fluctuation threshold, recording the same-family fluctuation area as an equivalent stable area; if the same-family fluctuation factor is greater than the fluctuation threshold, updating the fluctuation area to be processed using the same-family fluctuation area, and returning to the step of extracting the central fluctuation point of the fluctuation area to be processed; summarizing the equivalent stable areas to obtain an equivalent stable area set, and supplementing the stable area set with the equivalent stable area set to obtain a stable area set to be compensated; performing dynamic interference compensation based on the stable area set to be compensated to obtain a compensation response set.
[0013] Optionally, the dynamic interference compensation is performed based on the stable area set to be compensated to obtain a compensation response set, including: performing the following operations on each stable area to be compensated in the stable area set to be compensated: extracting a central compensation point in the stable area to be compensated, and determining a central interference value and a central response value of the central compensation point; determining a central compensation response value based on the standard environmental conditions, the central interference value and the central response value; calculating a stable compensation coefficient based on the central compensation response value and the central response value; extracting points to be compensated in the stable area to be compensated in turn, identifying the response values to be compensated of the points to be compensated, performing dynamic interference compensation based on the response values to be compensated and the stable compensation coefficient to obtain a compensation response value; and summarizing the compensation response values to obtain a compensation response set.
[0014] Optionally, the use of the compensated interference response curve to perform final position calibration on the preliminary calibration device to obtain a fully calibrated device includes: determining a control center of the preliminary calibration device, wherein the control center is an embedded control system; using the compensated interference response curve to input data into the control center to obtain a compensated control center, and connecting the compensated control center and the preliminary calibration device to obtain a fully calibrated device.
[0015] To achieve the above object, the application further provides a positioning system based on multi-sensor fusion, comprising: a perception data acquisition module, configured to acquire an initial environment feature set of a target scene, set a dynamic perception range based on the initial environment feature set, extract feature points in the dynamic perception range in sequence, acquire data of a pre-constructed multi-sensor integrated framework based on the feature points, and obtain a synchronous perception data set; a preliminary calibration module, configured to perform layered analysis on the synchronous perception data set to obtain basic position information and environment interference information, generate a comprehensive positioning model based on the basic position information and the environment interference information, perform preliminary position calibration on a pre-constructed positioning device by using the comprehensive positioning model, and obtain a preliminary calibration device; an interference response drawing module, configured to continuously stimulate the multi-sensor integrated framework by a pre-set dynamic interference source, obtain a change interference feature set and a change response feature set, draw an original interference response curve based on the change interference feature set and the change response feature set, divide the original interference response curve into regions to obtain a stable region set and a fluctuation region set, identify a fluctuation factor set of the fluctuation region set, perform dynamic interference compensation based on the fluctuation factor set and the stable region set, and obtain a compensation response set; and a final calibration module, configured to identify a compensation interference set corresponding to the compensation response set, draw a compensation interference response curve based on the compensation response set and the compensation interference set, perform final position calibration on the preliminary calibration device by using the compensation interference response curve, and obtain a completely calibrated device.
[0016] To solve the above problems, the application further provides an electronic device, comprising: a memory storing at least one instruction; and a processor executing the instruction stored in the memory to implement the positioning method based on multi-sensor fusion.
[0017] To solve the above problems, the application further provides a computer readable storage medium, wherein the computer readable storage medium stores at least one instruction, and the at least one instruction is executed by a processor in an electronic device to implement the positioning method based on multi-sensor fusion.
[0018] The present invention solves the problems described in the background technology by obtaining an initial environmental feature set of the target scene and setting a dynamic perception range based on the initial environmental feature set. Feature points are extracted in sequence within the dynamic perception range, which determines the environmental feature range that needs to be monitored and ensures that the environmental data within the range can be accurately collected and analyzed. Then, data is collected on the multi-sensor integration framework based on the feature points to obtain a synchronous perception data set, which creates a synchronous perception environment and helps to perform accurate data analysis. The synchronous perception data set is then hierarchically analyzed to obtain basic position information and environmental interference information, and based on the basic position information and environmental interference information, a comprehensive positioning model is generated to complete the construction of the comprehensive positioning model, which provides a basis for subsequent position calibration. The comprehensive positioning model is used to perform preliminary position calibration on the positioning device to obtain a preliminary calibration device. In this step, the comprehensive positioning model is used to calibrate the positioning device to compensate for possible position deviations. By continuously stimulating the multi-sensor integration framework with a dynamic interference source, a change interference feature set and a change response feature set are obtained. According to the change interference feature set and the change response feature set, an original interference response curve is drawn, which makes the relationship between the change interference and the change response intuitively represented, thereby improving the calibration efficiency. Efficiency, at the same time, due to the continuity of the curve, as long as the change interference and the change response are on the original interference response curve and satisfy the linear relationship of a certain line segment, even if the change interference and the change response are not directly measured, subsequent interference compensation can be performed, which greatly enhances the adaptability of the positioning system. Then, the original interference response curve is divided into regions to obtain a stable region set and a fluctuating region set. By dividing the stable region set and the fluctuating region set, different change interferences and change responses can be calibrated separately, thereby improving the accuracy and efficiency of calibration. Further, the fluctuation factor set of the fluctuation region set is identified, and according to the fluctuation factor set, the fluctuation factor set is used to calibrate the change interference and change response separately. and stable area set, dynamic interference compensation is performed to obtain a compensation response set. This step completes the dynamic compensation for different interferences. By identifying the compensation interference set corresponding to the compensation response set, and drawing the compensation interference response curve based on the compensation response set and the compensation interference set, the drawing of the compensation interference response curve makes the interference compensation that needs to be performed more intuitive. At the same time, the response value that needs to be compensated for different interferences can also be quickly located in the form of a curve, which improves the efficiency of the entire calibration. Finally, the final position calibration of the preliminary calibration device is performed using the compensation interference response curve to obtain a fully calibrated device, completing the calibration of the positioning device. Therefore, the present invention can optimize the sensor data fusion strategy, improve the real-time and robustness of the system, and enhance its adaptability in complex environments. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] Figure 1 A flowchart of a positioning method based on multi-sensor fusion provided by an embodiment of the present invention;
[0020] Figure 2 A functional module diagram of a positioning system based on multi-sensor fusion provided by one embodiment of the present invention;
[0021] Figure 3 A schematic structural diagram of an electronic device for implementing the multi-sensor fusion-based positioning method provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0022] The present invention provides a positioning method and system based on multi-sensor fusion, the core of which is to improve the real-time performance and robustness of the system and enhance its adaptability in complex environments by optimizing the multi-sensor data fusion strategy. Figure 1 To the attached Figure 3 Specific embodiments of the present invention are described in detail.
[0023] First, in practical applications, obtaining the initial environmental feature set of the target scene is the basic step of the entire positioning method. Figure 1 As shown in the figure, this process is completed by the perception data acquisition module, which includes a set of high-precision sensors such as lidar, cameras, and inertial measurement units (IMUs) for preliminary scanning and feature extraction of the target scene. Assuming the target scene is an indoor warehouse, the initial environmental feature set may include spatial distribution information of static objects such as walls, shelves, and floors, as well as dynamic environmental parameters such as temperature and humidity. To ensure the accuracy of subsequent data collection, it is necessary to set the dynamic perception range based on the initial environmental feature set. Specifically, by identifying the maximum and minimum environmental feature values in the initial environmental feature set and combining them with the preset number of perception partitions, the perception partition step size is calculated. The formula is as follows: Perception partition step size = (maximum environmental feature value - minimum environmental feature value) / number of perception partitions. Then, the initial environmental feature set is partitioned into nodes based on the perception partition step size to obtain the dynamic perception range. For example, if the maximum environmental characteristic value is 50 meters, the minimum environmental characteristic value is 10 meters, and the number of sensing segments is 8, then the sensing segment step size is 5 meters, and the dynamic sensing range is divided into 8 intervals: [10, 15), [15, 20), ..., [45, 50]. These intervals define the areas where the sensor needs to focus, thereby improving the targetedness of data collection.
[0024] Next, feature points are extracted sequentially within the dynamic perception range, which is a key step in generating a synchronous perception dataset. Figure 1As shown in the figure, feature point extraction is performed by the perception data acquisition module. The specific process involves scanning each sub-area within the dynamic perception range using a multi-sensor integration framework. Taking lidar as an example, it determines the distance and angle of the target object by emitting a laser beam and receiving the reflected signal, thereby generating a series of three-dimensional coordinate points. These points are called feature points and together constitute the synchronized perception dataset. The generation of synchronized perception datasets relies on a multi-sensor time synchronization mechanism, that is, all sensors collect data at the same timestamp to ensure data consistency and reliability. For example, when the lidar scans the edge of a shelf, the camera simultaneously captures an image of that edge, and the IMU records the device's posture changes. This data is integrated to form the synchronized perception dataset, providing the basis for subsequent analysis.
[0025] Subsequently, the synchronous sensing data set is analyzed hierarchically to obtain basic location information and environmental interference information. Figure 1 As shown in the figure, this process is completed by the preliminary calibration module. The core idea of hierarchical parsing is to decompose the synchronous perception dataset into multiple levels, each level corresponding to a different data type or feature. For example, the first level may contain distance information, the second level contains angle information, and the third level contains interference information such as environmental noise. The extraction of basic position information mainly relies on geometric algorithms, such as triangulation or least squares method. Taking triangulation as an example, assuming that the positions of three fixed reference points are known to be (x1, y1), (x2, y2), and (x3, y3), and the distances to these three reference points are measured by the synchronous perception dataset as d1, d2, and d3, respectively, then the target position (x, y) can be calculated by the following formula: (x-x1) 2 +(y-y1) 2 =d1 2 ;(x-x2) 2 +(y-y2) 2 =d2 2 ;(x-x3) 2 +(y-y3) 2 =d3 2 . By solving this set of equations, the precise coordinates of the target position can be obtained. At the same time, the extraction of environmental interference information depends on statistical analysis methods, such as mean filtering or Kalman filtering. Taking Kalman filtering as an example, its state update equation is: X(k|k)=X(k|k-1)+K(k)·(Z(k)-H·X(k|k-1)), where X(k|k-1) is the predicted state, K(k) is the Kalman gain, Z(k) is the observation value, and H is the observation matrix. Through continuous iteration, noise can be effectively removed and the real environmental interference information can be extracted.
[0026] Generating a comprehensive positioning model based on basic location information and environmental interference information is one of the core links of the entire positioning method. Figure 1 As shown, this process is still completed by the preliminary calibration module. The generation of the comprehensive positioning model needs to consider multiple factors, including standard environmental conditions, real-time environmental parameters, sensor sensitivity and error range. Specifically, first set the standard environmental conditions, such as temperature of 25°C, humidity of 50%, and air pressure of 1013.25hPa. Then, based on the standard environmental conditions, basic position information and environmental interference information, determine the target position offset. The calculation formula for the target position offset is: ΔP = P real -P standard , where P real is the actual measured value of the target position, P standard is the standard value of the target position. Next, the pre-built environmental monitoring module is used to measure the real-time environmental parameters of the multi-sensor integration framework, and the correction weights of the real-time environmental parameters are set. For example, if the current temperature is 30°C and the humidity is 60%, the correction weight may be 1.2. In addition, it is necessary to identify the core sensor in the multi-sensor integration framework and determine the sensor sensitivity and error range based on the core sensor. For example, the core sensor may be a lidar with a sensitivity of 0.01 meters and an error range of ±0.05 meters. Finally, the environmental parameter baseline value is queried, and a comprehensive positioning model is generated based on the environmental parameter baseline value, sensor sensitivity, target position offset, standard environmental conditions, real-time environmental parameters and correction weights. The form of the comprehensive positioning model can be expressed as: P final =P initial +ΔP*W correction , where P final is the final position, P initial is the initial position, W correction To correct the weight.
[0027] Using the comprehensive positioning model to perform preliminary position calibration on the positioning equipment and obtaining the preliminary calibration equipment is the next key step. Figure 1 As shown in Figure 1, this process is completed by the preliminary calibration module. The core of the preliminary position calibration is to calculate the position deviation set between the comprehensive positioning model and the actual position information and compensate for the position deviation. Specifically, the position deviation set between the comprehensive positioning model and the actual position information is first calculated. The calculation formula of the position deviation is: ΔD = P model -P actual , where P model is the position predicted by the comprehensive positioning model, P actuall is the actual measured position. Then, the position deviations are extracted in sequence from the position deviation set, and it is determined whether the position deviation is greater than the preset standard deviation threshold. For example, if the standard deviation threshold is 0.1 meter and a certain position deviation is 0.15 meter, then the position deviation is recorded as the compensated position deviation. Next, the core sensor error corresponding to the compensated position deviation is identified, and the core sensor error and the compensated position deviation are paired to obtain a compensated position deviation group. For example, if the compensated position deviation is 0.15 meter and the core sensor error is 0.05 meter, then the compensated position deviation group is (0.15, 0.05). Finally, all compensated position deviation groups are summarized to obtain a compensated position deviation group set, and the positioning device is calibrated for position deviation based on the compensated position deviation group set to obtain a preliminary calibrated device.
[0028] By continuously stimulating the multi-sensor integrated framework through preset dynamic interference sources, obtaining the changing interference feature set and the changing response feature set is an important means to further improve positioning accuracy. Figure 1 As shown in Figure 1, this process is completed by the interference response mapping module. Dynamic interference sources can be artificially introduced vibrations, electromagnetic interference, or other external disturbances. First, the initial excitation intensity and initial excitation duration are set. For example, the initial excitation intensity is 5N and the initial excitation duration is 10 seconds. Then, based on the initial excitation intensity and initial excitation duration, the multi-sensor integration framework is stimulated by the dynamic interference source to obtain an initial perception data set. For example, when vibration interference is applied to a sensor, the sensor will record the vibration frequency, amplitude, and other related parameters. Next, based on the preset data sampling frequency and data sampling duration, the initial perception data set is parameter extracted to obtain the initial interference feature set and the initial response feature set. For example, if the data sampling frequency is 100Hz and the data sampling duration is 5 seconds, the initial interference feature set may contain interference data from 500 sampling points, and the initial response feature set contains the corresponding sensor response data. Subsequently, the average interference value and average response value of the initial interference feature set and the initial response feature set are calculated, respectively, and the interference difference is calculated based on the average interference value and the preset historical interference value. The calculation formula for the interference difference is: ΔI = I average -I history , where I average is the average interference value, I historyis the historical interference value. If the interference difference is greater than the preset interference threshold, the historical interference value and the multi-sensor integration framework are updated using the average interference value and the initial perception data set, and the above excitation process is repeated. If the interference difference is not greater than the interference threshold, the average interference value and the average response value are recorded as the target interference value and the target response value, respectively. Finally, the target interference value and the target response value are used to supplement the pre-constructed initial change interference set and the initial change response set, respectively, to obtain the target change interference set and the target change response set. If the target sampling number of the target change interference set is greater than the preset standard sampling number, the target change interference set and the target change response set are recorded as the change interference feature set and the change response feature set, respectively.
[0029] According to the change interference feature set and the change response feature set, the original interference response curve is drawn, and the original interference response curve is divided into regions to obtain the stable region set and the fluctuating region set, which is one of the key steps to achieve accurate calibration. Figure 1 As shown in Figure 2, this process is completed by the interference response drawing module. The original interference response curve is drawn using an interpolation algorithm, such as linear interpolation or cubic spline interpolation. Taking linear interpolation as an example, assuming that the interference feature set is {I1, I2, ..., I n}, the change response feature set is {R1,R2,...,R n}, then any point (I, R) on the original interference response curve can be calculated using the following formula:
[0030]
[0031] Where I1≤I≤I2. After the drawing is completed, the original interference response curve is artificially preliminarily divided to obtain a set of preliminarily divided regions. For example, the curve is divided into 10 preliminarily divided regions. Then, the following operations are performed on each preliminarily divided region: the boundary point set of the preliminarily divided region is identified, the boundary points are sequentially extracted from the boundary point set, and the adjacent boundary points of the boundary points are identified. For example, assuming that the boundary points of a preliminarily divided region are A and B, the adjacent boundary points are A' and B'. The boundary slopes of the boundary points and the adjacent boundary points are calculated. The boundary slope calculation formula is:
[0032]
[0033] where R A and R B are the response values of boundary points A and B, I A and I B are the interference values of boundary points A and B respectively. Summarize all boundary slopes to obtain the boundary slope set, and calculate the regional fluctuation factor of the boundary slope set. The calculation formula of the regional fluctuation factor is: F = max(S set )-min(Sset ), where S set is the boundary slope set. If the regional fluctuation factor is not greater than the preset fluctuation threshold, the preliminary divided region is recorded as a stable region; otherwise, it is recorded as a fluctuating region. Finally, the stable regions and fluctuating regions are summarized to obtain the stable region set and the fluctuating region set.
[0034] Identifying the fluctuation factor set of the fluctuation region set and performing dynamic interference compensation based on the fluctuation factor set and the stable region set to obtain the compensation response set is an important step in further optimizing the calibration effect. Figure 1 As shown in Figure 1, this process is completed by the interference response drawing module. First, the following operations are performed on each fluctuation factor in the fluctuation factor set: the fluctuation area to be processed corresponding to the fluctuation factor is identified, and the central fluctuation point of the fluctuation area to be processed is extracted. For example, assuming that the central fluctuation point of a certain fluctuation area is C, the fluctuation area to be processed is divided with C as the center to obtain a set of homogeneous fluctuation areas. Then, the homogeneous fluctuation areas are extracted in sequence from the homogeneous fluctuation area set, and the homogeneous fluctuation point set of the homogeneous fluctuation area is identified. For example, assuming that the homogeneous fluctuation point set of a certain homogeneous fluctuation area is {C1, C2, ..., C m}, then calculate the same family fluctuation factor of the same family fluctuation point set. The calculation formula of the same family fluctuation factor is:
[0035]
[0036] in is the boundary slope set of the same family fluctuation point set. If the same family fluctuation factor is not greater than the fluctuation threshold, the same family fluctuation area is recorded as an equivalent stable area; otherwise, the same family fluctuation area is used to update the fluctuation area to be processed, and the above segmentation process is repeated. Finally, all equivalent stable areas are summarized to obtain an equivalent stable area set, and the equivalent stable area set is used to supplement the stable area set to obtain a stable area set to be compensated. Based on the stable area set to be compensated, dynamic interference compensation is performed to obtain a compensation response set. Specifically, the following operations are performed for each stable area to be compensated: the central compensation point is extracted in the stable area to be compensated, and the central interference value and central response value of the central compensation point are determined. For example, assuming that the central interference value of a central compensation point is I center , the central response value is R center , then determine the center compensation response value based on the standard environmental conditions, center interference value and center response value. The calculation formula of the center compensation response value is: R comp =R center +(I center -I standard )·K adjust , where I standardis the standard interference value, K_adjust is the adjustment coefficient. Then, based on the center compensation response value and the center response value, the stability compensation coefficient is calculated. The calculation formula of the stability compensation coefficient is: K stable =R comp / R center Then, the points to be compensated are sequentially extracted from the stable region to be compensated, and the response values to be compensated of the points to be compensated are identified. For example, assuming that the response value to be compensated of a certain point to be compensated is R target , then according to the response value to be compensated and the stable compensation coefficient, dynamic interference compensation is performed to obtain the compensation response value. The calculation formula of the compensation response value is: R final =R target ·K stable Finally, all compensation response values are summed up to obtain the compensation response set.
[0037] Identifying the compensation interference set corresponding to the compensation response set and drawing the compensation interference response curve based on the compensation response set and the compensation interference set are important steps to achieve the final calibration. Figure 1 As shown in Figure 2, this process is completed by the final calibration module. The interpolation algorithm is also used to draw the compensation interference response curve, such as linear interpolation or cubic spline interpolation. Taking linear interpolation as an example, assuming that the compensation response set is {R c1 ,R c2 ,...,R cn}, the compensation interference set is {I c1 ,I c2 ,...,I cn}, then any point (I, R) on the compensation interference response curve can be calculated using the following formula:
[0038]
[0039] Among them I c1 ≤I≤I c2 After the drawing is completed, the compensation interference response curve is used to perform the final position calibration on the preliminary calibration device to obtain a fully calibrated device. Specifically, the control center of the preliminary calibration device is first determined, where the control center is the embedded control system. Then, the compensation interference response curve is used to input data into the control center to obtain the compensated control center. For example, assuming that a point on the compensation interference response curve is (I comp ,R comp ), then R comp The compensation value is input to the control center. Finally, the compensation control center and the preliminary calibration device are connected to obtain a fully calibrated device.
[0040] As attached Figure 2As shown, the present invention also provides a positioning system based on multi-sensor fusion, comprising a perception data acquisition module, a preliminary calibration module, an interference response mapping module, and a final calibration module. The perception data acquisition module is responsible for acquiring an initial environmental feature set of the target scene, setting a dynamic perception range based on the initial environmental feature set, sequentially extracting feature points within the dynamic perception range, and performing data acquisition on the multi-sensor integrated framework based on the feature points to obtain a synchronized perception data set. The preliminary calibration module is responsible for performing hierarchical analysis on the synchronized perception data set to obtain basic location information and environmental interference information, generating a comprehensive positioning model based on the basic location information and environmental interference information, and performing preliminary location calibration on the positioning device using the comprehensive positioning model to obtain a preliminary calibrated device. The interference response mapping module is responsible for continuously stimulating the multi-sensor integrated framework with a preset dynamic interference source to obtain a variable interference feature set and a variable response feature set. Based on the variable interference feature set and the variable response feature set, the module draws an original interference response curve. The original interference response curve is then divided into regions to obtain a stable region set and a fluctuating region set. The fluctuation factor set of the fluctuating region set is identified, and dynamic interference compensation is performed based on the fluctuation factor set and the stable region set to obtain a compensated response set. The final calibration module is responsible for identifying the compensation interference set corresponding to the compensation response set, and drawing the compensation interference response curve based on the compensation response set and the compensation interference set. The compensation interference response curve is used to perform the final position calibration on the preliminary calibration device to obtain a fully calibrated device.
[0041] As attached Figure 3 The present invention also provides an electronic device comprising a memory and a processor. The memory is configured to store at least one instruction, and the processor is configured to execute the instruction stored in the memory to implement the aforementioned positioning method based on multi-sensor fusion. Furthermore, the present invention also provides a computer-readable storage medium storing at least one instruction, which is executed by the processor in the electronic device to implement the aforementioned positioning method based on multi-sensor fusion.
[0042] In summary, the present invention obtains an initial environmental feature set of the target scene, sets a dynamic sensing range based on the initial environmental feature set, and sequentially extracts feature points within the dynamic sensing range. This determines the range of environmental features to be monitored and ensures accurate collection and analysis of environmental data within this range. Next, data is collected from a multi-sensor integrated framework based on the feature points to obtain a synchronized sensing dataset, creating a synchronized sensing environment that facilitates accurate data analysis. The synchronized sensing dataset is then hierarchically parsed to obtain basic location information and environmental interference information. A comprehensive positioning model is generated based on the basic location information and environmental interference information, completing the construction of the comprehensive positioning model and providing a basis for subsequent position calibration. The comprehensive positioning model is used to perform preliminary position calibration on the positioning device, obtaining a preliminary calibration device. This step uses the comprehensive positioning model to calibrate the positioning device to compensate for any possible position deviations. By continuously stimulating the multi-sensor integrated framework with a dynamic interference source, a variable interference feature set and a variable response feature set are obtained. Based on the variable interference feature set and the variable response feature set, an original interference response curve is plotted. This provides an intuitive representation of the relationship between variable interference and variable response, improving calibration efficiency. At the same time, due to the continuity of the curve, as long as the variable interference and the variable response are on the original interference response curve and satisfy the linear relationship of a certain line segment, subsequent interference compensation can be performed even if the variable interference and the variable response are not directly measured, which greatly enhances the adaptability of the positioning system. Next, the original interference response curve is divided into regions to obtain a stable region set and a fluctuating region set. By dividing the stable region set and the fluctuating region set, different variable interferences and variable responses can be calibrated separately, improving the calibration accuracy and efficiency. Furthermore, the fluctuation factor set of the fluctuating region set is identified, and dynamic interference compensation is performed based on the fluctuation factor set and the stable region set to obtain a compensation response set. This step completes the dynamic compensation for different interferences. By identifying the compensation interference set corresponding to the compensation response set and plotting the compensation interference response curve based on the compensation response set and the compensation interference set, the plotting of the compensation interference response curve makes the required interference compensation more intuitive. At the same time, the curve format can also quickly locate the response value that needs to be compensated for different interferences, which improves the efficiency of the entire calibration. Finally, the compensated interference response curve is used to perform final position calibration on the preliminary calibration device, obtaining a fully calibrated device and completing the calibration of the positioning device. Therefore, the present invention can optimize the sensor data fusion strategy, improve the real-time performance and robustness of the system, and enhance its adaptability in complex environments.
Claims
1. A positioning method based on multi-sensor fusion, characterized in that: The method comprises: Acquire an initial environmental feature set of the target scene, set a dynamic perception range based on the initial environmental feature set, and sequentially extract feature points within the dynamic perception range; According to the feature points, a pre-built multi-sensor integration framework is used to collect data to obtain a synchronous perception data set; Performing hierarchical analysis on the synchronous sensing data set to obtain basic location information and environmental interference information, and generating a comprehensive positioning model based on the basic location information and environmental interference information; Using the comprehensive positioning model, performing preliminary position calibration on a pre-built positioning device to obtain a preliminary calibrated device; The multi-sensor integration framework is continuously stimulated by a preset dynamic interference source to obtain a change interference feature set and a change response feature set; According to the change interference feature set and the change response feature set, an original interference response curve is drawn, and the original interference response curve is divided into regions to obtain a stable region set and a fluctuating region set; Identifying a fluctuation factor set of the fluctuation region set, performing dynamic interference compensation based on the fluctuation factor set and the stable region set, and obtaining a compensation response set; Identifying a compensation interference set corresponding to the compensation response set, and drawing a compensation interference response curve based on the compensation response set and the compensation interference set; The compensated interference response curve is used to perform final position calibration on the preliminary calibration device to obtain a fully calibrated device.
2. The positioning method based on multi-sensor fusion according to claim 1, characterized in that: The step of setting a dynamic perception range based on the initial environmental feature set includes: According to the initial environmental feature set, setting the number of perception divisions; Identifying the maximum environmental feature value and the minimum environmental feature value of the initial environmental feature set, and calculating a partition step size based on the number of perception partitions, the maximum environmental feature value, and the minimum environmental feature value to obtain a perception partition step size; Based on the perception division step, the initial environmental feature set is divided into nodes to obtain a dynamic perception range.
3. The positioning method based on multi-sensor fusion according to claim 1, characterized in that: The generating of a comprehensive positioning model based on basic position information and environmental interference information includes: Setting standard environmental conditions, and determining a target position offset based on the standard environmental conditions, basic position information, and environmental interference information; Using a pre-built environmental monitoring module to measure real-time environmental parameters of the multi-sensor integrated framework, setting correction weights for the real-time environmental parameters, identifying core sensors within the multi-sensor integrated framework, and determining sensor sensitivity and sensor error range based on the core sensors; The environmental parameter reference value is queried, and a comprehensive positioning model is generated according to the environmental parameter reference value, sensor sensitivity, target position offset, standard environmental conditions, real-time environmental parameters and correction weights.
4. The positioning method based on multi-sensor fusion according to claim 1, characterized in that: The method of using the comprehensive positioning model to perform preliminary position calibration on a pre-built positioning device to obtain a preliminary calibrated device includes: Calculate the position deviation set between the comprehensive positioning model and the actual position information; Extracting position deviations in sequence from the position deviation set, and determining whether the position deviations are greater than a preset standard deviation threshold; If the position deviation is greater than the standard deviation threshold, the position deviation is recorded as a compensated position deviation, a core sensor error corresponding to the compensated position deviation is identified, and the core sensor error and the compensated position deviation are paired to obtain a compensated position deviation group; The compensated position deviation groups are summarized to obtain a compensated position deviation group set, and the position deviation of the positioning device is calibrated according to the compensated position deviation group set to obtain a preliminarily calibrated device.
5. The positioning method based on multi-sensor fusion according to claim 1, characterized in that: The multi-sensor integration framework is continuously stimulated by a preset dynamic interference source to obtain a change interference feature set and a change response feature set, including: Set the initial incentive intensity and initial incentive duration; Based on the initial excitation intensity and initial excitation duration, a dynamic interference source is used to excite the multi-sensor integration framework to obtain an initial perception data set; Extracting parameters from the initial perception data set according to a preset data sampling frequency and data sampling duration to obtain an initial interference feature set and an initial response feature set; Calculating the average interference value and the average response value of the initial interference feature set and the initial response feature set respectively, calculating the interference difference according to the average interference value and the preset historical interference value, and determining whether the interference difference is greater than a preset interference threshold; If the interference difference is greater than the interference threshold, the historical interference value and the multi-sensor integration framework are updated respectively using the average interference value and the initial perception data set, and the step of stimulating the multi-sensor integration framework using the dynamic interference source based on the initial excitation intensity and the initial excitation duration is returned; If the interference difference is not greater than the interference threshold, the average interference value and the average response value are recorded as the target interference value and the target response value respectively; Using the target interference value and the target response value to supplement the pre-constructed initial change interference set and the initial change response set respectively, to obtain a target change interference set and a target change response set; Obtaining a target sampling number of the target change interference set, and determining whether the target sampling number is greater than a preset standard sampling number; If the target sampling number is not greater than the standard sampling number, the initial change interference set and the initial change response set are updated respectively using the target change interference set and the target change response set, and the step of stimulating the multi-sensor integration framework using the dynamic interference source based on the initial excitation intensity and the initial excitation duration is returned; If the target sampling number is greater than the standard sampling number, the target change interference set and the target change response set are recorded as a change interference feature set and a change response feature set, respectively.
6. The positioning method based on multi-sensor fusion according to claim 1, characterized in that: The original interference response curve is divided into regions to obtain a stable region set and a fluctuating region set, including: Performing preliminary artificial division on the original interference response curve to obtain a preliminary division area set; The following operations are performed on each of the preliminary divided areas in the preliminary divided area set: Identifying a set of boundary points of the preliminarily divided area, extracting boundary points from the set of boundary points in sequence, identifying adjacent boundary points of the boundary points, and calculating boundary slopes of the boundary points and the adjacent boundary points; Summarizing the boundary slopes to obtain a boundary slope set, and calculating the regional fluctuation factor of the boundary slope set; Determining whether the regional fluctuation factor is greater than a preset fluctuation threshold; If the regional fluctuation factor is not greater than the fluctuation threshold, the preliminary divided area is recorded as a stable area; If the regional fluctuation factor is greater than the fluctuation threshold, the preliminary divided area is recorded as a fluctuation area; The stable regions and the fluctuating regions are respectively summarized to obtain a stable region set and a fluctuating region set.
7. The positioning method based on multi-sensor fusion according to claim 1, characterized in that: The dynamic interference compensation is performed according to the fluctuation factor set and the stable region set to obtain a compensation response set, including: The following operations are performed on each fluctuation factor in the fluctuation factor set: Identifying a fluctuation region to be processed corresponding to the fluctuation factor; Extracting the central fluctuation point of the fluctuation area to be processed, and segmenting the fluctuation area to be processed based on the central fluctuation point to obtain a set of fluctuation areas of the same family; sequentially extracting the same family of fluctuation regions from the same family of fluctuation region set, identifying the same family of fluctuation point sets of the same family of fluctuation regions, and calculating the same family of fluctuation factors of the same family of fluctuation point sets; Determining whether the same family fluctuation factor is greater than the fluctuation threshold; If the same family fluctuation factor is not greater than the fluctuation threshold, the same family fluctuation region is recorded as an equivalent stable region; If the same family fluctuation factor is greater than the fluctuation threshold, the fluctuation area to be processed is updated using the same family fluctuation area, and the process returns to the step of extracting the central fluctuation point of the fluctuation area to be processed; Summarizing the equivalent stable regions to obtain an equivalent stable region set, and using the equivalent stable region set to supplement the stable region set to obtain a stable region set to be compensated; Based on the set of stable regions to be compensated, dynamic interference compensation is performed to obtain a set of compensation responses.
8. The positioning method based on multi-sensor fusion according to claim 7, characterized in that: The performing dynamic interference compensation based on the stable region set to be compensated to obtain a compensation response set includes: The following operations are performed on each stable area to be compensated in the stable area set to be compensated: Extracting a central compensation point in the stable area to be compensated, and determining a central interference value and a central response value of the central compensation point; Determining a central compensation response value according to the standard environmental conditions, the central interference value, and the central response value; Calculating a stability compensation coefficient based on the center compensation response value and the center response value; sequentially extracting points to be compensated in the stable area to be compensated, identifying response values to be compensated of the points to be compensated, and performing dynamic interference compensation according to the response values to be compensated and stable compensation coefficients to obtain compensation response values; The compensation response values are aggregated to obtain a compensation response set.
9. The positioning method based on multi-sensor fusion according to claim 1, characterized in that: The method of performing final position calibration on the preliminary calibration device using the compensated interference response curve to obtain a fully calibrated device includes: Determining a control center of the preliminary calibration device, wherein the control center is an embedded control system; The compensation interference response curve is used to input data into the control center to obtain a compensation control center, and the compensation control center is connected to a preliminary calibration device to obtain a fully calibrated device.
10. A positioning system based on multi-sensor fusion, characterized in that: The system comprises: A perception data acquisition module is used to obtain an initial environmental feature set of the target scene, set a dynamic perception range based on the initial environmental feature set, sequentially extract feature points within the dynamic perception range, and perform data acquisition on a pre-built multi-sensor integration framework based on the feature points to obtain a synchronized perception data set; a preliminary calibration module, configured to perform hierarchical analysis on the synchronous sensing data set to obtain basic position information and environmental interference information, generate a comprehensive positioning model based on the basic position information and environmental interference information, and perform preliminary position calibration on a pre-built positioning device using the comprehensive positioning model to obtain a preliminary calibrated device; an interference response drawing module, configured to continuously stimulate the multi-sensor integrated framework through a preset dynamic interference source to obtain a changing interference feature set and a changing response feature set, draw an original interference response curve based on the changing interference feature set and the changing response feature set, divide the original interference response curve into regions to obtain a stable region set and a fluctuating region set, identify a fluctuation factor set of the fluctuating region set, perform dynamic interference compensation based on the fluctuation factor set and the stable region set, and obtain a compensation response set; The final calibration module is used to identify the compensation interference set corresponding to the compensation response set, draw a compensation interference response curve based on the compensation response set and the compensation interference set, and use the compensation interference response curve to perform final position calibration on the preliminary calibration device to obtain a fully calibrated device.
Citation Information
Patent Citations
AGV positioning method that integrates data from multiple positioning sensors
CN106595635B
Mapping and Localization Method Based on Multi-Sensor Fusion
CN116295355B
Indoor and outdoor positioning method based on multi-sensor fusion algorithm
CN118392151A
Multi-sensor fusion locator positioning method
CN119743831A
Electromagnetic interference positioning method and device, equipment and storage medium
CN119827875A
