Humanoid robot navigation method, device and equipment based on defect complementation
By complementing the defects of multiple sensors and constructing a reverse navigation field, the problems of navigation reliability and accuracy caused by sensor performance degradation are solved, realizing high-precision autonomous navigation in complex environments. It is highly adaptable and can safely and stably complete navigation tasks.
Patent Information
- Application Number
- CN202511713605.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-11-21
- Publication Date
- 2025-12-19
- Estimated Expiration
- 2045-11-21
AI Technical Summary
When the performance of sensors degrades in complex environments, existing robot navigation technologies struggle to fully utilize environmental features, leading to a decrease in navigation reliability and accuracy. This is especially true in special environments such as transparent partitions and mirrored walls, where it is difficult to ensure the continuous and stable operation of the system.
By employing a humanoid robot navigation method that leverages defect complementarity, multi-sensor defect feature maps and confidence-decreasing verification, navigation gain parameters are generated. A reverse navigation field and path phase transition rules are constructed to achieve sensor performance complementarity and in-depth mining of back-side information in the data, thereby generating an adaptive navigation sequence.
It improves the navigation reliability and accuracy of humanoid robots in complex environments, enabling them to navigate safely and stably in narrow passages, carpet seams, and other areas, adapting to changes in environmental complexity and ensuring the efficient completion of navigation tasks.
Smart Images

Figure CN121163530A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of robot navigation control, in particular to a humanoid robot navigation method, device and equipment based on defect complementation. BACKGROUND
[0002] With the rapid development of artificial intelligence and robot technology, the application demand of humanoid robots in the fields of service, medical treatment, security and the like is increasing day by day. In actual application, the humanoid robot needs to perform autonomous mobile tasks in complex indoor environments such as office buildings, commercial places, hospital corridors and the like, which puts forward very high requirements on its environment perception and path planning capability. Modern humanoid robots usually adopt a multi-modal perception system to integrate an RGB-D camera, a laser range finder, a gyroscope accelerometer and the like to obtain environment information, but the performance of various sensing devices under different environmental conditions has obvious differences.
[0003] The current mainstream robot navigation technology is mainly based on direct fusion processing of sensor data, and integrates multi-source perception information through filtering algorithms and probability estimation methods. However, when dealing with sensor performance degradation, this kind of method often adopts data rejection or weight reduction strategy, and fails to fully utilize the environment feature information contained behind the performance degradation. In real environments with drastic changes in light, complex material reflection characteristics and frequent interference of dynamic objects, the phenomenon of sensor performance degradation is common, and the limitations of traditional fusion methods are increasingly prominent. Especially under the influence of special environmental elements such as transparent partitions, mirror walls and carpet joints, the navigation strategy simply relying on high-quality sensing data is difficult to ensure the continuous and stable operation of the system. Therefore, it is urgent to improve the navigation reliability of humanoid robots in complex environments. SUMMARY
[0004] The present application provides a humanoid robot navigation method, device and equipment based on defect complementation, aiming to deeply mine the complementary characteristics of multi-sensor defects, convert the sensor defects in the traditional sense into valuable navigation information sources, construct a reverse navigation field and a path phase change rule, realize high-precision and high-reliability autonomous navigation control of humanoid robots in complex environments, and provide technical support for the wide application of humanoid robots in complex indoor scenes such as office buildings, commercial places and home environments.
[0005] The present application provides a humanoid robot navigation method, device and equipment based on defect complementation, aiming to deeply mine the complementary characteristics of multi-sensor defects, convert the sensor defects in the traditional sense into valuable navigation information sources, construct a reverse navigation field and a path phase change rule, realize high-precision and high-reliability autonomous navigation control of humanoid robots in complex environments, and provide technical support for the wide application of humanoid robots in complex indoor scenes such as office buildings, commercial places and home environments. Obtaining humanoid robot navigation data, performing defect feature extraction and identification on the navigation data to measure defect points and data hollow regions, and generating a defect feature map based on spatial distribution analysis of the measured defect points and the data hollow regions; The defect feature map is used to establish confidence decreasing verification to obtain multi-level perception results, sensor weight distribution is determined according to the multi-level perception results, negative error value of each sensor is extracted from the defect feature map based on the sensor weight distribution to generate a negative error feature set, and a navigation gain parameter is generated by using the negative error feature set; The navigation data is inversely analyzed by using the navigation gain parameter to extract data back information, environment implicit features are reconstructed based on the data back information, and an inverse navigation field is constructed by combining the environment implicit features and the navigation gain parameter; The spatial distribution density of the data hollow area is analyzed based on the inverse navigation field to generate a hollow density map, hollow clustering features and hollow connectivity modes are extracted from the hollow density map, a path phase change region is divided according to the density threshold value of the hollow density map, and a path phase change rule set is generated based on the path phase change region, the hollow clustering features and the hollow connectivity modes; An initial navigation path is generated according to the path phase change rule set and the inverse navigation field, morphological transformation is performed on the initial navigation path to generate a curve path parameter and a three-dimensional path parameter, and an adaptive navigation sequence is generated by fusing the curve path parameter, the three-dimensional path parameter and the navigation gain parameter.
[0006] The second aspect of the present application proposes a humanoid robot navigation device based on defect complementarity, comprising: A defect analysis module is configured to obtain humanoid robot navigation data, perform defect feature extraction and identification on the navigation data to measure defect points and data hollow areas, and generate a defect feature map based on spatial distribution analysis of the measured defect points and the data hollow areas; A gain generation module is configured to use the defect feature map to establish confidence decreasing verification to obtain multi-level perception results, determine sensor weight distribution according to the multi-level perception results, generate a negative error feature set by extracting negative error values of each sensor from the defect feature map based on the sensor weight distribution, and generate a navigation gain parameter by using the negative error feature set; An inverse field construction module is configured to inversely analyze the navigation data by using the navigation gain parameter to extract data back information, reconstruct environment implicit features based on the data back information, and construct an inverse navigation field by combining the environment implicit features and the navigation gain parameter; A phase change rule module is configured to analyze the spatial distribution density of the data hollow area based on the inverse navigation field to generate a hollow density map, extract hollow clustering features and hollow connectivity modes from the hollow density map, divide a path phase change region according to the density threshold value of the hollow density map, and generate a path phase change rule set based on the path phase change region, the hollow clustering features and the hollow connectivity modes; A path generation module is configured to generate an initial navigation path according to the path phase change rule set and the reverse navigation field, perform morphological transformation on the initial navigation path to generate a curve path parameter and a three-dimensional path parameter, and fuse the curve path parameter, the three-dimensional path parameter and the navigation gain parameter to generate an adaptive navigation sequence.
[0007] A third aspect of the present application provides a computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the navigation method of the first aspect when executing the program.
[0008] The beneficial effects of the present application are embodied in the following aspects: first, through defect feature map analysis and confidence decreasing verification mechanism, the active use and performance complement of sensor defects are realized. Confidence decreasing verification adopts a three-layer strategy, that is, even if the performance of a single sensor is poor, reliable perception can be achieved through multi-sensor cooperation, and the perception defects in the traditional sense are converted into valuable navigation information sources. The extraction of negative error feature set and the generation of navigation gain parameter effectively compensate for the systematic deviation of the sensor and improve the navigation accuracy of the humanoid robot in multi-material environments such as office buildings and commercial places. Second, a reverse navigation field is constructed to realize the deep mining of data back information and the reconstruction of environmental implicit features. Through reverse analysis of navigation data, information such as sensor failure position, measurement abnormal distribution, data hole shape is converted into the basis for judging potential passable areas. The reverse navigation field not only retains the navigation value of normal perception data, but also converts abnormal patterns and hole distribution into gain information for path planning, significantly improving the environmental adaptability. Finally, based on the hole density map, the environment is divided into strong phase change area, weak phase change area and normal area, and respectively adopts avoidance strategy, deceleration and enhanced perception strategy and high-efficiency passing mode. The path phase change rule set combines the hole clustering characteristics and the connected mode to realize fine navigation control. Through the Bezier control point optimization of the curve path parameter and the terrain undulation adaptation of the three-dimensional path parameter, the generated adaptive navigation sequence can adjust the motion control parameters in real time according to the environmental complexity, ensuring that the humanoid robot can safely and stably complete the navigation task in narrow passages, carpet joints and step edges It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present application. BRIEF DESCRIPTION OF DRAWINGS
[0009] The accompanying drawings herein show specific examples of the technical solutions of the present application, and constitute part of the specification together with the specific embodiments, for explaining the technical solutions, principles and effects of the present application.
[0010] Unless specifically stated or otherwise as clear from the context of the following terms, the same symbols shall have the same or similar meanings and functions throughout the various drawings. In addition, different symbols can also be used to represent the same or similar technical features.
[0011] Figure 1 is a flowchart of a method for navigating a humanoid robot based on complementary defects.
[0012] Figure 2 is a structural block diagram of a navigation device for a humanoid robot based on complementary defects.
[0013] Figure 3 is a structural diagram of a computer device. DETAILED DESCRIPTION
[0014] In the following description, for the purposes of explanation and not limitation, specific details are set forth, such as particular system configurations, techniques, etc., in order to provide a thorough understanding of the embodiments described. However, it will be apparent to those skilled in the art that the application can be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the application with unnecessary detail.
[0015] It should be understood that the term "comprise" or "comprising," when used in this specification and the appended claims, indicates the presence or addition of stated features, integers, steps, operations, elements, and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.
[0016] It should also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items, and that the term "at least one of" followed by a list of two or more items means any single one of the items in the list, and that the term "one or more of" followed by a list of two or more items means any single one or plurality of the items in the list.
[0017] As used in this specification and the appended claims, the term "if" can be interpreted as meaning "when," or "once," or "in response to determining," or "in response to detecting," as appropriate. Similarly, the phrase "if it is determined" or "if [a described condition or event] is detected" can be interpreted as meaning "once it is determined" or "in response to determining" or "once [the described condition or event] is detected" or "in response to detecting [the described condition or event]," as appropriate.
[0018] In addition, in the description of the application and the appended claims, the terms "first," "second," "third," etc. are used only to distinguish descriptions, and cannot be understood as indicating or implying relative importance.
[0019] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0020] The technical solutions of the embodiments of this application will be described below.
[0021] like Figure 1 As shown, this embodiment of the invention provides a humanoid robot navigation method based on defect complementarity, including the following steps S110-S150: Step S110: Obtain navigation data of the humanoid robot, extract and identify defect features based on the navigation data, measure defect points and data void areas, and generate a defect feature map based on spatial distribution analysis of the measured defect points and data void areas.
[0022] Specifically, navigation perception data of the humanoid robot is synchronously collected through a multi-sensor fusion architecture. The vision sensor uses a binocular camera configuration, acquiring RGB-D image data at a frame rate of 30fps, with a resolution of 1280×720 and a field of view of 120°. The LiDAR sensor uses a 16-line configuration, a scanning frequency of 10Hz, an angular resolution of 0.2°, a maximum detection distance of 100 meters, and an effective distance of approximately 30 meters in an indoor environment. The inertial measurement unit (IMU) has a sampling frequency of 200Hz and includes a three-axis accelerometer and a three-axis gyroscope. For example, when the service robot "Xiaozhi" is performing a navigation task in an office building, during the process of moving from the lobby on the first floor to the conference room on the third floor, the vision sensor can normally identify the reflected image in front of the glass elevator door, but the LiDAR suffers from penetration, causing ranging failure; in the dimly lit area of the corridor, visual depth information is missing, while the LiDAR continues to work normally; in dynamic crowds, the IMU is affected by collision interference, resulting in instantaneous abnormal readings. The data synchronization mechanism is based on hardware triggering and software timestamp calibration to ensure that the time alignment error of data from different sensors is less than 5ms. Sensor calibration employed the Zhang Zhengyou calibration method for camera intrinsic parameter calibration, while extrinsic parameter calibration of the LiDAR and camera was achieved through checkerboard feature point matching. Raw navigation data containing visual, LiDAR, and inertial information was acquired through collaborative acquisition and preprocessing of multi-source heterogeneous sensors.
[0023] Based on the collected multi-sensor navigation data, feature extraction algorithms are used to identify various types of measurement defects and data voids. Visual defect recognition mainly targets image blurring, occlusion, and abnormal lighting, etc. Gradient threshold method is used to detect blurred areas, and when the gradient amplitude G = √(Gx² + Gy²) < τ_blur, it is marked as a blurred defect point, where G is the gradient amplitude, Gx is the x-direction gradient, Gy is the y-direction gradient, and τ_blur is the blur judgment threshold (value 10). Laser radar defect recognition focuses on ranging abnormalities and reflection failures. By detecting the distance mutation between adjacent points, measurement defects can be identified. When the distance change exceeds the statistical threshold, it is determined as an abnormal point. Data void is defined as the area where the sensor cannot obtain effective measurement. Visual voids appear as invalid pixels in the depth map, and laser voids appear as discontinuous segments of scanning lines. For example, "Xiaozhi" in the office building glass partition area, the laser void presents a rectangular distribution of 2m x 1.5m, and the void area reaches 3m², while the visual sensor can normally detect the object contour behind the glass. The void detection algorithm uses connected component analysis to aggregate adjacent missing points into a void area, and when the void area A_hole > 0.05m², it is marked. The defects of inertial sensors are mainly noise and drift. By statistical analysis, the noise characteristics are extracted, and when the drift rate exceeds 0.1° / s, it is marked as a defect state. The severity of the defect is divided into three levels: mild, moderate, and severe. The visual blur area ratio is less than 10% for mild, 10%-30% for moderate, and more than 30% for severe.
[0024] The identified defect points and hollow areas are analyzed for spatial distribution to construct a defect feature map reflecting the environmental perception characteristics. The spatial distribution analysis first divides the environment around the robot into a grid map, with a grid resolution of 0.1 m x 0.1 m and a coverage range of 20 m x 20 m around the robot center. For measuring defect points, the point density distribution ρ_point = N_defect / A_grid is calculated, where ρ_point is the defect point density, N_defect is the number of defect points in the grid, and A_grid is the grid area (0.01 m²), and the defect type distribution ratio is counted. For data hollow areas, the area distribution, shape characteristics, and connectivity are analyzed, and the minimum circumscribed rectangle is used to describe large hollows, recording the center position, principal axis direction, and coverage range. For example, in the glass partition area of an office building, the laser defect density reaches 15 / m², and the visual defect points are gradiently distributed in the light transition area, with a density decreasing from 80 points / m² to 10 points / m². In the central open area of the corridor, the defect density is only 2-3 / m². Cross-sensor defect correlation analysis uses the defect mutual exclusion index M_ij = 1-(ρ_i∩ρ_j) / (ρ_i∪ρ_j), where M_ij is the mutual exclusion of sensors i and j, ρ_i and ρ_j represent the defect density distribution of sensors i and j, ρ_i∩ρ_j is the defect overlap area, and ρ_i∪ρ_j is the defect union area. When M_ij > 0.7, it is considered that the two sensors have strong complementarity. The defect evolution mode is obtained through spatiotemporal trajectory analysis, and the appearance, disappearance, and transfer rules of defects in the moving process provide important reference for path planning.
[0025] In step S120, a multi-level perception result is obtained by using the defect feature map to establish a confidence decreasing verification, the sensor weight distribution is determined according to the multi-level perception result, the negative error feature set of each sensor is generated based on the sensor weight distribution from the defect feature map, and the navigation gain parameter is generated by using the negative error feature set.
[0026] Specifically, the multi-level perception results are obtained by confidence decreasing verification using defect feature maps. First, the defect distribution differences of different sensors at the same spatial position are analyzed, and the defect mutual exclusion index M_ij defined in the foregoing step S110 is calculated. When M_ij>0.7, it is considered that the sensors have strong complementarity, and a defect complementary pair is formed. Based on the identified complementary pair, a quantitative complementary relationship of vision-laser and laser-inertia is established, and a multi-level defect complementary matrix is constructed. Then, the complementary matrix is used to design confidence decreasing verification, starting from the single sensor with the highest confidence, and gradually adding complementary sensors to verify the quality improvement effect of perception. The initial confidence is calculated according to the defect density C_init=1-ρ_defect, wherein C_init is the initial confidence of the sensor, and ρ_defect is the defect density of the sensor, and the value range is between 0 and 1. The multi-sensor combination confidence is obtained by complementary weighted fusion, which comprehensively considers the basic performance and complementary strength of each sensor, and the weighting coefficient is dynamically determined according to the complementary matrix. The verification adopts a three-layer strategy: the first layer verifies the single sensor perception (threshold value 0.8), the second layer verifies the double sensor complementarity (threshold value 0.6), and the third layer verifies the three sensor cooperation (threshold value 0.4). For example, the confidence of the vision sensor is only 0.3 when the light is insufficient, and the confidence of the laser radar is 0.7 in the glass reflection area, but through the weighted fusion of the high complementary strength 0.85, the combination confidence is improved to 0.489, which meets the third layer verification requirement. The multi-level perception results record the sensor combination, confidence value, dominant sensor and failure mode of each layer, and form a structured perception quality evaluation report. The verification process ensures that even if the performance of a single sensor is poor, reliable perception can be achieved through multi-sensor cooperation through a decreasing threshold, which fully embodies the core idea of defect complementarity.
[0027] In some embodiments, the determining sensor weight distribution according to the multi-level perception results comprises: extracting sensor response strength and stability indicators from the multi-level perception results; calculating the contribution degree of the sensor at different confidence levels based on the response strength; generating a dynamic weight coefficient based on the stability indicator and the contribution degree, and normalizing the dynamic weight coefficient to generate the sensor weight distribution.
[0028] From the confidence data of multi-level perception results, the response strength and stability characteristics of each sensor are extracted. The response strength reflects the effective perception ability of the sensor in the current environment, and is calculated by considering the sensor confidence and noise level, where C_init(v) represents the initial confidence of the visual sensor v, and noise_level_v is the corresponding noise level coefficient. The response strength of the visual sensor is mainly affected by the lighting conditions, and can reach 0.9 under sufficient light, and decreases to 0.2 in dark environment; the response strength of the laser radar is related to the target reflection characteristics, and the response strength of the standard diffuse reflection surface is 0.8, and the mirror or transparent material decreases to 0.3; the response strength of the inertial sensor is relatively stable, and usually remains in the range of 0.7-0.9. The stability index is obtained by calculating the time variance of the confidence, and the smaller the variance, the higher the stability. A sliding time window is used for real-time updating. For example, when "Xiao Zhi" performs a patrol task, the visual stability in a static environment is as high as 0.85, and the IMU stability in a dynamic scene is better, up to 0.9. The contribution degree is defined as the ratio of the confidence improvement after adding the sensor to the overall confidence, which reflects the marginal contribution of each sensor to the overall perception quality. The joint distribution of response strength and stability presents a specific pattern, high response strength usually accompanies high stability, but in the working boundary condition of the sensor, high response and low stability may occur, which needs special processing.
[0029] Based on the extracted response strength, the actual contribution of each sensor at different confidence levels is calculated. The contribution degree takes the response strength as the modulation factor, and defines the improvement of the overall confidence after adding the sensor. The contribution of the kth layer is calculated by modulating the confidence improvement of the layer by the response strength, which includes the difference between the combined confidence containing the visual sensor and the combined confidence not containing the visual sensor. For example, in the visual-laser combination, the marginal contribution of the visual sensor is modulated when the response strength is 0.3, ensuring that low-performance sensors do not excessively affect the overall evaluation. The comprehensive contribution degree is obtained by hierarchical weighted summation, with layer weights λ_1=0.5, λ_2=0.3, λ_3=0.2, ensuring that the basic perception ability is valued, while considering the multi-sensor cooperation effect. The time-varying characteristics of the contribution degree are tracked by a sliding window, with a window size of 20 sampling periods, about 2 seconds of time span, and the contribution evaluation of each sensor is updated in real time to adapt to the dynamic changes of the environment.
[0030] The dynamic weight coefficient is calculated according to the comprehensive stability index and the contribution degree information, and reflects the comprehensive performance of the sensor. The dynamic weight coefficient calculation formula is W_v=α×R_v+β×S_v+γ×G_v, wherein W_v is the dynamic weight coefficient of the visual sensor, R_v is the response intensity, S_v is the stability index, G_v is the comprehensive contribution degree, the weight factors α=0.4, β=0.3 and γ=0.3 balance the real-time performance and the long-term reliability. The influence of the complementary matrix is indirectly transmitted to the weight calculation through the contribution degree G_i, and the sensor combination with high complementarity is ensured to obtain higher weight distribution. The dynamic adjustment mechanism updates the weight in real time according to the environmental changes, and when the environmental feature change (such as light mutation and material switching) is detected, the weight is quickly adjusted, and the adjustment response time is less than 100 ms. The smooth updating of the weight is realized by using the exponential moving average method, and the smooth factor η=0.8 ensures the timeliness of the weight adjustment and avoids the system shock caused by the weight mutation. The dynamic weight coefficient obtained is normalized to ensure that the sum of the weights of all sensors is 1, and the mathematical consistency of the multi-sensor fusion is ensured.
[0031] According to the determined sensor weight distribution, the negative error feature set of each sensor is extracted from the foregoing defect feature spectrum. The negative error is defined as the error of the systematic small measurement value of the sensor, and the calculation formula is e_i=d_measured-d_true, wherein e_i is the negative error of the sensor i, d_measured is the measured value, d_true is the true value, and the obtained negative value reflects the small measurement degree. The visual negative error is mainly caused by the systematic deviation of the depth estimation, and the depth value is small in the sparse texture area, and the average negative error is about-5% to-10% of the true distance. The laser negative error appears on the low reflectivity surface, and the weak return signal causes the ranging to be small, and the negative error of the black surface can reach-15%. For example, when "Xiao Zhi" detects the black carpet of the office building, the laser ranging system is small by 0.3 meters, and the visual depth estimation is normal in the area. The comprehensive negative error weighted by the weight is reflected by the weighted sum after the multi-sensor fusion, wherein w_i is the normalized weight, and the negative error of the high-weight sensor is focused on. The spatial distribution feature is extracted by kernel density estimation, and a negative error heat map is generated to identify the high-risk area and distribution mode of the negative error. The negative error feature set includes statistical features (mean, variance, skewness, kurtosis), spatial features (distribution density, aggregation degree) and time sequence features (trend, periodicity), which provide comprehensive error information for subsequent navigation gain parameter generation.
[0032] In some embodiments, the generating the navigation gain parameter using the negative error feature set comprises: decomposing a positioning negative bias component and a ranging negative error component based on the negative error feature set; generating a path correction gain based on the positioning negative bias component; generating an obstacle avoidance safety margin based on the ranging negative error component; and fusing the path correction gain and the obstacle avoidance safety margin to generate the navigation gain parameter.
[0033] Firstly, two main error components affecting positioning and ranging are decomposed from the negative error feature set. The positioning negative bias component is mainly caused by visual depth underestimation and laser long-distance attenuation, which is extracted by analyzing the spatial cumulative characteristics of negative error. The decomposition method uses principal component analysis (PCA), and the first principal component usually corresponds to the positioning bias, with a contribution rate of about 60-70%, and the second principal component corresponds to the ranging error, with a contribution rate of about 20-30%. The ranging negative error component directly affects the judgment of obstacle distance, and different error models are used for different distance segments by modeling the error characteristics. For example, when "Xiaozhi" navigates in the long corridor of the office building, the positioning negative bias shows a cumulative characteristic, with a cumulative error of about 0.2 meters per 10 meters, while the ranging negative error shows an instantaneous characteristic when avoiding obstacles at close range, with an error fluctuation in the range of ±0.1 meters. The statistical characteristics of the error components include mean, standard deviation and distribution form, and the normality assumption of the error distribution is verified by K-S test. Through error source analysis and feature decomposition, the positioning negative bias component and the ranging negative error component are accurately separated.
[0034] Then, based on the statistical characteristics of the positioning negative bias component, the path correction gain is designed to compensate for the systematic position underestimation. The path correction gain k_path=1-δ_p / d_nominal, where k_path is the path correction gain, δ_p is the positioning negative bias (negative value), and d_nominal is the nominal motion distance. The gain value is dynamically adjusted according to the size of the negative bias and the motion distance to ensure the accuracy and stability of the compensation. The fixed gain compensation strategy is used for short distance motion (<5m), with a gain value of about 1.05-1.1, and the adaptive gain is used for long distance motion to avoid overcompensation, with a gain upper limit of 1.15. The spatial variation characteristics of the gain are realized through scene recognition, with a larger gain in corridor environment and a smaller gain in open space. Different environmental types correspond to different gain strategy curves. For example, when "Xiaozhi" performs a long-distance navigation task, the path correction gain is automatically adjusted according to the detected positioning negative bias characteristics, and the cumulative error is controlled within 0.5 meters in a 30-meter corridor navigation, ensuring the accuracy of reaching the target position. The gain limiting mechanism prevents excessive correction in abnormal situations, with upper and lower limits of 1.2 and 0.9 respectively, maintaining stable operation of the navigation process.
[0035] Then, according to the distribution characteristics of the ranging negative error component, the obstacle avoidance margin parameter ensuring navigation safety is generated. The basic obstacle avoidance margin calculation formula is margin_static=k_safe*max(|μ_e|,d_min), wherein margin_static is the static obstacle avoidance margin, k_safe is the safety coefficient (typical value 1.5-2.0), μ_e is the ranging negative error mean, and d_min is the minimum margin (0.3m). The dynamic margin considers the robot motion speed, and the calculation formula contains the current speed v and the reaction time t_reaction (typical value 0.5s), ensuring that there is enough braking distance in an emergency. The comprehensive obstacle avoidance margin combines static and dynamic factors, and adopts the maximum value principle to ensure safety in different motion states. For example, when "Xiaozhi" detects the black carpet and other areas prone to ranging negative errors, the corresponding safety margin is automatically increased to 0.5m, and the standard margin of 0.3m is maintained in normal areas, effectively avoiding collision risks. The sensor confidence correction adjusts the margin size according to the real-time perception quality, and appropriately increases the safety distance when the confidence is low. The confidence and the margin are inversely proportional, ensuring that safety is prioritized.
[0036] Finally, the path correction gain and the obstacle avoidance safety margin are fused to generate the navigation gain parameter. The navigation gain parameter includes the path correction gain, the static obstacle avoidance margin, the dynamic obstacle avoidance margin, and the scene weight, forming a complete compensation and safety information system, wherein the scene weight value range is 0.2-1.0. The parameter fusion considers the mutual constraint relationship, and appropriately increases the safety margin when the path gain is too large, ensuring overall coordination. The scene weight is dynamically allocated according to the environmental complexity, and the weight in narrow space is 0.8-1.0, and the weight in open area is 0.2-0.4, balancing efficiency and safety demand. For example, when "Xiaozhi" performs complex environment navigation, the path correction gain is 1.08, the static margin is 0.4m, the dynamic margin is 0.2m, and the scene weight is 0.7, forming a coordinated cooperation, reflecting the differences in navigation strategies under different environmental conditions. The consistency check of the gain parameter prevents parameter conflicts, and ensures that each parameter is within a reasonable range through constraint condition verification, ensuring stable operation of the navigation process. The navigation gain parameter can effectively compensate for the systematic deviation of the sensor, and at the same time provide reliable collision protection through dynamic safety margin adjustment. Through the optimization and fusion of various parameters and consistency verification, a complete set of navigation gain parameters is finally generated.
[0037] In step S130, the navigation data is inversely analyzed by the navigation gain parameter to extract data back information, the environment implicit features are reconstructed based on the data back information, and the reverse navigation field is constructed by combining the environment implicit features and the navigation gain parameter.
[0038] Specifically, the original navigation data is inversely parsed with navigation gain parameters to mine the neglected implicit information in sensor data. The navigation gain parameters include path correction gain k_path, obstacle avoidance safety margin margin, and scene weight w_scene, which reflect the systematic bias characteristics of sensors. The core idea of inverse parsing is to infer the real characteristics of the environment from error patterns, such as continuous small visual depth suggesting environmental factors affecting depth estimation. The parsing process first compensates the original measurement value with gain, and the compensated measurement value d_compensated is calculated by the formula d_compensated = d_measured x k_path, where d_measured is the original measurement value, and k_path is used to compensate the systematic negative error. The data back information is defined as a set of abnormal patterns, missing areas and implicit clues contained in the original navigation data, including: sensor failure position and time, spatial distribution of measurement anomalies, shape characteristics of data holes, and complete record of historical trajectory. For example, in the "JiZhi" office building navigation, the data back information records the continuous ranging jump point of the laser radar on the glass wall, the depth missing pattern of the visual sensor in the dark area, and the abnormal reading sequence of the IMU in the elevator. Time series inverse analysis of historical data trends identifies the time points and spatial positions that cause sensor performance degradation.
[0039] In some embodiments, reconstructing the environmental implicit characteristics based on the data back information includes: time series inversion of the data back information to obtain inverse features of the historical trajectory; identifying data missing areas from the data back information and mapping them as potential passable areas; analyzing the numerical change rate of the data back information to infer the environmental boundary position; and fusing the inverse features, the potential passable areas, and the environmental boundary position to generate complete environmental implicit characteristics.
[0040] For example, the time series inversion of the data back information to obtain inverse features of the historical trajectory includes: generating a reverse time sequence based on the data back information in reverse order of timestamp, generating an inverse motion vector based on the position difference between adjacent time points based on the reverse time sequence; identifying direction mutation points and speed anomaly points based on the inverse motion vector, and inferring environmental constraint strength based on the spatial distribution density of the direction mutation points and the speed anomaly points; and generating inverse features of the historical trajectory based on the environmental constraint strength.
[0041] Firstly, based on the data back information, a reverse time sequence is generated in reverse order of timestamp. The data back information contains the complete motion history and abnormal event records of the robot, and the reverse-ordered data sequence preserves the original timestamp. The position data at the time of sensor failure is extracted from the data back information, and these key time points constitute the nodes of the reverse sequence. Based on the reverse time sequence, the position difference between adjacent time points is extracted, and the reverse motion vector v rev(t i) is calculated, which contains three components of x-direction velocity, y-direction velocity and angular velocity, i.e. v rev=[Δx / Δt,Δy / Δt,Δθ / Δt]^T. For example, the data back information of "Xiaozhi" shows that visual abnormalities occur continuously at a corridor corner, and the position change in this period is extracted through reverse sequence analysis to generate the corresponding reverse motion vector sequence. The spatial distribution of the vector field is obtained by weighted averaging of all vectors passing through the same grid, and the weight is inversely proportional to the time distance. Through the time sequence processing and vector calculation of the data back information, the reverse motion vector reflecting the motion characteristics is successfully generated. Then, based on the reverse motion vector, the abnormal features in the motion process are identified. The direction mutation detection calculates the included angle of adjacent vectors, and marks the direction mutation point when the included angle exceeds the set threshold. The speed anomaly includes sudden acceleration and sudden stop, and the speed anomaly point is identified by calculating the acceleration. The identified direction mutation points and speed anomaly points are spatially clustered to form abnormal regions. The number of abnormal points in unit area is calculated to generate the spatial distribution density. For example, the reverse motion vector analysis of "Xiaozhi" found that multiple direction mutation points occurred in a certain area, indicating that there is strong environmental constraint at this position. According to the density distribution and feature analysis of the abnormal points, the environmental constraint strength of different regions is inferred, and the higher the density, the stronger the constraint. The constraint type inference combines abnormal features and environmental prior knowledge, such as narrow passages causing direction mutations and dynamic obstacles causing speed anomalies. Through abnormal point identification and density analysis, the inference of environmental constraint strength is completed. Finally, based on the environmental constraint strength, the reverse features of historical trajectory containing multi-dimensional information are generated. The reverse feature vector F reverse contains four dimensions of constraint strength, path preference, risk level and traffic efficiency, i.e. F_reverse=[f_constraint,f_preference,f_risk,f_efficiency], each component is normalized to the range of [0,1]. The path preference is obtained by counting the number of historical passes in each region, reflecting the habitual path of the robot; the risk level is calculated according to the frequency and severity of abnormal events, which comprehensively evaluates the navigation risk of each region; the traffic efficiency is obtained by analyzing the historical speed data, calculating the ratio of actual traffic speed to theoretical maximum speed. The spatial representation of the feature uses a grid map, and each grid stores the corresponding four-dimensional feature vector. The time decay mechanism weights the historical data to ensure that recent data have a greater impact. Through multi-dimensional analysis and comprehensive evaluation, the generation of reverse features of historical trajectory is completed.
[0042] From the data back information, missing areas are identified and their passable properties are inferred. The data back information records the valid detection range and blind area distribution of all sensors, and missing areas do not always mean the presence of obstacles. Based on the shape features and failure patterns in the data back information, three inference principles are used to determine passability: the continuity principle assesses whether the blank area connects two known passable areas; the symmetry principle uses the regularity of the environment layout; and the functionality principle considers the functional attributes of space. For example, Xiao Zhi's data back information shows a rectangular hollow area at the entrance of a conference room. By analyzing the area connecting two passable corridors and conforming to the geometric characteristics of the door, it is inferred to be a potentially passable area. The inference result generates a passable probability, and boundary smoothing processing converts discrete judgments into continuous probability fields. The verification mechanism checks whether the historical trajectories in the data back information have ever passed through these areas, improving the credibility of the inference.
[0043] Using the original sensor measurement values in the data back information, numerical change rate analysis is performed to infer environmental boundaries. The data back information saves the original measurement values of vision and laser sensors before failure, and the spatial gradient of these numerical values is used to identify implicit boundaries. Boundary detection uses a multi-sensor fusion gradient operator, and when the gradient value exceeds an adaptive threshold, it is determined to be a boundary point. Based on the distribution characteristics of abnormal patterns in the data back information, physical boundaries (walls, obstacles), material boundaries (different ground materials), and light boundaries (light-dark boundaries) are distinguished. For example, the laser ranging mutation sequence recorded in Xiao Zhi's data back information reveals the precise profile position of the glass wall, which is information that is ignored in normal perception. The continuity of the boundary is formed by connecting adjacent boundary points to form a complete profile, and multi-scale analysis detects boundaries at different resolutions to capture complete information from the overall structure to local details.
[0044] The temporal reverse features, potential passable areas and environmental boundary information are integrated to construct a complete environmental implicit feature representation. The fusion framework adopts a multi-level structure, fully utilizing the complementarity of various features. The four dimensions of the temporal reverse features play different roles in the fusion: the constraint strength directly affects the obstacle judgment weight; the path preference adjusts the path attraction; the risk level is used for safety margin adjustment; and the passable efficiency affects the speed planning suggestion. The feature fusion function considers the contribution and mutual relationship of each feature to generate a unified implicit feature representation F_hidden, which contains the multi-dimensional implicit information of the environment. The conflict resolution mechanism handles the contradictions of different feature sources, and determines the final feature through confidence comparison and timeliness judgment. For example, when "Xiaozhi"'s reverse feature shows that a certain area is high-risk, while the potential passable analysis determines that it is feasible, the decision is arbitrated through environmental boundary information. Spatial interpolation fills in the feature blank area, maintaining the continuity of the feature field. Multi-resolution representation supports different precision requirements of applications, and semantic enhancement gives the implicit feature a clear meaning.
[0045] The reconstructed environmental implicit features and navigation gain parameters are combined to construct a reverse navigation field guiding the robot motion. The reverse navigation field is based on the potential field theory, but integrates data-driven implicit features and gain modulation. Each component of the navigation gain parameter participates in the construction of the field, including the path correction gain, safety margin and scene weight. The field function Φ(x, y) considers three components: implicit feature potential, gain modulation potential and safety potential field, where Φ(x, y) represents the potential energy value at position (x, y), w_scene is the scene weight, Φ_hidden is the implicit feature potential generated based on F_hidden, Φ_gain is the path gain modulation potential, and Φ_safety is the safety potential field. The implicit feature potential is generated according to the content of F_hidden, with passable areas as negative potential, invisible obstacles as positive potential, and historical preferred paths with additional attraction. The gain modulation potential compensates for path negative errors, and the safety potential field integrates static and dynamic margins to generate repulsion zones around obstacles. For example, in "Xiaozhi"'s office building navigation, the implicit feature potential at the door of the glass conference room is negative (passable), combined with the path correction gain and safety margin to form a comprehensive navigation field. The gradient of the field provides direction guidance for motion, ensuring the balance between target approach and obstacle avoidance. The scene weight w_scene is adjusted in real time according to the environment type, with narrow spaces increasing the influence of implicit features and open areas reducing constraints.
[0046] In step S140, a hollow density map is generated based on the spatial distribution density of the data hollow area in the reverse navigation field, and hollow clustering features and hollow connectivity patterns are extracted from the hollow density map. A density threshold is set according to the hollow density map to divide the path phase transition area, and a path phase transition rule set is generated based on the path phase transition area, the hollow clustering features and the hollow connectivity patterns.
[0047] In some embodiments, the analyzing the spatial distribution density of the data hole region based on the inverse navigation field to generate a hole density map comprises: locating a three-dimensional coordinate of the data hole region in the inverse navigation field; calculating a number of holes in a unit volume based on the three-dimensional coordinate to generate a local density value; spatially interpolating the local density value to generate a continuous density distribution; and mapping the continuous density distribution to a two-dimensional grid map to generate a hole density map.
[0048] First, the three-dimensional spatial distribution of the high-density region is accurately located based on the hole density map. The grid positions with density values exceeding the threshold are extracted from the hole density map, and the two-dimensional grid coordinates are converted into three-dimensional spatial coordinates. The coordinate transformation considers the current pose of the robot and the height information of the environment, and the three-dimensional coordinates of the hole points are represented as P_hole=[x,y,z]^T. For example, the hole density map of "Xiaozhi" shows that the density at a certain corridor corner reaches 15 / m², and the corresponding three-dimensional coordinates are concentrated near the ground (z≈0.1m) and the waist height (z≈1.2m). The accuracy of coordinate positioning is improved through multi-sensor cross-validation, and the coordinates of adjacent hole points are aggregated to reduce data redundancy. Based on the efficient coordinate extraction of the hole density map, a set of three-dimensional coordinates of the data hole region is obtained.
[0049] Then, based on the located three-dimensional coordinates, the number of holes in a unit volume in space is calculated in combination with the density distribution data. The hole density map ρ_hole(x,y) is used as the basic data to extend the two-dimensional density to the three-dimensional volume density, where ρ_hole represents the hole density value at position (x,y). The local density calculation uses the kernel density estimation method, and the voxelization method divides the space into 0.1m³ cubic units. The density value of each voxel is calculated by interpolating the ρ_hole value of the corresponding two-dimensional grid. Density normalization ensures comparability in different regions, and vertical layer analysis is based on the identified density distribution characteristics. For example, based on the high-density characteristics of the corner region in the hole density map of "Xiaozhi", the three-dimensional volume density of this region is calculated to be 12 / m³. The dynamic density updating mechanism supports real-time environmental changes, and the newly detected holes are fused and updated with the existing density map.
[0050] Then, the calculated local density values are spatially interpolated to generate a continuous and smooth density distribution field. The interpolation process directly utilizes the continuity basis of the void density map and uses radial basis function (RBF) interpolation for three-dimensional expansion. The determination of the interpolation weight coefficient considers the density gradient information of adjacent grids in the density map, ensuring that the interpolation result is consistent with the original density distribution. The boundary processing uses an extrapolation strategy based on the gradient characteristics of the edge of the density map to estimate the density values outside the boundary. The interpolation quality is evaluated through cross-validation with the original density data to ensure that the expanded three-dimensional density field retains the original spatial features. Multi-scale interpolation is performed at different resolutions, with coarse scales inheriting overall trends and fine scales preserving local features. Continuity constraints ensure the first derivative of the density field to be continuous, avoiding unnatural jumps. Based on the RBF interpolation and smoothing processing driven by the density map, a spatially continuous density distribution field is generated.
[0051] Finally, the generated three-dimensional density distribution is projected onto a two-dimensional plane to update and optimize the void density map. The projection method uses maximum projection to retain the maximum density information in the vertical direction. The two-dimensional grid resolution is set to 0.2m to ensure compatibility of the data format. The optimized density map adds supplementary three-dimensional information, improving the accuracy of density estimation. Image enhancement processing improves the distinguishability of density differences, and edge detection identifies areas with sharp changes in density. For example, after three-dimensional processing, the density map accuracy of the "Xiaozhi" office building corner area is improved by 15%, more accurately reflecting the real distribution of the void. The visualization color scheme uses a heat map form, with red representing high density and blue representing low density.
[0052] Based on the generated hole density map, the clustering features and connectivity patterns of holes are extracted. The clustering analysis uses the DBSCAN algorithm to classify adjacent grids with ρ_hole exceeding the threshold value into the same class, and the density threshold is directly determined based on the distribution of ρ_hole. The clustering parameters are adjusted according to the density statistical characteristics: the average density is used as the reference, and the standard deviation is used to determine the clustering radius. The feature vector F_cluster of each cluster is [centroid, area, density_mean, shape_factor], where density_mean directly comes from the ρ_hole value of the corresponding region. The shape factor is described by calculating the aspect ratio and circularity of the cluster, and the long strip-shaped cluster (aspect ratio > 3) usually corresponds to a corridor or a channel. The connectivity analysis uses the graph theory method, taking the cluster as the node and the adjacent relationship as the edge to construct the connected graph G=(V,E), where V is the node set representing each cluster, and E is the edge set representing the connection relationship between clusters. For example, the hole density map of "Xiao Zhi" office building shows that the corridor area forms a chain-like connectivity pattern, and the open hall presents a network-like connectivity feature. The connectivity strength is measured by the shortest distance between clusters, and a distance less than 1m is considered as strong connectivity. The time evolution analysis tracks the dynamic changes of clusters and identifies stable patterns and transient patterns. According to the density map driven DBSCAN clustering and connectivity analysis, the hole clustering features and connectivity patterns are accurately extracted.
[0053] In some embodiments, according to the hole density map, a density threshold is set to divide the path phase change region, including: calculating the global average density and local peak density of the hole density map; setting a reference threshold based on the global average density and a dynamic threshold based on the local peak density; marking the region with a density exceeding the dynamic threshold as a strong phase change area, and the region with a density between the reference threshold and the dynamic threshold as a weak phase change area; merging the strong phase change area and the weak phase change area to generate a complete path phase change region.
[0054] First, the statistical characteristic indicators of the generated hole density map are calculated. The global average density p global is directly averaged over all p hole values in the density map, reflecting the overall hole distribution level. The local peak density is detected by applying a sliding window on the density map, with a window size of 2m x 2m, and the maximum p hole value in each window is recorded. The peak detection algorithm identifies local maximum points on the density map, requiring the peak point density to be greater than the density of the surrounding 8-neighborhood. For example, the density map statistics of the "Xiaozhi" office building show that the global average density p global = 4.2 / m2, and the local peak density of the corridor corner is p peak_local = 22 / m2. The density histogram is generated based on p hole data, showing a bimodal distribution characteristic. Spatial autocorrelation analysis evaluates the degree of aggregation of the density map, and temporal stability is evaluated by calculating the correlation coefficient of consecutive frame density maps. Outlier processing eliminates transient interference points in the calculation, and the 3σ criterion is used to identify outliers.
[0055] Next, according to the calculated density statistical characteristics, an adaptive density threshold system is set. The base threshold T base = p global + k _ σ x s global, where p global is the calculated global average density, s global is the corresponding standard deviation, and k _ σ is the standard deviation coefficient (typical value 1.5-2.0). The dynamic threshold T dynamic = a x p peak_local + (1-a) x T base, where p peak_local is the identified local peak density, and a is the weight coefficient (value 0.6-0.8). The spatial variation of the threshold is smoothed by Gaussian filtering, and the time adaptive mechanism adjusts the threshold according to historical statistical data. The influence of environmental type on the threshold is introduced by scene recognition, and the threshold tolerance is improved in complex environments. Threshold verification is performed by calculating the classification accuracy, with the actual distribution of the density map as the reference standard. Sensitivity analysis evaluates the influence of threshold changes on regional division, ensuring the robustness of classification.
[0056] Then, the density map is regionally divided based on the set T_base and T_dynamic thresholds. The strong phase transition region is defined as the region where p_hole > T_dynamic, indicating a high concentration of holes, and the navigation strategy needs to be changed. The weak phase transition region is defined as the region where T_base < p_hole < T_dynamic, indicating a moderate degree of perception degradation. Region labeling uses connected component analysis to ensure that adjacent grids of the same type are grouped into a region. Morphological operations optimize the region boundaries, with an opening operation to remove small noise regions and a closing operation to fill small holes within the region. Region feature extraction includes geometric properties such as area, perimeter, and compactness. Boundary smoothing uses the Douglas-Peucker algorithm to simplify the polygon boundary while preserving the main shape features. For example, based on the threshold division of the "Xiaozhi" office building density map, the corridor corner is labeled as a strong phase transition region, and the transition region is a weak phase transition region. Phase transition quantification reflects the degree of deviation from the normal state of the region, and the transition zone identifies the buffer region between strong and weak phase transition regions.
[0057] Finally, the identified strong and weak phase transition regions are integrated to generate a unified path phase transition region representation. Region merging uses the proximity principle, with regions of the same type within a distance of less than 0.3m being merged into a larger region to avoid excessive fragmentation affecting path planning efficiency. The merging process uses a recursive algorithm, first identifying a seed region, and then gradually absorbing surrounding regions of the same type that meet the conditions. Hierarchical representation decomposes large phase transition regions into multiple sub-regions, which are further divided based on the density distribution characteristics within the region to support fine-grained path planning. Sub-region division considers factors such as density gradient direction, region shape complexity, and boundary curvature to ensure that each sub-region has relatively consistent navigation characteristics. Region attribute labeling includes key information such as phase transition type, average density, area size, and shape descriptor to provide data support for subsequent rule generation. Boundary optimization uses a combination of morphological filtering and curve fitting to maintain the basic morphology of the region while eliminating the path planning difficulties caused by jagged boundaries. For example, in the "Xiaozhi" office building navigation, multiple small strong phase transition regions in the corridor region are merged into a continuous large region with a length of about 15 meters and a width of 2 meters, simplifying the complexity of path planning. Temporal and spatial consistency checks ensure the stability of the phase transition region in continuous navigation, avoiding path jitter caused by frequent region changes. Through density threshold division, region merging optimization, and hierarchical representation, accurate division and structured expression of the path phase transition region are achieved.
[0058] The rules set guiding the navigation behavior is formulated by integrating the phase transition region, the cavity clustering feature and the connectivity mode. The rule generation adopts the condition-action format: IF (condition) THEN (action). The basic rules include: strong phase transition region avoidance rule (completely avoiding the high-density cavity region), weak phase transition region deceleration rule (reducing the speed and increasing the perception time), and chain connectivity following rule (adjusting the path in the direction of the cavity chain). The rule priority is determined according to the trade-off between safety and efficiency, and the safety-related rules have the highest priority. The conflict resolution mechanism handles the situation where multiple rules are triggered at the same time, and adopts the priority sorting and rule fusion strategy. The rule parameters include trigger threshold, action intensity, duration, etc., which support fine adjustment. For example, based on the phase transition region and clustering feature of the "XiaoZhi" office building, a rule set containing 15 specific rules is generated, covering the navigation strategies under different environmental conditions. The context-related rules consider the current task and environmental state, and the rule learning mechanism automatically extracts new rules or adjusts existing rules by analyzing successful and failed navigation cases.
[0059] In step S150, the initial navigation path is generated according to the path phase transition rule set and the reverse navigation field, and the initial navigation path is morphologically transformed to generate curve path parameters and three-dimensional path parameters, and the curve path parameters, three-dimensional path parameters and navigation gain parameters are fused to generate an adaptive navigation sequence.
[0060] Specifically, the initial navigation path of the robot is generated by multi-constraint fusion using the path phase transition rule set and the reverse navigation field. The path generation adopts an improved A algorithm combined with potential field theory, and the reverse navigation field Φ(x, y) provides the global potential energy distribution, and the path phase transition rule set provides local behavior constraints. The cost function F(n) of the initial path search is designed as F(n) = G(n) + H(n) + P(n), where F(n) is the total cost of node n, G(n) is the actual cost from the starting point to the current node, H(n) is the heuristic estimate from the current node to the target, and P(n) is the potential energy penalty term based on the reverse navigation field. The potential energy penalty term calculation formula P(n) = w_field×Φ(x, y) + w_rule×R(n), where w_field is the navigation field weight, w_rule is the rule weight, and R(n) is the penalty value of the path phase transition rule. The specific implementation of the rule constraint is realized by dynamically adjusting the node expansion strategy in the path search process: when encountering a strong phase transition region, the search radius is increased to avoid the region, and when entering a weak phase transition region, the moving step is reduced to improve the accuracy. For example, "XiaoZhi" in the office building navigation, when the path approaches the strong phase transition region (ρ_hole=22 / m²) of the corridor corner, the A algorithm automatically detours and selects an alternative path in the open area. Path smoothing adopts B-spline curve fitting to ensure the feasibility and continuity of the generated path. The safety margin check verifies that the distance from each point on the path to the nearest obstacle meets the safety requirements.
[0061] In some embodiments, the morphological transformation of the initial navigation path generates a curve path parameter and a three-dimensional path parameter, including: determining a section in the initial navigation path corresponding to the path phase change region based on the path phase change rule set; inserting a Bezier control point based on the start and end points of the section; fitting a smooth curve parameter as a curve path parameter based on the Bezier control point; extracting terrain undulation information based on the environmental implicit features of the section of the initial navigation path, and generating a height change sequence as a three-dimensional path parameter based on the terrain undulation information.
[0062] Based on the path phase change rule set, the section of the initial navigation path that needs special processing is accurately identified. Path section analysis is performed by checking whether each sampling point on the path is located in a strong phase change region or a weak phase change region, and the sampling interval is set to 0.1 m to ensure detection accuracy. The identification of the phase change section uses continuity judgment: when more than 3 consecutive sampling points are located in the same type of phase change region, it is marked as a complete section. The section features include start and end point coordinates, section length, phase change type and intensity, etc. For example, when "Xiaozhi" passes through the office building corridor corner, a strong phase change section with a length of 1.5 m is detected, with start point coordinates (10.2, 5.4) and end point coordinates (11.5, 6.1). Section classification divides the path into three categories: normal section, weak phase change section and strong phase change section, and different types of sections use different processing strategies. Transition section identification identifies the connection between the phase change region and the normal region to ensure the smoothness of the path transformation. Spatial weight allocation is determined according to the phase change intensity: strong phase change section weight 0.8, weak phase change section weight 0.6, normal section weight 0.4. Section importance evaluation considers phase change intensity, section length and difficulty of passing, providing a basis for subsequent optimization. Based on the accurate analysis of the path phase change rule set, the accurate identification and classification of the phase change section in the initial navigation path are completed.
[0063] Based on the identified segment features, Bezier control points are inserted at key locations to achieve path smoothing. The control point insertion strategy is determined by the segment type: strong phase transition segments insert control points 0.3 m outside the start and end points, weak phase transition segments insert control points 0.2 m outside, and normal segments insert control points 0.1 m outside. The position of the control points is optimized by gradient descent perpendicular to the path direction, with the objective function considering path length, curvature continuity, and obstacle avoidance. The weight distribution of the Bezier control points uses the chord length parameterization method to ensure that the curve passes through the specified path points. For example, in the strong phase transition segment of the "Jiachi" corridor corner, four control points are inserted to form a cubic Bezier curve: the control point before the start point (9.9, 5.1), the start point (10.2, 5.4), the end point (11.5, 6.1), and the control point after the end point (11.8, 6.4). Control point constraints include a minimum turning radius limit R_min ≥ 0.8 m and a maximum curvature limit κ_max ≤ 1.2 m⁻¹ to prevent generating sharp turns that the robot cannot execute. The iterative optimization process minimizes the total path cost by adjusting the control point positions, with the convergence condition being that the cost change is less than 0.01 for five consecutive iterations. Control point validation checks whether it is within the feasible region to avoid collisions with obstacles. Multi-level optimization gradually adjusts the control points from coarse to fine to ensure global optimality.
[0064] Based on the optimized Bezier control points, curve parameters are fitted to describe the path geometry. The parameter equation of the cubic Bezier curve is P(t) = (1-t)³P0 + 3(1-t)²tP1 + 3(1-t)t²P2 + t³P3, where t ∈ [0, 1] is the parameter and P0 to P3 are the control point coordinates. The curve path parameters include parameterized representation, curvature distribution κ(t), and tangent direction θ(t). The curvature calculation formula is κ(t) = |P'(t) × P''(t)| / |P'(t)|³, where P'(t) and P''(t) are the first and second derivatives, respectively. The tangent direction θ(t) = arctan(dy / dx) provides orientation information for each point on the path. The discretization of the path parameters uses adaptive sampling, with increased sampling density in areas with large curvature changes and reduced sampling points for straight segments. For example, the Bezier curve of the "Jiachi" corner segment has a maximum curvature κ_max = 0.8 m at t = 0.5, corresponding to a minimum turning radius of 1.25 m, which satisfies the robot kinematic constraints. Parameter validation is performed by checking curvature continuity and path feasibility to ensure that the generated curve parameters meet the physical constraints. The velocity profile matches the curvature distribution, with reduced speed v = v_max√(R_min / R(t)) in high-curvature areas and increased efficiency on straight segments. Arc length parameterization s(t) = ∫0ᵗ|P'(τ)|dτ provides a natural parameter representation of the path, facilitating subsequent motion planning. Through Bezier curve fitting and parameterization, a complete set of curve path parameters is generated. -1 , corresponding to a minimum turning radius of 1.25 m, which satisfies the robot kinematic constraints. Parameter validation is performed by checking curvature continuity and path feasibility to ensure that the generated curve parameters meet the physical constraints. The velocity profile matches the curvature distribution, with reduced speed v = v_max√(R_min / R(t)) in high-curvature areas and increased efficiency on straight segments. Arc length parameterization s(t) = ∫0ᵗ|P'(τ)|dτ provides a natural parameter representation of the path, facilitating subsequent motion planning. Through Bezier curve fitting and parameterization, a complete set of curve path parameters is generated.
[0065] Based on the initial navigation path through the area, the terrain undulation information is inferred from the aforementioned environment implicit features F_hidden, generating three-dimensional path parameters. The environment implicit features F_hidden contain four dimensions of temporal inverse features: constraint strength, path preference, risk level, and traffic efficiency, which are inherently related to the terrain undulation. Terrain inference uses multidimensional correlation analysis: areas with constraint strength f_constraint>0.7 usually correspond to height changes such as steps or slopes; path preference f_preference<0.3 indicates a historical avoidance tendency, often corresponding to uneven terrain; risk level f_risk>0.6 is related to terrain changes, with higher risk at locations such as step edges; and traffic efficiency f_efficiency<0.5 indicates that the actual speed is lower than the theoretical value, with uphill and downhill being the main reason. For example, when "Xiaozhi" path passes through the edge of the carpet, F_hidden shows a combination of high constraint, low preference, high risk, and low efficiency features, inferring a height change of 0.02m. Terrain type recognition is based on feature combination patterns, and the undulation direction is determined by spatial gradients. The height change sequence H(s)=[h0,h1,...,h n ] is arranged according to the path arc length parameter, with a resolution of 0.05m. The vertical velocity dh / ds reflects the slope, and the pitch angle pitch(s)=arctan(dh / ds) describes the attitude adjustment. Parameter interpolation ensures continuity, and safety verification ensures within the physical limit range. Through F_hidden feature inference, complete three-dimensional path parameters are generated.
[0066] Based on the generated curve path parameters, three-dimensional path parameters and navigation gain parameters, multi-dimensional fusion is performed to generate an adaptive navigation sequence. A hierarchical structure is adopted: the geometric layer fuses the curve parameters and three-dimensional parameters to form a spatial path, the dynamics layer combines the navigation gain parameters to generate a motion sequence, and the control layer converts the motion sequence into execution instructions. The geometric fusion function Path_3D(s)=[x(s),y(s),h(s)]^T combines the two-dimensional curve path and the height variation sequence, where s is the arc length parameter. The four components of the navigation gain parameter (path correction gain, static obstacle avoidance margin, dynamic obstacle avoidance margin and scene weight) play a modulating role in fusion: the path correction gain compensates for systematic position errors, the static safety margin affects the distance between the path and the obstacle, the dynamic margin adjusts the safety distance according to the speed, and the scene weight balances different environmental strategies. The sequence update adopts a sliding window mechanism, and the window size is set to 2m. The parameters of the front path segment are updated in real time. For example, when "Xiaozhi" detects a new strong phase change region in front, the adaptive mechanism automatically adjusts the speed profile and safety margin of the region to ensure safe passage. The time parameterization of the navigation sequence is achieved through speed planning, considering the dynamic constraints of the robot and the task efficiency requirements. The speed profile V(s) is dynamically adjusted according to the path curvature κ(s), the terrain slope dh / ds and the safety margin in the aforementioned navigation gain parameters: V(s)=min(V_max,V_curve(κ),V_terrain(dh / ds),V_safety(margin)), where V(s) is the planned speed at arc length parameter s, V_max is the maximum allowed speed, V_curve(κ) is the speed limit based on curvature restriction (related to the aforementioned minimum turning radius R_min), V_terrain(dh / ds) is the speed limit based on terrain slope, and V_safety(margin) is the speed limit based on static and dynamic safety margins. Acceleration planning ensures the smoothness of speed changes, and the maximum acceleration and deceleration do not exceed the physical capabilities of the robot. The time stamp T(s)=∫[0→s]ds / V(s) provides the expected arrival time of each point on the path. Through the above multi-dimensional fusion and adaptive adjustment, the final generated navigation sequence can effectively cope with sensor defects and environmental uncertainties, and realizes stable, safe and efficient autonomous navigation control of humanoid robots in complex environments.
[0067] To perform the above-mentioned method embodiment corresponding to the humanoid robot navigation method based on defect complementation, to realize the corresponding functions and technical effects. Referring to Figure 2 , Figure 2 A structure block diagram of a humanoid robot navigation device 200 based on defect complementation provided by an embodiment of the present application is shown. For ease of illustration, only the parts related to the present embodiment are shown. The humanoid robot navigation device 200 based on defect complementation provided by the present embodiment includes: The defect analysis module 201 is configured to acquire humanoid robot navigation data, perform defect feature extraction and identification on the navigation data, measure defect points and data hollow areas, perform spatial distribution analysis based on the measured defect points and the data hollow areas, and generate a defect feature map; The gain generation module 202 is configured to establish a confidence-decreasing verification based on the defect feature map to obtain multi-level perception results, determine sensor weight distribution according to the multi-level perception results, extract negative error values of each sensor from the defect feature map based on the sensor weight distribution to generate a negative error feature set, and generate a navigation gain parameter by using the negative error feature set. The reverse field construction module 203 is configured to extract data back information by performing reverse analysis on the navigation data based on the navigation gain parameter, reconstruct environment implicit features based on the data back information, and construct a reverse navigation field by combining the environment implicit features and the navigation gain parameter. The phase change rule module 204 is configured to generate a hollow density map based on the spatial distribution density of the data hollow areas by analyzing the reverse navigation field, extract hollow clustering features and hollow connectivity modes from the hollow density map, set a density threshold to divide a path phase change area according to the hollow density map, and generate a path phase change rule set based on the path phase change area, the hollow clustering features, and the hollow connectivity modes. The path generation module 205 is configured to generate an initial navigation path according to the path phase change rule set and the reverse navigation field, perform morphological transformation on the initial navigation path to generate a curve path parameter and a three-dimensional path parameter, and generate an adaptive navigation sequence by fusing the curve path parameter, the three-dimensional path parameter, and the navigation gain parameter.
[0068] The humanoid robot navigation device 200 based on defect complementation described above can implement the humanoid robot navigation method based on defect complementation of the method embodiment described above. The optional items in the method embodiment described above are also applicable to the present embodiment, and will not be described in detail herein. The remaining contents of the present embodiment can be referred to the contents of the method embodiment described above, and will not be described in detail herein.
[0069] As shown in Figure 3 The third embodiment of the present application further provides a computer device, which comprises a memory 301, a processor 302, and a computer program stored in the memory 301 and executable on the processor 302, and characterized in that the processor 302 implements the steps of the humanoid robot navigation method based on defect complementation of the first embodiment of the present application when executing the program.
[0070] The above examples are intended to illustrate and deduce the technical solutions of the present application, and to completely describe the technical solutions, objects and effects of the present application. The purpose is to make the public more thoroughly and comprehensively understand the disclosed content of the present application, and does not limit the protection scope of the present application.
[0071] The above examples are not based on an exhaustive enumeration of the present application, and there can be many other unlisted embodiments. Any substitution and improvement made without violating the concept of the present application shall fall within the protection scope of the present application.
Claims
1. A humanoid robot navigation method based on defect complementarity, characterized in that, include: Obtain navigation data of a humanoid robot, extract and identify defect features based on the navigation data, measure defect points and data void areas, and perform spatial distribution analysis based on the measured defect points and data void areas to generate a defect feature map; The defect feature map is used to establish confidence-decreasing verification to obtain multi-level perception results. Sensor weight allocation is determined based on the multi-level perception results. Based on the sensor weight allocation, negative error values of each sensor are extracted from the defect feature map to generate a negative error feature set. Navigation gain parameters are generated using the negative error feature set. The navigation data is reverse-analyzed using the navigation gain parameters to extract back-side information. Based on the back-side information, the implicit features of the environment are reconstructed. The implicit features of the environment and the navigation gain parameters are then combined to construct a reverse navigation field. Based on the analysis of the spatial distribution density of the data void region in the reverse navigation field, a void density map is generated. Void clustering features and void connectivity patterns are extracted from the void density map. Path phase transition regions are divided according to the density threshold set in the void density map. A path phase transition rule set is generated based on the path phase transition regions, the void clustering features, and the void connectivity patterns. An initial navigation path is generated based on the path phase transition rule set and the reverse navigation field. The initial navigation path is then subjected to morphological transformation to generate curved path parameters and three-dimensional path parameters. The curved path parameters, the three-dimensional path parameters, and the navigation gain parameters are then fused to generate an adaptive navigation sequence.
2. The method as described in claim 1, characterized in that, The step of determining sensor weight allocation based on the multi-level perception results includes: Extract sensor response intensity and stability indicators from the multi-level sensing results; The contribution of the sensor at different confidence levels is calculated based on the response intensity. Dynamic weight coefficients are generated based on the stability index and the contribution, and the dynamic weight coefficients are normalized to generate sensor weight allocation.
3. The method as described in claim 1, characterized in that, The step of generating navigation gain parameters using the negative error feature set includes: Based on the negative error feature set, the positioning negative deviation component and the ranging negative error component are decomposed; A path correction gain is generated based on the negative positioning deviation component; An obstacle avoidance safety margin is generated based on the negative ranging error component. Navigation gain parameters are generated by fusing the path correction gain and the obstacle avoidance safety margin.
4. The method as described in claim 1, characterized in that, The reconstruction of implicit environmental features based on the back-side information of the data includes: The reverse features of historical trajectories are obtained by performing time-series inversion on the back information of the data; Identify missing data areas from the back-side information of the data and map them as potentially passable areas; Numerical rate of change analysis is performed on the back of the data to infer the location of the environmental boundary; The inverse features, the potentially passable areas, and the location of the environmental boundaries are combined to generate complete implicit environmental features.
5. The method as described in claim 1, characterized in that, Based on the reverse navigation field analysis, the spatial distribution density of the data hole region is analyzed to generate a hole density map, including: Locate the three-dimensional coordinates of the data void region in the reverse navigation field; The number of voids per unit volume is calculated based on the three-dimensional coordinates to generate a local density value; Spatial interpolation is performed on the local density values to generate a continuous density distribution; The continuous density distribution is mapped to a two-dimensional raster map to generate a hole density map.
6. The method as described in claim 1, characterized in that, Based on the void density map, a density threshold is set to divide the path phase transition region, including: Calculate the global average density and local peak density of the void density map; A baseline threshold is set based on the global average density, and a dynamic threshold is set based on the local peak density. Regions with density exceeding the dynamic threshold are marked as strong phase transition regions, and regions with density between the baseline threshold and the dynamic threshold are marked as weak phase transition regions. The strong phase transition region and the weak phase transition region are merged to generate a complete path phase transition region.
7. The method as described in claim 1, characterized in that, The step of performing morphological transformation on the initial navigation path to generate curved path parameters and three-dimensional path parameters includes: Based on the path phase transition rule set, determine the segment in the initial navigation path corresponding to the path phase transition region; Insert Bessel control points based on the start and end points of the segment; Based on the Bessel control points, smooth curve parameters are generated as curve path parameters; Based on the implicit environmental features of the areas traversed by the initial navigation path, terrain undulation information is extracted, and a height change sequence is generated as a three-dimensional path parameter based on the terrain undulation information.
8. The method as described in claim 4, characterized in that, Performing time-series inversion on the back information of the data to obtain the inverse features of the historical trajectory includes: Based on the back information of the data, a reverse time series is generated by arranging the data in reverse order according to the timestamps. Based on the reverse time series, the position difference between adjacent time points is extracted to generate a reverse motion vector. Based on the inverse motion vector, identify abrupt changes in direction and anomalies in velocity, and infer the intensity of environmental constraints based on the spatial distribution density of the abrupt changes in direction and anomalies in velocity. The inverse features of the historical trajectory are generated based on the environmental constraint strength.
9. A humanoid robot navigation device based on defect complementarity, characterized in that, include: The defect analysis module is used to acquire navigation data of the humanoid robot, extract and identify defect features based on the navigation data, measure defect points and data void areas, and perform spatial distribution analysis based on the measured defect points and data void areas to generate a defect feature map. The gain generation module is used to establish confidence-decreasing verification to obtain multi-level perception results using the defect feature map, determine sensor weight allocation based on the multi-level perception results, extract negative error values of each sensor from the defect feature map based on the sensor weight allocation to generate a negative error feature set, and generate navigation gain parameters using the negative error feature set. The reverse field construction module is used to perform reverse parsing on the navigation data through the navigation gain parameters to extract back information of the data, reconstruct the implicit features of the environment based on the back information of the data, and construct the reverse navigation field by combining the implicit features of the environment and the navigation gain parameters. The phase transition rule module is used to generate a hole density map based on the spatial distribution density of the data hole region analyzed by the reverse navigation field, extract hole clustering features and hole connectivity patterns from the hole density map, divide the path phase transition region according to the density threshold set by the hole density map, and generate a path phase transition rule set based on the path phase transition region, the hole clustering features and the hole connectivity patterns. The path generation module is used to generate an initial navigation path based on the path phase transition rule set and the reverse navigation field, perform morphological transformation on the initial navigation path to generate curved path parameters and three-dimensional path parameters, and fuse the curved path parameters, the three-dimensional path parameters and the navigation gain parameters to generate an adaptive navigation sequence.
10. A computer device, characterized in that, It includes a memory and a processor; the memory is used to store a computer program; the processor is used to execute the computer program and, when executing the computer program, implement the method as described in any one of claims 1 to 8.
Citation Information
Patent Citations
Intelligent evacuation method and device based on convolutional neural network, and storage medium
CN117332914A
Road disease detection method and system based on autonomous agent
CN119131739A
Path planning method based on improved artificial potential field method
CN119916803A
Autonomous navigation path planning method and device for humanoid robot in complex environment
CN120447563A
Humanoid robot inertial navigation and vision fusion positioning method, device and equipment
CN120558242A
Cited By
Perovskite thin film defect tracing method and system
CN121365343A
Automobile part defect identification method and system based on image enhancement
CN121458712A