Obstacle avoidance control method based on dynamic obstacle trajectory prediction
By using a mixture of Gaussian process regression algorithm and an adaptive trajectory prediction framework based on social force model, the problem of nonlinear motion prediction of dynamic obstacles in complex dynamic environments is solved, achieving efficient and safe obstacle avoidance control and improving the real-time performance and robustness of the system.
Patent Information
- Application Number
- CN202511966646.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-12-24
- Publication Date
- 2026-03-03
AI Technical Summary
Existing technologies struggle to accurately predict the nonlinear motion of dynamic obstacles in complex dynamic environments, leading to delayed obstacle avoidance decisions, path oscillations, and increased collision risks. Furthermore, the lack of feedback adjustment mechanisms prevents dynamic adjustment of prediction granularity and frequency, impacting the system's robustness and safety.
An adaptive trajectory prediction framework is constructed by combining a Gaussian mixture process regression algorithm with a social force model that incorporates scene topology constraints and attention mechanisms. Obstacle data is acquired in real time through a multi-source sensor fusion system to generate interactive intent-enhanced predicted trajectories. The path is optimized through closed-loop feedback obstacle avoidance decision-making, and the prediction model parameters and interaction weights are dynamically updated.
It improves the accuracy and robustness of trajectory prediction, enhances the foresight and social compatibility of obstacle avoidance decisions, reduces prediction errors and path oscillations, improves the safety and reliability of the system, and meets the requirements of high real-time performance.
Smart Images

Figure CN121596879A_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the field of artificial intelligence and intelligent control technology, specifically relating to an obstacle avoidance control method based on dynamic obstacle trajectory prediction. Background Technology
[0002] With the widespread application of intelligent mobile robots and autonomous driving systems, their autonomous navigation capability in complex dynamic environments has become a core challenge for achieving safe and reliable operation. Traditional obstacle avoidance control methods mainly rely on a strategy combining static map construction and real-time sensor perception, planning local paths by detecting the spatial position of obstacles at the current moment. While these methods perform well with stationary or low-speed obstacles, they struggle to cope with rapidly moving or non-linearly oriented obstacles in high-density dynamic scenarios, leading to delayed obstacle avoidance decisions, path oscillations, and even increased collision risks. Especially in densely populated areas, unmanned delivery channels, or industrial AGV collaborative operation environments, the system needs to complete environmental understanding, motion trend judgment, and control command output within milliseconds, placing stringent demands on prediction accuracy and real-time response.
[0003] Among them, obstacle avoidance control based on dynamic obstacle trajectory prediction aims to predict the future spatiotemporal distribution of obstacles by modeling their motion patterns, thereby providing a forward-looking decision-making basis for the main control system. The basic principle of this method is to estimate the velocity, acceleration, and steering characteristics of obstacles using historical observation data, and based on this, to deduce their possible pose sequences over several future time steps. The prediction results are then integrated into a local path optimization framework, achieving a shift from "reactive" to "predictive" control. An ideal prediction mechanism should be able to balance motion continuity and behavioral uncertainty, capturing potential sudden trajectory changes while ensuring computational efficiency.
[0004] However, existing technologies generally rely on single Kalman filtering or geometric extrapolation methods for trajectory prediction, which struggles to accurately characterize nonlinear changes under complex motion patterns, leading to significant long-term prediction bias accumulation. Furthermore, traditional obstacle avoidance controllers decouple the prediction and control modules, lacking feedback adjustment mechanisms and failing to dynamically adjust prediction granularity and update frequency according to control requirements. In addition, the prediction process does not fully integrate contextual semantic information (such as scene topology constraints and interaction intent inference), resulting in insufficient responsiveness to high-risk behaviors such as sudden entry, abrupt stops, or detours, severely impacting the overall system's robustness and safety. Therefore, there is an urgent need for an obstacle avoidance method that deeply integrates dynamic obstacle trajectory prediction and real-time control decision-making to address the technical challenge of balancing safety and smoothness in complex dynamic environments. Summary of the Invention
[0005] The purpose of this invention is to provide an obstacle avoidance control method based on dynamic obstacle trajectory prediction, which can effectively solve the problems in the background art.
[0006] To achieve the above objectives, the technical solution adopted by the present invention is as follows: An obstacle avoidance control method based on dynamic obstacle trajectory prediction includes the following specific steps: Step (1) Collect dynamic obstacle observation data: The historical pose sequence of each dynamic obstacle in the environment is obtained in real time through a multi-source sensor fusion system. The historical pose sequence includes the position coordinates, motion direction angle and velocity vector under continuous time steps. The original observation data is time aligned and noise filtered to obtain a standardized obstacle motion state input. Step (2) Construct an adaptive trajectory prediction model: Based on the standardized obstacle motion state input, a nonlinear trajectory prediction framework is established by using a mixture of Gaussian process regression algorithm combined with prior knowledge of scene topology constraints. The Gaussian process kernel function adopts a weighted combination of radial basis function and periodic kernel. The weight coefficient is dynamically adjusted according to the current obstacle motion mode to output the probabilistic trajectory distribution within the next T time steps. The value of T ranges from 5 to 15; Step (3) Generate interactive intention-enhanced prediction trajectory: Introduce a social force model based on attention mechanism, take the spatial distribution and movement trend of other dynamic individuals around as context information input, calculate the potential interaction influence intensity between them, and correct the probabilistic trajectory distribution output in step (2) accordingly to form a joint prediction result that considers the social behavior law; Step (4) Execute closed-loop feedback obstacle avoidance decision: Inject the joint prediction result into the cost function of the local path planner in the form of a spatiotemporal occupancy grid, construct a composite cost field containing collision risk gradient and traffic efficiency factor, solve the safe, smooth and dynamically constrained optimal avoidance path through the fast marching tree optimization algorithm, and feed back the control deviation in the actual execution process to step (2) and step (3) for dynamically updating the prediction model parameters and interaction weights.
[0007] Preferably, the multi-source sensor fusion system in step (1) includes a three-dimensional lidar, a millimeter-wave radar, and a monocular vision camera. The sampling frequencies of the three are 10 Hz, 25 Hz, and 30 Hz, respectively. All sensor data are processed by a Kalman filter to achieve cross-modal synchronization and unified spatial coordinate transformation. The transformation accuracy is controlled within ±0.03 meters to ensure that the pose observations from different sources are strictly aligned on the time axis and to eliminate misjudgments of motion state caused by asynchronous sampling.
[0008] Preferably, in step (1), the noise filtering process adopts an improved wavelet threshold denoising method, which selects the db4 wavelet basis for 4-level decomposition, applies adaptive soft threshold processing to the detail coefficients of each level, and dynamically determines the threshold size based on the local signal-to-noise ratio. This effectively preserves the motion mutation characteristics while suppressing high-frequency random interference, reducing the velocity vector estimation error to less than or equal to 0.15 meters per second.
[0009] Preferably, in step (2), the Gaussian mixture process regression algorithm sets up two parallel processing branches. One branch focuses on modeling uniform or uniformly accelerated motion segments, using a radial basis function kernel, with its length scale parameter initialized to 1.2 seconds. The other branch is used to capture periodic or oscillating motions, using a periodic kernel, with the period parameter initially set to 0.8 seconds. The outputs of the two branches are weighted and fused through a learnable gating network, with the gating weights being updated in real time driven by the rate of change of acceleration in the current motion state.
[0010] Preferably, the prior knowledge of scene topology constraints in step (2) comes from a preloaded local semantic map. The semantic map marks the boundaries of pedestrian passages, prohibited areas and common walking paths. When the predicted trajectory crosses a prohibited area, a penalty term is automatically applied to reduce the probability density of the trajectory branch to no less than 75%, thereby guiding the prediction result to conform to the physical accessibility rules.
[0011] Preferably, in step (3), the social force model of the attention mechanism defines each dynamic individual as a node, constructs a spatiotemporal adjacency graph, and the connection weight between nodes is determined by the relative distance, the relative velocity direction angle and whether there is line-of-sight occlusion. The number of attention heads is set to 4, and each head independently calculates the distribution of interactive influence. Finally, the aggregated output corrects the movement trend of the main target individual, and the maximum correction is limited to within ±15 degrees of the original predicted direction angle.
[0012] Preferably, the calculation of the interaction influence intensity in step (3) introduces a psychological expectation deviation factor. This factor makes a binary judgment based on whether the obstacle ahead is within its predetermined path. If it is within the path, its influence weight is increased by 1.6 times; otherwise, it is reduced to 0.4 times. This simulates the human's priority attention to potential conflict objects during obstacle avoidance.
[0013] Preferably, in step (4), the temporal resolution of the spatiotemporal occupancy grid is 0.2 seconds, and the spatial resolution is 0.1 meters by 0.1 meters. Each grid cell stores the probability value of being occupied at different future times and its confidence level. The probability value comes from the joint prediction result output in step (3). The confidence level decreases according to the prediction time span, decreasing by 6 percentage points for each additional time step, with a minimum of no less than 20%.
[0014] Preferably, the cost function of the composite cost field in step (4) consists of three terms: the first term is the reciprocal of the static obstacle distance, with a weight coefficient of 0.8; the second term is the integral of the dynamic spatiotemporal occupancy probability, with a weight coefficient of 1.2; and the third term is the square of the path curvature, used to ensure smoothness of motion, with a weight coefficient of 0.3. The weighted sum of the three terms is used as the evaluation index of the fast moving tree algorithm to guide the search direction toward a low-risk, high-smoothness region.
[0015] Preferably, in step (4), the control deviation feedback mechanism monitors the lateral deviation and heading angle error between the actual control path and the planned path. When the average deviation exceeds 0.2 meters or the heading angle error exceeds 8 degrees within three consecutive control cycles, the prediction model recalibration process is triggered. The observation data fragments under the current environment are cached and used for online fine-tuning of the Gaussian process hyperparameters in step (2) and the attention weight matrix in step (3). The fine-tuning learning rate is set to 0.01.
[0016] Preferably, it also includes a mechanism for dynamically adjusting the prediction time window T. The initial value of T is set to 10, and it is adjusted bidirectionally according to the current system load and the average relative speed of the obstacle. When the processor utilization is higher than 80% or the average relative speed in the last 5 seconds is lower than 0.5 meters per second, T is reduced to 7; when a high-speed approaching target (relative speed greater than 2 meters per second) is detected, T is increased to 13 to balance computational overhead and prediction foresight.
[0017] Preferably, it also includes an abnormal behavior detection submodule. This module monitors the consistency residual between the actual movement trajectory of each obstacle and its predicted trajectory. When the standard deviation of the residual sequence increases by more than twice the original mean within 5 consecutive sampling periods, it is determined that the obstacle has sudden maneuvering behavior. The high-frequency re-prediction mode is immediately activated, and the prediction update period is shortened from the default 0.5 seconds to 0.2 seconds until the behavior tends to stabilize.
[0018] Preferably, the method is deployed on an embedded vehicle computing platform equipped with a dual-core ARM processor and a dedicated neural network acceleration unit. The overall algorithm cycle is controlled within 80 milliseconds, which meets the real-time requirements of complex dynamic scenarios and supports the simultaneous tracking and prediction of the motion trajectories of no less than 32 dynamic obstacles.
[0019] Compared with the prior art, the present invention has the following beneficial effects: To improve the accuracy and robustness of trajectory prediction, the algorithm integrates multiple motion mode modeling capabilities through a Gaussian mixture process regression algorithm, overcoming the poor adaptability of a single Kalman filter to nonlinear motion. Under complex behaviors such as frequent pedestrian changes of direction and sudden stops and starts, the prediction error is reduced by more than 42% compared to traditional methods. By combining prior knowledge of scene topology constraints, the algorithm effectively eliminates unreachable path prediction branches, improving the rationality of long-term predictions by 68% and significantly reducing ineffective braking or detours caused by misprediction.
[0020] To enhance the foresight and social compatibility of obstacle avoidance decisions, a social force model based on attention mechanisms is introduced to achieve explicit modeling of multi-agent interaction relationships. This enables prediction results to reflect group movement trends and individual avoidance habits, generating more natural and easily understood travel trajectories in dense crowds. User subjective evaluation comfort score is improved to 4.7 out of 5. The composite cost field design comprehensively considers dynamic risk and motion smoothness, avoiding path oscillations and improving the stability of control command output by 55%.
[0021] Achieving deep coupling and dynamic adaptation between prediction and control, a closed-loop feedback mechanism is established, which reverses the control execution deviation to update the prediction model parameters, forming a complete loop of perception-prediction-decision-execution-feedback. The system has adaptive optimization capabilities during continuous operation, and the learning convergence time for new motion modes is shortened to less than 90 seconds. The strategy of dynamically adjusting the prediction time window and update frequency makes the allocation of algorithm resources more efficient, ensuring the prediction quality of key scenarios while keeping the overall computational load fluctuation within 15%.
[0022] Meeting the requirements of high real-time performance and engineering implementation, the optimized algorithm chain can run stably on mainstream embedded platforms with an end-to-end latency of less than 80 milliseconds, supporting millisecond-level response in high-density dynamic environments; the abnormal behavior detection and re-prediction mechanism effectively copes with emergencies, and the collision warning response time is reduced to more than 1.2 seconds, which is 2.3 times faster than the decoupled architecture, greatly improving the system's security and reliability. Attached Figure Description
[0023] Figure 1 This is a schematic diagram of the overall technical solution architecture of an obstacle avoidance control method based on dynamic obstacle trajectory prediction proposed in this invention. Figure 2 This is a schematic diagram of the core principle framework of adaptive trajectory prediction and interactive intent-enhanced obstacle avoidance decision-making in this invention. Detailed Implementation
[0024] Please refer to Figure 1 and Figure 2 In the above-mentioned obstacle avoidance control method based on dynamic obstacle trajectory prediction, step (1) collects dynamic obstacle observation data: the historical pose sequence of each dynamic obstacle in the environment is obtained in real time through a multi-source sensor fusion system. The historical pose sequence includes the position coordinates, motion direction angle and velocity vector under continuous time step. The original observation data is time aligned and noise filtered to obtain standardized obstacle motion state input.
[0025] Specifically, the multi-source sensor fusion system consists of a 3D LiDAR, a millimeter-wave radar, and a monocular vision camera. These three components operate independently at sampling frequencies of 10 Hz, 25 Hz, and 30 Hz, respectively, continuously scanning dynamic targets within a 30-meter radius around the vehicle. The 3D LiDAR uses a 905 nm wavelength light source, with a horizontal field of view of 360 degrees, a vertical field of view of 30 degrees, and an angular resolution of 0.2 degrees. It outputs raw point cloud data streams, with each frame containing no fewer than 128,000 3D spatial points. The millimeter-wave radar operates in the 77 GHz band, with a maximum detection range of 150 meters, a distance resolution of 0.5 meters, and a velocity resolution of 0.2 meters per second. It has the ability to penetrate rain and fog, supplementing the detection of moving targets under low visibility conditions. The monocular vision camera is equipped with a global shutter CMOS sensor with a resolution of 1920 pixels × 1080 pixels and a frame rate of 30 frames per second. It uses the YOLOv5 target detection network to achieve real-time semantic recognition of pedestrians, non-motorized vehicles, and motorized vehicles, and outputs two-dimensional bounding boxes with category labels and their corresponding pixel coordinates. All sensors are time-synchronized via hardware trigger signals. Their raw data streams are sent to the central data buffer of the in-vehicle embedded computing platform. This buffer adopts a ring buffer structure with a capacity of 1024 megabytes and supports cyclic writing and multi-threaded concurrent reading.
[0026] The time alignment of cross-modal data is performed by an extended Kalman filter, which projects observations from different sampling times to a unified timestamp based on the master clock, with time interpolation accuracy controlled within ±5 milliseconds. Spatial coordinate unification is achieved through a pre-calibrated extrinsic parameter matrix. Point cloud data from 3D LiDAR and millimeter-wave radar are mapped to a right-handed coordinate system with the optical center of the monocular vision camera as the origin via rigid body transformation. During the transformation, the least squares method is used to optimize the rotation matrix and translation vector, ensuring that the positional deviation after transformation is less than or equal to ±0.03 meters. After spatiotemporal alignment, the multi-source observation data is aggregated by timestamp, forming data packets with a period of 50 milliseconds. Each data packet contains joint observations of the same obstacle from multiple sensors at the same time. For each tracked dynamic obstacle, the system maintains an independent observation record queue with a first-in, first-out structure, storing up to 10 historical pose data points (T=10) for subsequent modeling.
[0027] The position coordinates are expressed in meters, rounded to three decimal places, as (x, y) two-dimensional plane coordinates. The motion direction angle is expressed in radians, ranging from -π to π, with eastward defined as 0 and counterclockwise rotation as positive. The velocity vector contains magnitude and direction components, with magnitude in meters per second and direction consistent with the motion direction angle. Outliers in the original observation data are first removed using a statistical outlier detection algorithm, with a threshold set at three times the standard deviation. If the position or velocity of an observation deviates from its sliding window mean by more than this threshold, it is marked as invalid and discarded. Noise filtering employs an improved wavelet thresholding method, using the db4 wavelet basis function to perform a four-level discrete wavelet decomposition of the velocity vector sequence. The decomposition process is recursively implemented using the Mallat algorithm, generating a set of approximation coefficients and detail coefficients for each level. Adaptive soft thresholding is applied to the detail coefficients of levels 1 to 4, with the soft threshold function expression being: ,in These are the original detail coefficients. The threshold is dynamically determined. The local signal-to-noise ratio (SNR) is calculated in real-time, estimated by the ratio of signal energy to noise energy within the current window. Signal energy is taken from the sum of squares of approximation coefficients, and noise energy is taken from the standard deviation of the highest-level detail coefficients multiplied by a constant factor of 0.6745. When the local SNR exceeds 15 dB, a threshold is set. Set as a general heuristic value ,in This is an estimate of the noise standard deviation. The sequence length is defined as follows: when the signal-to-noise ratio is below 15 dB, a correction factor k=1.5 is introduced to increase the threshold and enhance the denoising strength. The denoised wavelet coefficients are reconstructed into a smooth velocity sequence through inverse transform, while retaining abrupt changes such as rapid acceleration or deceleration. Experimental verification shows that this method can stably reduce the velocity vector estimation error to less than or equal to 0.15 m / s. The final output, the standardized obstacle motion state input, is encapsulated in a structured data format, including a unique obstacle ID, a timestamp sequence, a filtered position coordinate sequence, an orientation angle sequence, and a velocity vector sequence. All data types are double-precision floating-point, with a memory footprint not exceeding 2 kilobytes per obstacle, meeting the efficient access requirements of subsequent modules.
[0028] In the above method, step (2) constructs an adaptive trajectory prediction model: based on the standardized obstacle motion state input, a nonlinear trajectory prediction framework is established using a Gaussian process mixture regression algorithm combined with prior knowledge of scene topological constraints. The Gaussian process kernel function adopts a weighted combination of radial basis functions and periodic kernels, with the weight coefficients dynamically adjusted according to the current obstacle motion mode. The probabilistic trajectory distribution within the next T time steps is output, where T ranges from 5 to 15. Specifically, the Gaussian process mixture regression algorithm sets up two parallel processing branches. One branch focuses on modeling uniform or uniformly accelerated motion segments, using a radial basis function kernel (RBF Kernel), whose covariance function is defined as: in For signal variance, The squared time difference indicates that the closer the time points are, the higher the similarity. An exponential function ensures that the kernel value is always positive and decays rapidly with increasing distance. The value of the RBF kernel function represents the time point. and The similarity measure between them, used to calculate the elements of the covariance matrix, is initialized to 1.0. This is a length scale parameter, initialized to 1.2 seconds. This parameter determines the smoothness of the motion trend; longer durations result in smoother motion. This value corresponds to a slower change and is suitable for scenarios where pedestrians walk at a constant speed or vehicles travel in a straight line. Another approach is used to capture periodic or oscillating motions, employing a periodic kernel, whose covariance function is defined as: in The variance of the periodic signal is initialized to 0.8. It is a sine square function, achieving periodic repetition. This is the period parameter, initially set to 0.8 seconds, corresponding to the basic rhythm of the human walking gait. The length scale within the period is initialized to 0.5 seconds. Both branches receive the same input training dataset, which is the historical pose sequence of the past 10 time steps output by step (1). Each branch independently solves the mean and covariance matrix of the Gaussian process regression to generate the corresponding trajectory prediction distribution.
[0029] The outputs of the two branches are weighted and fused through a learnable gating network, which is a single-layer fully connected neural network. The input feature is the rate of change of acceleration of the current motion state, i.e., jerk = Δa / Δt, which is extracted from the velocity sequence through numerical differentiation, with a sampling interval of 0.5 seconds. If the absolute value of jerk is greater than 0.8 m / s³, it is judged as a violent maneuvering state, and the output weight of the gating network is biased towards the RBF branch with a ratio of 0.8:0.2; if jerk is between 0.2 and 0.8, the intermediate weight of 0.6:0.4 is used; if jerk is less than 0.2, it is considered to be in a stable periodic motion state, and the periodic kernel is given a higher weight of 0.3:0.7.
[0030] The gating weights are updated every 200 milliseconds to ensure rapid response to motion mode switching. The fused joint kernel function is represented as k_combined = w_rbf × k_RBF + w_per × k_Per. Based on this kernel function, a complete covariance matrix K is constructed, and the predicted distribution for the next T time steps is solved. The output is the mean μ_t and variance Σ_t of the position at each time step, forming a probabilistic trajectory distribution. The initial value of T is set to 10, but it is adjusted bidirectionally according to the current system load and the average relative speed of obstacles.
[0031] The specific adjustment logic is as follows: The system monitors the processor utilization rate in real time. If the average utilization rate is higher than 80% within three consecutive control cycles, T is reduced to 7 to reduce the computational load. If the average relative speed of all tracked obstacles is lower than 0.5 meters per second within the last 5 seconds, T is also reduced to 7, as the movement of low-speed targets is highly predictable and does not require long-term look-ahead. Conversely, when the relative speed between any obstacle and the vehicle is detected to be greater than 2 meters per second, T is immediately increased to 13 to improve the early warning capability for high-speed approaching targets. The prior knowledge of scene topology constraints comes from a pre-loaded local semantic map, which is stored in raster form with a spatial resolution of 0.2 meters × 0.2 meters. The annotation information includes pedestrian passage boundaries, prohibited areas (such as green belts and walls), and common walking path directions (represented by vector arrows). During trajectory prediction, if a candidate trajectory branch crosses a prohibited area, a penalty term is applied to the probability density of that trajectory. The penalty mechanism is implemented by modifying the covariance matrix. Specifically, the prediction variance at the crossing point is artificially amplified by more than 3 times, causing its proportion in the multimodal distribution to decrease significantly, thereby reducing the overall probability density of that trajectory branch by no less than 75%.
[0032] Furthermore, for predicted points located within pedestrian walkways, the system introduces a path alignment consistency reward. If the predicted direction angle is less than 30 degrees from the main direction of the walkway, its probability weight is appropriately increased to guide the prediction results to conform to physical accessibility rules and human walking habits. The entire prediction model is deployed on a dedicated neural network acceleration unit, using fixed-point quantization technology to compress floating-point weights to INT8 format, keeping inference latency within 18 milliseconds.
[0033] In the above method, step (3) generates an interactive intent-enhanced prediction trajectory: a social force model based on attention mechanism is introduced, and the spatial distribution and movement trend of other dynamic individuals in the surrounding area are used as contextual information input to calculate the potential interaction intensity between them. Based on this, the probabilistic trajectory distribution output in step (2) is corrected to form a joint prediction result that considers the laws of social behavior.
[0034] Specifically, the social force model of the attention mechanism defines each dynamic individual as a node in the graph and constructs a spatiotemporal adjacency graph G=(V, E), where V is the set of nodes, representing all tracked dynamic obstacles within the current field of view, including the main target individual and other pedestrians or moving objects within a radius of 8 meters around it; E is the set of edges, which establishes a connection only when the Euclidean distance between two nodes is less than 6 meters, to avoid interference from distant irrelevant individuals in the calculation.
[0035] The node feature vector contains five dimensions: current position coordinates (x, y), motion direction angle θ, velocity magnitude v, and acceleration a, for a total of 5 dimensions. After normalization, it is input into the model. The connection weights between nodes are determined by three factors: relative distance d_ij, normalized to the [0,1] interval using the inverse proportional function 1 / (1+d_ij); relative velocity direction angle α_ij, defined as the cosine of the angle between two velocity vectors, cosα_ij∈[-1,1], mapped to [0,1] using the Sigmoid function; and whether there is line-of-sight occlusion, determined by the continuity of the 3D LiDAR point cloud along the line connecting the two points. If continuous points exist, it is considered unoccluded and encoded as 1; otherwise, it is 0. The final connection weight w_ij = (1 / (1+d_ij)) × σ(cosα_ij) × occlusion_flag, where σ is the Sigmoid function.
[0036] The attention mechanism employs a multi-head self-attention structure with four attention heads. Each head independently performs the following operations: First, it generates a query vector Q, a key vector K, and a value vector V through a linear transformation, each with a dimension of 32. It then calculates the attention score A_ij = softmax(Q_i K_j^T / √d_k), where d_k = 32 is a scaling factor. Based on A_ij, it weights and aggregates the V vectors of neighboring nodes to obtain the output feature of that head. The outputs of the four heads are concatenated along the feature dimensions, linearly projected back to the original dimensions, and residual connections are then superimposed to finally output the interaction influence embedding vector of the primary target individual. The calculation of the interaction influence intensity introduces a psychological expectation bias factor β. This factor makes a binary judgment based on whether the obstacle ahead is within the predetermined path. The judgment method is as follows: taking the current position of the main target individual as the starting point and the initial direction of its predicted trajectory as the axis, a fan-shaped area with an angle of 60 degrees and a depth of 5 meters is constructed. If the predicted position of other dynamic individuals falls within this fan-shaped area, it is judged as "within the path", and β=1.6 is set; otherwise, it is judged as "non-conflict object", and β=0.4 is set. This factor directly affects the attention score A_ij, which is corrected to A'_ij = A_ij × β, thus prioritizing potential conflict objects when aggregating neighbor influences. The total correction amount δθ after aggregation is output in the form of angle, representing the adjustment suggestion for the movement direction angle of the main target individual at the next moment. The maximum correction range is limited to ±15 degrees of the original predicted direction angle to prevent excessive intervention from causing prediction distortion.
[0037] The correction process is achieved by reweighting the probabilistic trajectory distribution output in step (2): for each possible trajectory sample, its orientation angle θ_pred at the next moment is calculated. If there is a correction amount δθ from the social force model, the new orientation angle θ_new = θ_pred + δθ. Then, the spatial conflict degree between the trajectory and other individuals is reassessed. If the conflict decreases, its probability weight is increased; otherwise, it is decreased. The final joint prediction result is a set of weighted trajectory samples, with no less than 50 samples. Each sample contains a position sequence, orientation angle sequence, and confidence score for the next T time steps. The confidence score comprehensively considers the trajectory prior rationality, interaction coordination, and motion dynamics feasibility. The overall computation time of this module is controlled within 22 milliseconds, and it supports parallel processing of interactive modeling of no less than 32 dynamic obstacles.
[0038] In the above method, step (4) performs closed-loop feedback obstacle avoidance decision-making: the joint prediction results are injected into the cost function of the local path planner in the form of a spatiotemporal occupancy grid, a composite cost field containing collision risk gradient and traffic efficiency factor is constructed, the optimal avoidance path that is safe, smooth and conforms to dynamic constraints is solved by the fast marching tree optimization algorithm, and the control deviation in the actual execution process is fed back to steps (2) and (3) for dynamically updating the prediction model parameters and interaction weights.
[0039] Specifically, the spatiotemporal occupancy grid has a temporal resolution of 0.2 seconds and a spatial resolution of 0.1 m × 0.1 m, covering a rectangular area centered on the vehicle, 15 meters in front and behind, and 8 meters to the left and right, with a total size of 300 × 160 grid units. The grid structure is organized by time slices, containing a total of T_slice = T / 0.2 time layers. For example, when T = 10, T_slice = 50 layers, and each layer corresponds to the spatial occupancy probability distribution at a future moment. Each grid unit stores two core data: the probability value of being occupied, p_occ ∈ [0,1], and the confidence level, c_level ∈ [20%, 100%]. The probability value p_occ comes from the joint prediction result output in step (3), and is obtained by statistical histogram estimation of the occupancy of all trajectory samples at the corresponding spatiotemporal positions, i.e., p_occ(x,y,t) = number of samples falling into (x,y) at time t / total number of samples. The confidence level, c_level, decreases progressively with the prediction time span. The base value is 100%, decreasing by 6 percentage points for each additional time step (0.2 seconds), i.e., c_level(t) = max(100% - 6% × (t / 0.2), 20%), with a minimum of 20%, reflecting the uncertainty of long-term predictions. Spatiotemporal occupancy raster data is stored in shared memory as a three-dimensional array, with an update cycle of 500 milliseconds, synchronized with the refresh rate of the external environment sensing system by default.
[0040] The cost function of the composite cost field consists of three terms: the first term is the reciprocal of the static obstacle distance, C_static = 1 / (d_obs + ε), where d_obs is the distance from the current candidate path point to the nearest static obstacle, and ε is a minimal constant of 0.01 to prevent division by zero errors. The weight coefficient of this term is set to 0.8. The second term is the dynamic spatiotemporal occupancy probability integral, C_dynamic = ∫ p_occ(s,t) ds dt, which represents the cumulative risk of traversing a high-probability occupied area along path s in the future time period. The weight coefficient of this term is set to 1.2, reflecting the high importance attached to dynamic risk. The third term is the path curvature square term, C_curvature = ∑(κ_i)^2, where κ_i is the curvature of the i-th discrete point on the path, calculated by the three-point circle fitting method. The weight coefficient of this term is set to 0.3 to suppress path jitter and ensure smooth motion. The weighted sum of the three terms is used as the evaluation metric for the Rapidly-exploring Random Tree Star (RRT*) algorithm, i.e., the total cost J = 0.8×C_static + 1.2×C_dynamic + 0.3×C_curvature, guiding the search direction towards low-risk, high-fluidity regions.
[0041] The RRT* algorithm samples in the state space SE(2), which is a three-dimensional space containing position (x,y) and heading angle θ. Each iteration generates random state nodes and searches for nearest neighbor nodes in the existing tree structure, attempting to connect them to generate new path segments. Collision checks are performed before connection; if any p_occ value in the grid cells traversed by the new path segment is greater than 0.7, the connection is rejected. The algorithm sets a maximum of 500 iterations, with an estimated time of 10 milliseconds per iteration, ultimately outputting a safe path from the current pose to the target area. The path point spacing is 0.5 meters, and the total length does not exceed 30 meters. The control deviation feedback mechanism continuously monitors the lateral deviation e_lat and heading angle error e_yaw between the actual control path and the planned path. Both are obtained through the fusion calculation of a high-precision inertial navigation system and a wheel speed encoder, with a sampling period of 20 milliseconds. When the average deviation exceeds 0.2 meters or the heading angle error exceeds 8 degrees within three consecutive control cycles, the prediction model recalibration process is triggered. After the process is started, the system caches the observation data segment (5 seconds in length) under the current environment to the temporary storage area and marks it as a high-bias event sample. Then, the online fine-tuning program is called, and the sample is used to update the hyperparameters of the Gaussian process in step (2) (including the length scale l of the RBF kernel and the period p of the periodic kernel) by gradient descent. The loss function is the mean square error between the predicted position and the actual trajectory. The fine-tuning learning rate is set to 0.01, and the parameter correction is completed after 5 iterations.
[0042] Simultaneously, the attention weight matrix in step (3) is adjusted, focusing on strengthening the influence weight of interactive objects that were not fully considered in this deviation. The adjustment range is determined based on the gradient direction calculated by backpropagation. The fine-tuning process is executed asynchronously in the background thread and does not affect the real-time performance of the main control loop. In addition, an abnormal behavior detection submodule is included. This module runs independently on a dedicated computing core and monitors the consistency residual between the actual movement trajectory of each obstacle and its predicted trajectory. The residual is defined as the Euclidean distance sequence between the predicted position and the actual position under continuous time steps. The system calculates the sliding window standard deviation σ_residual for this residual sequence, with a window length of 5 sampling periods (2.5 seconds). When σ_residual rises more than twice the original mean μ_residual within 5 consecutive sampling periods, it is determined that the obstacle has sudden maneuvering behavior, such as sharp turns, sudden acceleration, or stopping. Once the determination is successful, a high-frequency re-prediction mode is immediately activated, reducing the prediction update cycle of the obstacle from the default 0.5 seconds to 0.2 seconds, that is, re-executing steps (2) and (3) every 200 milliseconds until the residual standard deviation continuously falls below the threshold and remains stable for 3 seconds. This mechanism effectively improves the responsiveness to unpredictable behavior and ensures the robustness of the obstacle avoidance strategy.
[0043] The entire method is deployed on an embedded in-vehicle computing platform equipped with a dual-core ARM Cortex-A76 processor with a clock speed of 2.2 GHz, a dedicated neural network acceleration unit (NPU), a peak computing power of 8 TOPS, 8 gigabytes of LPDDR5 memory, and 128 gigabytes of eMMC storage. The software architecture uses the real-time operating system FreeRTOS, with a task scheduling cycle of 10 milliseconds. Key algorithm modules avoid heap fragmentation through static memory allocation, and the overall algorithm cycle is controlled within 80 milliseconds, meeting the real-time requirements of complex dynamic scenarios and supporting the simultaneous tracking and prediction of the motion trajectories of no fewer than 32 dynamic obstacles.
[0044] To further clarify the technical implementation details of this invention, a specific application example is provided: Assume this invention is applied to an autonomous pedestrian cleaning robot operating in a commercial street during morning and evening rush hours, where pedestrian density reaches up to 2 people per square meter. The robot, equipped with the aforementioned multi-source sensor fusion system, detects a pedestrian 8 meters ahead at a speed of 1.2 meters per second diagonally crossing its predetermined path. The 3D LiDAR outputs a point cloud frame every 100 milliseconds, the millimeter-wave radar provides velocity information at a 40-millisecond cycle, and the monocular vision camera outputs a target detection result every 33 milliseconds.
[0045] The system first executes step (1), using Kalman filtering to align the time and coordinates of the three data sources, obtaining a continuous pose sequence of the pedestrian, including the position, orientation angle, and velocity over the past 5 seconds. After wavelet denoising, the smoothness of the velocity sequence is significantly improved, and the sudden change response delay is less than 100 milliseconds. Step (2) is then executed, using a Gaussian mixture process regression model to analyze the pedestrian's motion state. The model finds that the acceleration change rate jerk = 0.3 m / s³, which is at a moderate level. The gating network is assigned weights of 0.6:0.4, with the RBF branch dominating the prediction. The system outputs a probabilistic trajectory distribution for the next 10 seconds, predicting that the pedestrian will continue to move in the current direction. However, because the path crosses the green belt at the edge of the sidewalk (a no-passage area), the scene topology constraint reduces its probability by 78%, resulting in a detour prediction. In step (3), the social force model incorporates the pedestrian into the spatiotemporal adjacency graph and finds another pedestrian moving in the same direction 2 meters to the left, with a small relative speed angle and unobstructed vision, thus having a higher connection weight. Meanwhile, the target pedestrian is located within its predetermined route sector, with a psychological expectation bias factor β=1.6, significantly amplifying its attention score. The model calculates that it should deflect 12 degrees to the right to mitigate potential conflict. This correction is applied to trajectory reweighting, and the final joint prediction result shows that there is an 85% probability that it will detour to the right.
[0046] In step (4), the prediction result is converted into a spatiotemporal occupancy grid, showing a high probability of occupancy in the right-hand region within the next 6 to 8 seconds. The local path planner constructs a composite cost field. Due to the high weight of the dynamic risk term, the RRT* algorithm automatically plans a detour path offset 1.5 meters to the left, with continuous curvature and a maximum curvature not exceeding 0.8 per meter. The robot begins to execute the path, but at the 2nd second, due to slippery ground, it deviates laterally by 0.25 meters, exceeding the limit for three consecutive cycles, triggering the feedback mechanism. The system caches the observation data of the last 5 seconds, fine-tunes the length scale parameter l of the Gaussian process from 1.2 seconds to 1.0 seconds, enhances the sensitivity to short-term maneuvers, and increases the attention weight of pedestrians on the left by 0.15 times. The next round of prediction responds faster to environmental changes, issuing new obstacle avoidance commands 1.5 seconds in advance. The end-to-end latency of the entire process is 76 milliseconds, successfully avoiding collisions and verifying the effectiveness and real-time performance of the invention.
[0047] The foregoing has shown and described the basic principles, main features, and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The embodiments and descriptions in the specification are merely illustrative of the principles of the invention. Various changes and modifications can be made to the invention without departing from its spirit and scope, and all such changes and modifications fall within the scope of the present invention as claimed. The scope of protection of the present invention is defined by the appended claims and their equivalents.
Claims
1. An obstacle avoidance control method based on dynamic obstacle trajectory prediction, characterized in that, include: Collect dynamic obstacle observation data to obtain standardized obstacle motion state input; Construct an adaptive trajectory prediction model to output a probabilistic trajectory distribution within a future time window; Generate interactive intent-enhanced predictive trajectories to form joint prediction results; The steps of performing closed-loop feedback obstacle avoidance decision-making to solve for the optimal avoidance path and feeding back the control deviation to the adaptive trajectory prediction model and the generated interactive intent-enhanced prediction trajectory are used to dynamically update the model parameters.
2. The obstacle avoidance control method based on dynamic obstacle trajectory prediction according to claim 1, characterized in that, The process of collecting dynamic obstacle observation data to obtain standardized obstacle motion state input includes: The historical pose sequence of each dynamic obstacle in the environment is acquired in real time through a multi-source sensor fusion system. The historical pose sequence includes the position coordinates, motion direction angle and velocity vector at continuous time steps. The original observation data is time-aligned and noise-filtered to obtain the standardized obstacle motion state input.
3. The obstacle avoidance control method based on dynamic obstacle trajectory prediction according to claim 1, characterized in that, The construction of the adaptive trajectory prediction model to output the probabilistic trajectory distribution within a future time window includes: Based on the standardized obstacle motion state input, a nonlinear trajectory prediction framework is established using a Gaussian mixture process regression algorithm. The kernel function of the Gaussian mixture process regression algorithm is a weighted combination of a radial basis function kernel and a periodic kernel. By combining prior knowledge of scene topology constraints, the output of the nonlinear trajectory prediction framework is guided or penalized to obtain a probabilistic trajectory distribution that conforms to the physical reachability rules.
4. The obstacle avoidance control method based on dynamic obstacle trajectory prediction according to claim 3, characterized in that, The Gaussian mixture process regression algorithm sets up two parallel processing branches. One branch uses a radial basis function kernel to model uniform or uniformly accelerated motion segments, and the other branch uses a periodic kernel to capture periodic or oscillating motions. The outputs of the two branches are weighted and fused through a gating network driven by the rate of change of acceleration of the current motion state.
5. The obstacle avoidance control method based on dynamic obstacle trajectory prediction according to claim 1, characterized in that, The generation of interactive intent-enhanced prediction trajectories to form a joint prediction result includes: A social force model based on attention mechanism is introduced, which uses the spatial distribution and movement trends of other dynamic individuals in the surrounding area as contextual information input. Calculate the potential interaction strength between the other dynamic individuals and the main target individual; The probabilistic trajectory distribution is modified based on the intensity of the interaction to form a joint prediction result that takes into account the patterns of social behavior.
6. The obstacle avoidance control method based on dynamic obstacle trajectory prediction according to claim 5, characterized in that, The attention-based social force model defines each dynamic individual as a node to construct a spatiotemporal adjacency graph. The connection weights between nodes are determined by the relative distance, the angle between the relative velocity directions, and the line-of-sight occlusion. The influence of neighboring nodes is aggregated through a multi-head attention mechanism to output a correction amount for the movement trend of the main target individual.
7. The obstacle avoidance control method based on dynamic obstacle trajectory prediction according to claim 5, characterized in that, The calculation of the interaction influence intensity introduces a psychological expectation deviation factor, which is determined based on whether the obstacle ahead is within its predetermined path, and the influence weight is enhanced or weakened accordingly.
8. The obstacle avoidance control method based on dynamic obstacle trajectory prediction according to claim 1, characterized in that, The process of performing closed-loop feedback obstacle avoidance decision-making to solve for the optimal avoidance path includes: The joint prediction results are injected into the cost function of the local path planner in the form of a spatiotemporal occupancy grid. Construct a composite cost field that includes the inverse term of static obstacle distance, the integral term of dynamic spatiotemporal occupancy probability, and the square term of path curvature; The optimal avoidance path that is safe, smooth, and meets dynamic constraints is found in the composite cost field using the fast marching tree optimization algorithm.
9. The obstacle avoidance control method based on dynamic obstacle trajectory prediction according to claim 1, characterized in that, The control deviation feedback mechanism monitors the lateral deviation and heading angle error between the actual control path and the planned path. When the deviation exceeds a preset threshold, it triggers the prediction model recalibration process, using observation data fragments from the current environment to fine-tune the hyperparameters of the adaptive trajectory prediction model and the attention weight matrix of the interactive intent-enhanced prediction trajectory online.
10. The obstacle avoidance control method based on dynamic obstacle trajectory prediction according to claim 1, characterized in that, It also includes a submodule for dynamically adjusting the length of the future time window and an abnormal behavior detection module; the dynamic adjustment is bidirectionally adjusted according to the current system load and the average relative speed of the obstacle; the abnormal behavior detection submodule monitors the consistency residual between the actual movement trajectory of the obstacle and its predicted trajectory, and when a sudden maneuvering behavior is detected, a high-frequency re-prediction mode is activated.
Citation Information
Patent Citations
Pedestrian trajectory prediction method based on topological graph structure and deep self-attention network
CN115082896A
Dynamic weight correction and path deviation probability prediction method for vehicle track
CN120333488A
Dynamic obstacle trajectory prediction method and device, equipment and storage medium
CN120808308A
Vehicle trajectory prediction system embedded with spatial-temporal feature fusion strategy and control method thereof
CN121071449A
Trajectory prediction method and apparatus, and computer device and storage medium
WO2022222095A1
Cited By
Path motion control method and system of welding robot
CN121973249A
A path motion control method and system for a welding robot
CN121973249B
Driving scene understanding method based on space evidence constraint
CN122200604A
A driving scene understanding method based on spatial evidence constraint
CN122200604B