Trace line display control device, augmented reality head-up display device, and storage medium

By using a tracking line display control device and dynamic suppression parameters and weighted fusion correction processing, the problem of abnormal lateral position changes of tracking line data points during vehicle movement is solved, thus achieving stability and continuity of tracking line display.

CN123104384APending Publication Date: 2026-11-17JIANGSU NEW VISION AUTOMOTIVE ELECTRONICS CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202611288208.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-08-24
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

During vehicle operation, the lateral movement of the vehicle in front causes abnormal lateral position changes in the tracking line data points, resulting in problems such as local offset, jitter, or discontinuous position of the tracking line display.

Method used

The tracking line display control device determines dynamic suppression parameters based on the lateral position change information of the target vehicle, and calculates weights by combining the distance between the tracking line data points and the vehicle itself, and performs data point fusion and correction processing to form a continuous tracking line path.

Benefits of technology

This reduces the impact of changes in the lateral position of the target vehicle on the stability of the tracking line data point positions, ensuring the inter-frame continuity and spatial accuracy of the tracking line display.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123104384A_ABST
    Figure CN123104384A_ABST
Patent Text Reader

Abstract

This application provides a tracking line display control device, an augmented reality head-up display device, and a storage medium, relating to the field of vehicle display control technology. The tracking line display control device includes a memory and a processor. The memory is configured to store the correspondence between distance and weight. For at least one tracking line data point in the tracking line data point sequence, the processor determines dynamic suppression parameters based on the lateral position change information of the target vehicle, and determines weights based on the distance and correspondence between the tracking line data point and the vehicle. The processor then fuses the tracking line data points with the corresponding reference correction target points according to the dynamic suppression parameters and weights to obtain a corrected tracking line data point sequence. By having both the lateral position change of the target vehicle and the spatial position of the tracking line data points participate in the fusion, the inter-frame lateral fluctuation of the tracking line data points caused by the lateral movement of the target vehicle can be reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of vehicle display control technology, and in particular to a tracking line display control device, an augmented reality head-up display device, and a storage medium. Background Technology

[0002] Augmented Reality Head-Up Displays (AR-HUDs) project navigation lines into the driver's field of vision to show the vehicle's guiding path. These lines are typically generated based on tracking data points output by Advanced Driver Assistance Systems (ADAS).

[0003] During actual vehicle operation, vehicles ahead may cut in, cut out, or move laterally, causing abnormal lateral position changes in the tracking line data points output by ADAS between adjacent frames. These abnormal lateral position changes, when reflected in the AR-HUD, may cause local shifts, jitter, or discontinuities in the displayed tracking line. Summary of the Invention

[0004] This application provides a tracking line display control device, an augmented reality head-up display device, and a storage medium.

[0005] The technical solution of this application can be implemented in the following ways: In a first aspect, this application provides a tracking line display control device. The tracking line display control device includes a memory and a processor. The memory can be configured to store the correspondence between distance and weight. The processor is connected to the memory. For at least one tracking line data point in a tracking line data point sequence, the processor can determine the dynamic suppression parameter corresponding to the tracking line data point based on the lateral position change information of the target vehicle, and determine the weight corresponding to the tracking line data point based on the distance between the tracking line data point and the vehicle, and the correspondence between distance and weight. The processor further fuses the tracking line data point with the corresponding reference correction target point according to the dynamic suppression parameter and weight to form a corrected tracking line data point sequence.

[0006] Secondly, this application provides an AR-HUD. The AR-HUD may include a projection unit, optical components, and the tracking line display control device provided in the first aspect. The projection unit is used to project an image beam, and the optical components are used to reflect the image beam to form a virtual image; the tracking line display control device can generate a continuous tracking line path according to the corrected tracking line data point sequence, and control the projection unit to project the image beam corresponding to the continuous tracking line path.

[0007] Thirdly, this application provides a storage medium. The storage medium stores a computer program, which, when executed by a processor, can realize the dynamic determination of suppression parameters, weight determination, and fusion correction processing of tracking line data points.

[0008] The tracking line display control device provided in this application determines dynamic suppression parameters based on the lateral position change information of the target vehicle and determines weights based on the distance between the tracking line data points and the vehicle itself. This allows the fusion degree of the tracking line data points to simultaneously relate to the temporal change state of the target vehicle and the spatial position of the tracking line data points. The processor then fuses the tracking line data points with the corresponding reference correction target points according to the dynamic suppression parameters and weights, thereby reducing the inter-frame abnormal lateral position changes caused by the lateral position change of the target vehicle being transmitted to the tracking line data. Attached Figure Description

[0009] Figure 1 A schematic diagram of a first tracking line display scenario provided in this application for a target vehicle driving stably; Figure 2 A schematic diagram of a second tracking line display scenario provided in this application when a target vehicle moves laterally; Figure 3 This application provides a schematic diagram of the structure of a tracking line display control system; Figure 4 A schematic diagram of the structure of a tracking line display control device provided in this application; Figure 5 A schematic diagram of a tracking line data point fusion and correction processing flow provided in this application; Figure 6 A schematic diagram of tracking line correction in a scenario of lateral movement of a target vehicle provided in this application; Figure 7 This application provides a schematic diagram illustrating the fusion positional relationship between tracking line data points and reference correction target points; Figure 8 A schematic diagram of the distance segment division of the tracking line provided in this application; Figure 9 A schematic diagram showing a preset proximal reference position and the starting position of the tracking line provided in this application; Figure 10 This is a schematic diagram of the structure of an AR-HUD provided in this application. Detailed Implementation

[0010] The technical solutions in this application will now be clearly and completely described with reference to the accompanying drawings.

[0011] During vehicle operation, AR-HUD can overlay navigation routes, lane-level guidance information, and driver assistance guidance information onto the driver's forward field of vision. Tracking lines are used to display the suggested driving path. Tracking lines refer to driving guidance lines formed based on vehicle navigation information, road information, or path data output by ADAS. Tracking lines are typically formed by multiple tracking line data points arranged in spatial order. After coordinate transformation, curve interpolation, and graphic rendering, these tracking line data points can form a continuous path that the driver can observe.

[0012] Tracking line data points can come from ADAS, navigation systems, or the vehicle control system responsible for path planning. ADAS can generate path data based on the vehicle's position, lane information, road environment information, and surrounding target information. When the vehicle in front is in a stable driving state, the path data output between adjacent processing cycles usually has good continuity, and the displayed tracking line is also relatively stable.

[0013] The actual driving environment of a vehicle is constantly changing. A vehicle ahead may cut into the vehicle's lane from an adjacent lane, or cut out of the vehicle's lane to an adjacent lane, and may also move laterally within the lane. When the lateral position of the target vehicle changes, the environmental information obtained by ADAS and the path data generated based on that information may change accordingly. After the lateral position of the path data changes in adjacent processing cycles, the change can be further transmitted to the tracking line data points.

[0014] Specifically, this manifests as follows: the lateral coordinates of tracking line data points near the same spatial location in adjacent frames change abruptly. Near the edge, this may manifest as a drift in the starting position of the tracking line, while at the far edge, it may manifest as a left-right swaying of the path. When the changes of multiple data points are inconsistent, it may also cause the tracking line to form local bends or abrupt changes in path shape.

[0015] For example, such as Figure 1 As shown, vehicle 10 is traveling along its current lane, and target vehicle 11 is located in front of vehicle 10. At the first moment, target vehicle 11 remains stable relative to vehicle 10, and ADAS generates a first tracking line 101 based on the current path data. Figure 2As shown, at the second moment, the target vehicle 11 moves laterally relative to the first moment, and the ADAS generates a second tracking line 102 based on the updated path data. The lateral position change of the target vehicle 11 may cause different degrees of lateral position changes in the corresponding tracking line data points in the first tracking line 101 and the second tracking line 102. Here, the target vehicle 11 refers to a vehicle located in front of the vehicle 10, whose lateral position change can affect the tracking line data and is used for lateral position change analysis. The target vehicle 11 can be located in front of the vehicle 10's current lane, or it can cut into the vehicle 10's current lane from an adjacent lane.

[0016] based on Figure 1 and Figure 2 As shown in the scenario, this application provides a tracking line display control device. Before the tracking line data enters the display rendering stage, the tracking line display control device performs fusion correction on at least one tracking line data point. For the tracking line data point to be processed, the processor determines dynamic suppression parameters based on the lateral position change information of the target vehicle, and determines weights based on the distance between the tracking line data point and the vehicle. Then, according to the dynamic suppression parameters and weights, the tracking line data point is fused with the corresponding reference correction target point. This processing does not perform a fixed-amplitude overall translation of the entire tracking line, but rather determines the degree of fusion for each tracking line data point to be processed.

[0017] In this processing relationship, when the lateral position change of the target vehicle 11 is small, the fusion result can retain more of the original tracking line data points; when the lateral position change of the target vehicle 11 increases, the dynamic suppression parameter changes accordingly, so that the influence of the reference correction target point on the fusion result is adjusted accordingly. Tracking line data points at different spatial positions can also obtain different weights according to their distance from the vehicle 10, thereby forming a fusion degree corresponding to the spatial position of the data points.

[0018] like Figure 3 As shown, the tracking line display control system 100 can be applied to this vehicle 10, including a tracking line display control device 20, ADAS 30, a display system 40, and an environmental perception device 50. The tracking line display control device 20 establishes data communication relationships with ADAS 30 and the display system 40, respectively.

[0019] The vehicle 10 can be a passenger car, a commercial vehicle, or other vehicle equipped with a head-up display. ADAS 30 is used to provide data related to the tracking line display. ADAS 30 can output a sequence of tracking line data points, or it can output target vehicle information, vehicle status information, or lane information.

[0020] The tracking line data point sequence can include multiple tracking line data points arranged according to their spatial positions. The tracking line data point sequence can be represented as {P_i(t)}, where P_i(t) represents the i-th tracking line data point corresponding to processing time t, and the data point indices i, from smallest to largest, correspond to the order of data points from nearest to farthest. Tracking line data points are used to represent the data coordinates of the tracking line path at the corresponding spatial position. A tracking line data point can include at least one of longitudinal coordinates, lateral coordinates, and height coordinates. For two-dimensional path data, a tracking line data point can also be represented by longitudinal and lateral coordinates. A tracking line data point can be represented as P_i(t) = (x_i(t), y_i(t), z_i(t)), where x_i(t), y_i(t), and z_i(t) represent the longitudinal, lateral, and height coordinates of the tracking line data point in the advanced driver assistance system coordinate system, respectively.

[0021] Display system 40 may include an augmented reality head-up display system, a central control display system, an instrument display system, or other vehicle display systems capable of displaying a tracking path. The following example primarily uses an augmented reality head-up display system. An augmented reality head-up display system can form a corresponding image of a continuous tracking path and project the image onto a display area corresponding to the driver's forward field of vision.

[0022] The environmental perception device 50 is used to acquire information about the current road environment where the vehicle 10 is located. The environmental perception device 50 may include at least one of the following: a camera, millimeter-wave radar, lidar, ultrasonic radar, vehicle-to-everything (V2X) communication unit, high-precision map interface, or navigation information interface.

[0023] The tracking line display control device 20 is located in the data processing link between the path data output by the ADAS 30 and the display content formed by the display system 40. The tracking line display control device 20 can receive the tracking line data point sequence output by the ADAS 30 and data related to the target vehicle 11, perform fusion correction on the tracking line data points, and then provide the corrected tracking line data point sequence to the display system 40, or the tracking line display control device 20 can further complete coordinate transformation and curve interpolation to output a continuous tracking line path.

[0024] pass Figure 3 The system structure shown indicates that after the target vehicle 11 undergoes a lateral position change, the path data generated by ADAS 30 can first undergo data layer correction through the tracking line display control device 20 before entering the display output process, thereby setting the tracking line position stability processing between path data generation and display rendering.

[0025] like Figure 4 As shown, the tracking line display control device 20 may include a processor 21 and a memory 22 that are interconnected.

[0026] The memory 22 can be configured to store the correspondence between distance and weight, and can also be used to store the lateral position data of the target vehicle, the lateral position change information of the target vehicle, and the intermediate data generated during the operation of the processor 21.

[0027] The memory 22 may include random access memory, cache, high-speed buffer memory, non-volatile memory, or other data storage resources accessible to the processor 21. For continuously updated data during vehicle operation, the memory 22 can serve as a cache for temporarily storing processing results. For example, after receiving the tracking line data point sequence for the current processing cycle, the processor 21 can write the tracking line data point sequence into the cache; after determining the lateral position change information of the target vehicle based on the lateral position of the target vehicle at different processing times, the processor 21 can also write the lateral position change information of the target vehicle into the cache for subsequent reading when determining dynamic suppression parameters.

[0028] The correspondence between distance and weight is used to determine the corresponding weight based on the distance between the tracking line data point and the vehicle 10. Distance can be mapped to weight as a continuous variable, or it can be divided into multiple distance ranges, with different weights corresponding to different distance ranges. The correspondence between distance and weight can be stored using a mapping table, array, parameter table, or other data format that can be read by the processor 21.

[0029] Weights are used to characterize the degree to which tracking line data points at different spatial locations are affected by the reference correction target point during the fusion process. Processor 21 takes the distance between the tracking line data points and the vehicle 10 as input and obtains the corresponding weights based on the correspondence between distance and weights; the correspondence can be a direct mapping between distance and weights, or a mapping between distance segments and segmented weights. When the tracking line display range, path data characteristics, or display optical parameters differ for different vehicle projects, the correspondence between distance and weights can be obtained through project calibration and stored in memory 22.

[0030] The processor 21 can be an in-vehicle processor, a computing unit in a system-on-a-chip, a graphics processor, a digital signal processor, a microcontroller, or a processing circuit capable of performing corresponding data processing operations. The processor 21 can perform corresponding data processing by executing computer programs stored in memory 22, or it can perform at least some data processing through hardware logic.

[0031] like Figure 5 As shown, the process of processor 21 processing the tracking line data points may include steps S501 to S503.

[0032] In step S501, for at least one tracking line data point in the tracking line data point sequence, the dynamic suppression parameter corresponding to the tracking line data point is determined based on the lateral position change information of the target vehicle.

[0033] Here, at least one tracking line data point can be one data point, multiple data points, or multiple data points to be corrected in the sequence of tracking line data points. The range of data points involved in correction can be determined according to the actual data processing requirements. For example, dynamic suppression parameters can be determined for multiple tracking line data points located in the proximal, middle, and distal ranges, or corresponding processing can be performed on tracking line data points with large lateral position changes.

[0034] The lateral position change information of the target vehicle is used to characterize the degree of lateral position change of the target vehicle 11 at different processing times. The lateral position change information may include the amount of lateral position change, the rate of change obtained based on the amount of lateral position change, the change excitation value, or other information that can characterize the degree of lateral movement of the target vehicle 11. The lateral direction can be the left-right direction of the vehicle intersecting the longitudinal direction of travel in the vehicle coordinate system corresponding to the vehicle 10.

[0035] The dynamic suppression parameter is a numerical parameter determined by the processor 21 for the tracking line data points to be corrected. The input includes at least the lateral position change information of the target vehicle 11, and the output is used to determine the degree of fusion between the tracking line data points and the corresponding reference correction target points together with the weights. The dynamic suppression parameter is adjusted according to the lateral position change state of the target vehicle 11 to reflect the degree of dynamic change at the current processing time.

[0036] When the target vehicle 11 remains relatively stable, the lateral position change between adjacent processing times is small, and the dynamic suppression contribution caused by the lateral position change of the target vehicle is correspondingly small. In subsequent fusion processing, the original tracking line data points can retain a large degree of influence, so that normal path changes continue to be reflected in the correction results.

[0037] When the target vehicle 11 cuts in, cuts out, or moves laterally rapidly, the target vehicle 11 experiences a significant lateral position change between consecutive processing moments. This change in the target vehicle 11's state may further cause instantaneous lateral adjustments to the tracking line data points output by the ADAS. At this time, the processor 21 can adjust the dynamic suppression parameters based on the degree of the significant lateral position change. This allows the dynamic suppression parameters to increase the influence of the reference correction target point on the correction result when subsequently fused with weights, thereby suppressing abnormal lateral changes in the tracking line data transmitted from the short-term lateral movement of the target vehicle 11.

[0038] Therefore, the dynamic suppression parameter mainly reflects whether the target vehicle 11 undergoes lateral dynamic changes and the degree of such changes at the current processing time from the perspective of time change, providing a dynamic adjustment basis for determining the actual fusion degree of the tracking line data points in the subsequent process.

[0039] In step S502, based on the distance between the tracking line data point and the vehicle, the weight corresponding to the tracking line data point is determined according to the correspondence between distance and weight.

[0040] The distance between the tracking line data point and the vehicle 10 can be determined based on the position of the tracking line data point in the advanced driver assistance system coordinate system. This distance can be the longitudinal distance of the tracking line data point relative to the reference position of the vehicle 10, or it can be the spatial distance determined based on the spatial coordinates of the tracking line data point. When the tracking line mainly extends along the vehicle's forward direction, the longitudinal distance can be used to characterize the distance of the tracking line data point relative to the vehicle 10.

[0041] The tracking line is composed of multiple tracking line data points distributed along the vehicle's direction of travel. Data points at different distances have different data and display characteristics. For example, tracking line data points close to the vehicle 10 are located in the starting area of ​​the tracking line display, and even small changes in lateral position can be manifested as a drift in the starting position of the tracking line; mid-distance data points can be used to reflect the main shape of the current path; and long-distance data points may exhibit larger lateral fluctuations when affected by changes in the target ahead, the state of environmental perception, and the path prediction results. Therefore, appropriate weights can be determined based on the distance between the tracking line data points and the vehicle 10, so that tracking line data points at different spatial locations have a basic degree of fusion that matches their data characteristics.

[0042] The dynamic suppression parameters and weights reflect information from different dimensions. The dynamic suppression parameters mainly reflect the degree of lateral dynamic change of the target vehicle 11 at the current processing moment, and belong to the adjustment parameters of the time change dimension; the weights mainly reflect the spatial position attributes of the tracking line data points relative to the vehicle 10, and belong to the adjustment parameters of the spatial position dimension.

[0043] Therefore, even if the target vehicle 11 has the same lateral position change state at the same processing moment, tracking line data points located at different distances can still have different weights. Accordingly, the final fusion degree of the same target vehicle entry or exit event can differ for the near-end, middle-end, and far-end tracking line data points. By introducing dynamic suppression parameters and weights into the fusion process, it is possible to avoid using a single fixed correction amount to process the entire tracking line to the same degree.

[0044] In step S503, the tracking line data points are fused with the corresponding reference correction target points according to the dynamic suppression parameters and weights to obtain the corrected tracking line data point sequence.

[0045] The reference correction target point is a spatial reference data point corresponding to the tracking line data points to be processed, serving as another location input during the fusion of tracking line data points. The reference correction target point is not the location of the target vehicle 11, but is determined based on the reference path of the tracking line at the corresponding spatial location, used to limit the fusion direction when abnormal lateral changes occur in the tracking line data points.

[0046] Each tracking line data point to be processed can have a corresponding reference correction target point. The reference correction target point can be derived from a preset reference position, the lane centerline fitting result, the position calculated far from the existing reference path, or other data positions that can provide spatial reference for tracking line position correction.

[0047] Fusion refers to the process of combining the positional information of the original tracking line data points with the positional information of the corresponding reference correction target points to determine the tracking line data points after correction. The processor 21 can determine the relative influence of the two in the fusion result based on dynamic suppression parameters and weights, and obtain the corrected tracking line data points through a weighted method.

[0048] This application does not directly delete the path adjustment information caused by the change of the target vehicle 11, nor does it simply replace the abnormal data points with fixed positions. Instead, for the tracking line data points to be processed, it determines the dynamic suppression parameters based on the lateral position change information of the target vehicle, determines the weights based on the distance between the tracking line data points and the vehicle 10, and controls the degree of fusion between the original tracking line data points and the reference correction target points through the dynamic suppression parameters and weights.

[0049] When the lateral position change of the target vehicle 11 is small, the fusion result can retain more of the original tracking line data points, allowing normal road shape changes and normal path adjustments to continue to be reflected. When the target vehicle 11 cuts in or out and causes a short-term abnormal lateral change in the tracking line data points, the influence of the reference correction target point in the fusion result can be increased accordingly, causing the abnormally moving data points to move closer to a reasonable reference position. At the same time, data points at different distances have different weights, thus allowing for the formation of fusion degrees suitable for the corresponding spatial positions at the near, middle, and far ends.

[0050] The processor 21 can repeatedly perform the fusion process on multiple tracking line data points to be processed, and update the data points at the corresponding positions using the obtained corrected tracking line data points, thereby forming a sequence of corrected tracking line data points. Tracking line data points that did not participate in the current fusion process can retain their original positions and together with the corrected data points, form a complete corrected sequence.

[0051] After point-by-point fusion processing, the short-term path data abrupt changes caused by the entry or exit of target vehicle 11 are constrained by the spatial constraints of the reference correction target point, and the abnormal lateral position changes of corresponding data points between adjacent processing times can be reduced. At the same time, the original tracking line data still participates in the fusion, so normal road curvature changes and path changes are not directly eliminated. As a result, the corrected tracking line data point sequence has good inter-frame continuity in the time dimension and can still maintain the overall extension relationship of the tracking line path in the spatial dimension.

[0052] Combination Figure 2 After the target vehicle 11 moves laterally, some tracking data points in the second tracking line 102 shift laterally relative to the corresponding data points in the first tracking line 101. The degree of lateral change at the near and far ends may differ, and this manifests as tracking line oscillation during continuous display. Figure 6 As shown, after fusion processing, tracking line 601 represents the tracking line obtained by correcting the second tracking line 102. The corresponding tracking line data points in tracking line 601 are spatially constrained by the reference correction target point, the abnormal lateral changes between adjacent frames are reduced, and the tracking line as a whole still extends along the actual guidance path direction.

[0053] This embodiment of the application integrates the lateral position change of the target vehicle 11 in the time dimension with the spatial distance and position of the tracking line data points for fusion correction. The dynamic suppression parameter reflects the degree of dynamic change of the target vehicle, and the weights reflect the spatial correction attributes of different tracking line data points. Both are then used to adjust the degree of fusion between the original tracking line data points and the corresponding reference correction target point. This allows for differentiated correction results per data point at different processing times and spatial locations, reducing the impact of lateral position changes of the target vehicle on the positional stability of the tracking line data points.

[0054] Furthermore, the processor 21 can determine the dynamic suppression parameters corresponding to the tracking line data points based on the lateral position change information and adjustment information of the target vehicle 11. The adjustment information is used to characterize the operating state or spatial position state that can affect the degree of correction of the tracking line data point fusion, in addition to the lateral motion state of the target vehicle 11. The adjustment information may include at least one of the distance between the tracking line data point and the vehicle 10 and the current speed of the vehicle 10.

[0055] In some implementations, the processor 21 can determine dynamic suppression parameters based on the lateral position change information of the target vehicle 11 and the distance between the tracking line data points and the vehicle 10. The distance between the tracking line data points and the vehicle 10 is used to characterize the spatial position of the tracking line data points in the path ahead of the vehicle. For tracking line data points closer to the vehicle 10, the original path data usually has a high degree of spatial reliability, and since the tracking line data points are located in the starting area of ​​the tracking line display, position changes are easily reflected directly as drifts in the starting area of ​​the tracking line. For data points farther from the vehicle 10, the path data has strong predictive properties, and path adjustments caused by changes in the state of the vehicle ahead may result in large lateral swings at the far end. Therefore, using the distance of the tracking line data points as adjustment information for dynamic suppression parameters allows the dynamic suppression parameters to reflect not only the degree of lateral change of the target vehicle 11 but also the spatial position of the currently processed data point in the tracking line.

[0056] In some implementations, the processor 21 can determine dynamic suppression parameters based on the lateral position change information of the target vehicle 11 and the current speed of the vehicle 10. The current speed refers to the driving speed of the vehicle 10 at the current processing moment, which can come from the vehicle speed sensor, the vehicle controller, or vehicle status data output by the ADAS 30. At different current speeds, the same amplitude of tracking line data fluctuations may behave differently during continuous display, so the dynamic suppression parameters can be adjusted using the current speed.

[0057] For example, when vehicle 10 is at a relatively low speed, the driving environment and vehicle path may experience frequent local changes. Dynamic suppression parameters can better preserve the original path data's response to these environmental changes. When vehicle 10 is at a relatively high speed, the continuously displayed tracking line is more sensitive to inter-frame lateral fluctuations. The current vehicle speed can increase the stability-related adjustments in the dynamic suppression parameters. The influence of vehicle speed can be obtained through project calibration; specific values ​​can be set based on the vehicle platform, tracking line display distance, and path data characteristics.

[0058] The adjustment information can be obtained using different input combinations. For example, the processor 21 can determine the dynamic suppression parameters based on the lateral position change information of the target vehicle 11 and the distance between the tracking line data point and the vehicle 10; it can also determine the dynamic suppression parameters based on the lateral position change information of the target vehicle 11 and the current speed of the vehicle 10; or it can simultaneously determine the dynamic suppression parameters based on the lateral position change information of the target vehicle 11, the distance between the tracking line data point and the vehicle 10, and the current speed of the vehicle 10. Different input combinations are used to determine the degree of dynamic adjustment of the tracking line data point to be processed in the current operating state.

[0059] The lateral position change information of the target vehicle 11 may further include the target vehicle change stimulus value. The target vehicle change stimulus value is used to quantify the drastic degree of lateral position change of the target vehicle 11 within a certain time range. Compared with directly using the lateral coordinates of the target vehicle 11 at a certain moment, the target vehicle change stimulus value can reflect the position change process of the target vehicle 11 in the time dimension, thereby distinguishing between the target vehicle 11 being in a relatively stable state and the target vehicle 11 being in a state of lateral movement.

[0060] The processor 21 can acquire the lateral position of the target vehicle 11 at the current moment and at a historical moment. The current moment refers to the time point corresponding to the execution of the current processing cycle, and the historical moment refers to the time point before the current moment used for comparison of the lateral position with the current moment. The current moment and the historical moment can correspond to the current data frame and the historical data frame, respectively.

[0061] The historical moment can correspond to a historical frame before the current frame, or it can be selected from multiple historical frames before the current frame for position change calculation.

[0062] The lateral position of the target vehicle 11 can be represented using the vehicle coordinate system corresponding to the vehicle 10. For example, the longitudinal direction of travel of the vehicle 10 can be defined as the longitudinal direction, and the direction that intersects the longitudinal direction and extends along the left and right directions of the vehicle can be defined as the lateral direction. The lateral coordinates of the target vehicle 11 in the vehicle coordinate system can represent the lateral position of the target vehicle 11 relative to the vehicle 10.

[0063] The processor 21 can determine the change in lateral position based on the current lateral position and the lateral position at a historical time. The change in lateral position can be expressed as: Δy = y(t) - y(th). Where y(t) represents the lateral position of the target vehicle 11 at the current time t, y(th) represents the lateral position of the target vehicle 11 at the historical time th, and Δy represents the change in lateral position between the two times.

[0064] Lateral position changes can carry positive and negative directional information. For example, a change to the left of the vehicle can be predefined as a positive direction and a change to the right of the vehicle as a negative direction; alternatively, the opposite direction can be defined. The direction definition can be consistent with the horizontal axis of the vehicle coordinate system.

[0065] When the dynamic suppression processing focuses only on the degree of lateral change of the target vehicle 11 without distinguishing the direction of change, the absolute value of the lateral position change can be used as the input for subsequent excitation value calculation. The target vehicle 11 can generate corresponding dynamic change degrees based on the magnitude of the lateral position change whether it cuts in to the left or to the right.

[0066] Processor 21 can also determine the time interval between the current moment and a historical moment. The time interval can be determined based on the timestamps carried by the current data frame and the historical data frame, or it can be determined based on the system's fixed data period and the number of frames between two data frames.

[0067] For example, if the current time is t and the historical time is th, the time interval can be expressed as Δt = t - (th). The processor 21 can use the lateral position change Δy and the time interval Δt to determine the target vehicle's change excitation value φ. One implementation can be φ = |Δy| / Δt, where |Δy| represents the absolute value of the lateral position change of the target vehicle 11 between the current time and the historical time, and Δt represents the corresponding time interval.

[0068] The target vehicle's change excitation value can therefore have a physical meaning of lateral velocity. When the lateral position change amplitude is the same and the time interval is short, the target vehicle's change excitation value is larger, indicating that the target vehicle 11 produces a faster lateral movement in a shorter time. When the lateral position change amplitude is the same and the time interval is long, the target vehicle's change excitation value is relatively smaller, indicating that the corresponding lateral movement process is slower.

[0069] By using the lateral position change and time interval to form the target vehicle change excitation value, the processor 21 can distinguish between the static position of the target vehicle 11 and the current degree of lateral change. The dynamic suppression parameters can thus respond to the change process of the target vehicle 11, rather than just responding to a single static position value.

[0070] The target vehicle 11 may experience small lateral position changes between adjacent data frames due to target detection noise, target tracking errors, or slight lane swaying. If any minute position change directly becomes the target vehicle's change excitation value, the dynamic suppression parameters may continuously generate unnecessary dynamic changes under normal stable driving conditions. To distinguish between the target's lateral changes that need to participate in the dynamic suppression calculation and minor data fluctuations, the processor 21 can perform a change condition judgment on the amount of lateral position change.

[0071] The preset change conditions refer to the conditions used to determine whether the lateral position change of the target vehicle 11 reaches the dynamic change processing range. The preset change conditions may include a lateral position change amount threshold condition. The processor 21 can compare the lateral position change amount with the preset lateral position change threshold. When the lateral position change amount meets the preset change conditions, the processor 21 can determine the target vehicle change excitation value based on the lateral position change amount and the time interval; when the lateral position change amount does not meet the preset change conditions, the target vehicle change excitation value can be set to zero.

[0072] For example, in the method of judging by the absolute value of the lateral position change, it can be determined whether |Δy| is greater than or equal to the preset lateral position change threshold T_y. When |Δy| reaches T_y, the processor 21 can proceed to calculate the target vehicle change excitation value; when |Δy| is less than T_y, it can be considered that the current lateral position change is within the range that does not trigger the target vehicle's dynamic change adjustment, and the target vehicle change excitation value is set to zero.

[0073] The preset lateral position change threshold can be calibrated based on the accuracy of target detection data, the noise level of target tracking data, the lateral movement characteristics of the vehicle, and actual project test data. The preset lateral position change threshold is not used to determine whether the target vehicle 11 has completed a lane change, but rather to determine whether the current lateral position change participates in the calculation related to target vehicle changes in the dynamic suppression parameters.

[0074] For example, when target vehicle 11 makes a slight lateral correction within the lane, a small Δy may be generated between two consecutive frames. At this time, the lateral position change does not meet the preset change conditions, the target vehicle change excitation value is zero, the dynamic suppression parameter does not increase the additional contribution caused by the target vehicle change, and the tracking line continues to be processed according to the basic state and other adjustment information.

[0075] When target vehicle 11 rapidly cuts into the current lane of vehicle 10 from an adjacent lane, the lateral position change reaches a preset change condition. Processor 21 determines the target vehicle change excitation value based on the lateral position change and incorporates the target vehicle change excitation value into the dynamic suppression parameter calculation. When target vehicle 11 undergoes a large lateral change, the tracking line data points can obtain corresponding dynamic fusion adjustment.

[0076] When there is no target vehicle 11 ahead, no target vehicle change excitation is generated due to the lateral position change of the target vehicle. At this time, the target vehicle change excitation value can be zero, and the dynamic suppression parameter can be determined by the basic term and the vehicle speed influence term.

[0077] Furthermore, the memory 22 can store preset basic suppression parameters, preset vehicle speed influence coefficients, preset vehicle speed influence relationships, preset distance influence coefficients, and preset distance influence relationships. These parameters can be written into the memory 22 as project calibration parameters before vehicle operation and read by the processor 21 during vehicle operation.

[0078] The preset base suppression parameter refers to the parameter used to form the basis of the dynamic suppression parameter when there is no contribution from the target vehicle's dynamic changes or other dynamic adjustments. The preset base suppression parameter can be represented as λ_base. The preset base suppression parameter provides a preset base value for dynamic suppression processing, so that when the target vehicle's change excitation value is low or zero, the tracking line data points can still maintain a certain fusion relationship according to the project calibration results.

[0079] Preset basic suppression parameters can be obtained through vehicle project calibration. For example, different basic suppression parameters can be set on straight road segments where the lateral state of the target vehicle is relatively stable, and the position changes of the tracking line and the path following state in consecutive frames can be observed. Then, the corresponding preset basic suppression parameters can be selected according to the project evaluation conditions.

[0080] The preset speed influence relationship refers to the mapping relationship between the current speed of vehicle 10 and the speed influence value. The speed influence value can be used to convert the current speed into a value suitable for participating in the calculation of dynamic suppression parameters. The preset speed influence relationship can be implemented using a function, a lookup table, or a piecewise mapping relationship.

[0081] For example, the influence of vehicle speed can be represented as g(v). One implementation could be g(v) = v / v_max, where v represents the current vehicle speed and v_max represents a preset reference speed used for normalization, such as v_max being 120 km / h. Through normalization, different actual vehicle speeds can be converted into speed influence values ​​suitable for combination with other parameters.

[0082] The preset vehicle speed influence coefficient can be represented as k_v. The processor 21 can determine the vehicle speed influence value based on the relationship between the current vehicle speed and the preset vehicle speed influence, and then use the vehicle speed influence value and the preset vehicle speed influence coefficient to form a vehicle speed influence term. The vehicle speed influence term can be represented as k_v·g(v).

[0083] The preset speed influence coefficient is used to adjust the contribution of the current vehicle speed to the dynamic suppression parameters. The preset speed influence coefficient can be set during the project calibration phase based on the vehicle platform, path data update cycle, and display range. During vehicle operation, the preset speed influence coefficient remains at the calibration parameter for the corresponding project, while the speed influence value changes with the current vehicle speed.

[0084] The preset distance influence relationship refers to the mapping relationship between the distance between the tracking line data points and the vehicle 10, and the distance influence value. The distance influence value can represent the degree of influence of the spatial distance of the data points on the dynamic suppression parameters. The preset distance influence relationship can be a continuous function, a piecewise mapping, or a lookup table.

[0085] For example, the distance influence relationship can be represented as h(d_i). One implementation can be h(d_i) = d_i / d_max, where d_i represents the distance between the i-th tracking line data point and the vehicle 10, and d_max represents the reference distance used for normalization in the project, such as the farthest distance that the AR-HUD can display. As the distance of the tracking line data points increases, the distance influence value can increase accordingly, allowing the distance factor of far-end data points to contribute more to the dynamic suppression parameters.

[0086] The preset distance influence coefficient can be represented as k_d. The preset distance influence coefficient is used to determine the contribution of the distance influence value to the relevant terms of the target vehicle's change.

[0087] The processor 21 can determine the distance influence value based on the distance between the tracking line data point and the vehicle 10 and the preset distance influence relationship, and then determine the target vehicle change related terms based on the distance influence value, the preset distance influence coefficient, and the target vehicle change excitation value. For example, the target vehicle change related terms can be expressed as k_d·h(d_i)·φ.

[0088] The above relationships ensure that the target vehicle's change excitation does not act on different tracking line data points with the same magnitude. For data points closer to the vehicle 10, h(d_i) can be relatively small, and the contribution of the target vehicle's change excitation to the dynamic suppression parameters is relatively low; for data points farther from the vehicle 10, h(d_i) can be relatively large, and the contribution of the target vehicle's change excitation to the dynamic suppression parameters is correspondingly increased.

[0089] The processor 21 can further determine the dynamic suppression parameters based on the preset basic suppression parameters, the vehicle speed influence term, and the target vehicle change-related term. In one implementation, the dynamic suppression parameter corresponding to the i-th tracking line data point at time t can be expressed as λ_i(t) = λ_base + k_v·g(v(t)) + k_d·h(d_i)·φ(t). Wherein, λ_base represents the preset basic suppression parameter, k_v represents the preset vehicle speed influence coefficient, g(v(t)) represents the vehicle speed influence value corresponding to the current vehicle speed, k_d represents the preset distance influence coefficient, h(d_i) represents the distance influence value corresponding to the distance of the data point, and φ(t) represents the target vehicle change excitation value.

[0090] Different parts of the dynamic suppression parameters represent different information. λ_base provides the basic correction scale obtained from the project calibration; k_v·g(v(t)) enables the current vehicle speed to participate in dynamic adjustment; k_d·h(d_i)·φ(t) enables the lateral dynamic changes of the target vehicle 11 to produce differentiated effects according to the distance between data points.

[0091] When the lateral position of the target vehicle 11 is relatively stable, φ(t) is small or zero, and the relevant terms concerning the change of the target vehicle are correspondingly reduced or zeroed. The dynamic suppression parameters are mainly formed by the basic suppression parameters and the vehicle speed influence term. Therefore, the tracking line data points can retain more of the changes in the real-time path data of ADAS 30.

[0092] When target vehicle 11 makes a rapid entry or exit, φ(t) increases. For the same target vehicle change event, when the far-end data point has a larger h(d_i), the target vehicle change correlation term can increase; when the near-end data point has a smaller h(d_i), the corresponding target vehicle change correlation term can be relatively lower. The dynamic suppression parameter thus reflects both the degree of event change and the spatial location of the data point.

[0093] Furthermore, after the dynamic suppression parameters and weights have been determined, the processor 21 can determine the fusion parameters corresponding to the tracking line data points based on the dynamic suppression parameters and weights.

[0094] The fusion parameter refers to the parameter used to determine the proportion of the original tracking line data points and the reference correction target points in the fusion result. The fusion parameter is greater than 0 and less than 1.

[0095] For example, the fusion parameter corresponding to the i-th tracking line data point can be represented as η_i(t). In one implementation, η_i(t) = w_i·λ_i(t), where w_i represents the weight corresponding to the i-th tracking line data point, and λ_i(t) represents the dynamic suppression parameter corresponding to the i-th tracking line data point.

[0096] By combining the weight w_i with the dynamic suppression parameter λ_i(t), the tracking line data points at the same distance position can obtain different η_i(t) when the target vehicle 11 changes laterally at different degrees; under the same target vehicle change state, the tracking line data points at different distance positions can also obtain different η_i(t) due to different weight w_i.

[0097] The processor 21 can determine the first fusion ratio corresponding to the tracking line data point and the second fusion ratio corresponding to the reference correction target point based on the fusion parameters. The first fusion ratio is used to represent the degree of participation of the coordinates of the original tracking line data point in the corrected data points, and the second fusion ratio is used to represent the degree of participation of the coordinates of the reference correction target point in the corrected data points.

[0098] In one implementation, the second fusion ratio can be η_i(t), and the first fusion ratio can be 1-η_i(t). When the second fusion ratio increases, the position of the tracking line data point after correction can be more influenced by the reference correction target point; when the first fusion ratio increases, the position of the tracking line data point after correction can retain more information from the original tracking line data point.

[0099] The processor 21 can perform weighted fusion of the original tracking line data points and the corresponding reference correction target points according to the first fusion ratio and the second fusion ratio. Assume the i-th original tracking line data point is P_i(t), the corresponding reference correction target point is P_i_ref(t), and the corrected tracking line data point is P_i_ref(t). ’_i(t), a fusion implementation can be represented as P ’ _i(t)=[1-η_i(t)]·P_i(t)+η_i(t)·P_i_ref(t).

[0100] like Figure 7 As shown, the tracking line data point 701, the reference correction target point 702, and the corrected tracking line data point 703 can represent the positional relationship during the fusion process. Figure 7 Three types of data points are distinguished by different symbols. After correction, the tracking line data point 703 is located at the corresponding fusion position between the tracking line data point 701 and the reference correction target point 702. When the fusion parameter decreases, the corrected tracking line data point 703 is closer to the tracking line data point 701; when the fusion parameter increases, the corrected tracking line data point 703 moves towards the reference correction target point 702.

[0101] After performing weighted fusion on at least one tracking line data point, processor 21 can obtain the corrected tracking line data point. Processor 21 uses the corrected tracking line data point to update the corresponding data point in the original tracking line data point sequence. Data points that did not participate in the current fusion process can retain their input coordinates. After updating one or more data points, the corrected tracking line data point sequence can be obtained.

[0102] By using a sequence update method, the processor 21 does not need to change the original arrangement of the tracking line data points, nor does it need to regenerate a set of data points unrelated to the original path. The corrected tracking line data points still maintain the correspondence with the original tracking line index, distance order, and path position, which facilitates subsequent coordinate transformation and curve interpolation.

[0103] Furthermore, the correspondence between distance and weight can be specifically represented as the correspondence between distance segments and segment weights. Distance segments are used to represent the spatial range divided according to the distance between the tracking line data points and the vehicle 10, while segment weights are used to represent the fusion weights associated with the corresponding spatial range.

[0104] When using the correspondence between distance segments and segment weights, memory 22 can store the boundaries of multiple distance segments and the segment weights corresponding to each distance segment. After determining the distance between the tracking line data point and the vehicle 10, processor 21 determines the distance segment in which the distance belongs, then reads the corresponding segment weight, and uses the segment weight as the weight corresponding to the tracking line data point.

[0105] The division of distance segments can be based on the spatial distance between the tracking line data points and the vehicle 10. Although the sequence of tracking line data points can be arranged from nearest to farthest in distance, and a certain correspondence can be established between the data point index and the spatial distance, the actual spatial distance corresponding to the same index may vary under different frames, different vehicle platforms, or different display distance ranges. Using the actual distance to determine the distance segments can keep the segment weights related to the actual display positions of the tracking line data points.

[0106] In some implementations, the distance segment can also be indirectly determined by the data point index. For example, when the number of data points output by ADAS 30, the spacing between adjacent data points, and the tracking line display range remain stable, a correspondence between the data point index and the distance segment can be pre-established. After the processor 21 reads the data point index, it can obtain the distance segment corresponding to the data point based on this correspondence.

[0107] The effective display range of the tracking line may differ for different vehicle projects; therefore, the distance segment boundaries can be stored in memory 22 as project calibration data. For example, the tracking line display range can be from 0m to 50m, with the range within 20m designated as the near-end distance segment, the range from 20m to approximately 30m as the middle distance segment, and the range above 30m as the far-end distance segment. Correspondingly, the segment weights for the near-end distance segment can be from 0.90 to 1.00, the segment weights for the middle distance segment can be from 0.60 to 0.85, and the segment weights for the far-end distance segment can be from 0.30 to 0.55. These distance and weight values ​​are used to illustrate a distance segment division method and the corresponding segment weight configuration.

[0108] Segment weights can be determined through offline calibration. Offline calibration can be performed during vehicle development or model adaptation. During vehicle operation, the processor 21 can directly read the correspondence between the calibrated distance segments and segment weights, without needing to recalculate the basic segment weights in each processing cycle.

[0109] like Figure 8 As shown, the effective display range of the tracking line in front of the vehicle 10 can be divided into a near distance segment 801, a middle distance segment 802, and a far distance segment 803. The near distance segment 801, middle distance segment 802, and far distance segment 803 are distributed sequentially along the forward direction of the vehicle 10. The tracking line data point sequence may include near tracking line data points located in the near distance segment 801, middle tracking line data points located in the middle distance segment 802, and far tracking line data points located in the far distance segment 803.

[0110] Near end, middle end, and far end are spatial divisions relative to the vehicle itself (10) and the current tracking line display range, and do not represent fixed road distances. Different vehicle models, different augmented reality head-up display optical designs, or different tracking line display modes may use different distance boundaries.

[0111] Different reference correction target points can be determined using different methods for different distance segments. The reason for using different reference correction target points is that the position of the near-end tracking line, the shape of the mid-end path, and the extension of the far-end path each have different sources of spatial constraints. If different data points are merged together towards a fixed spatial position, it is easy to destroy the original path shape of the tracking line. Therefore, reference correction target points that match the corresponding path attributes can be established for different distance positions.

[0112] For near-end tracking line data points, processor 21 can determine a preset near-end reference position as the reference correction target point. The preset near-end reference position refers to the data position pre-determined in the near-end region of the tracking line, used to constrain the position of the starting region of the tracking line. The preset near-end reference position can be determined through vehicle project calibration and can be stored in memory 22.

[0113] In one specific implementation, a pre-defined near-end reference position can be established to correspond with the position of the vehicle speed element in the AR-HUD display. For example... Figure 9 As shown, the vehicle speed element 901 corresponds to a preset near-end reference position, and the tracking line 101 extends from the display area corresponding to the preset near-end reference position toward the front of the vehicle.

[0114] The starting area of ​​the tracking line in the driver's field of vision usually needs to maintain spatial coordination with the fixed or relatively stable display area in the vehicle display interface. By fusing the data points corresponding to the starting end of the tracking line to a preset near-end reference position, the lateral drift of the starting area of ​​the tracking line caused by the lateral changes of the target vehicle 11 being transmitted to the near-end path data can be reduced.

[0115] For the mid-range tracking line data points, the processor 21 can fit the lane centerline data corresponding to the mid-range distance segment and determine the reference correction target point corresponding to the mid-range tracking line data points based on the fitting results.

[0116] Lane centerline data refers to data that represents the center position of the vehicle's current drivable lane or the center position of the navigation target lane. Lane centerline data can be provided by ADAS 30 or calculated from lane boundary data. In this application, lane centerline data serves as the spatial constraint source for the mid-range reference path.

[0117] Fitting refers to the process of forming a continuous or approximately continuous path representation based on multiple lane centerline data points. The fitting result can represent the lane center direction and path curvature within a mid-range distance. The specific mathematical model can be selected based on the vehicle platform's existing path data processing capabilities.

[0118] The mid-range distance typically provides more stable lane perception information compared to the far-range distance. By using mid-range lane centerline data to establish a fitting result, a relatively stable mid-range reference path can be obtained. For mid-range tracking line data points located in the mid-range distance segment, a reference position can be determined in the fitting result based on the corresponding longitudinal position, and this reference position can be used as the reference correction target point corresponding to the mid-range tracking line data point.

[0119] This process does not directly replace the original tracking line with the lane centerline. The mid-lane centerline fitting result is used to provide a reference correction target point, while the original tracking line data points still participate in the correction result according to the fusion ratio. When the original navigation path does not coincide with the lane centerline, the fusion result can still retain the original navigation path representation, while using the lane centerline fitting result to constrain short-term abnormal lateral fluctuations.

[0120] For the far-end tracking line data points, the processor 21 can perform far-end extrapolation on the fitting results of the center line of the middle lane, and determine the reference correction target point corresponding to the far-end tracking line data points based on the far-end extrapolation results.

[0121] Far-end extrapolation refers to the process of extending the reference path further in the vehicle's direction of travel based on the path fitting results already formed within the mid-range distance. When far-end path data is affected by changes in the state of the target ahead and long-range perception errors, it may exhibit greater lateral fluctuations than the mid-range path. If the reference correction target point is directly generated using the current frame's raw far-end data, the reference correction target point itself may oscillate along with the abnormal data. Extending the far-end using the relatively stable mid-range fitting results ensures that the far-end reference correction target point maintains continuity with the mid-range path trend.

[0122] For example, the fitting result of the centerline of the middle lane indicates that the road ahead of the vehicle generally maintains a straight extension, and the target vehicle 11 cuts out in the far area, causing the far path point of ADAS 30 to shift to one side for a short time. The processor 21 can use the mid-range fitting result to calculate the reference position to the far end, and then fuse the original tracking line data points at the far end with the far reference correction target point, thereby reducing the degree to which the sudden change in the far path in a single frame is directly reflected in the displayed tracking line.

[0123] For example, when a road is on a curve, the fitting result of the centerline of the middle lane can include the corresponding curvature. The far-end extrapolation can continue to extend along the path trend obtained from the middle-end fitting, so that the far-end reference correction target point still reflects the road curve trend, rather than simply generating a fixed straight-line reference point according to the longitudinal direction of the vehicle.

[0124] In some implementation methods, the proximal tracking line data points corresponding to the starting end of the tracking line can be directly mapped to a preset proximal reference position; for other proximal tracking line data points located between the starting end of the tracking line and the middle fitting path, corresponding reference correction target points can be generated based on the path continuity relationship between the preset proximal reference position and the starting part of the middle fitting path, thereby enabling a smooth transition from the proximal reference position to the middle fitting path.

[0125] By configuring reference correction target points at different distances, the near-end region can have a relatively stable starting position constraint, the middle-end region uses the lane centerline to provide a path reference, and the far-end region uses the fitting results from the middle-end region to extend and form a path constraint. After establishing a continuous relationship between the reference information of the three spatial regions along the vehicle's direction of travel, and then combining the dynamic suppression parameters and weights corresponding to different data points to perform fusion, the overall path shape of the tracking line can be preserved while reducing local lateral jitter.

[0126] Furthermore, the processor 21 can also identify the target vehicle 11 for dynamic suppression parameter calculation from multiple vehicle targets in front of the vehicle 10.

[0127] Candidate vehicles refer to vehicles that meet the prerequisites for target vehicle selection and are eligible to participate in the target vehicle screening process. Vehicle targets can be provided by cameras, millimeter-wave radar, lidar, or target fusion modules within ADAS 30. Candidate vehicle information may include lateral position, longitudinal position, target identifier, and target tracking status.

[0128] The preset lateral distance condition is used to limit the lateral position range of candidate vehicles relative to the current vehicle 10, so that vehicles that are far away from the current driving path of the current vehicle are not directly used as target vehicles 11.

[0129] For example, a lateral position range can be set based on the current lane width, allowing vehicles in the current lane or those cutting into the current lane to enter the candidate set. In one specific configuration, the lane width can be approximately 3.5m, and vehicles are filtered within a lateral range of approximately 1.75m relative to the lane center, and then the target vehicle 11 is determined from the candidate vehicles that meet the lateral distance condition.

[0130] After obtaining at least one candidate vehicle, the processor 21 can determine the longitudinal distance between the candidate vehicle and the current vehicle 10, and identify the candidate vehicle with the smallest longitudinal distance as the target vehicle 11. Vehicles located in front of and close to the current vehicle 10 are more likely to alter the current path planning or lane-level tracking data. Therefore, selecting the vehicle with the closest longitudinal distance from vehicles that meet the lateral distance condition can maintain a strong correlation between the target vehicle's lateral position change information and the current tracking data change.

[0131] When a vehicle in an adjacent lane begins to cut into the current lane of this vehicle and enters a preset lateral distance range, the adjacent lane vehicle can be transformed into a candidate vehicle. If the longitudinal distance between the adjacent lane vehicle and this vehicle 10 is less than the corresponding distance of other candidate vehicles, the adjacent lane vehicle can be updated to the current target vehicle 11, and lateral position change information can be generated based on the continuous lateral position of the current target vehicle 11 in subsequent processing cycles.

[0132] By using the target vehicle selection method, a definite data association object can be established when multiple vehicles are present in front at the same time, avoiding the mixing of the lateral movements of multiple vehicles into an ambiguous target vehicle change information.

[0133] Furthermore, the corrected tracking line data point sequence can continue to be processed for display output.

[0134] The corrected tracking line data point sequence can be located in the Advanced Driver Assistance System (ADAS) coordinate system. The ADAS coordinate system refers to the data coordinate system used by ADAS 30 to represent the spatial position of the vehicle, road, and path. The tracking line data points can include longitudinal and lateral positions, and may further include height positions.

[0135] The display data used by AR-HUD is typically located in the head-up display image coordinate system. The head-up display image coordinate system refers to the data coordinate system corresponding to the AR-HUD display screen. Path data in the advanced driver assistance system coordinate system can be converted into image positions in the head-up display image coordinate system before being displayed and rendered.

[0136] When the corrected tracking line data point sequence meets the preset output conditions, the processor 21 can transform the corrected tracking line data point sequence from the advanced driver assistance system coordinate system to the head-up display image coordinate system to obtain the tracking line image data points.

[0137] The preset output conditions refer to the conditions used to determine whether the current correction result should enter the display output processing. The preset output conditions can be generated by the subsequent evaluation process. When the correction result meets the set data stability requirements, the processor 21 can allow the corresponding tracking line data to enter the coordinate transformation and rendering process; when the correction result does not meet the evaluation conditions, parameter feedback and re-correction can be performed first.

[0138] Coordinate transformation is used to establish a mapping between spatial path data in the coordinate system of an advanced driver assistance system and the position of the AR-HUD display screen. Specific coordinate transformations can be implemented in conjunction with display calibration parameters in the vehicle project; when different AR-HUDs have different optical parameters, virtual image distances, or display areas, the coordinate transformation relationship can be determined during the device calibration phase.

[0139] In one possible implementation, coordinate transformation parameters between the advanced driver assistance system coordinate system and the head-up display image coordinate system can be established during the vehicle project calibration stage, and the coordinate transformation parameters can be stored in memory 22; during vehicle operation, processor 21 calculates the corresponding image coordinates based on the spatial coordinates of the tracking line data points and the coordinate transformation parameters.

[0140] This application does not limit the coordinate transformation to a specific projection model. As long as the corrected spatial tracking line data points can be converted into image data points that are compatible with the head-up display, subsequent tracking line generation can be performed.

[0141] After coordinate transformation, there may still be gaps between multiple discrete tracking line image data points. If the display content is directly formed using discrete points, the display path may appear as a broken line or discontinuous. Therefore, the processor 21 can perform curve interpolation on the tracking line image data points to generate a continuous tracking line path.

[0142] Curve interpolation refers to generating a continuous curve that passes through or approximates multiple discrete tracking line image data points. Curve interpolation can employ spline curve interpolation or existing path smoothing methods in vehicle display systems. The interpolation process primarily transforms discrete data points into a continuous path suitable for image rendering without altering the positional relationships of the main data points determined by dynamic suppression and weight fusion.

[0143] After obtaining the continuous tracking path, the processor 21 can output the continuous tracking path to the display processing module or the augmented reality head-up display rendering module. The display processing module can generate corresponding graphics based on the continuous tracking path, and then project them onto the driver's field of vision through the augmented reality head-up display device.

[0144] Fusion correction can be completed before coordinate transformation and curve interpolation. After path data undergoes fusion correction in the advanced driver assistance system coordinate system, it is then transformed to the head-up display image coordinate system, thus making the fusion correction process independent of specific display resolution and image size.

[0145] Furthermore, before performing the corresponding coordinate transformation and display output process, the processor 21 can evaluate the corrected tracking line data point sequence.

[0146] The processor 21 can obtain the current corrected tracking line data point sequence and calculate the evaluation results. The evaluation results are used to characterize the positional stability and continuity of the fused and corrected tracking line data.

[0147] Evaluation metrics can include the positional stability of near-end data points, the lateral swing amplitude of far-end data points, and data point continuity. Data point continuity can be evaluated by the lateral positional change of data points at the same distance in adjacent frames.

[0148] The positional stability of near-end data points can be used to evaluate the degree of change in the starting region of the tracking line relative to a preset near-end reference position after fusion. For example, the lateral positional difference between near-end data points and the preset near-end reference position in consecutively processed frames can be compared. When the positional difference is small, the starting region of the near-end tracking line can be considered to have a good inter-frame stability.

[0149] The lateral swing amplitude of far-end data points can be used to evaluate the degree of lateral variation of data points within a far-end distance range between consecutive frames. For example, for far-end tracking line data points at the same or similar longitudinal distance positions, the lateral coordinate changes in consecutive frames can be compared, and the corresponding lateral variation amplitude can be obtained.

[0150] Data point continuity can be evaluated from the time dimension by assessing the lateral difference between data points at the same distance position between adjacent frames. When the target vehicle 11 enters or exits, if a certain tracking line data point undergoes a large lateral jump between consecutive frames, the corresponding inter-frame difference is large; after fusion correction, the inter-frame difference decreases, which can indicate that the data points change more continuously over time.

[0151] Preset evaluation conditions can be established based on at least one of the above evaluation indicators. One feasible evaluation condition may include: the lateral deviation between the near-end tracking line data point and the preset near-end reference position does not exceed a first evaluation threshold; the lateral swing amplitude of the far-end tracking line data point between consecutive frames does not exceed a second evaluation threshold; and the lateral difference between tracking line data points at the same distance position between adjacent frames does not exceed a third evaluation threshold. The first, second, and third evaluation thresholds can be determined during the project calibration phase based on the AR-HUD display distance, pixel resolution, and driving scenario test results.

[0152] When the current evaluation result does not meet the preset evaluation conditions, the processor 21 can update at least one of the parameters used to determine the dynamic suppression parameters and the correspondence between distance and weight, and then perform fusion again based on the updated result.

[0153] The parameters used to determine the dynamic suppression parameters may include preset basic suppression parameters, preset vehicle speed influence coefficients, preset distance influence coefficients, or other calibration parameters involved in the calculation of dynamic suppression parameters.

[0154] When the correspondence between distance and weight is updated, the distance segment boundary, the corresponding weight of the distance segment, or at least one of the two types of data can be adjusted. For example, if a certain far-end distance range continues to show large inter-frame left and right swings, the fusion weight of the corresponding distance range can be adjusted; or, for example, if the actual spatial location where the swing begins is inconsistent with the current far-end distance segment boundary, the distance segment boundary can be adjusted so that the corresponding data points adopt a more suitable segment weight.

[0155] After the parameters are updated, the processor 21 can redetermine the dynamic suppression parameters, reread or determine the corresponding weights for the relevant tracking line data points, and complete the fusion between the tracking line data points and the reference correction target points again. The processor 21 then re-evaluates the corrected tracking line data point sequence and repeats the parameter update, fusion and evaluation process until the evaluation result of the corrected tracking line data point sequence meets the preset evaluation conditions.

[0156] The evaluation process can establish a feedback relationship between data evaluation and correction parameters. Once the evaluation results meet the preset evaluation conditions, the current correction data is displayed and output; if the evaluation results still do not meet the preset evaluation conditions, parameter updates and fusion processing can continue.

[0157] In an feasible feedback strategy, the update direction can be selected based on indicators that fail to meet evaluation criteria. For example, if the lateral swing amplitude of a far-end tracking line data point between consecutive frames exceeds a second evaluation threshold, the distance influence coefficient or the weight corresponding to the far-end distance range can be adjusted first; if the lateral deviation between a near-end tracking line data point and a preset near-end reference position exceeds a first evaluation threshold, the weight corresponding to the near-end distance range can be adjusted first; if the lateral difference between tracking line data points at the same distance position between adjacent frames exceeds a third evaluation threshold, the calibration coefficient related to the dynamic suppression parameter can be adjusted. To avoid excessive parameter changes from a single feedback, a preset step size can be used for each parameter update, and a decision on whether to continue updating can be made after the next evaluation.

[0158] In some implementations, the preset basic suppression parameters, vehicle speed influence coefficient, distance influence coefficient, and distance segment boundary can be determined using the evaluation process during the project calibration phase, and the determination results can be written into the vehicle; alternatively, the processor 21 can be allowed to make limited adaptive adjustments within the preset parameter range during vehicle operation.

[0159] Evaluation feedback allows the fusion correction parameters to be determined not only by the initial configuration but also to be evaluated based on the performance of the corrected data. If the far-end data still exhibits significant left-right oscillations, corresponding adjustments can be made; if the near-end data shows over-anchoring or insufficient path response, the parameters can also be readjusted based on the evaluation results, thereby establishing a data feedback relationship between path stability and real-time path following.

[0160] Furthermore, such as Figure 10 As shown, this application also provides an AR-HUD 60. The AR-HUD 60 may include a tracking line display control device 20, a projection unit 61, and an optical component 62. The windshield 12 of the vehicle 10 can serve as a reflective component for the image beam, allowing the occupant 14 to observe a virtual image of the tracking line formed in the field of view in front of the vehicle; Figure 10 The road reference plane in the diagram is represented by 13.

[0161] The tracking line display control device 20 is connected to the projection unit 61. The projection unit 61 is used to project an image beam, and the optical component 62 is used to optically transmit and reflect the image beam. The tracking line display control device 20 generates a continuous tracking line path based on the corrected tracking line data point sequence, and controls the projection unit 61 to project the image beam corresponding to the continuous tracking line path, so that the occupant 14 can observe the corresponding virtual image through the windshield 12.

[0162] In the AR-HUD 60, the tracking line display control device 20, the projection unit 61, and the optical components 62 can be located within the same device housing, or they can be located in different electronic modules connected via an in-vehicle communication link. For example, the tracking line display control device 20 can operate on the cockpit domain controller, while the projection unit 61 and the optical components 62 are located in the HUD hardware device; alternatively, the processor 21 and memory 22 can be located in the HUD controller, allowing data correction and display rendering to be completed within the same controller.

[0163] The deployment position of the tracking line display control device 20 in the AR-HUD 60 does not change the data processing relationship. The processor 21 determines the dynamic suppression parameters and weights for at least one tracking line data point, and fuses the tracking line data point with the corresponding reference correction target point according to the dynamic suppression parameters and weights; the fused data is evaluated, coordinate transformed and curve interpolated to form a continuous tracking line path, and then the projection unit 61 and the optical component 62 cooperate to form the corresponding virtual image.

[0164] This application also provides a storage medium. The storage medium can store a computer program. When the computer program is executed by a processor, the processor can perform tasks such as determining the dynamic suppression parameters corresponding to the tracking line data points, determining the distance-corresponding weights, and fusing the tracking line data points.

[0165] For example, when a computer program runs, it can read a sequence of tracking line data points and obtain information on the lateral position change of the target vehicle for at least one tracking line data point in the sequence. The computer program can then determine the corresponding dynamic suppression parameters based on this information, and further determine the weights based on the distance between the tracking line data point and the vehicle, and the correspondence between distance and weight.

[0166] The computer program can further read or calculate the reference correction target point corresponding to the tracking line data point, and according to the dynamic suppression parameters and weights, fuse the original tracking line data point with the reference correction target point to generate a corrected tracking line data point sequence.

[0167] Storage media may include random access memory, read-only memory, flash memory, solid-state storage devices, magnetic storage media, optical storage media, or other non-transitory computer-readable media capable of storing computer programs.

[0168] Different functions in a computer program can be organized into software modules. For example, it may include functions for inputting tracking line data, processing changes in target vehicles, calculating dynamic suppression parameters, determining weights, determining reference correction target points, fusing data points, evaluating performance, and displaying data output. These functions can also be combined into a single program module.

[0169] For the tracking line display control device 20 implemented by processor 21 and memory 22, the computer program can be stored in memory 22. After processor 21 runs the computer program, memory 22 can also be used as a runtime cache to store the tracking line data point sequence, target vehicle lateral position change information, dynamic suppression parameters, weights, and fused tracking line data points.

[0170] During continuous vehicle operation, the computer program can repeatedly execute corresponding processing according to the tracking line data update cycle. Each time ADAS 30 generates new path data, processor 21 can form the current frame correction result based on the current path data and the lateral position change state of the target vehicle 11. The corrected data generated in different processing cycles can continue to be used to evaluate the inter-frame continuity, allowing the stability of the time dimension data to participate in subsequent parameter processing.

[0171] This application can complete the correction of the tracking line data before it enters the augmented reality display through software data processing, without requiring additional mechanical mechanisms to suppress the wobbling of the tracking line image.

[0172] When the target vehicle 11 maintains relatively stable driving, the dynamic suppression parameters can better reflect the basic parameters and the vehicle's operating status, allowing the tracking line to maintain a normal path and follow changes. When the target vehicle 11 laterally enters or exits, the target vehicle's change excitation is incorporated into the dynamic suppression parameter calculation, affecting the degree of tracking line data fusion. Simultaneously, the distance between data points is further differentiated by corresponding weights to distinguish the degree of correction at different spatial locations.

[0173] For near-end data, a preset near-end reference position can be used to reduce positional drift in the starting area of ​​the tracking line; for mid-end data, the lane centerline fitting results can be used to provide path reference; for far-end data, the mid-end fitting results can be used to extrapolate to the far end to form a reference correction target point, and combined with dynamic suppression processing related to target vehicle changes to reduce left and right sway at the far end.

[0174] After data point fusion is completed, the evaluation process can further determine the near-end position stability, far-end oscillation state, and the continuity of adjacent frame data. If the evaluation result does not meet the preset conditions, the parameters used for dynamic suppression parameter calculation or the correspondence between distance and weight can be adjusted, and the fusion can be completed again. When the evaluation result meets the preset conditions, the corrected tracking line data points can be transformed to the head-up display image coordinate system and a continuous tracking line path can be formed through curve interpolation.

[0175] Some functions performed by processor 21 can be implemented through software, hardware logic, or a combination of software and hardware. Different functions can be deployed on the same processor or in multiple computing units capable of exchanging data.

[0176] The specific values ​​of distance, position, vehicle speed, and various parameters recorded in this application can be calibrated based on the vehicle platform, advanced driver assistance system data characteristics, augmented reality head-up display optical parameters, and tracking line display range.

[0177] The processing order described in this application is used to illustrate the logical relationship between different data processing steps. Where data dependencies permit, some data acquisition, parameter reading, or pre-calculation processes can be performed in parallel. For example, processor 21 can read the correspondence between distance and weight while obtaining information on the lateral position change of the target vehicle, or it can predetermine the distances of multiple tracking line data points and then calculate the corresponding dynamic suppression parameters and weights separately.

[0178] The above specific embodiments are used to illustrate the tracking line display control scheme provided in this application. Technical content from different embodiments can be combined where there is no conflict in the data relationships.

Claims

1. A tracking line display and control device, characterized in that, include: The memory is configured to store the correspondence between distance and weight; The processor, connected to the memory, is configured to: For at least one tracking line data point in the tracking line data point sequence, based on the lateral position change information of the target vehicle, the dynamic suppression parameter corresponding to the tracking line data point is determined. Based on the distance between the tracking line data points and the vehicle, the weight corresponding to the tracking line data points is determined according to the correspondence. Based on the dynamic suppression parameters and the weights, the tracking line data points are fused with the corresponding reference correction target points to obtain the corrected tracking line data point sequence.

2. The tracking line display and control device according to claim 1, characterized in that, The processor is configured to: Based on the lateral position change information and adjustment information of the target vehicle, the dynamic suppression parameters corresponding to the tracking line data point are determined. The adjustment information includes at least one of the distance between the tracking line data point and the vehicle and the current speed of the vehicle.

3. The tracking line display and control device according to claim 2, characterized in that, The lateral position change information of the target vehicle includes the target vehicle change excitation value; The processor is also configured to: The change in lateral position is determined based on the target vehicle's lateral position at the current moment and its lateral position at historical moments. Determine the time interval between the current moment and the historical moment; The target vehicle change excitation value is determined based on the lateral position change and the time interval.

4. The tracking line display and control device according to claim 3, characterized in that, The processor is also configured to: Determine whether the change in lateral position meets the preset change conditions; If the lateral position change satisfies the preset change condition, the target vehicle change excitation value is determined based on the lateral position change and the time interval. If the lateral position change does not meet the preset change condition, the target vehicle change excitation value is determined to be zero.

5. The tracking line display and control device according to claim 3, characterized in that, The memory is also configured to store preset basic suppression parameters, preset vehicle speed influence coefficient, preset vehicle speed influence relationship, preset distance influence coefficient, and preset distance influence relationship; The processor is also configured to: Get the current speed of the vehicle; The vehicle speed influence value is determined based on the current vehicle speed and the preset vehicle speed influence relationship, and the vehicle speed influence item is determined based on the vehicle speed influence value and the preset vehicle speed influence coefficient; The distance influence value is determined based on the distance between the tracking line data point and the vehicle and the preset distance influence relationship, and the target vehicle change related items are determined based on the distance influence value, the preset distance influence coefficient and the target vehicle change excitation value; The dynamic suppression parameters are determined based on the preset basic suppression parameters, the vehicle speed influence item, and the target vehicle change related item.

6. The tracking line display and control device according to claim 1, characterized in that, The processor is configured to: Based on the dynamic suppression parameters and the weights, the fusion parameters corresponding to the tracking line data points are determined; Based on the fusion parameters, determine the first fusion ratio corresponding to the tracking line data point and the second fusion ratio corresponding to the reference correction target point; According to the first fusion ratio and the second fusion ratio, the tracking line data points and the corresponding reference correction target points are weighted and fused to obtain the corrected tracking line data points. The corrected tracking line data points are used to update the tracking line data point sequence to obtain the corrected tracking line data point sequence.

7. The tracking line display and control device according to claim 1, characterized in that, The correspondence is the correspondence between distance segments and segment weights; The processor is configured to: determine the segment weight corresponding to the distance segment between the tracking line data point and the vehicle as the weight corresponding to the tracking line data point, based on the correspondence.

8. The tracking line display control device according to claim 1, characterized in that, The tracking line data point sequence includes proximal tracking line data points located in the proximal distance segment, mid-range tracking line data points located in the mid-range distance segment, and distal tracking line data points located in the distal distance segment. The processor is also configured to: The preset proximal reference position is determined as the reference correction target point corresponding to the proximal tracking line data point; Fit the lane centerline data corresponding to the mid-range distance segment, and determine the reference correction target point corresponding to the mid-range tracking line data point based on the fitting result; The fitting results are extrapolated to the far end, and the reference correction target point corresponding to the far-end tracking line data point is determined based on the extrapolation results.

9. The tracking line display and control device according to claim 1, characterized in that, The processor is also configured to: Obtain at least one candidate vehicle located in front of the vehicle and satisfying a preset lateral distance condition; The candidate vehicle with the smallest longitudinal distance from the present vehicle among the at least one candidate vehicles is determined as the target vehicle.

10. The tracking line display control device according to claim 1, characterized in that, The processor is also configured to: If the corrected tracking line data point sequence meets the preset output conditions, the corrected tracking line data point sequence is transformed from the advanced driver assistance system coordinate system to the head-up display image coordinate system to obtain tracking line image data points. Perform curve interpolation based on the tracking line image data points to obtain a continuous tracking line path; Output the continuous tracking path.

11. The tracking line display control device according to claim 10, characterized in that, The processor is also configured to: The corrected tracking line data point sequence is evaluated to obtain the evaluation result; If the evaluation result meets the preset evaluation conditions, it is determined that the corrected tracking line data point sequence meets the preset output conditions. If the evaluation result does not meet the preset evaluation conditions, update at least one of the parameters used to determine the dynamic suppression parameter and the corresponding relationship; Based on at least one of the updated parameters used to determine the dynamic suppression parameters and the updated correspondence, the tracking line data points are fused with the corresponding reference correction target points until the evaluation result of the corrected tracking line data point sequence meets the preset evaluation conditions.

12. An augmented reality head-up display device, characterized in that, include: Projection unit, used to project image beams; Optical components for reflecting the image beam to form a virtual image; Tracking line display control device as described in any one of claims 1 to 11; The tracking line display control device is further configured to generate a continuous tracking line path based on the corrected tracking line data point sequence, and control the projection unit to project the image beam corresponding to the continuous tracking line path.

13. A storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it causes the processor to perform: For at least one tracking line data point in the tracking line data point sequence, based on the lateral position change information of the target vehicle, the dynamic suppression parameter corresponding to the tracking line data point is determined. Based on the distance between the tracking line data points and the vehicle, the weight corresponding to the tracking line data points is determined according to the correspondence between distance and weight. Based on the dynamic suppression parameters and the weights, the tracking line data points are fused with the corresponding reference correction target points to obtain the corrected tracking line data point sequence.