Intelligent headlamp control method and control system based on driving intention prediction

By using neural networks to predict driving intentions and biological signals, the headlight pattern is dynamically adjusted, solving the problems of lag and insufficient safety redundancy in existing technologies, thus achieving higher driving safety and reduced accidents.

CN121291269BActive Publication Date: 2026-03-17CHANGZHOU XINGYU AUTOMOTIVE LIGHTING SYST CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-12-11
Publication Date
2026-03-17

AI Technical Summary

Technical Problem

The existing headlight system has a lag response, resulting in blind spots. It does not take into account the driver's driving intentions and physiological state, lacks safety redundancy, and cannot provide effective lighting in low visibility conditions.

Method used

By predicting driving intentions through neural networks and combining them with driver biosignals, the headlight pattern is dynamically adjusted to eliminate blind spots, expand illumination range and brightness, and provide safety redundancy in conjunction with the ADAS system.

Benefits of technology

Significantly improves nighttime curve safety, reduces the probability of accidents caused by visual negligence, and reduces lighting-related accidents by 23%-41%.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121291269B_ABST
    Figure CN121291269B_ABST
Patent Text Reader

Abstract

This invention relates to the field of intelligent vehicle lighting technology, and in particular to an intelligent headlight control method and control system based on driver intention prediction. The method includes: collecting environmental data, driver biosignals, and vehicle dynamic data through multi-source sensors; using a spatiotemporal graph convolutional network to predict future short-term driving intentions and confidence levels; real-time correction of lighting parameters based on the driver's eye-tracking gaze area and heart rate variability; activating a conservative wide-angle lighting mode when the intention confidence level is below a threshold; and triggering a strobe warning light pattern in response to an ADAS system pre-collision signal. The system includes a data acquisition unit, a processing unit, and an execution layer, achieving coordinated adjustment of headlight deflection angle, brightness, and illumination range. It solves the problems of lag and blind spot risk inherent in traditional adaptive headlights, significantly improving the timeliness of blind spot lighting in curves and safety in low-visibility conditions.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of intelligent vehicle lighting technology, and in particular to an intelligent headlight control method and control system based on driver intention prediction. Background Technology

[0002] Current Advanced Front-lighting Systems (AFS) primarily rely on vehicle dynamic parameters such as steering wheel angle and vehicle speed to passively adjust the beam pattern, which has the following fundamental drawbacks:

[0003] 1. Response lag issue: Traditional solutions require the detection of actual steering action (such as steering wheel rotation > 15°) before adjusting the lighting, resulting in a 0.8-1.2 second blind spot in sharp bends, increasing the risk of nighttime driving;

[0004] 2. Lack of human factor adaptation: The driver's eye movement focus distribution and physiological state (such as distraction and fatigue) are not taken into account, and it is impossible to enhance the lighting for the visual focus area;

[0005] 3. Insufficient safety redundancy: There is a lack of conservative lighting strategies based on prediction confidence under low visibility conditions, and there is no light pattern coordination with the ADAS emergency braking system.

[0006] Although some solutions attempt to combine navigation maps to predict curves, they still cannot solve the lighting response needs of drivers who suddenly intend to change lanes. Summary of the Invention

[0007] The technical problem to be solved by the present invention is that the existing lighting steering changes respond after the actual operation, lack the analysis of the driver's driving intention and driving state, and lack lighting safety settings in some special scenarios.

[0008] Therefore, this invention provides an intelligent headlight control method and control system based on driving intention prediction, which achieves:

[0009] Intention-driven pre-lighting mechanism: By predicting driving intentions through neural networks, the light spot deflection is initiated before physical steering occurs, eliminating blind spots;

[0010] Biosignal fusion control: mapping eye-tracking gaze coordinates to road surface area weights, dynamically adjusting local brightness, and simultaneously extending the illumination distance based on heart rate variability;

[0011] The confidence-adaptive safety strategy automatically switches to wide-angle lighting mode (e.g., ≥120° illumination angle) when the prediction confidence is lower than a set threshold, and triggers a flashing warning in response to the ADAS collision warning signal.

[0012] The technical solution adopted by this invention to solve its technical problem is:

[0013] A method for intelligent headlight control based on driver intention prediction includes the following steps:

[0014] Step 1: Collect lane line and obstacle information, vehicle information and surrounding vehicle information, and also collect driver biosignals;

[0015] The driver's biosignals include the driver's gaze coordinates, heart rate variability, and grip strength;

[0016] Step 2: Preprocess the collected multi-source data;

[0017] Step 3: Use a neural network to process the preprocessed data obtained in Step 2, and output the driving intention prediction result and confidence level;

[0018] Step 4: Based on the dynamic light pattern control logic, multi-dimensional light pattern adjustment commands are generated according to the driving intention prediction results, confidence data and driver biosignals to dynamically adjust the headlight light pattern;

[0019] The light pattern includes the horizontal deflection angle, pitch angle, and regional brightness distribution of the headlights;

[0020] Step 5: When the confidence level is below the threshold, expand the headlight illumination angle to wide-angle lighting mode;

[0021] Step 6: Trigger warning light pattern in response to ADAS pre-collision signal.

[0022] Furthermore, in step 2, the preprocessing of the multi-source data includes time synchronization processing, outlier processing, data quality checking, and feature fusion.

[0023] Further, in step 3, the neural network is a spatiotemporal graph convolutional network, used to construct a spatiotemporal interaction graph containing the vehicle, surrounding vehicles, and lane lines. The vehicle nodes in the spatiotemporal interaction graph structure have feature vectors composed of their position coordinates, velocity components, and heading angles. The lane line nodes contain lane line curvature radius, lane type, and lane width feature parameters. When the centroid Euclidean distance between the vehicle and surrounding vehicles is less than 50 meters, an undirected connection edge is established between the vehicles. The vehicle always establishes an undirected connection edge between itself and the centerline of its lane. The edge weights are calculated using a dynamic function (Formula 3) in a learnable form. This function comprehensively considers the absolute value of the speed difference (relative speed) between the vehicle and surrounding vehicles and the Euclidean distance. Specific examples include:

[0024] Basic form (vehicle-to-vehicle connection): used to quantify the dynamic interaction risk between the vehicle and surrounding vehicles (such as a following vehicle approaching at high speed), the function formula is:

[0025] (1)

[0026] in, Let be the Euclidean distance (in meters) between the centroids of vehicles i and j. The absolute value of the speed difference between the vehicle and surrounding vehicles. This is the distance attenuation coefficient;

[0027] Extended form (vehicle and lane connection): Used to quantify the relationship between a vehicle and its lane (e.g., vehicle deviation from lane center), the function formula is:

[0028] (2)

[0029] in, It is the vertical distance (in meters) from the vehicle's center of gravity to the center line of its lane. This is the distance attenuation coefficient. Lane type weights;

[0030] Learnable Form (Complex Scenarios): Adaptive weight adjustment for complex traffic scenarios (such as high traffic volume and frequent lane changes), the function formula is:

[0031] (3)

[0032] in, The activation function maps the output to the 0-1 range (0 represents no correlation, and 1 represents strong correlation). It is a 2-layer neural network (64-dimensional input layer, 1-dimensional output layer), with the input being the absolute value of the speed difference. Euclidean distance from the center of mass .

[0033] The spatial topology of vehicles and roads is modeled by spatiotemporal interaction graph structure, and combined with the changes in time series (such as 5 consecutive frames), a two-layer graph convolutional network is used to process the topology. The graph convolutional network can capture dynamic high-risk interactions (such as vehicles approaching from a distance, changing lanes and cutting in).

[0034] An LSTM-CRF intent prediction model is constructed, consisting of LSTM and CRF layers, to process the feature sequences output by the spatiotemporal graph convolutional network. The spatiotemporal graph convolutional network outputs a 128-dimensional feature sequence (e.g., 5 consecutive frames), which is input into the LSTM-CRF intent prediction model, and the output is a driving intent label and probability distribution.

[0035] Furthermore, in step 3, the confidence calculation process is as follows: fifty forward propagation samplings are performed using the Monte Carlo Dropout mechanism, with twenty percent of neurons randomly discarded each time, and the mean probability μ and standard deviation σ of each driving intention label are calculated respectively.

[0036] When the mean of the maximum probability is below 0.6 or the standard deviation exceeds 0.25, it is judged as a low-confidence scene and the wide-angle lighting mode is triggered.

[0037] Furthermore, in step 4, the dynamic control logic for the light pattern includes: a first layer based on the intent prediction of a spatiotemporal graph convolutional network to drive pre-illumination actions, completing the spot deflection before physical turning occurs, eliminating the 0.8-second illumination blind spot caused by mechanical delay in traditional solutions; a second layer that integrates driver eye movement vectors and heart rate variability data, such as automatically increasing the illumination distance by 8 meters when the heart rate standard deviation is >50ms to cope with sudden operational hesitation; and a third layer that establishes a confidence-light pattern mapping rule, which provides a large coverage area for the wide-angle lighting mode in low-confidence scenarios and improves the ADAS-assisted flicker response speed.

[0038] Further, in step 4, the calculation process for regional brightness adjustment is as follows: the gaze point coordinates are mapped to road surface grid weight values ​​using a vector projection algorithm, and the calculation formula is:

[0039] (4)

[0040] in, The road surface grid weight value indicates the priority of brightness adjustment in the eye-tracking fixation area; , The driver's eye-tracking gaze coordinates (normalized values, ranging from 0 to 1) correspond to the relative position of the road surface. , The road surface is divided into 1024 independent grids using the center coordinates of the road surface grid (normalized value, range 0~1); This is the heart rate variability coefficient, reflecting the driver's condition.

[0041] The road surface grid weight value is used to adjust the brightness of the corresponding area, so as to achieve adaptive matching between physiological state and optical parameters.

[0042] Furthermore, in step 5, the wide-angle lighting mode has a horizontal illumination angle of ≥120° and the brightness is increased to more than 80% of the maximum level.

[0043] The goal is to ensure that drivers have sufficient safe visibility by maximizing coverage and high brightness redundancy without relying on intent prediction, in low-confidence scenarios such as complex environments (fog, rain), poor driver condition (distraction, fatigue) or sensor failure.

[0044] Furthermore, in step 6, the warning light pattern is generated by independent partitions within the main beam of the headlight and focused on the potential collision area.

[0045] A control system, comprising,

[0046] The data acquisition unit is used for multi-source data acquisition, including acquiring driver biosignals, environmental and vehicle dynamic information; and then preprocessing the multi-source data through the data fusion layer in the data acquisition unit.

[0047] The processing unit has a built-in intent prediction module and confidence assessment module, which outputs intent prediction results and prediction uncertainty based on the collected data.

[0048] The uncertainty in prediction is characterized by a confidence level.

[0049] The execution layer is connected to the vehicle deflection controller, modulator, and ADAS. The execution layer calls the light pattern dynamic control logic through the light pattern dynamic control module, sends dynamic adjustment of the headlight illumination direction and illumination range, and responds to the ADAS pre-collision signal to trigger the warning light pattern.

[0050] Compared to traditional headlight control schemes, the advantages of this invention are:

[0051] 1. Eliminate blind spots due to lighting delay: Adjust lighting before steering actions by predicting intent, solving the problem of blind spots in corners caused by mechanical response delay in traditional AFS, and significantly improving nighttime cornering safety;

[0052] 2. Enhanced human adaptability: The system dynamically allocates lighting resources based on the driver's eye focus, automatically enhancing the brightness of key areas when the driver is distracted or fatigued, thus reducing the probability of accidents caused by visual negligence.

[0053] 3. Systematized safety redundancy: The confidence-driven wide-angle lighting mode provides backup lighting for low visibility conditions, and the ADAS collaborative warning mechanism constructs an active safety closed loop. Actual simulations show that it can reduce lighting-related accidents by 23%-41%. Attached Figure Description

[0054] The present invention will be further described below with reference to the accompanying drawings and embodiments.

[0055] Figure 1 This is an architecture diagram of the control system of the present invention;

[0056] Figure 2 This is a logic block diagram of the control method of the present invention;

[0057] Figure 3 This is a flowchart of the multi-source data acquisition and fusion process of this invention;

[0058] Figure 4 This is a schematic diagram illustrating the principle of predicting intent and assessing confidence levels in this invention.

[0059] Figure 5 This is the flowchart of the dynamic control logic for the optical pattern of this invention. Detailed Implementation

[0060] The invention will now be described in further detail with reference to the accompanying drawings. These drawings are simplified schematic diagrams, illustrating only the basic structure of the invention and therefore showing only the components relevant to the invention. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of this disclosure.

[0061] It should also be understood that, for ease of description, the dimensions of the various parts shown in the accompanying drawings are not drawn to actual scale. The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit this disclosure or its application or use.

[0062] Techniques, methods, and apparatus known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and apparatus should be considered part of the specification. In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0063] In the description of this invention, it should be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "radial," and "circumferential," etc., indicating orientation or positional relationships, are based on the orientation or positional relationships shown in the accompanying drawings and are only for the convenience of describing the invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the invention. Furthermore, features defined with "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this invention, unless otherwise stated, "a plurality of" means two or more.

[0064] In the description of this invention, it should be noted that, unless otherwise explicitly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the specific circumstances.

[0065] A method and control system for intelligent headlight control based on driver intention prediction, applicable to, but not limited to, motor vehicles equipped with advanced driver assistance systems (ADAS), such as passenger cars and commercial vehicles.

[0066] Reference Figure 1 , Figure 3 A smart headlight control system based on driving intention prediction includes a data acquisition unit, a processing unit, and an execution layer.

[0067] The data acquisition unit is used for multi-source data acquisition, including environmental information, vehicle information, and driver biosignals. Specifically, the data acquisition unit acquires lane line information (lane line curvature radius, lane type, and lane width, etc.) and obstacle information through the vehicle's forward-facing camera; detects vehicle distance and relative speed through the vehicle's millimeter-wave radar; captures gaze point coordinates through an eye tracker installed in the vehicle; monitors heart rate variability and grip strength through biosensors on the vehicle's steering wheel; and reads vehicle dynamic parameters (position coordinates, speed components, and heading angle, etc.) through the vehicle's CAN bus. Simultaneously, the data acquisition unit integrates a data fusion layer to perform time synchronization processing, outlier handling, data quality checks, and feature fusion on the acquired multi-source data.

[0068] Time synchronization processing: Timestamps are unified for multi-source data using linear interpolation to ensure data time sequence consistency; Outlier handling: Outlier data is identified and removed, and missing values ​​are filled with sliding window mean to avoid outlier data interfering with subsequent predictions; Data quality check: Data is checked to see if it meets the standards; Feature fusion: Multi-source data is converted into high-dimensional feature vectors used by the processing unit.

[0069] The spatiotemporal graph construction module in the processing unit is based on a spatiotemporal graph convolutional network to construct a spatiotemporal interaction graph containing the vehicle, surrounding vehicles, and lane lines. The processing unit also includes an intent prediction module and a confidence evaluation module. The intent prediction module obtains the intent prediction results, namely driving intent labels and probability distributions, through an LSTM-CRF intent prediction model. The confidence evaluation module uses Monte Carlo Dropout sampling to calculate the probability mean μ and standard deviation σ of each driving intent label (intent type), which reflects the prediction uncertainty.

[0070] The execution layer is connected to the headlight spot deflection controller and modulator of the vehicle, and also to the vehicle's ADAS system. The execution layer calls the light pattern dynamic control logic through the light pattern dynamic control module, and combines the driving intention prediction results, confidence data and driver biosignals to generate multi-dimensional light pattern adjustment commands to dynamically adjust the light pattern. The light pattern includes the headlight illumination direction, illumination range, brightness, etc. The brightness adjustment is calculated by the eye-tracking-light spot linkage module in the light pattern dynamic control module. When the confidence level is below the threshold, the state machine decision-making mechanism built into the execution layer triggers a safety strategy to automatically switch to the wide-angle lighting mode executed by the safety redundancy module in the execution layer when σ > 0.25. At the same time, the current scene features are stored and uploaded to the edge server of the control system through the vehicle communication system (V2X) to optimize the spatiotemporal graph convolutional network loaded therein. In this mode, the illumination angle is expanded to a horizontal illumination angle ≥ 120° and the brightness is increased to more than 80% of the maximum level. Specifically, the light pattern dynamic control module is also connected to the vehicle's ADAS system through the ADAS collaboration module. The light pattern dynamic control module receives the pre-collision signal and triggers the warning light pattern. The warning light pattern is generated by independent partitions inside the headlight main beam. It achieves 8-12Hz high-frequency flashing through digital micromirror devices (DMD, which can realize millisecond-level light pattern reconstruction, supports 1024 independent lighting zone control, and its wavelength adaptation range covers 450-750nm, ensuring penetration performance in rainy and foggy weather) or matrix LED modules, and focuses on the potential collision area. The ADAS collaborative strobe response speed is 5 times faster than CAN bus transmission. In nighttime curve tests in mountainous areas, this solution increases the effective lighting coverage from 67% to 92% of the baseline solution; the warning light pattern can also include a dynamic warning light strip, which is projected onto vehicles behind to alert them to the danger.

[0071] The control system is compatible with mainstream vehicle sensors via CAN / Ethernet interface, supports matrix LED and DLP projection light sources, and has a retrofit cost that is 30% lower than industry solutions.

[0072] Reference Figures 2-5 A method for intelligent headlight control based on driver intention prediction includes the following steps:

[0073] S1, Multi-source data acquisition: The data acquisition unit collects lane lines and obstacle information, vehicle information and surrounding vehicle information, and also collects driver biosignals including driver gaze coordinates, heart rate variability and grip strength.

[0074] S2, Data Preprocessing: The collected multi-source data is preprocessed through the data fusion layer, specifically including the following steps:

[0075] S21 Time Synchronization Processing: Differences in sampling frequencies of different sensors (including vehicle sensors, biosensors, etc.) (e.g., 30fps for cameras, 100fps for radar, and 50fps for biosensors) can lead to timing misalignment. By using linear interpolation, all data is unified to a 100ms timestamp (matching the radar sampling frequency) to ensure data timing consistency.

[0076] S22 Outlier Handling: By identifying and removing outlier data (such as "ghost cars" falsely detected by radar or "heart rate mutations" from biosensors), missing values ​​are filled with the mean of a sliding window (e.g., a window size of 5 frames) to avoid outlier data interfering with subsequent predictions.

[0077] S23 Data Quality Check: Check for missing values ​​(≤5%), outliers (≤2%), and time sequence consistency. If the data meets the standard, proceed to the feature extraction step; otherwise, re-collect the data.

[0078] S24 Feature Fusion: Multi-source data is converted into high-dimensional feature vectors, which are then weighted and concatenated (e.g., environmental features weighted at 0.4, biological features weighted at 0.3, and vehicle features weighted at 0.3) and input into the spatiotemporal graph construction module of the processing unit. The fused features include: environmental features (lane line curvature, vehicle distance, lane type, lane width, relative speed between vehicles, etc.), biological features (gaze coordinates, grip strength, heart rate variability HRV_index=SDNN / 50, etc.), and vehicle features (position coordinates, velocity components, lateral angle, steering wheel angle, vehicle speed, yaw rate, etc.).

[0079] S3, Intent Prediction and Confidence Assessment: The preprocessed data obtained in step 2 is processed using a neural network to output the driving intent prediction result and confidence level; specifically, it includes the following steps:

[0080] S31 Spatiotemporal Graph Convolutional Network Construction: The spatiotemporal graph construction module is based on a spatiotemporal graph convolutional network to construct a spatiotemporal interaction graph containing the vehicle, surrounding vehicles, and lane lines. Vehicle nodes have feature vectors composed of position coordinates, velocity components, and heading angles. Lane line nodes have feature vectors composed of lane line curvature radius, lane type, and lane width. When the centroid Euclidean distance between the vehicle and surrounding vehicles is less than 50 meters, an undirected connection edge is established between the vehicles. The vehicle always has an undirected connection edge between itself and the centerline of its lane. The edge weights are calculated using a learnable dynamic function (Formula 3). This function comprehensively considers the absolute value of the speed difference between the vehicle and surrounding vehicles (relative speed between vehicles) and the Euclidean distance. Specific examples include:

[0081] Basic form (vehicle-to-vehicle connection): used to quantify the dynamic interaction risk between the vehicle and surrounding vehicles (such as a following vehicle approaching at high speed), the function formula is:

[0082] (1)

[0083] in, Let be the Euclidean distance (in meters) between the centroids of vehicles i and j. This is the absolute value of the speed difference between the vehicle and surrounding vehicles (e.g., if the vehicle's speed is 60 km / h and the vehicle behind it is 80 km / h, then...). ), The distance attenuation coefficient (obtained through experimental optimization - that is, by averaging multiple experiments);

[0084] Extended form (vehicle and lane connection): Used to quantify the relationship between a vehicle and its lane (e.g., vehicle deviation from lane center), the function formula is:

[0085] (2)

[0086] in, It is the vertical distance (in meters) from the vehicle's center of gravity to the center line of its lane. This is the distance attenuation coefficient. Lane type weights (e.g., fast lanes) slow lane );

[0087] Learnable Form (Complex Scenarios): Adaptive weight adjustment for complex traffic scenarios (such as high traffic volume and frequent lane changes), the function formula is:

[0088] (3)

[0089] in, The activation function maps the output to the 0-1 range (0 represents no correlation, and 1 represents strong correlation). It is a 2-layer neural network (64-dimensional input layer, 1-dimensional output layer), with the input being the absolute value of the speed difference. Euclidean distance from the center of mass .

[0090] It is important to note that edge weights can quantify the strength of the association between nodes, allowing spatiotemporal graph convolutional networks to pay more attention to vehicles that are close to each other and have high relative speeds, or vehicles that are off the center of the lane, thereby improving the accuracy of intent prediction and solving the problem of extracting high-risk interaction features.

[0091] For example:

[0092] Edge weights between vehicles: Combining relative speed and Euclidean distance, vehicles that are close to each other and have high relative speeds (such as a car accelerating to overtake) have larger edge weights. Spatiotemporal graph convolutional networks will enhance the feature extraction of such high-risk interactions.

[0093] Vehicle edge weights relative to the lane centerline: Based on the distance of the vehicle from the lane centerline, vehicles that deviate from the lane centerline (such as distracted vehicles) have smaller edge weights, indicating their possible lane change intentions.

[0094] S32 Feature Extraction: The spatial topology of vehicle-to-vehicle and vehicle-to-road interactions is modeled using a spatiotemporal interaction graph, combined with changes over a time series (5 consecutive frames). A two-layer graph convolutional network is then used to process this topology. Specifically:

[0095] The first layer outputs a 128-dimensional feature matrix and processes it using the ReLU activation function; the second layer introduces a four-head attention mechanism to enhance the feature extraction of high-risk interaction relationships.

[0096] Graph convolutional networks can capture dynamic, high-risk interactions (such as vehicles approaching from a distance or changing lanes).

[0097] S33 Intent Prediction: An LSTM-CRF intent prediction model is established. The LSTM-CRF intent prediction model consists of LSTM layers and CRF layers, specifically:

[0098] LSTM layer (Long Short-Term Memory Network): It adopts a 2-layer stacked structure (128 memory units per layer), inputs the graph convolutional features of 5 consecutive frames for temporal modeling, and extracts temporal features (such as "the steering wheel angle gradually increases" to indicate the steering intention).

[0099] CRF layer (Conditional Random Field): It handles the dependencies between labels (e.g., the probability of "turning left" is higher after "going straight"), selects the label sequence with the highest probability through an algorithm (existing technology in this layer), and outputs the driving intention label (e.g., "turning right") and probability distribution (e.g., "probability of turning right is 92.7%)).

[0100] The LSTM-CRF intent prediction model is used to process the feature sequence output by the spatiotemporal graph convolutional network. Specifically, the spatiotemporal graph convolutional network outputs a 128-dimensional feature sequence (5 consecutive frames), which is input into the LSTM-CRF model, and the output is the driving intent label and probability distribution.

[0101] S34 Confidence Calculation: Fifty forward propagation samples are taken using the Monte Carlo Dropout mechanism, with twenty percent of neurons randomly discarded each time. The mean probability μ and standard deviation σ of each driving intention label (intention type) are calculated. When the mean maximum probability is lower than the threshold of 0.6 or the standard deviation exceeds the threshold of 0.25, it is judged as a low-confidence scenario and S5 is triggered.

[0102] This confidence quantification method effectively characterizes prediction uncertainty based on Bayesian principles, achieving high accuracy in high-speed lane-changing scenario tests while keeping the average inference time within 18 milliseconds.

[0103] S4, the light pattern dynamic control module, based on the light pattern dynamic control logic, generates multi-dimensional light pattern adjustment commands according to the driver's intention prediction results, confidence assessment data, and driver's biosignals. It dynamically adjusts the horizontal deflection angle, pitch angle, and regional brightness distribution of the headlights. The brightness of the corresponding area is mapped to road surface grid weight values ​​by the eye-tracking-light spot linkage module using a vector projection algorithm. The calculation formula is as follows:

[0104] (4)

[0105] in, The road grid weight value (unitless, range 0~1) represents the brightness adjustment priority of the eye-tracking fixation area (the larger the value, the higher the brightness of the corresponding area). , The driver's eye-tracking gaze coordinates (normalized values, ranging from 0 to 1) correspond to the relative position on the road surface (e.g., x=0.35 represents the 35% area on the left, y=0.72 represents the 72% area in front). , The road surface is divided into 1024 independent grids using the center coordinates of the road surface grid (normalized value, range 0~1); The heart rate variability coefficient (unitless, range 0-3), detected by a biosensor. Where SDNN is the standard deviation of heart rate, in milliseconds, it reflects the driver's state (e.g., <1.0 indicates a stable state. >2.0 indicates fatigue state). The road surface grid weight value calculated by the above formula is directly used to adjust the brightness of the corresponding area, achieving adaptive matching between physiological state and optical parameters. For example, when the driver's gaze point deviates from the center of the curve ( , The curve exit area was calculated. Based on this, the system increases the brightness of the area by 35%, covering the driver's visual focus.

[0106] The dynamic light pattern control logic achieves precise light pattern adjustment through a three-layer closed-loop mechanism: The first layer, based on a spatiotemporal graph convolutional network, drives pre-illumination actions based on intent prediction, completing the light spot deflection before physical turning occurs, eliminating the 0.8-second blind spot caused by mechanical delay in traditional solutions; the second layer integrates driver eye movement vectors and heart rate variability data, for example, automatically increasing the illumination distance by 8 meters when the heart rate standard deviation is >50ms to cope with sudden operational hesitation; the third layer establishes a confidence-light pattern mapping rule, achieving a 2.3-fold wider-angle lighting mode coverage in low-confidence scenarios compared to traditional solutions, and improving the ADAS collaborative flicker response speed by 5 times compared to CAN bus transmission. In mountainous nighttime curve tests, this solution increased the effective lighting coverage from 67% to 92% of the baseline solution, while reducing driver reaction time in dangerous scenarios by 0.4 seconds.

[0107] In the dynamic control logic of the light pattern, the dynamic control module of the control system generates multi-dimensional light pattern adjustment commands based on the prediction results of driving intention, confidence calculation data, and driver biosignals. Specifically, when a left turn intention is predicted and the confidence level is ≥80%, the light spot deflection controller drives the headlights to rotate 20° to the left and increases the brightness of the left area by 30%, illuminating the inner curve trajectory 1.2 seconds earlier. Simultaneously, the coordinates of the gaze point obtained by the eye tracker are analyzed. If the driver's gaze focus is detected to deviate from the center of the curve by more than 15° for more than 2 seconds, non-uniform brightness analysis is used to adjust the light pattern. The algorithm enhances the illumination intensity in the offset direction by 25%-40%, compensating for the loss of vision caused by distraction. The uncertainty index output by the confidence assessment module triggers the safety strategy adjustment. When the standard deviation σ > 0.25, the illumination range modulator expands the horizontal beam angle to 130° and maintains 85% of the maximum brightness, constructing a conservative illumination redundancy under low visibility conditions - thus triggering S5. At the same time, the ADAS collaborative interface monitors the braking system (AEB) signal in real time through a hard-wired direct connection channel. Within 20 milliseconds after receiving the AEB pre-pressurization command, it activates the high-frequency flashing mode, thus triggering S6.

[0108] S5, when the confidence level is below the threshold, expand the headlight illumination angle to a wide-angle lighting mode. In the wide-angle lighting mode, the illumination angle is expanded to a horizontal illumination angle of ≥120°, preferably 130°-140°, and the brightness is increased to more than 80% of the maximum level, preferably 85%-90%. At the same time, it can also add an additional 8-12 meters of illumination distance. The aim is to ensure that the driver has sufficient safe visibility in low-confidence scenarios such as complex environments (fog, rain), poor driver condition (distraction, fatigue) or sensor failure, by maximizing coverage and high brightness redundancy without relying on intention prediction.

[0109] The S6 responds to the ADAS pre-collision signal and triggers a warning light pattern. The warning light pattern focuses on the potential collision area with the main beam of the headlights at a strobe rhythm of 8-12Hz, while simultaneously projecting a dynamic warning light strip to vehicles behind.

[0110] Example 1

[0111] Scene setting: Mountain night road curve scene

[0112] Specific implementation process: In a mountainous nighttime curve scenario, a vehicle enters a right curve with a lane curvature radius of 85m at a speed of 60km / h. The system identifies the curve's geometric features (8% gradient, lane curvature radius of 85m) using a forward-facing camera. Simultaneously, millimeter-wave radar detects an oncoming vehicle approaching at 25m / s relative speed from 62m away. An eye tracker monitors the driver's gaze point coordinates (0.35, 0.72) in real time, showing a continuous shift from the curve's center for 1.8 seconds. A steering wheel biosensor detects the driver's heart rate variability (SDNN) at 38ms (HRV_index = 0.76). A spatiotemporal graph convolutional network constructs a spatiotemporal interaction graph including the vehicle, three surrounding vehicles, and two lane lines. LSTM temporal analysis outputs a right turn intention probability of 92.7%. Monte Carlo Dropout sampling with 50 iterations and a standard deviation σ = 0.08 confirms a high-confidence scenario. Based on this, the dynamic beam pattern control module drives the Texas Instruments DLP5531-Q1 digital micromirror device to perform triple adjustments: the beam is deflected 18° to the right to cover the curve trajectory; the road surface grid weight value in the curve exit area is calculated to 0.83 based on the gaze point coordinates, and the brightness of this area is increased by 35%; at the same time, the illumination distance is increased by 6m forward because HRV_index < 1.0. The final result is a beam pattern distribution covering the area from the curve's center to the exit, with a maximum illuminance of 82 lux. Compared to traditional AFS systems, this reduces the duration of the blind spot from 1.1 seconds to 0.2 seconds, advances the driver's braking point by 0.7 seconds, and increases the curve passage speed by 12 km / h.

[0113] Example 2

[0114] Scene setting: Foggy highway scene

[0115] Specific implementation process: In a foggy highway scenario with visibility below 50m, the vehicle travels at 105km / h with an ambient humidity of 90%. Due to fog interference, the confidence level of the forward-facing camera drops to 45%. The vehicle communication system (V2X) receives an accident warning signal 2km ahead. The biosensor detects a driver heart rate variability (SDNN) of 112ms (HRV_index=2.24). The intent prediction module outputs a straight-ahead probability of 64.3%, and the standard deviation of the Monte Carlo Dropout calculation is σ=0.31 (exceeding the 0.25 threshold). The system activates a three-level safety response: First, it triggers a wide-angle illumination mode to expand the horizontal beam to 140° and increase the brightness to the maximum level of 90%. Second, based on the physiological state of HRV_index>2.0, it adds an additional 12m of illumination distance. Finally, within 20ms after receiving the AEB pre-pressurization signal, it activates a 10Hz high-frequency flashing mode through a hard-wired direct connection channel and focuses on the potential collision area 35m to the right front. This solution achieves 2.1 times the lighting coverage of traditional solutions, reduces the risk of rear-end collisions by 41%, and keeps the system's end-to-end latency within 50ms, meeting the functional safety requirements of Automotive Safety Integrity Level (ASIL-B). Simulations showed that during a 500ms emergency avoidance maneuver, the warning light pattern successfully guided following vehicles to decelerate by 0.7 m / s², preventing a rear-end collision.

[0116] Example 3

[0117] Scenario setting: Distracted driving scenario at an urban intersection

[0118] Specific implementation process: In an urban intersection scenario, a vehicle approaches the intersection at 40 km / h to switch traffic lights. The forward-facing camera detects a pedestrian suddenly crossing the zebra crossing, and millimeter-wave radar detects the pedestrian at a distance of 15 m and a relative speed of 3 m / s. The eye tracker detects that the driver's gaze point continuously deviates from the road focus for 3.2 seconds (coordinates (0.15, 0.35) are located in the vehicle information screen area). The biosensor detects a heart rate variability (SDNN) of 65 ms (HRV_index=1.3) and a sudden drop in steering wheel grip force to 8 N. A spatiotemporal graph convolutional network constructs a spatiotemporal interaction graph including pedestrians and adjacent vehicles, predicting an emergency braking intent probability of 88.4% with σ=0.12. The system triggers a composite response: based on the gaze point offset, a pedestrian area weight value of 0.92 is calculated, and the illumination in that area is increased to 120%. Based on the grip force data, the system determines the risk of operation delay and activates automatic braking pre-pressurization. At the same time, the confidence assessment unit maintains the standard light pattern because σ<0.15. Within a 200ms response time, the headlights successfully increased pedestrian visibility by 2.3 times in the focused area, enabling the AEB system to brake within 0.8 seconds and avoid a collision. Subsequent data analysis showed that in this scenario, the system improved hazard recognition time by 1.2 seconds through biosignal fusion, achieving a 67% performance improvement compared to a purely environmental perception-based solution.

[0119] In summary, this invention uses a neural network to predict driving intentions and initiates light spot deflection 0.5-1 seconds before physical steering occurs to eliminate blind spots; it maps eye-tracking coordinates to road area weights, dynamically adjusts local brightness, and simultaneously expands the illumination distance based on heart rate variability; when the prediction confidence is <60%, it automatically switches to wide-angle mode (≥120° illumination angle) and triggers an 8-12Hz strobe warning in response to ADAS collision warning signals.

[0120] This concludes the detailed description of the intelligent headlight control method and control system based on driving intention prediction according to this disclosure. To avoid obscuring the concept of this disclosure, some details known in the art have not been described. Those skilled in the art will fully understand how to implement the technical solutions disclosed herein based on the above description.

[0121] Based on the above-described preferred embodiments of the present invention, and through the foregoing description, those skilled in the art can make various changes and modifications without departing from the inventive concept. The technical scope of this invention is not limited to the contents of the specification, but must be determined by the scope of the claims.

Claims

1. An intelligent headlamp control method based on driving intention prediction, characterized by, Comprising the following steps: S1, collecting environment, self-vehicle information and surrounding vehicle information, and also collecting driver biological signals; S2, preprocessing the collected multi-source data; S3, using a neural network to process the data obtained in step 2, outputting driving intention prediction results and confidence; S4, based on the light type dynamic control logic, generating multi-dimensional light type adjustment instructions according to the driving intention prediction results, confidence and driver biological signals, and dynamically adjusting the light type of the headlamp; The light type includes the horizontal deflection angle, the pitch angle and the regional brightness distribution of the headlamp; S5, in a low confidence scenario, the light type is adjusted to a wide-angle lighting mode; S6, responding to the ADAS pre-crash signal to trigger a warning light type; The S3 specifically comprises: S31, spatiotemporal graph convolution network construction: the neural network is a spatiotemporal graph convolution network, which constructs a spatiotemporal interaction graph containing the ego vehicle, surrounding vehicles and lane lines, wherein the vehicle node is composed of a feature vector of its position coordinates, speed components and heading angle, and the lane line node contains characteristic parameters of the lane line curvature radius, lane type and lane width; when the Euclidean distance between the ego vehicle and the surrounding vehicles is < 50 meters, an undirected connection edge is established between the vehicles, and the ego vehicle always establishes an undirected connection edge with the center line of the lane; the edge weight is calculated by a learnable function, which comprehensively considers the factors of the absolute value of the speed difference and the Euclidean distance between the ego vehicle and the surrounding vehicles, and specifically includes: Basic form: used to quantify the dynamic interaction risk between the ego vehicle and the surrounding vehicles, and the function formula is: wherein, is the Euclidean distance between the mass centers of vehicles i and j, is the absolute value of the speed difference between the ego vehicle and the surrounding vehicle, is the distance decay coefficient; Extended form: used to quantify the ownership relationship between the ego vehicle and the lane, and the function formula is: wherein, is the vertical distance from the vehicle's center of mass to the centerline of the lane in which the vehicle is located, is a distance decay coefficient, is a lane type weight; Learnable form: used for adaptive weight adjustment in complex traffic scenarios, and the function formula is: wherein, is an activation function mapping the output to the 0-1 interval, is a 2-layer neural network with input the absolute value of the velocity difference and the centroidal Euclidean distance ; S32, feature extraction: the spatial topology of vehicle-vehicle and vehicle-road is modeled through the spatiotemporal interaction graph, and combined with the time series change, a two-layer graph convolution network is used to process the topology for feature extraction; S33, constructing an LSTM-CRF intention prediction model: the LSTM-CRF intention prediction model includes an LSTM layer and a CRF layer; The input of the LSTM-CRF intention prediction model is the feature sequence output by the spatiotemporal graph convolution network, and the output is the driving intention label and probability distribution; S34, confidence calculation: the probability mean μ and standard deviation σ of each driving intention label are calculated by Monte Carlo Dropout mechanism sampling, and when the maximum probability mean is lower than the threshold or the standard deviation exceeds the threshold, it is a low confidence scenario.

2. The intelligent headlamp control method based on driving intention prediction according to claim 1, characterized in that, In the S1, the environment information includes lane line and obstacle information; the driver biological signals include driver gaze point coordinates, heart rate variability and grip strength.

3. The intelligent headlamp control method based on driving intention prediction according to claim 2, characterized in that, In the S4, the light type dynamic control logic realizes precise light type adjustment through a three-layer closed-loop mechanism: The first layer: based on the intention prediction driven by the spatiotemporal graph convolution network, the pre-illumination action is completed before physical steering occurs, eliminating the temporary illumination blind area caused by mechanical delay in traditional schemes; The second layer: fusion of driver eye movement vector and heart rate variability data to adjust the light type to respond to sudden operation hesitation; The third layer establishes a confidence-light type mapping rule, and a wide-angle lighting mode is used to improve the coverage range in a low confidence scenario, and the ADAS cooperates with the stroboscopic.

4. The intelligent headlamp control method based on driving intention prediction according to claim 3, characterized in that, The S4 region brightness adjustment calculation process is: the gaze point coordinates are mapped to the road surface grid weight value by using the vector projection algorithm, the brightness of the corresponding region is adjusted through the road surface grid weight value, and the calculation formula is: wherein, is the road surface grid weight value, indicating the priority of the luminance adjustment of the eye movement fixation area; , is the driver eye movement fixation coordinate, corresponding to the relative position of the road surface; , is the road surface grid center coordinate; is the heart rate variability coefficient, reflecting the state of the driver.

5. The intelligent headlamp control method based on driving intention prediction according to claim 1, characterized in that, In the S5, the wide-angle lighting mode is a horizontal irradiation angle ≥ 120°, and the brightness is increased to more than 80% of the maximum gear.

6. The intelligent headlamp control method based on driving intention prediction according to claim 1, characterized in that, The preprocessing of the multi-source data in the S2 includes time synchronization processing, abnormal value processing, data quality checking and feature fusion, wherein: S21 time synchronization processing: linear interpolation method is used to process the time sequence dislocation caused by the difference of sampling frequency of different sensors, and the time sequence consistency is ensured; S22 abnormal value processing: identifying and eliminating abnormal data, and filling missing values with a sliding window mean; S23 data quality checking: checking data missing values, abnormal values and time sequence consistency, and if it meets the standard, it enters the feature extraction step, otherwise it is reacquired; S24 feature fusion: converting multi-source data into high-dimensional feature vectors, and using environment feature weight, biological feature weight and vehicle feature weight for weighted splicing, which is used to construct a space-time interaction graph.

7. The intelligent headlamp control method based on driving intention prediction according to claim 1, characterized in that, The warning light type in the S6 is generated by independent partitioning inside the main beam of the headlamp, and is focused on the potential collision area.

8. An intelligent headlamp control system based on driving intention prediction according to the control method of any one of claims 1-7, comprising, a data acquisition unit for multi-source data acquisition, including obtaining driver biosignal, environmental and vehicle dynamic information; The multi-source data is preprocessed by the data fusion layer in the data acquisition unit again; The processing unit is built-in intention prediction module and confidence evaluation module, and outputs intention prediction result and prediction uncertainty according to the collected data; The execution layer is connected with the self-vehicle deflection controller, modulator and ADAS, the execution layer calls the light type dynamic control logic through the light type dynamic control module, generates multi-dimensional light type adjustment instruction to dynamically adjust the irradiation direction and range of the headlamp, and responds to the ADAS pre-crash signal to trigger the warning light type.

9. The intelligent headlamp control system based on driving intention prediction according to claim 8, characterized in that, The processing unit also has a space-time graph construction module, which constructs a space-time interaction graph containing the ego vehicle, surrounding vehicles and lane lines based on a space-time graph convolution network.

Citation Information

Patent Citations

  • Predictive control system for intelligent head lamp and method thereof

    CN113103951A

  • Steering lamp control system and method capable of automatically steering

    CN119796049A