Methods, systems, storage media, and vehicles for monitoring the braking status of the vehicle in front.

Abstract

This application discloses a method, system, storage medium, and vehicle for monitoring the braking status of a vehicle ahead, belonging to the field of automotive technology. A thermal imager generates a thermal image of the brake discs of the vehicle ahead and sends the image to a gateway. The gateway sends the thermal image to a vehicle control unit (VCU). The VCU converts the pixel values ​​in the thermal image into temperature values, obtaining a temperature matrix. A brake type classification model is used to process the temperature matrix to obtain the brake type. The brake type is then sent to the gateway; the brake type is at least one of intermittent braking, gentle braking, emergency braking, and heavy braking. The gateway sends the brake type to an ambient lighting module. The ambient lighting module determines the operating mode corresponding to the brake type and controls the vehicle's ambient lights to provide braking status indication in that mode. The operating mode includes at least one of indication color, indication brightness, and flashing frequency. This application uses vehicle ambient lights to visually display the braking status of the vehicle ahead to the driver, facilitating accurate driver response and preventing rear-end collisions due to misjudgment.

Description

Technical Field

[0001] This application relates to the field of automotive technology, and in particular to a method, system, storage medium, and vehicle for monitoring the braking status of a vehicle in front. Background Technology

[0002] When the vehicle in front brakes, its brake lights will illuminate, allowing the driver of the following vehicle to determine the braking status of the vehicle in front based on whether the brake lights are illuminated.

[0003] However, when the brake lights come on, drivers only know that the vehicle in front is braking, but they cannot know the degree of braking, such as whether it is emergency braking or gradual braking. This can easily lead to misjudgment by the driver and cause a rear-end collision. Summary of the Invention

[0004] This application provides a method, system, storage medium, and vehicle for monitoring the braking status of a vehicle ahead, to solve the problem that drivers cannot judge the braking status based on brake lights, which easily leads to rear-end collisions. The technical solution is as follows:

[0005] According to a first aspect of this application, a method for monitoring the braking status of a preceding vehicle is provided, used in a monitoring system, the monitoring system including a thermal imager, a vehicle control unit (VCU), a gateway, and an ambient lighting module, the method comprising:

[0006] The thermal imager generates a thermal image of the brake disc of the vehicle in front and sends the thermal image to the gateway.

[0007] The gateway sends the thermal image to the VCU;

[0008] The VCU converts the pixel values ​​in the thermal image into temperature values ​​to obtain a temperature matrix; it processes the temperature matrix using a pre-trained brake type classification model to obtain the brake type; and it sends the brake type to the gateway, wherein the brake type is at least one of intermittent braking, gentle braking, emergency braking, and heavy braking.

[0009] The gateway sends the brake type to the ambient light module;

[0010] The ambient lighting module determines the working mode corresponding to the braking type and controls the vehicle ambient lighting to provide braking status indication in the working mode. The working mode includes at least one of the following: indication color, indication brightness, and flashing frequency.

[0011] In one possible implementation, the VCU converts pixel values ​​in the thermal image into temperature values ​​to obtain a temperature matrix, including:

[0012] The VCU obtains the model of the vehicle in front and determines the position of the brake disc based on the model.

[0013] The VCU selects a region of interest (ROI) in the thermal image based on the position of the brake disc.

[0014] The VCU converts the pixel values ​​in the ROI into temperature values ​​to obtain a temperature matrix.

[0015] In one possible implementation, the VCU converts the pixel values ​​in the ROI into temperature values ​​to obtain a temperature matrix, including:

[0016] For each pixel in the ROI, the VCU obtains the gain and offset parameters of the pixel from a preset standard file, calculates the temperature value based on the pixel value, the gain parameters, and the offset parameters, and then forms a temperature matrix using the temperature values ​​of all pixels in the ROI; or,

[0017] For each pixel in the ROI, the VCU looks up the temperature value corresponding to the pixel from a preset calibration table; and forms a temperature matrix by combining the temperature values ​​of all pixels in the ROI.

[0018] In one possible implementation, the monitoring system further includes a controller ECU and a forward-facing camera, and the method further includes:

[0019] The forward-facing camera captures an image of the vehicle in front, and sends the image to the ECU.

[0020] The ECU sends the vehicle body image to the VCU through the gateway;

[0021] The VCU acquires the vehicle model of the preceding vehicle, including: the VCU identifies the vehicle model of the preceding vehicle based on the vehicle body image.

[0022] In one possible implementation, the method further includes:

[0023] The ECU detects whether the brake lights are illuminated based on the vehicle image;

[0024] If the brake light is determined to be illuminated based on the vehicle image, the ECU activates the thermal imager.

[0025] In one possible implementation, the working mode includes a cue color, then

[0026] When the braking type is intermittent braking, the warning color is blue;

[0027] When the braking type is gentle braking, the indicator color is green;

[0028] When the braking type is emergency braking, the warning color is yellow;

[0029] When the braking type is heavy braking, the warning color is red.

[0030] In one possible implementation, the monitoring system further includes a central control screen and an ECU, and the method further includes:

[0031] The central control screen receives the driver's activation operation for the braking status prompt function, generates configuration information to indicate the activation of the braking status prompt function based on the activation operation, and sends the configuration information to the gateway.

[0032] The gateway notifies the VCU and the ECU to activate the braking status alert function based on the configuration information.

[0033] According to a second aspect of this application, a braking condition monitoring system for a preceding vehicle is provided, the monitoring system including a thermal imager, a vehicle control unit (VCU), a gateway, and an ambient lighting module;

[0034] The thermal imager is used to generate a thermal image of the brake disc of the vehicle in front and send the thermal image to the gateway.

[0035] The gateway is used to send the thermal image to the VCU;

[0036] The VCU is used to convert pixel values ​​in the thermal image into temperature values ​​to obtain a temperature matrix; process the temperature matrix using a pre-trained brake type classification model to obtain the brake type; and send the brake type to the gateway, wherein the brake type is at least one of intermittent braking, gentle braking, emergency braking, and heavy braking.

[0037] The gateway is also used to send the brake type to the ambient light module;

[0038] The ambient light module is used to determine the working mode corresponding to the brake type and control the vehicle ambient light to provide braking status indication in the working mode. The working mode includes at least one of the following: indication color, indication brightness, and flashing frequency.

[0039] According to a third aspect of this application, a computer-readable storage medium is provided, wherein at least one instruction is stored therein, the at least one instruction being loaded and executed by a processor to implement the method for monitoring the braking status of a vehicle ahead as described above.

[0040] According to a fourth aspect of this application, a vehicle is provided that includes the aforementioned braking status monitoring system for a preceding vehicle.

[0041] The beneficial effects of the technical solution provided in this application include at least the following:

[0042] After acquiring a thermal image of the brake disc of the vehicle in front, the pixel values ​​in the thermal image are converted into temperature values ​​to obtain a temperature matrix. The temperature matrix is ​​then processed using a brake type classification model to obtain the brake type. Based on the brake type, the corresponding working mode is determined, and the vehicle ambient lights are controlled to indicate the braking status in that working mode. In this way, the temperature of the vehicle ambient lights can be correlated with the temperature of the brake disc of the vehicle in front, and the braking status of the vehicle in front can be intuitively displayed to the driver through the vehicle ambient lights, making it easier for the driver to take appropriate measures and avoid misjudgment that could lead to a rear-end collision. Attached Figure Description

[0043] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0044] Figure 1 This is a schematic diagram illustrating the structure of a vehicle monitoring system according to some exemplary embodiments;

[0045] Figure 2 This is a flowchart of a method for monitoring the braking status of a vehicle in front, provided in one embodiment of this application;

[0046] Figure 3 This is a flowchart of a method for monitoring the braking status of a vehicle ahead, provided in one embodiment of this application. Detailed Implementation

[0047] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0048] like Figure 1 As shown, the vehicle monitoring system includes at least a thermal imager 110, a vehicle control unit (VCU) 120, a gateway 130, an ambient lighting module 140, an electronic control unit (ECU) 150, a forward-facing camera 160, and a central control screen 170.

[0049] Thermal imager 110 and forward-facing camera 160 are connected to ECU 150. ECU 150 is used to activate thermal imager 110 and forward-facing camera 160. Thermal imager 110 uses thermal imaging technology to generate a thermal image of the brake disc of the vehicle in front and sends the thermal image to ECU 150. Forward-facing camera 160 is used to capture images of objects within a forward-looking view and sends the captured images of the vehicle body to ECU 150. ECU 150 is also used to send the thermal image and vehicle body image to gateway 130.

[0050] Gateway 130 is used to forward data between VCU 120, ambient lighting module 140, ECU 150, and central control screen 170 using the Controller Area Network (CAN) bus. Specifically, gateway 130 communicates with ambient lighting module 140 and central control screen 170 via... Figure 1 CAN1 communication is used between gateway 130 and VCU120 and ECU150. Figure 1 CAN2 communication is used. Specifically, gateway 130 can forward thermal images and vehicle body images to VCU120.

[0051] VCU120 is used to identify the braking type of the vehicle in front based on thermal images and vehicle body images, and sends the braking type to gateway 130. The braking type includes at least one of intermittent braking, gentle braking, emergency braking, and heavy braking.

[0052] The central control screen 170 is used to configure the activation and deactivation of the brake status alert function. The brake status alert function uses ambient lighting within the vehicle to indicate the braking type of the vehicle ahead, indirectly reflecting road congestion.

[0053] The ambient lighting module 140 includes in-vehicle ambient lights, which are decorative lighting fixtures typically consisting of multiple light strips installed on the center console, door panels, roof, and center console. These lights are available in single-color and multi-color options to create diverse and pleasant atmospheres. When the braking status indicator function is activated, the ambient lighting module 140 can illuminate the ambient lights based on the braking type sent by the gateway 130, thus visually displaying the braking status of the vehicle ahead to the driver.

[0054] like Figure 2 The diagram illustrates a flowchart of a method for monitoring the braking status of a vehicle ahead, according to an embodiment of this application. This method can be applied to... Figure 1 The monitoring system shown may include a method for monitoring the braking status of the vehicle in front, which could include:

[0055] Step 201: The thermal imager generates a thermal image of the brake disc of the vehicle in front and sends the thermal image to the gateway.

[0056] The thermal imager can be activated when the vehicle starts moving, when the braking status warning function is activated, or when the vehicle in front brakes. In this embodiment, the activation time of the thermal imager is not limited.

[0057] The thermal imager can use thermal imaging technology to generate a thermal image of the brake disc of the vehicle in front, and send the thermal image to the ECU. The ECU then sends the thermal image to the gateway via CAN2.

[0058] Step 202: The gateway sends the thermal image to the VCU.

[0059] The gateway receives thermal images sent by the ECU via CAN2 and then sends the thermal images to the VCU via CAN2.

[0060] Step 203: The VCU converts the pixel values ​​in the thermal image into temperature values ​​to obtain a temperature matrix; it processes the temperature matrix using a pre-trained brake type classification model to obtain the brake type; and it sends the brake type to the gateway, where the brake type is at least one of point braking, gentle braking, emergency braking, and heavy braking.

[0061] VCU can convert the pixel value of each pixel in a thermal image into the corresponding temperature value, and then combine all the temperature values ​​into a temperature matrix.

[0062] The VCU has a pre-set brake category recognition model. This brake type classification model is a model obtained by training multiple training samples. Each training sample includes a temperature matrix generated based on a thermal image of the brake disc and the labeled brake type.

[0063] The VCU inputs the obtained temperature matrix into the brake type classification model. The brake type classification model processes the temperature matrix and outputs the brake type. The VCU then sends the brake type to the gateway via CAN2.

[0064] Step 204: The gateway sends the brake type to the ambient lighting module.

[0065] The gateway receives the brake type sent by the VCU via CAN2 and sends the brake type to the ambient lighting module via CAN1.

[0066] Step 205: The ambient lighting module determines the working mode corresponding to the braking type and controls the vehicle ambient lighting to provide braking status indication in the working mode. The working mode includes at least one of the following: indication color, indication brightness, and flashing frequency.

[0067] The ambient lighting module has a pre-set correspondence between brake types and operating modes. After receiving the current brake type, it can look up the corresponding operating mode in the correspondence and control the vehicle ambient lighting to provide a braking status indication in that operating mode.

[0068] If different colors of the vehicle ambient lighting are needed to indicate different braking types, the operating mode includes indicator colors: red for heavy braking, yellow for emergency braking, green for gentle braking, and blue for intermittent braking.

[0069] If different braking types need to be represented by the flashing frequency, the operating mode includes the flashing frequency. When the braking type is heavy braking, the flashing frequency is fast; when the braking type is emergency braking, the flashing frequency is medium speed; when the braking type is mild braking, the flashing frequency is slow; and when the braking type is intermittent braking, the flashing frequency is 0, that is, no flashing.

[0070] If different colors and brightness levels of the vehicle's ambient lighting are needed to indicate different braking types, the operating modes include indicator color and indicator brightness. When the braking type is heavy braking, the indicator is a bright red; when the braking type is emergency braking, the indicator is a medium yellow; when the braking type is gentle braking, the indicator is a low green; and when the braking type is intermittent braking, the indicator is a low blue.

[0071] If different colors and flashing frequencies of the vehicle ambient lighting are needed to indicate different braking types, the operating mode includes indicator color and flashing frequency. When the braking type is heavy braking, the indicator is a rapidly flashing red; when the braking type is emergency braking, the indicator is a medium-speed flashing yellow; when the braking type is gentle braking, the indicator is a slowly flashing green; and when the braking type is intermittent braking, the indicator is a non-flashing blue.

[0072] In summary, the method for monitoring the braking status of a vehicle ahead provided in this application, after acquiring a thermal image of the brake disc of the vehicle ahead, converts the pixel values ​​in the thermal image into temperature values ​​to obtain a temperature matrix; processes the temperature matrix using a brake type classification model to obtain the brake type; determines the corresponding working mode based on the brake type, and controls the vehicle ambient light to provide braking status indication in that working mode. In this way, the temperature of the vehicle ambient light can be associated with the temperature of the brake disc of the vehicle ahead, and the braking status of the vehicle ahead can be intuitively displayed to the driver through the vehicle ambient light, making it easier for the driver to take corresponding measures and avoid misjudgment that could lead to a rear-end collision.

[0073] like Figure 3 The diagram illustrates a flowchart of a method for monitoring the braking status of a vehicle ahead, according to an embodiment of this application. This method can be applied to... Figure 1 The monitoring system shown may include a method for monitoring the braking status of the vehicle in front, which could include:

[0074] Step 301: The central control screen receives the driver's activation operation for the brake status reminder function, generates configuration information to indicate the activation of the brake status reminder function based on the activation operation, and sends the configuration information to the gateway.

[0075] The brake status alert function identifies the braking type when the vehicle in front brakes and uses ambient lighting to indicate the braking type so that the driver can take the appropriate action.

[0076] The vehicle is equipped with a button for the brake status alert function. This button can be a physical button or a virtual button on the central control screen. When the user clicks the button, the central control screen obtains configuration information based on the click action and sends this configuration information to the gateway via CAN1. The gateway then determines whether to enable or disable the brake status alert function based on the value of the configuration information. For example, 0 represents enabling the brake status alert function, and 1 represents disabling it. If the gateway receives a configuration information value of 0, the brake status alert function is enabled; if the gateway receives a configuration information value of 1, the brake status alert function is disabled.

[0077] Of course, in addition to manual operation, the braking status alert function can also be turned on or off via voice, gestures, etc. This embodiment does not limit the configuration method.

[0078] Step 302: The gateway notifies the VCU and ECU to activate the brake status alert function based on the configuration information.

[0079] The gateway receives configuration information sent by the central control screen via CAN1 and notifies the VCU and ECU to activate the brake status warning function via CAN2.

[0080] Step 303: The forward-facing camera takes a picture of the vehicle in front, obtains an image of the vehicle body, and sends the image to the ECU.

[0081] A forward-facing camera can capture images of objects within a forward-looking field of view. By default, there is a vehicle in front within this field of view, so the image captured by the forward-facing camera can be referred to as the image of the vehicle in front.

[0082] Step 304: The ECU detects whether the brake lights are illuminated based on the vehicle image; if it is determined from the vehicle image that the brake lights are illuminated, the ECU activates the thermal imager.

[0083] After the ECU confirms that the brake status warning function is activated, it processes the vehicle image to identify whether the brake lights of the vehicle in front are illuminated. If the brake lights of the vehicle in front are illuminated, the thermal imager is activated. If the brake lights of the vehicle in front are not illuminated, the monitoring of the vehicle in front continues.

[0084] Step 305: The thermal imager generates a thermal image of the brake disc of the vehicle in front and sends the thermal image to the gateway.

[0085] After starting the thermal imager, you can also configure parameters such as resolution, frame rate, and temperature range to ensure image quality and the accuracy of temperature measurement.

[0086] The thermal imager can use thermal imaging technology to generate a thermal image of the brake disc of the vehicle in front, and send the thermal image to the ECU. The ECU then sends the thermal image to the gateway via CAN2.

[0087] Step 306: The gateway sends the thermal image to the VCU.

[0088] The gateway receives thermal images sent by the ECU via CAN2 and then sends the thermal images to the VCU via CAN2.

[0089] Step 307: The VCU converts the pixel values ​​in the thermal image into temperature values ​​to obtain a temperature matrix; it processes the temperature matrix using a pre-trained brake type classification model to obtain the brake type; and it sends the brake type to the gateway, where the brake type is at least one of point braking, gentle braking, emergency braking, and heavy braking.

[0090] After the VCU determines that the brake status alert function is enabled, the VCU needs to generate the brake type based on the thermal image.

[0091] Specifically, the VCU converts pixel values ​​in the thermal image into temperature values ​​to obtain a temperature matrix, which can include the following steps:

[0092] (1) The VCU obtains the model of the vehicle in front and determines the position of the brake disc based on the model.

[0093] When acquiring the vehicle model information of the vehicle in front, the ECU sends a vehicle image to the VCU via the gateway; the VCU identifies the vehicle model based on the vehicle image. Then, the VCU can obtain the position of the brake disc corresponding to that vehicle model.

[0094] (2) The VCU selects the ROI in the thermal image based on the position of the brake disc.

[0095] Regions of Interest (ROIs) typically contain key information. Processing the data within an ROI can reduce data redundancy, thereby reducing unnecessary computation and improving processing speed.

[0096] (3) The VCU converts the pixel values ​​in the ROI into temperature values ​​to obtain the temperature matrix.

[0097] There are many ways to generate a temperature matrix. This embodiment will illustrate two of them.

[0098] (1) For each pixel in the ROI, the VCU obtains the gain parameter and offset parameter of the pixel from the preset standard file, calculates the temperature value based on the pixel value, gain parameter and offset parameter; and forms a temperature matrix by combining the temperature values ​​of all pixels in the ROI.

[0099] If the thermal imager uses linear calibration, its calibration file typically contains parameters needed to map pixel values ​​to temperature values. These parameters may include gain and offset. These two parameters are used for the linear transformation from pixel values ​​to temperature values. The formula is usually expressed as Temperature = Gain * PixelValue + Offset, where Temperature represents the temperature value and PixelValue represents the pixel value.

[0100] (2) For each pixel in the ROI, the VCU looks up the temperature value corresponding to the pixel from the preset calibration table; and forms a temperature matrix by combining the temperature values ​​of all pixels in the ROI.

[0101] If the thermal imager uses non-linear calibration, a calibration table (LUT) needs to be looked up to determine the temperature value corresponding to each pixel value.

[0102] When converting pixel values ​​to temperature values, the temperature range that the thermal imager can measure must also be considered. If the calculated temperature value exceeds this range, it needs to be limited to that range or marked as invalid data.

[0103] In actual programming, the above steps need to be implemented as a function or method. This function will accept pixel values ​​as input and return the calculated temperature value. This function also needs to access calibration parameters (whether linear parameters or non-linear lookup tables).

[0104] After obtaining the temperature matrix, global temperature features such as average temperature, maximum temperature, and minimum temperature within the ROI region can be calculated. Local temperature features such as temperature gradient and temperature standard deviation within the ROI region can also be calculated to reflect the uniformity and degree of temperature distribution. Furthermore, continuous frames of temperature data can be recorded to analyze the trend and rate of temperature change, including the average, maximum, and minimum values ​​of temperature changes, as well as the average, maximum, and minimum values ​​of the rate of change. Then, based on experimental data and experience, the temperature features most helpful for brake type classification are selected, and corresponding weights are assigned to each feature.

[0105] Specifically, machine learning algorithms (such as decision trees, support vector machines, and random forests) can be used to train a brake type classification model. The input is a temperature matrix, and the output is the brake type (intermittent braking, gentle braking, emergency braking, heavy braking). Cross-validation and other methods are used to evaluate the model's performance, and feature selection, weight allocation, and model parameters are adjusted based on the evaluation results to improve classification accuracy.

[0106] To improve the accuracy of model classification, the model's performance can be evaluated periodically, and the model can be iterated and optimized using continuously collected training samples. The parameters and thresholds in the model can also be adjusted according to different weather, road conditions, and vehicle types to improve the model's adaptability and accuracy.

[0107] The VCU can input the temperature matrix into the trained brake type classification model. The brake type classification model processes the temperature matrix and outputs the brake type. The VCU then sends the brake type to the gateway via CAN2.

[0108] Step 308: The gateway sends the brake type to the ambient lighting module.

[0109] The gateway receives the brake type sent by the VCU via CAN2 and sends the brake type to the ambient lighting module via CAN1.

[0110] Step 309: The ambient lighting module determines the working mode corresponding to the braking type and controls the vehicle ambient lighting to provide braking status indication in the working mode. The working mode includes at least one of the following: indication color, indication brightness, and flashing frequency.

[0111] The ambient lighting module has a pre-set correspondence between brake types and operating modes. After receiving the current brake type, it can look up the corresponding operating mode in the correspondence and control the vehicle ambient lighting to indicate the braking status in the operating mode.

[0112] If different colors of the vehicle ambient lighting are needed to indicate different braking types, the operating mode includes indicator colors: red for heavy braking, yellow for emergency braking, green for gentle braking, and blue for intermittent braking.

[0113] If different braking types need to be represented by the flashing frequency, the operating mode includes the flashing frequency. When the braking type is heavy braking, the flashing frequency is fast; when the braking type is emergency braking, the flashing frequency is medium speed; when the braking type is mild braking, the flashing frequency is slow; and when the braking type is intermittent braking, the flashing frequency is 0, that is, no flashing.

[0114] If different colors and brightness levels of the vehicle's ambient lighting are needed to indicate different braking types, the operating modes include indicator color and indicator brightness. When the braking type is heavy braking, the indicator is a bright red; when the braking type is emergency braking, the indicator is a medium yellow; when the braking type is gentle braking, the indicator is a low green; and when the braking type is intermittent braking, the indicator is a low blue.

[0115] If different colors and flashing frequencies of the vehicle ambient lighting are needed to indicate different braking types, the operating mode includes indicator color and flashing frequency. When the braking type is heavy braking, the indicator is a rapidly flashing red; when the braking type is emergency braking, the indicator is a medium-speed flashing yellow; when the braking type is gentle braking, the indicator is a slowly flashing green; and when the braking type is intermittent braking, the indicator is a non-flashing blue.

[0116] In summary, the method for monitoring the braking status of a vehicle ahead provided in this application, after acquiring a thermal image of the brake disc of the vehicle ahead, converts the pixel values ​​in the thermal image into temperature values ​​to obtain a temperature matrix; processes the temperature matrix using a brake type classification model to obtain the brake type; determines the corresponding working mode based on the brake type, and controls the vehicle ambient light to provide braking status indication in that working mode. In this way, the temperature of the vehicle ambient light can be associated with the temperature of the brake disc of the vehicle ahead, and the braking status of the vehicle ahead can be intuitively displayed to the driver through the vehicle ambient light, making it easier for the driver to take corresponding measures and avoid misjudgment that could lead to a rear-end collision.

[0117] When the braking type is intermittent braking, the indicator color is blue; when the braking type is gentle braking, the indicator color is green; when the braking type is emergency braking, the indicator color is yellow; and when the braking type is heavy braking, the indicator color is red. This allows the driver to identify the braking status of the vehicle in front based on the color of the ambient light, thereby improving the driver's focus when there is congestion ahead.

[0118] like Figure 1 The diagram illustrates a structural block diagram of a vehicle braking status monitoring system according to an embodiment of this application. This vehicle braking status monitoring system can be applied to a vehicle. The vehicle braking status monitoring system may include a thermal imager 110, a VCU 120, a gateway 130, and an ambient lighting module 140.

[0119] Thermal imager 110 is used to generate thermal images of the brake discs of the vehicle in front and send the thermal images to gateway 130.

[0120] Gateway 130 is used to send thermal images to VCU120;

[0121] VCU120 is used to convert pixel values ​​in thermal images into temperature values ​​to obtain a temperature matrix; the temperature matrix is ​​processed using a pre-trained brake type classification model to obtain the brake type; the brake type is sent to gateway 130, and the brake type is at least one of point braking, gentle braking, emergency braking and heavy braking;

[0122] Gateway 130 is also used to send the brake type to ambient lighting module 140;

[0123] The ambient lighting module 140 is used to determine the working mode corresponding to the braking type and control the vehicle ambient lighting to provide braking status indication in the working mode. The working mode includes at least one of the following: indication color, indication brightness, and flashing frequency.

[0124] In an optional embodiment, VCU120 is also used for:

[0125] Obtain the model of the vehicle in front and determine the position of the brake discs based on the model;

[0126] Select the ROI in the thermal image based on the location of the brake disc;

[0127] Convert the pixel values ​​in the ROI to temperature values ​​to obtain a temperature matrix.

[0128] In an optional embodiment, VCU120 is also used for:

[0129] For each pixel in the ROI, obtain the pixel's gain and offset parameters from a preset standard file, and calculate the temperature value based on the pixel value, gain parameters, and offset parameters; then, construct a temperature matrix from the temperature values ​​of all pixels in the ROI; or...

[0130] For each pixel in the ROI, the temperature value corresponding to the pixel is found from the preset calibration table; the temperature values ​​of all pixels in the ROI are combined into a temperature matrix.

[0131] In an optional embodiment, the monitoring system further includes a controller ECU 150 and a forward-facing camera 160;

[0132] The forward-facing camera 160 is used to photograph the vehicle in front, obtain an image of the vehicle body, and send the image to the ECU 150.

[0133] ECU150 is used to send vehicle body images to VCU120 via gateway 130;

[0134] The VCU120 is also used to identify the model of the vehicle in front based on the vehicle body image.

[0135] In an optional embodiment, ECU150 is further configured to:

[0136] Detect whether the brake lights are illuminated based on the vehicle image;

[0137] If the brake lights are determined to be illuminated based on the vehicle image, then the thermal imager 110 is activated.

[0138] In an optional embodiment, the operating mode includes cue colors, then

[0139] When the braking type is intermittent braking, the indicator color is blue;

[0140] When the braking type is gentle braking, the indicator color is green;

[0141] When the braking type is emergency braking, the warning color is yellow;

[0142] When the braking type is heavy braking, the warning color is red.

[0143] In an optional embodiment, the monitoring system further includes a central control screen 170 and an ECU 150;

[0144] The central control screen 170 is used to receive the driver's activation operation for the brake status reminder function, generate configuration information to indicate the activation of the brake status reminder function based on the activation operation, and send the configuration information to the gateway 130.

[0145] Gateway 130 is also used to notify VCU120 and ECU150 to activate the brake status alert function based on configuration information.

[0146] In summary, the braking status monitoring system for the vehicle ahead provided in this application, after acquiring a thermal image of the brake disc of the vehicle ahead, converts the pixel values ​​in the thermal image into temperature values ​​to obtain a temperature matrix; processes the temperature matrix using a brake type classification model to obtain the brake type; determines the corresponding working mode based on the brake type, and controls the vehicle ambient light to provide braking status indication in that working mode. In this way, the temperature of the vehicle ambient light can be associated with the temperature of the brake disc of the vehicle ahead, and the braking status of the vehicle ahead can be intuitively displayed to the driver through the vehicle ambient light, making it easier for the driver to take corresponding measures and avoid misjudgment that could lead to a rear-end collision.

[0147] When the braking type is intermittent braking, the indicator color is blue; when the braking type is gentle braking, the indicator color is green; when the braking type is emergency braking, the indicator color is yellow; and when the braking type is heavy braking, the indicator color is red. This allows the driver to identify the braking status of the vehicle in front based on the color of the ambient light, thereby improving the driver's focus when there is congestion ahead.

[0148] One embodiment of this application provides a computer-readable storage medium storing at least one instruction, which is loaded and executed by a processor to implement the method for monitoring the braking status of a vehicle ahead as described above.

[0149] One embodiment of this application provides a vehicle that includes a braking status monitoring system for any of the aforementioned preceding vehicles.

[0150] It should be noted that the braking status monitoring system for the vehicle ahead provided in the above embodiments is only illustrated by the division of the functional modules described above. In practical applications, the functions described above can be assigned to different functional modules as needed, that is, the internal structure of the braking status monitoring system for the vehicle ahead can be divided into different functional modules to complete all or part of the functions described above. Furthermore, the braking status monitoring system for the vehicle ahead provided in the above embodiments and the braking status monitoring method embodiments for the vehicle ahead belong to the same concept, and their specific implementation process is detailed in the method embodiments, which will not be repeated here.

[0151] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0152] The above description is not intended to limit the embodiments of this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the embodiments of this application should be included within the protection scope of the embodiments of this application.

Claims

1. A method for monitoring the braking status of a vehicle ahead, characterized in that, For use in a monitoring system, the monitoring system includes a thermal imager, a vehicle control unit (VCU), a gateway, and an ambient lighting module, the method includes: The thermal imager generates a thermal image of the brake disc of the vehicle in front and sends the thermal image to the gateway. The gateway sends the thermal image to the VCU; The VCU converts the pixel values ​​in the thermal image into temperature values ​​to obtain a temperature matrix; it processes the temperature matrix using a pre-trained brake type classification model to obtain the brake type; and it sends the brake type to the gateway, wherein the brake type is at least one of intermittent braking, gentle braking, emergency braking, and heavy braking. The gateway sends the brake type to the ambient light module; The ambient lighting module determines the working mode corresponding to the braking type and controls the vehicle ambient lighting to provide braking status indication in the working mode. The working mode includes at least one of the following: indication color, indication brightness, and flashing frequency.

2. The method for monitoring the braking status of the vehicle ahead according to claim 1, characterized in that, The VCU converts the pixel values ​​in the thermal image into temperature values ​​to obtain a temperature matrix, including: The VCU obtains the model of the vehicle in front and determines the position of the brake disc based on the model. The VCU selects a region of interest (ROI) in the thermal image based on the position of the brake disc. The VCU converts the pixel values ​​in the ROI into temperature values ​​to obtain a temperature matrix.

3. The method for monitoring the braking status of the vehicle ahead according to claim 2, characterized in that, The VCU converts the pixel values ​​in the ROI into temperature values ​​to obtain a temperature matrix, including: For each pixel in the ROI, the VCU obtains the gain and offset parameters of the pixel from a preset standard file, calculates the temperature value based on the pixel value, the gain parameters, and the offset parameters, and then forms a temperature matrix using the temperature values ​​of all pixels in the ROI; or, For each pixel in the ROI, the VCU looks up the temperature value corresponding to the pixel from a preset calibration table; and forms a temperature matrix by combining the temperature values ​​of all pixels in the ROI.

4. The method for monitoring the braking status of the vehicle ahead according to claim 2, characterized in that, The monitoring system also includes a controller ECU and a forward-facing camera, and the method further includes: The forward-facing camera captures an image of the vehicle in front, and sends the image to the ECU. The ECU sends the vehicle body image to the VCU through the gateway; The VCU acquires the vehicle model of the preceding vehicle, including: the VCU identifies the vehicle model of the preceding vehicle based on the vehicle body image.

5. The method for monitoring the braking status of the vehicle in front according to claim 4, characterized in that, The method further includes: The ECU detects whether the brake lights are illuminated based on the vehicle image; If the brake light is determined to be illuminated based on the vehicle image, the ECU activates the thermal imager.

6. The method for monitoring the braking status of the vehicle ahead according to claim 1, characterized in that, The working mode includes indicator colors, then When the braking type is intermittent braking, the warning color is blue; When the braking type is gentle braking, the indicator color is green; When the braking type is emergency braking, the warning color is yellow; When the braking type is heavy braking, the warning color is red.

7. The method for monitoring the braking status of a vehicle ahead according to any one of claims 1 to 6, characterized in that, The monitoring system also includes a central control screen and an ECU, and the method further includes: The central control screen receives the driver's activation operation for the braking status prompt function, generates configuration information to indicate the activation of the braking status prompt function based on the activation operation, and sends the configuration information to the gateway. The gateway notifies the VCU and the ECU to activate the braking status alert function based on the configuration information.

8. A system for monitoring the braking status of a vehicle ahead, characterized in that, The monitoring system includes a thermal imager, a vehicle control unit (VCU), a gateway, and an ambient lighting module. The thermal imager is used to generate a thermal image of the brake disc of the vehicle in front and send the thermal image to the gateway. The gateway is used to send the thermal image to the VCU; The VCU is used to convert pixel values ​​in the thermal image into temperature values ​​to obtain a temperature matrix; process the temperature matrix using a pre-trained brake type classification model to obtain the brake type; and send the brake type to the gateway, wherein the brake type is at least one of intermittent braking, gentle braking, emergency braking, and heavy braking. The gateway is also used to send the brake type to the ambient light module; The ambient light module is used to determine the working mode corresponding to the brake type and control the vehicle ambient light to provide braking status indication in the working mode. The working mode includes at least one of the following: indication color, indication brightness, and flashing frequency.

9. A computer-readable storage medium, characterized in that, The storage medium stores at least one instruction, which is loaded and executed by a processor to implement the method for monitoring the braking status of the vehicle ahead as described in any one of claims 1 to 7.

10. A vehicle, characterized in that, The vehicles include: The braking status monitoring system of the vehicle in front as described in claim 8.

Images