Vehicle monitoring method, device and vehicle

Abstract

The present application relates to a vehicle monitoring method, device and vehicle, and the method includes: obtaining first battery information and first audio information of the vehicle in a current state; the first audio information is obtained based on a first transmitted audio signal emitted by a first target audio component; the first target audio component is within a preset range from the installation position of the battery of the vehicle; the first battery information and the first audio information are matched with the target preset conditions obtained in the current state to obtain a thermal runaway detection result of the battery, thereby improving the detection accuracy of the thermal runaway detection of the battery.

Description

Technical Field

[0001] The present application relates to the field of automobile technology, and in particular to a vehicle monitoring method, device, and vehicle. Background Art

[0002] Vehicle collisions are one of the most common forms of traffic accidents, resulting not only in casualties but also potentially causing secondary disasters such as vehicle fires. Existing vehicle fire alarm systems often rely on single sensors (such as smoke or temperature sensors). However, single sensors have significant drawbacks, including high false alarm rates, delayed response times, and limited use cases. Summary of the Invention

[0003] This application provides a vehicle monitoring method, device, and vehicle. To achieve the above-mentioned objectives, the technical solutions adopted in this application are as follows:

[0004] A vehicle monitoring method includes: obtaining first battery information and first audio information of the vehicle in a current state; obtaining the first audio information based on a first transmitted audio signal emitted by a first target audio component; the first target audio component is within a preset range from an installation position of a battery of the vehicle; matching the first battery information and the first audio information with the obtained target preset conditions in the current state to obtain a thermal runaway detection result of the battery.

[0005] According to the above technical approach, the current state of the vehicle is first acquired, and target preset conditions under the current state can be determined, so that the target preset conditions used to determine the battery thermal runaway detection result are adapted to the current state of the vehicle. This allows for analysis of different current vehicle states to improve the accuracy of battery thermal runaway determination. Then, first battery information and first audio information collected by a first target audio component within a preset range from the vehicle's battery installation location are determined. Finally, based on the first battery information and the first audio information, a battery thermal runaway detection result is determined. In this way, by real-time monitoring of multiple vehicle state information, multimodal data, including the first audio information and the first battery information, is obtained. Thermal runaway detection of the vehicle's battery is achieved through this multimodal data, improving the accuracy of battery thermal runaway detection and enabling intelligent identification and emergency response of vehicle abnormal conditions, thereby enhancing vehicle safety. Furthermore, the use of multimodal data, including the first audio information and the first battery information, addresses the high false alarm rate, response delay, and scenario limitations associated with using a single sensor to identify vehicle abnormal conditions in related technologies.

[0006] Furthermore, obtaining the first audio information of the vehicle in the current state includes: controlling the first target audio component to transmit a first transmitted audio signal; controlling the first target audio component to receive a first received audio signal; the first received audio signal is obtained after the first transmitted audio signal passes through the battery; processing the first received audio signal to obtain the first audio information.

[0007] According to the above technical approach, a first transmitted audio signal emitted by the first target audio component passes through the battery area, generating a first received audio signal. This first received audio signal is then processed to generate first audio information. This allows detection of battery thermal runaway regardless of environmental constraints such as light and weather (rain, snow, dust, etc.). The timing corresponding to the first transmitted audio signal and the first received audio signal can also be used to determine the thermal runaway failure location. Furthermore, this method eliminates the need for the audio component to be exposed to flames or smoke, thereby extending its service life.

[0008] Furthermore, the vehicle monitoring method includes: outputting an alarm message when the thermal runaway detection result of the battery indicates that the battery has triggered thermal runaway; and controlling the vehicle to perform a target operation corresponding to the current status information when the thermal runaway detection result of the battery indicates that the battery has not triggered thermal runaway.

[0009] Based on the above technical means, the corresponding execution strategies are explained in two different scenarios: the battery does not trigger thermal runaway or triggers thermal runaway. In this way, after obtaining the thermal runaway detection results of the battery, the corresponding execution strategy can be matched based on the detection results.

[0010] Furthermore, the vehicle is controlled to perform a target operation corresponding to the current state, including: when the current state is a driving state, obtaining second battery information and second audio information of the vehicle in the driving state; based on the second battery information and the second audio information, determining the thermal runaway detection result of the battery.

[0011] According to the above technical means, it is explained that after determining that the battery has not triggered thermal runaway based on the first battery information and the first audio information, the second battery information and the second audio information are obtained again, and the thermal runaway detection result of the battery of the vehicle at the current moment is determined through the second battery information and the second audio information, so as to realize real-time monitoring of thermal runaway of the vehicle's battery.

[0012] Furthermore, the vehicle is controlled to perform a target operation corresponding to the current state, including: when the current state is a parking state, obtaining first characteristic information of the vehicle; the first characteristic information includes a target temperature and / or heat flux density; when the first characteristic information meets a first preset condition, determining that there is a fire in the target scene where the vehicle is located.

[0013] According to the above technical means, the target operation in the parking state is explained when it is determined that the battery has not triggered thermal runaway. In this way, after determining that the battery has not triggered thermal runaway, if the vehicle is in the parking state, it can be determined through the first characteristic information that there is a fire in the target scene where the vehicle is located, so as to determine whether there is a fire risk caused by other factors in the vehicle.

[0014] Furthermore, the first characteristic information includes a target temperature; obtaining the first characteristic information of the vehicle includes: determining a second target audio component based on whether the sentry mode of the vehicle is turned on; determining third audio information based on a second transmitted audio signal emitted by the second target audio component; and determining the target temperature from mapping information of the audio information and temperature based on the third audio information.

[0015] Based on the above technical means, a method for determining the target temperature is proposed, so that the target temperature can be used to determine whether there is a fire in the target scene where the vehicle is located, so as to determine whether there is a fire risk caused by other factors in the vehicle.

[0016] Furthermore, based on whether the sentry mode of the vehicle is turned on, the second target audio component is determined, including: when the sentry mode is not turned on, all audio components are determined as second target audio components; when the sentry mode is turned on, based on the image data collected by the image component of the vehicle, it is determined whether there is a target feature for identifying the fire; when the target feature exists, the second target audio component is determined based on the target position corresponding to the target feature.

[0017] According to the above technical means, a method for determining the corresponding second target audio component in two different scenarios, when the sentry mode is turned on or not, is explained. For the scenario where the sentry mode is turned on, the second target audio component to be enabled is determined to be related to the target position of the target feature. In this way, there is no need to start all audio components in the vehicle, which reduces the operating pressure of the vehicle and improves the operating efficiency of the vehicle.

[0018] Furthermore, the vehicle monitoring method includes: obtaining third battery information and fourth audio information of the vehicle in a parked state when the target feature exists; and determining a thermal runaway detection result of the battery based on the third battery information and the fourth audio information.

[0019] According to the above technical means, before performing thermal runaway detection on the battery, the target features are identified based on the image data. When the target features are identified, the battery is tested for thermal runaway. This eliminates the need for the vehicle to frequently obtain battery information and audio information, thereby reducing the operating pressure of the vehicle.

[0020] Furthermore, obtaining the first characteristic information of the vehicle includes: obtaining the first characteristic information multiple times; the method also includes: if the first characteristic information obtained multiple times does not meet the first preset condition, determining that there is no fire in the target scene.

[0021] According to the above technical means, a method for determining whether a fire does not exist in a target scene is described. Through this judgment method, abnormal vehicle conditions can be identified to improve vehicle safety.

[0022] Furthermore, the method also includes: in the event that there is a fire in the target scene, outputting an alarm message, and performing a first operation and a second operation; wherein the first operation is used to wake up the person based on the person's location information when a person is detected to be present in the vehicle; the second operation is used to release the charging or discharging state of the vehicle by disconnecting the charging connection of the vehicle and closing the charging interface of the vehicle when the vehicle is detected to be in a charging or discharging state.

[0023] According to the above technical means, the corresponding operations when there is a fire in the target scene are explained. In this way, emergency handling of the abnormal state of the vehicle can be achieved through the first operation and the second operation to reduce the risk of vehicle accidents, thereby reducing the number of vehicle accidents and improving the safety performance of the vehicle.

[0024] A vehicle monitoring device includes: an acquisition module for acquiring first battery information and first audio information of the vehicle in a current state; the first audio information is obtained based on a first transmitted audio signal emitted by a first target audio component; the first target audio component is within a preset range from the installation position of the vehicle's battery; and an acquisition module for matching the first battery information and the first audio information with the acquired target preset conditions in the current state to obtain a thermal runaway detection result of the battery.

[0025] A vehicle includes a vehicle body, a first target audio component mounted on the vehicle body, and a vehicle controller and a memory connected to the first target audio component. The memory stores a computer program executable on the vehicle controller, and the memory stores a computer program executable on a processor. When the vehicle controller executes the program, the steps of any of the above methods are implemented.

[0026] Beneficial effects of this application:

[0027] 1. By real-time monitoring of various vehicle status information, multimodal data, including first audio information and first battery information, is generated. This multimodal data enables thermal runaway detection of the vehicle's battery, improving accuracy and enabling intelligent identification and emergency response to vehicle abnormalities, thereby enhancing vehicle safety. Furthermore, the use of multimodal data, including first audio information and first battery information, addresses the high false alarm rate, response delay, and scenario limitations associated with using a single sensor to identify vehicle abnormalities in related technologies.

[0028] 2. For the scenario where Sentry Mode is turned on, the second target audio component to be enabled is determined to be related to the location of the target feature. This eliminates the need to activate all audio components in the vehicle, reduces the operating pressure of the vehicle, and improves the operating efficiency of the audio perception module. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 This is a schematic diagram of the implementation process of a vehicle monitoring method proposed in this application Figure 1 ;

[0030] Figure 2 A schematic diagram of a control system for a vehicle monitoring method proposed in this application;

[0031] Figure 3 This is a schematic diagram of the implementation process of a vehicle monitoring method proposed in this application Figure 2 ;

[0032] Figure 4 This is a schematic diagram of the structure of a vehicle monitoring device proposed in this application;

[0033] Figure 5 A schematic diagram of the hardware entity of a vehicle proposed in this application. DETAILED DESCRIPTION

[0034] The following will describe the embodiments of the present application with reference to the accompanying drawings and preferred embodiments. Those skilled in the art can easily understand the other advantages and effects of the present application from the contents disclosed in this specification. The present application can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present application. It should be understood that the preferred embodiments are only for the purpose of illustrating the present application and are not intended to limit the scope of protection of the present application.

[0035] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present application. Therefore, the illustrations only show components related to the present application and are not drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component can be changed at will, and the component layout type may also be more complicated.

[0036] The embodiment of the present application proposes a vehicle monitoring method, such as Figure 1 As shown, the vehicle monitoring method includes the following steps S110 and S120, wherein:

[0037] Step S110: Acquire first battery information and first audio information of the vehicle in the current state; the first audio information is obtained based on a first transmitted audio signal transmitted by a first target audio component; the first target audio component is within a preset range from the installation position of the battery of the vehicle.

[0038] Here, the current state of the vehicle refers to the operating condition of the vehicle, which includes the driving state and the parking state. The preset range is the spatial range with the battery installation position as the origin, that is, the spatial distance.

[0039] It can be understood that the current state of the vehicle can represent the current operating condition of the vehicle.

[0040] In some implementations, the first target audio component may be one or more.

[0041] In some embodiments, the battery may be integrated into the chassis of the vehicle, so that the first target audio component may also be located within a target preset range from the chassis of the vehicle.

[0042] It can be understood that, when the battery is integrated into the chassis of the vehicle, the target preset range may be less than or equal to the preset range.

[0043] In some embodiments, the Subaru Vehicle Dynamics Control (SVDC) sends a battery information collection request to the Battery Management System (BMS) via the Controller Area Network Flexible Data-Rate (CAN FD) bus. After receiving the battery information collection request, the BMS collects the battery information.

[0044] In some embodiments, the battery information includes at least one of the following: voltage, current, temperature, gas concentration, impedance, battery status description, and battery load. The battery status description may include at least one of health status, charge status, power status, and energy status.

[0045] In the embodiment of the present application, it is explained that the battery information includes at least one of voltage, current, temperature, gas concentration, impedance, battery status description, and battery load. In this way, in the process of collecting battery information, if the above information is collected at the same time, comprehensive monitoring of the battery can be achieved, thereby improving the accuracy of judging thermal runaway and fire of the battery.

[0046] In some embodiments, battery information may be obtained through a first target sensor, which may be one or more of a Hall current sensor, a semiconductor temperature sensor, a thermistor, a shunt, an audio temperature measurement component, a gas sensor, and the like.

[0047] Next, the relationship between the battery information and the first target sensor will be described.

[0048] In some embodiments, when the battery information includes voltage, the first target sensing component may be a Hall current sensor, so that during the battery discharge process, the battery voltage may be inferred by measuring the discharge current in combination with a known load resistance.

[0049] In some embodiments, when the battery information includes current, the first target sensing component may be a shunt, so that the battery current can be calculated by measuring the voltage drop across the shunt based on Ohm's law.

[0050] In some embodiments, when the battery information includes current, the first target sensing component can be a Hall current sensor. Based on the Hall effect, when current passes through a conductor in a magnetic field, a potential difference is generated on both sides of the conductor. By measuring the potential difference, the battery current can be calculated.

[0051] In some embodiments, when the battery information includes temperature, the first target sensing component may be a semiconductor temperature sensor, so that the battery temperature can be detected by the semiconductor temperature sensor.

[0052] In some embodiments, when the battery information includes temperature, the first target sensing component may be a thermistor. Since the resistance of the thermistor changes with temperature, the battery temperature may be inferred by measuring the resistance of the thermistor.

[0053] In some embodiments, when the battery information includes temperature, the first target sensing component can be an audio temperature measurement component. Based on the temperature sensitivity of the audio signal, the audio characteristic parameters of the audio signal change with the change of temperature. By measuring the audio characteristic parameter values, the battery temperature can be inferred.

[0054] In some embodiments, when the battery information includes gas concentration, the first target sensing component may be a gas sensor, so that the gas concentration at a location where the gas sensor is installed within a first range from the battery can be obtained through the gas sensor.

[0055] In one example, the gas sensor may be a hydrogen sensor, so that when hydrogen is generated inside the battery, the hydrogen sensor can detect it in real time and convert it into a corresponding electrical signal output, thereby monitoring the hydrogen concentration at the location where the hydrogen sensor is installed within a first range from the battery.

[0056] In one example, the gas sensor may be a carbon monoxide sensor, so that when carbon monoxide is generated inside the battery, the carbon monoxide sensor can detect it in real time and convert it into a corresponding electrical signal output, thereby monitoring the carbon monoxide concentration at the location where the carbon monoxide sensor is installed within a first range from the battery.

[0057] In one example, the gas sensor may be a carbon dioxide sensor, such that when carbon dioxide is generated inside the battery, the carbon dioxide sensor can detect it in real time and convert it into a corresponding electrical signal output, thereby monitoring the carbon dioxide concentration at the location where the carbon dioxide sensor is installed within a first range from the battery.

[0058] In one example, the gas sensor may be an organic compound sensor. When organic compounds are generated inside the battery, the organic compound sensor can detect them in real time and convert them into corresponding electrical signal outputs, thereby monitoring the concentration of volatile organic compounds at the location of the organic compound sensor installed within a first range from the battery.

[0059] In other embodiments, when the battery information includes voltage, the voltage may be measured by a voltage measurement circuit in the BMS, wherein the voltage measurement circuit may use technologies such as a voltage divider, an analog switch, and an analog-to-digital converter to implement voltage signal acquisition and conversion.

[0060] It is understandable that the first target audio component is within a preset range from the installation position of the battery of the vehicle, so that the first transmission audio signal of the first target audio component can pass through the battery when transmitted in the vehicle.

[0061] In some embodiments, when the distance difference between the first target audio component and the battery is less than or equal to a preset distance, it is determined that the installation position of the first target audio component is within a preset range from the battery of the vehicle.

[0062] In other embodiments, based on a preset distance, a preset range is determined with the battery as the center and the preset distance as the radius, so that a first target audio component within the preset range from the installation position of the battery of the vehicle can be obtained.

[0063] In some embodiments, in the above step S110, obtaining the first audio information of the vehicle in the current state includes the following steps S111 to S113, wherein:

[0064] Step S111: controlling the first target audio component to transmit a first transmission audio signal.

[0065] In some implementations, the first transmitted audio signal corresponds to a first target audio component.

[0066] In one example, when there is only one first target audio component, the first transmitted audio signal is a signal transmitted by the single first target audio component.

[0067] In one example, when there are multiple first target audio components, the first transmitted audio signal includes signals respectively transmitted by the multiple first target audio components.

[0068] In some embodiments, the first target audio component includes a transmitter, such that the first transmit audio signal is transmitted via the transmitter in the first target audio component.

[0069] In some embodiments, the first transmit audio signal may include a predefined, known audio signal.

[0070] In one example, the first transmit audio signal may be an ultrasonic signal.

[0071] In one example, the first transmitted audio signal may be an infrasound signal, or other acoustic signals for determination.

[0072] In some implementations, an external audio power amplifier (AMP) controller unit controls the first target audio component to send the first transmit audio signal.

[0073] In one example, first, the SVDC sends an audio perception request to the AMP through the CAN FD bus. After receiving the audio perception request, the AMP outputs a specified signal value and sends it to the first audio unit within a preset range from the battery installation position; then, after receiving the specified signal value, the first audio unit controls the first target audio component in the first audio unit to transmit the specified first transmission audio signal.

[0074] In one example, the first audio unit may be a power chassis audio unit, and the first target audio component may be a chassis audio module, or a chassis audio module and front and rear bumper audio modules.

[0075] In one example, the AMP diagnoses and controls the audio unit in the audio perception module through an Inter-Integrated Circuit (I2C) protocol.

[0076] Step S112: controlling the first target audio component to receive a first received audio signal; the first received audio signal is obtained after the first transmitted audio signal passes through the battery.

[0077] In some implementations, the AMP controls the first target audio component to receive the first received audio signal.

[0078] In some embodiments, the first target audio component includes a receiver, such that the first received audio signal is received by the receiver in the first target audio component.

[0079] In some embodiments, after the first target audio component transmits the first transmitted audio signal, the first transmitted audio signal passes through the area where the battery is located, so that the first received audio signal includes an audio signal related to the area where the battery is located. The first received audio signal is received by a receiver in the first target audio component;

[0080] Step S113: Process the first received audio signal to obtain first audio information.

[0081] In some implementations, the first received audio signal is converted from an acoustic signal to a level signal to obtain the first audio information.

[0082] In some implementations, the AMP controls the first audio unit to send the first received audio signal to a digital signal processor (DSP), and the DSP processes the first received audio signal to obtain the first audio information.

[0083] It can be understood that after the first transmitted audio signal is sent, it is received by the first target audio component after transmission. The received audio is the first received audio signal. The first transmitted audio signal may change during the transmission process. Therefore, the first received audio signal set and the first transmitted audio signal may be the same or different.

[0084] In this embodiment of the present application, a first transmitted audio signal emitted by a first target audio component passes through the area where the battery is located, generating a first received audio signal. This first received audio signal is then processed to generate first audio information. This allows for thermal runaway detection of the battery regardless of environmental constraints such as light and weather (rain, snow, sand, and dust). The timing corresponding to the first transmitted audio signal set and the first received audio signal set can also be used to determine the thermal runaway failure location. Furthermore, this method eliminates the need for the audio component to be exposed to flames or smoke, thereby extending its service life.

[0085] Step S120: matching the first battery information and the first audio information with the acquired target preset condition in the current state to obtain a thermal runaway detection result of the battery.

[0086] Here, thermal runaway of the battery refers to the phenomenon that under certain conditions, the heat generated by the internal chemical reaction of the battery exceeds the heat dissipation capacity, causing the temperature to rise sharply, which in turn triggers a series of irreversible chemical reactions, which may eventually cause the battery to catch fire or explode.

[0087] In some embodiments, the target preset condition in the current state includes a first threshold interval related to battery information in the current state and a second threshold interval related to audio information in the current state. The threshold intervals can be calibrated or dynamically changed.

[0088] It can be understood that the first threshold interval in the parking state is different from the first threshold interval in the driving state, and the second threshold interval in the parking state is different from the second threshold interval in the driving state.

[0089] In one example, the threshold interval may be calibrated based on at least one piece of information such as the battery model, vehicle type, environment, and experimental data.

[0090] In one example, the threshold interval may be a dynamic threshold model, which is implemented by algorithm optimization and / or a machine learning model.

[0091] The following description will be made assuming that the target preset condition includes a first threshold interval related to battery information and a second threshold interval related to audio information.

[0092] In some embodiments, the BMS compares the first battery information with a first threshold interval under a current state, and compares the first audio information with a second threshold interval under a current state to determine a thermal runaway detection result of the battery.

[0093] In some embodiments, when the specific value of the first battery information is within a first threshold range in the current state and the specific value of the first audio information is within a second threshold range in the current state, it is determined that the battery triggers thermal runaway.

[0094] In some embodiments, the BMS obtains a first audio feature of the first audio information and determines whether the first audio information is within the second threshold range based on a comparison of a specific value of the first audio feature with a second threshold range corresponding to the first audio feature. The first audio feature includes at least one of the following: propagation delay, signal amplitude attenuation, waveform distortion rate, envelope fluctuation variance, harmonic distortion, and spectral energy center of gravity shift.

[0095] In some embodiments, the BMS obtains a first audio feature of the first audio information and a transmitted audio feature corresponding to the first transmitted audio signal, and performs a difference calculation based on the specific values of the first audio feature and the transmitted audio feature to obtain a third audio feature; based on the comparison between the third audio feature and the second threshold interval corresponding to the third audio feature, it is determined whether the first audio information is in the second threshold interval.

[0096] It is understandable that, for different determination methods of the first audio information, the corresponding second threshold intervals are different, that is, the second threshold interval is related to the current state of the vehicle and the determination method of the first audio information.

[0097] In an example, when the first battery information includes a single battery parameter, and the single battery parameter is within a first threshold interval corresponding to the single battery parameter, it is determined that the first battery information is within the first threshold interval.

[0098] In one example, when the first battery information includes multiple battery parameters and at least one battery parameter among the multiple battery parameters is within a first threshold range corresponding to the battery parameter, it is determined that the first battery information is within the first threshold range.

[0099] In other embodiments, within a preset time period, the first battery information is compared with a first threshold interval in the current state, and the first audio information is compared with a second threshold interval in the current state to obtain a thermal runaway detection result of the battery.

[0100] In one example, when the first battery information is within a first threshold range within a preset time period, and the first audio information is within a second threshold range within a preset time period, it is determined that the battery triggers thermal runaway.

[0101] In an embodiment of the present application, the current state of the vehicle is first acquired, and a target preset condition under the current state can be determined. This target preset condition, ultimately used to determine the battery thermal runaway detection result, is adapted to the vehicle's current state. This allows analysis of different current vehicle states to improve the accuracy of battery thermal runaway determination. Next, first battery information and first audio information collected by a first target audio component within a preset range from the vehicle's battery installation location are determined. Finally, based on the first battery information and the first audio information, a battery thermal runaway detection result is determined. In this way, by real-time monitoring of multiple vehicle state information, multimodal data, including the first audio information and the first battery information, is obtained. Thermal runaway detection of the vehicle's battery is achieved through this multimodal data, improving the accuracy of battery thermal runaway detection and enabling intelligent identification and emergency response of vehicle abnormal conditions, thereby enhancing vehicle safety. Furthermore, the use of multimodal data, including the first audio information and the first battery information, addresses the high false alarm rate, response delay, and scenario limitations associated with identifying vehicle abnormal conditions using a single sensor in related technologies.

[0102] In some embodiments, obtaining the current state of the vehicle includes the following steps S1 and S2, wherein:

[0103] Step S1: Acquire state parameters collected by at least one second target sensor component related to the current state of the vehicle; the state parameters include at least one of the following parameters: vehicle speed, accelerator pedal opening, brake pedal opening, motor speed, gear position, and handbrake state.

[0104] In some embodiments, an integrated brake control unit (IBCU) obtains vehicle status parameters through at least one second target sensing component. The IBCU sends the vehicle status parameters collected by the at least one second target sensing component to the SVDC via a controller area network (CAN) bus. The SVDC then determines the current status information of the vehicle based on the status parameters.

[0105] Next, the relationship between the state parameter and the second target sensor will be described.

[0106] In some embodiments, when the state parameter includes vehicle speed, the second target sensor may be a vehicle speed sensor.

[0107] In some implementations, when the state parameter includes an accelerator pedal opening, the second target sensor may be an accelerator pedal position sensor.

[0108] In some implementations, when the state parameter includes a brake pedal opening, the second target sensor may be a brake pedal position sensor.

[0109] In some implementations, when the state parameter includes a motor speed, the second target sensor may be a motor speed sensor.

[0110] In some embodiments, when the state parameter includes a gear position, the second target sensor may be a gear position sensor.

[0111] In some embodiments, when the state parameter includes a handbrake state, the second target sensor may be a handbrake sensor.

[0112] Step S2: Determine the current state of the vehicle based on the state parameters.

[0113] In an embodiment of the present application, the state parameters collected by the second target sensing component can be used to determine the current state of the vehicle, thereby determining a first threshold interval or a second threshold interval adapted to the current state. This takes into account the first threshold interval or the second threshold interval of the vehicle's battery under different current states, and can improve the accuracy of identifying abnormal vehicle states.

[0114] In some embodiments, the above step S2, determining the current state of the vehicle based on the state parameter, includes at least one of the following steps S21 to S26, wherein:

[0115] Step S21: When the vehicle speed is greater than a first critical value and maintains a first critical time, determining that the current state is a driving state.

[0116] Here, the driving state refers to a state in which the vehicle is in motion. The first critical value may be 0 kilometers per hour (km / h). The first time length critical value may be 5 seconds (s).

[0117] Step S22: When the accelerator pedal opening is greater than the second critical value, determining that the current state is a driving state.

[0118] Here, the second critical value may range from 0% to 5%.

[0119] Step S23: When the brake pedal opening is greater than the third critical value, determine that the current state is the driving state.

[0120] Here, the third critical value may be 0%.

[0121] Step S24: When the motor speed is greater than the fourth critical value and maintains the second critical time, determine that the current state is the driving state.

[0122] Here, the fourth critical value may be 0 revolutions per minute (r / min), and the second time critical value may be 5 seconds.

[0123] Step S25: When the gear position is the target gear position, determine that the current state is the driving state.

[0124] Here, the target gear may be a forward gear and a reverse gear.

[0125] Step S26 : When the parking brake (PB) is in the off state, it is determined that the current state is the driving state.

[0126] In some embodiments, the state of the PB is determined to be the off state when the parking brake indicator light on the dashboard of the vehicle is on.

[0127] In some embodiments, the vehicle is determined to be in a driving state when the vehicle speed is greater than a first critical value and maintained for a first critical time, the accelerator pedal opening is greater than a second critical value, and the brake pedal opening is greater than a third critical value.

[0128] In one example, when the vehicle speed is greater than 0 km / h and maintained for 5 seconds, the accelerator pedal opening is greater than 0%, and the brake pedal opening is greater than 0%, it is determined that the vehicle is in a driving state.

[0129] In some embodiments, the vehicle is determined to be in a driving state when the vehicle speed is greater than a first critical value and maintained at a first critical time, the accelerator pedal opening is greater than a second critical value, and the motor speed is greater than a fourth critical value and maintained at a second critical time.

[0130] In some embodiments, when the vehicle speed is greater than a first critical value and maintained for a first critical time period, and the gear position is the target gear position, it is determined that the vehicle is in a driving state.

[0131] In some embodiments, when the vehicle speed is greater than a first critical value and maintains a first critical time period, and the PB is in an off state, it is determined that the vehicle is in a driving state.

[0132] In other embodiments, the vehicle is determined to be in a driving state when the wheel speed is greater than a ninth threshold, the gear is in forward or reverse gear, and the motor drive torque is greater than or equal to an eleventh threshold. It should be noted that in this scenario, accelerator pedal opening, brake pedal opening, motor speed, etc. may serve as supplementary conditions for determining whether the vehicle is in a driving state in this scenario, and are equivalent to any of the above conditions and do not affect the determination result.

[0133] In an embodiment of the present application, a method for determining the driving state of a vehicle is proposed. Through the above method, it can be determined whether the current state information of the vehicle is a driving state.

[0134] In some embodiments, the above step S2, determining the current state of the vehicle based on the state parameter, includes at least one of the following steps S27 to S32, wherein:

[0135] Step S27: When the vehicle speed is less than or equal to the fifth critical value, determine that the current state information is the parking state.

[0136] Here, the parking state refers to a state in which the vehicle is stationary. The fifth critical value is less than or equal to the first critical value, for example, the fifth critical value may be 0 km / h.

[0137] Step S28: When the accelerator pedal opening is less than or equal to the sixth critical value, determine that the current state information is the parking state.

[0138] Here, the sixth critical value is less than or equal to the second critical value. For example, the sixth critical value may be 0%.

[0139] Step S29: When the brake pedal opening is less than or equal to the seventh critical value, determine that the current state information is the parking state.

[0140] Here, the seventh critical value is less than or equal to the third critical value. For example, the seventh critical value may be 0%.

[0141] Step S30: When the motor speed is less than or equal to the eighth critical value, determining that the current state information is the parking state.

[0142] Here, the eighth critical value is less than or equal to the fourth critical value. For example, the eighth critical value may be 0 r / min.

[0143] Step S31: When the gear position is not the target gear position, determine that the current state information is the parking state.

[0144] Step S32: When the PB state is the on state, determine that the current state information is the parking state.

[0145] In some embodiments, the vehicle is determined to be in a parking state when the vehicle speed is less than or equal to the fifth critical value, the accelerator pedal opening is less than or equal to the sixth critical value, the brake pedal opening is less than or equal to the seventh critical value, the motor speed is less than or equal to the eighth critical value, the gear position is not the target gear position, and the hand PB state is on.

[0146] In one example, when the vehicle speed is 0 km / h, the motor speed is 0 r / min, the gear is neutral, the accelerator pedal opening is 0%, the brake pedal opening is 0%, and the PB state is on, it is determined that the vehicle is in a parking state.

[0147] In some embodiments, the vehicle is determined to be in a parking state when the vehicle speed is less than or equal to a fifth critical value, the accelerator pedal opening is less than or equal to a sixth critical value, and the motor speed is less than or equal to an eighth critical value.

[0148] In some implementations, when the vehicle speed is less than or equal to a fifth threshold value and the gear position is not the target gear position, it is determined that the vehicle is in the parking state.

[0149] In some embodiments, when the vehicle speed is less than or equal to a fifth threshold value and the PB is in an on state, it is determined that the vehicle is in a parking state.

[0150] In other embodiments, the vehicle is determined to be parked when the vehicle speed remains at 0 km / h, the gear is in park or neutral, and the PB is on. It should be noted that in this scenario, accelerator pedal opening, brake pedal opening, motor speed, etc. may serve as supplementary conditions for determining that the vehicle is parked, and are equivalent to any of the aforementioned conditions and do not affect the determination result.

[0151] In an embodiment of the present application, a method for determining the parking state of a vehicle is proposed. Through the above method, it can be determined whether the current state information of the vehicle is the parking state.

[0152] In some embodiments, after step S120, the vehicle monitoring method may further include steps S130 and S140, wherein:

[0153] Step S130: When the battery thermal runaway detection result indicates that the battery has triggered thermal runaway, output warning information.

[0154] In some implementations, if the BMS determines that a battery fire has occurred, it sends an alert to the SVDC's telematics box (T-BOX). Upon receiving the alert, the T-BOX wirelessly transmits the alert to the cloud, a customer service center, or other locations.

[0155] In one example, T-BOX can send warning information to the cloud through the Vehicle-to-Everything (V2X) communication module or other dedicated modules.

[0156] In some embodiments, the BMS uploads the collected first battery information and first audio information to the T-BOX. Thus, after receiving the first battery information and the first audio information, the T-BOX sends the first battery information and the first audio information to the cloud, a user service center, etc. via wireless communication.

[0157] In one example, the T-BOX may send the first battery information and the first audio information to the cloud via a V2X communication module or other dedicated modules.

[0158] Step S140: When the thermal runaway detection result of the battery indicates that the battery has not triggered thermal runaway, the vehicle is controlled to execute a target operation corresponding to the current state information.

[0159] It is understandable that the embodiment of the present application can determine that the battery has not triggered thermal runaway, but it does not mean that the vehicle has not caught fire. The cause of the vehicle fire may also be the temperature in the vehicle's engine compartment or a circuit failure in the vehicle. Therefore, when it is determined that the battery has not triggered thermal runaway, it can only be said that the vehicle's battery will not cause the vehicle to catch fire. It is necessary to further determine whether other components in the vehicle will cause the vehicle to catch fire.

[0160] In the embodiment of the present application, the corresponding execution strategies for two different scenarios in which the battery does not trigger thermal runaway or triggers thermal runaway are described. In this way, after obtaining the thermal runaway detection result of the battery, the corresponding execution strategy can be matched based on the judgment result.

[0161] In some embodiments, the above step S140, controlling the vehicle to perform a target operation corresponding to the current state, may include steps S141 and S142, wherein:

[0162] Step S141: when the current state information is the driving state, obtaining the second battery information and the second audio information of the vehicle in the driving state.

[0163] Step S142: Determine a thermal runaway detection result of the battery based on the second battery information and the second audio information.

[0164] In some embodiments, when the current state is driving state and the battery has not triggered thermal runaway, second battery information and second audio information of the vehicle in the driving state are obtained, wherein the second battery information and the first battery information correspond to different collection times, and the second audio information and the first audio information correspond to different collection times.

[0165] In some implementations, the second battery information and the second audio information are matched with a target preset condition in a driving state to determine a thermal runaway detection result of the battery.

[0166] In an embodiment of the present application, it is described that after determining that the battery has not triggered thermal runaway based on the first battery information and the first audio information, the second battery information and the second audio information are obtained again, and the thermal runaway detection result of the battery of the vehicle at the current moment is determined through the second battery information and the second audio information, so as to realize real-time monitoring of thermal runaway of the battery of the vehicle.

[0167] In some embodiments, the above step S140, controlling the vehicle to perform a target operation corresponding to the current state, may include steps S143 and S144, wherein:

[0168] Step S143: When the current state is the parking state, obtain first characteristic information of the vehicle; the first characteristic information includes a target temperature and / or heat flux density.

[0169] Step S144: When the first characteristic information satisfies the first preset condition, it is determined that there is a fire in the target scene where the vehicle is located.

[0170] In some embodiments, the first preset condition includes a third threshold interval.

[0171] The first feature information and the third threshold range are described below.

[0172] In some embodiments, when the first characteristic information includes the target temperature, the third threshold interval includes a third threshold interval corresponding to the target temperature.

[0173] In some embodiments, when the first characteristic information includes heat flux density, the third threshold interval includes a third threshold interval corresponding to the heat flux density.

[0174] In some embodiments, the heat flux density can be obtained by a heat flux density sensor.

[0175] In some embodiments, the first characteristic information is in the third threshold interval, which may be that the target temperature is in the third threshold interval corresponding to the target temperature, or that the heat flux density is in the third threshold interval corresponding to the heat flux density, or that the target temperature is in the third threshold interval corresponding to the target temperature and the heat flux density is in the third threshold interval corresponding to the heat flux density.

[0176] In some embodiments, the fire in the target scene may be a fire in a vehicle, a fire in other vehicles within a preset distance from the vehicle, or a fire in a target object within a preset distance from the vehicle, where the target object does not include the vehicle.

[0177] In an embodiment of the present application, target operations in the parking state are described when it is determined that the battery has not triggered thermal runaway. In this way, after it is determined that the battery has not triggered thermal runaway, if the vehicle is in the parking state, it can be determined through the first characteristic information that there is a fire in the target scene where the vehicle is located, so as to determine whether there is a fire risk caused by other factors in the vehicle.

[0178] In some embodiments, the first characteristic information includes a target temperature; the above step S143, obtaining the first characteristic information of the vehicle, may include steps S1431 to S1433, wherein:

[0179] Step S1431: Determine a second target audio component based on whether the sentry mode of the vehicle is turned on.

[0180] Here, Sentry Mode is a safety feature built by smart connected vehicles based on the vehicle's existing sensors, cameras and other hardware. When the vehicle is parked, Sentry Mode can monitor the safety conditions around the vehicle in real time and automatically send an alarm message to the owner when an abnormal situation is detected.

[0181] In some implementations, the second target audio component may be single or multiple.

[0182] In some embodiments, when the vehicle is in a parked state, the SVDC or the Central Computing and Control Unit (C2) may determine whether the sentry mode is on.

[0183] Step S1432: Determine third audio information based on the second transmitted audio signal transmitted by the second target audio component.

[0184] It should be noted that, for the method of determining the third audio information, refer to the above description of the first audio information, which will not be repeated here.

[0185] Step S1433: Based on the third audio information, determine the target temperature from the mapping information of the audio information and the temperature.

[0186] In some embodiments, mapping information may be pre-acquired, and the mapping information is used to represent a mapping relationship between temperature and audio feature parameters of the audio information. Thus, after acquiring the third audio information, the second audio feature corresponding to the third audio information is determined, and the second audio feature can be searched from the mapping information. Thus, the target temperature corresponding to the third audio information can be obtained from the mapping information. The second audio feature may include at least one of the following: the amplitude of the third audio information, or the frequency of the third audio information.

[0187] In some embodiments, after obtaining the third audio information, the second audio feature corresponding to the third audio information is determined. If the second audio feature of the third audio information is not found from the mapping information, the first mapping audio feature and the second mapping audio feature that are closest to the third audio information can be found from the mapping information. Based on the temperature information corresponding to the first mapping audio feature and the second mapping audio feature, respectively, the target temperature is obtained through a linear interpolation method, wherein the first mapping audio feature is greater than the second audio feature of the third audio information, and the second mapping audio feature is smaller than the second audio feature of the third audio information.

[0188] In some embodiments, after obtaining the third audio information, the second audio feature corresponding to the third audio information is determined. If the second audio feature of the third audio information is not found from the mapping information, the first mapping audio feature or the second mapping audio feature that is closest to the second audio feature of the third audio information can be found from the mapping information, and the temperature corresponding to the first mapping audio feature or the second mapping audio feature is determined as the target temperature.

[0189] In an embodiment of the present application, a method for determining the target temperature is proposed, so that the target temperature can be used to determine whether there is a fire in the target scene where the vehicle is located, so as to determine whether there is a fire risk caused by other factors in the vehicle.

[0190] In some embodiments, the third characteristic information includes a target temperature; the above step S1431, determining the second target audio component based on whether the sentry mode of the vehicle is turned on, may include steps S14311 and S14312, wherein:

[0191] Step S14311: When the sentry mode is not enabled, all audio components are determined as second target audio components.

[0192] It is understandable that when the sentry mode is not turned on, all audio components of the audio sensing module need to be enabled because the location of the fire trigger is uncertain.

[0193] Step S14312: When the sentry mode is turned on, determine whether there is a target feature for identifying the fire based on the image data collected by the image component in the vehicle; if the target feature exists, determine the second target audio component based on the target position corresponding to the target feature.

[0194] Here, the image component is located in the vehicle's image perception module, which is responsible for capturing image information around the vehicle through a camera, and processing and analyzing it to achieve perception and understanding of the surrounding environment.

[0195] In some embodiments, the imaging component may be a camera unit or a Time of Flight (TOF) camera unit. Furthermore, the image sensing module includes an exterior camera module and an interior camera module, while the TOF camera unit includes an exterior TOF module and an interior TOF module. Thus, the image data may include both interior and exterior image data of the vehicle.

[0196] In some embodiments, when the target feature is white smoke, SVDC obtains color features and texture features in the image data and performs white smoke determination on the color features and texture features; wherein the color features include smoke color distribution features, and the texture features include smoke texture structure features; the white smoke determination includes threshold determination based on color features and pattern matching based on texture features.

[0197] In some embodiments, before obtaining the color features and texture features in the image data, the image data can also be preprocessed by an image preprocessing unit. After the image data is preprocessed, the preprocessed image data is sent to the SVDC for analysis and processing, wherein the preprocessing operation includes filtering, noise reduction, and feature extraction.

[0198] In some embodiments, SVDC determines the grayscale value of the preprocessed image data, and when the grayscale value is greater than a preset calibration value, determines characteristic information such as the target position, color, and estimated volume of the white smoke based on the preprocessed image data.

[0199] In some embodiments, when the SVDC determines that the target feature exists, white smoke information such as the target position, color, and estimated volume of the white smoke is determined based on the preprocessed image data, and the white smoke information is sent to the audio perception module.

[0200] It is understandable that the target position and estimated volume may be determined based on image data captured by a TOF camera, and the color may be determined based on image data captured by a camera.

[0201] In some embodiments, the audio perception module determines whether the target feature is located inside or outside the vehicle based on the received target position, and determines a second target audio component corresponding to the inside or outside of the vehicle.

[0202] In one example, where the target feature is located outside the vehicle, the second target audio components may include front and rear bumper audio modules, a chassis audio module, and a door audio module.

[0203] In one example, when the target feature is located inside the vehicle, the second target audio component may include a door audio module, a skylight-carpet audio module, a dashboard and A-pillar and B-pillar audio module, and a seat audio module, wherein the door audio module, the skylight-carpet audio module, the dashboard and A-pillar and B-pillar audio module, and the seat audio module are located at the second audio unit.

[0204] In some embodiments, when the target feature is located outside the vehicle, it is determined that there is a fire on another vehicle within a preset distance from the vehicle or there is a fire on a target object within a preset distance from the vehicle.

[0205] In some embodiments, when the target feature is not present, at least one image component in an image perception module of the vehicle is controlled to collect image data.

[0206] In an embodiment of the present application, a method for determining the second target audio component in two different scenarios, namely, when the sentry mode is turned on or not, is described. For the scenario where the sentry mode is turned on, the second target audio component to be enabled is determined to be related to the target position of the target feature. This eliminates the need to start all audio components in the vehicle, thereby reducing the operating pressure of the vehicle and improving the operating efficiency of the vehicle.

[0207] In some embodiments, when the current state of the vehicle is the parking state, before step S110, steps S14313 and S14314 may be further included:

[0208] Step S14313: When the target feature exists, obtain the third battery information and the fourth audio information of the vehicle in the parking state.

[0209] In some implementations, when the current state is a parking state and the target feature exists, the third battery information and the fourth audio information of the vehicle in a driving state are obtained.

[0210] Step S14314: Determine a thermal runaway detection result of the battery based on the third battery information and the fourth audio information.

[0211] In some implementations, the third battery information and the fourth audio information are matched with a target preset condition in a parking state to obtain a thermal runaway detection result of the battery.

[0212] It should be noted that the fourth audio information is equivalent to the first audio information in the parking state, and the third battery information is equivalent to the first battery information in the parking state.

[0213] In an embodiment of the present application, before performing thermal runaway detection on the battery, target features are identified based on image data. When the target features are identified, thermal runaway detection is performed on the battery. This eliminates the need for the vehicle to frequently obtain battery information and audio information, thereby reducing the operating pressure of the vehicle.

[0214] In some embodiments, obtaining first characteristic information of a vehicle includes:

[0215] obtaining first feature information multiple times;

[0216] The method also includes:

[0217] When the first feature information obtained multiple times is not within the third threshold range, it is determined that there is no fire in the target scene.

[0218] In some embodiments, the first characteristic information may be obtained continuously for a first preset number of times. If the first characteristic information for the first preset number of times does not satisfy the first preset condition, it is determined that no fire exists in the target scene.

[0219] The following description is given assuming that the first preset condition includes the third threshold range.

[0220] In some embodiments, the first characteristic information of the first preset number of times may be obtained continuously, and it is determined that there is no fire in the target scene when at least the first characteristic information of the second preset number of times among the first characteristic information of the first preset number of times is not within the third threshold range; the second preset number of times is less than the first preset number of times.

[0221] In some embodiments, the first characteristic information may be continuously acquired within a first preset time period, and when none of the first characteristic information collected within the first preset time period is within a third threshold interval, it is determined that no fire exists in the target scene.

[0222] In some embodiments, the first characteristic information may be continuously acquired within a second preset time period, and if the first characteristic information collected within the second preset time period contains at least a third preset number of first characteristic information that is not within a third threshold range, it is determined that there is no fire in the target scene.

[0223] In the embodiment of the present application, a method for determining whether a fire does not exist in a target scene is described. Through this determination method, abnormal vehicle conditions are identified to improve vehicle safety.

[0224] In some embodiments, after step S144, the method further includes step S145, wherein:

[0225] Step S145: When there is a fire in the target scene, output alarm information, and execute the first operation and the second operation.

[0226] Among them, the first operation is used to wake up the person based on the person's location information when the presence of a person is detected in the vehicle; the second operation is used to release the vehicle's charging or discharging state by disconnecting the vehicle's charging connection and closing the vehicle's charging interface when the vehicle is detected to be in charging or discharging state.

[0227] In some embodiments, the first operation is further used to detect whether there is a person in the vehicle.

[0228] In one example, detecting the presence of a person in a vehicle includes: first, the SVDC sends a first detection instruction to the Smart Cockpit Domain Controller (CDC), which is used to detect the number and location of occupants in the vehicle. After receiving the first detection instruction from the SVDC, the CDC sends an audio sensing request to the AMP. Then, after receiving the audio sensing request, the AMP sends a specified signal value to the audio sensing module. The audio sensing module receives the specified signal value from the AMP and controls at least one third target audio component of a second audio unit to transmit and receive a specified fifth transmitted audio signal. The third target audio component includes at least one of the following: a door audio module, an instrument panel and A-pillar / B-pillar audio module, and a skylight / carpet audio module. Finally, the second audio unit sends the received fifth received audio signal to the DSP. The DSP converts the received fifth received audio signal from an acoustic signal to a level signal to obtain fifth audio information. The fifth audio information is then sent to the CDC, which performs signal processing and calculation to determine the number and location of occupants in the cabin. The fifth transmitted audio signal and the fifth received audio signal can be the same or different.

[0229] In some embodiments, the second operation is further used to detect whether the vehicle is in a charging or discharging state.

[0230] In one example, detecting whether the vehicle is in a charging or discharging state includes: the SVDC sends a second detection instruction to the BMS, and after receiving the second detection instruction, the BMS reads the charging port connection status data frame to determine whether the status of the charging port is a connected state.

[0231] In some embodiments, when the presence of a person is detected in the vehicle, the CDC uses the audio perception module in combination with the person's location information to wake up the person.

[0232] In one example, the CDC sends an audio perception request to the AMP. After receiving the audio perception request, the AMP outputs a specified signal value and sends it to the audio perception module. The audio perception module receives the specified signal value sent by the AMP and wakes up the person.

[0233] In some embodiments, when the presence of a person in the vehicle is detected, the person can be woken up by the voice system in the vehicle.

[0234] In some embodiments, when the presence of a person in the vehicle is detected, the person can be awakened by vibrating the seat where the person is sitting in the vehicle.

[0235] In some embodiments, when the charging port is in a connected state, the charging port of the vehicle is closed and the charging gun is ejected from the vehicle to release the charging or discharging state of the vehicle.

[0236] In some embodiments, if the charging gun fails to pop up, the BMS stops sending the pop-up request, sends a pop-up failure reminder to the user, and applies for accident rescue at the same time.

[0237] In one example, if the charging gun fails to be ejected within a fourth preset number of times, the BMS stops sending the ejection request.

[0238] In some embodiments, when the charging port is disconnected, an automatic driving-away operation is performed, wherein the automatic driving-away operation includes planning a safe driving path and controlling the vehicle to drive automatically.

[0239] It can be understood that the status of the charging port connection refers to whether a charging gun is inserted into the charging port, and the status of the charging port refers to whether the charging port is currently performing charging or discharging work.

[0240] In some embodiments, accident level information is sent to the cloud or user end, wherein the accident level information for the scenario where the charging gun fails to pop out is level one, the accident level information for the scenario where the vehicle's charging or discharging status is released is level two, the accident level information for the scenario where there are people in the vehicle is level three, and the accident level information for the scenario where alarm information is uploaded is level four.

[0241] It should be noted that when there are multiple scenarios, the accident level information corresponding to the multiple scenarios is obtained, and the highest accident level information is reported to the cloud or user end, or the accident level information corresponding to multiple scenarios is reported to the cloud.

[0242] It is understood that, if the target scene is a vehicle fire, the vehicle is driven away to an open area so that the vehicle does not affect the target object. If the target scene is another vehicle fire and / or a target object fire, the vehicle is driven away from the target scene so that the fire object does not affect the vehicle.

[0243] In the embodiment of the present application, the corresponding operations when there is a fire in the target scene are explained, so that emergency handling of the abnormal state of the vehicle can be achieved through the first operation and the second operation to reduce the risk of vehicle accidents, thereby reducing the number of vehicle accidents and improving the safety performance of the vehicle.

[0244] The following describes the application of the embodiments of the present application in actual scenarios.

[0245] Vehicle collisions are one of the most common forms of traffic accidents, causing not only casualties but also potential secondary disasters such as vehicle fires. Existing vehicle fire alarm systems often rely on single sensors (such as smoke or temperature sensors). However, single sensors have significant drawbacks:

[0246] 1. High false alarm rate: Traditional smoke sensors have a false alarm rate of 35%-45% due to environmental interference (data source: SAEJ3083-2021);

[0247] 2. Response delay: Early signs of thermal runaway (such as abnormal electrochemical signals) cannot be captured in a timely manner, with an average warning lag time of 8-12 minutes (data source: NFPA 2022);

[0248] 3. Scenario limitations: The relevant technology cannot cover all driving / parking conditions, and there is a lack of thermal runaway linkage protection for adjacent vehicles in the parking state.

[0249] To address these issues, the present invention proposes a control system and method for vehicle accident monitoring, identification, warning, and response based on multimodal data fusion. This method addresses the shortcomings of existing monitoring methods for delayed mechanical failure and fire accidents. Compared to related technologies, it significantly improves on these three aspects: reducing false alarm rates, shortening thermal runaway warning times, and improving coverage of driving and parking scenarios.

[0250] First, let’s introduce the control system. Figure 2 As shown, the control system includes a control and decision module 1, an audio perception module 2, an image perception module 3 and a data preprocessing module 4, wherein:

[0251] The control and decision module 1 includes: an SVDC unit 11, a CDC unit 12, a BMS unit 13, a C2 unit 14, an IBCU unit 15, and an AMP unit 16, wherein:

[0252] The BMS unit 13 is used to detect, identify and issue a warning of battery thermal runaway by integrating the collected battery information such as electrochemical signals, temperature signals, and gas concentration signals with the audio information determined by the audio sensing module 2.

[0253] The IBCU 15 is configured to acquire vehicle status parameters using various sensors and transmit them via the CAN bus to the vehicle control unit (VCU) or other relevant control units. The VCU or other relevant control units then use the vehicle status parameters to comprehensively determine whether the vehicle is in driving or parking mode. These sensors may include a vehicle speed sensor, a brake pedal position sensor, an accelerator pedal position sensor, and the like.

[0254] The SVDC unit 11 includes a T-BOX 101 and an MCU 102, wherein:

[0255] The T-BOX 101 is designed to perform the following functions: 1) Network Access and Communication: Serving as the gateway between the vehicle and the connected vehicle network, the T-BOX provides 4G / 5G wireless communication capabilities. It communicates with the vehicle's head unit or other electronic control units (ECUs) via Ethernet or the CAN bus, connecting the vehicle's internal network to the external network. 2) Remote Control and Monitoring: Users can remotely control the Telematics Service Provider (TSP) through a mobile app or platform, performing actions such as starting / stopping charging, flashing lights, and honking the horn. Furthermore, the T-BOX can monitor vehicle status in real time, including door lock status, remaining battery life, and vehicle location. 3) Safety and Diagnostics: The T-BOX features remote vehicle diagnostics, detecting vehicle faults and promptly notifying the owner. It also supports emergency call functionality, ensuring rapid contact with emergency services in the event of an accident. 4) Data Reporting and Monitoring: The T-BOX uploads vehicle data to enterprise platforms and national regulatory platforms in accordance with national standards (such as GB / T 32960). T-BOX also supports data encryption and secure storage to ensure the confidentiality and integrity of vehicle data.

[0256] Among them, MCU 102 is used to control the opening and closing of the sentry mode and the in-vehicle occupant detection mode, and specifically implements the corresponding mode functions by calling the camera unit and the TOF camera unit of the image perception module.

[0257] AMP unit 16 is used to amplify the input signal to meet the needs of subsequent circuits or devices. The input signal may include at least one of the following: current, voltage, and power. Furthermore, in mixed-precision training for deep learning, AMP unit 16 can address numerical stability issues caused by excessively small gradients through gradient scaling. For example, AMP unit 16 amplifies the loss before backpropagation and restores the gradient scale after weight updates.

[0258] The CDC unit 12 is used to implement the following functions: 1) detect the number and position of passengers in the vehicle by outputting control instructions to the cabin audio unit of the audio sensing module; 2) remind passengers in the cabin by controlling the steering wheel vibrator and seat vibrator.

[0259] The C2 unit 14 is used to process, calculate, make decisions and issue warnings on the collected audio data, image data, etc. inside and outside the vehicle.

[0260] In some embodiments, the audio perception module 2 is used to determine real-time audio information and provide a basis for system decision-making based on the mapping relationship between audio information and temperature. The audio perception module 2 includes a cabin audio unit 21 and a power chassis audio unit 22, wherein:

[0261] The cockpit audio unit 21 includes: a door audio module 211 , a cockpit audio module 212 , a skylight-carpet audio module 213 , and an instrument panel and A-pillar and B-pillar audio module 214 .

[0262] The power chassis audio unit 22 includes: front and rear bumper audio modules 221 and a chassis audio module 222 .

[0263] In some embodiments, the image perception module 3 is used to provide real-time image data to provide a basis for system decision-making. The image perception module 3 includes a camera unit 31 and a TOF camera unit 32, wherein:

[0264] The camera unit 31 includes an exterior camera module 311 and an interior camera module 312 . The TOF camera unit 32 includes an exterior TOF module 321 and an interior TOF module 322 .

[0265] In some embodiments, the data preprocessing module 4 is responsible for receiving data from the audio perception module 2 and the image perception module 3, performing preliminary processing, and then transmitting the processed data to the control and decision module 1. The control and decision module 1 analyzes the processed data to determine whether safety measures need to be taken in response, such as alarming, uploading data, automatic departure, etc.

[0266] The data pre-processing module 4 includes a DSP unit 41 and an image pre-processing unit 42 .

[0267] Next, the control method applied to the control system is described. Figure 3 As shown, it may include steps S301 to S330:

[0268] Step S301: Read vehicle status parameters (ie the above-mentioned status parameters).

[0269] Here, first determine the current state of the vehicle, that is, determine whether the vehicle is in a driving state or a parking state.

[0270] In some embodiments, the IBCU obtains vehicle status parameters through multiple sensors and transmits the obtained vehicle status parameters to the SVDC unit or other relevant control units through the CAN bus, so that the SVDC unit or other relevant control units can comprehensively judge the current status of the vehicle based on the vehicle status parameters.

[0271] The driving status is determined as follows: the vehicle speed is greater than 0 km / h, the accelerator pedal opening is greater than 0%, and the brake pedal opening is 0%.

[0272] The conditions for judging the parking state are: vehicle speed is 0 km / h, motor speed is 0, gear is neutral, accelerator pedal opening is 0%, brake pedal opening changes from greater than 0% to 0%, and the parking brake button is on.

[0273] Step S302: Determine whether the vehicle is in a parking state.

[0274] Here, the SVDC unit or other relevant control unit determines whether the vehicle is in the parked state based on the vehicle state parameters and the parking state judgment criteria. If the vehicle is not parked, the process proceeds to step S303 to determine whether the vehicle is in the driving state. If the vehicle is parked, the process proceeds to step S310 to determine whether the sentry mode is enabled.

[0275] Step S303: Determine whether the vehicle is in a driving state.

[0276] Here, the SVDC unit or other relevant control unit determines whether the vehicle is in a driving state based on the vehicle state parameters and the driving state judgment criteria. If the vehicle is not in a driving state, the process proceeds to step S301 to read the vehicle state parameters. If the vehicle is in a driving state, the process proceeds to steps S304 and S305 simultaneously to determine the second battery information and the second audio information under the driving state.

[0277] Step S304: SVDC sends a battery information collection request to the BMS.

[0278] Here, SVDC sends a battery information collection request to the BMS of the control and decision module through the CAN FD bus. After receiving the battery information collection request, the BMS starts to collect the second battery information of the battery in the driving state. The second battery information at least includes the battery voltage information U D , current information I D , temperature information T D , Gas concentration information C D wait.

[0279] Step S305: SVDC sends an audio perception request to AMP.

[0280] Here, the SVDC sends an audio perception request to the control and decision module's AMP via the CAN FD bus. The AMP receives the audio perception request and outputs a specified signal value. After receiving the specified signal value from the AMP, the power chassis audio unit (the aforementioned first audio unit) in the audio perception module emits a specified first transmit audio signal using the transmitters in the front and rear bumper audio modules and chassis audio module. Typically, the AMP uses the I2C protocol for internal diagnostics and control of the corresponding audio units. Simultaneously, the receivers in the front and rear bumper audio modules and chassis audio module of the power chassis audio unit receive the first receive audio signal after receiving the activation command from the SVDC.

[0281] Step S306: The DSP processes the first received audio signal and sends it to the BMS.

[0282] Here, the receivers of the front and rear bumper audio modules and the chassis audio module of the power chassis audio unit send the received first received audio signal to the DSP of the data preprocessing module, and the DSP processes the received first received audio signal to obtain the first audio information W D , that is, converting the first received audio signal from an acoustic signal into a level signal, and sending the level signal to the BMS.

[0283] Step S307: Determine whether the battery has a thermal runaway risk.

[0284] Here, BMS receives the U D , I D 、T D 、C D and W D Analyze the mechanical load of the battery and monitor whether the battery has a risk of thermal runaway. If the battery is determined to have a risk of thermal runaway, proceed to step S308; if the vehicle is determined not to have a risk of thermal runaway, proceed to both steps S304 and S305.

[0285] When implemented, it can be U D , I D 、T D and C D Compare it with the first threshold interval under the corresponding driving state, and W D Compare with the second threshold interval corresponding to the driving state; D , I D 、T D and C D Any one of the items is in its corresponding first threshold interval, and W D When the battery is in the second threshold range under its corresponding driving state, it is determined that the battery has a thermal runaway risk.

[0286] In some embodiments, the first battery information and the first audio information may be continuously obtained within a first time period, and when any one of the first battery information obtained within the first time period is within a first threshold interval under its corresponding driving state, and the first audio information is within a second threshold interval under its corresponding driving state, it is determined that the battery is at risk of thermal runaway.

[0287] In some embodiments, when there is no risk of thermal runaway of the battery, the BMS is controlled to continuously collect the first battery information and the audio sensing module is controlled to continuously transmit the first transmission audio signal and receive the first reception audio signal.

[0288] Step S308: Send an alarm signal and corresponding data via T-BOX.

[0289] Here, if the BMS determines that the battery is at risk of thermal runaway, it sends an alarm signal to the T-BOX. After receiving the alarm signal, the T-BOX transmits it to the cloud, user service center, etc. via wireless communication.

[0290] In some embodiments, the BMS may also send a second audio signal and a second battery information corresponding to the alarm signal to the T-BOX. After receiving the second audio signal and the second battery information, the T-BOX may send the second audio signal and the second battery information to the cloud, a user service center, etc. via wireless communication.

[0291] Step S309: Activate the passive safety device.

[0292] Passive safety devices are systems that automatically activate without human intervention to protect occupants in the event of a collision. Their core design concept is "passive response," meaning they automatically trigger at the moment of an accident to mitigate or prevent occupant injury.

[0293] Step S310: Determine whether the sentry mode is on.

[0294] Here, if the vehicle is determined to be parked, the SVDC or C2 is used to determine whether Sentry Mode is enabled. If Sentry Mode is enabled, the process proceeds to step S311, where the image sensing module collects image data and sends it to the SVDC. If Sentry Mode is not enabled, the process proceeds to step S315, where the fourth audio information and the third battery information are obtained.

[0295] Step S311: The image perception module collects image data and sends it to the SVDC.

[0296] Here, when Sentry Mode is on, the image data collected by the camera unit and TOF camera unit of the image perception module is sent to the image preprocessing unit for processing. The processed image data is then sent to the SVDC for analysis and processing to determine whether white smoke, a characteristic feature before a fire, (i.e., the target feature mentioned above) appears inside or outside the vehicle.

[0297] Step S312: Determine whether suspected characteristic white smoke appears.

[0298] Here, SVDC obtains the grayscale value of the processed image data based on the image data collected and processed by the camera unit and the TOF camera unit. It then compares the grayscale value with a preset grayscale threshold to determine whether suspected white smoke is present. If suspected white smoke is present, the process proceeds to steps S313 and S315 simultaneously. If suspected white smoke is not present, the process proceeds to step S311.

[0299] Step S313: Calculate white smoke information of the suspected characteristic white smoke.

[0300] Here, when the SVDC determines that the grayscale value is greater than the grayscale threshold, it calculates and generates white smoke information of the suspected characteristic white smoke, where the white smoke information may include the position of the suspected characteristic white smoke and the color of the suspected characteristic white smoke.

[0301] Step S314: sending white smoke information to the audio perception module.

[0302] Here, SVDC sends the calculated white smoke information to the audio perception module.

[0303] Step S315: Acquire fourth audio information and third battery information.

[0304] Here, when the sentry mode is not enabled, the process proceeds from step S310 to step S315 , or when the sentry mode is enabled, the process proceeds from step S312 to step S315 .

[0305] It should be noted that the fourth audio information and the third battery information are the first audio information and the first battery information when the vehicle is in the parking state, and the above-mentioned second audio information and the second battery information can be understood as the first audio information and the first battery information when the vehicle is in the driving state.

[0306] The third battery information includes: voltage information U P , current information I P , temperature information T P , Gas concentration information C P and the fourth audio information W P .

[0307] The BMS obtains the fourth audio information W in the parking state PThe process of acquiring the first audio information and the third battery information can be found in the above description of the first audio information and the first battery information, which will not be repeated here.

[0308] Step S316: Determine whether the battery has a thermal runaway risk.

[0309] Here, BMS receives the U P , I P 、T P 、C P and W P Analyze the battery's mechanical load and monitor whether the battery is at risk of thermal runaway while parked. If the battery is at risk of thermal runaway, proceed to step S308. If the battery is not at risk of thermal runaway, proceed to step S317 to obtain the heat flux and target temperature.

[0310] When implemented, it can be U P , I P 、T P 、C P and W P Compare with the first threshold interval in its parking state, and W P Compare with its corresponding second threshold interval; P , I P 、T P and C P When the vehicle is in the first threshold interval of the parking state, and W P When the vehicle is in the second threshold range in the parking state, it is determined that there is a risk of thermal runaway.

[0311] In some embodiments, the third battery information and the fourth audio information may be continuously obtained within a second time period, and when any one of the third battery information obtained within the second time period is in the corresponding first threshold interval when the vehicle is in the parking state, and the fourth audio information is in the corresponding second threshold interval when the vehicle is in the parking state, it is determined that there is a risk of thermal runaway.

[0312] In some embodiments, if the BMS determines that a battery is at risk of thermal runaway, the BMS sends an alarm signal to the T-BOX. After receiving the alarm signal, the T-BOX transmits the alarm signal to the cloud, a user service center, etc. via wireless communication.

[0313] In some embodiments, when the BMS determines that the battery is at risk of thermal runaway, the BMS may also send a fourth audio signal and a third battery signal corresponding to the alarm signal to the T-BOX. After receiving the fourth audio signal and the third battery signal, the T-BOX transmits the fourth audio signal and the third battery signal to the cloud, a user service center, etc. via wireless communication.

[0314] In some embodiments, when the BMS determines that there is no risk of thermal runaway of the battery, it can determine that the suspected characteristic white smoke is not caused by thermal runaway of the battery of the vehicle. In this scenario, it may be caused by other vehicles adjacent to the vehicle.

[0315] Furthermore, as shown in Table 1 below, a comparison of the effects of the battery thermal runaway monitoring method proposed in the present application and the battery thermal runaway risk methods in related technologies is shown. It can be seen that the battery thermal runaway monitoring method proposed in the present application reduces the false alarm rate of battery thermal runaway and the response time to battery thermal runaway.

[0316] Table 1 Comparison of battery thermal runaway monitoring methods in this application and related technologies

[0317]

[0318] Step S317: Obtain heat flux and target temperature.

[0319] In some embodiments, the target temperature T P1 It can be determined based on the third audio information collected by the second target audio component in the audio perception module.

[0320] In one example, when the sentry mode is activated, when the audio perception module is started, the audio perception module determines a second target audio component related to the white smoke information from multiple audio components of the audio perception module based on the received white smoke information, so that the third audio information determined by the second target audio component can obtain the target temperature of the target identification area.

[0321] It can be understood that the above solution can reduce the number of audio components in the called audio perception module without affecting the monitoring precision and accuracy, thereby improving system efficiency.

[0322] In one example, when the location of the suspected characteristic white smoke is determined to be outside the vehicle based on the white smoke information, the second target audio component may include the front and rear bumper audio modules and chassis audio module of the power chassis audio unit, and the door audio module of the cabin audio unit.

[0323] In one example, when the location of the suspected characteristic white smoke is determined to be inside the car based on the white smoke information, the second target audio component may include the door audio module, the skylight-carpet audio module, the instrument panel and the A-pillar and B-pillar audio module and the seat audio module of the cabin audio unit.

[0324] In one example, when the sentry mode is not activated, when the audio perception module is activated, all audio components in the audio perception module need to be called as second target audio components to obtain the target temperature of the target recognition area.

[0325] In some embodiments, the system pre-stores a mapping relationship between audio features corresponding to the audio information and temperature. This allows the target temperature of the target identification area to be determined based on the mapping relationship after obtaining the second audio feature of the third audio information. The second audio feature may include the amplitude of the audio information and / or the frequency of the audio information.

[0326] In some embodiments, the heat flux q p It can be detected by a heat flux density sensor.

[0327] Step S318: Determine whether there is a fire in the target scene where the vehicle is located.

[0328] Here, BMS receives the q p and T P1 , determine whether there is a fire in the target scene where the vehicle is located.

[0329] When implemented, it can be q p and T P1 The information is compared with the corresponding third threshold interval. When any one of the information is within the corresponding third threshold interval, it is determined that there is a fire in the target scene where the vehicle is located.

[0330] Among them, when it is determined that there is a fire in the target scene where the vehicle is located, the process proceeds to step S308, step S320 and step S322; when it is determined that there is no fire in the target scene where the vehicle is located, the process proceeds to step S319.

[0331] It can be understood that based on the white smoke information, it can also be obtained that the location of the suspected characteristic white smoke is inside or outside the vehicle. When the location of the suspected characteristic white smoke is inside the vehicle, it means that the fire was caused by this vehicle. When the location of the suspected characteristic white smoke is outside the vehicle, it means that the fire was caused by another vehicle, that is, other vehicles near this vehicle.

[0332] Furthermore, as shown in Table 2 below, a comparison of the effects of the thermal runaway method for a different vehicle proposed in the present application and the thermal runaway method for a different vehicle in the related art is shown. It can be seen that the thermal runaway method for a different vehicle proposed in the present application reduces the false alarm rate of thermal runaway for a different vehicle and the response time to thermal runaway for a different vehicle.

[0333] Table 2 Comparison of the out-of-control monitoring method of the present application and the related art

[0334]

[0335] Step S319: Determine whether N>n0.

[0336] In some embodiments, the number of judgment results that there is no fire in the target scene where the vehicle is located is counted. When the number of judgments N is greater than the preset number n0, if q p and T P1 If it is still not within the corresponding third threshold range, it can be determined that the suspected characteristic white smoke is not caused by fire.

[0337] In some embodiments, the judgment results that there is no fire in the target scene where the vehicle is located are counted. When the number of judgments N is less than or equal to the preset number n0, step S317 is entered. When the number of judgments N is greater than the preset number n0, it indicates that the risk of the vehicle currently having an accident is relatively small.

[0338] Step S320: Determine whether the number of passengers in the cabin is 0.

[0339] In some embodiments, if a fire is determined to exist in the target scene where the vehicle is located, a cabin occupant detection is performed (i.e., the first detection operation described above), and an alarm signal is transmitted via the T-BOX. If the number of cabin occupants is zero, there is no need to remind the occupants to leave the vehicle. If the number of cabin occupants is not zero, the process proceeds to step S321.

[0340] In some embodiments, the SVDC sends an occupant detection instruction to the CDC to detect the number and location of occupants in the vehicle. After receiving the occupant detection instruction from the SVDC, the CDC sends an audio perception request to the AMP of the control and decision module. After receiving the audio perception request, the AMP outputs a specified signal value. The audio perception module receives the specified signal value sent by the AMP and controls the door audio module, instrument panel, A-pillar and B-pillar audio module, and skylight-carpet audio module of the cabin audio unit to transmit and receive a specified fifth transmitted audio signal. The received fifth received audio signal is then sent to the DSP of the data preprocessing module. The DSP converts the received fifth received audio signal into fifth audio information and sends the fifth audio information to the CDC. The CDC performs signal processing and calculation to determine the number and location of occupants in the cabin.

[0341] Step S321: Wake up the passengers and request rescue.

[0342] Here, when it is determined that there are passengers in the cabin, that is, the number of passengers is greater than 0, the CDC uses the audio perception module in combination with the passenger position information to wake up the passenger.

[0343] During implementation, the CDC sends an audio sensing request to the AMP in the control and decision-making module. The AMP receives the signal and outputs a specified value. The audio sensing module then applies vibration stimulation to the cabin occupants. Simultaneously, the CDC sends a request for emergency assistance via T-BOX to the user center and the vehicle owner's mobile device, and the user center assists with the rescue.

[0344] Step S322: Determine whether the status of the charging port is connected.

[0345] If the state of the charging port is the connected state, the process proceeds to step S323 ; if the state of the charging port is not the connected state, the process proceeds to step S325 .

[0346] In some embodiments, when it is determined that there is a fire in the target scene where the vehicle is located, a charge / discharge status detection (ie, the above-mentioned second detection operation) is performed.

[0347] In one example, the SVDC sends a charge / discharge status detection instruction to the BMS, and the BMS reads the status data frame of the charging port to determine whether the status of the charging port is a connected state.

[0348] Step S323: Close the charging port.

[0349] Here, when the state of the charging port is the connected state, the charging port is closed.

[0350] In one example, the state of the charging port is switched to a disconnected state, closing the charging port to stop charging or discharging.

[0351] Step S324: Determine whether the charging port connection status is disconnected.

[0352] Among them, when the state of the charging port connection is connected, go to step S326, and when the state of the charging port connection is disconnected, go to step S325.

[0353] In some embodiments, when it is determined that the charging port connection state is disconnected, it is determined that the charging gun has popped out of the charging port. In this scenario, the automatic departure program can be activated to control the vehicle to depart along the cached map path.

[0354] In some implementations, when it is determined that the charging port is in a connected state, the charging gun has not yet popped out of the charging port. In this scenario, it is necessary to first control the charging gun to pop out of the charging port.

[0355] Step S325: Activate the automatic departure program.

[0356] Here, when the charging port connection state is in the disconnected state, the automatic drive-away program is activated.

[0357] The Auto-Drive program is an intelligent driver-assistance technology designed to simplify the process of starting a vehicle from a standstill and improve driving convenience and safety.

[0358] Step S326: Control the charging gun to pop out of the charging port.

[0359] Step S327: Determine whether the charging gun is ejected successfully.

[0360] Here, when the charging gun is ejected, the charging port connection state is not connected. If the charging gun fails to be ejected, the process proceeds to step S328. If the charging gun is ejected successfully, the process proceeds to step S325.

[0361] Step S328: Determine whether the pop-up request exceeds the preset request times.

[0362] Here, if the charging gun fails to eject, the BMS sends an eject request again to control the charging gun to eject, and at the same time counts the number of eject requests sent. If the count exceeds the preset number of requests, the BMS stops sending eject requests, sends an eject failure reminder to the user, and requests accident rescue.

[0363] Step S329: Stop sending the pop-up request, send a pop-up failure reminder to the user, and apply for accident rescue.

[0364] Step S330: Control the vehicle to stay in place, start the recording function, and activate other emergency protection systems.

[0365] Here, in this scenario, it is also necessary to collect vehicle data, store the collected data locally and transmit it back in real time.

[0366] It should be noted that the above control method is applicable to at least Scenario 1, Scenario 2, and Scenario 3. Scenario 1 involves "evolutionary" thermal runaway caused by mechanical failure during driving, Scenario 2 involves "sudden death" thermal runaway caused by mechanical failure of the own vehicle during parking, and Scenario 3 involves identifying (tracing the heat source) and actively evacuating the vehicle from a neighboring vehicle under parking due to an unknown failure mode. Furthermore, for Scenario 1, the corresponding steps are S301 to S309; for Scenario 2, the corresponding steps are S301, S302, S310 to S312, S315, and S316; and for Scenario 3, the corresponding steps are S301, S302, S310 to S330.

[0367] In summary, based on the control system and control method proposed in this application, the following beneficial effects can be achieved:

[0368] 1. Decoupled multimodal data fusion improves detection accuracy.

[0369] By integrating mechanical signals, electrochemical parameters, acoustic parameters, and image information, the system overcomes the limitations of single sensors, such as poor environmental adaptability and high false alarm rates. Experiments have shown that, through cross-validation of multi-source data, the system reduces the false alarm rate for sudden thermal runaway events by 42% or more (tested according to the SAE J2990 standard). It also provides 15-30 minutes of lead time for evolving failures, significantly outperforming traditional single-modality solutions. Furthermore, audio sensing operates independently of image perception.

[0370] 2. Full-scene coverage and working condition adaptation.

[0371] Based on vehicle dynamic parameters (vehicle speed, pedal opening, motor status), driving / parking conditions are determined in real time, and differentiated monitoring strategies are dynamically activated:

[0372] 1) Under driving conditions, the audio perception module captures chassis mechanical vibrations at a specific sampling rate and combines this with BMS electrochemical parameters to enable real-time assessment of collision damage.

[0373] 2) In parking conditions, the TOF camera analyzes smoke volume with a resolution of 0.1 m³, and combined with acoustic positioning error of ≤ 5 cm (GB / T 38186-2023), it can distinguish the heat sources of the vehicle and neighboring vehicles.

[0374] Based on the above embodiments, the present application provides a vehicle monitoring device, such as Figure 4 As shown, the vehicle monitoring device 400 includes:

[0375] An acquisition module 401 is configured to acquire first battery information and first audio information of a vehicle in a current state; the first audio information is obtained based on a first transmitted audio signal transmitted by a first target audio component; and the first target audio component is within a preset range from an installation position of the vehicle battery.

[0376] The obtaining module 402 matches the first battery information and the first audio information with the obtained target preset condition in the current state to obtain a thermal runaway detection result of the battery.

[0377] In some embodiments, the acquisition module includes: a first control unit, used to control the first target audio component to transmit a first transmitted audio signal; a second control unit, used to control the first target audio component to receive a first received audio signal; the first received audio signal is obtained after the first transmitted audio signal passes through the battery; a third control unit, used to process the first received audio signal to obtain first audio information.

[0378] In some embodiments, a vehicle monitoring device includes: an output module for outputting an alarm message when the thermal runaway detection result of the battery indicates that the battery has triggered thermal runaway; and a control module for controlling the vehicle to perform a target operation corresponding to the current status information when the thermal runaway detection result of the battery indicates that the battery has not triggered thermal runaway.

[0379] In some embodiments, the control module includes: a first acquisition unit, used to obtain second battery information and second audio information of the vehicle in a driving state when the current state is a driving state; a first determination unit, used to determine the thermal runaway detection result of the battery based on the second battery information and the second audio information.

[0380] In some embodiments, the control module includes: a second acquisition unit, used to obtain first characteristic information of the vehicle when the current state is a parking state; the first characteristic information includes a target temperature and / or heat flux density; a second determination unit, used to determine whether there is a fire in the target scene where the vehicle is located when the first characteristic information meets a first preset condition.

[0381] In some embodiments, the first characteristic information includes a target temperature, and the second acquisition unit includes: a first determination subunit, used to determine the second target audio component based on whether the sentry mode of the vehicle is turned on; a second determination subunit, used to determine the third audio information based on the second transmitted audio signal emitted by the second target audio component; and a third determination subunit, used to determine the target temperature from the mapping information of the audio information and the temperature based on the third audio information.

[0382] In some embodiments, the first determination subunit includes: when the sentry mode is not turned on, determining all audio components as second target audio components; when the sentry mode is turned on, determining whether there is a target feature for identifying the fire based on the image data collected by the image component in the vehicle; when the target feature exists, determining the second target audio component based on the target position of the target feature.

[0383] In some embodiments, the first determination subunit further includes: when the target feature exists, obtaining third battery information and fourth audio information of the vehicle in a parking state; and determining a thermal runaway detection result of the battery based on the third battery information and the fourth audio information.

[0384] In some embodiments, the second acquisition unit further includes: a fourth determination subunit, configured to determine that no fire exists in the target scene when the first feature information acquired multiple times does not satisfy the first preset condition.

[0385] In some embodiments, the vehicle monitoring device also includes: an execution module, which outputs an alarm message and performs a first operation and a second operation when there is a fire in the target scene; wherein the first operation is used to wake up the person based on the person's location information when a person is detected to be present in the vehicle; the second operation is used to release the vehicle from the charging or discharging state by disconnecting the vehicle's charging connection and closing the vehicle's charging interface when the vehicle is detected to be in the charging or discharging state.

[0386] An embodiment of the present application also proposes a vehicle, including a vehicle body, a first target audio component installed on the vehicle body, and a vehicle controller and a memory connected to the first target audio component. The memory stores a computer program that can be run on the vehicle controller. When the vehicle controller executes the program, some or all of the steps in the above method are implemented.

[0387] The present application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a vehicle monitoring device, implements some or all of the steps in the above method. The computer-readable storage medium may be transient or non-transient.

[0388] An embodiment of the present application also proposes a computer program, including a computer-readable code. When the computer-readable code runs in an electronic device, a vehicle monitoring device in a vehicle executes some or all of the steps for implementing the above method.

[0389] The present application also provides a computer program product comprising a computer program or instructions. When executed by a vehicle monitoring device, the computer program or instructions implement some or all of the steps in the above-described method. The computer program product may be implemented through hardware, software, or a combination thereof. In some embodiments, the computer program product is embodied as a computer storage medium. In other embodiments, the computer program product is embodied as a software product, such as a software development kit (SDK).

[0390] It should be noted that the above descriptions of the various embodiments tend to emphasize the differences between the various embodiments, and reference can be made to the similarities and similarities between the embodiments. The descriptions of the above vehicle, storage medium, computer program, and computer program product embodiments are similar to the descriptions of the above method embodiments and have similar beneficial effects as the method embodiments. For any technical details not disclosed in the vehicle, storage medium, computer program, and computer program product embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0391] It should be noted that the embodiment of the present application provides a vehicle hardware entity, such as Figure 5 As shown, the hardware entities of vehicle 500 include:

[0392] Vehicle body 501;

[0393] A first target audio component 502 is mounted on a vehicle body 501; the first target audio component is within a preset range from a mounting position of a battery of the vehicle;

[0394] A vehicle controller 503 and a memory 504 connected to the first target audio component 502;

[0395] The memory 504 is used to store computer programs that can be run on the vehicle controller 503. It can also cache data to be processed or processed by the vehicle controller 503 and various modules in the vehicle 500 (for example, image data, audio data, voice communication data and video communication data). It can be implemented by flash memory (FLASH) or random access memory (RAM).

[0396] The vehicle controller 503 is used to obtain first battery information and first audio information of the vehicle in the current state; the first audio information is obtained based on the first transmitted audio signal emitted by the first target audio component; based on the first battery information, the first audio information, and the target preset conditions in the current state, determine the thermal runaway detection result of the battery.

[0397] The first target audio component 502 transmits data to the vehicle controller 503 via a bus, and the memory 504 transmits data to the vehicle controller 503 via a bus.

[0398] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned steps / processes does not mean the order of execution, and the execution order of each step / process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The above-mentioned serial numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments.

[0399] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0400] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of units is merely a logical function division. In actual implementation, there may be other division methods, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0401] The units described above as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units; they may be located in one place or distributed across multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. In addition, the functional units in the various embodiments of the present application may all be integrated into one processing unit, or each unit may be separately used as a unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0402] Those skilled in the art will understand that all or part of the steps of the above-mentioned method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above-mentioned method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, and other media that can store program codes.

[0403] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the relevant technology, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions for enabling the vehicle to execute all or part of the methods of each embodiment of the present application. The aforementioned storage medium includes: various media that can store program code, such as mobile storage devices, ROMs, magnetic disks or optical disks.

[0404] The above embodiments are only preferred embodiments for fully illustrating the present application, and the protection scope of the present application is not limited thereto. Any equivalent substitutions or modifications made by those skilled in the art based on the present application are within the protection scope of the present application.

Claims

1. A vehicle monitoring method, characterized in that: The vehicle monitoring method includes: Obtaining first battery information and first audio information of the vehicle in a current state; the first audio information is obtained based on a first transmitted audio signal transmitted by a first target audio component; the first target audio component is within a preset range from an installation position of the battery; the current state includes a parking state or a driving state; the first target audio component includes a chassis audio module, or a chassis audio module and front and rear bumper audio modules; matching the first battery information and the first audio information with the acquired target preset condition in the current state to obtain a thermal runaway detection result of the battery; The vehicle monitoring method further includes: When a thermal runaway monitoring result of the battery indicates that the battery has not triggered thermal runaway, controlling the vehicle to perform a target operation corresponding to the current state; The controlling the vehicle to perform a target operation corresponding to the current state includes: When the current state is a parking state, determining a second target audio component based on whether a sentry mode of the vehicle is turned on; determining third audio information based on a second transmitted audio signal transmitted by the second target audio component; determining the target temperature from mapping information of the audio information and the temperature based on the third audio information; When the target temperature and heat flux density meet a first preset condition, determining that a fire exists in the target scene where the vehicle is located; The fire in the target scene includes any one of the following: a fire triggered by the vehicle not caused by battery thermal runaway, a fire triggered by a vehicle within a preset distance from the vehicle, and a fire triggered by a target object within a preset distance from the vehicle, the target object not including the vehicle; The determining of the second target audio component based on whether the sentry mode of the vehicle is turned on includes: When the sentry mode is turned on, based on the image data collected by the image component in the vehicle, it is determined whether there is a target feature for identifying the fire; when the target feature exists, the second target audio component is determined based on the target position of the target feature; wherein, the target feature is located outside the vehicle, and the second target audio component includes the front and rear bumper audio modules, the chassis audio module and the door audio module.

2. The method according to claim 1, characterized in that Obtain the first audio information of the vehicle in the current state, including: controlling the first target audio component to transmit the first transmit audio signal; controlling the first target audio component to receive a first received audio signal; the first received audio signal being obtained after the first transmitted audio signal passes through the battery; The first received audio signal is processed to obtain the first audio information.

3. The method according to claim 1, characterized in that The vehicle monitoring method further includes: When the thermal runaway detection result of the battery indicates that the battery has triggered thermal runaway, an alarm message is output.

4. The method according to claim 1, characterized in that The controlling the vehicle to perform a target operation corresponding to the current state includes: When the current state is a driving state, obtaining second battery information and second audio information of the vehicle in the driving state; A thermal runaway detection result of the battery is determined based on the second battery information and the second audio information.

5. The method according to claim 1, characterized in that: The determining of the second target audio component based on whether the sentry mode of the vehicle is turned on includes: When the sentry mode is not enabled, all audio components are determined as the second target audio components.

6. The method according to claim 5, characterized in that The vehicle monitoring method further includes: When the target feature exists, obtaining third battery information and fourth audio information of the vehicle in the parking state; A thermal runaway detection result of the battery is determined based on the third battery information and the fourth audio information.

7. The method according to claim 1, characterized in that The method further comprises: Acquiring the target temperature and heat flux density multiple times; The vehicle monitoring method further includes: When the target temperatures and heat flux densities obtained multiple times do not satisfy the first preset condition, it is determined that there is no fire in the target scene.

8. The method according to any one of claims 1 to 7, characterized in that: The vehicle monitoring method further includes: When a fire occurs in the target scene, outputting an alarm message and performing a first operation and a second operation; Among them, the first operation is used to wake up the person based on the person's location information when it is detected that there is a person in the vehicle; the second operation is used to release the charging or discharging state of the vehicle by disconnecting the charging connection of the vehicle and closing the charging interface of the vehicle when it is detected that the vehicle is in a charging or discharging state.

9. A vehicle monitoring device, characterized in that: The vehicle monitoring device comprises: An acquisition module is configured to acquire first battery information and first audio information of the vehicle in a current state; the first audio information is obtained based on a first transmitted audio signal transmitted by a first target audio component; the first target audio component is within a preset range from an installation position of the battery; the current state includes a parking state or a driving state; the first target audio component includes a chassis audio module, or a chassis audio module and front and rear bumper audio modules; an obtaining module, configured to match the first battery information and the first audio information with the acquired target preset condition in the current state to obtain a thermal runaway detection result of the battery; The vehicle monitoring device further comprises: a control module, configured to control the vehicle to perform a target operation corresponding to the current state if a thermal runaway monitoring result of the battery indicates that the battery has not triggered thermal runaway; The control module includes: a first determining subunit, configured to determine a second target audio component based on whether a sentry mode of the vehicle is turned on when the current state is a parking state; a second determining subunit, configured to determine third audio information based on a second transmitted audio signal transmitted by the second target audio component; a third determining subunit, configured to determine the target temperature from mapping information of the audio information and the temperature based on the third audio information; a second determining unit, configured to determine that a fire exists in the target scene where the vehicle is located when the target temperature and the heat flux density meet a first preset condition; The fire in the target scene includes any one of the following: a fire triggered by the vehicle not caused by battery thermal runaway, a fire triggered by a vehicle within a preset distance from the vehicle, and a fire triggered by a target object within a preset distance from the vehicle, the target object not including the vehicle; The first determining subunit is further configured to: When the sentry mode is turned on, based on the image data collected by the image component in the vehicle, it is determined whether there is a target feature for identifying the fire; when the target feature exists, the second target audio component is determined based on the target position of the target feature; wherein, the target feature is located outside the vehicle, and the second target audio component includes the front and rear bumper audio modules, the chassis audio module and the door audio module.

10. A vehicle comprising a vehicle body, a first target audio component mounted on the vehicle body, a vehicle controller connected to the first target audio component, and a memory, wherein the memory stores a computer program executable on the vehicle controller, wherein: When the vehicle controller executes the program, the steps of the method according to any one of claims 1 to 8 are implemented.

Images