Closing roof and windows due to thunderstorm prediction with external microphones

Abstract

The invention relates to a system for a motor vehicle, comprising at least one microphone (1) and a computing unit (3) connected to the microphone (1), which is configured to receive signals from the microphone (1), and wherein the computing unit (3) is configured and designed to detect thunder of a storm by analyzing the signals from the microphone (1) and, upon detection of thunder, to carry out a predetermined reaction regarding the closing of a roof of the motor vehicle, wherein the reaction comprises a warning of the storm to a user and / or an automatic closing of the roof.

Description

[0001] The invention relates to a system for a motor vehicle for thunder detection.

[0002] The use of microphones on vehicles to detect dangerous driving situations and the occurrence of damage is known from the state of the art.

[0003] DE 10 2019 205 374 A1 relates to a method for detecting dangerous driving situations and the occurrence of damage in a vehicle, wherein noises from the vehicle's surroundings are continuously recorded by means of microphones attached externally to the vehicle and forwarded to a computing unit provided in the vehicle, wherein the noises are evaluated in the computing unit by means of software, wherein noises which are classified by the software as indications of a dangerous driving situation or the occurrence of damage and are assigned to a dangerous driving situation or the occurrence of damage are stored as a sound file in a memory provided in the vehicle and / or transmitted to an operator via a module for wireless communication together with an identifier uniquely assigned to the vehicle.

[0004] Furthermore, it is known in the prior art to use such microphones installed on the vehicle to monitor the vehicle in order to locate noise sources after their identification using time-of-flight analysis.

[0005] DE 10 2020 204 014 A1 relates to a method for the acoustic monitoring of a vehicle, in which noise signals are recorded, processed and subjected to an analysis in the context of which the recorded and processed noise signals are compared with known noise signals, wherein a plurality of microphones spatially distributed in and / or on the vehicle are used to record the noise signals, wherein the noise signals recorded with the aid of the plurality of microphones are subjected to a sound propagation time analysis in the context of the analysis and an associated noise source is localized on the basis of sound propagation time differences.

[0006] DE 20 2018 002 864 U1 concerns a rain sensor for convertible cars, whereby the convertible top is automatically closed when it starts to rain.

[0007] The article "Cars learn to hear. Locating signal sources, recognizing ringing and shouting. In c't Magazine 2023 Issue 28. Arne Grävemeyer." also describes how vehicles can be equipped with audio sensors, and how their sensor signals can be evaluated.

[0008] A convertible is a passenger car that can be driven with or without a roof over the interior. Typical methods for retracting and storing the roof vary depending on the decade of development and production and the manufacturer. During rainfall, an open roof can quickly cause damage to the vehicle interior due to moisture penetrating through the open convertible roof or from the sides of the window areas. It is therefore important to close the roof of a convertible before it starts to rain. However, due to the driver's own speed and the speed and intensity of rain during thunderstorms, this is often done too late, and a sudden rain shower can carry moisture into the vehicle's interior.

[0009] Sensors that detect rain are of limited help in solving this problem, as the rain must already be present to receive a corresponding sensor signal and be able to react to it. However, since it typically takes some time to close a convertible roof, significant water ingress into the vehicle interior can be expected with such a solution.

[0010] The object of the invention is to protect the interior of a motor vehicle, in particular a convertible vehicle, from moisture ingress during thunderstorms.

[0011] The invention is based on the features of the independent claims. Advantageous developments and refinements are the subject of the dependent claims.

[0012] A first aspect of the invention relates to a system for a motor vehicle, comprising at least one microphone and a computing unit connected to the microphone, which is configured to receive signals from the microphone, and wherein the computing unit is configured and designed to detect thunder of a thunderstorm by analyzing the signals from the microphone and, upon detection of thunder, to carry out a predetermined reaction regarding the closing of a roof of the motor vehicle, wherein the reaction comprises a warning of the thunderstorm to a user and / or an automatic closing of the roof.

[0013] During the formation of a thunderstorm, moisture rises within the thundercloud, condenses, and this condensation, in turn, contributes to the rising air within the thundercloud by releasing heat. An electrical charge separation, caused by high wind speeds, suddenly discharges in the form of an electric flash when a certain electrical potential is exceeded. This, in turn, generates thunder. However, the moisture rising within a thundercloud after condensation eventually falls to the ground in the form of rain or hail. Detecting thunder therefore advantageously allows for early preparation for rain or hailstorms.

[0014] Modern motor vehicles often use external microphones anyway, typically at least at all four corners of the vehicle, for example, to detect emergency vehicles using their horns. Advantageously, therefore, no additional microphones are required on the vehicle to implement the system according to the invention. The already present signal from the microphones can be used to detect thunder sounds using a processing unit, thus providing early warning of the possible onset of rain or hail.

[0015] In particular, by means of pattern recognition, executing a machine learning model such as an artificial neural network for detecting sounds, or similar methods known in the art, it is possible for a computing unit to detect thunder from a thunderstorm even when a multitude of other sounds predominate, for example from road traffic, sounds generated by the user's own motor vehicle, and the like.

[0016] In principle, a single microphone configured to capture ambient noise around the vehicle is sufficient to detect thunder. Depending on the number and arrangement of the microphones, however, the direction of the thunder relative to the vehicle can also be determined through triangulation. The sound pressure level of the thunder provides clues about the distance and intensity of the storm, which in turn can be used to determine whether the storm is critical for the vehicle and whether closing the vehicle's roof seems appropriate.

[0017] Machine learning methods can also be used to create models that infer the distance of the thunder from the sound pattern itself. For example, a distant flash of lightning and its thunder will have a different sound pattern until it reaches the receiver than a nearby flash. Reflection of the sound waves often creates reverberation, creating the impression of a drawn-out thunderclap, whereas in close proximity to a flash of lightning, a more bang-like sound is perceived.

[0018] The frequency of consecutive thunderstorms can also indicate the intensity of a thunderstorm, or even suggest the presence of multiple storm cells. In summary, the volume and / or frequency of thunderstorms, and / or the direction and distance of thunder from the computing unit can be used to determine the relevance of the thunderstorms to the vehicle. Furthermore, the temporal sequence of thunderstorms can be tracked, for example, to determine the approach of the thunderstorm to the vehicle.

[0019] Depending on the assessed intensity and relevance for the vehicle, i.e., criticality, the intended response can be gradually adjusted. For example, if only weak thunder is detected, likely originating at a considerable distance from the vehicle, optionally also occurring with a low thunder frequency, and optionally taking into account a determined probability of rain, the response can be empty or a warning can be issued to a vehicle user that thunder has been detected and closing the roof should be considered.

[0020] If the relevance is higher, for example, if the probability of rain is higher, the computing unit can initiate automatic closing of the roof, preferably with a time delay after a warning is issued, giving the vehicle user the option of suppressing the planned closing of the roof if they do not wish to close it. If the roof closes automatically, the respective side windows will also be closed to protect the interior from moisture. In a further escalation level, for example, if the probability of rain is very high, the computing unit can automatically initiate immediate closing of the roof.

[0021] This can advantageously prevent water damage inside the vehicle, as the presence of a thunderstorm is detected early, and the possibility of an accompanying rain or hailstorm is known in advance. The processing unit checks whether the roof is already closed and only reacts if it is open. However, it can also issue a warning when the roof is closed to alert the user that opening the roof entails corresponding risks.

[0022] According to an advantageous embodiment, the computing unit is designed to determine the criticality of the storm from the sound level of the thunder and to adapt the response based on the determined criticality. The response can be adjusted accordingly to higher escalation levels if an increased criticality is detected. In particular, the issuing of a warning can be converted into a combination of a warning and automatic closing of the roof.

[0023] According to a further advantageous embodiment, the system further comprises a plurality of microphones connected to the computing unit, wherein the computing unit is designed to determine the direction of the thunder relative to the motor vehicle by means of triangulation. The triangulation compares the time delay of the reception of a sound signal at several spatially separated microphones in order to thus be able to determine the direction of the sound source, in this case, the thunder.

[0024] According to a further advantageous embodiment, the computing unit is designed to determine a wind direction and, based on the wind direction in relation to the determined direction of the thunder, to determine the criticality of the thunderstorm. The criticality is then used to adapt the response. The generally prevailing wind direction can be used to determine whether the thunderstorm will move away from the vehicle, tangentially to it, or toward the vehicle. Furthermore, the vehicle's direction of travel must be taken into account to determine whether the vehicle is moving away from the thunderstorm or not.

[0025] According to a further advantageous embodiment, the system further comprises a light sensor which is connected to the computing unit, wherein the computing unit is designed to detect a flash of lightning from a thunderstorm using a signal from the light sensor and to determine a distance of the thunderstorm depending on a time difference between a detected flash of lightning and a subsequent thunder, and to adapt the reaction depending on the determined distance.

[0026] According to a further advantageous embodiment, the computing unit is designed to determine a current rain probability and to adapt the predetermined response based on the rain probability upon detection of thunder. The rain probability can be calculated from the detected thunder itself or, for example, obtained from a central server via an internet connection to obtain the current weather forecast. In the latter case, this information can be fused with the criticality from the detection of thunder in order to derive a correspondingly appropriate response.

[0027] According to a further advantageous embodiment, the predetermined reaction is one of the following depending on the probability of rain: issuing a warning message to a user of the motor vehicle; automatic closing of the roof of the motor vehicle after a predetermined period of time with the option of aborting by a user; immediate automatic closing of the roof of the motor vehicle.

[0028] According to a further advantageous embodiment, the computing unit is designed to adapt the predetermined reaction depending on a frequency of successive thunders.

[0029] According to a further advantageous embodiment, the computing unit is designed to use a machine learning model to infer a distance of the thunder relative to the vehicle from the sound pattern of a detected thunder and to adapt the reaction depending on the determined distance.

[0030] According to a further advantageous embodiment, the computing unit is designed to transmit the warning to a mobile terminal of a user of the vehicle in the event of a reaction intended as a warning.

[0031] Further advantages, features and details emerge from the following description, in which - if necessary with reference to the drawing - at least one embodiment is described in detail.

[0032] It shows: Fig. 1: A vehicle with a thunderstorm warning system according to an embodiment of the invention.

[0033] The representations in the figure are schematic and not to scale.

[0034] Fig.1 shows a system for a motor vehicle for warning of possible thunderstorms or for automatically closing the roof of the vehicle. Several external microphones 1 are arranged on the vehicle to detect sounds from the vehicle's surroundings and transmit corresponding information about the sounds in the form of a signal to a computing unit 3 of the vehicle. The computing unit 3 continuously analyzes the received sounds to determine whether the sounds represent thunder from a thunderstorm. In doing so, the computing unit 3 also determines the frequency of successive thunderstorms and, if possible through triangulation, the direction of each thunderstorm relative to the vehicle.The distance of thunder can be determined by detecting lightning strikes and the relative time offset between a flash of lightning and the following thunder. However, a machine learning model can also be used to infer its distance from the sound of thunder. Computing unit 3 determines the probability of rain from the analysis of the thunder sounds and selects a reaction based on this. Basic reactions are stored so that, when certain conditions are met, a corresponding reaction can be selected in a logical circuit by computing unit 3. If thunder is detected at a distance from the vehicle, a warning is simply issued in the vehicle if the vehicle is moving; if the vehicle is stationary, the warning is transmitted to a mobile device of a vehicle user.In cases of higher relevance, such as multiple thunderstorms and a detected close proximity of one or more thunderstorms to the vehicle, the roof of the vehicle is also automatically closed. In cases of medium relevance, however, this is done with an automatic time delay from a previous warning. Preferably, immediate closure of the roof is only initiated in cases of high relevance and thus a high determined probability of rain. In the case of automatic roof closure, whether immediate or delayed, the user has the option of manually overriding the automatic closure at any time if they do not wish the roof to close.

[0035] Although the invention has been illustrated and explained in detail by preferred embodiments, the invention is not limited by the disclosed examples, and other variations may be derived therefrom by those skilled in the art without departing from the scope of the invention. It is therefore clear that a multitude of variations exist. It is also clear that exemplary embodiments are truly only examples and should not be construed as limiting the scope, possible applications, or configuration of the invention in any way.Rather, the preceding description and the description of the figures enable the person skilled in the art to implement the exemplary embodiments in concrete terms, whereby the person skilled in the art, with knowledge of the disclosed inventive concept, can make various changes, for example with regard to the function or the arrangement of individual elements mentioned in an exemplary embodiment, without departing from the scope of protection defined by the claims and their legal equivalents, such as further explanations in the description.

Claims

[1] System for a motor vehicle, comprising at least one microphone (1) and a computing unit (3) connected to the microphone (1), which is configured to receive signals from the microphone (1), and wherein the computing unit (3) is configured and designed to detect thunder from a storm by analyzing the signals from the microphone (1) and, upon detection of thunder, to execute a predetermined response regarding the closing of the roof of the motor vehicle, wherein the response includes a warning of the storm to a user and / or an automatic closing of the roof. [2] System according to claim 1, wherein the computing unit (3) is configured to determine the criticality of the thunderstorm from the sound level of the thunder and to adapt the response from the determined criticality. [3] System according to one of the preceding claims, comprising a plurality of microphones (1) connected to the computing unit (3), wherein the computing unit (3) is configured to determine a direction of the thunder relative to the motor vehicle by means of triangulation. [4] System according to claim 3, wherein the computing unit (3) is configured to determine a wind direction and to determine a criticality of the thunderstorm from the wind direction in relation to the determined direction of the thunder, and to adapt the response from the determined criticality. [5] System according to one of the preceding claims, comprising a light sensor connected to the computing unit (3), wherein the computing unit (3) is configured to detect a lightning flash of a thunderstorm using a signal from the light sensor and to determine a distance of the thunderstorm depending on a time difference between a detected lightning flash and a subsequent thunder, and to adjust the reaction depending on the determined distance. [6] System according to one of the preceding claims, wherein the computing unit (3) is configured to determine a current probability of rain and to adapt the predetermined reaction depending on the probability of rain upon detection of thunder. [7] System according to claim 6, wherein the predetermined reaction, depending on the probability of rain, is one of the following: issuing a warning message to a user of the motor vehicle; automatic closing of the roof of the motor vehicle after a predetermined period of time with the possibility of cancellation by a user; immediate automatic closing of the roof of the motor vehicle. [8] System according to one of the preceding claims, wherein the computing unit (3) is configured to adapt the predetermined response depending on a frequency of successive thunder. [9] System according to one of the preceding claims, wherein the computing unit (3) is configured to infer the distance of the thunder relative to the vehicle from the sound profile of a detected thunder by applying a machine learning model and to adjust the response depending on the determined distance. [10] System according to one of the preceding claims, wherein the computing unit (3) is configured to transmit the warning to a mobile terminal of a user of the vehicle in the event of a reaction intended as a warning.

Images