Event detection device for a motor vehicle, and method for detecting at least one specific event
The event detection device uses sound characteristics and FD-SOI technology to reliably identify and classify events in motor vehicles, addressing the limitations of existing systems by enabling efficient and permanent monitoring with reduced energy consumption.
Patent Information
- Application Number
- PCT/EP2024/063166
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-23
- Filing Date
- 2024-05-14
- Publication Date
- 2024-11-28
AI Technical Summary
Existing motor vehicle monitoring systems face challenges in reliably detecting specific events, such as theft attempts, while minimizing energy consumption, leading to frequent false alarms and limited monitoring capabilities when the vehicle is inactive.
An event detection device that utilizes sound-generating events to identify specific occurrences by comparing sound characteristics with reference characteristics, employing FD-SOI semiconductor technology for energy-efficient operation and enabling permanent monitoring, with modes for reduced power consumption and advanced signal processing.
The solution provides reliable and differentiated detection of various events, reduces false alarms, and allows for permanent monitoring of motor vehicles, even when inactive, by leveraging sound signals and advanced semiconductor technology, ensuring efficient energy use and effective event classification.
Smart Images

Figure EP2024063166_28112024_PF_FP_ABST
Abstract
Description
[0001] Event detection device for a motor vehicle and method for detecting at least one specific event
[0002] DESCRIPTION:
[0003] The project leading to this application has received funding from the ECSEL Joint Undertaking (JU) under grant agreement No. 783127. The JU receives support from the European Union's Horizon 2020 research and innovation programme, as well as from France, Germany, Austria, Portugal, Greece, Spain, and Poland.
[0004] The invention relates to an event detection device for a motor vehicle, wherein the event detection device is designed to detect at least one specific event in an inactive state of the motor vehicle. Furthermore, the invention also relates to a method for detecting an event.
[0005] An alarm system, for example, can be considered an event detection device designed to detect at least one specific event when a motor vehicle is inactive. Such alarm systems are typically used to prevent a possible theft of the motor vehicle. Various vehicle sensors can be used to detect such a possible theft attempt, for example, door contact switches to detect the opening of the doors when the motor vehicle is locked. Inclinometers or position sensors of the motor vehicle can also be used to detect changes in the vehicle's position.
[0006] In principle, numerous different sensors, such as cameras, ultrasonic sensors or similar, are known from the state of the art, which would in principle enable comprehensive monitoring of a motor vehicle. However, the energy consumption of such systems is particularly problematic when monitoring a motor vehicle when it is in an inactive state. To prevent the 12-volt battery from being over-discharged when the vehicle is inactive and, for example, parked, the vehicle monitoring mechanisms used to date have been limited to relatively basic monitoring of the vehicle, as described above in connection with the alarm system. For example, previous systems cannot reliably distinguish between an actual theft attempt of the vehicle and situations in which there is no theft attempt at all. This leads to frequent false alarms.In addition, it would be desirable to be able to not only detect a theft attempt when the vehicle is inactive, but also to monitor it for the possible occurrence of other events.
[0007] The object of the present invention is therefore to provide an event detection device for a motor vehicle and a method that enable more reliable and differentiated detection of a specific event. Furthermore, advantageous developments of the invention aim to provide such monitoring, if possible, as a permanent monitoring option for the motor vehicle.
[0008] This object is achieved by an event detection device and a method having the features according to the respective independent patent claims. Advantageous embodiments of the invention are the subject of the dependent patent claims, the description, and the figures.
[0009] An event detection device according to the invention for a motor vehicle is designed to detect at least one specific event when the motor vehicle is inactive. The event detection device is designed to detect a sound-generating event as the event, to record the sound generated by the event as a sound signal, to compare a sound characteristic derived from the recorded sound signal with at least one reference characteristic assigned to the event, and to detect the specific event depending on the result of the comparison. The invention is based on the recognition that there are numerous different events that generate a characteristic sound signal upon their occurrence. This characteristic sound signal can be used accordingly to identify such an event and to detect it accordingly.This advantageously makes it possible not only to detect a specific event, but also, and in particular, to detect numerous different events and differentiate them from one another. Furthermore, even when considering only a single such specific event, it can be detected much more reliably, and false triggering or false detections can be avoided more effectively. Furthermore, the detection of an event based on the sound generated by the event enables particularly energy-efficient detection of such an event, as will be explained in more detail later. This energy-saving design option, in turn, makes it possible to provide continuous monitoring of the motor vehicle by the event detection device.
[0010] The fact that the event detection device is designed to detect such a specific event when the motor vehicle is inactive does not imply that the detection of such events is limited to the inactive state of the motor vehicle. In particular, the event detection device can also be designed to detect such a specific event when the motor vehicle is inactive. However, such a detection option is particularly advantageous when the motor vehicle is inactive, when there is generally no user or driver of the motor vehicle in the vicinity of the motor vehicle, since events occurring in such a situation cannot be directly perceived by the driver or user themselves, who are not even present.
[0011] The sound generated by such a specific event does not necessarily have to be in the audible frequency range, although this may be the case. Furthermore, sound should be understood to include both sound transmitted through air or a gaseous medium and structure-borne sound, i.e., sound transmitted through a solid body. In other words, the event detectable by the event detection device can also be an event that generates structure-borne sound, which is transmitted, for example, through the vehicle body. This advantageously also allows events that generate vibrations, shock signals, or similar phenomena to be detected.
[0012] The event detection device is also designed, in particular, to derive or determine the sound characteristic from the detected sound signal in order to then compare it with the at least one reference characteristic. At least one assigned reference characteristic is specified for the specific event. This can be stored, for example, in a memory of the event detection device. Such a reference characteristic, as well as the derived sound characteristic, can be, for example, a frequency spectrum, as will be explained in more detail later. By comparing the derived sound characteristic with the reference characteristic, the event detection device can determine whether a sufficiently high level of similarity or agreement exists. This can be established, for example, by means of a predetermined limit value for the similarity or agreement.If this is the case, the event can be considered detected. However, the detection of the event can still depend on further criteria. For example, a subsequent plausibility check can also take place. It is also conceivable that several different assigned reference characteristics are specified for a specific event. This is particularly advantageous for events that can generate different sound signals. To give an example, the event to be detected could be hail. If hail hits the motor vehicle, this generates sound, particularly structure-borne sound. However, this generated sound signal can vary depending on the situation and depends, for example, on the intensity of the hail, the size of the hailstones, the surface area of the motor vehicle that is exposed to the hail, and so on.For the "hail" event, various reference characteristics can be stored that take these different situations into account. This allows the "hail" event to be detected more clearly and reliably. Accordingly, the sound characteristic derived from the recorded sound signal can also be compared with several reference characteristics assigned to the same event, and the event can be detected depending on the result of the comparison. Furthermore, the assigned reference characteristic does not necessarily have to be a fixed, stored reference characteristic, such as a fixed frequency spectrum; instead, the event detection device can, for example, also be based on a learning process for identifying the event. This also enables adaptation or modification of the assigned reference characteristic during the learning process.
[0013] In a further very advantageous embodiment of the invention, the event detection device has at least one FD-SOI (fully depleted silicon on insulator) semiconductor component, in particular as part of an evaluation device of the event detection device, which comprises, for example, an integrated circuit with an FD-SOI substrate.
[0014] FD-SOI is a process technology in which a thin silicon layer, which in the case of a transistor as a semiconductor component, for example, forms the channel of the transistor, is separated from the underlying silicon substrate by an equally thin insulating layer. This technology prevents the flow of electrons from the channel into the substrate and therefore enables significantly more energy-efficient operation of the evaluation device or the event detection device itself. In principle, any semiconductor components can be manufactured using this FD-SOI technology. In particular, not only individual discrete semiconductor components, such as transistors, can be based on this FD-SOI technology, but also, for example, the chip of the evaluation unit, which provides the integrated circuit, can be provided as an FD-SOI chip.If the evaluation device is designed as an integrated circuit, for example, or has such an integrated circuit, this integrated circuit can therefore comprise an FD-SOI substrate. However, even if the evaluation device is constructed from direct electronic components, e.g. transistors, these can be manufactured using FD-SOI technology. This FD-SOI technology thus advantageously enables extremely energy-efficient operation of the event detection device. This advantageously enables the continuous use of the event detection device, even when the motor vehicle is inactive. In particular, this can provide permanent monitoring of the motor vehicle, regardless of the current operating state of the motor vehicle. For example, the event detection device can, e.g.Unless deactivated, for example, by a user or driver, it must be permanently active—that is, 24 hours a day, 7 days a week, all year round, and for several years. This also allows for advantageous application possibilities for this event detection device, even independent of the motor vehicle's drive type. This can be, in particular, a combustion engine-powered vehicle, a hybrid vehicle, or an electric vehicle.
[0015] In a further very advantageous embodiment of the invention, the event detection device has a sleep mode and an active mode, wherein the event detection device is designed to detect sound signals in sleep mode and to classify them as relevant or irrelevant according to at least one specific relevance criterion, and to switch to active mode if a sound signal is classified as relevant, in particular wherein power consumption by the event detection device is lower in sleep mode than in active mode. This is particularly advantageous because in sleep mode, in which significantly less power is consumed, a certain amount of preprocessing and preselection of received sound signals can already take place. A more detailed analysis of a detected sound signal only takes place if it has previously been classified or classified as possibly relevant or as relevant in sleep mode.More energy-intensive computing operations that can occur in active mode can thus advantageously be avoided in sleep mode. This allows the power consumption of the event detection device to be reduced even further. This is particularly advantageous because a motor vehicle is typically constantly exposed to sound-generating environmental influences. However, most of these environmental influences are not associated with any event to be detected and are therefore irrelevant. Such irrelevant sound signals can thus be filtered out from the outset in sleep mode with extremely low energy consumption. This allows the energy efficiency of the event detection device to be further increased.
[0016] In a further advantageous embodiment of the invention, the event detection device in active mode is designed to generate a frequency spectrum of the sound signal classified as relevant, in particular by means of FFT (Fast Fourier Transformation) of the sound signal, and to compare the generated frequency spectrum, which represents the sound characteristic derived from the detected sound signal, with the reference characteristic provided as a reference frequency spectrum. A frequency spectrum indicates the frequencies contained in the sound signal with their associated amplitudes and phases. Observing a frequency spectrum to identify and detect specific events is particularly advantageous because different events can be detected and identified particularly clearly and thus particularly reliably based on their frequency spectra.This allows for easy differentiation between numerous different events. Furthermore, it also allows for a simple software expansion of the event detection device's functionality. For example, the event detection device's functionality can be expanded to include the detection capability for additional new events simply by supplying the event detection device with corresponding reference characteristics in the form of corresponding reference frequency spectra for such additional events via software and / or storing them in the event detection device's memory. It would also be conceivable for a user to be able to select, for example, from a database which events should be detected by the event detection device. These events can then be loaded into the event detection device in the form of their assigned reference characteristics.
[0017] Such a frequency analysis is preferably performed only in the active mode of the event detection device. This enables particularly power-efficient operation of the event detection device, which can be limited to the execution of a few basic functions.
[0018] In a further highly advantageous embodiment of the invention, the event detection device is designed to subject the sound signal detected in idle mode to pre-filtering, in particular high-pass and / or low-pass and / or band-pass filtering. This has the significant advantage that only the frequencies of interest are considered in advance and, if necessary, examined in the subsequent analysis in active mode. The type of pre-filtering used can also be selected, for example, depending on the events to be detected.The aforementioned predetermined relevance criterion, based on which sound signals detected in idle mode are classified as relevant or irrelevant, can, for example, include that the detected sound signal has a certain minimum signal level, particularly in the unfiltered state and / or related to a specific frequency range of interest to which the received signal can be limited by frequency filtering. Therefore, such a relevance criterion can also determine that the pre-filtered, e.g., bandpass-filtered, resulting sound signal also has a certain minimum signal level. Such pre-filtering in the form of frequency filtering can be accomplished electrically very easily and with very little energy consumption. This allows numerous irrelevant sound signals to be filtered out right from the start.Only once a sound signal has been classified as relevant can the event detection device be awakened to perform more complex evaluation and processing of the signal. The preliminary processing and classification of the signal as relevant or irrelevant, as well as the wake-up function, can be performed using a very simple electrical circuit as part of the evaluation device and therefore consumes little energy.
[0019] In general, background noise or interference can also be initially filtered out from a signal to be analyzed. Suitable background noise reference spectra can also be stored for such background noise or interference, which is typical, for example, for a vehicle operating at a ferry. This allows a more reliable distinction to be made between the wanted signal and the interference signal. This can also be done as part of the pre-filtering and pre-selection performed in the detection device's idle mode and / or in active mode as part of a more in-depth analysis.
[0020] According to a further advantageous embodiment of the invention, the event detection device has a sound sensor that is designed to detect sound transmitted via air and / or that is designed to detect structure-borne sound. A sound sensor that is designed to detect structure-borne sound can be, for example, an inertial sensor. It is also possible for the event detection device to have several different sound sensors or several similar sound sensors, which can be arranged, for example, at different positions on the motor vehicle. In addition, the event detection device, as already described above, has an evaluation device. Such a sound sensor and the evaluation device can form a structural unit. The event detection device can then accordingly comprise several such sensor units, each with a sound sensor and an associated evaluation device.Alternatively, multiple sound sensors can be provided, which are assigned to a common evaluation unit of the event detection device. The sound sensors can then be designed as separate structural units, in particular separate from each other and separate from the evaluation unit.
[0021] If the sound sensor is designed to detect airborne sound, for example as a microphone, it is possible to use this sensor simultaneously to detect structure-borne sound. Certain events generate a characteristic noise, i.e. a sound signal transmitted through air, which can therefore advantageously be used when detected via a microphone to identify such an event very reliably. Sensors for detecting airborne sound, such as microphones, generally have a relatively strong directivity with regard to their reception characteristics. Therefore, when using such sound sensors, such as microphones, it is advantageous to provide several such microphones that are placed and aligned at different points on the vehicle, for example depending on the event to be detected.Structure-borne sound, on the other hand, can be reliably detected even very far from the actual sound source using a structure-borne sound sensor, such as an inertial sensor. Many events, for example environmental events such as hail, generate a strong, distinct structure-borne sound signal, which can therefore be advantageously used to detect and identify such an event. Such an inertial sensor can, for example, be designed as an acceleration sensor and / or yaw rate sensor, or it can comprise several such similar and / or different sensors. If the inertial sensor, for example, comprises an acceleration sensor or is designed as such, there are various other design options for this. For example, it can be designed as a piezoelectric acceleration sensor or as a microsystem or as a micro-electro-mechanical system.The measuring principle can be based on capacitance measurement. The electronics for evaluating the usually very small capacitance changes can then be housed on the same integrated circuit as the sensor itself. In this example, the sound sensor and the evaluation device then form a single structural unit.
[0022] Such an inertial sensor can also be installed anywhere in or on the vehicle, for example, on the body. Examples include a vehicle door, on or in the vehicle roof, on the bumper, or even in the interior of the vehicle. Here, too, it is possible to install multiple such inertial sensors.
[0023] In a further very advantageous embodiment of the invention, at least one associated reference characteristic is predefined for each of several different, predetermined events to be detected by the event detection device. The event detection device is designed to determine, by comparing the derived sound characteristic of the detected sound signal with the plurality of reference characteristics, from which of the plurality of events the sound detected as the sound signal originates. Based on the detected sound signal and its analysis, which can be carried out as described above, not only can a specific event be detected, but it can also be classified as to which of several possible, predetermined events it is.Furthermore, for each event to be detected by the event detection device, not only one assigned reference characteristic can be specified, but possibly also several different reference characteristics, as already described above. The event detection device can therefore, for example, gradually compare the sound characteristic derived from the detected sound signal with the multiple reference characteristics and thus easily determine which of the multiple possible events is involved. In particular, this event can be determined by the correspondence between the reference characteristic assigned to this event and the derived sound characteristic being maximum and / or exceeding a predetermined threshold.
[0024] This advantageously makes it possible to detect not just one event, but many different events, and even differentiate between them. This also advantageously makes it possible, for example, to provide a dedicated function for each event that is triggered upon detection of the respective event. In other words, the event detection device can trigger different reactions to different events.
[0025] It is a further very advantageous embodiment of the invention if the event represents at least one of the following:
[0026] - A weather event, for example hail and / or storm or a roof avalanche and / or rain and / or storm damage;
[0027] - Vandalism to the motor vehicle, for example breaking or breaking a mirror, paint damage, for example due to scratching, puncturing of one or more tires, wheel theft or jacking up of the motor vehicle, breaking windows or throwing objects at the car, trailer theft,
[0028] - an accident, in particular contact of the motor vehicle with a person and / or an object external to the motor vehicle and / or damage to the motor vehicle, for example a parking bump caused by another vehicle parking in the vehicle, a shopping trolley bump, a trailer rolling against the motor vehicle, a collision with another road user, for example with a cyclist who rides up to the parked motor vehicle,
[0029] - a faulty condition of a component internal to the vehicle, for example a gearbox, an electric motor, an internal combustion engine, one or more generators, pumps, etc.,
[0030] - a living being located in the motor vehicle, in particular one that is enclosed, for example a child or a dog still located in the motor vehicle, in particular in a locked motor vehicle, a voice command, in particular a voice-based initialization of a voice input for the voice-based operation of a vehicle component of the motor vehicle.
[0031] This makes it particularly advantageous to provide monitoring in numerous different situations, detecting numerous different events and differentiating them from one another, i.e. classifying them. It is particularly advantageous to be able to detect environmental influences such as weather events. Hail or other weather events in particular can cause very significant damage to a vehicle. Early detection of the onset of such a weather event is particularly advantageous, for example, in order to initiate appropriate measures well in advance and thus before (severe) damage to the vehicle occurs. This could include sending a warning message to the owner of the vehicle and / or driving autonomously into a garage or carport, or similar.Vandalism or other damage to the vehicle, such as shopping cart collisions or parking collisions caused by other vehicles, can also be reliably detected. In these cases, too, appropriate measures can be initiated, for example, the user or owner can be immediately informed, or environmental sensors, such as the vehicle's exterior cameras, can be activated to record the accident, or similar. An alarm system can also be activated to, for example, scare off vandals. It is also advantageously possible to provide component monitoring of internal components and parts. This can be done not only when the vehicle is inactive, but also, and above all, when it is active.Certain fault conditions or defects in a transmission, the electric motor, or other components can also be advantageously detected based on acoustic or sound signals. This allows for early detection of faults or defects, and potentially significant damage to these components can be prevented through timely repair. The event detection system can also advantageously implement occupant detection, especially while the vehicle is parked and locked. Children or dogs left behind in the vehicle can thus also be reliably detected, and appropriate action, such as a warning, can be initiated.
[0032] For example, it can also be detected when the motor vehicle is being washed, e.g. by hand. This can also be detected based on the typical sound characteristics. The event detection device can then take measures such as closing any open windows of the vehicle, automatically adjusting the mirrors, or similar. The event detection device can also detect magic commands, i.e. voice commands, in particular key voice commands. These are primarily commands or keywords or key phrases for initializing a voice input mode of the motor vehicle. Therefore, in the context of detecting such a voice command, it is not necessary for the event detection device itself to correctly understand and interpret the voice commands, which can trigger various functions on the motor vehicle.This primarily refers to the detection of an initialization command, which can also be easily recognized based on an associated reference characteristic, such as "Hello Car" or similar. Upon detection of such an initialization command, the event detection device can, for example, activate a voice assistance system present in the motor vehicle to capture further commands from a user and execute the associated functions. This advantageously also allows a user of the motor vehicle to use the voice assistance function even when the motor vehicle is inactive, in which such a voice assistance function is generally not available.For example, even when the vehicle is locked, the user or owner can use a voice command to open the trunk or easily change the windshield wiper blades. For example, a user near the vehicle can give the voice command "wiper blades up." The vehicle will then first check for the presence of a keyless key belonging to and assigned to the vehicle in the vicinity. If present, the vehicle will automatically move the wiper blades to the maintenance position. A similar procedure can be used with the trunk or a fuel cap, or the general operation of any vehicle component, using a suitable assigned voice command.The only difference is that a different voice command can be provided for opening the trunk and / or the fuel cap, or for operating another component. In all of these scenarios, it is not necessary for the owner or user of the vehicle to unlock or activate the vehicle beforehand. This means that, for example, voice inputs can also be used outside the vehicle to trigger certain functions.
[0033] Numerous other possible applications are conceivable, and not all of them can be listed here. For example, acoustic detection and identification of thermal runaway and outgassing in a battery cell of a high-voltage battery in an electric vehicle, detection of a fire in a neighboring vehicle, earthquake detection, for example, during a charging process for a motor vehicle's high-voltage battery, and so on.
[0034] In principle, the detectable events can be grouped into environmental events and internal events, whereby the environmental events have their origin in the environment of the vehicle, e.g. weather events, vandalism, accidents, earthquakes, etc. The detection of such environmental events is particularly advantageous, as they are often unpredictable and can cause great damage, so that monitoring, especially permanent monitoring, is very advantageous in this case.
[0035] In a further advantageous embodiment of the invention, the event detection device is designed to trigger at least one function associated with the event depending on the detection of the event, in particular depending on which event was detected. This is particularly advantageous because the ability to distinguish between different events allows for particularly good situational adaptation. Thus, no blanket reaction needs to be triggered upon the detection of such an event; instead, an event-specific reaction can be triggered. Examples of such reactions have already been mentioned above.In general, such a reaction can, for example, comprise notifying the driver or owner of the motor vehicle, for example by means of a push message in an app, in particular a motor vehicle app, on a mobile communication device of the driver, owner or user. Furthermore, as a reaction, an alarm system can be activated or triggered to issue an alarm, an e-call, i.e. an automatic emergency call, can be triggered, hazard lights can be triggered, etc. Furthermore, the vehicle can, under certain circumstances, also be moved autonomously as a reaction, for example by being reparked, in particular to avoid an accident, or by driving out of or into a garage.As a further reaction, for example, a charging process can be terminated and / or cameras and / or recording can be activated, a suggestion for a workshop visit or a workshop can be issued in an output device of the motor vehicle, in particular in the MMI (multimedia interface) of the motor vehicle, or even a suggestion for an authorized dealer, for example to repair detected paint damage or for a mirror repair or other detected damage, or a corresponding action for access and / or maintenance on the vehicle can be carried out by voice commands, for example the fuel filler flap can be opened, wiper blades can be moved to a certain position, the trunk can be opened, the exterior mirrors can be folded in, and so on.
[0036] Furthermore, the invention also relates to a motor vehicle with an event detection device according to the invention or one of its embodiments. The advantages mentioned for the event detection device according to the invention and its embodiments apply equally to the motor vehicle according to the invention.
[0037] The motor vehicle according to the invention is preferably designed as a motor vehicle, in particular as a passenger car or truck, or as a passenger bus or motorcycle.
[0038] Furthermore, the invention also relates to a method for detecting at least one specific event relating to a motor vehicle when the motor vehicle is inactive. A sound-generating event is detected as the event, wherein the sound generated by the event is recorded as a sound signal, a sound characteristic derived from the recorded sound signal is compared with at least one reference characteristic associated with the event, and the event is detected depending on the result of the comparison.
[0039] Here too, the advantages described for the event detection device according to the invention and its embodiments apply equally to the method according to the invention.
[0040] The invention also includes further developments of the method according to the invention that have features already described in connection with the further developments of the event detection device according to the invention. For this reason, the corresponding further developments of the method according to the invention are not described again here.
[0041] The invention also encompasses combinations of the features of the described embodiments. The invention therefore also encompasses implementations that each comprise a combination of the features of several of the described embodiments, unless the embodiments are described as mutually exclusive.
[0042] Exemplary embodiments of the invention are described below. Shown are:
[0043] Fig. 1 is a schematic representation of a motor vehicle with an event detection device according to an embodiment of the invention; and
[0044] Fig. 2 is a flowchart illustrating a method for detecting a specific event according to an embodiment of the invention.
[0045] Fig. 1 shows a schematic representation of a motor vehicle 10 with an event detection device 12 according to an exemplary embodiment of the invention. In this example, the event detection device 12 has a sound sensor 14, which in this example is designed as an inertial sensor 16, and an evaluation device 18 based on FD-SOI technology. This FD-SOI semiconductor technology is particularly advantageous for achieving "ultra-low power," i.e., extremely power-saving operation of the event detection device 12. This advantageously enables continuous operation of this event detection device 12, i.e., not only in the active state of the motor vehicle 10, but also in an inactive state ZI of the motor vehicle 10, as shown in this example.In other words, this makes it possible to provide a power loss-optimized inertial sensor in battery-operated continuous operation for the detection of specific events E1, E2, such as environmental events E1 or vandalism E2. The inertial sensor 16, or generally the entire event detection device 12, can thus advantageously be supplied with energy even in the inactive state ZI of the motor vehicle 10 by an energy storage device 20 of the motor vehicle, for example, a low-voltage battery, for example, a 12-volt battery of the motor vehicle 10. Nevertheless, due to the extremely energy-saving operation of the event detection device 12, there is no need to fear that the low-voltage battery 20, which is not recharged in the inactive state ZI of the motor vehicle 10, will be excessively discharged.Thus, the event detection device 12 can advantageously provide monitoring of the motor vehicle 10 around the clock.
[0046] A further very big advantage of the event detection device 12 is that it not only allows certain events E1, E2 to be detected, but that it also allows the type of event E1, E2 to be determined. Two different events E1, E2 are shown as examples in Fig. 1. Firstly, as an example of a first event E1, there is an environmental event E1, for example hail E1, which strikes the motor vehicle 10. The impact of the hailstones on the motor vehicle 10 causes a certain first sound signal S1, in this example in the form of structure-borne sound, which is transmitted via the body of the motor vehicle 10. This sound signal S1 can be detected accordingly by the inertial sensor 16 and forwarded to the evaluation device 18.This can derive a specific first sound characteristic C1 from the detected sound signal S1, in particular by means of Fourier transformation, in particular FFT, to generate a frequency spectrum. This generated frequency spectrum C1 can then be compared with reference characteristics R1, R2 stored in a memory 22 of the evaluation device 18. In this example, a first reference characteristic R1 is assigned to the first event E1, and a second reference characteristic R2 to a second event E2. These can also be frequency spectra that are characteristic of the respective events E1, E2. Several assigned reference characteristics R1, R2 can also be stored for each event E1, E2 to be detected.Furthermore, these do not have to be fixed spectra; rather, the evaluation device 18 can optionally also implement a learning method using an artificial neural network, so that the evaluation device 18 is designed, for example, in a learning phase, to automatically extract or derive such reference characteristics R1, R2 from detected sound signals S1 and to store and / or modify them as such references and to use them for the future detection of various events E1, E2. Variations occurring in newly detected events E1, E2 concerning such characteristics can then also be stored as a modification or adaptation of the reference characteristics R1, R2.
[0047] If there is a match when comparing the derived characteristic C1 with one of the stored reference characteristics R1, R2 or if the similarity with one of the stored spectra R1, R2 is sufficiently large, which can be determined, for example, by a threshold value, the corresponding event assigned to the reference characteristic R1, R2, in this example the environmental event E1, can be considered to have been detected.
[0048] As a further example, a second event E2 in the form of an accident or vandalism is shown here. If, for example, the exterior of the motor vehicle 10 is scratched, this also generates a corresponding second sound signal S2, in particular in this example again a structure-borne sound signal, which is detected by the inertial sensor 16. The evaluation device 18 in turn generates a derived second sound characteristic C2 from this detected sound signal S2, in particular again in the form of a frequency spectrum, and compares this frequency spectrum C2 with the stored reference spectra R1, R2. If there is sufficient agreement with one of the stored reference spectra R1, R2, the event assigned to the reference spectrum is considered to have been detected, such as the second event E2 in this example, namely the scratching of the paintwork of the motor vehicle 10.In this way, the evaluation device 18 can reliably detect various events E1, E2 and even differentiate and classify them according to their type. This also makes it possible to trigger corresponding reactions, in particular even event-specific reactions. For example, each event E1, E2, which is triggered by the
[0049] Event detection device 12 is detectable, that is to say to which, for example, at least one reference characteristic R1, R2 is stored, a reaction or function to be triggered can be assigned, which is then triggered accordingly upon detection of the event E1 or E2.
[0050] In order to further increase the energy efficiency of the event detection device 12, it is also provided that it can be operated in different modes. In particular, it can be in a sleep mode in which only a pre-filtering of received sound signals takes place by the evaluation device 18. This pre-filtering or pre-analysis can be kept relatively elementary and simple, so that it does not require a lot of energy. Only when a potential candidate for a possible event has been found on the basis of this pre-analysis can the evaluation device 18 or a main analysis unit of the evaluation device 18 be woken up or the evaluation device 18 can switch to its active analysis mode in which, for example, the corresponding spectra C1, C2 are then generated from the detected sound signals S1, S2 and a more in-depth comparison with the stored reference spectra R1, R2 takes place.This will now be explained in more detail using Fig. 2.
[0051] Fig. 2 shows a flowchart to illustrate a method for detecting specific sound-generating events E1, E2 according to an embodiment of the invention. The method starts in step S10, in which the event detection device 12 is in a first mode M1, which represents a power-saving sleep mode M1. In this first mode M1, the event detection device 12 detects sound events, in particular continuously, via the sound sensor 14, for example the inertial sensor 16. Not all of these sound events are relevant and can be assigned to an event to be detected. Accordingly, in this first mode M1, the event detection device 12 first checks in step S12 whether the detected sound signals are relevant sound signals or irrelevant sound signals. This pre-filtering can be carried out by simple electrical signal filtering.If these are irrelevant sound signals, the process goes to step S10, so the event detection device 12 remains in the first mode M1 and continues to detect sound signals from the environment 24 (cf. Fig. 1 ) of the motor vehicle 10. Only when a detected sound signal has been detected as possibly relevant in step S12 does the event detection device 12 switch in step S14 to a second mode M2, which represents an active analysis mode of the event detection device 12. In this second mode M2, the power consumption is on average higher than in the first mode M1. Due to the FD-SOI technology in which the evaluation device 18 is designed, the power consumption is still relatively low here. In this second mode M2, a sound characteristic, in this example the one shown in Fig.1 is generated in step S16, for example, using FFT. The generated sound characteristic C1 is then compared with the reference characteristics R1, R2 stored in memory 22 in step S18. A match with the first reference characteristic R1 is determined, or a sufficient match. Therefore, in step S20, the first event E1, which is characterized by the first reference characteristic R1, is now considered to have been detected. Subsequently, the event detection device 12 triggers a function F1 in step S22. This can represent a function F1 specifically assigned to the detected event E1.
[0052] Although not explicitly illustrated here, the comparison result in step S18 may also reveal that there is not a sufficiently strong match. In this case, the process does not proceed to step S20, but begins again from the beginning at step S10.
[0053] Overall, the examples demonstrate how the invention can provide a power loss-optimized inertial sensor and / or a microphone in battery-operated continuous operation for the detection of environmental events or other events. A vehicle can be very effectively electronically monitored by the driver or by sensors during active states such as charging or driving. However, if the driver is not in the vehicle or in the vicinity of the vehicle, the electronics, namely the event detection device 12, can take over this monitoring. To prevent the 12-volt battery or other energy storage device from being over-discharged in a parked vehicle, this electronics, in particular the event detection device 12 and its evaluation device 18, are designed to be very power-efficient.By monitoring the car body for characteristic vibrations or by acoustic monitoring, various signals can be advantageously detected. These signals can include, for example, vibrations caused by accidents, such as parking bumps, or environmental influences, such as hail or storms, or even acoustic signals, such as hail, tire theft, paint damage caused by deliberate scratching, and so on. This allows the user to have the parked car monitored 24 / 7, i.e., continuously, using the event detection device. For this purpose, the detected signals in the time domain, i.e., the measured acoustic signal or the mechanical shock signal, can be advantageously measured and characterized in a power-saving manner. This is achieved by pre-filtering for relevance and by using the previously described FD-SOI technology to provide the evaluation device.Subsequently, a transformation or conversion to the frequency domain can take place using FFT, followed by a comparison with characteristic spectra. Further vehicle functions can then be initiated. Using power-saving semiconductor technology, the signal can be detected even in vehicle states in which the vehicle or the 12-volt battery is not being charged, without increasing the vehicle's quiescent current consumption. This enables continuous monitoring, providing maximum safety for the user and enabling the user to implement many functions that would otherwise be unavailable due to excessive power consumption of the parked vehicle.Overall, a power-saving detection methodology can be provided, new semiconductor technologies can be used to achieve extremely power-saving operation, and many new user functions can be implemented with little additional effort or cost. The power-saving inertial sensor barely increases the idle power consumption of the parked vehicle. By using the inertial sensor as the first filter stage for power-saving event evaluation, additional vehicle functions can be activated as needed, for example, for specific actions or for further plausibility checks, thus opening up new functions for the user.
[0054] LIST OF REFERENCE SYMBOLS:
[0055] 10 motor vehicle
[0056] 12 Event detection device
[0057] 14 Sound sensor
[0058] 16 Inertial sensor
[0059] 18 Evaluation device
[0060] 20 energy storage units
[0061] 22 storage
[0062] 24 Surroundings
[0063] C1 first sound characteristic
[0064] C2 second sound characteristic
[0065] E1 first event
[0066] E2 second event
[0067] F1 function
[0068] M1 first mode
[0069] M2 second mode
[0070] R1 first reference characteristic
[0071] R2 second reference characteristic
[0072] 51 first sound signal
[0073] 52 second sound signal
[0074] ZI inactive state
[0075] S10 Step
[0076] S12 Step
[0077] S14 Step
[0078] S16 Step
[0079] S18 Step
[0080] S20 Step
[0081] S22 Step
Claims
CLAIMS: 1 . Event detection device (12) for a motor vehicle (10), wherein the event detection device (12) is designed to detect at least one specific event (E1, E2) in an inactive state (ZI) of the motor vehicle (10), characterized in that the event detection device (12) is designed to - to detect an event (E1, E2) generating sound (S1, S2) as the event (E1, E2), - to record the sound (S1, S2) generated by the event (E1, E2) as a sound signal (S1, S2), - to compare a sound characteristic (C1, C2) derived from the detected sound signal (S1, S2) with at least one reference characteristic (R1, R2) assigned to the event (E1, E2), and - to detect the event (E1, E2) depending on the result of the comparison.
2. Event detection device (12) according to claim 1, characterized in that the event detection device (12) has at least one FD-SOI semiconductor component, in particular as part of an evaluation device (18) which, for example, comprises an integrated circuit with an FD-SOI substrate.
3. Event detection device (12) according to one of the preceding claims, characterized in that the event detection device (12) has a sleep mode (M1) and an active mode (M2), wherein the event detection device (12) is designed to detect sound signals in the sleep mode (M1) and to classify them as relevant or not relevant according to at least one specific relevance criterion, and in the case of a classification of a sound signal (S1, S2) as relevant to switch to the active mode (M2), in particular wherein a power consumption by the event detection device (12) in the sleep mode (M1) is lower than in the active mode (M2).
4. Event detection device (12) according to one of the preceding Claims, characterized in that the event detection device (12) in the active mode (M2) is designed to generate a frequency spectrum (C1, C2) of the sound signal (S1, S2) classified as relevant, in particular by means of FFT of the sound signal (S1, S2), and to compare the generated frequency spectrum (C1, C2), which represents the sound characteristic (C1, C2) derived from the detected sound signal (S1, S2), with the reference characteristic (R1, R2) which is provided as a reference frequency spectrum (R1, R2).
5. Event detection device (12) according to one of the preceding claims, characterized in that the event detection device (12) is designed to subject the sound signal (S1, S2) detected in the idle mode (M1) to a pre-filtering, in particular a high-pass and / or low-pass and / or band-pass filtering, in the idle mode (M1).
6. Event detection device (12) according to one of the preceding claims, characterized in that the event detection device (12) has at least one sound sensor (14, 16) which is designed to detect sound transmitted via air (S1, S2), in particular a microphone, and / or which is designed to detect structure-borne sound, in particular an inertial sensor (16).
7. Event detection device (12) according to one of the preceding claims, characterized in that that for a plurality of different predetermined events (E1, E2) to be detected by the event detection device (12), at least one associated reference characteristic (R1, R2) is predetermined, wherein the event detection device (12) is designed to determine, by comparing the derived sound characteristic (C1, C2) with the plurality of reference characteristics (R1, R2), from which of the plurality of events (E1, E2) the sound (S1, S2) detected as the sound signal (S1, S2) originates.
8. Event detection device (12) according to one of the preceding claims, characterized in that the event (E1, E2) represents at least one of the following: A weather event (E); Vandalism (E2) on motor vehicles (10); An accident; A faulty condition (ZI) of a component internal to the vehicle; A living being located, in particular enclosed, in the motor vehicle (10); A voice command, in particular a voice-based initialization of a voice input for voice-based operation of a vehicle component of the motor vehicle (10); a thermal runaway and outgassing of a battery cell of a high-voltage battery; a fire in a neighboring vehicle; an earthquake.
9. Event detection device (12) according to one of the preceding claims, characterized in that the event detection device (12) is designed to, depending on the detection of the event (E1, E2), in particular in Depending on which event (E1, E2) was detected, at least one function (F1) assigned to the event (E1, E2) is to be triggered.
10. Method for detecting at least one specific event (E1, E2) relating to a motor vehicle (10) in an inactive state (ZI) of the Motor vehicle (10), characterized in that an event (E1, E2) generating sound (S1, S2) is detected as the event (E1, E2), wherein the sound (S1, S2) generated by the event (E1, E2) is detected as a sound signal (S1, S2), a signal generated from the detected sound signal (S1, S2) derived sound characteristic (C1, C2) is compared with at least one reference characteristic (R1, R2) assigned to the event (E1, E2) and the event (E1, E2) is detected depending on a result of the comparison.
Citation Information
Patent Citations
Automobile passenger space surveillance method for anti-theft alarm
DE19642607A1
Acoustic alarm system for motor vehicles using echo signals - generated by applying signal to internal passenger compartment with each subjected to spectral analysis and comparison with reference
DE4226543A1
Phase calibration using a neutralised amplifier with varactors
WO2023062291A1
