Method and system for evaluating an emergency in a vehicle
By using speakers and microphone equipment in the vehicle, acoustic testing and parameter comparison methods are solved, and the problem of untimely data acquisition and privacy protection in vehicle emergency assessment is achieved, and accurate emergency identification and response adjustment is achieved.
Patent Information
- Application Number
- CN202380074035.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-10-21
- Filing Date
- 2023-10-12
- Publication Date
- 2025-05-16
AI Technical Summary
In the prior art, when evaluating vehicle emergency situations, it is necessary to collect and transmit visual data in passenger compartments, which have problems with untimely data acquisition and privacy protection.
By setting up the speaker device and microphone device in the vehicle, an acoustic test signal is emitted, the acoustic parameters of the signal are detected, and compared with the predetermined acoustic parameters to identify an emergency.
It enables the assessment of vehicle emergency situations based on acoustic analysis alone, avoids dependence on vehicle images, ensures privacy protection, and accurately adjusts emergency responses.
Smart Images
Figure CN120019257A_ABST
Abstract
Description
Technical Field
[0001] The invention belongs to the technical field of identifying vehicle conditions, in particular identifying emergency situations.
[0002] In particular, it relates to a method and a system for assessing an emergency situation in a vehicle. Background Art
[0003] An eCall system (for "emergency Call") in a vehicle is a system that is able to establish communication with emergency services, either automatically or manually, when the vehicle is involved in an accident or incident. This communication with the emergency services can transmit location information and may also include details, for example, about whether the vehicle's airbags have been deployed. The communication is intended to determine the level of urgency of the vehicle and its occupants.
[0004] One way to assess the urgency is to assess the situation in the passenger compartment. If the driver or passengers are unresponsive, a solution may be to observe the situation in the passenger compartment, such as based on visual data of the passenger compartment.
[0005] However, this data is not always available. Furthermore, this analysis requires the collection of personal data that is sent to external devices, such as emergency centers. Therefore, privacy considerations must be taken into account. Summary of the invention
[0006] The present invention proposes to improve the assessment of critical situations when a vehicle is involved in an accident or incident.
[0007] According to one aspect of the invention, the invention relates to a method for assessing an emergency situation in a vehicle, the vehicle comprising a passenger compartment, a loudspeaker arrangement and a microphone arrangement, the method comprising the following steps:
[0008] - Produce sound from the speaker device in the passenger compartment,
[0009] - detecting a signal corresponding to an emitted sound received by a microphone device,
[0010] - determine the acoustic parameters of the detection signal, and
[0011] - comparing said acoustic parameters of the detection signal with predetermined acoustic parameters associated with a specific situation in order to identify an emergency situation.
[0012] Thanks to the invention, the method allows determining the emergency situation of a vehicle based solely on the acoustic analysis of the propagation signal. For example, there is no need to use an image of the vehicle. Furthermore, a comparison with predetermined acoustic parameters stored in the vehicle and corresponding to normal driving conditions allows an accurate determination of the degree of emergency. The degree of emergency can then adjust the emergency response.
[0013] Other beneficial features of electronic components are as follows:
[0014] - the vehicle comprises a module for eliminating echoes from the emitted sound propagating in the passenger compartment, said module being used to determine acoustic parameters of the detection signal;
[0015] - The sound emitted is an acoustic test signal;
[0016] - The acoustic test signal is formed by white noise;
[0017] - The acoustic test signal is formed by a sweep signal;
[0018] - The acoustic test signal is formed by a maximum length sequence signal;
[0019] - the method further comprises the step of transmitting to an emergency center an acoustic function based on the determined acoustic parameters regarding the identified situation;
[0020] - Acoustic parameters include the reverberation time of the received signal in the passenger compartment or the eigenfrequency of the received signal or the power of the detected signal;
[0021] - the method further comprises a preliminary step of storing predetermined acoustic parameters corresponding to normal driving conditions;
[0022] - the emitted sound is a presence signal configured to detect the presence of a vehicle occupant, the detection signal corresponding to a response signal associated with said occupant;
[0023] - the method further comprises the step of increasing the volume of the presence signal so that the response signal can be heard from outside the vehicle; and
[0024] - The comparing step comprises comparing the magnitude and phase of the response acoustic parameter with the magnitude and phase of a predetermined acoustic parameter at least at a predetermined frequency.
[0025] The invention also relates to a system for assessing an emergency situation in a vehicle, the vehicle comprising a passenger compartment, a control unit, a loudspeaker device and a microphone device, the device comprising:
[0026] - a speaker device configured to emit sound within the passenger compartment,
[0027] - a control unit configured to detect a signal corresponding to an emitted sound received by the microphone device,
[0028] The control unit is also configured to:
[0029] - determine the acoustic parameters of the detection signal, and
[0030] - comparing said acoustic parameters of the detection signal with predetermined acoustic parameters associated with a specific situation in order to identify an emergency situation.
[0031] The different features, variants and embodiments of the invention can be combined with one another in various combinations, as long as they do not contradict or exclude one another. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] The following description with reference to the accompanying drawings will make clear what the invention consists of and how it can be implemented. The invention is not limited to the embodiments shown in the accompanying drawings. Therefore, it should be understood that in the case where features mentioned in the claims are followed by reference numerals, the inclusion of these numerals is only to enhance the intelligibility of the claims and in no way to limit the scope of the claims.
[0033] In the attached picture:
[0034] - Figure 1 A vehicle is shown which is equipped with a system for assessing an emergency situation according to the invention,
[0035] - Figure 2 schematically represents an example of a system for assessing an emergency situation according to the present invention,
[0036] - Figure 3 An exemplary flow chart showing a method for assessing an emergency situation according to the present invention,
[0037] - Figure 4 an exemplary flow chart representing a preliminary method for evaluating predetermined acoustic parameters associated with a predetermined specific situation, and
[0038] - Figure 5 An exemplary graph comparing the magnitude of a response acoustic parameter and the magnitude of a predetermined acoustic parameter in accordance with the present invention is shown.
[0039] It should be noted that in these figures, structural and / or functional elements common to different embodiments may have the same reference numerals. DETAILED DESCRIPTION
[0040] Figure 1 A vehicle 1 embodying the invention is shown.
[0041] The vehicle 1 comprises a passenger compartment 5 which corresponds to a space defined in the vehicle 1 and is intended for seating a driver and passengers.
[0042] Typically, the vehicle 1 also includes windows, a dashboard, a steering wheel or an air conditioning system ( Figure 1 not shown).
[0043] like Figure 1As shown, the vehicle 1 includes a system 10 for assessing an emergency situation (hereinafter also referred to as “system 10 ”). Figure 2 An example of such a system 10 is shown.
[0044] The system 10 includes a control unit 12 , a speaker device 14 and a microphone device 16 .
[0045] The speaker device 14 includes at least one speaker. The speaker may be, for example, a speaker commonly used in a vehicle for playing music in the passenger compartment 5 and / or reproducing a voice of an incoming call.
[0046] The speaker is located in the passenger compartment 5. For example, it is located inside the door. Preferably, a plurality of speakers are located in the passenger compartment 5, for example, at the front and rear of the passenger compartment 5.
[0047] The speaker device 14 is configured to emit sound in the passenger compartment 5. Depending on the properties of the emitted sound (eg the volume of the emitted sound), the speaker device 14 may be configured to emit the sound such that the sound may also propagate outside the vehicle 1.
[0048] The microphone device 16 comprises at least one microphone. The microphone is located in the passenger compartment 5. It is located, for example, in the area of the dashboard of the vehicle 1 close to the steering wheel (so as to be close to the driver of the vehicle 1).
[0049] The microphone device 16 is configured to receive sounds propagating in the vehicle 1. It is also configured to receive sounds propagating in the vicinity of the vehicle 1 but outside the vehicle 1, in particular when a window is opened or broken.
[0050] like Figure 2 As shown, the system 10 further includes a control unit 12. The control unit 12 includes a processor 15, a memory 17, a communication unit 18 and a positioning unit 19.
[0051] The positioning unit 19 here comprises a GNSS (for “Global Navigation Satellite System”) sensor, such as a GPS (for “Global Positioning System”) sensor. The positioning unit 19 is configured to determine the position of the vehicle 1 while the vehicle 1 is moving.
[0052] In a variant, the positioning unit may be located in the vehicle but outside the system 10 .
[0053] The communication unit 18 is configured to establish communication, such as wireless communication, with a service outside the vehicle 1 .
[0054] As an example, the communication unit 18 is configured to communicate with emergency services via the eCall procedure as previously described.
[0055] The control unit 12, more specifically the processor 15 of the control unit 12, is configured to control different components in the vehicle 1, such as the communication unit 18, the microphone device 16 and the speaker device 14. The control unit 12 is also configured to receive and process data acquired by different sensors (e.g. from the positioning unit 19).
[0056] The control unit 12 also includes a memory 17 for storing data, such as predetermined acoustic parameters as described below.
[0057] The memory 17 of the control unit 12 also stores computer program code instructions suitable for performing the operations and functions of modules (eg, modules for echo cancellation, as described below) and units when the processor 15 executes the relevant program code instructions.
[0058] More specifically, the memory 17 of the control unit 12 stores a computer program comprising instructions, the execution of which enables the processor 15 of the control unit 12 to implement the method for assessing an emergency situation in the vehicle 1 as described below.
[0059] In the context of the present invention, it is estimated that the vehicle 1 is involved in an accident or incident. Therefore, the present invention aims to assess the emergency situation in which the vehicle 1 (and the driver and passengers) is in order to adjust the emergency response to be provided. As described in more detail below, the assessment of the emergency situation of the vehicle 1 here relies on an acoustic analysis of the signals propagating in the vehicle 1.
[0060] Figure 3 is an exemplary flow chart of a method for assessing an emergency situation implemented in the context of the previous description.
[0061] Prior to executing the method, a preliminary method is performed to determine predetermined acoustic parameters.
[0062] In this specification, "acoustic parameter" refers to a parameter that can characterize the propagation of an acoustic signal. For example, an acoustic parameter includes the amplitude or phase of a propagated acoustic signal. An acoustic parameter may also include the power of an acoustic signal or the eigenfrequency of an acoustic signal or the reverberation time of an acoustic signal during its propagation.
[0063] The preliminary method aims to determine predetermined acoustic parameters corresponding to signal propagation under predetermined specific conditions. These predetermined specific conditions correspond here to different situations of the vehicle 1 under normal driving conditions. The expression "normal driving conditions" here refers to situations in which the vehicle 1 has no accidents or incidents.
[0064] To define such predetermined specific conditions, the number of passengers in the vehicle may vary, the options used in the passenger compartment (heating, air conditioning...) may be switched on or off, the windows may be opened or closed, etc. Each configuration that may be used under normal driving conditions corresponds to a predetermined specific condition (as defined in the present invention).
[0065] The preliminary method is performed for each possible predetermined specific condition. In practice, the preliminary method is implemented, for example, before the vehicle is put into service. Preferably, the preliminary method is performed after the vehicle 1 is manufactured, for example, before the vehicle 1 is delivered.
[0066] As an alternative, the predetermined acoustic parameters may be varied while the vehicle is in operation. The preliminary method may therefore be implemented during operation of the vehicle.
[0067] Figure 4 An exemplary flow chart showing a preliminary method for evaluating predetermined acoustic parameters associated with the previously introduced predetermined specific situation. In the following, the preliminary method is described considering one predetermined specific condition of the vehicle 1. However, the preliminary method is performed in the same way for all predetermined specific conditions.
[0068] like Figure 4 As shown, the preliminary method starts at step S2. During this S2 step, the control unit 12 controls the emission of a test sound from the speaker device 14. The test sound is, for example, white noise. It can be continuous or hashed white noise. As an alternative, the test sound can be formed by a sweep signal. As another alternative, the test sound can be formed by a maximum length sequence (or MLS) signal.
[0069] The test sound is then propagated in the passenger compartment 5. The control unit 12 detects a signal corresponding to the emitted test sound received by the microphone device 16 at step S4.
[0070] The control unit 12 then determines the acoustic parameters of the detection signal (also called predetermined acoustic parameters, since they correspond to predetermined specific conditions of the vehicle 1) (step S6). In other words, at step S6, the control unit 12 analyzes the detection signal in order to extract the acoustic features of the detection signal. In practice, this analysis is performed, for example, by comparing the detection signal with the test sound emitted at step S2.
[0071] At the end of step S6 , the control unit 12 has thus determined predetermined acoustic parameters relevant to the predetermined specific situation of the vehicle 1 under consideration.
[0072] In step S8, the memory 17 stores the predetermined acoustic parameters determined in step S6.
[0073] Finally, before the vehicle 1 is put into operation, the memory 17 of the control unit 12 stores all the predetermined acoustic parameters respectively corresponding to each predetermined specific situation.
[0074] The method for assessing an emergency situation in the vehicle 1 is implemented while the vehicle is running. More specifically, when the control unit 12 detects that an accident or an incident may have occurred, the method starts at step S20 ( Figure 3 ). For example, the control unit 12 detects that the vehicle's airbag has been deployed. In this case, the method aims to identify the situation and its urgency in order to transmit accurate information to the emergency center. The emergency center is then able to coordinate the emergency response.
[0075] In order to identify the situation of the vehicle 1 after an accident or incident, the method comprises a step S22 . During this step S22 , the control unit 12 controls the emission of a sound from the speaker device 14 .
[0076] In fact, the sound of step S22 is an acoustic test sound. Preferably, the acoustic sound is the same as the sound used in the preliminary method (as described above).
[0077] The acoustic test sound is, for example, white noise. It can be continuous or scattered white noise.
[0078] As an alternative, the acoustic test sound may be formed by a sweep signal.As a further alternative, the acoustic test sound may be formed by a maximum length sequence (or MLS) signal.
[0079] The emitted sound then propagates in the passenger compartment 5 .
[0080] In step S24, the control unit 12 detects a signal corresponding to the emitted sound received by the microphone device 16. The detection signal corresponds to a response related to the emitted sound. In other words, the detection signal corresponds to the sound received by the microphone device 16 and is generated by the propagation of the emitted sound in the passenger compartment 5.
[0081] The control unit 12 then determines the acoustic parameters of the detection signal (step S26). In other words, in step S26, the control unit 12 analyzes the detection signal in order to extract the acoustic characteristics of the detection signal. In practice, the analysis is performed, for example, by comparing the detection signal with the test sound emitted in step S22, in a manner similar to that implemented during the preliminary method.
[0082] like Figure 3 As shown, the method then comprises a step S28 . During this step, the control unit 12 compares the acoustic parameters determined in step S26 with predetermined acoustic parameters (determined during the preliminary method and corresponding to normal driving conditions).
[0083] In practice, at step S28, the control unit 12 compares the amplitude and / or phase of the determined acoustic parameter (related to an accident or incident) with the amplitude and / or phase of a predetermined acoustic parameter (under normal driving conditions), respectively, for example at a given frequency.
[0084] Figure 5An example of such a comparison is shown. In this figure, Figure a shows the amplitude variation of the detection signal as a function of frequency under normal driving conditions. Figure b shows the amplitude variation of the detection signal as a function of frequency when an accident or an unexpected event occurs. For example, at a frequency of 500 Hz, there is a significant difference between the amplitude of the detection signal under normal driving conditions and the amplitude of the detection signal when an accident or an unexpected event occurs. Therefore, the significant difference at this frequency reflects that the situation does not conform to normal conditions.
[0085] Thus, at a given frequency, the difference between the predetermined acoustic parameter and the determined acoustic parameter allows the identification of an emergency situation. A larger difference represents a feature related to the severity of the accident. Finally, based on this comparison, the control unit 12 identifies the degree of urgency of the situation of the vehicle 1. The identified situation is represented, for example, by an acoustic function based on the determined acoustic parameter.
[0086] The report including the detected situation is then transmitted (step S30 ), for example to an emergency center. The report here includes the determined acoustic function.
[0087] The report is transmitted here using the communication unit 18. The report is transmitted in the form of a text message or a minimum data set (or MSD, corresponding to the data format usually used for eCalls).
[0088] This step S30 then directs an appropriate response to the emergency center.
[0089] Thus, the method described here allows determining the emergency situation of a vehicle based solely on the acoustic analysis of the propagated signal. For example, there is no need to use an image of the vehicle. Furthermore, a comparison with predetermined acoustic parameters stored in the vehicle and corresponding to normal driving conditions allows an accurate determination of the degree of urgency. The degree of urgency then enables the emergency response to be adjusted (by contacting an ambulance or a car repair shop, or by doing nothing if the situation is not ultimately urgent).
[0090] According to another embodiment, the determination of the acoustic parameters of the detection signal may be based on an echo cancellation method implemented by a module for eliminating echoes from emitted sounds propagating in the passenger compartment 5 .
[0091] When the emitted sound propagates in the passenger compartment 5 (for example during a conversation with an emergency center in the framework of an eCall), the microphone device 16 receives the signal of the emitted sound and the echo. The echo is represented by the echo acoustic parameters. The module for canceling the echo includes an adaptive filter, which is configured to filter the echo based on the echo acoustic parameters.
[0092] As described above, determining the acoustic parameters may thus be performed during an emergency using a module for cancelling echoes (or an echo cancellation module).
[0093] In this embodiment, the preliminary method is therefore replaced by the setting of the module for echo cancellation, resulting in its typical operation during normal use of the speaker device 14 and microphone device 16 before an emergency, such as during a telephone call using the speaker device 14 and microphone device 16.
[0094] In this case, since the echo is eliminated in step S26, the acoustic parameters of the detection signal are determined in a more accurate manner and thus do not interfere with determining the acoustic parameters of the detection signal.
[0095] According to another embodiment, the sound emitted at step S22 is, for example, a presence signal in order to detect the presence of a vehicle occupant (driver and / or passenger). The presence signal is, for example, a speech signal reproduced by the loudspeaker device 14 and corresponds to the speech of a person at the emergency center. In this case, the sound comprises, for example, a question to which the occupant can answer if he hears it.
[0096] In this embodiment, the method may optionally include a step of increasing the emitted volume of the presence signal so that the response signal can be heard from outside the vehicle 1. This step thus allows the presence signal to be transmitted to occupants who may have left the passenger compartment after an incident or accident.
[0097] Indeed, in this embodiment, the detection signal may be generated by a vehicle occupant responding to an emitted sound. The response may be a verbal response (i.e. words spoken by the occupant) or a response signal associated with the movement of the occupant (who may not be able to speak but can move).
Claims
1. A method for assessing an emergency situation in a vehicle (1), the vehicle (1) comprising a passenger compartment (5), a speaker device (14) and a microphone device (16), the method comprising the following steps: - emitting sound from the loudspeaker device (14) in the passenger compartment (5), - detecting a signal corresponding to an emitted sound received by said microphone device (16), - determine the acoustic parameters of the detection signal, and - comparing said acoustic parameters of said detection signal with predetermined acoustic parameters associated with specific situations in order to identify said emergency situation.
2. The method according to claim 1, wherein: The vehicle (1) comprises a module for cancelling echoes from the emitted sound propagating in the passenger compartment (5), the module being arranged to determine the acoustic parameters of the detection signal.
3. The method according to claim 1, wherein: The emitted sound is an acoustic test signal.
4. The method according to claim 3, wherein: The acoustic test signal is formed by white noise.
5. The method according to claim 3, wherein: The acoustic test signal is formed by a scanning signal or a maximum length sequence signal.
6. The method according to any one of claims 1 to 5, further comprising the step of transmitting an acoustic function based on the determined acoustic parameters regarding the identified situation to an emergency center.
7. The method according to any one of claims 1 to 6, wherein: The acoustic parameters include the reverberation time of the received signal in the passenger compartment (5) or the eigenfrequency of the received signal or the power of the detection signal.
8. The method according to any one of claims 1 to 7, further comprising a preliminary step of storing the predetermined acoustic parameters corresponding to normal driving conditions.
9. The method according to any one of claims 1 to 8, wherein: The emitted sound is a presence signal configured to detect the presence of an occupant of the vehicle (1), the detection signal corresponding to a response signal associated with the occupant.
10. The method according to claim 9, further comprising the step of increasing the volume of the presence signal so that the response signal can be heard from outside the vehicle (1).
11. The method according to any one of claims 1 to 10, wherein: The comparing step includes comparing the magnitude and phase of the response acoustic parameter with the magnitude and phase of the predetermined acoustic parameter at least at a predetermined frequency.
12. A system (10) for assessing an emergency situation in a vehicle (1), the vehicle (1) comprising a passenger compartment (5), a control unit (12), a loudspeaker device (14) and a microphone device (16), the device comprising: - a speaker device (14) configured to emit sound in the passenger compartment (5), - a control unit (12) configured to detect a signal corresponding to an emitted sound received by said microphone device (16), The control unit (12) is further configured to: - determine the acoustic parameters of the detection signal, and - comparing said acoustic parameters of said detection signal with predetermined acoustic parameters associated with specific situations in order to identify said emergency situation.