SYSTEM AND METHOD FOR VALIDATING THE FUNCTIONAL SAFETY OF AN AUDIO MESSAGE OUTPUT IN THE INTERIOR OF A VEHICLE

Abstract

A system and procedure for validating the output of an audio message in a vehicle interior are provided. A signal power modulator modulates the audio message using an audio frequency spectrum of the message as the carrier frequency and predefined modulation data. An audio generator outputs a loudspeaker tone corresponding to the modulated audio message using one or more loudspeakers in the vehicle interior. An audio recorder receives vehicle noise using one or more microphones in the vehicle interior and outputs a vehicle signal corresponding to the received vehicle noise. An extraction unit extracts estimated modulation data from the vehicle signal.A validation unit determines a difference between the estimated modulation data and the previously defined modulation data and validates an output of the audio message if the difference is below a previously defined threshold.

Description

BACKGROUND

[0001] A vehicle multimedia system can deliver an audio message to the driver or other occupants. This audio message can be a warning or instruction for the driver or other occupants. Due to circumstances (e.g., a faulty speaker), this message may not reach the vehicle occupants in time. Therefore, it can be important to validate the delivery of the safety message to the interior where the occupants are seated. If the message was not delivered in time, it can be regenerated, for example, as a visual message or again as an audio message.

[0002] EP 4 325 893 A1 describes a system for playing back and monitoring the playback of audio signals. An audio signal generation module is configured to generate an audio signal. An identification signal generation module is configured to generate an identification signal associated with the audio signal. A verification module is configured to process a played-back tone to verify that the played-back tone contains the identification signal.

[0003] The article “Automatic evaluation method for vehicle audio warning system using MFCC-polynomial hybrid feature” (WANG, Zuoliang; XU, Qimin; CHEN, Zehua, In: Proceedings of the Institution of Mechanical Engineers, part D: Journal of automobile engineering, Vol. 239, 2025, No. 5, pp. 1577-1586. - ISSN 0954-4070) describes an efficient, precise and automatic evaluation method for acoustic warning systems in vehicles.

[0004] The object of the invention is therefore to provide a system and a method for validating the functional safety of an audio message output in the interior of a vehicle. SUMMARY

[0005] The object of the invention is achieved by providing a system according to claim 1 and a method according to claim 7.

[0006] According to a first aspect, a system for validating the functional safety of an audio message output in the interior of a vehicle is provided, the system comprising the following: - a signal power modulator - an audio generator - an audio recorder - an extraction unit - a validation unit wherein the signal power modulator is arranged to: - to receive an audio message that has an audio spectrum of at least one or more audio frequencies with an amplitude greater than a minimum value and with any phase; - to modulate the audio message using the audio spectrum as carrier frequencies and previously defined modulation data for the audio message; - to output a modulated audio message to the audio generator, to output the audio message to the extraction unit, and to output the previously defined modulation data to the validation unit; the audio records are arranged to: - to receive a vehicle sound using one or more microphones inside the vehicle; - to output a vehicle signal corresponding to the received vehicle noise to the extraction unit; the audio recorder is arranged to: - to receive a vehicle sound using one or more microphones inside the vehicle; - to output a vehicle signal corresponding to the received vehicle noise to the extraction unit; wherein the extraction unit is arranged to: - to receive the vehicle signal and the audio message; - to extract estimated modulation data from the vehicle signal using the audio message; - to output the estimated modulation data to the validation unit, the validation unit is arranged to: - to receive the estimated modulation data and the previously defined modulation data; - to determine a difference between the estimated modulation data and the previously defined modulation data; - to validate an output of the audio message if the difference is below a previously defined threshold; - To output validation data that corresponds to the validation.

[0007] The term "functional safety validation" can refer to determining that a safety message has been transmitted, i.e., that the audio message function of providing information to the vehicle's driver has been executed. Furthermore, the volume of the transmitted audio message should be such that the driver is able to understand the information contained within it. Therefore, the volume should be above a certain minimum level and above the volume of other ambient noises around the driver.

[0008] According to the invention, the audio message comprises an audio spectrum of at least one or more audio frequencies with an amplitude greater than a minimum value and with an arbitrary phase. In other words, the amplitudes of the one or more audio frequencies can be equal, but must all be above a previously defined minimum value, and the phases of the one or more audio frequencies can have an arbitrary value.

[0009] In one or more embodiments, the audio message can comprise one or more tones, each with a specific audio frequency. In one or more embodiments, the audio message can comprise one or more spoken words.

[0010] The system according to the invention comprises a signal power modulator, an audio generator, an audio recorder, an extraction unit, and a validation unit. These can be separate devices, separate processors on a printed circuit board, or separate programs running on a single processor.

[0011] In one or more embodiments, the audio message is received by the signal power modulator from a memory located within the system. In one or more other embodiments, the audio message is received by the signal power modulator from a server located outside the vehicle, for example, via a wireless connection.

[0012] In one or more embodiments, the signal power modulator can be located outside the vehicle, and the modulation can be performed outside the vehicle and / or can be performed prior to the need for output of the audio message, for example, before the vehicle is manufactured. Subsequently, the signal power modulator can provide the modulated audio message, the audio message, and the previously defined modulation to the vehicle, where they are recorded for later use.

[0013] According to the invention, the audio message is modulated with all or part of its audio frequencies as carrier frequencies and previously defined modulation data for the audio message.

[0014] In one or more embodiments, all frequencies of the audio message above the highest frequency of the previously defined modulation data are used for demodulation. This is explained in more detail in the comprehensive description section of this document.

[0015] Due to this modulation, the validation results are more accurate and less sensitive to noise and interference (which do not normally correlate with the audio message) than the results of many prior art systems. Furthermore, the system can correctly validate the audio message output using a shorter audio sample time than many prior art systems.

[0016] In one or more embodiments, different audio messages can be modulated with predefined modulation data. The predefined modulation data can be retrieved for each audio message from a memory contained within the system or received by the signal power modulator from a server located outside the vehicle, for example, via a wireless connection.

[0017] The audio generator receives the modulated audio message from the signal power modulator and uses one or more speakers in the vehicle to transmit the audio message to the driver and other vehicle occupants.

[0018] To determine what the occupant would be able to hear, the audio recorder can use one or more microphones to receive vehicle noise. This vehicle noise can include the speaker sound and other sounds from the vehicle itself (e.g., the engine), from the speaking occupants, and / or from outside the vehicle. The speaker sound can be distorted within the vehicle by reflections or echoes of the speaker sound and / or a defect in one or more speakers in the vehicle.

[0019] The extraction unit receives a vehicle signal corresponding to the received vehicle noise from the audio recorder and extracts estimated modulation data from the vehicle signal using the audio message received by the signal power modulator. It should be noted that the modulated audio message is not provided to the extraction unit, and it can advantageously extract estimated modulation data from the vehicle signal without using the modulated audio message.

[0020] The estimated modulation data is used by the validation unit to determine the difference between the estimated modulation data and the previously specified modulation data received by the signal power modulator. This difference can indicate how well the audio message could have been heard by the occupants, with a smaller difference indicating better transmission of the audio message.

[0021] Based on this difference, the validation unit determines whether the audio message transmission meets one or more requirements for transmitting a security message, i.e., whether the difference is below a predefined threshold. In this case, the audio message output can be considered validated. The validation unit outputs validation data indicating the results of the validation.

[0022] The previously defined modulation data can correspond to many different types of signal modulation or a combination thereof: - In one or more embodiments, the previously defined modulation data corresponds to a modulation frequency. In one or more embodiments, the previously defined modulation data corresponds to (i) periodic modulation data corresponding to periodic modulation, and / or (ii) non-periodic modulation data corresponding to non-periodic modulation. An advantage of this combination is that periodic modulation can be helpful in extracting estimated modulation data from the vehicle signal. In one or more embodiments, the previously defined modulation data corresponds to pause data, which represent modulation pauses. Modulation pauses can be applied to periods when the sound power of the audio message is too low to be properly received by the audio recorder. Advantages of using modulation pauses may be that (i) low sound power does not contribute to non-validation and (ii) modulation pauses may be characteristic of the audio message and thus be used for validation.

[0023] In one or more embodiments, the signal power modulator is further arranged to determine a minimum sound power for the modulated audio message during a predetermined power period and to output minimum sound power data corresponding to the minimum sound power to the validation unit. The extraction unit may further be arranged to extract an estimated sound power of the vehicle noise during the predetermined power period using the vehicle signal and to output estimated sound power data corresponding to the estimated sound power to the validation unit, wherein the validation unit is further arranged to receive the estimated sound power data and minimum sound power data and to validate the output of the audio message if the estimated sound power is equal to or greater than the minimum sound power.

[0024] One advantage of this embodiment is that it introduces a further requirement for the output of the audio message: the sound level of the audio message. This should be above a minimum level, otherwise it cannot be assumed that the occupants have heard the audio message.

[0025] In one or more embodiments, the extraction unit may further be arranged to store an inverse audio transfer function for the interior and to determine an estimated audio signal based on the vehicle signal and the audio message using the inverse audio transfer function.

[0026] The inverse audio transfer function (IAF) can indicate how a sound from the speakers inside the vehicle is distorted before being recorded by the microphones inside the vehicle. This distortion is caused by reflections within the interior and / or attenuation in the interior air. This IAF can be specific to a particular vehicle model. Using an IAF can improve the extraction of estimated modulation data.

[0027] The extraction unit can further be configured to demodulate the estimated audio signal using the audio message and optionally filter the demodulation results using a bandpass filter to obtain an estimated demodulated audio signal. The bandpass filter can allow a frequency range to pass through that includes modulation frequencies used for modulation. The extraction unit can further be configured to extract estimated modulation data from the estimated demodulated audio signal.

[0028] In one or more embodiments, the extraction unit is further arranged to extract estimated periodic modulation data from the estimated demodulated audio signal, wherein the estimated modulation data includes the estimated periodic modulation data or is extracted using the estimated periodic modulation data.

[0029] One advantage of using estimated periodic modulation data can be that it can be used as input for the extraction of non-periodic modulation data and / or as input for validation, thus making the estimated periodic modulation data part of the estimated modulation data.

[0030] In one or more embodiments, the extraction unit is further arranged to extract estimated pause data from the estimated demodulated audio signal, wherein the estimated modulation data includes the estimated pause data or is extracted using the estimated pause data.

[0031] One advantage of using estimated pause data is that it can be used as input for extracting periodic and / or non-periodic modulation data and / or as input for validation, thus making the estimated pause data part of the estimated modulation data.

[0032] In one or more embodiments, the system according to the invention can be embodied by a multimedia system of a vehicle. According to a further aspect of the invention, a vehicle is provided that includes a system for validating the functional safety of an audio message output according to any of the embodiments discussed in this document.

[0033] According to yet another embodiment, a method for validating the functional safety of an audio message output in the interior of a vehicle is provided, the method comprising the following steps: - Receiving an audio message that has an audio spectrum of at least one or more audio frequencies with an amplitude greater than a minimum value and with any phase; - Modulating the audio message using the audio frequency spectrum as carrier frequencies and previously defined modulation data for the audio message; - Outputting a vehicle signal corresponding to the received vehicle noise to the extraction unit; - Receiving a vehicle sound using one or more microphones inside the vehicle; - Generating a vehicle signal that corresponds to the received vehicle noise; - Extracting estimated modulation data from the vehicle signal using the audio message; - Determining a difference between the estimated modulation data and the previously defined modulation data; - Validating an audio message output if the difference is below a previously defined threshold; - Generating validation data that meets the validation requirements.

[0034] In one or more embodiments, the previously defined modulation data corresponds to a previously defined modulation frequency; and / or the previously defined modulation data include the following: a. periodic modulation data corresponding to a periodic modulation of the audio message; and b. non-periodic modulation data corresponding to a non-periodic modulation of the audio message; and preferably c. Pause data corresponding to modulation pauses, wherein a modulation pause is the absence of modulation during a previously defined period, wherein the sound power of the audio message is preferably below a previously defined threshold.

[0035] In one or more embodiments, the method further comprises the following steps: - Determining a minimum sound power level for the modulated audio message during a previously defined power period; - Generating minimum sound power data corresponding to the minimum sound power level for the validation unit; - Extracting an estimated sound power level of the vehicle noise during the previously defined power period using the vehicle signal; - Generating estimated sound power data corresponding to the estimated sound power to the validation unit; - Validating the audio message output if the estimated sound power is equal to or higher than the minimum sound power.

[0036] In one or more embodiments, the method further comprises the following steps: - Determining an estimated audio signal based on the vehicle signal and the audio message using the inverse audio transfer function; - Demodulating the estimated audio signal using the audio message and optionally filtering the demodulation results using a bandpass filter to obtain an estimated demodulated audio signal, the optional bandpass filter allowing a frequency range to pass through that includes modulation frequencies used for modulation; and - Extracting estimated modulation data from the estimated demodulated audio signal.

[0037] In one or more embodiments, the method further comprises the following step: Extracting estimated periodic modulation data from the estimated demodulated audio signal, wherein the estimated modulation data is extracted using the estimated periodic modulation data.

[0038] In one or more embodiments, the method further comprises the step of extracting estimated pause data from the estimated demodulated audio signal, wherein the estimated modulation data includes the estimated pause data.

[0039] According to a further aspect of the invention, a computer program is provided, wherein the computer program comprises instructions which, when executed by a computer, cause the computer to perform the steps of the method according to one of the embodiments described in this document. Furthermore, a computer-readable medium is provided on which the computer program is stored.

[0040] The functioning, advantages and embodiments of the method and the vehicle, as well as the functioning, advantages and embodiments of the computer program and the computer-readable medium, correspond to the functioning, advantages and embodiments of the method as described in this document, in the relevant application. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] For a more complete understanding of the present invention, the following description refers to the accompanying drawings. These show: Fig. 1 a schematic overview of a system for validating the functional safety of an audio message output in the interior of a vehicle according to one or more embodiments; Fig. 2 a schematic overview of an extraction unit 140 of the system as in Fig. 1 shown; Fig. 3 a vehicle with a system for validating the functional safety of an audio message output according to one or more embodiments; and Fig. 4 a schematic overview of a method for validating the functional safety of an audio message output in the interior of a vehicle according to one or more embodiments. DETAILED DESCRIPTION

[0042] Fig. Figure 1 shows a schematic overview of a System 100 for validating the functional safety of an audio message output in the interior of a vehicle according to one or more embodiments.

[0043] The system 100 includes a signal power modulator 110, an audio generator 120, an audio recorder 130, an extraction unit 140 and a validation unit 150.

[0044] The signal power modulator 110 receives an audio message X, which has an audio spectrum of at least one or more audio frequencies with an amplitude greater than a minimum value and with any phase, and modulates the audio message using the audio frequency spectrum as carrier frequencies and previously specified modulation data M for the audio message X.

[0045] In one or more embodiments, all frequencies of the audio message above the highest frequency of the previously defined modulation data are used for demodulation.

[0046] This can be shown using the following mathematical theorems: 1. cos(x)*cos(y) = 0.5 * (cos(xy) + cos(x+y)) 2. cos 2 (x) = 0.5 * (1+cos(2*x)) 3. cos(x) = cos(-x)

[0047] The following frequencies are defined: Ωi = one of the audio frequencies of the audio spectrum. Ωmin is the lowest frequency and Ωmax is the highest frequency of the audio spectrum. The following equations apply to any i. ω = a frequency for data modulation, i.e., ω0 = 40 Hz symbolizes a "0" and ω1 = 80 Hz symbolizes a "1". The highest / lowest frequency used can be noted as wmax and wmin, respectively.

[0048] Since audio frequencies within the audio spectrum can be defined by the audio message, the frequencies for data modulation should be chosen so that their ranges do not overlap. An example could be: Ωi > Ωmin > 100 Hz and ω < wmax < 100 Hz.

[0049] Below, an example of modulation and demodulation according to one or more embodiments of the invention is mathematically proven: 1. Generating the modulated audio message Xm using the previously defined modulation signal Ms for the audio message X; X = sum of all Xi with Xi = Ai * cos(Ωi * t), where Ai can be different for different i and different phases of Xi are not taken into account, as they do not change the result with respect to the frequencies. Ms = cos(ω * t), for example with ω0 (e.g. = 40 Hz) and ω1 (e.g. = 80 Hz), which define the modulation data “0” and “1”. Xm=X*(1+r*Ms) with r=modulation factor

[0050] For each Xi, the following equation applies: Xmi=Ai*cos(Ωi*t)*(1+r*cos(ω*t))=Ai*cos(Ωi*t)+0,5*Ai*r*(cos((Ωi+ω)t)+cos((Ωi−ω)t))

[0051] The following can take place in the extraction unit: 2. Demodulation of XXm with X for all Xi

[0052] In a first step, the signal XXm is calculated as follows: XXm = X*Xm. The resulting signal XXm is then filtered for ω0 (e.g., = 40 Hz) and for ω1 (e.g., = 80 Hz).

[0053] If the signal power of XXm is above a previously defined threshold and the filtered signal for ω0 is larger than for ω1, a “0” (otherwise a “1”) is generated as estimated modulation data Mc.

[0054] It can be shown that XXm contains the modulation signal M = cos(ω * t) with ω = ω0 (e.g., = 40 Hz) and ω = ω1 (e.g., = 80 Hz) for each Xmi. It is assumed that the extraction unit can perfectly reconstruct the modulated audio message Xm from the vehicle signal Ym.

[0055] The audio power output of X and Xmi is calculated as follows: XXmi=Xi*Xmi =Ai*cos(Ωi*t)*(Ai*cos(Ωi*t)+0.5*Ai*r*(cos((Ωi+ω)t)+cos((Ωi−ω)t)) =0.5*(Ai)2*(1+cos(2*Ωi*t))+0.5*(Ai)2*r*cos(Ωi*t)*(cos((Ωi+ω)t)+cos((Ωi−ω)t)) =0.5*(Ai)2*(1+cos(2*Ωi*t))+0.5*(Ai)2*r*0.5*(cos((Ωi+(Ωi+ω))* t)+cos((Ωi−(Ωi+ω))*t)+cos((Ωi+(Ωi−ω))*t)+cos((Ωi−(Ωi−ω))*t)) =0.5*(Ai)2*(1+cos(2*Ωi*t))+0.25*(Ai)2*r*(cos((2*Ωi+ω)*t)+cos(−ω*t)+cos((2*Ωi−ω))*t)+cos(ω*t)) =0.5*(Ai)2*(1+cos(2*Ωi*t))+0.25*(Ai)2*r*cos((2*Ωi+ω)*t)+0.25*(Ai)2*r*cos((2*Ωi−ω)*t))+0.5*(Ai)2*r*cos(ω*t))

[0056] Discussion of the result: The term: 0.5 * (Ai) 2 The function (1 + cos(2 * Ωi * t)) has a constant component and an alternating component with twice the audio signal frequency. Both can be easily filtered out since their frequency is zero and greater than Ωmin. This term carries no modulation data. The term: 0.25 * (Ai) 2* r * cos((2*Ωi + ω) * t) is a mixture of audio message frequencies and a modulation data signal. It can be easily filtered out because its frequency 2*Ωi + ω > Ωmin. The term: 0.25 * (Ai) 2 * r * cos((2*Ωi - ω) * t)) is also a mixture of audio message frequencies and a modulation data signal. It can be filtered out because its frequency 2*Ωi - ω > 2* Ωmin - wmax > Ω min. The term: 0.5* (Ai) 2 The interesting result, *r * cos(ω * t)), carries exactly the frequency of the modulation data signal. It can be filtered with a low-pass filter with a cutoff frequency < Ωmin. It can then be further investigated.

[0057] In one or more embodiments, the previously defined modulation data M corresponds to a previously defined modulation frequency. In one or more embodiments, the previously defined modulation data M comprises periodic and non-periodic modulation data corresponding to periodic and non-periodic modulation of the audio message X. The previously defined modulation data M may further comprise pause data corresponding to modulation pauses.

[0058] A modulation pause is an absence of modulation during a predetermined period, where the sound power of the audio message X is preferably below a predetermined threshold.

[0059] Since the human ear and brain have limitations regarding the processing of sounds, the previously determined modulation data should be chosen so that the occupants are not aware of the fact that the audio message was modulated using previously determined modulation data, or are not disturbed by it.

[0060] The signal power modulator 110 outputs a modulated audio message Xm to the audio generator 120, which in turn outputs the audio message X to the extraction unit 140. The signal power modulator 110 also outputs predefined modulation data M to the validation unit 150.

[0061] In one or more embodiments, the signal power modulator 110 determines a minimum sound power for the modulated audio message Xm during a previously defined power period and outputs minimum sound power data Px corresponding to the minimum sound power to the validation unit 150.

[0062] The audio generator 120 receives the modulated audio message Xm and outputs a loudspeaker tone corresponding to the modulated audio message Xm using one or more loudspeakers 301 in the vehicle interior. The audio generator 120 can be configured to convert the modulated audio message Xm into an analog electrical signal Xn for the one or more loudspeakers 301. In one or more embodiments, the one or more loudspeakers can be incorporated into the audio generator.

[0063] The audio recorder 130 receives vehicle sound using one or more microphones 303 inside the vehicle. The speaker sound can be received directly from the one or more speakers 301 and / or via reflections of the sound from surfaces 302 inside the vehicle. In addition to the speaker sound, the audio recorder 130 can also record ambient sounds N generated outside and / or outside the vehicle.

[0064] The audio recorder 130 can receive an analog electrical signal Yn from one or more microphones 303. The audio recorder 130 outputs a vehicle signal Ym, corresponding to the received vehicle noise, to the extraction unit 140.

[0065] Fig. Figure 2 shows a schematic overview of an extraction unit 140 of the system as in Fig. Figure 1 shows. In one or more embodiments, the extraction unit 140 can comprise a room acoustic compensator 210 and / or a demodulator 220.

[0066] The room acoustic compensator 210 can store an inverse audio transfer function (InvGxy) for the vehicle interior. The audio transfer function Gxy can be determined from the relationship between the cross-power density Sxy of X and Ym and the car's power density Sxx of X. Subsequently, the impulse response of the room or interior can be calculated by converting Gx into the time domain, which represents the room's sound reflections or echoes. To compensate for these reflections, the audio transfer function Gxy is inverted to obtain the inverse audio transfer function (InvGxy = 1 / Gxy). However, other methods besides those known in the prior art can also be used to determine the inverse audio transfer function InvGxy.

[0067] The inverse audio transfer function (InvGxy) can then be used as a filter to extract the estimated audio signal Xs from the vehicle signal Ym. The room acoustic compensator 210 can then output the estimated audio signal Xs to the demodulator 220.

[0068] The demodulator 220 can demodulate and filter the estimated audio signal Xs using the audio message X and a bandpass filter to obtain an estimated demodulated audio signal XXs. The bandpass filter can be configured to allow a frequency range to pass through that includes the modulation frequencies used for modulation. The extraction unit 140 can further be configured to extract estimated modulation data Mc from the estimated demodulated audio signal XXs.

[0069] In one or more embodiments, the extraction unit 140 may further comprise a modulation synchronization unit 230 and a modulation data estimation unit 240.

[0070] The modulation synchronization unit 230 is configured to determine an estimated periodic modulation Mb in the estimated demodulated audio signal XXs. The modulation synchronization unit 230 can further be configured to determine estimated modulation pauses Mp in the estimated demodulated audio signal XXs. Furthermore, the modulation synchronization unit 230 can be configured to output the estimated periodic modulation Mb and, optionally, the estimated modulation pauses Mp to the modulation data estimation unit 240.

[0071] The modulation data estimation unit 240 uses the estimated demodulated audio signal XXs to determine estimated modulation data Mc. For this purpose, the modulation data estimation unit 240 can further be configured to use the estimated periodic modulation Mb and / or the estimated modulation pauses Mp.

[0072] In one or more embodiments, the extraction unit 140 or, more specifically, the modulation data estimation unit 240 is further arranged to extract an estimated sound power of the vehicle noise during the previously defined power period using the vehicle signal Ym or the estimated demodulated audio signal XXs.

[0073] The extraction unit 140 outputs the estimated modulation data Mc and optionally the estimated sound power data Pm, which correspond to the estimated sound power, to the validation unit 150.

[0074] As from Fig. As can be seen in Figure 1, the validation unit 150 receives the estimated modulation data Mc and the previously defined modulation data M. The validation unit 150 determines the difference between the estimated modulation data Mc and the previously defined modulation data M and validates the audio message output if the difference is below a previously defined threshold. The validation unit 150 outputs validation data that corresponds to the validation.

[0075] In one or more embodiments, after the output of the audio message has not been validated, the system 100 can restart the validation of an output of an audio message in which the audio message is output again, based on the validation data.

[0076] In one or more embodiments, the system 100 further comprises a display 160. The display 160 can be arranged to show a visual message to the vehicle occupants based on the validation data. The visual message can visually indicate the content of the audio message, preferably using symbols and / or letters if the audio message output has not been validated.

[0077] Fig. Figure 3 shows a vehicle 310 with a system 100 for validating the functional safety of an audio message output according to one or more embodiments as described in this document. The vehicle 310 may further include one or more loudspeakers 303 located in the interior of the vehicle 310 and / or one or more microphones 301 located in the interior of the vehicle 310. In one or more embodiments, the vehicle 310 may be a car, motorcycle, van, truck, bicycle, or scooter. In one or more embodiments, the system 100 may be part of the infotainment system of the vehicle 310.

[0078] Fig. Figure 4 shows a schematic overview of a method 400 for validating the functional safety of an audio message output in the interior of a vehicle according to one or more embodiments.

[0079] Procedure 400 comprises the following steps:

[410] Receiving an audio message X which has an audio spectrum of at least one or more audio frequencies with an amplitude Ai greater than a minimum value and with any phase;

[420] Modulating the audio message X using the audio spectrum as carrier frequencies and previously defined modulation data for the audio message;

[430] Outputting a loudspeaker tone corresponding to the modulated audio message Xm using one or more loudspeakers inside the vehicle 310;

[440] Receiving a vehicle sound using one or more microphones inside the vehicle 310;

[450] Generating a vehicle signal Ym corresponding to the received vehicle noise;

[460] Extracting estimated modulation data Mc from the vehicle signal Ym using the audio message X;

[470] Determining a difference between the estimated modulation data and the previously determined modulation data;

[480] Validating an output of the audio message if the difference is below a previously set threshold; and

[490] Generating validation data that corresponds to the validation.

[0080] In one or more embodiments, the previously defined modulation data M corresponds to a previously defined modulation frequency, and / or wherein the previously defined modulation data M comprises the following: a. periodic modulation data corresponding to a periodic modulation of the audio message X; and b. non-periodic modulation data corresponding to a non-periodic modulation of the audio message X; and preferably c. Pause data corresponding to modulation pauses, wherein a modulation pause is an absence of modulation for a previously defined period, wherein the sound power of the audio message X is preferably below a previously defined threshold.

[0081] In one or more embodiments, the method further comprises the following steps:

[510] Determining a minimum sound power Px for the modulated audio message Xm during a previously defined power period;

[520] Generating minimum sound power data corresponding to the minimum sound power Px to the validation unit;

[530] Extracting an estimated sound power Pm of the vehicle noise during the previously determined power period using the vehicle signal Ym;

[540] Generating estimated sound power data corresponding to the estimated sound power Pm to the validation unit;

[550] Validating the output of the audio message when the estimated sound power Pm is equal to or higher than the minimum sound power Px.

[0082] In one or more embodiments, the method further comprises the following steps:

[610] Determining an estimated audio signal Xs based on the vehicle signal Ym and the audio message X using the inverse audio transfer function InvGxy;

[620] Demodulating the estimated audio signal using the audio message and optionally filtering the demodulation results using a bandpass filter to obtain an estimated demodulated audio signal, wherein the optional bandpass filter allows a frequency range to pass through that includes modulation frequencies used for modulation; and

[630] Extracting estimated modulation data Mc from the estimated demodulated audio signal XXs.

[0083] In one or more embodiments, the method further comprises the following steps:

[710] The method of claim 11, further comprising the following step: extracting estimated periodic modulation data Mb from the estimated demodulated audio signal XXs, wherein the estimated modulation data Mc are extracted using the estimated periodic modulation data Mb; and / or

[720] Extracting estimated pause data Mp from the estimated demodulated audio signal XXs, wherein the estimated modulation Mc includes the estimated pause data Mp.

[0084] Experts understand that the various illustrative logic blocks, modules, circuits, and algorithm steps described in connection with the embodiments disclosed herein can be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above in general terms with regard to their functionality. Whether such functionality is implemented as hardware or software depends on the specific application(s) and design-related constraints to which the overall system is subject.Experts may implement the described functionality in different ways for each specific application; however, such implementation decisions should not be interpreted as resulting in a deviation from the scope of the present invention.

[0085] The foregoing description of the disclosed embodiments is provided so that any person skilled in the art can carry out or use the present invention. Various modifications of these embodiments are obvious to those skilled in the art, and the overarching principles defined herein can be applied to other embodiments without departing from the spirit or scope of the invention. The present invention is therefore not intended to be limited to the embodiments shown herein, but is to be granted the widest scope compatible with the principles and novel features disclosed herein.

[0086] The benefits and advantages that can be provided by the present invention have been described above with reference to specific embodiments. These benefits and advantages, as well as any elements or limitations that may cause them to occur or enhance them, are not to be construed as critical, necessary, or essential features of any or all of the claims. As used herein, the terms "includes," "comprehensive," or any other form thereof are to be understood as encompassing not exclusively the elements or limitations that follow these terms. Accordingly, a system, method, or other embodiment comprising a group of elements is not limited to these elements but may include other elements not expressly stated or inherent in the claimed embodiment.

[0087] Although the present invention has been described with reference to specific embodiments, it is understood that these embodiments are for illustrative purposes only and that the scope of the invention is not limited to these embodiments. Many variations, modifications, additions, and improvements are possible with respect to the embodiments described above. It is intended that these variations, modifications, additions, and improvements fall within the scope of the invention, as detailed in the following claims.

Claims

[1] System for validating the functional safety of an audio message output in the interior of a vehicle, the system comprising: - a signal power modulator - an audio generator - an audio recorder - an extraction unit - a validation unit wherein the signal power modulator is arranged to: - to receive an audio message (X) that has an audio spectrum of at least one or more audio frequencies with an amplitude greater than a minimum value and with any phase; - to modulate the audio message using the audio frequency spectrum as carrier frequencies and previously defined modulation data (M) for the audio message (X); - to output a modulated audio message (Xm) to the audio generator, to output the audio message to the extraction unit, and to output the previously defined modulation data (M) to the validation unit; the audio generator is arranged to: - to receive the modulated audio message (Xm); - to output a loudspeaker tone corresponding to the modulated audio message (Xm) using one or more loudspeakers inside the vehicle; the audio recorder is arranged to: - to receive a vehicle sound using one or more microphones inside the vehicle; - to output a vehicle signal (Ym) corresponding to the received vehicle noise to the extraction unit; wherein the extraction unit is arranged to: - to receive the vehicle signal (Ym) and the audio message (X); - to extract estimated modulation data (Mc) from the vehicle signal (Ym) using the audio message (X); - to output the estimated modulation data (Mc) to the validation unit, the validation unit is arranged to: - to receive the estimated modulation data (Mc) and the previously defined modulation data (M); - to determine a difference between the estimated modulation data (Mc) and the previously defined modulation data (M); - to validate an output of the audio message if the difference is below a previously defined threshold; - To output validation data that corresponds to the validation, characterized by the fact that the extraction unit is further arranged to: - to store an inverse audio transmission function (InvGxy) for the interior; - to determine an estimated audio signal (Xs) based on the vehicle signal (Ym) and the audio message (X) using the inverse audio transfer function (InvGxy); - to demodulate the estimated audio signal using the audio message and optionally to filter the demodulation results using a bandpass filter to obtain an estimated demodulated audio signal, the optional bandpass filter allowing a frequency range to pass through that includes modulation frequencies used for modulation; and - to extract estimated modulation data (Mc) from the estimated demodulated audio signal (XXs). [2] System according to claim 1, - wherein the previously defined modulation data (M) correspond to a previously defined modulation frequency; and / or - wherein the previously defined modulation data (M) comprise the following: ◯ periodic modulation data corresponding to a periodic modulation of the audio message (X); and ◯ Non-periodic modulation data corresponding to a non-periodic modulation of the audio message (X); and preferably ◯ Pause data corresponding to modulation pauses, wherein a modulation pause is an absence of modulation during a previously defined period, wherein the sound power of the audio message (X) is preferably below a previously defined threshold. [3] System according to any of the preceding claims, wherein the signal power modulator is further arranged to: - to determine a minimum sound power for the modulated audio message (Xm) during a previously defined power period; - Output minimum sound power data (Px) corresponding to the minimum sound power to the validation unit; wherein the extraction unit is further arranged to: - to extract an estimated sound power (Pm) of the vehicle noise during the previously defined power period using the vehicle signal (Ym); - to output estimated sound power data corresponding to the estimated sound power (Pm) to the validation unit; the validation unit is further arranged to: - to receive the estimated sound power data and the minimum sound power data; - to validate the output of the audio message if the estimated sound power (Pm) is equal to or higher than the minimum sound power (Px). [4] System according to claim 2, wherein the extraction unit is further arranged to: - to extract estimated periodic modulation data (Mb) from the estimated demodulated audio signal (XXs); wherein the estimated modulation data (Mc) is extracted using the estimated periodic modulation data (Mb). [5] System according to one of claims 3-4 depending on claim 2, wherein the extraction unit is further arranged to: - to extract estimated pause data (Mp) from the estimated demodulated audio signal (XXs); wherein the estimated modulation data (Mc) is extracted using the estimated pause data (Mp). [6] Vehicle comprising a system for validating the functional safety of an audio message output according to any one of claims 1-5. [7] Method for validating the functional safety of an audio message output in the interior of a vehicle, the method comprising the following steps: - Receiving an audio message (X) that has an audio spectrum of at least one or more audio frequencies with an amplitude greater than a minimum value and with any phase; - Modulating the audio message using the audio frequency spectrum as carrier frequencies and previously defined modulation data (M) for the audio message (X); - Output of a loudspeaker tone corresponding to the modulated audio message (Xm) using one or more loudspeakers inside the vehicle; - Receiving a vehicle sound using one or more microphones inside the vehicle; - Generating a vehicle signal (Ym) that corresponds to the received vehicle noise; - Extracting estimated modulation data (Mc) from the vehicle signal (Ym) using the audio message (X); - Determining a difference between the estimated modulation data (Mc) and the previously defined modulation data (M); - Validating an audio message output if the difference is below a previously defined threshold; - Generating validation data that complies with the validation. Characterized by the fact that the procedure further comprises the following steps: - Determining an estimated audio signal (Xs) based on the vehicle signal (Ym) and the audio message (X) using an inverse audio transfer function (InvGxy) for the interior; - Demodulating the estimated audio signal using the audio message and optionally filtering the demodulation results using a bandpass filter to obtain an estimated demodulated audio signal, the optional bandpass filter allowing a frequency range to pass through that includes modulation frequencies used for modulation; and - Extracting estimated modulation data (Mc) from the estimated demodulated audio signal (XXs). [8] Method according to claim 7, wherein the previously defined modulation data (M) correspond to a previously defined modulation frequency; and / or the previously defined modulation data (M) include the following: a. periodic modulation data corresponding to a periodic modulation of the audio message (X); and b. non-periodic modulation data corresponding to a non-periodic modulation of the audio message (X); and preferably c. Pause data corresponding to modulation pauses, wherein a modulation pause is an absence of modulation for a previously defined period, wherein a sound power of the audio message (X) is preferably below a previously defined threshold. [9] A method according to any one of claims 7-8, further comprising the following steps: - Determining a minimum sound power (Px) for the modulated audio message (Xm) during a previously defined power period; - Generating minimum sound power data corresponding to the minimum sound power (Px) to the validation unit; - Extracting an estimated sound power (Pm) of the vehicle noise during the previously defined power period using the vehicle signal (Ym); - Generating estimated sound power data corresponding to the estimated sound power (Pm) to the validation unit; - Validating the audio message output if the estimated sound power (Pm) is equal to or higher than the minimum sound power (Px). [10] The method of claim 9, further comprising the following step: Extracting estimated periodic modulation data (Mb) from the estimated demodulated audio signal (XXs), wherein the estimated modulation data (Mc) is extracted using the estimated periodic modulation data (Mb). [11] The method of claim 9, further comprising the following step: Extracting estimated pause data (Mp) from the estimated demodulated audio signal (XXs), where the estimated modulation (Mc) includes the estimated pause data (Mp). [12] Computer program comprising instructions which, when executed by a computer, cause the computer to perform the steps of the method according to any one of claims 7-11. [13] Computer-readable medium on which the computer program according to claim 12 is stored.

Images