Method and device for compensating for sound ingress in a vehicle cabin

Abstract

A method for compensating for sound intrusion in a vehicle cabin, an apparatus for a vehicle including a memory and a processor operable to perform the method, and a vehicle including a processor, at least one speaker, and at least one microphone. The method includes: receiving input from at least one sensor; associating the input with one of a plurality of predetermined scenes; receiving an audio signal; and applying a predetermined set of parameters to the audio signal, the predetermined set of parameters corresponding to the associated predetermined scene. The predetermined set of parameters includes changing the sound offset of the audio signal in the vehicle, applying an equalizer to the audio signal, applying spatial awareness processing to the audio signal, or any combination of the above. The method further includes playing the audio signal with the applied predetermined set of parameters.

Description

Technical Field

[0001] The present invention relates to a method for compensating for sound entering a vehicle compartment, a device for compensating for sound entering a vehicle compartment, and a vehicle. Background Technology

[0002] Spatial audio is a technique that creates a realistic three-dimensional sound experience by making sounds appear to originate from the listener's surroundings. It is gaining popularity in the headphone, earphone, speaker, and high-fidelity (Hi-Fi) industries. Unwanted noise can negatively impact spatial audio perception. For example, external noise from a controlled environment (such as noise outside headphones, noise outside a vehicle cabin, noise outside a house / apartment with Hi-Fi equipment, etc.) can permeate into that controlled environment and affect spatial perception. Similarly, internal noise from a controlled environment (e.g., humming or similar noise from electrical installations in a vehicle cabin) can also affect spatial perception.

[0003] This issue becomes particularly important with the increasing adoption of immersive sound upmixers (i.e., the process of generating additional speaker signals from source content with fewer channels) and native spatial audio formats (such as Dolby Atmos, Sony 360 Reality Audio, Samsung / Google Eclipsa Audio, etc.), as spatial experience is a key driver of listener satisfaction.

[0004] Current practices for parameterizing and evaluating these technologies typically take place in controlled, noise-free environments. This approach fails to capture the significant changes in spatial perception that occur during real-world conditions, such as real-world driving conditions.

[0005] Therefore, there is an urgent need for a practical arrangement that actively compensates for noise intrusion (e.g., for automotive audio systems) to ensure that the delivered spatial experience matches the designer's intentions across various scenarios (including, for example, various driving scenarios in a vehicle). Figure 1 To. Summary of the Invention

[0006] To achieve the above objectives, the present invention provides methods, apparatus and vehicles as described in the appended claims.

[0007] In a preferred embodiment, a method for compensating for sound intrusion into a vehicle cabin is provided. The method includes: receiving input from at least one sensor; associating the input with one of a plurality of predetermined scenarios; receiving an audio signal; and applying a predetermined set of parameters to the audio signal, the predetermined set of parameters corresponding to the associated predetermined scenario. The predetermined set of parameters includes altering the sound offset of the audio signal in the vehicle, applying an equalizer to the audio signal (spectral), applying a spatially aware filter and signal processing to the audio signal, or any combination of the above. The method further includes playing the audio signal with the applied predetermined set of parameters.

[0008] By matching inputs from at least one sensor (such as inputs from internal or external microphones, vehicle electronics, CAN bus messages, etc.) to a predetermined scenario, and by applying a predetermined set of parameters to the audio signal based on this scenario, the adverse effects of noise intrusion can be effectively mitigated for various driving conditions. Advantageously, it provides a consistent and immersive spatial audio experience for vehicle occupants under various driving conditions. In other words, the present invention provides an in-vehicle audio system, and specifically an in-vehicle spatial audio system, which can deliver a consistently high-quality spatial audio experience to vehicle occupants regardless of current noise conditions. Therefore, this allows next-generation upmixers and native spatial audio processors to deliver a superior spatial experience compared to older upmixers and native spatial audio processors.

[0009] In embodiments, the spatial perception filter includes one or more of the following: realigning the phantom center of the audio signal within the vehicle; or applying one or more signal processing operations (e.g., signal processing alteration operations) to one or more (spatially relevant) components of the audio signal to preserve psychoacoustic perception of spatial depth, surround, immersion, etc. These one or more signal processing alteration operations may include one or more of apparent source width (ASW), surround (LEV), perceived depth, source localization, spatial balance, or immersion. Advantageously, more detailed user attention can be provided, which improves the spatial perception and immersion of vehicle occupants.

[0010] In an embodiment, the input includes signals received from one or more microphones, processors, vehicle speed messages, auxiliary components of the vehicle (e.g., HVAC (heating, ventilation and air conditioning) systems, seat massage systems, or any other mechanical / electrical components that generate noise during operation), or any combination of the above.

[0011] Advantageously, it can effectively reduce noise ingress in a variety of scenarios, including external factors (such as wind noise, tire noise, etc.) and internal factors (such as internal vibrations from vehicle movement, sounds from auxiliary components of the vehicle such as HVAC (heating, ventilation and air conditioning) units or other components, or combinations of those factors).

[0012] In embodiments, the predetermined parameters further include adjusting the perceived volume and / or adjusting one or more parameters of the equalizer, and adjusting the energy emitted by subsystems related to spatial perception and psychoacoustic modeling signal processing. Advantageously, noise ingress can be mitigated more effectively by compensating for sound ingress with an increase in the volume of the audio signal and / or by adjusting the equalizer of the audio signal.

[0013] In an embodiment, the method further includes receiving a second input from one of the at least one sensors and determining a noise entry level inside the vehicle compartment based on the second input and the sensor type, wherein the noise entry level is determined when the audio signal is played with an applied predetermined set of parameters. The method further includes: adjusting at least one of the predetermined set of parameters corresponding to an associated predetermined scenario; applying the adjusted predetermined set of parameters to the audio signal; and playing the audio signal with the adjusted predetermined set of parameters applied to the audio signal.

[0014] Advantageously, it can provide dynamic integrated noise compensation for in-vehicle spatial audio systems in real time. By employing this integrated approach, the present invention aims to deliver a consistently high-quality spatial audio experience to vehicle occupants regardless of current noise conditions.

[0015] In an embodiment, the method further includes applying a test scenario to a vehicle, the test scenario including activating at least one component of the vehicle (e.g., engine, HVAC), driving the vehicle (e.g., for tire noise measurement, wind noise, etc.), applying physical forces to the vehicle (e.g., wind tunnel), playing sound outside the vehicle, or any combination of the above. The method further includes recording sound inside the vehicle using at least one microphone placed inside the vehicle's passenger compartment during the test scenario. The method further includes measuring a set of acoustic features of the sound at multiple locations inside the vehicle's passenger compartment, the set of acoustic features corresponding to one or more of the sound's volume, frequency range, or signal processing changes. The signal processing changes may include any combination of one or more of apparent source width (ASW), sense of envelopment (LEV), perceived depth, sound source localization, spatial balance, or sense of immersion. The method further includes: determining an algorithm for compensating the measured set of acoustic features, the algorithm including a set of parameters; and associating the test scenario and the set of parameters with a predetermined scenario.

[0016] Advantageously, a database of predetermined scenarios can be established, with each scenario associated with one or more "sound ingress" scenarios (e.g., a vehicle traveling at high speed, which may include external noise from wind and / or tires; a vehicle traveling in urban traffic, which may include external noise from the city; an HVAC system in a vehicle that has been turned on, which may include fan noise and / or other electrical noise, etc.). Therefore, the in-vehicle audio system, and specifically the in-vehicle spatial audio system, can be trained to automatically detect multiple scenarios to compensate for noise ingress from internal and / or external factors.

[0017] In an embodiment, the predetermined scenario includes tire noise, engine noise, transmission noise, suspension noise, noise from one or more electrical components of the vehicle, wind noise, or any combination of the above.

[0018] Advantageously, dynamic integrated noise compensation can be provided for a variety of scenarios, which may include mitigation of noise ingress targeting internal factors, external factors, or a combination of internal and external factors.

[0019] In a preferred embodiment, a device for a vehicle is provided. The device includes a memory and a processor. The processor is operable to: receive input from at least one sensor; associate the input with one of a plurality of predetermined scenes; receive an audio signal; and apply a predetermined set of parameters to the audio signal, the predetermined set of parameters corresponding to the associated predetermined scene. The predetermined set of parameters includes changing the sound offset of the audio signal in the vehicle, applying an equalizer to the audio signal, applying a spatially aware filter to the audio signal, or any combination thereof. The processor is further configured to transmit the audio signal to one or more speakers in the vehicle with the applied predetermined set of parameters.

[0020] By matching inputs from at least one sensor (such as inputs from internal or external microphones, vehicle electronics, etc.) to a predetermined scenario, and by applying a predetermined set of parameters to the audio signal based on that scenario, the adverse effects of noise intrusion can be effectively mitigated for various driving conditions. Advantageously, a device is provided that provides a consistent and immersive spatial audio experience for vehicle occupants under various driving conditions. In other words, the present invention provides an in-vehicle audio system, and more specifically an in-vehicle spatial audio system, which can deliver a consistently high-quality spatial audio experience to vehicle occupants regardless of current noise conditions. Therefore, this allows next-generation upmixers and native spatial audio processors to deliver a superior spatial experience compared to older upmixers and native spatial audio processors.

[0021] In embodiments, the spatial perception filter includes one or more of the following: realigning the phantom center of the audio signal within the vehicle; or applying one or more signal processing operations (e.g., signal processing alteration operations) to one or more (spatially relevant) components of the audio signal to preserve psychoacoustic perception of spatial depth, surround, immersion, etc. The one or more signal processing alteration operations may include one or more of apparent source width (ASW), surround (LEV), perceived depth, source localization, spatial balance, or immersion. Advantageously, more detailed user attention can be provided, which improves the spatial perception and immersion of vehicle occupants.

[0022] In an embodiment, the input includes signals received from one or more microphones, processors, auxiliary components of the vehicle (e.g., HVAC (heating, ventilation and air conditioning) systems, seat massage systems, or any other mechanical / electrical components that generate noise during operation), or any combination of the above.

[0023] Advantageously, it can effectively reduce noise ingress in a variety of scenarios, including external factors (such as wind noise, tire noise, etc.) and internal factors (such as internal vibrations from vehicle movement, sounds from auxiliary components of the vehicle such as HVAC (heating, ventilation and air conditioning) units or other components, or combinations of those factors).

[0024] In one embodiment, the processor is further configured to adjust the perceived volume, adjust one or more parameters of the equalizer, and / or adjust the energy emitted by the subsystems associated with spatial perception and psychoacoustic modeling signal processing for the predetermined parameters.

[0025] Advantageously, noise ingress can be reduced more effectively by compensating for sound ingress with the volume of the audio signal and / or by increasing the volume of the base equalizer.

[0026] In an embodiment, the processor is further configured to receive a second input from one of the at least one sensors and determine a noise entry level inside the vehicle cabin based on the second input and the sensor type, wherein the noise entry level is determined when the audio signal is played with an applied predetermined set of parameters. The processor is further configured to: adjust at least one of a predetermined set of parameters corresponding to an associated predetermined scenario; apply the adjusted predetermined set of parameters to the audio signal; and transmit the audio signal to one or more speakers in the vehicle with the adjusted predetermined set of parameters applied to the audio signal.

[0027] Advantageously, it can provide dynamic integrated noise compensation for in-vehicle spatial audio systems in real time. By employing this integrated approach, the present invention aims to deliver a consistently high-quality spatial audio experience to vehicle occupants regardless of current noise conditions.

[0028] In an embodiment, the processor is further configured to receive from a microphone a signal corresponding to sound recorded inside the vehicle compartment during a test scenario. The test scenario includes activating at least one component of the vehicle (e.g., engine, tires, HVAC), applying physical force to the vehicle, driving the vehicle, playing sound outside the vehicle, or any combination of the above. The processor is further configured to determine a set of acoustic features of the sound at multiple locations inside the vehicle compartment based on the signal, the set of acoustic features corresponding to the volume of the sound, the frequency range of the sound, or a combination of the above. The processor is further configured to: determine an algorithm for compensating the measured set of acoustic features, the algorithm including a set of parameters; and associate the test scenario and the set of parameters with a predetermined scenario.

[0029] Advantageously, a database of predetermined scenarios can be established, with each scenario associated with one or more "sound ingress" scenarios (e.g., a vehicle traveling at high speed, which may include external noise from wind and / or tires; a vehicle traveling in urban traffic, which may include external noise from the city; an HVAC system in a vehicle that has been turned on, which may include fan noise and / or other electrical noise, etc.). Therefore, the in-vehicle audio system, and specifically the in-vehicle spatial audio system, can be trained to automatically detect multiple scenarios to compensate for noise ingress from internal and / or external factors.

[0030] In an embodiment, the predetermined scenario includes tire noise, engine noise, transmission noise, suspension noise, noise from one or more electrical components of the vehicle, wind noise, or any combination of the above.

[0031] Advantageously, dynamic integrated noise compensation can be provided for a variety of scenarios, which may include mitigation of noise ingress targeting internal factors, external factors, or a combination of internal and external factors.

[0032] In a preferred embodiment, a vehicle is provided. The vehicle includes at least one speaker, at least one microphone, and the devices described above.

[0033] Advantageously, a vehicle is provided that can provide a consistent and immersive spatial audio experience for vehicle occupants under a variety of driving conditions. Attached Figure Description

[0034] The features, aspects and advantages of this disclosure may become more apparent from the following detailed description set forth in conjunction with the accompanying drawings, in which the same reference numerals refer to similar elements.

[0035] Figure 1 An example is shown where a vehicle experiences both sounds from outside the vehicle and sounds from inside the vehicle.

[0036] Figure 2 A computer including a processor and memory according to the present invention is shown;

[0037] Figure 3 The invention illustrates a system comprising one or more loudspeakers, one or more microphones, and... Figure 2 The computer vehicle;

[0038] Figure 4 A flowchart is depicted illustrating a method for compensating for sound entry into a vehicle compartment according to the present invention.

[0039] Figure 5 A flowchart illustrating an alternative method for compensating for sound entry into a vehicle compartment according to an alternative embodiment of the present invention is described; and

[0040] Figure 6 A flowchart depicts an alternative method for compensating for sound entry into a vehicle compartment according to an alternative embodiment of the present invention. Detailed Implementation

[0041] Figure 1 Vehicle 100 and vehicle interior 102 are shown. The depicted vehicle interior 102 (i.e., the vehicle's passenger compartment) shows a front view of the vehicle's interior and dashboard. Vehicle interior 102 is not limited to this example and includes all components, arrangements, systems, and features within the vehicle's passenger compartment. Vehicle passenger compartment 102 may include an in-vehicle audio system (such as...). Figure 3 As described above, the in-vehicle audio system can play audio (e.g., music, audiobooks, navigation instructions, or any other audio content) to one or more vehicle occupants. Figure 1 Various sounds 104a-104e are shown, either from vehicle 100 or from the environment surrounding vehicle 100. These various sounds 104a-104e can be considered as noise, and specifically as unwanted noise from one or more vehicle occupants inside the vehicle's cabin 102 while listening to audio content played by the vehicle's audio system.

[0042] This invention provides a method and apparatus for compensating for unwanted noise 104a-104e. In embodiments, compensating for unwanted noise 104a-104e may include (for example, by means of the following text) Figure 2The computer processor described herein applies algorithms to audio content (i.e., audio signals including music, audiobooks, navigation instructions, etc.) to compensate for unwanted noise 104a-104e.

[0043] These noises may include one or more external noises 104a, 104b, 104c. The one or more external noises 104a-104c may include noises generated by the vehicle 100, such as engine noise 104a, exhaust pipe noise 104b, tire and / or road noise, transmission noise (e.g., during upshifting and / or downshifting), suspension noise (e.g., when driving on a bumpy road), wind noise (e.g., due to high-speed vehicle travel), or any other noise generated by one or more components outside the vehicle compartment 102. The one or more external noises 104a-104c may also include noise caused by the environment 104c of the vehicle 100. The ambient noise 104 may include noise caused by weather (e.g., rain, hail, wind, snow, etc.), noise caused by other vehicles near vehicle 100 (e.g., engine noise, horn sound, or similar noise during traffic), noise caused by one or more people nearby (e.g., pedestrians talking, shouting, singing, etc.), noise caused by one or more animals nearby (e.g., dog barking, bird chirping, etc.), noise from machinery or other auxiliary devices (e.g., factory noise, etc.), or any other type of noise that may be in the vicinity of vehicle 100.

[0044] These noises may include one or more internal noises 104d, 104e. These internal noises 104d, 104e may include noise generated by components of vehicle 100 within the vehicle compartment 102. For example, current vehicles have multiple auxiliary electromechanical components that may include an HVAC system, massage chairs, motors for other moving parts, etc. Each of these internal electromechanical components may generate a noise level when activated (e.g., an HVAC system blows air when activated, which may include noise from a fan and perceived noise due to air movement).

[0045] This algorithm dynamically maintains the spatial properties of the in-vehicle audio system (and thus the audio playback performed by the in-vehicle audio system) across various driving conditions by mitigating the effects of noise ingress from one or more noises 104a-104e as described above. For example, when one or more sensors (e.g., one or more internal and / or external microphones and / or a GPS navigation system) detect that vehicle 100 is driving through a city, the in-vehicle audio system can select a predetermined algorithm to compensate for external ambient noise 104c, which may include noise from one or more other vehicles, one or more pedestrians, one or more dogs, etc. In another example, when highway driving is detected (e.g., by a GPS navigation system, by a speedometer, by one or more microphones that detect tire and / or wind noise), the in-vehicle audio system can select a predetermined algorithm to compensate for engine noise 104a, wind noise, and tire noise. When excessive engine noise 104a and / or exhaust noise 104b is detected, the in-vehicle audio system can select a predetermined algorithm to compensate for engine noise 104a and / or exhaust noise 104b. The above examples are intended only to provide an understanding of the invention. The types of noise detected, the ways in which they are detected, and the types of predetermined algorithms are not limited to the examples above.

[0046] In one embodiment, the algorithm includes applying a psychoacoustic model. This model analyzes real-time data (e.g., one or more of noise 104a-104e) from onboard sensors (e.g., one or more microphones, accelerometers, etc.) and vehicle information (e.g., vehicle speed, volume of the played audio content, or other audio settings, etc.) to estimate the overall noise level. Based on this estimate, the computer can select a predetermined algorithm to compensate for the overall noise level. Alternatively or additionally, the algorithm can dynamically adjust one or more parameters of the selected predetermined algorithm. Each predetermined algorithm may include multiple high-level attributes (or parameters) of spatial perception, which may include surround (perceived immersion), image width and depth (perceived lateral and longitudinal localization of the sound source), and apparent localization of sound events within the vehicle's cabin 102.

[0047] In an embodiment, each predetermined algorithm may be trained during a training phase. This training phase may include recording one or more types of noise (e.g., one or more of noises 104a-104e) in the vehicle compartment 102 in a test scenario and applying one or more audio parameters to the input audio signal. These one or more audio parameters may be manually adjusted during the training phase to minimize the noise ingress level without affecting the sound quality of the audio signal. This training phase may include (e.g., with a trained group) manually conducting one or more listening tests to evaluate the noise compensation effectiveness of each determined algorithm (each determined scenario) in maintaining desired spatial perception under different noise conditions.

[0048] The algorithm adjusts one or more parameters using various signal processing techniques. For example, the algorithm may include system equalization for customizing the frequency response to compensate for noise-induced frequency masking. The algorithm may include speaker gain and delay functions for manipulating the perceived location of sound sources. The algorithm may include channel processing for optimizing the processing of individual audio channels to enhance spatial effects. The algorithm can control surround and immersive upmixer parameters to maintain a consistent spatial experience despite noise variations. By employing this comprehensive approach, the present invention provides vehicle occupants with a consistently high-quality spatial audio experience regardless of prevailing noise conditions.

[0049] Figure 2 A device 202 (e.g., a computer) is depicted, including a processor 204, a memory 206, and an input / output (I / O) interface 208. The processor 204 is operable to execute a set of actions and / or instructions that can be stored in the memory 206. This set of actions may include the algorithm and / or as described above. Figure 1 One or more predetermined algorithms as described herein. Computer 202 may be a separate unit dedicated to performing the methods and steps as defined herein (e.g., as described below). Figures 4 to 6 (As described in the text). Computer 202 can be a vehicle (e.g., Figure 1 Vehicle 100 or below described in the text Figure 3 The electronic control unit (ECU) of the vehicle described herein. Alternatively, the computer 202 may be part of the vehicle's ECU (e.g., as described herein). Figure 1 or Figure 3 (The vehicle described in the text).

[0050] Processor 204 receives data from the vehicle (e.g., this document). Figure 1 and Figure 3 The input is from at least one sensor of the vehicle described herein. In an embodiment, this input includes signals received from one or more microphones, processors, auxiliary components of the vehicle (e.g., HVAC (heating, ventilation, and air conditioning) systems, seat massage systems, or any other mechanical / electrical components that generate noise during operation), or any combination of the above. Advantageously, noise ingress can be effectively mitigated for a variety of scenarios, including external factors (such as wind noise, tire noise, etc.), internal factors (such as internal vibrations from vehicle movement, sounds emitted from auxiliary components of the vehicle such as HVAC (heating, ventilation, and air conditioning) units or other components, or combinations of those factors).

[0051] Multiple pre-defined scenarios (as mentioned above) Figure 1 The predetermined algorithm described herein (corresponding to the predetermined algorithm) can be stored in memory 206. Each predetermined scene may include a set of predetermined parameters. Each predetermined parameter may be an audio parameter.

[0052] Upon receiving an input, processor 204 associates or matches the input with one of a plurality of predetermined scenarios stored in memory 206. Associating or matching the input may include determining that the input was received from a particular sensor and that the input received from that particular sensor is matched with a predetermined scenario linked to that particular sensor (in other words, the predetermined scenario is a predetermined algorithm that can compensate for noise input received from that particular sensor). The particular sensor may be, for example, an internal or external sensor. The particular sensor may be a sensor located in a specific part of the vehicle (e.g., inside a wheel arch or under a dashboard). Associating or matching the input may include determining that the input corresponds to an audio input that matches (i.e., is similar to or identical to) a pre-recorded audio file linked to a predetermined scenario. For example, the input may be an audio input that matches tire noise, engine noise, exhaust noise, or any other noise as described above. A predetermined scenario may be linked to one or more of the noises described above. For example, a predetermined scenario may be linked to tire noise. A predetermined scenario may be linked to two or more types of noise (e.g., tire noise and engine noise). Predefined scenarios can be linked to noise types and subtypes within those noise types. For example, a predetermined scenario can be linked to a specific tire noise, and different predetermined scenarios can be linked to different tire noises. Input can be a signal sent from vehicle auxiliary components (e.g., HVAC system, speedometer, navigation system, etc.) to processor 204. Processor 204 can match the reception of this signal with a predetermined scenario (e.g., linked to the activation of the HVAC system, indication of a vehicle speed, vehicle position, etc.).

[0053] These examples are provided only as examples, and the number of different predefined scenarios and input types is not limited to these examples.

[0054] Processor 204 receives an audio signal (which may be stored on memory 206 or in physical and / or cloud media coupled to computer 202). The audio signal may be a data file, such as, but not limited to, music, audiobooks, navigation instructions, etc. After associating / matching the input with one of a plurality of predetermined scenes stored on memory 206, processor 204 selects the associated / matched predetermined scene and applies a predetermined set of parameters of the associated / matched predetermined scene to the audio signal.

[0055] The predetermined set of parameters includes altering the sound offset of the audio signal in the vehicle, applying an equalizer to the audio signal, applying a spatially perceptual filter to the audio signal, or any combination thereof. The processor 204 sends the audio signal to one or more speakers in the vehicle with the applied predetermined set of parameters, wherein the audio signal will be played to the occupants of the vehicle in the vehicle compartment 102.

[0056] By matching inputs from at least one sensor (such as inputs from internal or external microphones, vehicle electronics, etc.) to a predetermined scenario, and by applying a predetermined set of parameters to the audio signal based on that scenario, the adverse effects of noise intrusion can be effectively mitigated for various driving conditions. Advantageously, a device is provided that provides a consistent and immersive spatial audio experience for vehicle occupants under various driving conditions. In other words, the present invention provides an in-vehicle audio system, and more specifically an in-vehicle spatial audio system, which can deliver a consistently high-quality spatial audio experience to vehicle occupants regardless of current noise conditions. Therefore, this allows next-generation upmixers and native spatial audio processors to deliver a superior spatial experience compared to older upmixers and native spatial audio processors.

[0057] In an embodiment, the one or more sensors may include one or more microphones, one or more cameras, one or more motion sensors, accelerometers, position sensors (e.g., navigation systems such as GPS, GLONASS, or similar navigation systems), one or more touch sensors, or any other type of sensor.

[0058] Spatial perception filters may include one or more of the following: realigning the phantom center of the audio signal within the vehicle; or applying one or more signal processing operations (e.g., signal processing alteration operations) to one or more (spatially relevant) components of the audio signal to preserve psychoacoustic perception of spatial depth, surround, immersion, etc. These one or more signal processing alteration operations may include one or more of apparent source width (ASW), surround (LEV), perceived depth, source localization, spatial balance, or immersion. Advantageously, more detailed user attention can be provided, which improves the spatial perception and immersion of vehicle occupants.

[0059] Adjusting predetermined parameters may further include the processor 204 adjusting the perceived volume of the audio input. The perceived volume is the loudness level of the audio input to be played by the vehicle's speakers as perceived by the vehicle occupants. If significant noise is entering, the perceived volume may be lower than (i.e., quieter than) the actual volume set by the computer 202 (or manually by the vehicle occupants). This is because noise entering will set a new baseline volume for the vehicle occupants and may drown out the audio input played by the speakers. For example, if audio is played in a stationary vehicle in a quiet environment (i.e., with little or no noise entering), and that audio is set to a specific volume level (e.g., level 10 out of 15), the vehicle occupants may perceive this volume as “loud.” However, if that volume is not adjusted, and the vehicle is now traveling at high speed along a highway, the vehicle may experience significant noise entering the cabin (e.g., tire noise, wind noise, engine noise, etc.). This noise entering increases the overall volume in the vehicle cabin 102, meaning the volume of the played audio is lower relative to the noise entering (although still at level 10 out of 15). Therefore, vehicle occupants can now perceive audio being played at a “quiet” level. In this case, increasing the perceived volume could include increasing the actual volume (e.g., to level 13 out of 15) so that the volume of the played audio is “loud” relative to the noise entering.

[0060] Alternatively or additionally, processor 204 may adjust one or more parameters of the equalizer. This may include increasing the fundamental parameters of the equalizer (e.g., the fundamental level compared to the treble and midrange). Noise ingress can attenuate the fundamental range of audio played by the vehicle's speakers. Alternatively or additionally, processor 204 may adjust the energy emitted by subsystems related to spatial perception and psychoacoustic modeling of signal processing. Therefore, increasing the fundamental range can help to effectively reduce noise ingress. Advantageously, noise ingress can be reduced more effectively by compensating for sound ingress with the volume of the audio signal and / or by increasing the fundamental equalizer.

[0061] Processor 204 may be further configured to receive a second input from one of at least one sensor. The second input may be received after the first input. This second input may include a signal received from one or more microphones, the processor, auxiliary components of the vehicle (e.g., an HVAC (heating, ventilation, and air conditioning) system, a seat massage system, or any other mechanical / electrical component that generates noise during operation), or any combination of the above. Processor 204 may determine the noise entry level inside the vehicle cabin based on the second input and on the sensor type (e.g., microphone, camera, motion sensor, touch sensor, navigation, interior sensor, exterior sensor, etc.). The noise entry level is determined when the audio signal is played with an applied set of predetermined parameters. Processor 204 may adjust at least one of the predetermined parameter sets corresponding to an associated predetermined scenario and then apply the adjusted predetermined parameter set to the audio signal. Processor 204 may then transmit the audio signal to one or more speakers in the vehicle with the adjusted predetermined parameter set applied to the audio signal.

[0062] Advantageously, it can provide dynamic integrated noise compensation for in-vehicle spatial audio systems in real time. By employing this integrated approach, the present invention aims to deliver a consistently high-quality spatial audio experience to vehicle occupants regardless of current noise conditions.

[0063] In this embodiment, each predetermined scenario (algorithm) can be determined during the training phase, as described above. Figure 1 As described above. During this training phase, processor 204 can receive signals from one or more sensors (such as microphones that may be in or outside the vehicle compartment 102) corresponding to sounds recorded inside the vehicle compartment during a test scenario. The test scenario may include activating at least one component of the vehicle (e.g., activating the engine, driving the vehicle, activating HVAC). The test scenario may include applying physical forces to the vehicle (e.g., applying wind to the vehicle in a wind tunnel). The test scenario may include driving the vehicle. The test scenario may include playing one or more sounds outside the vehicle (one or more sounds corresponding to, for example, ambient sound 104c as described above). The test scenario may include any combination of the above. Processor 204 can determine a set of acoustic features of the sound at multiple locations inside the vehicle compartment based on the signal, the set of acoustic features corresponding to the volume of the sound, the frequency range of the sound, or a combination of the above. Processor 204 can determine an algorithm for compensating the measured set of acoustic features, the algorithm including a set of parameters. Processor 204 can associate (i.e., match, link) the test scenario and the set of parameters with a predetermined scenario.

[0064] Advantageously, a database of predetermined scenarios can be established, with each scenario associated with one or more "sound ingress" scenarios (e.g., a vehicle traveling at high speed, which may include external noise from wind and / or tires; a vehicle traveling in urban traffic, which may include external noise from the city; an HVAC system in a vehicle that has been turned on, which may include fan noise and / or other electrical noise, etc.). Therefore, the in-vehicle audio system, and specifically the in-vehicle spatial audio system, can be trained to automatically detect multiple scenarios to compensate for noise ingress from internal and / or external factors.

[0065] In embodiments, predetermined scenarios may include tire noise, engine noise, transmission noise, suspension noise, noise from one or more electrical components of the vehicle, wind noise, ambient noise, or any combination of the above. Advantageously, dynamic integrated noise compensation can be provided for multiple scenarios, which may include mitigating noise ingress for internal factors, external factors, or a combination of internal and external factors.

[0066] Figure 3 Vehicle 302 is shown, which includes, for example... Figure 2 The device 202, one or more microphones 304, and one or more speakers 306 are described herein. Device 202 is coupled to one or more speakers 306 via a wired or wireless connection. Device 202 can be coupled to one or more speakers 306 (via wired or wireless connection). Vehicle 302 can be connected to... Figure 1 The vehicle 100 described herein refers to the same vehicle. The one or more microphones may be located inside or outside the vehicle compartment 102. The one or more speakers may be located inside the vehicle compartment 102. The one or more speakers may be speakers including one or more drivers, individual drivers, or any type of playback device capable of playing audio content (including any type of playback device capable of playing audio and other types of content). Vehicle 302 may include one or more sensors (not shown). The one or more sensors may each be coupled to device 202 (via wired or wireless connection). The one or more sensors may include one or more microphones, one or more cameras, one or more motion sensors, accelerometers, position sensors (e.g., navigation systems such as GPS, GLONASS, or similar navigation systems), one or more touch sensors, or any other type of sensor.

[0067] Advantageously, a vehicle is provided that can provide a consistent and immersive spatial audio experience for vehicle occupants under a variety of driving conditions.

[0068] Figure 4 The invention is illustrated as described above. Figure 1 , Figure 2 and Figure 3A flowchart of the method 400 for compensating for sound intrusion into a vehicle compartment. The method includes receiving input from at least one sensor at 402 and associating that input with one of a plurality of predetermined scenes at 404. The method includes receiving an audio signal at 406. The method includes applying a predetermined set of parameters to the audio signal at 408, the predetermined set of parameters corresponding to the associated predetermined scene. The predetermined set of parameters includes changing the sound offset of the audio signal in the vehicle, applying an equalizer to the audio signal (spectral), applying a spatially aware filter to the audio signal, or any combination of the above. The method further includes playing the audio signal at 410 with the applied predetermined set of parameters.

[0069] By matching inputs from at least one sensor (such as inputs from internal or external microphones, vehicle electronics, etc.) to a predetermined scenario, and by applying a predetermined set of parameters to the audio signal based on this predetermined scenario, the adverse effects of noise intrusion can be effectively mitigated for various driving conditions. Advantageously, it provides a consistent and immersive spatial audio experience for vehicle occupants under various driving conditions. In other words, the present invention provides an in-vehicle audio system, and specifically an in-vehicle spatial audio system, which can deliver a consistently high-quality spatial audio experience to vehicle occupants regardless of current noise conditions. Therefore, this allows next-generation upmixers and native spatial audio processors to deliver a superior spatial experience compared to older upmixers and native spatial audio processors.

[0070] In embodiments, the spatial perception filter may include one or more of the following: realigning the phantom center of the audio signal within the vehicle; or applying one or more signal processing operations (e.g., signal processing alteration operations) to one or more (spatially relevant) components of the audio signal to preserve psychoacoustic perception of spatial depth, surround, immersion, etc. The one or more signal processing alteration operations may include one or more of apparent source width (ASW), surround (LEV), perceived depth, source localization, spatial balance, or immersion. Advantageously, more detailed user attention can be provided, which improves the spatial perception and immersion of vehicle occupants.

[0071] In an embodiment, the input includes signals received from one or more microphones, processors, auxiliary components of the vehicle (e.g., HVAC (heating, ventilation and air conditioning) systems, seat massage systems, or any other mechanical / electrical components that generate noise during operation), or any combination of the above.

[0072] Advantageously, it can effectively reduce noise ingress in a variety of scenarios, including external factors (such as wind noise, tire noise, etc.) and internal factors (such as internal vibrations from vehicle movement, sounds from auxiliary components of the vehicle such as HVAC (heating, ventilation and air conditioning) units or other components, or combinations of those factors).

[0073] In embodiments, the predetermined parameters further include adjusting the perceived volume, adjusting one or more parameters of the equalizer, and / or adjusting the energy emitted by the subsystems associated with spatial perception and psychoacoustic modeling signal processing. Advantageously, noise ingress can be mitigated more effectively by compensating for sound ingress with the increase in the volume of the audio signal and / or the base equalizer.

[0074] In an embodiment, the predetermined scenario includes tire noise, engine noise, transmission noise, suspension noise, noise from one or more electrical components of the vehicle, wind noise, or any combination of the above.

[0075] Advantageously, dynamic integrated noise compensation can be provided for a variety of scenarios, which may include mitigation of noise ingress targeting internal factors, external factors, or a combination of internal and external factors.

[0076] Figure 5 Additional method steps for compensating for audio intrusion in a vehicle compartment are shown, which can be related to the above description. Figure 4 The methods described above and referenced above Figure 1 , Figure 2 and Figure 3 The aforementioned arrangement is combined.

[0077] The method may include receiving a second input at 502 from one of at least one sensor. The method may include determining a noise entry level inside the vehicle compartment at 504 based on the second input and on the sensor type, wherein the noise entry level is determined while playing an audio signal with an applied predetermined set of parameters. The method may further include adjusting at 506 at at least one of the predetermined set of parameters corresponding to an associated predetermined scenario. The method may further include applying the adjusted predetermined set of parameters to the audio signal at 508. At 510, the method may include playing the audio signal with the adjusted predetermined set of parameters applied to the audio signal.

[0078] Advantageously, it can provide dynamic integrated noise compensation for in-vehicle spatial audio systems in real time. By employing this integrated approach, the present invention aims to deliver a consistently high-quality spatial audio experience to vehicle occupants regardless of current noise conditions.

[0079] Figure 6Additional method steps for compensating for audio intrusion in a vehicle compartment are shown, which can be related to the above description. Figure 4 and Figure 5 The methods described above and referenced above Figure 1 , Figure 2 and Figure 3 The aforementioned arrangement is combined.

[0080] The method may include applying a test scenario to a vehicle at 602, the test scenario including activating at least one component of the vehicle (e.g., engine, HVAC), driving the vehicle (e.g., for tire noise measurement, wind noise, etc.), applying physical forces to the vehicle (e.g., wind tunnel), playing sound outside the vehicle, or any combination of the above. The method may further include recording sound inside the vehicle using at least one microphone placed inside the vehicle's cabin during the test scenario at 604. The method may further include measuring a set of acoustic features of the sound at multiple locations inside the vehicle's cabin at 606, the set of acoustic features corresponding to one or more of the sound's volume, frequency range, or signal processing changes. The signal processing changes may include one or more of apparent source width (ASW), sense of envelopment (LEV), perceived depth, source localization, spatial balance, or sense of immersion. The method may further include determining an algorithm at 608 for compensating the measured set of acoustic features, the algorithm including a set of parameters. The method may further include associating the test scenario and the set of parameters with a predetermined scenario at 610.

[0081] Advantageously, a database of predetermined scenarios can be established, with each scenario associated with one or more "sound ingress" scenarios (e.g., a vehicle traveling at high speed, which may include external noise from wind and / or tires; a vehicle traveling in urban traffic, which may include external noise from the city; an HVAC system in a vehicle that has been turned on, which may include fan noise and / or other electrical noise, etc.). Therefore, the in-vehicle audio system, and specifically the in-vehicle spatial audio system, can be trained to automatically detect multiple scenarios to compensate for noise ingress from internal and / or external factors.

Claims

1. A method for compensating for sound entering a vehicle compartment, the method comprising: Receives input from at least one sensor; Associate the input with one of a plurality of predetermined scenarios; Receive audio signals; A predetermined set of parameters is applied to the audio signal, the predetermined set of parameters corresponding to a predetermined scene, wherein the predetermined set of parameters includes: Change the sound offset of the audio signal in the vehicle. Apply an equalizer to the audio signal. Apply a spatially perceptual filter to the audio signal, or Any combination of the above; and The audio signal is played with the predetermined set of applied parameters.

2. The method of claim 1, wherein the spatial sensing filter comprises one or more of the following: Realign the phantom center of the audio signal in the vehicle; or One or more signal processing modification operations are applied to one or more components of the audio signal, the one or more signal processing modification operations including one or more of the following: Apparent Sound Source Width (ASW) Sense of Envelopment (LEV) Depth of perception Sound source localization Spatial balance, or Immersive experience.

3. The method of claim 1 or 2, wherein the input comprises a signal received from: One or more microphones; processor; The vehicle's auxiliary components; or Any combination of the above.

4. The method of claims 1 to 3, wherein the predetermined parameter further comprises: Adjust the perceived volume; Adjust one or more parameters of the equalizer; and / or Adjust the energy emitted by subsystems related to spatial perception and psychoacoustic modeling of signal processing.

5. The method of claims 1 to 4, further comprising: Receive a second input from one of the at least one sensors; The noise entry level inside the vehicle compartment is determined based on the second input and the sensor type, wherein the noise entry level is determined when the audio signal is played with a predetermined set of applied parameters. Adjust at least one of the predetermined parameters corresponding to the associated predetermined scenario; The adjusted set of predetermined parameters is applied to the audio signal; as well as The audio signal is played with the adjusted predetermined set of parameters applied to it.

6. The method of claims 1 to 5, further comprising: The test scenario is applied to the vehicle, and the test scenario includes: Enable at least one component of the vehicle. Driving the vehicle, applying physical force to the vehicle, Playing sound outside the vehicle, or Any combination of the above; During the test scenario of the vehicle, the sound inside the vehicle is recorded using at least one microphone placed inside the vehicle compartment; The sound feature set is measured at multiple locations inside the vehicle compartment, and the sound feature set corresponds to one or more of the following: The volume of the sound, The frequency range of the sound, or Signal processing changes, including one or more of the following: Apparent Sound Source Width (ASW) Sense of Envelopment (LEV) Depth of perception Sound source localization Spatial balance, or immersion; An algorithm is determined for compensating a set of measured sound features, the algorithm comprising a set of parameters; and The test scenario and the parameter set are associated with a predetermined scenario.

7. The method of claim 6, wherein the predetermined scenario includes: Tire noise; Engine noise; Transmission noise; Suspension noise; Noise originating from one or more electrical components of the vehicle; Wind noise; or Any combination of the above.

8. An apparatus for a vehicle, the apparatus comprising: Memory; as well as Processor, the processor being operable to: Receives input from at least one sensor; The input is associated with one of a plurality of predetermined scenarios stored in the memory; Receive audio signals; A predetermined set of parameters is applied to the audio signal, the predetermined set of parameters corresponding to a predetermined scene, wherein the predetermined set of parameters includes: Change the sound offset of the audio signal in the vehicle. Apply an equalizer to the audio signal. Apply a spatially perceptual filter to the audio signal, or Any combination of the above; as well as The audio signal is transmitted to one or more speakers of the vehicle, provided that a predetermined set of parameters is applied.

9. The device of claim 8, wherein the spatial sensing filter comprises one or more of the following: Realign the phantom center of the audio signal in the vehicle; or One or more signal processing modification operations are applied to one or more components of the audio signal, the one or more signal processing modification operations including one or more of the following: Apparent Sound Source Width (ASW) Sense of Envelopment (LEV) Depth of perception Sound source localization Spatial balance, or Immersive experience.

10. The device of claim 8 or 9, wherein the input includes a signal received from: One or more microphones; processor; The vehicle's auxiliary components; or Any combination of the above.

11. The device of any one of claims 8 to 10, wherein the processor is further configured to: Adjust the perceived volume; Adjust one or more parameters of the equalizer; and / or Adjust the energy emitted by subsystems related to spatial perception and psychoacoustic modeling of signal processing.

12. The device of any one of claims 8 to 11, wherein the processor is further configured to: Receive a second input from one of the at least one sensors; The noise entry level inside the vehicle compartment is determined based on the second input and the sensor type, wherein the noise entry level is determined when the audio signal is played with a predetermined set of applied parameters. Adjust at least one of the predetermined parameters corresponding to the associated predetermined scenario; The adjusted set of predetermined parameters is applied to the audio signal; as well as The audio signal is transmitted to one or more speakers of the vehicle with the adjusted predetermined set of parameters applied to the audio signal.

13. The device of any one of claims 1 to 12, wherein the processor is further configured to: Receive from a microphone a signal corresponding to sound recorded inside the vehicle compartment during a test scenario in the vehicle, wherein the test scenario includes: Enable at least one component of the vehicle. Apply physical force to the vehicle. Playing sound outside the vehicle, or Any combination of the above; Based on the signal, a set of acoustic features of the sound is determined at multiple locations inside the vehicle compartment, the set of acoustic features corresponding to the following: The volume of the sound, The frequency range of the sound, or The combination of the above; An algorithm is determined for compensating a set of measured sound features, the algorithm comprising a set of parameters; and The test scenario and the parameter set are associated with a predetermined scenario.

14. The device of claim 13, wherein the predetermined scenario includes: Tire noise; Engine noise; Transmission noise; Suspension noise; Noise originating from one or more electrical components of the vehicle; Wind noise; or Any combination of the above.

15. A vehicle comprising: At least one speaker; At least one microphone; as well as The device as described in claims 7 to 14.

Images