A vehicle-mounted multi-sound-source dynamic spatialization and interrupt priority management method and system

Abstract

This invention relates to the field of vehicle terminal software technology, and more particularly to a method and system for dynamic spatialization and interruption priority management of multiple audio sources in a vehicle. The method includes: receiving a user-inputted audio source location configuration command, the command being used to specify independent virtual sound field coordinates for different types of audio sources; receiving a user-inputted interruption priority configuration command, generating and storing an audio source interruption priority list; during the audio mixing stage, spatially rendering the audio sources according to the independent virtual sound field coordinates assigned to each audio source, so that different types of audio sources have different perceived locations in the in-vehicle sound field; when multiple audio sources request playback simultaneously, performing audio playback arbitration according to the audio source interruption priority list. This invention solves the problems of auditory confusion and information omission among multiple audio sources by assigning independent virtual sound field coordinates to different audio sources and allowing users to customize interruption priorities.

Description

Technical Field

[0001] This application relates to the field of vehicle terminal software technology, and in particular to a method and system for vehicle-mounted multi-source dynamic spatialization and interruption priority management. Background Technology

[0002] As automobiles become increasingly intelligent, modern car cabins integrate various audio sources, including but not limited to navigation voice prompts, multimedia entertainment, telephone calls, advanced driver assistance system alarm sounds, and vehicle status feedback sounds. How to efficiently and clearly convey this audio information to users has become a key issue.

[0003] Currently, mainstream in-vehicle audio management systems typically employ a combination of static priority queues and fixed sound field layouts. Their typical processing logic is as follows: the system pre-defines a strict audio interruption order, for example, emergency alarms are the highest priority, followed by navigation and telephone calls, and finally media; the sound source locations of various audio sources are hard-coded at the software level, with most alert tones set to be emitted from the driver's side in front, conforming to the traditional logic of "driver priority"; when a high-priority sound is triggered, low-priority sounds are immediately reduced in volume or interrupted.

[0004] While the above solutions are logically simple and easy to implement, they reveal significant shortcomings in complex real-world driving scenarios. First, there is auditory confusion due to overlapping sound fields. Because navigation, phone calls, and notification tones share the same front left channel, when multiple voices are emitted simultaneously, the sound images in physical space completely overlap, making it difficult for the human ear to distinguish between two sounds from the same direction. This results in users not being able to hear navigation instructions or the content of the call clearly. The root cause is that the existing system lacks the ability to dynamically locate the sound image of a single sound source and cannot utilize the difference in hearing between the two ears to separate the sound source. Second, there is information loss due to rigid interruption logic. In scenarios such as long-distance driving, if navigation intervenes while the user is making an important call, according to inherent limitations, the call will be forcibly interrupted or avoided, disrupting information continuity and distracting the driver's attention. The root cause is that the system lacks user intent perception and cannot override the default "one-size-fits-all" priority through custom logic. Third, there is a lack of personalization and scenario adaptability. Different users have different needs regarding the spatial location of sound and interruption rules in different scenarios, and the existing system cannot provide fine-grained control. Summary of the Invention

[0005] The purpose of this invention is to provide a method and system for dynamic spatialization and interruption priority management of multiple audio sources in vehicles, so as to solve the problems of auditory confusion and information omission caused by static sound field layout and fixed priority interruption logic in the prior art.

[0006] This invention provides the following solution:

[0007] On one hand, the present invention provides a method for dynamic spatialization and interruption priority management of multiple audio sources in vehicles, including:

[0008] Receive user-input sound source location configuration instructions, which are used to specify independent virtual sound field coordinates for different types of sound sources;

[0009] Receive interruption priority configuration instructions from the user, generate and store a list of audio source interruption priorities;

[0010] During the audio mixing stage, the sound sources are spatially rendered based on the virtual sound field coordinates assigned to each sound source, so that different types of sound sources have different perceptual orientations in the in-vehicle sound field.

[0011] When multiple audio sources request playback simultaneously, audio playback arbitration is performed based on the audio source interruption priority list.

[0012] Furthermore, the independent virtual sound field coordinates include at least left-right balance parameters and front-back attenuation parameters.

[0013] Furthermore, it also includes:

[0014] A sound source orientation adjustment interface is provided, the interface including a sound field orientation adjuster;

[0015] In response to the user's operation on the sound field orientation adjuster, the sound source orientation configuration command is generated.

[0016] Furthermore, it also includes:

[0017] Provides a priority configuration interface that displays at least two audio source objects with configurable priorities;

[0018] In response to the user's drag-and-drop sorting operation on the audio source object, a list of audio source interruption priorities is generated.

[0019] Furthermore, audio playback arbitration is performed based on the aforementioned audio source interruption priority list, including:

[0020] In response to simultaneous requests for playback from the first audio source and the second audio source, and given that the first audio source has a lower priority than the second audio source, the system determines whether the first audio source is allowed to be interrupted based on its configuration information.

[0021] In response to the condition that the first audio source is not allowed to be interrupted, the first audio source and the second audio source are mixed and played.

[0022] In response to the first audio source being allowed to be interrupted, the operation of lowering the volume or pausing playback is performed on the first audio source.

[0023] Furthermore, the priority configuration interface also provides an option to allow interruption;

[0024] The method further includes: in response to a user selecting the "Allow Interruption" option for a certain audio source, generating configuration information for the audio source to be interrupted.

[0025] Furthermore, during spatial rendering, a head-related transfer function or a channel balancing algorithm is used to adjust the gain of different speakers to achieve the perceived orientation.

[0026] Furthermore, spatial rendering is performed using a channel balancing algorithm, including:

[0027] Based on the left-right balance parameters and front-back attenuation parameters in the independent virtual sound field coordinates, calculate the gain coefficient corresponding to each channel speaker;

[0028] The audio signal from the sound source is distributed to each channel speaker according to the gain coefficient for playback. By controlling the difference in the output sound pressure level of different speakers, the listener can perceive that the sound comes from the target direction.

[0029] Furthermore, spatial rendering is performed using header-related transfer functions, including:

[0030] A pair of head-related transfer function filters corresponding to the target virtual location are applied to the mono audio signal of the sound source to generate left channel signal and right channel signal respectively, so as to simulate the human ear's auditory perception of a real sound source from that location. The head-related transfer function filters include interaural time difference, interaural sound level difference and auricular spectral cues.

[0031] According to another aspect of the present invention, an in-vehicle multi-source dynamic spatialization and interruption priority management system is provided, comprising:

[0032] The sound source orientation configuration module is used to receive sound source orientation configuration instructions input by the user. The instructions are used to specify independent virtual sound field coordinates for different types of sound sources.

[0033] The priority list generation module is used to receive interruption priority configuration instructions input by the user, generate and store the audio source interruption priority list;

[0034] The spatial rendering processing module is used to perform spatial rendering on the sound sources in the audio mixing stage according to the independent virtual sound field coordinates assigned to each sound source, so that different types of sound sources have different perceptual orientations in the in-vehicle sound field.

[0035] The audio playback arbitration module is used to arbitrate audio playback based on the audio source interruption priority list when multiple audio sources request playback simultaneously.

[0036] The above solution achieves the following beneficial technical effects:

[0037] First, it significantly improves auditory clarity and driving safety. By assigning independent virtual sound field coordinates to different types of sound sources and spatially rendering them, multiple simultaneously emitted voices can be perceived from different locations within the vehicle. The scientific principle behind this is based on two points: one is the spatial demasking effect. According to auditory scene analysis theory, the human brain uses binaural cues to categorize sound streams from different spatial locations into different "auditory streams." Even if they overlap in the frequency domain, the brain can easily separate them, allowing the driver to "selectively listen" to one while ignoring the other. The second is cognitive load diversion. Fixed spatial locations provide additional contextual cues. Once the user's brain forms a "spatial-information" conditioned reflex, there is no need to expend extra attention to distinguish the source of the current sound, directly reducing the driver's cognitive load and improving reaction speed.

[0038] Second, it enhances user experience and sense of control. By providing users with customizable audio source interruption priority configurations, the decision-making power for audio interruption is delegated from the system firmware to the user. Users can freely define the "voice" of each sound according to the current scenario, realizing the transformation from "machine adapting to humans" to "humans commanding machines."

[0039] Third, the system boasts high flexibility and strong compatibility. This invention can be implemented through software algorithms based on existing in-vehicle audio hardware, resulting in low cost and easy integration into existing in-vehicle infotainment systems. Furthermore, spatial rendering can employ either a channel balancing algorithm or a head-related transfer function, allowing for flexible selection based on actual computing power and audio hardware configuration, achieving an optimal balance between cost and performance. Attached Figure Description

[0040] Figure 1 This is a flowchart of the in-vehicle multi-source dynamic spatialization and interruption priority management method of the present invention.

[0041] Figure 2 This is a schematic diagram of the structure of the vehicle-mounted multi-source dynamic spatialization and interruption priority management system of the present invention. Detailed Implementation

[0042] The technical solution of the present invention will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0043] It should be noted that all uses of "first" and "second" in the embodiments of the present invention are for the purpose of distinguishing two entities or parameters with the same name but different names. It is clear that "first" and "second" are only for the convenience of expression and should not be construed as limiting the embodiments of the present invention. Subsequent embodiments will not explain this in detail.

[0044] Example 1:

[0045] Reference Figure 1 This invention provides a method for dynamic spatialization and interruption priority management of multiple audio sources in vehicles, which specifically includes steps S10 to S40.

[0046] Step S10: Receive the sound source orientation configuration instruction input by the user. This instruction is used to specify independent virtual sound field coordinates for different types of sound sources.

[0047] In this embodiment of the invention, the sound source types include, but are not limited to, telephone, navigation, media, alarm tones, system prompt tones, etc. The system maintains an independent set of virtual sound field coordinate parameters for each sound source type, rather than sharing a single global balance and attenuation setting for all sound sources in traditional solutions. The independent virtual sound field coordinates include at least left-right balance parameters and front-back attenuation parameters. The left-right balance parameters control the perceived position of the sound source from left to right within the vehicle's sound field, and the front-back attenuation parameters control the perceived position of the sound source from front to back within the vehicle's sound field. Each of the left-right balance parameters and the front-back attenuation parameters has a preset value range, and each set of parameter values ​​uniquely corresponds to a virtual location within the vehicle's sound field. For example, setting both the left-right balance parameter and the front-back attenuation parameter to their maximum values ​​corresponds to the "front right" position; setting both the left-right balance parameter to their minimum values ​​and the front-back attenuation parameter to their maximum values ​​corresponds to the "front left" position.

[0048] In some embodiments of the present invention, to facilitate user operation, a sound source orientation adjustment interface is provided before step S10. This interface includes a sound field orientation adjuster, and in response to user operation of the sound field orientation adjuster, a sound source orientation configuration command is generated.

[0049] Specifically, users can select "Source Selection" in the vehicle's settings menu to enter the source orientation configuration mode. The system displays a list of all currently configurable sources, including telephone, navigation, alarms, and media. Clicking on a specific source, such as "Navigation," switches the interface to the sound field orientation adjuster. This adjuster is similar to a traditional Fader / Balance slider, but it operates on a single source. As the user drags the slider, the system plays a test tone, allowing the user to immediately hear the adjusted effect. After setting, the system saves the configuration to non-volatile memory, ensuring it is retained across different ignition cycles.

[0050] Step S20: Receive the interruption priority configuration instruction input by the user, and generate and store the audio source interruption priority list.

[0051] In some embodiments of the present invention, receiving a user-input interruption priority configuration command and generating and storing an audio source interruption priority list specifically includes: providing a priority configuration interface that displays at least two audio source objects with configurable priorities; generating an audio source interruption priority list in response to a user's drag-and-drop sorting operation on the audio source objects; and internally generating a priority lookup table based on this list, for example: telephone is Level 1, navigation is Level 2, and media is Level 3.

[0052] Furthermore, the priority configuration interface also provides an "Allow Interruption" option. This option is typically represented by a checkbox. In response to the user unchecking the "Allow Interruption" option for a specific audio source, the system generates configuration information indicating that the audio source cannot be interrupted. For example, the user can uncheck "Allow Interruption" for "Emergency Alarm," meaning that once the emergency alarm sounds, it will exclusively occupy the audio channel and cannot be interrupted by any other audio source.

[0053] Step S30: In the audio mixing stage, the sound source is spatially rendered based on the independent virtual sound field coordinates assigned to each sound source, so that different types of sound sources have different perceptual orientations in the in-vehicle sound field.

[0054] In this embodiment of the invention, spatial rendering can be implemented using a channel balancing algorithm or a head-related transfer function.

[0055] When using the channel balancing algorithm, the processing flow is as follows: First, based on the left-right balance parameters and front-back attenuation parameters in the independent virtual sound field coordinates, the gain coefficient corresponding to each channel speaker is calculated. For example, if the user configures the navigation audio source's location as "right front," the system assigns a higher gain coefficient to the right front speaker and a lower gain coefficient to the left front speaker based on this coordinate. In a specific embodiment, a gain allocation algorithm based on inverse distance ratio can be used: The system pre-establishes a two-dimensional coordinate system of the in-vehicle sound field and determines the position of each speaker and the virtual coordinate selected by the user. For any speaker, its gain coefficient is inversely proportional to the distance from the speaker to the virtual coordinate. At the same time, to ensure that the total loudness remains constant during the sound image movement, the system normalizes the gain coefficients of all speakers so that the sum of the squares of each gain coefficient is a constant. Subsequently, the system distributes the audio signal of the sound source to each channel speaker for playback according to the calculated gain coefficients. By precisely controlling the difference in output sound pressure level between different speakers, and utilizing the auditory localization cue of inter-ear sound level difference, the listener perceives that the sound comes from the target location. This method has extremely low computational overhead, involving only simple gain calculations, making it very suitable for embedded vehicle platforms with limited computing power.

[0056] When using head-related transfer functions (HRT) for spatial rendering, the processing flow is as follows: First, determine the HRT filter pair corresponding to the target virtual location. The HRT describes the physical process of sound waves propagating from a point in space to the eardrum. It naturally contains all the key clues needed for spatial auditory localization: interaural time difference, interaural sound level difference, and the characteristic spectral filtering effect caused by the shape of the auricle. Then, the system executes the spatial rendering algorithm: the mono audio signal of the sound source is convolved in the time domain with the impulse response of the left ear's HRT to generate the left channel signal; this mono audio signal is then convolved in the time domain with the impulse response of the right ear's HRT to generate the right channel signal. This convolution process is equivalent to multiplying the audio spectrum with the frequency response of the HRT in the frequency domain. Finally, playback via headphones or a designated speaker in a car reconstructs the listener's perception that the sound originates from that virtual location, creating a realistic sense of immersion. Compared to channel balance algorithms, head-related transfer function technology can provide a more accurate, height-based, and immersive spatial listening experience, making it particularly suitable for multi-channel audio systems in high-end vehicles.

[0057] Through the two optional solutions described above, the embodiments of the present invention can flexibly select the most suitable spatial rendering technology based on the actual computing power and audio hardware configuration of the in-vehicle infotainment system, achieving the best balance between cost and performance while ensuring auditory clarity.

[0058] Step S40: When multiple audio sources request playback simultaneously, audio playback arbitration is performed based on the audio source interruption priority list.

[0059] In some embodiments of the present invention, the audio playback arbitration process in step S40 specifically includes:

[0060] In response to simultaneous requests for playback from the first audio source and the second audio source, where the first audio source has a lower priority than the second audio source, the system determines whether the first audio source is allowed to be interrupted based on its configuration information.

[0061] In response to the rule that the first audio source cannot be interrupted, the interruption request from the second audio source is rejected, and the first and second audio sources are mixed and played.

[0062] In response to the first audio source being allowed to be interrupted, the volume of the first audio source is reduced or playback is paused to ensure clear playback of the second audio source.

[0063] The following explanation will cover two specific scenarios.

[0064] Scenario A: The phone call and navigation are playing simultaneously, with the phone call having higher priority than the navigation. The system detects that the phone call has higher priority than the navigation. In this case, the system further queries the navigation audio source configuration information. If the user has selected "Allow interruptions" for the navigation, the system performs the traditional interruption operation: reducing the navigation volume to the preset ducking level, or directly pausing navigation playback to ensure that the phone call audio is clearly audible. When the phone call ends, the system automatically resumes navigation playback.

[0065] Scenario B: The user has pre-set the navigation to "not be interrupted." When the phone call and navigation are both playing simultaneously, even if the system detects that the phone call has a higher priority, it will reject the interruption request. In this case, the system will not skip or mute either party, but will use a mixed audio approach to play the phone call and navigation simultaneously. Thanks to the different spatial orientations configured for the phone call and navigation in step S30 (e.g., the phone call is in the front left, and the navigation is in the front right), the mixed audio playback will not cause auditory confusion as in traditional solutions. The user's left ear primarily receives the phone call audio, and the right ear primarily receives the navigation audio. According to auditory scene analysis theory, the user's brain can easily separate the two sound streams without interference. The video call will not be interrupted or skipped, ensuring the integrity and continuity of the call content, while the user will not miss navigation instructions.

[0066] Through the above solution, the embodiments of the present invention combine sound field configuration with interruption rule configuration to jointly solve the problems of sound confusion and information omission.

[0067] Based on the same inventive concept, such as Figure 2 As shown, embodiments of the present invention also provide an in-vehicle multi-source dynamic spatialization and interruption priority management system 200, comprising:

[0068] The sound source orientation configuration module 201 is used to receive sound source orientation configuration instructions input by the user, the instructions being used to specify independent virtual sound field coordinates for different types of sound sources;

[0069] The priority list generation module 202 is used to receive interruption priority configuration instructions input by the user, generate and store the audio source interruption priority list;

[0070] The spatial rendering processing module 203 is used to perform spatial rendering on the sound sources in the audio mixing stage according to the independent virtual sound field coordinates allocated to each sound source, so that different types of sound sources have different perceptual orientations in the in-vehicle sound field.

[0071] The audio playback arbitration module 204 is used to perform audio playback arbitration based on the audio source interruption priority list when multiple audio sources request playback at the same time.

[0072] In some embodiments of the present invention, alternative sound field adjustment methods include: in addition to slider adjustment, a "click on the sound field map" method can also be used. The user directly clicks on the target position on the schematic diagram representing the seats in the vehicle, and the system automatically calculates the corresponding left-right balance parameters and front-back attenuation parameters based on the geometric relationship between the click coordinates and the positions of each speaker. Alternative priority setting methods include: in addition to drag-and-drop sorting, priority values ​​can be set using "numerical input" or a "hierarchical drop-down menu," for example, directly inputting the numbers 1, 2, and 3 to represent the priority order. Alternative technical implementation methods include: in spatial processing, in addition to the aforementioned channel balance algorithm and head-related transfer function, more advanced wave field synthesis or Ambisonics panoramic sound technology can be used, combined with a multi-speaker array in the vehicle, to achieve a more accurate and stable sound positioning effect over a larger area by synthesizing the sound field.

[0073] Obviously, the above embodiments of the present invention are merely examples for clearly illustrating the present invention, and are not intended to limit the implementation of the present invention. For those skilled in the art, other variations or modifications can be made based on the above description. It is impossible to exhaustively list all the implementation methods here. All obvious variations or modifications derived from the technical solutions of the present invention are still within the protection scope of the present invention.

Claims

1. A method for dynamic spatialization and interruption priority management of multi-source audio in vehicles, characterized in that, include: Receive user-input sound source location configuration instructions, which are used to specify independent virtual sound field coordinates for different types of sound sources; Receive interruption priority configuration instructions from the user, generate and store a list of audio source interruption priorities; During the audio mixing stage, the sound sources are spatially rendered based on the virtual sound field coordinates assigned to each sound source, so that different types of sound sources have different perceptual orientations in the in-vehicle sound field. When multiple audio sources request playback simultaneously, audio playback arbitration is performed based on the audio source interruption priority list.

2. The in-vehicle multi-source dynamic spatialization and interruption priority management method according to claim 1, characterized in that, The independent virtual sound field coordinates include at least left-right balance parameters and front-back attenuation parameters.

3. The in-vehicle multi-source dynamic spatialization and interruption priority management method according to claim 1, characterized in that, Also includes: A sound source orientation adjustment interface is provided, the interface including a sound field orientation adjuster; In response to the user's operation on the sound field orientation adjuster, the sound source orientation configuration command is generated.

4. The in-vehicle multi-source dynamic spatialization and interruption priority management method according to claim 1, characterized in that, Also includes: Provides a priority configuration interface that displays at least two audio source objects with configurable priorities; In response to the user's drag-and-drop sorting operation on the audio source object, a list of audio source interruption priorities is generated.

5. The in-vehicle multi-source dynamic spatialization and interruption priority management method according to claim 4, characterized in that, Audio playback arbitration is performed based on the aforementioned audio source interruption priority list, including: In response to simultaneous requests for playback from the first audio source and the second audio source, and given that the first audio source has a lower priority than the second audio source, the system determines whether the first audio source is allowed to be interrupted based on its configuration information. In response to the condition that the first audio source is not allowed to be interrupted, the first audio source and the second audio source are mixed and played. In response to the first audio source being allowed to be interrupted, the operation of lowering the volume or pausing playback is performed on the first audio source.

6. The in-vehicle multi-source dynamic spatialization and interruption priority management method according to claim 4, characterized in that, The priority configuration interface also provides an option to allow interruption; The method further includes: in response to a user selecting the "Allow Interruption" option for a certain audio source, generating configuration information for the audio source to be interrupted.

7. The in-vehicle multi-source dynamic spatialization and interruption priority management method according to claim 1, characterized in that, During spatial rendering, head-related transfer functions or channel balancing algorithms are used to adjust the gain of different speakers to achieve the perceived orientation.

8. The in-vehicle multi-source dynamic spatialization and interruption priority management method according to claim 1, characterized in that, Spatial rendering is performed using a channel balancing algorithm, including: Based on the left-right balance parameters and front-back attenuation parameters in the independent virtual sound field coordinates, calculate the gain coefficient corresponding to each channel speaker; The audio signal from the sound source is distributed to each channel speaker according to the gain coefficient for playback. By controlling the difference in the output sound pressure level of different speakers, the listener can perceive that the sound comes from the target direction.

9. The in-vehicle multi-source dynamic spatialization and interruption priority management method according to claim 1, characterized in that, Spatial rendering is performed using header-related transfer functions, including: A pair of head-related transfer function filters corresponding to the target virtual location are applied to the mono audio signal of the sound source to generate left channel signal and right channel signal respectively, so as to simulate the human ear's auditory perception of a real sound source from that location. The head-related transfer function filters include interaural time difference, interaural sound level difference and auricular spectral cues.

10. A vehicle-mounted multi-source dynamic spatialization and interruption priority management system, applied to the vehicle-mounted multi-source dynamic spatialization and interruption priority management method as described in any one of claims 1-9, characterized in that, include: The sound source orientation configuration module is used to receive sound source orientation configuration instructions input by the user. The instructions are used to specify independent virtual sound field coordinates for different types of sound sources. The priority list generation module is used to receive interruption priority configuration instructions input by the user, generate and store the audio source interruption priority list; The spatial rendering processing module is used to perform spatial rendering on the sound sources in the audio mixing stage according to the independent virtual sound field coordinates assigned to each sound source, so that different types of sound sources have different perceptual orientations in the in-vehicle sound field. The audio playback arbitration module is used to arbitrate audio playback based on the audio source interruption priority list when multiple audio sources request playback simultaneously.

Images