In-vehicle audio processing method and vehicle-mounted audio system

Abstract

The invention provides an in-vehicle audio processing method and a vehicle-mounted audio system, and the method comprises the steps: generating and issuing a mode switching instruction of a post-processing module for second audio data to be played in a vehicle based on a post-processing mode corresponding to the second audio data, the post-processing mode of the post-processing module is switched to the post-processing mode corresponding to the second audio; rendering the second audio data to obtain multi-channel audio data; and sending the multi-channel audio data to a post-processing module, so that the post-processing module performs post-processing on the audio data after sound mixing in a post-processing mode corresponding to the second audio data. By switching the post-processing mode of the power amplifier, the flexibility and accuracy of audio data post-processing are improved, and the playing effect of the second audio data such as a prompt tone is ensured.

Description

Technical Field

[0001] This application relates to the technical field of audio processing, and particularly to an in-vehicle audio processing method and an in-vehicle audio system. Background Art

[0002] The layout of vehicle speakers is gradually developing towards surround sound or even panoramic sound, enabling the rendering and tuning of audio data based on the selected optimal listening position during in-vehicle audio tuning, thereby achieving immersive audio playback.

[0003] The audio data in the vehicle needs to be rendered, post-processed, and then played through the speaker array. The post-processing steps are usually carried out by a power amplifier, which often adopts a fixed post-processing method for various audio data. However, different audio data have different requirements for the post-processing stage, and using a fixed post-processing method results in poor playback effects for some audio data. For example, the listening position of the prompt sound is not the position of the driver, resulting in the driver being unable to clearly hear the content of the prompt sound and poor driving safety.

[0004] Therefore, there is an urgent need to provide a flexible and accurate in-vehicle audio presentation solution. Summary of the Invention

[0005] This application provides an in-vehicle audio processing method and an in-vehicle audio system. For the scenario of in-vehicle audio presentation, the post-processing mode of the post-processing module is adjusted through the post-processing mode of the audio data, so that when performing audio post-processing, factors such as the listening position and time delay of the audio data are fully considered, improving the flexibility and accuracy of audio data post-processing and the presentation effect of in-vehicle sound.

[0006] In a first aspect, this application provides an in-vehicle audio processing method, including:

[0007] For the second audio data to be played in the vehicle, based on the post-processing mode corresponding to the second audio data, generate and issue a mode switching instruction for the post-processing module to switch the post-processing mode of the post-processing module to the post-processing mode corresponding to the second audio;

[0008] Render the second audio data to obtain multi-channel audio data;

[0009] Send the multi-channel audio data to the post-processing module, so that the post-processing module performs post-processing on the multi-channel audio data based on the post-processing mode corresponding to the second audio.

[0010] Optionally, if there are multiple pieces of the second audio data, generating a mode switching instruction for the post-processing module based on the post-processing mode corresponding to the second audio data includes:

[0011] Determine target audio data from the multiple second audio data based on the type and / or priority of the multiple second audio data;

[0012] Generate a mode switching instruction for the post-processing module based on the post-processing mode corresponding to the target audio data.

[0013] Optionally, when the first audio data is being played in the vehicle, after rendering the second audio data to obtain multi-channel audio data, the method further includes:

[0014] Mix the multi-channel audio data with the rendering data of the first audio data to obtain mixed audio data.

[0015] Correspondingly, sending the multi-channel audio data to the post-processing module so that the post-processing module performs post-processing on the multi-channel audio data based on the post-processing mode corresponding to the second audio data includes:

[0016] Send the mixed audio data to the post-processing module so that the post-processing module performs post-processing on the mixed audio data based on the post-processing mode corresponding to the second audio.

[0017] Optionally, generating and sending a mode switching instruction for the post-processing module based on the post-processing mode corresponding to the second audio data includes:

[0018] Read and record the current post-processing mode of the post-processing module;

[0019] If the current post-processing mode is different from the post-processing mode corresponding to the second audio data, generate and send a mode switching instruction for the post-processing module based on the post-processing mode corresponding to the second audio data.

[0020] Optionally, the method further includes:

[0021] When the second audio data finishes playing, generate and send a mode restoration instruction for the post-processing module to switch the post-processing mode of the post-processing module to the current post-processing mode.

[0022] Optionally, the first audio data is entertainment audio data and the second audio data is a prompt tone data; or, the first audio data is navigation prompt tone data and the second audio data is driving safety prompt tone data, and both the navigation prompt tone data and the driving safety prompt tone data are prompt tone data.

[0023] Optionally, the method further includes:

[0024] Determine the playback delay corresponding to the second audio data based on the type of the second audio data;

[0025] Determine the post - processing mode of the second audio data based on the listening position corresponding to the second audio data and the playback delay.

[0026] Optionally, if the second audio data is the driving safety prompt sound data, the method further includes:

[0027] Determine the listening position corresponding to the second audio data based on the action area of the driving safety prompt sound data.

[0028] Optionally, rendering the second audio data to obtain multi - channel audio data includes:

[0029] Render the second audio data based on the sound source position corresponding to the second audio data and the listening position corresponding to the post - processing mode corresponding to the second audio data to obtain the multi - channel audio data.

[0030] Optionally, rendering the second audio data to obtain multi - channel audio data includes:

[0031] Determine the rendering algorithm of the second audio data based on the type of the second audio data;

[0032] Render the second audio data based on the determined rendering algorithm, the sound source position corresponding to the second audio data, and the listening position corresponding to the post - processing mode corresponding to the second audio data to obtain the multi - channel audio data.

[0033] Optionally, before mixing the multi - channel audio data with the rendering data of the first audio data to obtain the mixed audio data, the method further includes:

[0034] Reduce the volume of the rendering data of the first audio data.

[0035] Optionally, the method is applied to the in - vehicle infotainment system of the vehicle, the post - processing module is deployed in the in - vehicle infotainment system of the vehicle, or the post - processing module is a power amplifier.

[0036] In a second aspect, the present application further provides an in - vehicle audio processing device, including:

[0037] A post - processing mode switching module, configured to generate and send a mode switching instruction for the post - processing module based on the post - processing mode corresponding to the second audio data to be played in the vehicle, so as to switch the post - processing mode of the post - processing module to the post - processing mode corresponding to the second audio;

[0038] A rendering module for rendering the second audio data to obtain multi-channel audio data;

[0039] An audio post-processing module for sending the multi-channel audio data to the post-processing module, so that the post-processing module performs post-processing on the multi-channel audio data based on the post-processing mode corresponding to the second audio.

[0040] In a third aspect, the present application further provides a vehicle audio system, including a car head unit operating system, an audio bus, a controller area network bus, a post-processing module, and a speaker array;

[0041] The car head unit operating system sends the rendered audio data to the post-processing module through the audio bus;

[0042] The car head unit operating system interacts with the post-processing module through the controller area network bus for instructions;

[0043] The post-processing module is used for post-processing the rendered audio data;

[0044] The speaker array is used for playing the audio data post-processed by the post-processing module;

[0045] The car head unit operating system is used to execute the method provided in the first aspect of the present application to perform processing and control of audio data.

[0046] In a fourth aspect, the present application further provides an electronic device, including a memory and at least one processor, the memory stores computer-executable instructions; the at least one processor executes the computer-executable instructions stored in the memory, so that the electronic device implements the method provided in the first aspect.

[0047] In a fifth aspect, an embodiment of the present application further provides a computer-readable storage medium, in which computer-executable instructions are stored, and when a processor executes the computer-executable instructions, the method provided in the first aspect is implemented.

[0048] In a sixth aspect, an embodiment of the present application further provides a computer program product, including a computer program, and when the computer program is executed by a processor, the method provided in the first aspect is implemented.

[0049] The in-vehicle audio processing method and in-vehicle audio system provided by this application are directed to the scenario of playing audio data in a vehicle. Based on the post-processing mode corresponding to the audio data, the post-processing mode of the post-processing module is switched. This post-processing mode is used to characterize the requirements of the audio data for parameters such as the listening position and playback delay. Thus, when the post-processing module performs post-processing on the multi-channel audio data obtained after rendering the audio data, it fully considers parameters such as the listening position and playback delay corresponding to the audio data, improving the accuracy of audio data processing and the playback effect. If the audio data is a prompt tone, through the post-processing method based on parameters such as the listening position and playback delay of the prompt tone, the effects of listening and identifying the position and timely reminder can be achieved, improving the safety of vehicle driving. Description of the Drawings

[0050] The drawings herein are incorporated into the specification and form a part of this specification, showing embodiments consistent with the present disclosure, and are used together with the specification to explain the principles of the present disclosure.

[0051] Figure 1 It is a schematic diagram of the in-vehicle playback process of audio data provided by an embodiment of this application;

[0052] Figure 2 It is a schematic flow chart of an in-vehicle audio processing method provided by an embodiment of this application;

[0053] Figure 3 It is a schematic flow chart of another in-vehicle audio processing method provided by an embodiment of this application;

[0054] Figure 4 It is a schematic flow chart of another in-vehicle audio processing method provided by an embodiment of this application;

[0055] Figure 5 It is a schematic diagram of the rendering effect of the second audio data provided by an embodiment of this application;

[0056] Figure 6 It is a schematic diagram of the structure of an in-vehicle audio system provided by an embodiment of this application;

[0057] Figure 7 It is a schematic flow chart of yet another in-vehicle audio processing method provided by an embodiment of this application;

[0058] Figure 8 It is a schematic diagram of the structure of an in-vehicle audio processing device provided by an embodiment of this application.

[0059] Through the above-mentioned drawings, the clear embodiments of the present disclosure have been shown, and there will be more detailed descriptions hereinafter. These drawings and the textual descriptions are not intended to limit the scope of the concept of the present disclosure in any way, but to explain the concept of the present disclosure to those skilled in the art by referring to specific embodiments. Detailed Embodiments

[0060] Exemplary embodiments will be described in detail herein, and examples thereof are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. On the contrary, they are merely examples of apparatuses and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0061] An in-vehicle audio system can play various types of audio, including beep sounds and entertainment media programs. The beep sounds can be navigation beep sounds, driving safety beep sounds, etc., such as beep sounds of turn signals, reverse radars, etc. The entertainment media programs include music, video works, audiobooks, etc.

[0062] Figure 1 It is a schematic diagram of an in-vehicle playback process of audio data provided by an embodiment of the present application, as Figure 1 shown. First, the audio data to be played is selected. The audio data can be a local audio file, an online media stream, audio data generated in real time by code, etc. The audio data to be played can be selected through the vehicle's multimedia panel, or through a device wirelessly connected to the vehicle, such as a mobile terminal.

[0063] After the audio data to be played is selected, the audio data is rendered by the in-vehicle operating system. Mainly, the audio data is processed into a form that conforms to the vehicle speaker layout. For example, if the audio data is stereo and the in-vehicle playback environment is 7.1.4, then through rendering, the stereo audio data is converted into 7.1.4 audio data. If the sound object in the audio data is mono and the in-vehicle playback environment is 5.1.4, through rendering, the mono audio data together with the coordinates of the sound object is processed into 5.1.4 audio data. The specific manner of rendering in the embodiments of the present application is not limited.

[0064] The power amplifier performs post-processing on the rendered audio signal, including but not limited to sound field calibration, delay processing, gain adjustment, etc. Sound field calibration is also called tuning. The main purpose is to achieve the optimal presentation of the rendered audio data in a specific playback environment, such as tuning through means such as volume adjustment, equalizer, frequency division, etc.

[0065] Tuning is a key audio processing method in the post-processing responsible for the power amplifier (abbreviated as PA). In some embodiments, the referred post-processing can be specifically tuning. For example, the subsequent mentioned post-processing mode can be a tuning mode.

[0066] The audio data after post-processing by the power amplifier is played by the speaker array in the in-vehicle audio system.

[0067] With the continuous development of in-vehicle audio systems, the channel layout of in-vehicle audio systems is gradually evolving towards surround sound and even immersive sound, such as 7.1.4 channels, 7.3.4 channels, etc. When playing audio data, the best listening position can be selected, so that during rendering and tuning, the parameter adjustment of the audio data can be combined with the selected best listening position.

[0068] In the related art, the post-processing method adopted by the power amplifier is fixed and non-adjustable, resulting in the same post-processing method being used for different audio data.

[0069] The inventors of this application have found through research that the service objects and requirements for playback latency of two types of audio data, namely entertainment audio (such as songs, film and television works, audiobooks, etc.) and reminder sounds (such as navigation reminder sounds, driving safety reminder sounds, etc.), are different. The main service objects of entertainment audio are the co-driver or rear passengers, and the best listening position (abbreviated as listening position) is relatively free, while the main service object of reminder sounds is the driver, and the best listening position is relatively fixed, such as the driver's position. At the same time, the requirement for playback latency of reminder sounds is higher than that of entertainment audio.

[0070] If the post-processing method of entertainment audio data is fixedly used to process reminder sounds, it will result in too long playback latency of reminder sounds, so that the people in the vehicle cannot be reminded in time, or the listening position of reminder sounds is inaccurate, so that the sound source cannot be identified by listening, resulting in poor reminder effects.

[0071] Based on this, this application provides an in-vehicle audio processing method. By configuring a parameter of the post-processing mode for the audio data, the post-processing module (such as the power amplifier) performs adaptive post-processing of the audio data based on the post-processing mode corresponding to the audio data, improving the flexibility and accuracy of the post-processing of the audio data. Taking reminder sounds as an example, by performing post-processing of reminder sounds through a post-processing mode formulated based on the listening position, playback latency, etc. corresponding to the reminder sounds, the playback latency of the reminder sounds can be shortened, the timeliness of the reminder can be improved, and the effect of sound source identification by listening can be achieved, so that the driver can quickly locate the sound source position based on the heard reminder sounds, improving driving safety.

[0072] In some embodiments, multiple post-processing modes can be pre-generated based on different best listening positions and different requirements for playback latency, etc. By adaptively configuring the corresponding post-processing mode for the audio data, the accuracy of the post-processing of the audio data can be improved.

[0073] Exemplarily, the post-processing mode can include a driver mode and a rear row mode. The best listening position of the driver mode is the driver's position, and the best listening position of the rear row mode is a position in the rear row, such as the center of the rear seat.

[0074] Exemplarily, the post-processing mode may include a low-latency mode and a high-latency mode. The playback latency of audio data in the low-latency mode is less than that of audio data in the high-latency mode.

[0075] In some other embodiments, there is a situation where two types of audio data need to be played simultaneously in a vehicle. One of the audio data is being played, denoted as the first audio data, and the other audio data needs to be inserted during the playback of the first audio data, denoted as the second audio data. For example, when a user plays entertainment audio (the first audio data), such as music or audiobooks, through an in-vehicle audio system, if a prompt tone (the second audio data), such as a navigation prompt tone, needs to be played simultaneously.

[0076] Since the post-processing module can only adopt one post-processing method when post-processing audio data, and the transmission channel capacity of the A2B audio bus for the audio data transmitted between the in-vehicle computer operating system and the post-processing module is limited, in order to play two types of audio data simultaneously, two solutions can be adopted. One is to expand the number of channels of the A2B audio bus and the number of channels of the speaker array, and use the expanded channels to transmit the second audio data and the expanded channels to play the prompt tone. This will lead to an increase in cost, and the number of expanded channels and channels is small. Playing audio data through fewer channels results in a poor playback effect of the audio data. Taking the prompt tone as an example, the spatial orientation of the prompt tone often cannot be reflected. Another solution is to mix the two types of audio data to be played, and then send it to the post-processing module through the A2B audio bus for post-processing. In this case, the post-processing module often adopts the default post-processing mode, such as the post-processing mode of the first audio data, resulting in a poor playback effect of the second audio data. For example, the best listening position of the prompt tone is not the driver's seat, resulting in the driver being unable to clearly hear the prompt content.

[0077] In the related art, in order to ensure that the occupants in the vehicle can hear the prompt tone, the volume of the prompt tone is usually increased or the volume of the entertainment audio is reduced during playback. Only by adjusting the volume, the post-processing of the prompt tone may be performed based on the post-processing method of the entertainment audio. If the best listening position of the post-processing method of the entertainment audio is in the back row, when the prompt tone and the entertainment audio are played simultaneously, even if the volume of the prompt tone is increased, since the best listening position of the prompt tone is in the back row, the driver may still not be able to clearly hear the prompt tone, and the playback effect of the prompt tone is poor, which is likely to cause safety accidents.

[0078] Based on this, the present application provides another in-vehicle audio processing method. For the case where the first audio data (such as music) and the second audio data (such as a prompt tone) need to be played simultaneously, where the first audio data is the audio data being played and the second audio data is the audio data that needs to be inserted and played, it realizes switching the post-processing mode of the post-processing module to the post-processing mode of the second audio data. Thus, after rendering and mixing the first audio data and the second audio data, the post-processing module performs post-processing on the mixed audio data in the post-processing mode of the second audio data, making the played audio have the best listening position of the second audio data as the best listening position, and improving the playback effect of the second audio data.

[0079] The following uses specific embodiments to elaborate in detail on the technical solution of the present application and how the technical solution of the present application solves the above technical problems. These several specific embodiments below can be combined with each other, and for the same or similar concepts or processes, they may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0080] Figure 2 It is a schematic flowchart of an in-vehicle audio processing method provided by an embodiment of the present application. This method is applied to a vehicle and can be executed by the in-vehicle operating system on the vehicle or a post-processing control device communicatively connected to the post-processing module on the vehicle. As Figure 2 shown, the in-vehicle audio processing method includes the following steps:

[0081] Step S201, for the audio data to be played in the vehicle, based on the post-processing mode corresponding to the audio data, generate a mode switching instruction for the post-processing module to set the post-processing mode of the post-processing module to the post-processing mode corresponding to the audio data;

[0082] Step S202, render the audio data to obtain multi-channel audio data;

[0083] Step S203, send the multi-channel audio data to the post-processing module.

[0084] Step S204, the post-processing module performs post-processing on the multi-channel audio data based on the post-processing mode corresponding to the audio data.

[0085] In some embodiments, step S201 and step S202 (or step S203) can be executed serially or in parallel. For example, step S202 can be executed first and then step S201, or step S201 can be executed after or during the execution of step S203. For example, step S201 can be executed during the process of sending the multi-channel audio data. The present application does not limit this, Figure 2 Taking parallel execution as an example.

[0086] The post - processing mode is used to characterize the listening position corresponding to the audio data and / or the requirements of the audio data for the playback delay.

[0087] The post - processing module can be a module integrated in the in - vehicle operating system or deployed as a separate module on the vehicle. The post - processing module is responsible for post - processing the rendered audio data, such as multi - channel audio data.

[0088] Specifically, the post - processing module is connected to the in - vehicle operating system through an audio bus and is responsible for post - processing the audio data rendered by the in - vehicle operating system.

[0089] Optionally, this in - vehicle audio processing method is applied to the in - vehicle operating system of the vehicle. The post - processing module is deployed in this in - vehicle operating system, or the post - processing module is the power amplifier of the vehicle.

[0090] When there is audio data to be played in the vehicle, such as entertainment audio data, prompt audio data, etc., the in - vehicle operating system reads the post - processing mode corresponding to the audio data and generates a mode - switching instruction for the post - processing mode of the post - processing module based on this, so as to switch the post - processing mode of the post - processing module to the post - processing mode corresponding to the audio data to be played, realizing the adaptive adjustment of the post - processing mode of the post - processing module, and making the post - processing mode meet the requirements of parameters such as the listening position and playback delay of the audio data.

[0091] When receiving or generating the audio data to be played, there may or may not be other audio data being played in the vehicle, that is, the vehicle is not playing other audio data.

[0092] In some embodiments, the post - processing mode corresponding to the audio data can be set in the playback request of the audio data. The in - vehicle operating system parses the playback request of the audio data to obtain the post - processing mode corresponding to the audio data.

[0093] In other embodiments, the post - processing mode corresponding to the audio data can also be determined based on the attribute information of the audio data. The attribute information can be type, listening position, playback delay, etc.

[0094] Exemplarily, when the type of the audio data is a beep type, that is, the audio data is beep data, the post - processing mode is the low - latency driver mode. "Low - latency" means that there is a high requirement for the playback latency, and the audio data needs to be played within a short latency, such as 10 ms, 15 ms, etc. "Driver" means that the listening position is the driver's seat. When the type of the audio data is an entertainment type, that is, the audio data is entertainment audio data, the post - processing mode is the high - latency free mode. "High - latency" means that there is a low requirement for the playback latency, and the audio data can be played within a long latency, such as 50 ms, 100 ms, etc. "Free" means that the listening position can be freely set, that is, the position selected by the vehicle occupants independently. The post - processing mode of the audio data can be determined based on the listening position and the playback latency corresponding to the audio data.

[0095] The listening position and the playback latency corresponding to the audio data can be default parameters, configurable parameters, or parameters dynamically determined based on the actual scenario.

[0096] The listening position and the playback latency corresponding to the audio data can be determined based on the type of the audio data. The listening position corresponding to the beep data can be the driver's seat, the passenger seat, or the center of the front row seats. The listening position corresponding to the entertainment audio data can be the center of the rear row seats, or set independently.

[0097] The in - vehicle audio processing method provided by this application, for the scenario of playing audio data in a vehicle, switches the post - processing mode of the post - processing module based on the post - processing mode corresponding to the audio data. This post - processing mode is used to characterize the requirements of the audio data for parameters such as the listening position and the playback latency. Thus, when the post - processing module performs post - processing on the multi - channel audio data obtained after rendering the audio data, it fully considers parameters such as the listening position and the playback latency corresponding to the audio data, improving the accuracy of audio data processing and the playback effect. If the audio data is a beep, through the post - processing method based on parameters such as the beep listening position and the playback latency, the effects of listening and identifying the position and timely reminder are achieved, improving the safety of vehicle driving.

[0098] For the sake of convenience of description, in the subsequent embodiments, the audio data to be played is denoted as the second audio data.

[0099] Optionally, when there are multiple second audio data, generating a mode switching instruction for the post - processing module based on the post - processing mode corresponding to the second audio data includes:

[0100] Determining target audio data from the multiple second audio data based on the type and / or priority of the multiple second audio data; generating the mode switching instruction for the post - processing module based on the post - processing mode corresponding to the target audio data.

[0101] The target audio data is one of the second audio data.

[0102] Exemplarily, the target audio data may be the prompt tone data among multiple second audio data.

[0103] Exemplarily, the target audio data may be the second audio data with the highest priority among multiple second audio data.

[0104] The priority of the audio data may be determined based on the type of the audio data and / or the requirement of the audio data for the playback delay, etc. The higher the requirement of the audio data for the playback delay, the higher the urgency of the audio data and the higher its priority.

[0105] The priority of the prompt tone data is higher than that of the entertainment audio data. The prompt tone data may be further divided into navigation prompt tone data and driving safety prompt tone data, and the priority of the driving safety prompt tone data is higher than that of the navigation prompt tone data.

[0106] When there are multiple second audio data, after rendering each second audio data to obtain the multi-channel audio data of each second audio data, it is also necessary to mix the multi-channel audio data of each second audio data to obtain the mixed audio data, and send the mixed audio data to the post-processing module, so that the post-processing module performs post-processing on the mixed audio data based on the post-processing mode corresponding to the target audio.

[0107] By combining parameters such as the type and priority of the audio data, determining the target audio data from multiple audio data to be played, and performing post-processing on multiple audio data in the post-processing mode of the target audio data, the accuracy of the post-processing of the target audio data is improved, thereby ensuring the playback effect of the audio data with high priority or the set type.

[0108] Optionally, the method further includes:

[0109] Determining the playback delay corresponding to the second audio data based on the type of the second audio data; determining the post-processing mode of the second audio data based on the listening position corresponding to the second audio data and the playback delay.

[0110] The corresponding playback delay for various types may be configured in advance to obtain the correspondence between the playback delay and the type, so as to determine the playback delay corresponding to the second audio data based on this correspondence and the type of the second audio data.

[0111] The playback delay corresponding to the second audio data is used to characterize the requirement of the second audio data for the playback delay, and the actual playback delay may not exceed the playback delay corresponding to the second audio data.

[0112] Audio data can be divided into two categories: prompt tone data and entertainment audio data. The playback delay corresponding to the prompt tone data is less than the playback delay corresponding to the entertainment audio data.

[0113] The prompt tone data can be further divided into navigation prompt tone data and driving safety prompt tone data. The navigation prompt tone data and the driving safety prompt tone data can be further divided into more subcategories respectively. The classification method of the audio data in this application is not limited.

[0114] Exemplarily, the driving safety prompt tone data can be divided into reminder prompt tone data and alarm prompt tone data according to the level of emergency from low to high.

[0115] Through the permutation and combination of the listening position and the playback delay corresponding to the audio data to be played, a matching post-processing mode is configured for the audio data for processing.

[0116] Corresponding post-processing modes can be pre-configured for various listening positions and playback delay intervals to obtain the corresponding relationship among the listening position, the playback delay, and the post-processing mode. After obtaining the listening position and the playback delay corresponding to the audio data to be played, based on the intervals where the listening position and the playback delay corresponding to the audio data to be played are located, the post-processing mode corresponding to the audio data to be played is determined from this corresponding relationship.

[0117] In this embodiment, the post-processing mode of the audio data is determined by comprehensively considering the listening position and the playback delay. The post-processing module is dynamically adjusted through the post-processing mode, so that the audio data can be played within the required playback delay of the audio data, enabling audio data with high requirements for playback delay, such as prompt tones, to be played in a timely manner, and avoiding safety accidents caused by the lag of prompt tone playback; at the same time, the played audio data has the specified listening position as the optimal listening position to achieve the effect of sound localization or immersive listening.

[0118] When the playback delay in the post-processing mode indicated by the mode switching instruction is small, that is, when the audio data to be played has a high requirement for playback delay, the in-vehicle operating system can control the post-processing module to reduce the post-processing steps through the mode switching instruction, such as omitting one or more of the steps of frequency division, gain adjustment, inter-channel delay control, etc., or by reducing the number of filters, orders, etc. used during tuning to shorten the playback delay caused by post-processing.

[0119] Optionally, if the second audio data is the driving safety prompt tone data, the method further includes:

[0120] Based on the action area of the driving safety prompt tone data, the prompt tone corresponding to the second audio data is determined.

[0121] The action area of the driving safety prompt sound data can be predefined, that is, corresponding action areas are assigned to different types of driving safety prompt sounds.

[0122] Exemplarily, taking the driving safety prompt sound data for the co - pilot not wearing a seatbelt as an example, the action area is the co - pilot seat, and the corresponding post - processing mode is the co - pilot mode, that is, the post - processing mode with the co - pilot seat as the best listening position.

[0123] Exemplarily, taking the audio data of the detected obstacle prompt sound as the driving safety prompt sound data, the action area can be the front row of the seats, that is, the driver's seat and the co - pilot seat, and the corresponding post - processing mode is the front row mode, that is, the post - processing mode with the center of the front row as the best post - processing position.

[0124] By determining the post - processing mode based on the action area of the driving safety prompt sound data, the accuracy of determining the post - processing mode of the driver safety prompt sound is improved. Furthermore, the accuracy of the post - processing mode switching of the post - processing module is improved, thereby improving the post - processing accuracy of the driving safety prompt sound data.

[0125] Figure 3 It is a schematic flowchart of another in - vehicle audio processing method provided by the embodiment of the present application. This embodiment is for the scenario where the vehicle needs to insert and play the second audio data when playing the first audio data. As Figure 3 shown, the in - vehicle audio processing method includes the following steps:

[0126] Step S301, in response to the presence of the to - be - played second audio data in the vehicle playing the first audio data, generate and send a mode switching instruction for the post - processing module based on the post - processing mode corresponding to the second audio data, so as to switch the post - processing mode of the post - processing module to the post - processing mode corresponding to the second audio.

[0127] The first audio data is the audio data of the first audio, and the second audio data is the audio data of the second audio. The first audio data is the audio data being played when the second audio data is sent, and the second audio data needs to be played together with the first audio data.

[0128] Exemplarily, the first audio data can be audio data of entertainment or multimedia, that is, entertainment audio data or multimedia programs, such as music, film and television works, audiobooks, etc. The second audio data can be audio data of prompt sounds, that is, prompt audio data, such as navigation prompt sounds, driving safety prompt sounds, or other prompt sounds.

[0129] Exemplarily, the first audio data can be entertainment audio data, and the second audio data can be the inserted audio data of the weather forecast.

[0130] In some embodiments, the duration of the first audio data is longer than the duration of the second audio data.

[0131] The audio data, such as the first audio data or the second audio data, can be the audio data output by the vehicle's multimedia system or the audio data sent by an external device. The external device can be a mobile terminal, a USB flash drive, etc.

[0132] The post - processing mode is used to describe the mode adopted when the audio data is post - processed in the post - processing module. It can be divided into multiple post - processing modes based on the different corresponding optimal listening positions, such as the driver mode (the optimal listening position is the driver's seat), the passenger mode (the optimal listening position is the passenger's seat), the front - row mode (the optimal listening position is the center of the front row seats), the rear - row mode (the optimal listening position is the center of the rear row seats), the custom mode (the optimal listening position is a custom position), etc.

[0133] During the process of playing the first audio data through the vehicle's in - vehicle audio system, when the in - vehicle audio system receives the second audio data to be played, it obtains the post - processing mode corresponding to the second audio data, generates a mode - switching instruction for the post - processing module based on the post - processing mode corresponding to the second audio data, and sends the mode - switching instruction to the post - processing module. Thus, the post - processing module switches its post - processing mode to the post - processing mode corresponding to the second audio data based on this mode - switching instruction.

[0134] The post - processing mode corresponding to the second audio data can be determined based on the audio type of the second audio data or by reading the attributes of the set field of the second audio data to determine its post - processing mode.

[0135] The audio type can include the prompt - sound type and the entertainment audio type. The post - processing mode of the audio data of the prompt - sound type can be the driver mode, while the post - processing mode of the audio data of the entertainment audio type can be the rear - row mode.

[0136] In some embodiments, the prompt - sound type can be further subdivided into the navigation type and the driving - safety type. The post - processing mode of the audio data of the navigation type can be the front - row mode, and the post - processing mode of the audio data of the driving - safety type can be the driver mode.

[0137] The corresponding relationship between various audio types and post - processing modes can be established in advance. Based on this corresponding relationship and the audio type of the second audio data, the post - processing mode corresponding to the second audio data is determined.

[0138] When the mode - switching instruction controls the post - processing module to switch the post - processing mode, it can be a gradual - change switching.

[0139] An optional way of gradual switching is as follows: First, process and play the mixed audio data according to the current post-processing mode, but gradually reduce the playing volume; when the volume is reduced to a certain level, such as the first volume, switch to the post-processing mode corresponding to the second audio data, process and play the mixed audio data based on the post-processing mode corresponding to the second audio data, and the playing volume gradually increases from the first volume to achieve the effect of gradual mode switching, reduce the generation of popping sounds, and improve the user experience.

[0140] Another optional way of gradual switching is: The post-processing module copies a portion of the mixed audio data. One portion of the mixed audio data is post-processed using the current post-processing mode, but the volume gradually decreases and stops post-processing when it reaches silence; the other portion of the mixed audio data is post-processed using the post-processing mode corresponding to the second audio data, and the volume increases from silence. The two portions of the mixed audio data are superimposed and played simultaneously through the speaker array.

[0141] This application does not limit the specific way of switching the post-processing mode of the post-processing module.

[0142] Step S302: Render the second audio data to obtain multi-channel audio data, and mix the multi-channel audio data with the rendering data of the first audio data to obtain mixed audio data.

[0143] Since the vehicle is playing the first audio data before playing the second audio data, the current post-processing mode of the post-processing module is the post-processing mode corresponding to the first audio data. Through the above mode switching instruction, the post-processing mode of the post-processing module is switched to the post-processing mode corresponding to the second audio data.

[0144] After switching the post-processing mode of the post-processing module from the current post-processing mode (the post-processing mode corresponding to the first audio data) to the post-processing mode corresponding to the second audio data or after sending the mode switching instruction to the post-processing module, render the second audio data to obtain multi-channel audio data. Then, mix the rendered second audio data, i.e., the multi-channel audio data, with the rendering data obtained after rendering the first audio data to obtain mixed audio data.

[0145] In some embodiments, after receiving the second audio data to be played, the second audio data can be rendered to obtain multi-channel audio data, and the rendered second audio data, i.e., the multi-channel audio data, can be mixed with the rendering data obtained after rendering the first audio data to obtain mixed audio data. Thus, after the post-processing mode of the post-processing module is switched to the post-processing mode corresponding to the second audio data, post-process the mixed audio data, such as tuning.

[0146] The embodiments of the present application do not limit the algorithm used for rendering, and the second audio data can be rendered based on the playback environment of the vehicle, i.e., the layout of the speaker array.

[0147] Step S303: Send the mixed audio data to the post-processing module, so that the post-processing module performs post-processing on the mixed audio data based on the post-processing mode corresponding to the second audio.

[0148] After the post-processing mode of the post-processing module is switched to the post-processing mode corresponding to the second audio data, such as the driver's seat mode, the mixed audio data obtained after mixing is sent to the post-processing module. The post-processing module performs post-processing on the mixed audio data based on the post-processing mode corresponding to the second audio data and plays it through the vehicle's speaker array, thereby giving priority to ensuring the playback effect of the second audio data, such as a prompt tone, and presenting the sound with the best listening position corresponding to the second audio data as the best listening position.

[0149] For the scenario where a vehicle playing the first audio data needs to play the second audio data simultaneously, the in-vehicle audio processing method provided in this embodiment switches the post-processing mode of the post-processing module based on the post-processing mode of the second audio data. After rendering the second audio data and mixing the rendering data with the first audio data, the mixed audio data is sent to the post-processing module, so that the post-processing module performs post-processing on the mixed audio data in the post-processing mode corresponding to the second audio data to give priority to ensuring the playback effect of the second audio data.

[0150] Optionally, rendering the second audio data to obtain multi-channel audio data includes:

[0151] Render the second audio data based on the sound source position corresponding to the second audio data and the listening position corresponding to the post-processing mode corresponding to the second audio data to obtain the multi-channel audio data.

[0152] Combining the sound source position and the listening position for rendering the second audio data can make the rendered multi-channel audio data simulate the effect of a simulated sound source emitting sound at the sound source position, so as to achieve the effect of sound source identification for prompt tones, and for entertainment audio, improve the immersive effect of sound rendering.

[0153] Optionally, the first audio data is entertainment audio data, and the second audio data is prompt tone data; or, the first audio data is navigation prompt tone data, and the second audio data is driving safety prompt tone data, and both the navigation prompt tone data and the driving safety prompt tone data are prompt tone data.

[0154] The prompt tone data is the audio data of the prompt tone. The prompt tone can be the audio data of the navigation prompt tone, i.e., the navigation prompt tone data, or the audio data of the driving safety prompt tone, i.e., the driving safety prompt tone data. The navigation prompt tone is the audio generated during the navigation process, such as the road condition prompt tone, the turning prompt tone, the remaining time prompt tone of the traffic light, etc. The driving safety prompt tone is the prompt tone related to the driving safety of the vehicle, such as the vehicle collision prompt tone, the turn signal prompt tone, the seat belt not fastened prompt tone, the door opening prompt tone, etc.

[0155] By switching the post - processing mode of the post - processing module from the post - processing mode corresponding to the entertainment audio data to the post - processing mode corresponding to the audio data of the prompt tone, the post - processing effect of the prompt tone is ensured preferentially, so that the driver can clearly hear the content of the prompt tone while playing the entertainment audio, improving driving safety.

[0156] Optionally, before mixing the multi - channel audio data with the rendering data of the first audio data to obtain the mixed audio data, the method further includes:

[0157] Reducing the volume of the rendering data of the first audio data.

[0158] The rendering data obtained by rendering the first audio data, that is, the multi - channel audio data, can have its volume reduced, such as multiplying by a preset percentage less than 1.

[0159] The preset percentage can be a default parameter or a configurable parameter, such as 50% or 75%.

[0160] In some other embodiments, the volume of the rendering data of the first audio data can be reduced to a set percentage of the volume of the multi - channel audio data obtained after rendering the second audio data, such as 50% or 60%.

[0161] By reducing the volume of the first audio data, the playback effect of the second audio data can be further improved, enabling the user at a specified position to better hear the content of the second audio data.

[0162] Figure 4 This is a flowchart of another in - vehicle audio processing method provided by the embodiments of the present application. This embodiment further limits step S01 on the basis of the Figure 3 embodiment shown, and adds a step of restoring the post - processing mode of the post - processing module. As Figure 4 shown, the in - vehicle audio processing method provided by this embodiment can include the following steps:

[0163] Step S401, in response to the presence of the to - be - played second audio data in the vehicle where the first audio data is being played, read and record the current post - processing mode of the post - processing module.

[0164] The in-vehicle operating system can read and record the current post-processing mode stored in the post-processing module by interacting with the post-processing module, so as to restore the current post-processing mode of the post-processing module after the second audio data is played.

[0165] Step S402, if the current post-processing mode is different from the post-processing mode corresponding to the second audio data, generate and issue a mode switching instruction for the post-processing module based on the post-processing mode corresponding to the second audio data.

[0166] In some embodiments, it is possible to directly generate and issue a mode switching instruction for the post-processing module based on the post-processing mode corresponding to the second audio data without determining whether the current post-processing mode of the post-processing module is different from the post-processing mode corresponding to the second audio data.

[0167] In other embodiments, it is possible to first determine whether the current post-processing mode of the post-processing module is different from the post-processing mode corresponding to the second audio data. If they are different, directly generate and issue a mode switching instruction for the post-processing module based on the post-processing mode corresponding to the second audio data; if they are the same, there is no need to switch the post-processing mode of the post-processing module. After rendering and mixing, directly perform post-processing on the mixed audio data through the post-processing module, so as to perform post-processing on the audio data after rendering the second audio data and the first audio data in the current post-processing mode of the post-processing module, and play the post-processed audio data through the speaker array of the vehicle.

[0168] Step S403, based on the type of the second audio data, determine the rendering algorithm of the second audio data, and render the second audio data based on the determined rendering algorithm, the sound source position corresponding to the second audio data, and the listening position corresponding to the post-processing mode corresponding to the second audio data, to obtain the multi-channel audio data.

[0169] A mapping relationship between the type of audio data and the rendering algorithm can be established in advance. Based on this mapping relationship and the type of the second audio data, determine the rendering algorithm used for rendering the second audio data, and render the second audio data based on the determined rendering algorithm, the layout of the speaker array in the vehicle playback environment, the sound source position corresponding to the second audio data, and the corresponding listening position, so as to achieve the presentation of surround sound or panoramic sound.

[0170] The rendering algorithms include but are not limited to panoramic sound rendering algorithms, panning rendering algorithms, wave field synthesis rendering algorithms, sound bed rendering algorithms, etc.

[0171] Among them, the adopted panoramic sound rendering algorithm can be the first-order panoramic sound rendering algorithm (First Order Ambisonics, FOA) or the high-order panoramic sound rendering algorithm (High Order Ambisonics, HOA). The high-order panoramic sound rendering algorithm uses high-order spherical harmonic functions, such as second-order, third-order, etc., to improve the spatial resolution of the rendering algorithm, enrich the details of the sound image, and improve the stereoscopic effect of the second audio data rendering.

[0172] The sound bed rendering algorithm is a rendering algorithm proposed for the sound bed.

[0173] The panning algorithm is a rendering algorithm that uses panning, such as the basic panning algorithm, which performs sound rendering through simple panning, and the improved panning algorithm, such as the Vector Based Amplitude Panning (VBAP), the Distance Based Amplitude Panning (DBAP), etc.

[0174] The Wave Field Synthesis (WFS) rendering algorithm is a technology that uses a loudspeaker array to reconstruct the spatial sound field, realizing the reproduction of a real sound field at a specified listening position.

[0175] Exemplarily, Figure 5 is a schematic diagram of the rendering effect of the second audio data provided by the embodiment of the present application. Figure 5 Taking the audio data of the second audio data as an obstacle reminder sound, the content of which is "Be careful of obstacles", as Figure 5 shown, there is an obstacle in the upper right front of the vehicle ( Figure 5 the solid circle is used to represent the obstacle in Figure 5 ), such as a pedestrian crossing the road. Through rendering, the sound emitted by the loudspeaker, that is, "Be careful of obstacles", reaches the listening position, simulating the sound of a sound source at the position of the pedestrian emitting "Be careful of obstacles" reaching the listening position. So that the user at the listening position, such as the driver, can accurately judge the position of the obstacle after hearing the reminder sound of "Be careful of obstacles".

[0176] In this embodiment, by differentially configuring the rendering algorithm for the second audio data, the accuracy of the second audio data rendering is improved; combining the sound source position and the listening position (or the optimal post-processing position) corresponding to the second audio data to perform the second audio data rendering, so that the user can distinguish the position of the second audio data sound source based on the heard sound, such as the position of the obstacle, the position of the vehicle about to collide, etc., achieving the effect of listening and distinguishing positions and improving the immersive effect of the second audio data.

[0177] Step S404: Mix the multi-channel audio data with the rendering data of the first audio data to obtain the mixed audio data.

[0178] For ease of description, the audio data obtained after rendering the first audio data can be denoted as the first multi-channel audio data, and the audio data obtained after rendering the second audio data can be denoted as the second multi-channel audio data.

[0179] The number of channels of the multi-channel audio data (including the first multi-channel audio data and the second multi-channel audio data) can be determined by the rendering algorithm or the layout of the speaker array in the vehicle playback environment.

[0180] By rendering the first multi-channel audio data and the second multi-channel audio data, in order to play the second audio data and the first audio data simultaneously, it is necessary to mix and superimpose the first multi-channel audio data and the second multi-channel audio data to obtain the mixed audio data.

[0181] In some other embodiments, before the mixing and superimposing, the volume of the first multi-channel audio data can also be reduced, so that the user can hear the content of the second audio data more clearly.

[0182] Step S405: After switching the post-processing mode of the post-processing module to the post-processing mode corresponding to the second audio, send the mixed audio data to the post-processing module, so that the post-processing module performs post-processing on the mixed audio data based on the post-processing mode corresponding to the second audio.

[0183] The post-processing module uses the post-processing mode corresponding to the second audio as the post-processing mode, performs post-processing on the mixed audio data, and plays the post-processed audio data through the speaker array of the vehicle, so that the played second audio data and the first audio data use the optimal listening position corresponding to the second audio data as the optimal listening position, thereby improving the playback effect of the second audio data when multiple audio data are played simultaneously.

[0184] Step S406: When the second audio data finishes playing, generate and send a mode restoration instruction for the post-processing module based on the current post-processing mode to switch the post-processing mode of the post-processing module to the current post-processing mode.

[0185] After the second audio data is played, since the duration of the first audio data is much longer than that of the second audio data, a mode restoration instruction for the post-processing module can be generated based on the previously recorded current post-processing mode of the post-processing module, so as to restore the post-processing mode of the post-processing module from the post-processing mode corresponding to the second audio data to the previously recorded current post-processing mode, so that the post-processing module uses the post-processing mode corresponding to the first audio data for subsequent post-processing and playback of the first audio data, improving the presentation effect of the first audio data.

[0186] In this embodiment, when the post-processing mode corresponding to the first audio data, that is, the current post-processing mode of the post-processing module, is different from the post-processing mode corresponding to the second audio data, the post-processing mode of the post-processing module is switched from the post-processing mode corresponding to the first audio data to the post-processing mode corresponding to the second audio data, so that the audio presented after post-processing uses the optimal listening position corresponding to the second audio data as the listening position, ensuring the presentation effect of the second audio data; when the post-processing modes corresponding to the first audio data and the second audio data are the same, there is no need to switch the post-processing mode of the post-processing module, reducing the number of switches and the cost of post-processing mode control; at the same time, before switching the post-processing mode of the post-processing module, by recording the post-processing mode before the switch, the post-processing mode of the post-processing module before the switch is restored after the second audio data is played, so as to ensure the post-processing effect of the subsequent first audio data.

[0187] In some embodiments, the number of the second audio data can be multiple. When there are multiple second audio data that need to be played simultaneously, that is, when it is necessary to play multiple second audio data on the basis of playing the first audio data, the post-processing mode of the post-processing module can be the post-processing mode corresponding to the second audio data with the highest priority according to the priority, so as to preferentially ensure the presentation effect of the second audio data with the highest priority.

[0188] Optionally, if the number of the second audio data is multiple, generating and sending a mode switching instruction for the post-processing module based on the post-processing mode corresponding to the second audio data includes:

[0189] Generating and sending a mode switching instruction for the post-processing module based on the post-processing mode corresponding to the second audio data with the highest priority among the multiple second audio data.

[0190] The priority of the second audio data can be pre-configured or custom-configured by the user.

[0191] Specifically, the priority of the audio data can be set based on the impact degree of the audio data on the vehicle or the people in the vehicle, or the urgency of the audio data.

[0192] Exemplarily, the priority of the prompt audio data is higher than that of the entertainment audio data, and the priority of the driving safety prompt sound data is higher than that of the navigation prompt sound data.

[0193] In some other embodiments, the priority of some of the prompt sound data in the driving safety prompt sound data is higher than that of the navigation prompt sound data. For example, the priority of the audio data of the collision type safety prompt sound is higher than that of the navigation prompt sound data, and the priority of the audio data of the seat belt unfastened prompt sound is lower than that of the navigation prompt sound data.

[0194] Specifically, after receiving multiple pieces of second audio data to be played, the priority of each piece of second audio data can be read and compared to obtain the second audio data with the highest priority; the post-processing mode corresponding to the second audio data with the highest priority is read, and a mode switching instruction for the post-processing module is generated, so as to switch the post-processing mode of the post-processing module to the post-processing mode corresponding to the second audio data with the highest priority.

[0195] By configuring appropriate priorities for the audio data, it is ensured that when multiple pieces of audio data are played simultaneously, the post-processing mode of the audio data with a higher priority is preferentially adopted, thereby ensuring the presentation quality of the audio data with a higher priority.

[0196] The embodiment of the present application provides a vehicle-mounted audio system, including a vehicle head unit operating system, an audio bus, a controller area network bus, a post-processing module, and a speaker array; the vehicle head unit operating system sends the rendered audio data to the post-processing module through the audio bus; the vehicle head unit operating system interacts with the post-processing module through the controller area network bus; the post-processing module is used to perform post-processing on the rendered audio data; the speaker array is used to play the audio data post-processed by the post-processing module; the vehicle head unit operating system is used to execute the method provided in any embodiment of the present application to perform playback control of the audio data.

[0197] Figure 6 It is a schematic structural diagram of a vehicle-mounted audio system provided by the embodiment of the present application. Figure 6 Taking the post-processing module as a power amplifier as an example, as Figure 6 shown, the vehicle-mounted audio system includes a vehicle head unit operating system, a CAN (Controller Area Network) bus, a power amplifier, an A2B audio bus, and a speaker array.

[0198] The in-vehicle infotainment (IVI) system operating system interacts with the power amplifier via the CAN bus. For example, it sends the above-mentioned mode switching instruction and mode restoration instruction to the power amplifier to control the post-processing mode of the power amplifier. The IVI system operating system is also used to perform operations such as rendering and mixing of audio data, and to send the rendered or mixed audio data to the power amplifier via the A2B audio bus. The power amplifier is used to perform post-processing on the input audio data, and the post-processing mode used during post-processing can be controlled by the IVI system operating system. The speaker array is connected to the power amplifier and is used to play the post-processed audio data, thereby presenting an immersive audio playback effect to the vehicle occupants.

[0199] Figure 6 Taking the first audio as a multimedia program and the second audio as a prompt tone as an example, the prompt tone is rendered by the IVI system operating system to obtain corresponding multi-channel audio data; the multimedia program is decoded and rendered by the IVI system operating system to obtain corresponding multi-channel audio data; then the IVI system operating system mixes the two-channel multi-channel audio data to obtain the mixed audio data; the mixed audio data is sent to the power amplifier via the A2B bus. The post-processing mode of the power amplifier can be adjusted or switched by an instruction, such as being switched by a mode switching instruction issued by the IVI system operating system. The IVI system operating system specifically generates a mode switching instruction based on the post-processing mode corresponding to the prompt tone, such as the front row mode. This mode switching instruction is sent to the power amplifier via the CAN bus, so that the power amplifier switches its own post-processing mode to the post-processing mode corresponding to the prompt tone and performs post-processing on the received mixed audio data. The post-processed audio data is played through the vehicle's speaker array.

[0200] Exemplarily, the IVI system operating system can be Android, AliOS, etc., and the channel layout of the speaker array can be 5.1.4, 7.1.4, 7.3.4, 9.1.4 or other layouts.

[0201] Figure 7 The flowchart of another in-vehicle audio processing method provided by the embodiment of the present application. The in-vehicle audio processing method provided by this embodiment is applied to Figure 6 the in-vehicle audio system shown in the embodiment, and can be executed by the IVI system operating system therein.

[0202] In this embodiment, taking the post-processing module as the power amplifier, the first audio data as entertainment audio data, the second audio data as prompt tone data, and the post-processing mode corresponding to the prompt tone data as the driver's mode as an example, as Figure 7 shown, the in-vehicle audio processing method provided by this embodiment specifically includes the following steps:

[0203] Step S701, when the in-vehicle audio system playing entertainment audio data needs to play prompt tone data, the vehicle head unit operating system records the current post-processing mode of the power amplifier;

[0204] Step S702, the vehicle head unit operating system sends a mode switching instruction to the power amplifier via the CAN bus, controlling the power amplifier to switch the post-processing mode to the driver's mode;

[0205] Step S703, the vehicle head unit operating system renders the prompt tone data in combination with the sound source position to obtain multi-channel audio data of the prompt tone;

[0206] Step S704, the vehicle head unit operating system reduces the volume of the entertainment audio data;

[0207] The volume of the entertainment audio data can be reduced according to the pre-set volume percentage of the prompt tone data and the entertainment audio data. For example, the volume of the entertainment audio data is updated to the product of it and the pre-set percentage, and the pre-set percentage is less than 1.

[0208] Step S705, the vehicle head unit operating system superimposes and mixes the multi-channel audio data of the prompt tone and the multi-channel audio data obtained by rendering the entertainment audio data in the vehicle head unit operating system;

[0209] Step S706, the vehicle head unit operating system transmits the superimposed and mixed audio data to the power amplifier via the A2B audio bus;

[0210] Step S707, after the superimposed and mixed audio data is post-processed by the power amplifier in the driver's mode (just switched), it is played through the speaker array;

[0211] Step S708, after the prompt tone data is played, the vehicle head unit operating system sends the recorded post-processing mode to the power amplifier via the CAN bus, and the power amplifier restores the post-processing mode.

[0212] The sound source position of the prompt tone data can be provided by the device providing the prompt tone data. The device can be a camera, radar, etc. on the vehicle, or a mobile terminal connected to the vehicle.

[0213] Taking the audio data of the obstacle prompt tone as an example, its sound source position can be the position of the obstacle relative to the vehicle. Thus, by rendering the prompt tone data with the position of the obstacle relative to the vehicle as the sound source position, the user, such as the driver, can determine the position of the obstacle relative to the vehicle based on the played obstacle prompt tone, achieving the effect of sound localization, improving the rendering effect of the prompt tone and driving safety.

[0214] In some embodiments, the in-vehicle audio system includes an ADAS (Advanced Driving Assistance System), which is configured to determine whether there is an obstacle based on data collected by sensors. If so, it generates audio data of a prompt sound corresponding to the obstacle (a second type of audio data).

[0215] Figure 8 FIG. is a schematic structural diagram of an in-vehicle audio processing device provided by an embodiment of the present application. As Figure 8 shown, the in-vehicle audio processing device includes: a post-processing mode switching module 810, a rendering module 820, and an audio post-processing module 830.

[0216] The post-processing mode switching module 810 is configured to generate and send a mode switching instruction for the post-processing module based on the post-processing mode corresponding to the second audio data to be played in the vehicle, so as to switch the post-processing mode of the post-processing module to the post-processing mode corresponding to the second audio; the rendering module 820 is configured to render the second audio data to obtain multi-channel audio data; the audio post-processing module 830 is configured to send the multi-channel audio data to the post-processing module, so that the post-processing module performs post-processing on the multi-channel audio data based on the post-processing mode corresponding to the second audio.

[0217] In some embodiments, the post-processing mode switching module 810 is specifically configured to:

[0218] If there are multiple pieces of the second audio data, determine target audio data from the multiple pieces of the second audio data based on the type and / or priority of the multiple pieces of the second audio data; generate a mode switching instruction for the post-processing module based on the post-processing mode corresponding to the target audio data, so as to switch the post-processing mode of the post-processing module to the post-processing mode corresponding to the second audio.

[0219] In some embodiments, the first audio data is being played in the vehicle, and the device further includes a mixing module, which is configured to:

[0220] Mix the multi-channel audio data with the rendering data of the first audio data to obtain mixed audio data.

[0221] Correspondingly, the audio post-processing module 830 is specifically configured to:

[0222] Send the mixed audio data to the post-processing module, so that the post-processing module performs post-processing on the mixed audio data based on the post-processing mode corresponding to the second audio.

[0223] In some embodiments, the post-processing mode switching module 810 includes:

[0224] A current mode storage unit for reading and recording the current post - processing mode of the post - processing module; a post - processing mode switching unit for generating and sending a mode switching instruction for the post - processing module based on the post - processing mode corresponding to the second audio data if the current post - processing mode is different from the post - processing mode corresponding to the second audio data.

[0225] In some embodiments, the post - processing mode switching module 810 further includes:

[0226] A post - processing mode restoration unit for generating and sending a mode restoration instruction for the post - processing module based on the current post - processing mode when the second audio data finishes playing, so as to switch the post - processing mode of the post - processing module to the current post - processing mode.

[0227] In some embodiments, the first audio data is entertainment audio data and the second audio data is prompt tone data; or, the first audio data is navigation prompt tone data and the second audio data is driving safety prompt tone data, and both the navigation prompt tone data and the driving safety prompt tone data are prompt tone data.

[0228] In some embodiments, the device further includes:

[0229] A post - processing mode determination module for determining the playback delay corresponding to the second audio data based on the type of the second audio data; and determining the post - processing mode of the second audio data based on the listening position corresponding to the second audio data and the playback delay.

[0230] In some embodiments, the device further includes:

[0231] A listening position determination module for determining the listening position corresponding to the second audio data based on the action area of the driving safety prompt tone data if the second audio data is the driving safety prompt tone data.

[0232] In some embodiments, the post - processing mode switching module 810 is specifically configured to:

[0233] In response to the presence of multiple second audio data to be played in a vehicle where the first audio data is being played, generating and sending a mode switching instruction for the post - processing module based on the post - processing mode corresponding to the second audio data with the highest priority among the multiple second audio data, so as to switch the post - processing mode of the post - processing module to the post - processing mode corresponding to the second audio with the highest priority.

[0234] In some embodiments, the rendering module 820 is specifically configured to:

[0235] Determine the rendering algorithm for the second audio data based on the type of the second audio data; render the second audio data based on the determined rendering algorithm, the sound source position corresponding to the second audio data, and the listening position corresponding to the post-processing mode corresponding to the second audio data to obtain the multi-channel audio data; mix the multi-channel audio data with the rendering data of the first audio data to obtain the mixed audio data.

[0236] In some embodiments, the apparatus further includes:

[0237] A volume adjustment module, configured to reduce the volume of the rendering data of the first audio data before mixing the multi-channel audio data with the rendering data of the first audio data to obtain the mixed audio data. An embodiment of the present application also provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the processor is caused to implement the method provided in any embodiment of the present application.

[0238] An embodiment of the present application also provides a computer program product, including a computer program, which when executed by a processor implements the method provided in any embodiment of the present application.

[0239] Those skilled in the art will readily conceive of other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common general knowledge or conventional technical means in the technical field not disclosed herein. The specification and embodiments are to be considered as exemplary only, and the true scope and spirit of the present disclosure are pointed out by the following claims.

[0240] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.

Claims

1. An in-vehicle audio processing method, characterized in that Including: For the second audio data to be played in the vehicle, based on the post - processing mode corresponding to the second audio data, generating a mode - switching instruction for the post - processing module to switch the post - processing mode of the post - processing module to the post - processing mode corresponding to the second audio data; the post - processing mode is used to characterize the listening position corresponding to the second audio data and / or the requirements of the second audio data for playback delay. Rendering the second audio data to obtain multi - channel audio data. Sending the multi - channel audio data to the post - processing module so that the post - processing module performs post - processing on the multi - channel audio data based on the post - processing mode corresponding to the second audio data.

2. The method according to claim 1, wherein If there are multiple second audio data, generating a mode - switching instruction for the post - processing module based on the post - processing mode corresponding to the second audio data includes: Determining target audio data from the multiple second audio data based on the type and / or priority of the multiple second audio data. Generating the mode - switching instruction for the post - processing module based on the post - processing mode corresponding to the target audio data.

3. The method according to claim 1, characterized in that, The first audio data is being played in the vehicle. After rendering the second audio data to obtain multi - channel audio data, the method further includes: Mixing the multi - channel audio data with the rendering data of the first audio data to obtain mixed audio data. Sending the multi - channel audio data to the post - processing module so that the post - processing module performs post - processing on the multi - channel audio data based on the post - processing mode corresponding to the second audio data includes: Sending the mixed audio data to the post - processing module so that the post - processing module performs post - processing on the mixed audio data based on the post - processing mode corresponding to the second audio.

4. The method according to claim 3, wherein Generating and sending a mode - switching instruction for the post - processing module based on the post - processing mode corresponding to the second audio data includes: Reading and recording the current post - processing mode of the post - processing module. If the current post - processing mode is different from the post - processing mode corresponding to the second audio data, generating and sending a mode - switching instruction for the post - processing module based on the post - processing mode corresponding to the second audio data.

5. The method according to claim 4, characterized in that The method further includes: When the second audio data finishes playing, generating and sending a mode - recovery instruction for the post - processing module to switch the post - processing mode of the post - processing module to the current post - processing mode.

6. The method according to claim 3, characterized in that, Before mixing the multi - channel audio data with the rendering data of the first audio data to obtain mixed audio data, the method further includes: Reducing the volume of the rendering data of the first audio data.

7. The method according to any one of claims 1-6, characterized in that The method further includes: Determining the playback delay corresponding to the second audio data based on the type of the second audio data. Determining the post - processing mode of the second audio data based on the listening position corresponding to the second audio data and the playback delay.

8. The method according to claim 7, wherein If the second audio data is driving safety prompt tone data, the method further includes: Determining the listening position corresponding to the second audio data based on the action area of the driving safety prompt tone data.

9. The method according to any one of claims 1-6, characterized in that The method is applied to the in-vehicle operating system of the vehicle, and the post-processing module is deployed in the in-vehicle operating system, or the post-processing module is a power amplifier.

10. The method according to any one of claims 1-6, characterized in that Render the second audio data to obtain multi-channel audio data, including: Determine the rendering algorithm of the second audio data based on the type of the second audio data; Render the second audio data based on the determined rendering algorithm, the sound source position corresponding to the second audio data, and the listening position corresponding to the post-processing mode corresponding to the second audio data, to obtain the multi-channel audio data.

11. A vehicle audio system, characterized in that, It includes an in-vehicle operating system, an audio bus, a controller area network bus, a post-processing module, and a speaker array; The in-vehicle operating system sends the rendered audio data to the post-processing module through the audio bus; The in-vehicle operating system interacts with the post-processing module through the controller area network bus for instruction; The post-processing module is used to perform post-processing on the rendered audio data; The speaker array is used to play the audio data post-processed by the post-processing module; The in-vehicle operating system is used to execute the method provided in any one of claims 1-10 to perform processing control of audio data.

Images