Audio playing method, electronic device and vehicle

Abstract

This application provides an audio playback method, electronic device, and vehicle, relating to the field of smart cockpit technology. In response to concurrent playback requests for multiple types of audio within the cockpit, the target playback volume for each type of audio is dynamically determined based on the ambient noise level within the cockpit. This can counteract the obscuring effect of ambient noise on key information by increasing the signal-to-noise ratio of the played audio relative to ambient noise when multiple types of audio are mixed and played, thus overcoming the limitation of simply linearly superimposing multiple types of audio, which results in important information being buried. Furthermore, mixing and playing multiple types of audio based on the target playback volume intelligently highlights important audio containing substantial content and reasonably suppresses secondary audio. The dynamic adjustment of the target playback volume of each type of audio in the mixed playback based on the ambient noise level in this solution ensures that users can still clearly obtain important information in noisy environments, significantly improving the auditory experience within the cockpit.

Description

Technical Field

[0001] This application relates to the field of smart cockpit technology, and more specifically, to an audio playback method, electronic device, and vehicle in the field of smart cockpit technology. Background Technology

[0002] With the widespread use of audio in vehicle cabins, the integration of cabin audio systems is constantly improving. In-vehicle audio systems must not only provide entertainment but also integrate functions such as alarm sounds, Bluetooth calling, navigation announcements, and voice interaction. In most scenarios, multiple types of audio need to be played simultaneously.

[0003] When multiple audio types are played simultaneously, in-vehicle audio systems face the challenge of effectively managing these audio tracks to ensure that critical information is not obscured or interfered with. Current technologies often simply linearly superimpose multiple audio types, which can negatively impact the efficiency of identifying important information.

[0004] Therefore, there is an urgent need for an audio playback method to reasonably control the mixed playback of multiple types of audio and improve the efficiency of identifying important information. Summary of the Invention

[0005] This application provides an audio playback method, an electronic device, and a vehicle. The method can reasonably control the mixed playback of multiple types of audio, thereby improving the efficiency of identifying important information.

[0006] In a first aspect, an audio playback method is provided, the method comprising: responding to a concurrent playback request of multiple types of audio in the cabin of a target vehicle, determining an ambient noise value in the cabin, the ambient noise value being used to reflect the level of ambient noise; determining, based on the ambient noise value, a target playback volume for each type of audio in the multiple types of audio, the target playback volume of different audio paths being different; and mixing and playing the multiple types of audio based on the target playback volume of each type of audio.

[0007] In the aforementioned technical solution, in response to concurrent playback requests from multiple audio types within the cabin, the ambient noise level within the cabin is determined. This accurately quantifies the acoustic interference level of the current cabin environment, providing a core basis for subsequent mixed playback of multiple audio types. Subsequently, based on the ambient noise level, the target playback volume for each audio type is dynamically determined. This utilizes the masking effect in acoustics; that is, when multiple audio types are mixed and played, the signal-to-noise ratio of the played audio relative to the ambient noise is increased to counteract the masking effect of ambient noise on key information, thus overcoming the limitation of existing technologies that simply linearly superimpose multiple audio types, resulting in the silencing of important information. Based on this, mixing and playing multiple audio types based on the target playback volume intelligently highlights important audio containing substantial content while reasonably suppressing secondary audio. The mechanism in this solution that dynamically adjusts the target playback volume of each audio type in the mixed playback based on the ambient noise level not only solves the problem of the severe impact on the recognition efficiency of important information during linear superposition playback but also ensures that users can still clearly obtain important information in noisy environments, significantly improving the auditory experience and interactive safety within the cabin.

[0008] In conjunction with the first aspect, in some possible implementations, determining the target playback volume of each audio category among the multiple audio categories based on the ambient noise value includes: determining the volume gain coefficient corresponding to each audio category based on the ambient noise value, wherein the volume gain coefficient is used to indicate the amplification factor or attenuation factor of the corresponding audio path in the amplitude under the noise environment of the ambient noise value; and determining the target playback volume of each audio category based on the volume gain coefficient corresponding to each audio category.

[0009] In the above technical solution, the volume gain coefficients for various audio types are determined based on the ambient noise level. The volume gain coefficient indicates the amplification or attenuation factor required for the audio amplitude in the current noise environment, providing a standardized adjustment benchmark for volume control. That is, a linear gain control mechanism can be used to transform complex environmental acoustic interference into specific mathematical factors, thereby achieving fine-grained compensation for different audio signal intensities. Based on this, the target playback volume is determined according to the volume gain coefficients for each audio type, allowing for differentiated gain strategies to be assigned to audio of different priorities. This solution not only avoids abrupt changes in sound caused by harsh adjustments but also ensures that important audio receives sufficient signal-to-noise ratio compensation in noisy environments, while secondary audio is appropriately suppressed. In other words, this solution can accurately and adaptively determine the optimal playback volume for multiple audio types in complex and variable cabin noise environments, significantly improving the clarity and layering during mixed playback.

[0010] Combining the first aspect and the above implementation methods, in some possible implementation methods, determining the volume gain coefficient corresponding to each type of audio based on the ambient noise value includes: determining the first volume gain coefficient corresponding to each type of audio based on the ambient noise value; obtaining the target operating condition parameters of the target vehicle, and determining the first adjustment coefficient based on the target operating condition parameters, wherein the first adjustment coefficient is used to adjust the first volume gain coefficient, and the target operating condition parameters are used to reflect the changing trend of the noise level in the cabin; and determining the volume gain coefficient corresponding to each type of audio based on the product between the first adjustment coefficient and the first volume gain coefficient corresponding to each type of audio.

[0011] In the above technical solution, based on the environmental noise value, the first volume gain coefficient corresponding to various audio types is determined, which can quantify the basic volume compensation requirements under the current noise environment. Subsequently, vehicle operating condition parameters are introduced as forward-looking variables to determine the first adjustment coefficient that reflects the changing trend of cabin noise levels. The first adjustment coefficient is then multiplied by the first volume gain coefficient to construct a dynamic feedforward compensation strategy. This solution can overcome the lag of relying solely on real-time noise feedback and can predict trends such as increased wind noise and tire noise due to increased vehicle speed. This solution can not only counteract the current environmental masking effect but also smooth out volume fluctuations caused by sudden changes in vehicle operating conditions, thereby achieving a high degree of adaptability during mixed playback and ultimate auditory consistency in complex and ever-changing driving environments.

[0012] In conjunction with the first aspect and the above implementation methods, in some possible implementation methods, the multiple audio categories include driving guidance audio, alarm notification audio, and entertainment audio. Based on the ambient noise value, determining the first volume gain coefficient corresponding to each type of audio includes: obtaining a reference volume gain coefficient, which is a fixed volume gain coefficient used by each type of audio when there is no ambient noise in the cabin; determining the first volume gain coefficient corresponding to the driving guidance audio based on the ambient noise value, the first coefficient, and the reference volume gain coefficient, where the first coefficient is used to indicate the playback priority of the driving guidance audio among the multiple audio categories, and the first coefficient is a volume gain coefficient corresponding to a unit decibel; determining the first volume gain coefficient corresponding to the alarm notification audio based on the ambient noise value, the second coefficient is used to indicate the playback priority of the alarm notification audio among the multiple audio categories, and the second coefficient is greater than the first coefficient; and determining the first volume gain coefficient corresponding to the entertainment audio based on the ambient noise value, the third coefficient is used to indicate the playback priority of the entertainment audio among the multiple audio categories, and the first coefficient is greater than the third coefficient.

[0013] In the above technical solution, a reference volume gain coefficient is obtained, which clearly defines the volume reference in a noise-free environment. Subsequently, a gain coefficient in decibels (dB) is introduced to characterize playback priority, implementing differentiated dynamic compensation strategies for different audio categories. Specifically, based on the ambient noise level, a first coefficient, and the reference volume gain coefficient, a first volume gain coefficient is determined for driving guidance audio; a second coefficient greater than the first coefficient is determined for warning audio; and a third coefficient less than the first coefficient is used to determine the first volume gain coefficient for entertainment audio. This tiered coefficient setting ensures stronger noise reduction for warning and driving guidance audio, while entertainment audio is moderately suppressed. This allows for accurate reconstruction of the hierarchical relationship of multiple audio categories in noisy environments, ensuring that critical driving information is not drowned out by ambient noise and preventing the inversion of playback priority for secondary audio. Therefore, this solution can significantly improve auditory comfort during human-computer interaction.

[0014] In conjunction with the first aspect and the above implementation methods, in some possible implementation methods, determining the first volume gain coefficient corresponding to the driving guidance audio based on the ambient noise value, the first coefficient, and the reference volume gain coefficient includes: determining the product between the ambient noise value and the first coefficient to obtain a second volume gain coefficient, and determining the sum of the second volume gain coefficient and the reference volume gain coefficient as the first volume gain coefficient corresponding to the driving guidance audio; and determining the first volume gain coefficient corresponding to the alarm notification audio based on the ambient noise value, the second coefficient, and the reference volume gain coefficient includes: determining... The product of the ambient noise value and the second coefficient is used to obtain a third volume gain coefficient, and the sum of the third volume gain coefficient and the reference volume gain coefficient is used to determine the first volume gain coefficient corresponding to the alarm notification audio. Furthermore, based on the ambient noise value, the third coefficient, and the reference volume gain coefficient, the first volume gain coefficient corresponding to the entertainment audio is determined, including: determining the product of the ambient noise value and the third coefficient to obtain a fourth volume gain coefficient, and the difference between the reference volume gain coefficient and the fourth volume gain coefficient is used to determine the first volume gain coefficient corresponding to the entertainment audio.

[0015] In the above technical solution, for high-priority driving guidance audio and warning audio, a product summation mechanism is used to ensure that their volume increases linearly with ambient noise to counteract the masking effect. For low-priority entertainment audio, the ambient noise value is multiplied by a third coefficient to obtain a fourth volume gain coefficient, and the difference between the base volume gain coefficient and the fourth volume gain coefficient is determined to achieve a negative adjustment where the entertainment volume automatically decreases as the noise level rises. In other words, the above solution provides a two-way control strategy combining positive noise reduction compensation and negative dynamic avoidance. This not only ensures the clarity and penetration of key information during driving in noisy environments, but also avoids sound field conflicts between multiple audio types by lowering the first volume gain coefficient corresponding to entertainment audio, greatly improving the efficiency of information interaction and auditory comfort in the cabin.

[0016] Combining the first aspect and the above implementation methods, in some possible implementation methods, determining the first volume gain coefficient corresponding to each type of audio based on the ambient noise value includes: determining the ambient noise level based on the noise value range to which the ambient noise value falls; obtaining the volume gain coefficient of multiple types of sample audio corresponding to the ambient noise level; for each type of audio in the multiple types of audio, determining the target audio that matches the audio from the multiple types of sample audio, and determining the volume gain coefficient of the target audio as the first volume gain coefficient corresponding to the audio.

[0017] The above technical solution abandons complex real-time calculations and adopts a lookup table method or empirical mapping method based on noise scene classification to select the volume gain coefficient that matches the current multiple audio types, which serves as the first volume gain coefficient for each audio type. This solution not only significantly reduces the real-time computing power overhead of the in-vehicle processor but also ensures the accuracy and stability of volume adjustment by calling verified acoustic parameters (multiple sample noise levels and volume gain coefficients of multiple sample audio types). Therefore, this solution can achieve adaptive optimization during mixing playback with extremely high computational efficiency in complex and variable cabin noise environments, perfectly balancing the response speed of the in-vehicle processor and the continuity of the listening experience.

[0018] In combination with the first aspect and the above implementation methods, in some possible implementation methods, determining the environmental noise value in the cabin includes: acquiring the original sound signal in the cabin and converting the original sound signal into a frequency domain sound signal; filtering out a first type of sound signal from the frequency domain sound signal to obtain a noise signal in the frequency domain, wherein the first type of sound signal is a non-environmental noise signal actively emitted by the vehicle system; and converting the signal intensity of the noise signal into a decibel value to obtain the environmental noise value.

[0019] The above technical solution involves acquiring the raw sound signal within the cabin and converting it into a frequency-domain sound signal, overcoming the limitations of single time-domain analysis. Based on this, non-environmental noise signals actively emitted by the vehicle system (i.e., Type I sound signals) are filtered out from the frequency-domain sound signal, resulting in a clean frequency-domain noise signal. The signal strength of this frequency-domain noise signal is then converted into decibel values ​​as the ambient noise level. This processing method effectively eliminates interference from in-vehicle music, navigation announcements, and other sound sources, preventing volume adjustment loops caused by misjudging in-vehicle entertainment volume and significantly improving the accuracy and robustness of intelligent audio control within the cabin.

[0020] Combining the first aspect and the above implementation methods, in some possible implementation methods, the multi-type audio is mixed and played based on the target playback volume of each type of audio, including: adjusting the amplitude of the time-domain audio signal corresponding to each type of audio based on the target playback volume of each type of audio to obtain the adjusted audio signal corresponding to each type of audio; superimposing the adjusted audio signals corresponding to the multi-type audio to obtain the mixed audio signal; and controlling the in-vehicle player in the target vehicle to output the mixed audio signal to mix and play the multi-type audio.

[0021] In the above technical solution, amplitude modulation is applied to the time-domain audio signals corresponding to various audio types, and then the adjusted audio signals corresponding to multiple audio types are superimposed. This processing strategy not only ensures that various audio types are strictly fused according to preset playback priorities and signal-to-noise ratio requirements, but also effectively avoids amplitude overflow problems that may be caused when the adjusted audio signals corresponding to multiple audio types are directly superimposed. In addition, by transforming the abstract volume strategy into specific time-domain signal processing, the above solution can also guarantee the clarity of important audio and the layering of other audio types during mixed playback, perfectly achieving high-quality playback of multiple audio types in the in-vehicle environment.

[0022] Secondly, a cabin audio mixing device is provided, comprising: a determining module, configured to: in response to a concurrent playback request of multiple types of audio in the cabin of a target vehicle, determine an ambient noise value in the cabin, the ambient noise value reflecting the level of ambient noise; based on the ambient noise value, determine the target playback volume of each type of audio, the target playback volume of different audio streams being different; and a playback module, configured to mix and play the multiple types of audio based on the target playback volume of each type of audio.

[0023] In conjunction with the second aspect, in some possible implementations, the determining module is specifically used to: determine the volume gain coefficient corresponding to each type of audio based on the ambient noise value, wherein the volume gain coefficient is used to indicate the amplification factor or attenuation factor of the corresponding audio in the amplitude under the noise environment of the ambient noise value; and determine the target playback volume of each type of audio based on the volume gain coefficient corresponding to each type of audio.

[0024] In conjunction with the second aspect and the above implementation methods, in some possible implementation methods, the determining module is further specifically used for: determining the first volume gain coefficient corresponding to each type of audio based on the ambient noise value; obtaining the target operating condition parameters of the target vehicle, and determining the first adjustment coefficient based on the target operating condition parameters, the first adjustment coefficient being used to adjust the first volume gain coefficient, the target operating condition parameters being used to reflect the changing trend of the noise level in the cabin; and determining the volume gain coefficient corresponding to each type of audio based on the product between the first adjustment coefficient and the first volume gain coefficient corresponding to each type of audio.

[0025] In conjunction with the second aspect and the above implementation methods, in some possible implementation methods, the multiple audio types include driving guidance audio, alarm notification audio, and entertainment audio. The determining module is further specifically used for: obtaining a reference volume gain coefficient, which is a fixed volume gain coefficient used for each type of audio when there is no ambient noise in the cabin; determining a first volume gain coefficient corresponding to the driving guidance audio based on the ambient noise value, a first coefficient, and the reference volume gain coefficient, where the first coefficient indicates the playback priority of the driving guidance audio among the multiple audio types, and the first coefficient is a volume gain coefficient per decibel; determining a first volume gain coefficient corresponding to the alarm notification audio based on the ambient noise value, a second coefficient, and the reference volume gain coefficient, where the second coefficient indicates the playback priority of the alarm notification audio among the multiple audio types, and the second coefficient is greater than the first coefficient; and determining a first volume gain coefficient corresponding to the entertainment audio based on the ambient noise value, a third coefficient, and the reference volume gain coefficient, where the third coefficient indicates the playback priority of the entertainment audio among the multiple audio types, and the first coefficient is greater than the third coefficient.

[0026] In conjunction with the second aspect and the above implementation methods, in some possible implementation methods, the determining module is further configured to determine the product between the ambient noise value and the first coefficient to obtain a second volume gain coefficient, and to determine the sum of the second volume gain coefficient and the reference volume gain coefficient as the first volume gain coefficient corresponding to the driving guidance audio; and the determining module is further configured to determine the product between the ambient noise value and the second coefficient to obtain a third volume gain coefficient, and to determine the sum of the third volume gain coefficient and the reference volume gain coefficient as the first volume gain coefficient corresponding to the alarm notification audio; and the determining module is further configured to determine the product between the ambient noise value and the third coefficient to obtain a fourth volume gain coefficient, and to determine the difference between the reference volume gain coefficient and the fourth volume gain coefficient as the first volume gain coefficient corresponding to the entertainment audio.

[0027] In conjunction with the second aspect and the above implementation methods, in some possible implementation methods, the determining module is further configured to determine the environmental noise level based on the noise value range to which the environmental noise value falls; obtain the volume gain coefficients of multiple types of sample audio corresponding to the environmental noise level; for each type of audio in the multiple types of audio, determine the target audio that matches the audio from the multiple types of sample audio, and determine the volume gain coefficient of the target audio as the first volume gain coefficient corresponding to the audio.

[0028] In conjunction with the second aspect and the above-described implementation, in some possible implementations, the device further includes: a conversion module for acquiring the original sound signal inside the cabin and converting the original sound signal into a frequency domain sound signal; a filtering module for filtering out a first type of sound signal from the frequency domain sound signal to obtain a noise signal in the frequency domain, wherein the first type of sound signal is a non-environmental noise signal actively emitted within the vehicle system; the conversion module is also used to convert the signal intensity of the noise signal into a decibel value to obtain the environmental noise value.

[0029] In conjunction with the second aspect and the above implementation methods, in some possible implementation methods, the device further includes: an adjustment module, used to adjust the amplitude of the time-domain audio signal corresponding to each type of audio based on the target playback volume of each type of audio, to obtain the adjusted audio signal corresponding to each type of audio; a superposition module, used to superimpose the adjusted audio signals corresponding to the multiple types of audio to obtain a mixed audio signal; and a control module, used to control the in-vehicle player in the target vehicle to output the mixed audio signal for mixed playback of the multiple types of audio.

[0030] Thirdly, an electronic device is provided, including a storage module and a processing module. The storage module is used to store executable program code, and the processing module is used to call and run the executable program code from the storage module, causing the electronic device to perform the methods in the first aspect or any possible implementation thereof.

[0031] Fourthly, a vehicle is provided, including a memory and a processor. The memory is used to store executable program code, and the processor is used to call and run the executable program code from the memory, causing the vehicle to perform the methods described in the first aspect or any possible implementation thereof. Attached Figure Description

[0032] Figure 1 This is a schematic diagram of a scenario where audio is played in a cockpit, as provided in an embodiment of this application. Figure 2 This is a schematic flowchart illustrating an audio playback method provided in an embodiment of this application; Figure 3 This is a system architecture diagram on which an audio playback method provided in this application depends; Figure 4 This is a schematic diagram of the structure of an in-cabin audio mixing device provided in an embodiment of this application; Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application; Figure 6 This is a schematic diagram of the structure of a vehicle provided in an embodiment of this application. Detailed Implementation

[0033] The technical solutions in this application will be clearly and thoroughly described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B. "And / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0034] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.

[0035] In most typical vehicle usage scenarios, the vehicle cabin often requires the simultaneous playback of multiple audio formats of different types. For example, such as... Figure 1As shown, while the driver is driving vehicle A, the music player continuously plays music, and the navigation system provides real-time route guidance and voice announcements, such as "Turn right in 100 meters." When vehicle A experiences an abnormal condition, the onboard alarm device will also be triggered to output fault information, such as "abnormal tire pressure." This creates an application scenario where different types of audio (referred to as multi-audio) are played simultaneously in the cabin.

[0036] Currently, Figure 1 In the illustrated application scenario, when vehicle A is in motion, the friction between the vehicle body and the air generates wind noise, and the rolling of the tires against the road surface generates road noise, resulting in ambient noise within the cabin. Related technologies often involve simply linearly superimposing multiple audio types when they are played simultaneously in the cabin. However, in the presence of ambient noise, important audio such as navigation and warning audio, played at a fixed original volume, is easily masked by the noise, affecting the efficiency of identifying critical information. Specifically, this method of simply linearly superimposing multiple audio types does not distinguish between ambient noise within the cabin; it directly adds the time-domain signal amplitudes of various audio types, such as navigation, warning, and entertainment audio, at a fixed original volume, and then outputs the sum directly to the in-vehicle player for mixed playback.

[0037] To address the aforementioned technical problems, this application proposes an audio playback method to rationally control the mixed playback of multiple audio types, thereby improving the efficiency of identifying important information. Specific implementation steps are as follows: Figure 2 .

[0038] Figure 2 This is a schematic flowchart of an audio playback method provided in an embodiment of this application.

[0039] It should be understood that the audio playback method provided in this application embodiment can be applied to, for example, Figure 1 The vehicle shown (e.g., vehicle A) can specifically be used with an in-vehicle player. Alternatively, the mixing method can be performed by the vehicle or a controller within it.

[0040] For example, such as Figure 2 As shown, the method 200 includes the following steps 201 to 203.

[0041] Step 201: In response to the concurrent playback request of multiple types of audio in the cabin of the target vehicle, determine the ambient noise value in the cabin, which is used to reflect the level of ambient noise.

[0042] It should be understood that in step 201 above, concurrent playback requests refer to playback trigger requests for multiple types of audio received by the target vehicle within the same time period. "Same time period" can be understood as multiple types of audio overlapping in their playback time. Ambient noise levels can be characterized by decibel values, which specifically reflect the level of noise within the cabin. That is, the higher the noise level, the higher the ambient noise value; the lower the noise level, the lower the ambient noise value.

[0043] In one possible implementation, determining the ambient noise value in the cabin in step 201 includes: acquiring the original sound signal in the cabin and converting the original sound signal into a frequency domain sound signal; filtering out a first type of sound signal from the frequency domain sound signal to obtain a noise signal in the frequency domain, wherein the first type of sound signal is a non-environmental noise signal actively emitted by the vehicle system; and converting the signal intensity of the noise signal into a decibel value to obtain the ambient noise value.

[0044] It should be understood that in the above scheme, the original sound signal refers to the time-domain signal of the mixed sound waves in the cabin, used to characterize the sum of all sounds in the cabin. This includes wind noise, road noise, music / navigation / alarm sounds played by the vehicle's own system, as well as the voices of the driver and passengers, abnormal noises inside the vehicle, and operating noise of the onboard equipment. Among them, wind noise refers to the airflow noise generated when the target vehicle is moving, caused by the friction between the body, windows, rearview mirrors, etc., and the airflow rushing into the gaps in the body. Road noise refers to the vibration and rolling noise transmitted to the cabin through the chassis and body when the target vehicle is moving, caused by the rolling friction between the tires and the road surface, the impact of the road surface unevenness on the tires, and the rolling noise.

[0045] It should also be understood that, in the above scheme, non-environmental noise signals refer to the sound signals actively output by the vehicle's own infotainment system, such as music / navigation / alarm sounds; these represent effective audio signals actively output by the user and are not inherent noises in the external driving environment. Among these, the voices of drivers and passengers, abnormal noises inside the vehicle, and the operating noise of onboard equipment are considered environmental noises, as are wind noise and road noise.

[0046] The above technical solution involves acquiring the raw sound signal within the cabin and converting it into a frequency-domain sound signal, overcoming the limitations of single time-domain analysis. Based on this, non-environmental noise signals actively emitted by the vehicle system (i.e., Type I sound signals) are filtered out from the frequency-domain sound signal, resulting in a clean frequency-domain noise signal. The signal strength of this frequency-domain noise signal is then converted into decibel values ​​as the ambient noise level. This processing method effectively eliminates interference from in-vehicle music, navigation announcements, and other sound sources, preventing volume adjustment loops caused by misjudging in-vehicle entertainment volume and significantly improving the accuracy and robustness of intelligent audio control within the cabin.

[0047] In some embodiments, converting the original sound signal into a frequency domain sound signal includes: performing a Fourier transform on the original sound signal to decompose the original sound signal in the time dimension into different frequency components to obtain the frequency domain sound signal.

[0048] In some embodiments, filtering out a first type of sound signal from the frequency domain sound signal to obtain a noise signal in the frequency domain includes: acquiring the spectral characteristics and frequency distribution range of the first type of sound signal; defining a corresponding frequency band region in the frequency domain sound signal based on the frequency distribution range; determining a target spectral characteristic that matches the spectral characteristics within the frequency band region; and filtering out the signal portion corresponding to the target spectral characteristic from the frequency domain sound signal to obtain a noise signal in the frequency domain.

[0049] In some embodiments, the signal strength is the time-domain voltage value corresponding to the noise signal. Converting the signal strength of the noise signal into a decibel value to obtain the ambient noise value includes: determining the ratio between the signal strength and a sensitivity parameter as the effective sound pressure value corresponding to the noise signal, wherein the sensitivity parameter is used to indicate the correspondence between the time-domain voltage value and the effective sound pressure value corresponding to the noise signal, and the sensitivity parameter is the voltage output per Pa sound pressure; determining the ambient noise value based on the effective sound pressure value and a reference sound pressure, wherein the reference sound pressure is...

[0050] In some embodiments, determining the ambient noise value based on the effective sound pressure value and the reference sound pressure value includes: determining the ambient noise value based on the following formula (1); (1) in, This represents the ambient noise level. The effective sound pressure level, This is the reference sound pressure level, and the reference sound pressure level is... Specifically Pa. Furthermore, this It refers to the minimum reference sound pressure level corresponding to the sound signal that the human ear can hear, and is a fixed reference value for determining the above decibel value.

[0051] Step 202: Based on the ambient noise value, determine the target playback volume of each type of audio in the multi-type audio, and the target playback volume of different audio paths is different.

[0052] It should be understood that in step 202 above, the target playback volume refers to the optimal playback volume that the corresponding audio should be set at the end during the mixing playback, which is used to indicate the loudness level when playing various types of audio.

[0053] Furthermore, it should be understood that the different target playback volumes for different audio types in step 202 above refer to the different target playback volumes matched for different types of audio. Optionally, the various audio types include driving guidance audio, warning audio, or entertainment audio. Driving guidance audio refers to voice audio used for driving guidance, such as navigation announcements, lane guidance, traffic updates, and route prompts. Warning audio refers to safety warning sounds such as fault alarms, tire pressure warnings, seatbelt reminders, lane departure warnings, and collision warnings. Entertainment audio refers to audio used solely for the leisure and entertainment of drivers and passengers, such as in-car music, radio broadcasts, audiobooks, and video audio.

[0054] In one possible implementation, step 202 includes: determining the volume gain coefficient corresponding to each type of audio based on the ambient noise value, wherein the volume gain coefficient is used to indicate the amplification factor or attenuation factor of the corresponding audio in the amplitude under the noise environment of the ambient noise value; and determining the target playback volume of each type of audio based on the volume gain coefficient corresponding to each type of audio.

[0055] It should be understood that in the above scheme, the volume gain coefficient is a preset amplitude adjustment factor for a single audio channel, with a value range between 0 and 2. When the volume gain coefficient is greater than the preset coefficient, the amplitude needs to be amplified; conversely, the amplitude needs to be attenuated. Optionally, the preset coefficient is 1. The volume gain coefficient is used to reflect the degree to which the volume of the corresponding audio channel needs to be increased or decreased in a noisy environment. For example, at 1.2, the amplitude of the corresponding audio channel is amplified to 1.2 times its original value, and the volume increases; at 0.8, the amplitude of the corresponding audio channel is reduced to 0.8 times its original value, and the volume decreases.

[0056] In the above technical solution, the volume gain coefficients for various audio types are determined based on the ambient noise level. The volume gain coefficient indicates the amplification or attenuation factor required for the audio amplitude in the current noise environment, providing a standardized adjustment benchmark for volume control. That is, a linear gain control mechanism can be used to transform complex environmental acoustic interference into specific mathematical factors, thereby achieving fine-grained compensation for different audio signal intensities. Based on this, the target playback volume is determined according to the volume gain coefficients for each audio type, allowing for differentiated gain strategies to be assigned to audio of different priorities. This solution not only avoids abrupt changes in sound caused by harsh adjustments but also ensures that important audio receives sufficient signal-to-noise ratio compensation in noisy environments, while secondary audio is appropriately suppressed. In other words, this solution can accurately and adaptively determine the optimal playback volume for multiple audio types in complex and variable cabin noise environments, significantly improving the clarity and layering during mixed playback.

[0057] In some embodiments, determining the target playback volume of each type of audio based on the volume gain coefficient corresponding to each type of audio includes: taking any audio as the first audio and determining the product between the volume gain coefficient corresponding to the first audio and the original volume of the first audio as the target playback volume of the first audio.

[0058] The following describes the process of "determining the volume gain coefficient for various audio types based on ambient noise levels".

[0059] In one possible implementation, determining the volume gain coefficients corresponding to various types of audio based on the ambient noise value includes: determining a first volume gain coefficient corresponding to various types of audio based on the ambient noise value; obtaining target operating condition parameters of the target vehicle, and determining a first adjustment coefficient based on the target operating condition parameters, wherein the first adjustment coefficient is used to adjust the first volume gain coefficient, and the target operating condition parameters are used to reflect the changing trend of the noise level in the cabin; and determining the volume gain coefficients corresponding to various types of audio based on the product between the first adjustment coefficient and the first volume gain coefficients corresponding to various types of audio.

[0060] It should be understood that in the above scheme, the first volume gain coefficient corresponding to each type of audio is affected by the ambient noise level, and the first volume gain coefficient is different for different audio (different types of audio). In addition, the first volume gain coefficient and the volume gain coefficient have the same value range, both between 0 and 2.

[0061] It should also be understood that, in the above scheme, the target operating condition parameters refer to the operating state parameters of the target vehicle that affect the noise level inside the cabin, including vehicle speed, window opening / closing status, air conditioning airflow, and road surface type. These target operating condition parameters are used to supplement factors affecting the noise level other than the ambient noise value.

[0062] It should also be noted that the first adjustment factor refers to the correction factor used to make secondary fine adjustments to the corresponding audio path based on the first volume gain factor. In other words, the ambient noise value controls the base volume gain factor, while the target operating condition parameters are finely compensated. Furthermore, the first adjustment factor has a value range of 0 to 2. When the first adjustment factor is between 0 and 1, it indicates that the current operating condition reduces noise levels; when the first adjustment factor is 0, it indicates that the current operating condition has no additional impact on noise levels, and the original first volume gain factor can be maintained unchanged; when the first adjustment factor is between 1 and 2, it indicates that the current operating condition exacerbates noise, and the volume gain factor can be further amplified.

[0063] In the above technical solution, based on the environmental noise value, the first volume gain coefficient corresponding to various audio types is determined, which can quantify the basic volume compensation requirements under the current noise environment. Subsequently, vehicle operating condition parameters are introduced as forward-looking variables to determine the first adjustment coefficient that reflects the changing trend of cabin noise levels. The first adjustment coefficient is then multiplied by the first volume gain coefficient to construct a dynamic feedforward compensation strategy. This solution can overcome the lag of relying solely on real-time noise feedback and can predict trends such as increased wind noise and tire noise due to increased vehicle speed. This solution can not only counteract the current environmental masking effect but also smooth out volume fluctuations caused by sudden changes in vehicle operating conditions, thereby achieving a high degree of adaptability during mixed playback and ultimate auditory consistency in complex and ever-changing driving environments.

[0064] In some embodiments, determining a first adjustment coefficient based on the target operating condition parameter includes: determining a noise level in the cockpit based on the target operating condition parameter; determining a second adjustment coefficient based on the noise level; if the second adjustment coefficient is within a first value range, determining the second adjustment coefficient as the first adjustment coefficient; if the second adjustment coefficient is not within the first value range, determining the first adjustment coefficient as a third adjustment coefficient, wherein the third adjustment coefficient is within the first value range and the coefficient deviation between the third adjustment coefficient and the second adjustment coefficient is less than a preset coefficient deviation.

[0065] For example, when the second adjustment coefficient is -0.2, the second adjustment coefficient is not within the first value range, and the third adjustment coefficient can be 0; when the second adjustment coefficient is 2.1, the second adjustment coefficient is not within the first value range, and the third adjustment coefficient can be 1.99.

[0066] In some embodiments, determining the noise level in the cockpit based on the target operating condition parameters includes: normalizing each operating state parameter that affects the noise level in the cockpit to obtain normalized operating state parameters; determining the noise contribution weight corresponding to each operating state parameter, which reflects the influence of the operating condition corresponding to the operating state parameter on the noise level in the cockpit; performing weighted fusion on the normalized operating state parameters based on the noise contribution weight corresponding to each operating state parameter to obtain a noise quantization value, which reflects the noise level in the cockpit; and determining the noise level in the cockpit based on the noise quantization value.

[0067] It should be understood that the above noise levels are positively correlated with the noise quantization value; the higher the noise quantization value, the higher the noise level; and the lower the noise quantization value, the lower the noise level.

[0068] In some embodiments, determining the second adjustment coefficient based on the noise level includes: comparing the noise level with a plurality of sample noise levels, determining a candidate noise level that matches the noise level from the plurality of sample noise levels, and determining the sample adjustment coefficient corresponding to the candidate noise level as the second adjustment coefficient.

[0069] In other words, the above scheme contains a pre-set mapping table that corresponds one-to-one between cabin noise levels and the second adjustment coefficient. Furthermore, the second adjustment coefficient is positively correlated with the noise level; that is, the higher the noise level, the larger the second adjustment coefficient, and vice versa.

[0070] In some embodiments, determining the volume gain coefficient corresponding to each type of audio based on the product of the first adjustment coefficient and the first volume gain coefficient corresponding to each type of audio includes: multiplying the first adjustment coefficient and the first volume gain coefficient corresponding to each type of audio to obtain a fifth volume gain coefficient corresponding to each type of audio; determining the volume gain coefficient corresponding to each type of audio as the fifth volume gain coefficient of the corresponding audio path; determining a second value range in which the first volume gain coefficient falls; determining a first weight corresponding to the first volume gain coefficient based on the second value range; and performing weighted fusion of the first volume gain coefficient and the corresponding fifth volume gain coefficient based on the first weight and the corresponding second weight to obtain the volume gain coefficient corresponding to each type of audio, wherein the second weight is the difference between a preset weight and the first weight.

[0071] It should be understood that the above-mentioned preset weight is 1.

[0072] It should be noted that the first weight is used to reflect the degree of confidence in the first volume gain coefficient determined by the ambient noise value when determining the volume gain coefficient corresponding to the corresponding audio; the second weight is used to reflect the degree of confidence in the fifth volume gain coefficient determined by the target operating condition parameters when determining the volume gain coefficient corresponding to the corresponding audio. Therefore, these two volume gain coefficients (the first volume gain coefficient and the fifth volume gain coefficient) can be weighted and fused to obtain the volume gain coefficients corresponding to various types of audio.

[0073] Optionally, the second value range includes the first preset range. (i.e., the range of low volume gain coefficient), second preset range (i.e., the range of the mid-volume gain coefficient) and the first preset range ≥1.2 (i.e., the range of high volume gain coefficient).

[0074] In some embodiments, determining the first weight corresponding to the first volume gain coefficient based on the second value range includes: when the second value range is a first preset range, determining the first weight as a first preset weight, the first preset weight being greater than the corresponding second weight; when the second value range is a second preset range, determining the first weight as a second preset weight, the second preset weight being equal to the corresponding second weight; when the second value range is a third preset range, determining the first weight as a third preset weight, the third preset weight being less than the corresponding second weight, the first preset weight being greater than the second preset weight, and the second preset weight being greater than the third preset weight.

[0075] Optionally, when the first volume gain coefficient falls within a first preset range, the first weight is 0.8 and the second weight is 0.2; when the first volume gain coefficient falls within a second preset range, the first weight is 0.5 and the second weight is 0.5; when the first volume gain coefficient falls within a third preset range, the first weight is 0.3 and the second weight is 0.7.

[0076] It should also be noted that when the first volume gain coefficient falls within the low volume gain coefficient range (first preset range), the first weight is set to a larger value. The principle is that in a quiet cabin environment, there is no need to adjust the volume significantly, so the original fixed volume is retained first to avoid changing the volume with slight changes in operating conditions and to ensure auditory stability. When the first volume gain coefficient falls within the medium volume gain coefficient range (second preset range), the first weight is set to a middle value. The principle is that it can take into account the basic tuning of ambient noise and balance the noise changes brought by vehicle conditions, and the above two volume gain coefficients are compromised to adapt to most normal road conditions. When the first volume gain coefficient falls within the high volume gain coefficient range (third preset range), the first weight is set to a smaller value. The principle is that the ambient noise is already high, and the vehicle conditions will further aggravate the noise. The second weight corresponding to the fifth volume gain coefficient is set to a larger value, which can enhance the compensation capability for dynamic vehicle conditions, so as to increase the volume synchronously with the vehicle conditions and ensure the clarity of important audio.

[0077] The following are several methods for determining the volume gain coefficient for various audio types based on ambient noise levels.

[0078] Method 1: Based on functional relations Determine the first volume gain coefficient In one possible implementation, the multiple audio categories include driving guidance audio, alarm notification audio, and entertainment audio. Based on the ambient noise value, a first volume gain coefficient corresponding to each type of audio is determined, including: obtaining a reference volume gain coefficient, which is a fixed volume gain coefficient used by each type of audio when there is no ambient noise in the cabin; determining a first volume gain coefficient corresponding to the driving guidance audio based on the ambient noise value, the first coefficient, and the reference volume gain coefficient, where the first coefficient is used to indicate the playback priority of the driving guidance audio among the multiple audio categories, and the first coefficient is a volume gain coefficient in decibels; determining a first volume gain coefficient corresponding to the alarm notification audio based on the ambient noise value, a second coefficient, and the reference volume gain coefficient, where the second coefficient is used to indicate the playback priority of the alarm notification audio among the multiple audio categories, and the second coefficient is greater than the first coefficient; and determining a first volume gain coefficient corresponding to the entertainment audio based on the ambient noise value, a third coefficient, and the reference volume gain coefficient, where the third coefficient is used to indicate the playback priority of the entertainment audio among the multiple audio categories, and the first coefficient is greater than the third coefficient.

[0079] It should be understood that in the above scheme, the reference volume gain coefficient is the same for all types of audio. The reference volume gain coefficient is related to the acoustic characteristics within the cabin, the comfort threshold of human hearing, and the inherent properties of each type of audio. The acoustic characteristics within the cabin are used to indicate the differences in sound quality caused by the cabin's size, the sound insulation materials of the cabin interior, the sound absorption effect within the cabin, and the installation location of the in-vehicle player. The comfort threshold refers to the first volume range that a user can accept and find comfortable while sitting in the vehicle. Furthermore, warning and alert audio has a higher playback priority than driving guidance audio, which in turn has a higher playback priority than entertainment audio.

[0080] In the above technical solution, a reference volume gain coefficient is obtained, which clearly defines the volume reference in a noise-free environment. Subsequently, a gain coefficient in decibels (dB) is introduced to characterize playback priority, implementing differentiated dynamic compensation strategies for different audio categories. Specifically, based on the ambient noise level, a first coefficient, and the reference volume gain coefficient, a first volume gain coefficient is determined for driving guidance audio; a second coefficient greater than the first coefficient is determined for warning audio; and a third coefficient less than the first coefficient is used to determine the first volume gain coefficient for entertainment audio. This tiered coefficient setting ensures stronger noise reduction for warning and driving guidance audio, while entertainment audio is moderately suppressed. This allows for accurate reconstruction of the hierarchical relationship of multiple audio categories in noisy environments, ensuring that critical driving information is not drowned out by ambient noise and preventing the inversion of playback priority for secondary audio. Therefore, this solution can significantly improve auditory comfort during human-computer interaction.

[0081] In some embodiments, obtaining a reference volume gain coefficient includes: controlling the vehicle player to mix and play multiple types of original audio when there is no ambient noise in the cabin; gradually adjusting the volume gain coefficient during playback, and determining the current volume gain coefficient as the reference volume gain coefficient when the adjusted volume gain coefficient is within the volume gain coefficient range corresponding to the first volume range.

[0082] Optionally, the first coefficient is 0.4, the second coefficient is 0.5, and the third coefficient is 0.5.

[0083] In some embodiments, obtaining a reference volume gain coefficient includes: determining the listening preference information of the driver of the target vehicle, the listening preference information being used to indicate the driver's acceptance of loudness of various types of audio in the absence of ambient noise in the cabin; and determining the reference volume gain coefficient based on the listening preference information.

[0084] Optionally, the audio preference information indicates whether the driver prefers loud announcements, moderate prompts, or gentle prompts.

[0085] It should be understood that in the above scheme, the more drivers prefer loud announcements, the larger the base volume gain coefficient will be; the more drivers prefer gentle prompts, the smaller the base volume gain coefficient will be.

[0086] In some embodiments, determining the driver's listening preference information for the target vehicle includes: collecting data on the driver's use of the in-vehicle player during historical time periods to statistically analyze the frequency of the driver's use of each volume level when there is no ambient noise in the cabin; determining that the listening preference information indicates the driver's preference for loud announcements when the driver's frequency of use of the first volume level is greater than a preset frequency; determining that the listening preference information indicates the driver's preference for gentle prompts when the driver's frequency of use of the second volume level is greater than a preset frequency; and determining that the listening preference information indicates the driver's preference for moderate prompts when the driver's frequency of use of the third volume level is greater than a preset frequency, wherein the first volume level is higher than the third volume level, and the third volume level is higher than the second volume level.

[0087] In some embodiments, the determination of the first volume gain coefficient corresponding to the driving guidance audio based on the ambient noise value, the first coefficient and the reference volume gain coefficient includes: determining the first volume gain coefficient corresponding to the driving guidance audio based on the following formula (2); (2) in, This is the first volume gain coefficient corresponding to driving guidance audio. This is the reference volume gain coefficient. For this first coefficient, This is the ambient noise level; And, based on the ambient noise value, the second coefficient and the reference volume gain coefficient, the first volume gain coefficient corresponding to the alarm prompt audio is determined, including: based on the following formula (3), the first volume gain coefficient corresponding to the alarm prompt audio is determined; (3) in, This is the first volume gain coefficient corresponding to alarm / notification audio. This is the second coefficient; And, based on the ambient noise value, the third coefficient and the reference volume gain coefficient, the first volume gain coefficient corresponding to the entertainment audio is determined, including: based on the following formula (4), the first volume gain coefficient corresponding to the entertainment audio is determined; (4) in, This is the first volume gain coefficient corresponding to entertainment audio. This is the third coefficient.

[0088] In one possible implementation, determining the first volume gain coefficient corresponding to the driving guidance audio based on the ambient noise value, the first coefficient, and the reference volume gain coefficient includes: determining the product between the ambient noise value and the first coefficient to obtain a second volume gain coefficient, and determining the sum of the second volume gain coefficient and the reference volume gain coefficient as the first volume gain coefficient corresponding to the driving guidance audio; and determining the first volume gain coefficient corresponding to the alarm notification audio based on the ambient noise value, the second coefficient, and the reference volume gain coefficient includes: determining the product between the ambient noise value and the second coefficient to obtain a third volume gain coefficient, and determining the sum of the third volume gain coefficient and the reference volume gain coefficient as the first volume gain coefficient corresponding to the alarm notification audio; and determining the first volume gain coefficient corresponding to the entertainment audio based on the ambient noise value, the third coefficient, and the reference volume gain coefficient includes: determining the product between the ambient noise value and the third coefficient to obtain a fourth volume gain coefficient, and determining the difference between the reference volume gain coefficient and the fourth volume gain coefficient as the first volume gain coefficient corresponding to the entertainment audio.

[0089] In the above technical solution, for high-priority driving guidance audio and warning audio, a product summation mechanism is used to ensure that their volume increases linearly with ambient noise to counteract the masking effect. For low-priority entertainment audio, the ambient noise value is multiplied by a third coefficient to obtain a fourth volume gain coefficient, and the difference between the base volume gain coefficient and the fourth volume gain coefficient is determined to achieve a negative adjustment where the entertainment volume automatically decreases as the noise level rises. In other words, the above solution provides a two-way control strategy combining positive noise reduction compensation and negative dynamic avoidance. This not only ensures the clarity and penetration of key information during driving in noisy environments, but also avoids sound field conflicts between multiple audio types by lowering the first volume gain coefficient corresponding to entertainment audio, greatly improving the efficiency of information interaction and auditory comfort in the cabin.

[0090] Method 2: Based on table lookup method Determine the first volume gain coefficient In one possible implementation, determining the first volume gain coefficient corresponding to each type of audio based on the ambient noise value includes: determining the ambient noise level based on the noise value range to which the ambient noise value falls; obtaining the volume gain coefficients of multiple types of sample audio corresponding to the ambient noise level; for each type of audio in the multiple types of audio, determining the target audio that matches the audio from the multiple types of sample audio, and determining the volume gain coefficient of the target audio as the first volume gain coefficient corresponding to the audio.

[0091] It should be understood that in the above scheme, the environmental noise level is positively correlated with the environmental noise value; the higher the environmental noise value, the higher the environmental noise level; and the lower the environmental noise value, the lower the environmental noise level.

[0092] Furthermore, it should be understood that different ambient noise levels correspond to different volume gain coefficients.

[0093] The above technical solution abandons complex real-time calculations and adopts a lookup table method or empirical mapping method based on noise scene classification to select the volume gain coefficient that matches the current multiple audio types, which serves as the first volume gain coefficient for each audio type. This solution not only significantly reduces the real-time computing power overhead of the in-vehicle processor but also ensures the accuracy and stability of volume adjustment by calling verified acoustic parameters (multiple sample noise levels and volume gain coefficients of multiple sample audio types). Therefore, this solution can achieve adaptive optimization during mixing playback with extremely high computational efficiency in complex and variable cabin noise environments, perfectly balancing the response speed of the in-vehicle processor and the continuity of the listening experience.

[0094] In some embodiments, determining an environmental noise level based on the noise value range to which the environmental noise value falls includes: determining the environmental noise level as a first level when the environmental noise value is less than or equal to a first preset noise value; determining the environmental noise level as a second level when the environmental noise value is greater than the first preset noise value and less than or equal to a second preset noise value; and determining the environmental noise level as a third level when the environmental noise value is greater than the second preset noise value, wherein the second level is higher than the first level and the third level is higher than the second level.

[0095] That is, in the above scheme, the first noise value range is specifically the range where the ambient noise value is less than or equal to the first preset noise value; the second noise value range is specifically the range where the ambient noise value is greater than the first preset noise value and less than or equal to the second preset noise value; and the third noise value range is specifically the range where the ambient noise value is greater than the second preset noise value. The noise value range that the aforementioned ambient noise value falls within is either the first noise value range, the second noise value range, or the third noise value range. Furthermore, the first level can be considered a low noise level, the second level can be considered a medium noise level, and the third level can be considered a high noise level.

[0096] Optionally, if the ambient noise level is level three, the first volume gain coefficient corresponding to driving guidance audio is 1.4, the first volume gain coefficient corresponding to alarm notification audio is 1.5, and the first volume gain coefficient corresponding to entertainment audio is 0.5; if the ambient noise level is level two, the first volume gain coefficient corresponding to driving guidance audio is 1.1, the first volume gain coefficient corresponding to alarm notification audio is 1.2, and the first volume gain coefficient corresponding to entertainment audio is 0.7; if the ambient noise level is level one, the first volume gain coefficients corresponding to driving guidance audio, alarm notification audio, and entertainment audio are all 0.99.

[0097] Step 203: Mix and play the various audio types based on their respective target playback volumes.

[0098] It should be understood that in step 203 above, "mixing and playing" refers to merging multiple types of audio into one audio stream and playing it synchronously through the in-vehicle player.

[0099] In one possible implementation, step 203, which involves mixing and playing multiple types of audio based on their respective target playback volumes, includes: adjusting the amplitude of the time-domain audio signals corresponding to each type of audio based on their respective target playback volumes to obtain adjusted audio signals corresponding to each type of audio; superimposing the adjusted audio signals corresponding to the multiple types of audio to obtain a mixed audio signal; and controlling the in-vehicle player in the target vehicle to output the mixed audio signal for mixing and playing the multiple types of audio.

[0100] It should be understood that, in the above scheme, adjusting the amplitude of the time-domain audio signal corresponding to each type of audio based on its target playback volume means amplifying or reducing the amplitude of the corresponding audio signal waveform based on its target playback volume.

[0101] In the above technical solution, amplitude modulation is applied to the time-domain audio signals corresponding to various audio types, and then the adjusted audio signals corresponding to multiple audio types are superimposed. This processing strategy not only ensures that various audio types are strictly fused according to preset playback priorities and signal-to-noise ratio requirements, but also effectively avoids amplitude overflow problems that may be caused when the adjusted audio signals corresponding to multiple audio types are directly superimposed. In addition, by transforming the abstract volume strategy into specific time-domain signal processing, the above solution can also guarantee the clarity of important audio and the layering of other audio types during mixed playback, perfectly achieving high-quality playback of multiple audio types in the in-vehicle environment.

[0102] In some embodiments, based on the target playback volume of each type of audio, the amplitude of the time-domain audio signal corresponding to each type of audio is adjusted to obtain the adjusted audio signal corresponding to each type of audio, including: taking any audio as a first audio, determining the volume difference between the target playback volume and the current playback volume of each of the first audios; determining the ratio between the volume difference and the target playback volume as the adjustment amplitude; when the adjustment amplitude is greater than a preset amplitude, amplifying the amplitude of each sampling time in the time-domain audio signal corresponding to the first audio by the adjustment amplitude to obtain the adjusted audio signal corresponding to the first audio; when the adjustment amplitude is less than the preset amplitude, attenuating the amplitude of each sampling time in the time-domain audio signal corresponding to the first audio by the adjustment amplitude to obtain the adjusted audio signal corresponding to the first audio; when the adjustment amplitude is equal to the preset amplitude, determining the time-domain audio signal corresponding to the first audio as the adjusted audio signal corresponding to the first audio.

[0103] It should be understood that in the above scheme, the preset amplitude is 0%.

[0104] Figure 3This is a system architecture diagram based on an audio playback method provided in this application embodiment. The system architecture is based on existing hardware in the target vehicle and does not include any new sensors.

[0105] For example, such as Figure 3 As shown, the system architecture can be divided into a 5-layer architecture, including the cockpit environment layer, preprocessing layer, core processing layer, audio source layer, and audio output layer.

[0106] The cockpit environment layer consists of multiple types of microphones in the target vehicle, used to collect raw sound signals within the cockpit. The preprocessing layer includes an analog-to-digital conversion module and a filtering module, used to convert the raw sound signals into frequency domain sound signals, filter out the first type of sound signals from the frequency domain sound signals to obtain frequency domain noise signals, and convert the signal strength of the noise signals into decibel values ​​to obtain the ambient noise level within the cockpit. The core processing layer includes a noise level detection module, a dynamic mixing strategy module, and a dynamic gain adjustment module, used to determine the target playback volume of each type of audio based on the ambient noise level. The audio source layer provides multiple types of audio, including a first audio channel, a second audio channel, etc. The audio output layer includes an in-vehicle player, used to mix and play the multiple types of audio based on their respective target playback volumes.

[0107] Figure 4 This is a schematic diagram of the structure of an in-cabin audio mixing device provided in an embodiment of this application.

[0108] For example, such as Figure 4 As shown, the device 400 includes: Determine module 401, used for: In response to concurrent playback requests for multiple types of audio in the cabin of the target vehicle, the ambient noise value in the cabin is determined, which reflects the level of ambient noise. Based on the ambient noise value, the target playback volume of each type of audio is determined, and the target playback volume of different audio paths is different. The playback module 402 is used to mix and play multiple types of audio based on their respective target playback volumes.

[0109] Optionally, the determining module 401 is specifically used to: determine the volume gain coefficient corresponding to each type of audio based on the ambient noise value, wherein the volume gain coefficient is used to indicate the amplification factor or attenuation factor of the corresponding audio in the amplitude under the noise environment of the ambient noise value; and determine the target playback volume of each type of audio based on the volume gain coefficient corresponding to each type of audio.

[0110] Optionally, the determining module 401 is further configured to: determine a first volume gain coefficient corresponding to each type of audio based on the ambient noise value; obtain the target operating condition parameters of the target vehicle, and determine a first adjustment coefficient based on the target operating condition parameters, wherein the first adjustment coefficient is used to adjust the first volume gain coefficient, and the target operating condition parameters are used to reflect the changing trend of the noise level in the cabin; and determine the volume gain coefficient corresponding to each type of audio based on the product between the first adjustment coefficient and the first volume gain coefficient corresponding to each type of audio.

[0111] Optionally, the multiple audio categories include driving guidance audio, alarm notification audio, and entertainment audio. The determining module 401 is further configured to: obtain a reference volume gain coefficient, which is a fixed volume gain coefficient used for each type of audio when there is no ambient noise in the cabin; determine a first volume gain coefficient corresponding to the driving guidance audio based on the ambient noise value, a first coefficient, and the reference volume gain coefficient, wherein the first coefficient is used to indicate the playback priority of the driving guidance audio among the multiple audio categories, and the first coefficient is a volume gain coefficient in decibels; determine a first volume gain coefficient corresponding to the alarm notification audio based on the ambient noise value, a second coefficient, and the reference volume gain coefficient, wherein the second coefficient is used to indicate the playback priority of the alarm notification audio among the multiple audio categories, and the second coefficient is greater than the first coefficient; and determine a first volume gain coefficient corresponding to the entertainment audio based on the ambient noise value, a third coefficient, and the reference volume gain coefficient, wherein the third coefficient is used to indicate the playback priority of the entertainment audio among the multiple audio categories, and the first coefficient is greater than the third coefficient.

[0112] Optionally, the determining module 401 is further configured to determine the product between the ambient noise value and the first coefficient to obtain a second volume gain coefficient, and to determine the sum of the second volume gain coefficient and the reference volume gain coefficient as the first volume gain coefficient corresponding to the driving guidance audio; and the determining module 401 is further configured to determine the product between the ambient noise value and the second coefficient to obtain a third volume gain coefficient, and to determine the sum of the third volume gain coefficient and the reference volume gain coefficient as the first volume gain coefficient corresponding to the alarm notification audio; and the determining module 401 is further configured to determine the product between the ambient noise value and the third coefficient to obtain a fourth volume gain coefficient, and to determine the difference between the reference volume gain coefficient and the fourth volume gain coefficient as the first volume gain coefficient corresponding to the entertainment audio.

[0113] Optionally, the determining module 401 is further configured to determine the ambient noise level based on the noise value range to which the ambient noise value falls; obtain the volume gain coefficients of multiple types of sample audio corresponding to the ambient noise level; for each type of audio in the multiple types of audio, determine the target audio that matches the audio from the multiple types of sample audio, and determine the volume gain coefficient of the target audio as the first volume gain coefficient corresponding to the audio.

[0114] Optionally, the device 400 further includes: a conversion module for acquiring the original sound signal in the cabin and converting the original sound signal into a frequency domain sound signal; a filtering module for filtering out a first type of sound signal from the frequency domain sound signal to obtain a noise signal in the frequency domain, wherein the first type of sound signal is a non-environmental noise signal actively emitted by the vehicle system; the conversion module is also used to convert the signal intensity of the noise signal into a decibel value to obtain the environmental noise value.

[0115] Optionally, the device 400 further includes: an adjustment module, used to adjust the amplitude of the time-domain audio signal corresponding to each type of audio based on the target playback volume of each type of audio, to obtain the adjusted audio signal corresponding to each type of audio; an overlay module, used to overlay the adjusted audio signals corresponding to the multiple types of audio to obtain a mixed audio signal; and a control module, used to control the in-vehicle player in the target vehicle to output the mixed audio signal for mixed playback of the multiple types of audio.

[0116] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.

[0117] For example, such as Figure 5 As shown, the electronic device 500 includes a storage module 501 and a processing module 502. The storage module 501 stores executable program code 503, and the processing module 502 is used to call and execute the executable program code 503 to perform an audio playback method.

[0118] Figure 6 This is a schematic diagram of the structure of a vehicle provided in an embodiment of this application.

[0119] For example, such as Figure 6 As shown, the vehicle 600 includes a memory 601 and a processor 602. The memory 601 stores executable program code 603, and the processor 602 is used to call and execute the executable program code 603 to perform an audio playback method.

[0120] Furthermore, embodiments of this application also protect an apparatus that may include a memory and a processor, wherein the memory stores executable program code, and the processor is used to call and execute the executable program code to perform an audio playback method provided in embodiments of this application.

[0121] This embodiment can divide the device into functional modules based on the above method example. For example, each module can correspond to a separate function, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware. It should be noted that the module division in this embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0122] When each functional module is divided according to its corresponding function, the device may further include a determining module, a playback module, a conversion module, a filtering module, an adjustment module, an overlay module, and a control module. It should be noted that all relevant content in the above method embodiments can be referenced from the functional descriptions of the corresponding functional modules, and will not be repeated here.

[0123] It should be understood that the device provided in this embodiment is used to execute the above-described audio playback method, and therefore can achieve the same effect as the above-described implementation method.

[0124] When using an integrated unit, the device may include a processing module and a storage module. When the device is applied to a vehicle, the processing module can be used to control and manage the vehicle's movements. The storage module can be used to support the vehicle in executing relevant executable program code.

[0125] The processing module may be a processor or a controller, which can implement or execute various exemplary logic blocks, modules, and circuits shown in conjunction with the disclosure of this application. The processor may also be a combination of functions that implement computing capabilities, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc., and the storage module may be a memory.

[0126] In addition, the device provided in the embodiments of this application may specifically be a chip, component or module. The chip may include a connected processor and a memory. The memory is used to store instructions. When the processor calls and executes the instructions, the chip can execute an audio playback method provided in the above embodiments.

[0127] This embodiment also provides a computer-readable storage medium storing executable program code. When the executable program code is run on a computer, the computer performs the aforementioned method steps to implement an audio playback method provided in the above embodiment.

[0128] This embodiment also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement an audio playback method provided in the above embodiment.

[0129] In this embodiment, the device, computer-readable storage medium, computer program product, or chip are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0130] Through the above description of the embodiments, those skilled in the art will understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0131] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0132] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An audio playback method, characterized in that, The method includes: In response to concurrent playback requests for multiple types of audio within the cabin of the target vehicle, the ambient noise value within the cabin is determined, and the ambient noise value is used to reflect the level of ambient noise. Based on the ambient noise value, the target playback volume of each type of audio is determined, and the target playback volume is different for different types of audio. Based on the target playback volume of each type of audio, the various types of audio are mixed and played.

2. The method according to claim 1, characterized in that, Determining the target playback volume for each of the multiple audio types based on the ambient noise value includes: Based on the ambient noise value, the volume gain coefficient corresponding to each type of audio is determined. The volume gain coefficient is used to indicate the amplification factor or attenuation factor of the corresponding type of audio in the amplitude under the noise environment of the ambient noise value. Based on the volume gain coefficients corresponding to each type of audio, the target playback volume for each type of audio is determined.

3. The method according to claim 2, characterized in that, The step of determining the volume gain coefficients for various audio types based on the ambient noise values ​​includes: Based on the ambient noise value, determine the first volume gain coefficient corresponding to each type of audio. The target operating condition parameters of the target vehicle are obtained, and a first adjustment coefficient is determined based on the target operating condition parameters. The first adjustment coefficient is used to adjust the first volume gain coefficient, and the target operating condition parameters are used to reflect the changing trend of the noise level in the cabin. The volume gain coefficient for each type of audio is determined by multiplying the first adjustment coefficient with the first volume gain coefficient corresponding to each type of audio.

4. The method according to claim 3, characterized in that, The various audio types include driving guidance audio, alarm notification audio, and entertainment audio. Determining the first volume gain coefficient corresponding to each type of audio based on the ambient noise value includes: Obtain a reference volume gain coefficient, which is a fixed volume gain coefficient used for various audio types when there is no ambient noise in the cockpit; Based on the ambient noise value, the first coefficient and the reference volume gain coefficient, the first volume gain coefficient corresponding to the driving guidance audio is determined. The first coefficient is used to indicate the playback priority of the driving guidance audio among the multiple audio types. The first coefficient is the volume gain coefficient corresponding to decibels. Based on the ambient noise value, the second coefficient, and the reference volume gain coefficient, a first volume gain coefficient corresponding to the alarm notification audio is determined. The second coefficient is used to indicate the playback priority of the alarm notification audio among the multiple audio types, and the second coefficient is greater than the first coefficient. Based on the ambient noise value, the third coefficient, and the reference volume gain coefficient, a first volume gain coefficient corresponding to the entertainment audio is determined. The third coefficient is used to indicate the playback priority of the entertainment audio among the multiple audio categories, and the first coefficient is greater than the third coefficient.

5. The method according to claim 4, characterized in that, The step of determining the first volume gain coefficient corresponding to the driving guidance audio based on the ambient noise value, the first coefficient, and the reference volume gain coefficient includes: The product between the ambient noise value and the first coefficient is determined to obtain the second volume gain coefficient, and the sum of the second volume gain coefficient and the reference volume gain coefficient is determined as the first volume gain coefficient corresponding to the driving guidance audio. And, determining the first volume gain coefficient corresponding to the alarm notification audio based on the ambient noise value, the second coefficient, and the reference volume gain coefficient includes: The product between the ambient noise value and the second coefficient is determined to obtain the third volume gain coefficient, and the sum of the third volume gain coefficient and the reference volume gain coefficient is determined as the first volume gain coefficient corresponding to the alarm prompt audio. And, determining the first volume gain coefficient corresponding to the entertainment audio based on the ambient noise value, the third coefficient, and the reference volume gain coefficient includes: The product between the ambient noise value and the third coefficient is determined to obtain the fourth volume gain coefficient, and the difference between the reference volume gain coefficient and the fourth volume gain coefficient is determined as the first volume gain coefficient corresponding to the entertainment audio.

6. The method according to claim 3, characterized in that, The step of determining the first volume gain coefficient corresponding to various audio types based on the ambient noise value includes: The environmental noise level is determined based on the range of noise values ​​that the environmental noise values ​​fall within. Obtain the volume gain coefficients of multiple types of sample audio corresponding to the environmental noise level; For each of the multiple audio types, a target audio that matches the audio is determined from the multiple sample audio types, and the volume gain coefficient of the target audio is determined as the first volume gain coefficient corresponding to the audio.

7. The method according to claim 1, characterized in that, Determining the ambient noise level inside the cabin includes: The original sound signal inside the cockpit is collected and converted into a frequency domain sound signal in the frequency domain. The first type of sound signal is filtered out from the frequency domain sound signal to obtain the noise signal in the frequency domain. The first type of sound signal is a non-environmental noise signal actively emitted by the vehicle system. The signal strength of the noise signal is converted into a decibel value to obtain the environmental noise value.

8. The method according to claim 1, characterized in that, The mixing and playback of the multiple audio types based on their respective target playback volumes includes: Based on the target playback volume of each type of audio, the amplitude of the time-domain audio signal corresponding to each type of audio is adjusted to obtain the adjusted audio signal corresponding to each type of audio. The adjusted audio signals corresponding to the multiple audio types are superimposed to obtain a mixed audio signal; The vehicle's in-vehicle player is controlled to output the mixed audio signal to mix and play the various types of audio.

9. An electronic device, characterized in that, The electronic device includes: The storage module is used to store executable program code; A processing module is configured to call and run the executable program code from the storage module, causing the electronic device to perform the method as described in any one of claims 1 to 8.

10. A vehicle, characterized in that, The vehicles include: Memory, used to store executable program code; A processor for calling and running the executable program code from the memory, causing the vehicle to perform the method as described in any one of claims 1 to 8.

Images