Audio processing method and system, electronic equipment and storage medium

Abstract

The invention relates to an audio processing method and system, electronic equipment and a storage medium. The method comprises the steps that when it is detected that an audio signal changes, the current signal amplitude is obtained, a compensation strategy of the audio signal is determined, and the compensation strategy comprises compensation sub-strategies of the audio signal under multiple sound pressure levels; determining a preset sound pressure level of the audio signal according to the signal amplitude; determining a target compensation sub-strategy corresponding to the preset sound pressure level in a compensation strategy; and performing loudness compensation on the audio signal according to the target compensation sub-strategy to obtain an audio signal meeting a preset loudness condition. When it is detected that the audio signal changes, the signal amplitude of the current audio signal is obtained in real time, the preset sound pressure level is determined according to the signal amplitude, and then the corresponding compensation decision is determined, so that self-adaptive loudness compensation for the amplitude change of a television playing program source is achieved, and the sound effect experience is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data processing, and in particular to an audio processing method and system, an electronic device, and a storage medium. BACKGROUND

[0002] With the increasing demand for sound of televisions and other display devices, it is no longer just to satisfy the clear human voice emitted by the television sound, but also to use the television to enjoy music, and to require the television to be able to play a wide frequency band of sound; due to the hearing characteristics of the human ear, the gain required for each frequency to reach the same subjective loudness under different volume levels of the television is different, therefore, the amplitude of the audio needs to be compensated by referring to the equal loudness curve to achieve the best sound experience.

[0003] At present, the loudness compensation technology based on the equal loudness curve is to play a program source with a specific amplitude, and then use a sound level meter or a microphone to measure the loudness of the television under different volumes, and according to the loudness corresponding to each volume level, the equal loudness curve is compensated, that is, each volume level corresponds to a set of compensation parameters.

[0004] However, in actual application, the program content played by the television is different, even if the television is at the same volume level, due to the different amplitudes of the program source played, the loudness heard will also be different, and a single set of audio parameters cannot adapt to the entire volume range.

[0005] Therefore, it is urgent to develop an audio processing method, system, electronic device and storage medium to solve one or more of the above problems. SUMMARY

[0006] In view of this, in order to solve the above technical problems or part of the technical problems, the embodiments of the present application provide an audio processing method, system, electronic device and storage medium.

[0007] In a first aspect, the present application provides an audio processing method, the method comprising:

[0008] When a change in the audio signal is detected, the current signal amplitude is obtained, and a compensation strategy of the audio signal is determined, the compensation strategy comprising a compensation sub-strategy of the audio signal under a plurality of sound pressure levels;

[0009] determining a preset sound pressure level of the audio signal according to the signal amplitude;

[0010] determining a target compensation sub-strategy corresponding to the preset sound pressure level in the compensation strategy;

[0011] performing loudness compensation on the audio signal according to the target compensation sub-strategy to obtain an audio signal meeting a preset loudness condition.

[0012] In a possible implementation, the target compensation sub-strategy includes loudness compensation values of the preset sound pressure level at multiple frequency points.

[0013] The loudness compensation of the audio signal according to the target compensation sub-strategy includes:

[0014] The signal frequency of the audio signal is obtained, and the signal frequency includes at least one frequency point.

[0015] From the signal frequency, a target frequency point with a frequency value in a target frequency interval is selected.

[0016] The target loudness compensation value corresponding to the target frequency point in the target compensation sub-strategy is determined.

[0017] The audio signal at the target frequency point is compensated according to the target loudness compensation value to obtain an audio signal meeting a preset loudness condition.

[0018] In a possible implementation, the method further includes:

[0019] In the loudness compensation process, it is judged whether the signal amplitude of the compensated audio signal reaches a preset amplitude limiting threshold.

[0020] In the case where the signal amplitude reaches the preset amplitude limiting threshold, the loudness compensation is stopped, and the current compensated audio signal is taken as an audio signal meeting a preset loudness condition.

[0021] In a possible implementation, before the target frequency point with a frequency value in a target frequency interval is selected from the signal frequency, the method further includes:

[0022] The frequency distribution information of the signal frequency is obtained.

[0023] The target frequency interval is determined according to the frequency distribution information.

[0024] In a possible implementation, the preset sound pressure level of the audio signal is determined according to the signal amplitude, including:

[0025] The amplitude difference between the signal amplitude and the output amplitude of a test audio signal is obtained, and the sound pressure level of the test audio signal is a first sound pressure level.

[0026] The preset sound pressure level of the audio signal is determined according to the linear relationship between the amplitude difference and the sound pressure level difference.

[0027] In a possible implementation, when the change of the audio signal is detected, the current signal amplitude is obtained, and the compensation strategy of the audio signal is determined, including:

[0028] When the amplitude of the audio signal is detected to change and / or the setting volume is detected to change, the current signal amplitude is acquired, and a compensation strategy of the audio signal is determined.

[0029] In a possible implementation, the compensation strategy is determined according to the following procedure:

[0030] An equal loudness curve is acquired, the equal loudness curve being used to indicate a standard sound pressure level of the audio signal at a plurality of signal frequencies;

[0031] For any sound pressure level, a loudness compensation value of the audio signal at the plurality of signal frequencies is acquired based on the equal loudness curve, to obtain a compensation sub-strategy of the sound pressure level;

[0032] The compensation strategy is obtained according to the compensation sub-strategies of different sound pressure levels.

[0033] In a second aspect, the present application provides an audio adjustment system, the system comprising:

[0034] An acquisition module, configured to acquire a current signal amplitude and determine a compensation strategy of an audio signal when the audio signal is detected to change, the compensation strategy comprising compensation sub-strategies of the audio signal at a plurality of sound pressure levels;

[0035] A first determination module, configured to determine a preset sound pressure level of the audio signal according to the signal amplitude;

[0036] A second determination module, configured to determine a target compensation sub-strategy corresponding to the preset sound pressure level in the compensation strategy;

[0037] An execution module, configured to perform loudness compensation on the audio signal according to the target compensation sub-strategy, to obtain an audio signal meeting a preset loudness condition.

[0038] In a third aspect, the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the audio adjustment method according to any one of the first aspect.

[0039] In a fourth aspect, the present application further provides a computer storage medium, having a computer program stored thereon, wherein the computer program is executable by a processor to implement the steps of the audio adjustment method according to any one of the first aspect.

[0040] Compared with the prior art, the technical solution provided by the embodiments of the present application has the following advantages: the method provided by the embodiments of the present application acquires the signal amplitude of the current audio signal in real time when detecting that the audio signal changes, and determines the preset sound pressure level according to the signal amplitude, and then determines the corresponding compensation decision, thereby realizing adaptive loudness compensation for the amplitude change of the television program source, and improving the sound experience. BRIEF DESCRIPTION OF DRAWINGS

[0041] The accompanying drawings, which are incorporated into and form a part of the specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the application.

[0042] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed to be used in the embodiments or the prior art description will be briefly introduced as follows: obviously, for those skilled in the art, other drawings can also be obtained without creative labor based on these drawings.

[0043] One or more embodiments are exemplarily illustrated by the pictures in the drawings corresponding thereto, and these exemplary illustrations do not constitute a limitation on the embodiments, elements with the same reference numerals in the drawings represent similar elements, unless otherwise specified, the drawings do not constitute a proportional limitation.

[0044] Figure 1 A flowchart of an audio processing method provided by the embodiments of the present application;

[0045] Figure 2 A flowchart of audio signal loudness compensation provided by the embodiments of the present application;

[0046] Figure 3 An architecture diagram of a multi-channel audio playing device provided by the embodiments of the present application;

[0047] Figure 4 A flowchart of another audio signal loudness compensation provided by the embodiments of the present application;

[0048] Figure 5 A digital power amplifier signal processing diagram provided by the embodiments of the present application;

[0049] Figure 6 A flowchart of still another audio signal loudness compensation provided by the embodiments of the present application;

[0050] Figure 7 A flowchart of preset sound pressure level determination provided by the embodiments of the present application;

[0051] Figure 8 A flowchart of compensation strategy formulation provided by the embodiments of the present application;

[0052] Figure 9 A structural schematic diagram of an audio adjustment system provided by an embodiment of the present application is shown in FIG. 1.

[0053] Figure 10 A structural schematic diagram of an electronic device provided by an embodiment of the present application is shown in FIG. 2. DETAILED DESCRIPTION

[0054] To make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described below in connection with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative work fall within the protection scope of the present application.

[0055] The following disclosure provides many different embodiments, or examples, for implementing different structures of the present application. For the purpose of simplification, the components and arrangements of specific examples are described in the following. Of course, they are only examples, and the purpose is not to limit the present application. In addition, reference numerals and / or letters can be repeated in different examples. Such repetition is for the purpose of simplification and clarity, and does not indicate a relationship between the various embodiments and / or arrangements being discussed.

[0056] To solve the technical problem that a single audio parameter set cannot adapt to the entire volume range due to the difference in loudness caused by different audio amplitudes in the audio playing process in the prior art, the present application provides an audio processing method, system, electronic device, and storage medium, which can detect audio changes in real time, and when detecting that an audio signal changes, the signal amplitude of the current audio signal is obtained, the signal amplitude is used to determine a preset sound pressure level, and then a corresponding compensation strategy is determined according to the sound pressure level. In this way, adaptive loudness compensation for the amplitude change of a television program source is realized, thereby significantly improving the sound experience of users.

[0057] Figure 1 A flowchart of an audio processing method provided by an embodiment of the present application is shown in FIG. 3, which specifically includes the following steps. Figure 1

[0058] S101, when detecting that an audio signal changes, the current signal amplitude is obtained, and a compensation strategy of the audio signal is determined, the compensation strategy including compensation sub-strategies of the audio signal at multiple sound pressure levels.

[0059] ​In the embodiment, when the audio playing device plays audio, the level detection module of the digital power amplifier is used to obtain the current voltage signal amplitude in real time, to obtain the real-time state of the voltage, and to call the compensation strategy of the audio signal.

[0060] In an actual audio scene, different playing environments, device characteristics, and user needs will cause the audio to be presented at different sound pressure levels; for example, in a quiet indoor environment, the sound pressure level of the audio may be relatively low; while in a noisy outdoor or large-scale performance environment, the sound pressure level of the audio will be higher in order to achieve a clear and audible effect. In order to enable the audio to present the best auditory effect at various sound pressure levels, the compensation strategy records compensation sub-strategies for different sound pressure levels, and each compensation sub-strategy is a set of audio adjustment schemes, including the processing mode of the audio signal in multiple dimensions.

[0061] S102, determining a preset sound pressure level of the audio signal according to the signal amplitude;

[0062] In the embodiment, after detecting the amplitude of the current signal, the amplitude effective value of the current signal is read through the configured register. Since the amplitude change of the voltage signal is linearly related to the loudness sound pressure level, the sound pressure level of the current audio playing device can be derived according to the amplitude change, thereby providing a basis for subsequently selecting a suitable compensation sub-strategy.

[0063] S103, determining a target compensation sub-strategy corresponding to the preset sound pressure level in the compensation strategy;

[0064] In the embodiment, in an actual audio playing scene, different preset sound pressure levels correspond to different auditory needs and environmental characteristics. When the preset sound pressure level of the audio signal is obtained, a target compensation sub-strategy matching the preset sound pressure level is queried from the constructed compensation strategy. Each compensation sub-strategy is an audio processing scheme for a specific sound pressure level environment. The target compensation sub-strategy details the loudness compensation values for the multiple frequency points of the audio signal at the preset sound pressure level, thereby providing targeted data basis for subsequent accurate audio loudness compensation and ideal auditory effect of the audio output.

[0065] Specifically, in the process of determining the target compensation sub-strategy, the preset sound pressure level is compared with different sound pressure level conditions recorded in the compensation strategy according to the numerical value of the preset sound pressure level. Once a match is successful, the target compensation sub-strategy is locked.

[0066] S104, performing loudness compensation on the audio signal according to the target compensation sub-strategy, to obtain an audio signal meeting a preset loudness condition.

[0067] In the embodiment, different frequency points in the audio signal are compensated in the target compensation sub-strategy, so that the loudness of each frequency point in the audio signal reaches the preset hearing effect under the preset sound pressure level.

[0068] Specifically, the loudness compensation process includes adjusting each target frequency point in the audio signal individually, and performing gain or attenuation processing on the audio signal of each target frequency point according to the loudness compensation value recorded in the target compensation sub-strategy, so as to ensure that the overall loudness of the audio signal meets the preset hearing standard under the preset sound pressure level.

[0069] The audio processing method provided in the embodiment can automatically obtain the signal amplitude of the current audio signal when detecting that the audio signal changes, determine the preset sound pressure level according to the signal amplitude change, select the target compensation sub-strategy corresponding to the preset sound pressure level from the compensation strategy, and perform gain or attenuation processing on each target frequency point in the audio signal according to the target compensation sub-strategy, so as to ensure that the audio signal reaches the ideal hearing effect under the preset sound pressure level, realize adaptive loudness compensation, improve the sound experience, and make the audio output more consistent with the hearing demand of the user in the current playing environment.

[0070] In an optional scheme of the embodiment, the target compensation sub-strategy includes loudness compensation values of the preset sound pressure level at multiple frequency points.

[0071] In the embodiment, the target compensation sub-strategy records specific compensation values for loudness compensation according to the preset sound pressure level at multiple signal frequencies, so as to ensure that the perceived intensity of the sound can reach the expected balanced state in different frequency ranges, thereby providing a more harmonious hearing experience.

[0072] Figure 2 A flowchart of the loudness compensation of the audio signal provided in the embodiment is shown in FIG. 1. Figure 2 As shown in FIG. 1, the loudness compensation of the audio signal according to the target compensation sub-strategy to obtain the audio signal meeting the preset loudness condition includes the following steps.

[0073] S201, obtaining a signal frequency of the audio signal, the signal frequency including at least one frequency point.

[0074] The frequency of the audio signal is dynamically changed, the signal frequency is the sound wave vibration changing with time in the time domain, and is the periodic characteristic of the overall waveform; the frequency point is the frequency value of the audio signal at a specific time, reflecting the speed of the sound wave vibration at the specific time.

[0075] In the embodiment, the frequency point distribution of the audio signal in the time domain is obtained by monitoring the change of the signal frequency in real time.

[0076] S201, select a target frequency point with a frequency value in a target frequency interval from the signal frequency;

[0077] The actual television plays a composite sound, and through multiple sound channels of different frequency bands, provides a more rich and stereoscopic auditory experience for the audience; when processing the sound of the television, usually only the low frequency and high frequency parts change significantly; therefore, in order to optimize the sound effect, several frequency points in the low frequency and high frequency ranges can be selected according to the frequency bandwidth range of the sound of the television, and the frequency points are compensated, so that the overall performance of the sound of the television can be effectively improved, and a more balanced auditory experience can be provided when playing various audio content.

[0078] In the embodiment, when processing different sound channels of the playing device, specific frequency points with frequency values in the target frequency interval are selected from the received signal audio, and the specific frequency points are subjected to detailed loudness compensation processing, so that the performance of the audio signal at the key frequency points is enhanced, and the overall sound experience of the user is significantly improved.

[0079] S203, determine a target loudness compensation value corresponding to the target frequency point in a target compensation sub-strategy;

[0080] In the embodiment, according to the frequency value of the target frequency point, a target loudness compensation value corresponding to the target frequency point is searched in the target compensation sub-strategy.

[0081] S204, according to the target loudness compensation value, the audio signal at the target frequency point is subjected to loudness compensation to obtain an audio signal meeting a preset loudness condition.

[0082] In the embodiment, according to the target loudness compensation value corresponding to each target frequency point, the audio signal at the target frequency point is subjected to appropriate loudness compensation processing, so that the audio signal reaches a preset loudness effect at each target frequency point; the key frequency points in the audio signal are subjected to accurate loudness adjustment, the effect of the same perceived loudness but different physical frequencies is realized, and the overall sound experience is optimized.

[0083] The audio signal loudness compensation method provided by the embodiment of the application realizes the targeted loudness enhancement of the audio signal at the key frequency points by monitoring the frequency change of the audio signal in real time and performing accurate loudness compensation processing on the specific frequency points in the target frequency interval, can effectively improve the overall performance of the television sound when playing various audio content, and provides a more balanced and harmonious auditory experience for the user.

[0084] Figure 3 The architecture schematic diagram of the multi-channel audio playing device provided by the embodiment of the application is as follows: Figure 3As shown, for multi-channel sound system, due to the use of different playing hardware (such as speakers) in each symmetrical channel, in order to achieve the overall balance of sound, the gain in each power amplifier is also different, for example, in order to obtain good low frequency effect, the gain of the power amplifier of the bass channel is increased.

[0085] For the above multi-channel audio playing environment, since the scheme is to determine the target frequency point according to the frequency value, and further to implement targeted loudness adjustment on the audio signal at the target frequency point, the object of adjustment can be a single-channel audio playing device or a multi-channel audio playing device.

[0086] Specifically, for a multi-channel audio playing device, the embodiment of the present application can detect the amplitude of the audio signal of each channel in real time, and determine the corresponding preset sound pressure level according to the amplitude of the audio signal of each channel, and then determine a suitable compensation sub-strategy for each channel; then by determining the target frequency point of each channel, and using the target compensation sub-strategy of the channel to determine the loudness compensation value of each target frequency point, the compensation sub-strategy of each single channel is used to compensate the loudness of the audio signal respectively, so as to realize accurate loudness compensation for each channel.

[0087] Figure 4 Another flowchart of the loudness compensation of the audio signal provided by the embodiment of the present application is shown as Figure 4 The method further comprises:

[0088] S401, in the process of loudness compensation, it is judged whether the signal amplitude of the compensated audio signal reaches the preset amplitude limiting threshold;

[0089] In the process of loudness compensation, it is necessary to judge whether the compensated audio loudness reaches the upper limit of loudness. The upper limit of loudness refers to the maximum loudness value that the audio signal can reach after compensation processing. If the loudness of the audio signal has reached this upper limit during the compensation process, but the compensation is still continued, it may cause damage to the quality of the audio signal, the problem of sound distortion, and even may cause damage to the playing device.

[0090] In order to avoid the occurrence of the above problems, in the embodiment, the power amplifier limiter is used to monitor the signal amplitude of the audio signal after compensation processing in real time, and by comparing with the amplitude limiting threshold preset by the power amplifier limiter, it can be judged whether the compensation has reached the upper limit, so as to effectively prevent the risk of sound distortion and device damage.

[0091] It should be noted that the signal amplitude detection module must be placed behind the power amplifier limiter; when the amplitude of the signal reaches the preset threshold, even if the intensity of the input signal continues to increase, the amplitude of the output signal will remain unchanged, and the loudness will not change.

[0092] S402、In the case where the signal amplitude reaches the preset amplitude limiting threshold, stop performing the loudness compensation, and output the current compensated audio signal as an audio signal meeting the preset loudness condition.

[0093] In this embodiment, in the case where the amplitude of the audio signal reaches the preset amplitude limiting threshold, the operation of performing loudness compensation is immediately stopped to prevent distortion or overload of the audio signal during playback, ensure clear and stable sound quality, and then output the current compensated audio signal as an audio signal that has met the preset loudness condition; not only the loudness compensation requirement is met, but also a balance point is reached in the sense of hearing, which neither is too harsh nor is too dull, thereby providing a comfortable listening experience for the listener.

[0094] Conversely, if the signal amplitude does not reach the preset amplitude limiting threshold, the operation of performing loudness compensation is maintained, and during the loudness compensation, it is continuously detected whether the amplitude of the compensated signal reaches the preset amplitude limiting threshold until the signal amplitude of the audio signal reaches the preset amplitude limiting threshold or the preset loudness compensation is completed.

[0095] It should be noted that for a multi-channel audio playback device, the audio signals of different channels can have different signal amplitudes and preset sound pressure levels, and therefore, when performing loudness compensation, the audio signals of each channel need to be monitored and processed respectively.

[0096] Specifically, an independent power amplifier amplitude limiter can be set for each channel to monitor the signal amplitude of the compensated audio signal of the channel in real time and compare it with the preset amplitude limiting threshold of the channel; when the signal amplitude of a certain channel reaches the preset amplitude limiting threshold of the channel, the operation of performing loudness compensation on the channel is stopped, and the current compensated audio signal is output as an audio signal meeting the preset loudness condition, so as to ensure that the audio signals of each channel after the loudness compensation can not only achieve an ideal listening effect, but also avoid the risk of sound distortion and device damage.

[0097] The improved loudness compensation method for audio signals in this embodiment increases the monitoring of the amplitude of the compensated audio signal during the loudness compensation, intelligently stops further loudness compensation when it is detected that the amplitude of the compensated audio signal reaches the preset amplitude limiting threshold, thereby ensuring sound quality while avoiding sound distortion or device damage caused by excessive processing, and ensuring that the finally output audio signal can achieve the best state in terms of sound quality and listening experience.

[0098] Figure 5 A digital power amplifier signal processing schematic diagram provided by the embodiment of the present application is shown in FIG. 1, and a processing link of a two-channel (ch1, ch2) audio signal from input to digital-to-analog conversion output mainly includes the following steps: Figure 5 As shown in FIG. 1, the processing link of the two-channel (ch1, ch2) audio signal from input to digital-to-analog conversion output mainly includes the following steps:

[0099] Step one: signal input and basic mixing, receiving a double-channel original audio signal (ch1, ch2), inputting the original audio signal into a mixer for mixing processing such as channel mixing ratio adjustment, signal merging, etc.

[0100] Step two: signal conditioning module, frequency equalization processing is performed on the mixed audio signal, which can specifically enhance or attenuate a specific frequency band (such as enhancing bass, weakening high-frequency noise), and optimize the audio frequency spectrum characteristics.

[0101] Step three: loudness compensation processing is performed on the audio signal to control the loudness of the audio output.

[0102] Step four: limit the signal peak value to avoid distortion caused by excessive signal amplitude and ensure audio quality.

[0103] Step five: further adjust the frequency of the signal, which can address the residual frequency problems after the above steps (such as specific frequency bands that still need to be compensated), or adapt and optimize according to the frequency response characteristics of the terminal device (such as a digital-to-analog converter, a playback device).

[0104] Step five: output and digital-to-analog conversion, convert the digital audio signal processed by the full-link into an analog audio signal to ensure that the output loudness meets the standard output signal.

[0105] The digital power amplifier signal processing method provided by the embodiments of the present application first adjusts the mixing ratio of the double-channel audio signal through mixing processing to meet the playback requirements in different scenarios. Through frequency equalization processing, specific frequency bands can be specifically enhanced or attenuated to optimize the audio frequency spectrum characteristics, making the audio signal clearer and fuller. Then, through loudness compensation processing, the audio signal can be accurately adjusted in terms of loudness according to different compensation strategies under different sound pressure levels, ensuring that the ideal auditory effect can be achieved in various playback environments. In this process, by limiting the signal peak value, distortion caused by excessive signal amplitude is avoided, and the audio quality is ensured. Further, through the post-stage equalization, the residual frequency problems can be further adjusted, or the frequency response characteristics of the terminal device can be adapted and optimized to ensure that the final output meets the preset requirements of the audio signal.

[0106] Figure 6 Another flowchart of the audio signal loudness compensation provided by the embodiments of the present application is shown in FIG. 6, which includes the following steps: Figure 6

[0107] S601, acquiring frequency distribution information of the signal frequency;

[0108] S602, determining a target frequency interval according to the frequency distribution information.

[0109] ​It can be seen from the equal loudness curve that the human ear is more sensitive to the medium frequency, and the sensitivity to the low frequency and the high frequency is low. With the increase of the volume, the "concave" of the curve is gradually flattened, the relative change of the medium frequency band is relatively small, and the changes of the low frequency and the high frequency are large. Therefore, in the actual audio processing process, the loudness adjustment needs to be performed on the low frequency and the high frequency, so as to ensure that the entire audio signal can achieve the ideal hearing effect under different sound pressure levels.

[0110] In the embodiment, the frequency distribution information of the audio signal is first acquired, the distribution of each frequency point in the audio signal is understood, and the target frequency interval which needs to be compensated in the loudness is further determined. After the target frequency interval is determined, the loudness compensation processing is further performed on each target frequency point in the target frequency interval according to the preset sound pressure level and the compensation strategy, so that the overall loudness of the audio signal is kept consistent.

[0111] The audio signal loudness compensation method provided in the embodiment can analyze the frequency distribution information of the audio signal, determine the target frequency interval which needs to be compensated in the loudness, and perform the loudness compensation processing on the audio signal in a targeted manner, thereby improving the loudness compensation processing efficiency and effect, ensuring the consistency of the overall loudness of the audio signal, and enabling the perceived intensity of the audio signal in different frequency ranges to reach the expected balanced state, so as to provide the user with a more harmonious and comfortable hearing experience.

[0112] Figure 7 The flowchart for determining the preset sound pressure level provided in the embodiment is shown in FIG. 1. Figure 7 The method further includes the following steps.

[0113] S701, acquiring an amplitude difference value between the signal amplitude and the output amplitude of the test audio signal, the sound pressure level of the test audio signal being a first sound pressure level.

[0114] S702, determining the preset sound pressure level of the audio signal according to the linear relationship between the amplitude difference value and the sound pressure level difference.

[0115] In the audio playing system, the voltage signal amplitude change obtained at the front end of the digital-to-analog converter has a linear relationship with the loudness sound pressure level. When the signal amplitude increases by 1 dBFS, the sound pressure level generated by the terminal audio playing hardware is also increased by 1 dB. Therefore, the conversion relationship can be used to detect the change of the sound pressure level in real time by using the SDOUT (serial digital output) or the effective value level table.

[0116] In the embodiment, the amplitude difference value between the signal amplitude and the output amplitude of the test audio signal is acquired, and then the preset sound pressure level of the audio signal is further determined based on the linear relationship between the amplitude difference value and the sound pressure level difference.

[0117] Specifically, the sound pressure level of the test audio signal is set as a first sound pressure level, by monitoring the amplitude change of the audio signal in real time and comparing it with the amplitude of the test audio signal, the amplitude difference is calculated, and the preset sound pressure level of the audio signal is calculated by using the linear relationship between the amplitude of the audio signal and the sound pressure level.

[0118] For example, when tuning, the television plays -12dB pink noise, at this time the voltage amplitude detected by the digital power amplifier SDOUT is recorded as U0, at this time the sound pressure level of the loudspeaker sound is recorded as SPL0, and the basic calibration is completed; then the current input voltage amplitude U1 is monitored in real time through the digital power amplifier SDOUT interface, the difference (U1-U0) is calculated, and the voltage amplitude change is captured; according to the linear relationship between the voltage amplitude and the sound pressure level, the sound pressure level SPL1 of the current loudspeaker is obtained, SPL1=SPL0+(U1-U0).

[0119] It should be noted that in the above example, the initial voltage amplitude U0 is obtained by calibrating according to the standard playback volume of the television, and the sound pressure level SPL0 of the test audio signal is a reference value preset in advance; in actual application, the values of the initial calibrated voltage amplitude U0 and the first sound pressure level SPL0 can be flexibly adjusted according to different audio playback devices and playback environments to adapt to the audio processing requirements in various scenes.

[0120] In an optional scheme of the embodiment of the application, when it is detected that the audio signal changes, the current signal amplitude is obtained, and a compensation strategy of the audio signal is determined, including:

[0121] When it is detected that the amplitude of the audio signal changes and / or the set volume changes, the current signal amplitude is obtained, and a compensation strategy of the audio signal is determined.

[0122] In the embodiment, when it is detected that the amplitude of the audio signal or the set volume of the audio signal corresponding output device changes, the loudness compensation step of the audio signal is started, and necessary loudness adjustment is performed on the currently playing audio signal, so as to ensure the stability of the volume and the comfort of the hearing.

[0123] Among them, the volume change and the amplitude change are regarded as parallel triggering conditions, and both parameters are monitored, and the loudness compensation is executed in time when any parameter changes. For example, when the user increases the TV volume through the remote control, the set volume of the audio signal will be raised, the volume change is detected, and the loudness compensation process is started immediately to adjust the audio signal appropriately to keep the volume within the preset loudness range. Similarly, if the amplitude of the audio signal suddenly increases for some reason, this change can also be monitored and the loudness compensation mechanism is triggered to prevent the volume from being too large to cause sound distortion or equipment damage. This method enables the audio adjustment system to respond more sensitively to various audio signal changes, ensuring that the audio output always remains in the best state, providing users with a more stable and comfortable listening experience.

[0124] Figure 8 The flowchart of the compensation strategy development provided by the embodiments of the present application is shown in FIG. 1, and the method further comprises: Figure 8

[0125] S801, obtaining an equal loudness curve, the equal loudness curve being used to indicate standard sound pressure levels of an audio signal at a plurality of signal frequencies;

[0126] S802, for any sound pressure level, obtaining a loudness compensation value of the audio signal at the plurality of signal frequencies based on the equal loudness curve, to obtain a compensation sub-strategy of the sound pressure level;

[0127] In this embodiment, for each preset sound pressure level, based on the equal loudness curve, the loudness compensation demand of the audio signal at each frequency point is analyzed, so as to calculate the corresponding loudness compensation value, and a complete compensation sub-strategy will be generated for each sound pressure level; the obtained compensation sub-strategy comprehensively considers the auditory characteristics of the human ear and the characteristics of the audio signal itself, ensuring that the audio signal can present the best auditory effect in different playing environments.

[0128] Take 80Hz and 10KHz frequency points as examples to illustrate the compensation method. According to the ISO 226:2023 standard, the difference between the sound pressure levels of 80Hz and 10KHz at each loudness and the sound pressure level of 1KHz is as follows in Table 1:

[0129] Table 1

[0130]

[0131] Taking the TV sound quality with a loudness of 60 phons as the ideal state, the sound pressure level changes relative to 60 phons are compensated, and the sound pressure levels in Table 1 are subtracted from the sound pressure level corresponding to 60 phons to obtain Table 2 as follows:

[0132] Table 2

[0133] ​

[0134] According to Table II, the compensation sub-strategies of 80Hz and 10KHz frequency points are obtained, that is, the gains of 80Hz frequency points of 30 square, 40 square, 50 square, 60 square, 70 square and 80 square need to be increased by 9dB, 5dB, 3dB, 0dB, -3dB and -7dB respectively, and the gains of 10KHz frequency points of 30 square, 40 square, 50 square, 60 square, 70 square and 80 square need to be increased by 2dB, 1dB, 1dB, 0dB, 0dB and -1dB respectively.

[0135] S803, obtaining a compensation strategy according to the compensation sub-strategies of different sound pressure levels.

[0136] In this embodiment, the compensation sub-strategies corresponding to each sound pressure level are summarized and integrated to form a complete compensation strategy; the compensation strategy covers the loudness compensation requirements of the audio signal at each frequency point under different sound pressure levels, and can ensure that the audio signal can present the best auditory effect under various playing environments.

[0137] The compensation strategy formulation method provided in the embodiments of the present application,

[0138] By analyzing the equal loudness curve, the loudness compensation requirements of the audio signal at different frequencies are calculated, so that a reasonable compensation strategy is formulated; when formulating the compensation strategy, the auditory characteristics of the human ear and the audio characteristics of the audio signal itself are fully considered, and the compensation strategy can be adjusted and optimized according to different audio playing devices and playing environments, so as to ensure the accuracy and practicability of the compensation strategy, and to meet the audio processing requirements in various scenes.

[0139] Figure 9 A structural schematic diagram of an audio adjustment system provided in an embodiment of the present application is shown in Figure 9 The system specifically includes:

[0140] The acquisition module 901 is configured to acquire a current signal amplitude when detecting that an audio signal changes, and determine a compensation strategy of the audio signal, wherein the compensation strategy includes compensation sub-strategies of the audio signal under multiple sound pressure levels.

[0141] The first determination module 902 is configured to determine a preset sound pressure level of the audio signal according to the signal amplitude.

[0142] The second determination module 903 is configured to determine a target compensation sub-strategy corresponding to the preset sound pressure level in the compensation strategy.

[0143] The execution module 904 is configured to perform loudness compensation on the audio signal according to the target compensation sub-strategy, so as to obtain an audio signal meeting a preset loudness condition.

[0144] In a possible implementation, the execution module 904 is further configured to acquire a signal frequency of the audio signal, the signal frequency comprising at least one frequency point; select a target frequency point with a frequency value in a target frequency interval from the signal frequency; determine a target loudness compensation value corresponding to the target frequency point in a target compensation sub-strategy; and perform loudness compensation on the audio signal at the target frequency point according to the target loudness compensation value, to obtain the audio signal meeting the preset loudness condition.

[0145] In a possible implementation, the execution module 904 is further configured to, in the process of loudness compensation, determine whether a signal amplitude of the compensated audio signal reaches a preset amplitude limiting threshold; and in the case where the signal amplitude reaches the preset amplitude limiting threshold, stop performing the loudness compensation, and take the current compensated audio signal as the audio signal meeting the preset loudness condition.

[0146] In a possible implementation, the execution module 904 is further configured to acquire frequency distribution information of the signal frequency; and determine the target frequency interval according to the frequency distribution information.

[0147] In a possible implementation, the second determination module 903 is further configured to acquire an amplitude difference value between the signal amplitude and an output amplitude of a test audio signal, the test audio signal having a first sound pressure level; and determine the preset sound pressure level of the audio signal according to a linear relationship between the amplitude difference value and a sound pressure level difference value.

[0148] In a possible implementation, the system further comprises a detection module 905 (not shown in the figure), configured to acquire a current signal amplitude and determine a compensation strategy of the audio signal when detecting that the amplitude of the audio signal changes and / or the setting volume changes.

[0149] In a possible implementation, the system further comprises a formulation module 906 (not shown in the figure), configured to acquire an equal loudness curve, the equal loudness curve being used to indicate a standard sound pressure level of the audio signal at a plurality of signal frequencies; for any sound pressure level, acquire a loudness compensation value of the audio signal at the plurality of signal frequencies based on the equal loudness curve, to obtain a compensation sub-strategy of the sound pressure level; and acquire the compensation strategy according to the compensation sub-strategies of different sound pressure levels.

[0150] The audio adjustment system provided in this embodiment can be the audio adjustment system shown in Figure 9 , and can perform all steps of the audio adjustment in Figures 1-8 , thereby realizing the technical effects of the audio adjustment shown in Figures 1-8 . For details, refer to the related description in Figures 1-8 . For brevity and conciseness, details are not repeated here.

[0151] The system embodiments described above are only illustrative, wherein the units described as separate components can or can not be physically separated, and the components displayed as units can or can not be physical units, i.e., can be located in one place or can be distributed to multiple network units. Part or all of the modules can be selected according to actual needs to achieve the purpose of the embodiment.

[0152] Figure 10 A structural schematic diagram of an electronic device provided in the embodiment of the present application is shown in Figure 10 The embodiment of the present application provides an electronic device, which comprises a processor 1001, a communication interface 1002, a memory 1003 and a communication bus 1004, wherein the processor 1001, the communication interface 1002 and the memory 1003 complete mutual communication through the communication bus 1004; the memory 1003 is used for storing a computer program; and the processor 1001 is used for executing the program stored on the memory 1003 to implement the steps of the audio processing provided in any one of the method embodiments:

[0153] When it is detected that the audio signal changes, the current signal amplitude is acquired, and a compensation strategy of the audio signal is determined, the compensation strategy comprising compensation sub-strategies of the audio signal at multiple sound pressure levels; a preset sound pressure level of the audio signal is determined according to the signal amplitude; a target compensation sub-strategy corresponding to the preset sound pressure level in the compensation strategy is determined; and the audio signal is subjected to loudness compensation according to the target compensation sub-strategy, so as to obtain an audio signal meeting a preset loudness condition.

[0154] In one possible implementation, a signal frequency of the audio signal is acquired, the signal frequency comprising at least one frequency point; a target frequency point with a frequency value in a target frequency interval is selected from the signal frequency; a target loudness compensation value corresponding to the target frequency point in the target compensation sub-strategy is determined; and the audio signal at the target frequency point is subjected to loudness compensation according to the target loudness compensation value, so as to obtain an audio signal meeting a preset loudness condition.

[0155] In one possible implementation, in the process of loudness compensation, it is judged whether the signal amplitude of the compensated audio signal reaches a preset amplitude limiting threshold; in the case that the signal amplitude reaches the preset amplitude limiting threshold, the loudness compensation is stopped, and the current compensated audio signal is taken as an audio signal meeting a preset loudness condition.

[0156] In one possible implementation, frequency distribution information of the signal frequency is acquired; and the target frequency interval is determined according to the frequency distribution information.

[0157] In a possible implementation, the amplitude difference between the signal amplitude and the test audio signal output amplitude is obtained, the sound pressure level of the test audio signal is a first sound pressure level; and the preset sound pressure level of the audio signal is determined according to a linear relationship between the amplitude difference and a sound pressure level difference.

[0158] In a possible implementation, when the amplitude of the audio signal is detected to change and / or the setting volume is detected to change, the current signal amplitude is obtained, and a compensation strategy of the audio signal is determined.

[0159] In a possible implementation, an equal loudness curve is obtained, the equal loudness curve is used to indicate a standard sound pressure level of the audio signal at a plurality of signal frequencies; for any sound pressure level, a loudness compensation value of the audio signal at the plurality of signal frequencies is obtained based on the equal loudness curve, to obtain a compensation sub-strategy of the sound pressure level; and the compensation strategy is obtained according to the compensation sub-strategies of different sound pressure levels.

[0160] Through the above description of the embodiments, those skilled in the art can clearly understand that the embodiments can be implemented by means of software plus a general hardware platform, and of course, can also be implemented by hardware. Based on such understanding, the above technical solutions essentially or say the part that contributes to the related art can be embodied in the form of a software product, which can be stored in a computer readable storage medium, such as a ROM / RAM, a magnetic disk, an optical disk, etc., and includes a plurality of instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute the methods described in the embodiments or some parts of the embodiments.

[0161] It should be understood that the terms used herein are for the purpose of describing particular example implementations only and are not intended to be limiting. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. The terms "comprises", "comprising", "includes", "including" and "has" are inclusive and therefore specify the presence of stated features, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and / or groups thereof. The method steps, processes, and operations described herein are not to be construed as necessarily requiring their performance in the particular order in which they are described, unless specifically indicated as such. It is also to be understood that additional or alternative steps can be employed.

[0162] The foregoing is considered as illustrative only of the principles of the application. Numerous modifications and changes will readily occur to those skilled in the art, and it is intended to embrace all such modifications and changes that fall within the scope of the application. Accordingly, the application is not to be restricted in scope to the specific embodiments disclosed herein but is to be accorded the full scope that the principles and novel features request appropriately granted.

Claims

1. An audio processing method, characterized by, The method comprises: When detecting that the audio signal changes, the current signal amplitude is obtained, and a compensation strategy of the audio signal is determined, the compensation strategy comprising compensation sub-strategies of the audio signal at multiple sound pressure levels; A preset sound pressure level of the audio signal is determined according to the signal amplitude; A target compensation sub-strategy corresponding to the preset sound pressure level in the compensation strategy is determined; The audio signal is subjected to loudness compensation according to the target compensation sub-strategy, so as to obtain an audio signal meeting a preset loudness condition.

2. The method of claim 1, wherein, The target compensation sub-strategy comprises loudness compensation values of the preset sound pressure level at multiple frequency points; The audio signal is subjected to loudness compensation according to the target compensation sub-strategy, so as to obtain an audio signal meeting a preset loudness condition, comprising: A signal frequency of the audio signal is obtained, the signal frequency comprising at least one frequency point; From the signal frequency, a target frequency point with a frequency value in a target frequency interval is selected; A target loudness compensation value corresponding to the target frequency point in the target compensation sub-strategy is determined; The audio signal at the target frequency point is subjected to loudness compensation according to the target loudness compensation value, so as to obtain an audio signal meeting a preset loudness condition.

3. The method of claim 2, wherein, The method further comprises: During the loudness compensation process, it is judged whether the signal amplitude of the compensated audio signal reaches a preset amplitude limiting threshold; In the case where the signal amplitude reaches the preset amplitude limiting threshold, the loudness compensation is stopped, and the current compensated audio signal is taken as an audio signal meeting the preset loudness condition.

4. The method of claim 2, wherein, Before the step of selecting, from the signal frequency, a target frequency point with a frequency value in a target frequency interval, the method further comprises: Frequency distribution information of the signal frequency is obtained; The target frequency interval is determined according to the frequency distribution information.

5. The method of claim 1, wherein, The preset sound pressure level of the audio signal is determined according to the signal amplitude, comprising: An amplitude difference value between the signal amplitude and a test audio signal output amplitude is obtained, the sound pressure level of the test audio signal being a first sound pressure level; The preset sound pressure level of the audio signal is determined according to a linear relationship between the amplitude difference value and a sound pressure level difference value.

6. The method of claim 1, wherein, The current signal amplitude is obtained when detecting that the audio signal changes, and the compensation strategy of the audio signal is determined, comprising: The current signal amplitude is obtained when detecting that the amplitude of the audio signal changes and / or the setting volume changes, and the compensation strategy of the audio signal is determined.

7. The method of claim 1, wherein, The compensation strategy is formulated as follows: An equal loudness curve is obtained, the equal loudness curve being used to indicate standard sound pressure levels of the audio signal at multiple signal frequencies; For any sound pressure level, loudness compensation values of the audio signal at multiple signal frequencies are obtained based on the equal loudness curve, to obtain a compensation sub-strategy of the sound pressure level; The compensation strategy is obtained according to the compensation sub-strategies of different sound pressure levels.

8. An audio adjustment system, characterized by The method comprises: An obtaining module is configured to obtain the current signal amplitude when detecting that the audio signal changes, and determine the compensation strategy of the audio signal, the compensation strategy comprising compensation sub-strategies of the audio signal at multiple sound pressure levels; A first determining module is configured to determine a preset sound pressure level of the audio signal according to the signal amplitude; A second determining module is configured to determine a target compensation sub-strategy corresponding to the preset sound pressure level in a compensation strategy. An executing module is configured to perform loudness compensation on the audio signal according to the target compensation sub-strategy, so as to obtain an audio signal meeting a preset loudness condition.

9. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, The processor executes the computer program to implement the steps of the audio processing method in any one of claims 1-7.

10. A storage medium having stored thereon a computer program, characterized in that The computer program is executed by the processor to implement the steps of the audio processing method in any one of claims 1-7.

Images