Audio processing method and device, electronic equipment and storage medium

Abstract

The invention relates to an audio processing method and device, electronic equipment and a storage medium. The method comprises the steps of collecting a first stereo signal output through a left sound channel and a second stereo signal output through a right sound channel in the running process of an application program; determining a difference degree between the first stereo signal and the second stereo signal; under the condition that the difference degree is larger than a preset difference threshold value, the first stereo signal and / or the second stereo signal are / is adjusted, and the preset difference threshold value is used for judging whether azimuth difference exists between signals output by the left sound channel and the right sound channel or not. According to the embodiment of the invention, under the condition that the azimuth difference exists between the first stereo signal and the second stereo signal, the first stereo signal and / or the second stereo signal can be adaptively adjusted, so that the adjusted first stereo signal and the adjusted second stereo signal correspond to the running scene of the application program, and further the perception of a user to sound is increased.

Description

Technical Field

[0001] The present disclosure relates to the field of information technology, and in particular to an audio processing method, device, electronic device and storage medium. Background Art

[0002] With the development of True Wireless Stereo (TWS) technology, TWS headphones came into being. As the TWS headphone market matures, separate gaming headphones have emerged. Many manufacturers limit game sound effects to changing the equalizer (EQ), and do not design other game sound effects to increase gaming experience and competitive ability. In related technologies, TWS headphones have specific sound effects. For example, there are similar TWS headphones with game sound effects, but they are limited to simple increases in filters and volume, and do not increase users' perception of game sounds. Summary of the invention

[0003] In order to overcome the problems existing in the related art, the present disclosure provides an audio processing method, device, electronic device and storage medium to overcome the problem that the user's perception of game sound cannot be increased.

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided an audio processing method, including:

[0005] During the running of the application, a first stereo signal output through a left channel and a second stereo signal output through a right channel are collected;

[0006] determining a degree of difference between the first stereo signal and the second stereo signal;

[0007] When the difference is greater than a preset difference threshold, the first stereo signal and / or the second stereo signal is adjusted, wherein the preset difference threshold is used to determine whether there is an azimuth difference between the signals output from the left and right channels.

[0008] In some embodiments, determining the difference between the first stereo signal and the second stereo signal comprises:

[0009] Identifying first sound segments of the first stereo signal within respective frequency bands of an octave, and determining energy parameters of respective first sound segments;

[0010] identifying second sound segments of the first stereo signal within each of the frequency bands of the octave, and determining energy parameters of each of the second sound segments;

[0011] The degree of difference is determined based on energy parameters of each of the first sound segments and energy parameters of each of the second sound segments.

[0012] In some embodiments, determining the difference based on the energy parameters of each of the first sound segments and the energy parameters of each of the second sound segments includes:

[0013] Obtaining energy differences corresponding to each frequency band based on differences between energy parameters of the first sound segment and energy parameters of the second sound segment within the same frequency band;

[0014] Based on each of the energy difference values, the degree of difference is determined.

[0015] In some embodiments, the method further comprises:

[0016] Determine, based on each of the energy differences, a first gain value of the first sound segment corresponding to the energy difference value, and a second gain value of the second sound segment corresponding to the energy difference value;

[0017] The adjusting the first stereo signal and / or the second stereo signal comprises:

[0018] Adjusting the corresponding first sound segment based on the first gain value; and / or

[0019] adjusting the corresponding second sound segment based on the second gain value;

[0020] The first gain value and the second gain value are both negatively correlated with the energy difference value.

[0021] In some embodiments, the method further comprises:

[0022] determining a third gain value based on a signal value of the first stereo signal, and determining a fourth gain value based on a signal value of the second stereo signal;

[0023] The adjusting the first stereo signal and / or the second stereo signal comprises:

[0024] Adjusting the first stereo signal based on the third gain value; and / or

[0025] adjusting the second stereo signal based on the fourth gain value;

[0026] The third gain value is negatively correlated with the signal value of the first stereo signal, and the fourth gain value is negatively correlated with the signal value of the second stereo signal.

[0027] In some embodiments, the method further comprises:

[0028] The adjusted first stereo signal is output through the left channel, and the adjusted second stereo signal is output through the right channel.

[0029] In some embodiments, the method further comprises:

[0030] During the running of the application, the touch control is displayed through the application interface of the application;

[0031] When a trigger operation on the touch control is detected, an adaptive orientation enhancement function is turned on, and a first stereo signal output through a left channel and a second stereo signal output through a right channel are collected.

[0032] According to a second aspect of an embodiment of the present disclosure, there is provided an audio processing device, including:

[0033] A collection module, configured to collect a first stereo signal output through a left channel and a second stereo signal output through a right channel during the running of the application;

[0034] A first determining module, configured to determine a difference between the first stereo signal and the second stereo signal;

[0035] The adjustment module is configured to adjust the first stereo signal and / or the second stereo signal when the difference is greater than a preset difference threshold, wherein the preset difference threshold is used to determine whether there is an azimuth difference between the signals output by the left and right channels.

[0036] In some embodiments, the second determining module is configured to:

[0037] Identifying first sound segments of the first stereo signal within respective frequency bands of an octave, and determining energy parameters of respective first sound segments;

[0038] identifying second sound segments of the first stereo signal within each of the frequency bands of the octave, and determining energy parameters of each of the second sound segments;

[0039] The degree of difference is determined based on energy parameters of each of the first sound segments and energy parameters of each of the second sound segments.

[0040] In some embodiments, the second determining module is configured to:

[0041] Obtaining energy differences corresponding to each frequency band based on differences between energy parameters of the first sound segment and energy parameters of the second sound segment within the same frequency band;

[0042] Based on each of the energy difference values, the degree of difference is determined.

[0043] In some embodiments, the apparatus further comprises:

[0044] A second determination module is configured to determine, based on each of the energy differences, a first gain value of the first sound segment corresponding to the energy difference value, and a second gain value of the second sound segment corresponding to the energy difference value;

[0045] The adjustment module is configured as follows:

[0046] Adjusting the corresponding first sound segment based on the first gain value; and / or

[0047] adjusting the corresponding second sound segment based on the second gain value;

[0048] The first gain value and the second gain value are both negatively correlated with the energy difference value.

[0049] In some embodiments, the apparatus further comprises:

[0050] a third determining module, configured to determine a third gain value based on a signal value of the first stereo signal, and to determine a fourth gain value based on a signal value of the second stereo signal;

[0051] The adjustment module is configured as follows:

[0052] Adjusting the first stereo signal based on the third gain value; and / or

[0053] adjusting the second stereo signal based on the fourth gain value;

[0054] The third gain value is negatively correlated with the signal value of the first stereo signal, and the fourth gain value is negatively correlated with the signal value of the second stereo signal.

[0055] In some embodiments, the apparatus further comprises:

[0056] The output module is configured to output the adjusted first stereo signal through the left channel and output the adjusted second stereo signal through the right channel.

[0057] In some embodiments, the apparatus further comprises:

[0058] A display module, configured to display touch controls through an application interface of the application during the running of the application;

[0059] The starting module is configured to start the adaptive orientation enhancement function when a trigger operation for the touch control is detected, and collect the first stereo signal output through the left channel and the second stereo signal output through the right channel.

[0060] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0061] processor;

[0062] a memory configured to store processor-executable instructions;

[0063] Wherein, the processor is configured to: implement the steps in any one of the audio processing methods in the first aspect when executed.

[0064] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform any one of the audio processing methods in the first aspect.

[0065] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0066] The technical solution disclosed herein collects a first stereo signal output through a left channel and a second stereo signal output through a right channel during the running of an application; determines the difference between the first stereo signal and the second stereo signal; determines that there is an azimuth difference between the first stereo signal and the second stereo signal when the difference is greater than a preset difference threshold; and adjusts the first stereo signal and / or the second stereo signal when there is an azimuth difference.

[0067] It is possible to detect audio signals in the running scenario of the application. When there is an azimuth difference between the first stereo signal and the second stereo signal, the first stereo signal and / or the second stereo signal can be adaptively adjusted so that the adjusted first stereo signal and the second stereo signal correspond to the running scenario of the application, thereby increasing the user's perception of sound.

[0068] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0069] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0070] Figure 1 The following is a flow chart of an audio processing method according to an exemplary embodiment. Figure 1 .

[0071] Figure 2 The following is a flow chart of an audio processing method according to an exemplary embodiment. Figure 2 .

[0072] Figure 3 The present invention is a block diagram of an audio processing device according to an exemplary embodiment.

[0073] Figure 4 It is a hardware structure block diagram of an electronic device 800 according to an exemplary embodiment. DETAILED DESCRIPTION

[0074] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0075] Figure 1 The following is a flow chart of an audio processing method according to an exemplary embodiment. Figure 1 ,like Figure 1 As shown, the method mainly includes the following steps:

[0076] In step 101, during the running of the application, a first stereo signal output through a left channel and a second stereo signal output through a right channel are collected;

[0077] In step 102, a difference between the first stereo signal and the second stereo signal is determined;

[0078] In step 103, when the difference is greater than a preset difference threshold, the first stereo signal and / or the second stereo signal is adjusted, wherein the preset difference threshold is used to determine whether there is an azimuth difference between the signals output by the left and right channels.

[0079] It should be noted that the method can be applied to electronic devices. The electronic devices may include terminal devices. The terminal devices may include mobile terminals and fixed terminals, such as mobile phones, tablet computers, PDAs, laptop computers, desktop computers, wearable devices, smart speakers, televisions, and vehicle-mounted terminals.

[0080] Wearable devices may include: portable devices that are worn directly on the user or integrated into the user's accessories. For example, they may include: wearable devices supported by the head (including headphones, glasses, helmets, headbands, etc.). They may also include: smart clothing, school bags, crutches, accessories, etc.

[0081] In some embodiments, the electronic device may have an audio playback function, for example, may be a headset with an audio playback function.

[0082] In some embodiments, during the running of the application, the first stereo signal output through the left channel and the second stereo signal output through the right channel in the audio stream can be collected in real time. Here, the application can be an application that requires audio output, such as a game application. Taking the application of the audio processing method to TWS headphones as an example, during the running of the application, the audio signal generated during the running of the application can be played to the user through the TWS headphones.

[0083] In the disclosed embodiment, after collecting the first stereo signal output through the left channel and the second stereo signal output through the right channel, the difference between the first stereo signal and the second stereo signal can be determined, and then whether there is an azimuth difference between the first stereo signal and the second stereo signal based on the difference can be determined. Exemplarily, when the difference is greater than a preset difference threshold, it is determined that there is an azimuth difference between the first stereo signal and the second stereo signal. Here, the azimuth difference is used to characterize the azimuth difference perceived by the user through sound in different scenarios during the operation of the application. Among them, the preset difference threshold can be obtained based on experiments, and can also be customized as needed, and is not specifically limited here.

[0084] The technical solution in the embodiments of the present disclosure can be applied to applications with a strong sense of direction. For example, it can be applied to shooting or competitive game applications. In this way, it can be realized as needed to expand the width of the rear sound in stereo and adaptively enhance the volume of the side direction (non-front direction) sound source in real time.

[0085] In some embodiments, a signal value of the first stereo signal and a signal value of the second stereo signal may be determined, and a difference between the first stereo signal and the second stereo signal may be determined based on the signal value of the first stereo signal and the signal value of the second stereo signal. For example, the difference between the first stereo signal and the second stereo signal may be determined based on a difference between the signal value of the first stereo signal and the signal value of the second stereo signal.

[0086] In case of an orientation difference, adjusting the first stereo signal and / or the second stereo signal may include: adjusting only the first stereo signal; or adjusting only the first stereo signal; or adjusting both the first stereo signal and the second stereo signal.

[0087] Through the technical solution of the present invention, it is possible to detect audio signals in the running scenario of an application. When there is an azimuth difference between the first stereo signal and the second stereo signal, the first stereo signal and / or the second stereo signal can be adaptively adjusted so that the adjusted first stereo signal and the second stereo signal correspond to the running scenario of the application, thereby increasing the user's perception of sound.

[0088] In some embodiments, determining the difference between the first stereo signal and the second stereo signal comprises:

[0089] Identifying first sound segments of the first stereo signal within respective frequency bands of an octave, and determining energy parameters of respective first sound segments;

[0090] identifying second sound segments of the first stereo signal within each of the frequency bands of the octave, and determining energy parameters of each of the second sound segments;

[0091] The degree of difference is determined based on energy parameters of each of the first sound segments and energy parameters of each of the second sound segments.

[0092] Exemplarily, a first sound segment in which the first stereo signal is located within each frequency band of 1 / 2 octave and a second sound segment in which the second stereo signal is located within each frequency band of 1 / 2 octave can be identified. After determining the first sound segment and the second sound segment, the energy parameter (RMS value) of each first sound segment and the energy parameter of each second sound segment can be determined, and the degree of difference can be determined based on the energy parameter of each first sound segment and the energy parameter of each second sound segment. Of course, the above-mentioned 1 / 2 octave is used as an example, and it can also be 2 octave, 1 / 3 octave, etc., as long as the stereo signal can be segmented.

[0093] Table 1 shows the identification of the first sound segment of the first stereo signal located in each frequency band of 1 / 2 octave, the second sound segment of the second stereo signal located in each frequency band of 1 / 2 octave, and the energy parameters of each first sound segment and the energy parameters of each second sound segment. The energy parameter can characterize the volume of the sound signal. For example, the volume is positively correlated with the energy parameter. The larger the volume, the larger the energy parameter, and the smaller the volume, the smaller the energy parameter.

[0094] Table 1

[0095] Frequency band 20-45Hz 45-90Hz 90-180Hz ... 11.2-20kHz RMS value of the first sound clip A1 A2 A3 A10 RMS value of the first sound clip B1 B2 B3 B10

[0096] As shown in Table 1, the energy parameter of the first audio segment in the first frequency band (20-45 Hz) is A1, and the energy parameter of the second audio segment is B1; the energy parameter of the first audio segment in the second frequency band (45-90 Hz) is A2, and the energy parameter of the second audio segment is B2; the energy parameter of the first audio segment in the third frequency band (90-180 Hz) is A3, and the energy parameter of the second audio segment is B3; ... the energy parameter of the first audio segment in the tenth frequency band (11.2k-20kHz) is A10, and the energy parameter of the second audio segment is B10.

[0097] In some embodiments, determining the difference based on the energy parameters of each first sound segment and the energy parameters of each second sound segment may include: summing the energy parameters of all first sound segments to obtain a first sum value, summing the energy parameters of all second sound segments to obtain a second sum value, and determining the difference based on the difference between the first sum value and the second sum value. In other embodiments, the difference between the first sum value and the second sum value may be weighted, and the difference may be obtained based on the weighted result. As long as the obtained difference can characterize the azimuth difference between the first stereo signal and the second stereo signal, it is sufficient.

[0098] In some embodiments, determining the difference based on the energy parameters of each of the first sound segments and the energy parameters of each of the second sound segments includes:

[0099] Obtaining energy differences corresponding to each frequency band based on differences between energy parameters of the first sound segment and energy parameters of the second sound segment within the same frequency band;

[0100] Based on each of the energy difference values, the degree of difference is determined.

[0101] In some embodiments, the difference between the energy parameter of the first sound segment and the energy parameter of the second sound segment within the same frequency band can be directly determined as the energy difference corresponding to each frequency band. In other embodiments, the difference between the energy parameter of the first sound segment and the energy parameter of the second sound segment within the same frequency band can be weighted, and the result of the weighted processing can be determined as the energy difference corresponding to each frequency band. As long as the energy difference can characterize the azimuth difference between the first sound segment and the second sound segment within the same frequency band, it will be sufficient.

[0102] After the energy difference values ​​are obtained, the difference degree may be determined based on each energy difference value. For example, the difference degree may be determined based on the average value between each energy difference value. For another example, the difference degree may be determined based on the weighted average value between each energy difference value. For another example, the difference degree may be determined based on the square root of each energy difference value.

[0103] Taking the energy parameters of the first audio segment and the energy parameters of the second audio segment obtained in Table 1 as an example, the calculation formula of the difference X can be as follows:

[0104]

[0105] In formula (1), X represents the difference, A represents the energy parameter of the first audio segment, and B represents the energy parameter of the second audio segment.

[0106] In the embodiment of the present disclosure, the azimuth differences between the first sound segments and the second sound segments may be determined respectively first, and then the azimuth difference between the first stereo signal and the second stereo signal may be determined, so that the final determined difference degree may be more accurate.

[0107] In some embodiments, the method further comprises:

[0108] Determine, based on each of the energy differences, a first gain value of the first sound segment corresponding to the energy difference value, and a second gain value of the second sound segment corresponding to the energy difference value;

[0109] The adjusting the first stereo signal and / or the second stereo signal comprises:

[0110] Adjusting the corresponding first sound segment based on the first gain value; and / or

[0111] adjusting the corresponding second sound segment based on the second gain value;

[0112] The first gain value and the second gain value are both negatively correlated with the energy difference value.

[0113] Since the smaller the energy difference value, the smaller the orientation difference between the first sound segment and the second sound segment corresponding to the energy difference value, in this case, it is necessary to make a larger adjustment to the first sound segment and / or the second sound segment so that the user can more clearly perceive the orientation difference between the first sound segment and / or the second sound segment. The larger the energy difference value, the larger the orientation difference between the first sound segment and the second sound segment corresponding to the energy difference value, in this case, it is necessary to make a smaller adjustment to the first sound segment and / or the second sound segment so as to maintain the orientation difference between the first sound segment and / or the second sound segment.

[0114] The technical solution disclosed in the present invention makes the first gain value and the second gain value negatively correlated with the energy difference value, so that the azimuth difference between the adjusted first stereo signal and the second stereo signal is relatively large, so that the user can clearly perceive the difference between the first stereo signal and the second stereo signal when using the application. When the application is a game application, the user's perception of the current game scene can be improved, and the spatial sound effect can be felt, thereby enhancing the game sound effect.

[0115] Furthermore, by adjusting each first sound segment and / or second sound segment separately, the flexibility of audio processing can be improved, and the adjusted first stereo signal and second stereo signal finally obtained are more in line with the current application scenario of the application (for example, a game scenario).

[0116] In some embodiments, the method further comprises:

[0117] determining a third gain value based on a signal value of the first stereo signal, and determining a fourth gain value based on a signal value of the second stereo signal;

[0118] The adjusting the first stereo signal and / or the second stereo signal comprises:

[0119] Adjusting the first stereo signal based on the third gain value; and / or

[0120] adjusting the second stereo signal based on the fourth gain value;

[0121] The third gain value is negatively correlated with the signal value of the first stereo signal, and the fourth gain value is negatively correlated with the signal value of the second stereo signal.

[0122] Since the larger the first stereo signal is, the more obvious the user's perception of the first stereo signal is, at this time, the amplitude of adjusting the first stereo signal can be relatively small. By making the third gain value negatively correlated with the signal value of the first stereo signal, the user's perception of the first stereo signal can be maintained when the first stereo signal is relatively large. Since the larger the second stereo signal is, the more obvious the user's perception of the second stereo signal is, at this time, the amplitude of adjusting the second stereo signal can be relatively small. By making the third gain value negatively correlated with the signal value of the second stereo signal, the user's perception of the second stereo signal can be maintained when the second stereo signal is relatively large.

[0123] The technical solution disclosed in the present invention enables the user to have a stronger perception of the adjusted first stereo signal and the second stereo signal by making the third gain value negatively correlated with the signal value of the first stereo signal, and the fourth gain value negatively correlated with the signal value of the second stereo signal, so that the user can clearly perceive the first stereo signal and the second stereo signal respectively when using the application program. When the application program is a game application program, the user's perception of the current game scene can be improved, and the user can feel the spatial sound effect, thereby enhancing the game sound effect.

[0124] In some embodiments, the method further comprises:

[0125] The adjusted first stereo signal is output through the left channel, and the adjusted second stereo signal is output through the right channel.

[0126] In some embodiments, when it is determined that the difference between the adjusted first stereo signal and the adjusted second stereo signal is less than a preset difference threshold, the adjusted first stereo signal can be output through the left channel, and the adjusted second stereo signal can be output through the right channel, so that the sound signal heard by the user has a stronger sense of space.

[0127] In some embodiments, the method further comprises:

[0128] During the running of the application, the touch control is displayed through the application interface of the application;

[0129] When a trigger operation on the touch control is detected, an adaptive orientation enhancement function is turned on, and a first stereo signal output through a left channel and a second stereo signal output through a right channel are collected.

[0130] Here, the touch control may be a virtual button displayed on an application interface. During the running of the application, the touch control may be displayed through the application interface of the application, which may improve the convenience of the user in using the application.

[0131] It should be noted that the trigger operation for the touch control may include a click operation, a press operation, a gesture operation, etc. In the embodiment of the present disclosure, after the trigger operation acting on the touch control is detected, the adaptive azimuth enhancement function may be turned on, and the first stereo signal output through the left channel and the second stereo signal output through the right channel may be collected; the difference between the first stereo signal and the second stereo signal may be determined; if the difference is greater than a preset difference threshold, it may be determined that there is an azimuth difference between the first stereo signal and the second stereo signal; if there is an azimuth difference, the first stereo signal and / or the second stereo signal may be adjusted.

[0132] Figure 2 A flow chart of an audio processing method according to an exemplary embodiment is shown Figure 2 ,like Figure 2 As shown, when the difference is less than or equal to the preset difference threshold, it is determined that there is no azimuth difference between the first stereo signal and the second stereo signal, and at this time, there is no need to enable the adaptive azimuth enhancement function. In some embodiments, when there is no azimuth difference between the first stereo signal and the second stereo signal, it can be determined whether the application is in a human voice scene or a music scene. If it is in a human voice scene, a filter for enhancing human voice can be applied, and if it is in a music scene, a filter for enhancing music can be applied. The adaptive azimuth enhancement function is not enabled in the above two scenes.

[0133] In the case where there is an azimuth difference between the first stereo signal and the second stereo signal, the adaptive azimuth enhancement function can be turned on to adaptively adjust the first stereo signal and / or the second stereo signal so that the adjusted first stereo signal and the second stereo signal correspond to the running scenario of the application, thereby increasing the user's perception of the sound.

[0134] Figure 3 FIG. 1 is a block diagram of an audio processing device according to an exemplary embodiment. Figure 3 As shown, the audio processing device 300 mainly includes:

[0135] The acquisition module 301 is configured to acquire a first stereo signal output through a left channel and a second stereo signal output through a right channel during the running of the application program;

[0136] A first determination module 302 is configured to determine a difference between the first stereo signal and the second stereo signal;

[0137] The adjustment module 303 is configured to adjust the first stereo signal and / or the second stereo signal when the difference is greater than a preset difference threshold, wherein the preset difference threshold is used to determine whether there is an azimuth difference between the signals output by the left and right channels.

[0138] In some embodiments, the second determining module 303 is configured to:

[0139] Identifying first sound segments of the first stereo signal within respective frequency bands of an octave, and determining energy parameters of respective first sound segments;

[0140] identifying second sound segments of the first stereo signal within each of the frequency bands of the octave, and determining energy parameters of each of the second sound segments;

[0141] The degree of difference is determined based on energy parameters of each of the first sound segments and energy parameters of each of the second sound segments.

[0142] In some embodiments, the second determining module 303 is configured to:

[0143] Obtaining energy differences corresponding to each frequency band based on differences between energy parameters of the first sound segment and energy parameters of the second sound segment within the same frequency band;

[0144] Based on each of the energy difference values, the degree of difference is determined.

[0145] In some embodiments, the apparatus further comprises:

[0146] A second determination module is configured to determine, based on each of the energy differences, a first gain value of the first sound segment corresponding to the energy difference value, and a second gain value of the second sound segment corresponding to the energy difference value;

[0147] The adjustment module is configured as follows:

[0148] Adjusting the corresponding first sound segment based on the first gain value; and / or

[0149] adjusting the corresponding second sound segment based on the second gain value;

[0150] The first gain value and the second gain value are both negatively correlated with the energy difference value.

[0151] In some embodiments, the apparatus further comprises:

[0152] a third determining module, configured to determine a third gain value based on a signal value of the first stereo signal, and to determine a fourth gain value based on a signal value of the second stereo signal;

[0153] The adjustment module is configured as follows:

[0154] Adjusting the first stereo signal based on the third gain value; and / or

[0155] adjusting the second stereo signal based on the fourth gain value;

[0156] The third gain value is negatively correlated with the signal value of the first stereo signal, and the fourth gain value is negatively correlated with the signal value of the second stereo signal.

[0157] In some embodiments, the apparatus further comprises:

[0158] The output module is configured to output the adjusted first stereo signal through the left channel and output the adjusted second stereo signal through the right channel.

[0159] In some embodiments, the apparatus further comprises:

[0160] A display module, configured to display touch controls through an application interface of the application during the running of the application;

[0161] The starting module is configured to start the adaptive orientation enhancement function when a trigger operation for the touch control is detected, and collect the first stereo signal output through the left channel and the second stereo signal output through the right channel.

[0162] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0163] Figure 4 8 is a hardware structure block diagram of an electronic device 800 according to an exemplary embodiment. For example, the device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, a wearable device, etc.

[0164] Reference Figure 4 , device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0165] The processing component 802 generally controls the overall operation of the device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0166] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0167] The power supply component 806 provides power to the various components of the device 800. The power supply component 806 can include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 800.

[0168] The multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0169] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the device 800 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0170] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0171] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the device 800, and the sensor assembly 814 can also detect the position change of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration / deceleration of the device 800, and the temperature change of the device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0172] The communication component 816 is configured to facilitate wired or wireless communication between the device 800 and other devices. The device 800 can access a wireless network based on a communication standard, such as Wi-Fi, 4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0173] In an exemplary embodiment, the device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0174] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, which can be executed by a processor 820 of the device 800 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0175] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to perform an audio processing method, the method comprising:

[0176] During the running of the application, a first stereo signal output through a left channel and a second stereo signal output through a right channel are collected;

[0177] determining a degree of difference between the first stereo signal and the second stereo signal;

[0178] When the difference is greater than a preset difference threshold, the first stereo signal and / or the second stereo signal is adjusted, wherein the preset difference threshold is used to determine whether there is an azimuth difference between the signals output from the left and right channels.

[0179] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0180] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An audio processing method, characterized in that, it includes: During the running of the application, collect the first stereo signal output through the left channel and the second stereo signal output through the right channel; Determine the difference degree between the first stereo signal and the second stereo signal; When the difference degree is greater than a preset difference threshold, adjust the first stereo signal and / or the second stereo signal, where the preset difference threshold is used to judge whether there is an azimuth difference between the signals output by the left and right channels.

2. The method according to claim 1, characterized in that, The determining the difference degree between the first stereo signal and the second stereo signal includes: Identify the first sound segments of the first stereo signal in each frequency band range of the octave, and determine the energy parameters of each of the first sound segments; Identify the second sound segments of the first stereo signal in each of the frequency band ranges of the octave, and determine the energy parameters of each of the second sound segments; Based on the energy parameters of each of the first sound segments and the energy parameters of each of the second sound segments, determine the difference degree.

3. The method according to claim 2, characterized in that, The based on the energy parameters of each of the first sound segments and the energy parameters of each of the second sound segments to determine the difference degree includes: Respectively based on the difference between the energy parameter of the first sound segment and the energy parameter of the second sound segment in the same frequency band range, obtain the energy difference corresponding to each frequency band range; Based on each of the energy differences, determine the difference degree.

4. The method according to claim 3, characterized in that, The method further includes: Respectively based on each of the energy differences, determine the first gain value of the first sound segment corresponding to the energy difference, and the second gain value of the second sound segment corresponding to the energy difference; The adjusting the first stereo signal and / or the second stereo signal includes: Adjust the corresponding first sound segment based on the first gain value; and / or Adjust the corresponding second sound segment based on the second gain value; wherein, both the first gain value and the second gain value are negatively correlated with the energy difference.

5. The method according to claim 1, characterized in that, The method further includes: Determine the third gain value based on the signal value of the first stereo signal, and determine the fourth gain value based on the signal value of the second stereo signal; The adjusting the first stereo signal and / or the second stereo signal includes: Adjust the first stereo signal based on the third gain value; and / or Adjust the second stereo signal based on the fourth gain value; wherein, the third gain value is negatively correlated with the signal value of the first stereo signal, and the fourth gain value is negatively correlated with the signal value of the second stereo signal.

6. The method according to any one of claims 1 to 5, characterized in that, The method further includes: Output the adjusted first stereo signal through the left channel and output the adjusted second stereo signal through the right channel.

7. The method according to any one of claims 1 to 5, wherein, the method further includes: During the running of the application, display a touch control through the application interface of the application; When a trigger operation on the touch control is detected, enable the adaptive azimuth enhancement function and collect the first stereo signal output through the left channel and the second stereo signal output through the right channel.

8. An audio processing device, wherein, comprising: A collection module configured to collect the first stereo signal output through the left channel and the second stereo signal output through the right channel during the running of the application; A first determination module configured to determine the degree of difference between the first stereo signal and the second stereo signal; An adjustment module configured to adjust the first stereo signal and / or the second stereo signal when the degree of difference is greater than a preset difference threshold, wherein the preset difference threshold is used to determine whether there is an azimuth difference between the signals output by the left and right channels.

9. An electronic device, wherein, comprising: A processor; A memory configured to store processor-executable instructions; wherein, the processor is configured to: when executed, implement the steps in any one of the above audio processing methods of claims 1 to 7.

10. A non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by the processor of the electronic device, enable the electronic device to execute any one of the above audio processing methods of claims 1 to 7.

Images