Audio processing method and device, electronic equipment and readable storage medium

Abstract

The invention provides an audio processing method and device, electronic equipment and a readable storage medium, and belongs to the field of audio processing, and the method comprises the steps: determining a target bone conduction participation coefficient and a target air conduction participation coefficient based on the frequency characteristics of a target audio; adjusting the target bone conduction participation coefficient and the target air conduction participation coefficient based on the preference information of the target person to obtain a first audio output strategy; determining a first noise reduction strategy based on the noise characteristics of the external environment; and controlling the audio output of the target device based on the first audio output strategy and the first noise reduction strategy. According to the audio processing method and device, the electronic equipment and the readable storage medium provided by the invention, the accuracy and reliability of audio processing can be improved.

Description

Technical Field

[0001] The present disclosure belongs to the field of audio processing, and more specifically, relates to an audio processing method and device, an electronic device, and a readable storage medium. Background Art

[0002] With the continuous advancement of science and technology, audio processing technology has been widely used in various fields. From the early simple sound recording and playback to today's complex audio signal processing, noise reduction, enhancement and other technologies, audio processing technology continues to develop and improve.

[0003] Nowadays, there are roughly two ways for headphones to transmit sound, namely bone conduction and air conduction. Bone conduction and air conduction are key technologies in the field of audio processing. Air conduction transmits sound through the air medium and transmits it to the inner ear through structures such as the external auditory canal, eardrum, and auditory bones. It is widely used in headphones, speakers and other devices and can provide clear and rich sound signals. Bone conduction transmits sound directly to the inner ear through skull vibrations. Bone conduction headphones and other devices have unique advantages in special scenarios such as sports and medical treatment. Sound can be heard without blocking the ears while reducing external noise interference.

[0004] However, today, it is not possible to balance the two conduction methods well, and the accuracy and reliability of audio processing are low. Summary of the invention

[0005] The purpose of the present disclosure is to provide an audio processing method and device, an electronic device, and a readable storage medium to improve the accuracy and reliability of audio processing.

[0006] According to a first aspect of the present disclosure, there is provided an audio processing method, including: Determine a target bone conduction participation coefficient and a target air conduction participation coefficient based on the frequency characteristics of the target audio; Adjusting the target bone conduction participation coefficient and the target air conduction participation coefficient based on the preference information of the target person to obtain a first audio output strategy; Determining a first noise reduction strategy based on noise characteristics of the external environment; The audio output of the target device is controlled based on the first audio output policy and the first noise reduction policy.

[0007] According to a second aspect of the present disclosure, there is provided an audio processing device, including: A coefficient determination module, used to determine a target bone conduction participation coefficient and a target air conduction participation coefficient based on the frequency characteristics of the target audio; A strategy adjustment module, used to adjust the target bone conduction participation coefficient and the target air conduction participation coefficient based on the preference information of the target person, to obtain a first audio output strategy; A noise reduction strategy module, used to determine a first noise reduction strategy based on noise characteristics of an external environment; The audio control module is used to control the audio output of the target device based on the first audio output strategy and the first noise reduction strategy.

[0008] According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, including a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor implements the steps of the above-mentioned audio processing method when executing the computer program.

[0009] According to a fourth aspect of the embodiments of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned audio processing method are implemented.

[0010] The audio processing method and device, electronic device, and readable storage medium provided by the embodiments of the present disclosure have the following beneficial effects: The present disclosure determines the target bone conduction participation coefficient and the target air conduction participation coefficient through the frequency characteristics of the target audio, ensuring that the audio processing can be optimized for specific audio content, so that the audio output is more in line with the characteristics of the audio itself. The present disclosure can obtain a personalized audio output strategy by adjusting the participation coefficient based on the preference information of the target person. Each user can customize the audio output according to their own auditory preferences, thereby obtaining a hearing experience that is more in line with their personal tastes. The present disclosure dynamically adjusts the noise reduction strategy so that users can enjoy clear, high-quality audio content in different environments, improves the practicality and user experience of audio output, optimizes and balances bone conduction and air conduction, and improves the accuracy and reliability of audio processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0012] Figure 1 A flowchart of an audio processing method provided by an embodiment of the present disclosure; Figure 2 A structural block diagram of an audio processing device provided by an embodiment of the present disclosure; Figure 3 A schematic block diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0013] In the following description, specific details such as specific system structures and technologies are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present disclosure. However, it should be clear to those skilled in the art that the present disclosure may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obstructing the description of the present disclosure with unnecessary details.

[0014] In order to make the purpose, technical solutions and advantages of the present disclosure more clear, specific embodiments will be described below in conjunction with the accompanying drawings.

[0015] Before the specific introduction, the possible application scenarios of the present disclosure are first clarified. The present disclosure can be applied to earphone devices, smart audio devices, smart glasses with voice playback function, virtual reality and augmented reality devices and other devices. The key point is that it has the functions of bone conduction and air conduction at the same time. It should be noted that the above explanation is not a limitation, but is for a better understanding of the present case.

[0016] Please refer to Figure 1 , Figure 1 A flowchart of an audio processing method provided by an embodiment of the present disclosure is provided, and the method includes: S101: Determine a target bone conduction participation coefficient and a target air conduction participation coefficient based on the frequency characteristics of the target audio.

[0017] In this embodiment, the target audio refers to an audio file that needs to be processed and output, which may be a piece of music, a video, or a voice message.

[0018] Frequency characteristics are the characteristics of audio signals in the frequency domain. Audio is composed of sound waves of different frequencies, and frequency characteristics include the distribution of low frequency, medium frequency and high frequency parts. Frequency characteristics can be obtained through fast Fourier transform, short-time Fourier transform or some dedicated audio editing software.

[0019] The target bone conduction participation coefficient is a value used to measure the degree of bone conduction's participation in the audio output process. The larger the coefficient, the greater the proportion of bone conduction in the audio output, that is, the more bone conduction is relied upon to transmit audio signals.

[0020] The target air conduction participation coefficient corresponds to the target bone conduction participation coefficient and is used to measure the degree of participation of air conduction in the audio output process. For example, when the air conduction participation coefficient is high, it means that the audio output is mainly carried out through air conduction.

[0021] The participation coefficient refers to the proportion or relative contribution of bone conduction or air conduction in the audio output process. It is a value between 0 and 1 that is used to quantify the role of each conduction method in the final audio output. For example, a bone conduction participation coefficient of 0.6 means that when the audio is output, 60% of the audio signal is transmitted to the user through bone conduction, and the remaining 40% is transmitted through air conduction.

[0022] In this embodiment, the natural characteristics of bone conduction and air conduction are taken into account, and bone conduction has a natural advantage in the conduction of low-frequency sounds. This is because the wavelength of low-frequency sounds is longer, and the skull can produce relatively effective vibrations under the action of low-frequency sounds, and this vibration is easily perceived by the inner ear. For example, in music parts like heavy bass rhythms, bone conduction can allow users to feel the vibrations and rhythm of the sound more directly, as if the body can also follow the beat. Air conduction performs well in processing intermediate and high-frequency sounds. For intermediate frequency parts, such as human voices and the fundamental tones of most musical instruments, air conduction can restore the details and timbre of the sound very well. In the high-frequency part, like the overtones of musical instruments and some subtle environmental sound effects, air conduction can accurately transmit these sounds, making the sound clearer and brighter.

[0023] The low frequency band may be a frequency range of 20 Hz-200 Hz, the middle frequency band may be a frequency range of 200 Hz-2000 Hz, and the high frequency band may be a frequency range of 2000 Hz-20000 Hz.

[0024] Therefore, in this embodiment, the participation coefficients of bone conduction and air conduction can be adjusted in real time according to the frequency characteristics of the target audio, or the overall frequency distribution of the audio can be analyzed. If the ratio of the audio time in a certain frequency band to the total time is greater than a certain value, the audio can be played with a fixed participation coefficient to prevent the user from feeling uncomfortable.

[0025] Specifically, in response to the frequency characteristic of the target audio satisfying that a ratio of a duration of the first frequency band to a total duration of the target audio is greater than or equal to a first duration threshold, determining a bone conduction participation coefficient and an air conduction participation coefficient based on the first frequency band; In response to the frequency characteristic of the target audio satisfying that the ratio of the duration of the second frequency band to the total duration of the target audio is greater than or equal to a second duration threshold, the bone conduction participation coefficient and the air conduction participation coefficient are determined based on the second frequency band.

[0026] The first frequency band can be a low frequency band, and the second frequency band can be a mid-frequency band and a high frequency band, taking into account the importance of different frequency bands in the audio experience and the different degrees of user perception of them. For example, low-frequency sounds usually have a greater impact on the overall sense of atmosphere and rhythm, and users may be able to perceive its existence and changes when the duration of low-frequency audio accounts for a small proportion. The mid- and high-frequency parts mainly involve the details and clarity of the sound, and their duration may need to reach a certain proportion before users can clearly perceive its contribution to the audio quality. Therefore, the first duration threshold can be smaller than the second duration threshold, and the first duration threshold and the second duration threshold can be determined according to actual conditions, or they can vary according to the type of audio applied or the device applied.

[0027] For example, in response to the audio processing method being applied to an ambience device, the first duration threshold is lowered according to the first ambience step length, and the second duration threshold is increased according to the second ambience step length; In response to the audio processing method being applied to daily equipment, the first duration threshold is increased according to a first daily step length, and the second duration threshold is decreased according to the first daily step length.

[0028] Atmosphere devices refer to devices whose main goal is to create atmosphere, such as virtual reality devices, augmented reality devices, or augmented display, mixed reality and other devices. In these devices, low frequencies are very important for creating an immersive environment. The first duration threshold can be set lower, while mid- and high-frequency frequencies are mainly used for detail prompts. The second duration threshold can be set higher. This can give priority to ensuring the creation of atmosphere by low frequencies, while enhancing details when mid- and high-frequency content is sufficient. The first duration threshold and the second duration threshold can be adjusted by the first atmosphere step.

[0029] Everyday devices can be sports headphones, smart glasses with voice playback function, etc. For these devices, more attention should be paid to the audio in daily life, such as the details of the conversation, the clarity of the human voice, etc., so more attention should be paid to the sound of the mid-high frequency band. The first duration threshold can be set higher and the second duration threshold can be set lower. The first duration threshold and the second duration threshold can be adjusted through the first daily step. Both the first atmosphere step and the first daily step can be determined based on experiments.

[0030] After determining the duration proportion of the first frequency band and / or the second frequency band, if the corresponding threshold is met, the corresponding bone conduction participation coefficient and air conduction participation coefficient can be determined according to the energy proportion of the first frequency band and / or the second frequency band. The energy proportion of the first frequency band can be calculated by the spectrum analysis formula, the bone conduction coefficient can be calculated according to the first formula, and the air conduction coefficient can be calculated by the second formula.

[0031] The first formula can be: , the second formula can be: ,in , represents the bone conduction participation coefficient, represents the air conduction participation coefficient, Indicates the energy proportion of the first frequency band (second frequency band), represents the energy of the first frequency band (or the second frequency band), It represents the total energy of the target audio, which can be obtained by spectrum analysis of the target audio. is the advantage adjustment coefficient, the value range can be 0-1, and can be determined based on experiments.

[0032] If the frequency characteristics of the target audio satisfy that the ratio of the duration of the first frequency band to the total duration of the target audio is greater than or equal to the first duration threshold, and also satisfy that the ratio of the duration of the second frequency band to the total duration of the target audio is greater than or equal to the second duration threshold, then no adjustment is required and the audio can be played using the bone conduction participation coefficient and air conduction participation coefficient that have been set in advance.

[0033] S102: Adjust the target bone conduction participation coefficient and the target air conduction participation coefficient based on the preference information of the target person to obtain a first audio output strategy.

[0034] In this embodiment, the target bone conduction participation coefficient and the target air conduction participation coefficient are adjusted based on the preference information of the target person to obtain the first audio output strategy, including: determining a target preference adjustment strategy from a plurality of standard preference adjustment strategies based on the preference information of the target person; The target bone conduction participation coefficient and the target air conduction participation coefficient are adjusted based on the target preference adjustment strategy to obtain a first audio output strategy.

[0035] In this embodiment, the target person refers to a user who uses an audio device. The preference information is data related to the target person's preference for audio features. For example, if the target person likes music with a strong bass effect, or prefers clear and bright high notes, or likes a certain music style (such as classical, rock), these preferences will be reflected in the expectation of the degree of participation in bone conduction and air conduction.

[0036] The standard preference adjustment strategy is a series of pre-set rule sets. Each rule set corresponds to a common user preference type and specifies how to adjust the bone conduction participation coefficient and the air conduction participation coefficient to optimize the audio output according to different preferences.

[0037] The target preference adjustment strategy is a strategy that is selected from multiple standard preference adjustment strategies based on the specific preference information of the target person and is the strategy that best suits the preferences of the person.

[0038] The first audio output strategy is a combination strategy of bone conduction participation coefficient and air conduction participation coefficient that is finally determined after comprehensively considering the target audio frequency characteristics and the target person's preference information, so as to control the audio device to output audio that meets user needs.

[0039] For example, user Xiao Li uses a pair of smart glasses with bone conduction and air conduction functions and audio playback function to listen to music. Xiao Li sets the "heavy bass enhancement" mode in the accompanying APP, which is Xiao Li's preference information. This information shows that Xiao Li prefers strong low-frequency rhythms and hopes to highlight the heavy bass effect when listening to music. There are multiple standard preference adjustment strategies in the headphone system, such as "heavy bass enhancement", "treble clarity", "balanced sound effects", etc. Based on the preference information of "heavy bass enhancement" selected by Xiao Li, the system determines the strategy corresponding to "heavy bass enhancement" from these standard strategies as the target preference adjustment strategy. This strategy pre-sets the rules for adjusting the bone conduction and air conduction participation coefficients for the needs of heavy bass enhancement, such as increasing the bone conduction participation coefficient to enhance the low-frequency conduction effect, because bone conduction has advantages in low frequencies. Assume that the target bone conduction participation coefficient preliminarily determined based on the audio frequency characteristics is 0.4, and the target air conduction participation coefficient is 0.6. According to the target preference adjustment strategy of "heavy bass enhancement", the bone conduction participation coefficient increases to 0.7, and the air conduction participation coefficient decreases to 0.3 accordingly. In this way, the first audio output strategy is obtained, that is, the audio is output according to the ratio of 0.7 for the bone conduction participation coefficient and 0.3 for the air conduction participation coefficient. When playing music, the headphones will transmit more low-frequency sounds through bone conduction according to this strategy, allowing Xiao Li to feel a stronger heavy bass effect and meet his preferences.

[0040] The target preference adjustment strategy can be determined from a plurality of standard preference feature strategies through a preset mapping table, as shown in Table 1.

[0041] Table 1 Preference information mapping table (partial)

[0042] It should be noted that Table 1 is only a part of the table, and it also contains other target preference adjustment strategies corresponding to preference information. Each target preference adjustment strategy in Table 1 is essentially a standard preference adjustment strategy, and the target preference adjustment strategy refers to the adjustment strategy that best suits the current preference information.

[0043] In this embodiment, the bone conduction participation coefficient and the air conduction participation coefficient can also be adjusted according to the activity state of the target person, considering that when the user (target person) is in motion, the shaking of the body and the changes in the surrounding environment (such as wind sound) will affect the audio reception. Bone conduction is more advantageous in this case because it is not affected by wind noise and slight changes in the position of the earphone due to movement like air conduction. If the user is detected to be in motion, the bone conduction participation coefficient can be adjusted according to the intensity of the exercise.

[0044] For example, in response to the target user being in a motion state, the bone conduction participation coefficient is increased according to the first motion step length, and the air conduction participation degree is reduced according to the first motion step length.

[0045] In this embodiment, whether the target user is in motion can be obtained by an acceleration sensor or a gyroscope sensor installed in a device such as smart glasses or headphones that applies this method. When the target person is monitored to be in motion, for example, it can be determined by monitoring whether the acceleration exceeds the first acceleration threshold for more than a first number of times within a third time period. If it exceeds, it proves that the target user is in motion, otherwise, it is not in motion. The third time period, the first acceleration threshold and the first number can be set based on experience. The first motion step length can be set based on experience or determined based on the value of acceleration. According to a pre-set formula, the greater the amplitude of the motion, the greater the first motion step length. The pre-set formula can be: , represents the first motion step length, Represents the proportionality coefficient, which is used to adjust the influence of the mean and standard deviation on the step size and can be calibrated through experiments. is the basic step length value, ensuring that there is a minimum step length even when the acceleration is relatively stable, which can be determined based on experiments. The acceleration data sequence collected by the acceleration sensor is (In the third time period), calculate the average value of the acceleration in the third time period and standard deviation ,in, , , Indicates acceleration value.

[0046] S103: Determine a first noise reduction strategy based on noise characteristics of the external environment.

[0047] In this embodiment, determining the first noise reduction strategy based on the noise characteristics of the external environment includes: Determining a noise characteristic of the external environment based on a first noise characteristic of the external environment and a second noise characteristic of the external environment; Determine the air conduction frequency noise reduction strategy and the bone conduction frequency noise reduction strategy based on the frequency characteristics in the noise characteristics; In response to an intensity feature in the noise feature satisfying a first intensity condition, determining an air conduction intensity noise reduction strategy and a bone conduction intensity noise reduction strategy based on the intensity feature; Determine a first noise reduction strategy based on an air conduction frequency noise reduction strategy, a bone conduction frequency noise reduction strategy, an air conduction intensity noise reduction strategy, and a bone conduction intensity noise reduction strategy; The first noise characteristic is obtained by monitoring a bone conduction device in the target device, and the second noise characteristic is obtained by monitoring an air conduction device in the target device.

[0048] In this embodiment, the noise characteristics of the external environment refer to the characteristics presented by the noise in the external environment, including information such as the frequency distribution and intensity of the noise. These characteristics are used to determine an appropriate noise reduction strategy to minimize the interference of noise on the target audio.

[0049] The first noise feature is information about external noise monitored by the bone conduction device in the target device. For example, the bone conduction device may monitor the vibration characteristics of the low-frequency part of the noise, but the accuracy of monitoring the sound of the medium and high frequencies is low. The first noise feature may include a first noise intensity and a first noise frequency.

[0050] The second noise feature is the external noise information acquired through monitoring by the air conduction device in the target device. The air conduction device's perception of noise focuses on the sound characteristics transmitted through the air, such as the details of high-frequency noise. It is another important part of the comprehensive noise feature analysis. The second noise feature may include a second noise intensity and a second noise frequency.

[0051] The air conduction frequency noise reduction strategy is a noise reduction strategy specially developed for the air conduction method based on the frequency information in the noise characteristics. It aims to specifically reduce the interference of specific frequency noise in the air conduction process to improve the clarity of the audio.

[0052] The bone conduction frequency noise reduction strategy is a noise reduction strategy designed for the bone conduction method based on the noise frequency characteristics. Its purpose is to suppress the specific frequency noise transmitted through the bone conduction pathway and optimize the audio output effect through bone conduction.

[0053] Intensity characteristic, an important parameter in noise characteristics, is used to describe the intensity of noise and is usually measured in units such as decibels (dB).

[0054] The first intensity condition is a pre-set noise intensity standard. When the intensity characteristics of the noise reach this standard, it will trigger a further noise reduction strategy determination process based on the intensity characteristics. The first intensity condition can be that the intensity of the external noise is greater than the first intensity threshold. The first intensity threshold can be set based on experience. When it exceeds this threshold, it proves that the external environment is too noisy and the volume of the audio output needs to be increased.

[0055] Air conduction intensity noise reduction strategy: when the noise intensity characteristic meets the first intensity condition, a noise reduction strategy is formulated for the air conduction mode based on the intensity information, focusing on processing the impact of high-intensity noise on air conduction audio.

[0056] Bone conduction intensity noise reduction strategy: When the noise intensity meets the first intensity condition, a noise reduction strategy developed for the bone conduction method is used to reduce the interference of high-intensity noise on the audio through bone conduction.

[0057] The first noise reduction strategy is the final noise reduction strategy formed by integrating air conduction frequency noise reduction strategy, bone conduction frequency noise reduction strategy, air conduction intensity noise reduction strategy and bone conduction intensity noise reduction strategy. This strategy comprehensively considers the frequency and intensity characteristics of noise under different conduction modes to achieve the best noise reduction effect.

[0058] In this embodiment, the first noise feature includes the first noise intensity and the first noise frequency, and the second noise feature includes the second noise intensity and the second noise frequency. Since the first noise feature is obtained by monitoring the bone conduction device, the monitoring of the intensity and frequency of low-frequency noise is more accurate, so the monitoring of low-frequency noise is more valuable for reference. Similarly, for the intensity and frequency of medium and high-frequency noise, the second noise feature is more valuable for reference.

[0059] Therefore, different weights can be set in the process of determining the noise characteristics of the external environment, and the weights can also be adjusted according to the audio being played and other influencing factors.

[0060] For example, the weights corresponding to the first noise feature and the second noise feature may be predetermined, and the noise features of the external environment may be obtained through weighted calculation. Similarly, the noise features of the external environment also include noise intensity and noise frequency.

[0061] The specific weight adjustment strategy is shown below. At present, the noise characteristics of the external environment are known, that is, the noise intensity and noise frequency are known. The air conduction noise reduction strategy and the bone conduction noise reduction strategy can be determined based on the frequency characteristics in the noise characteristics. The air conduction noise reduction strategy and the bone conduction noise reduction strategy can be based on the recursive least squares (RLS) method for active noise reduction. There is a key parameter in the RLS algorithm, namely the forgetting factor Here we briefly introduce the basic formula of the RLS algorithm and the principle of active noise reduction.

[0062] set up For the The filter coefficient vector at time , For the The input signal vector at time t (in active noise reduction, it is the signal vector containing noise information), For the The estimated error at time t (the error between the filter output and the expected signal), is the forgetting factor ( ), For the The inverse of the covariance matrix at time instant .

[0063] The filter coefficient update formula is: ,in is the Kalman gain vector, calculated as ,in for The conjugate transpose of .

[0064] Covariance matrix update formula:

[0065] Error calculation formula: For the The desired signal at time (in active noise reduction, it is the inversion of the noise signal), the filter output ,error . for The conjugate transpose of .

[0066] In the initial stage of active noise reduction, The initial filter coefficients can be set based on prior knowledge or a simple initialization method. The input signal vector Contains the noise signal detected by the microphone of the bone conduction or air conduction device. According to the above formula, the Kalman gain vector is calculated , which is used to measure the importance of the new input signal to the filter coefficient update. Then, through the error (by the expected anti-phase noise signal And the actual output of the filter Calculated) to update the filter coefficients In this way, the filter can continuously adjust its coefficients according to the new noise signal and the desired anti-phase signal to generate a more accurate anti-phase cancellation signal.

[0067] Covariance matrix The update of plays a key role in the entire algorithm. It reflects the uncertainty of the filter coefficients. At the beginning of active noise reduction, It can be initialized based on a preliminary estimate or empirical value of the noise signal. Over time, by updating the formula, According to the new input signal and the forgetting factor Make adjustments. Forgetting Factor The role of is to weigh the importance of past data and current data. When it is close to 1, the algorithm relies more on past data and is suitable for situations where the noise changes slowly (such as low-frequency noise in bone conduction); When the noise is small (such as high-frequency noise in air conduction), the algorithm pays more attention to the current data and can adapt to the changes in noise more quickly. The update of the covariance matrix affects the calculation of the Kalman gain vector, which in turn affects the update of the filter coefficients, allowing the algorithm to adaptively adjust the generation of the anti-phase cancellation signal according to the dynamic characteristics of the noise.

[0068] For example, in response to the frequency feature in the noise feature satisfying the second low-frequency condition, increasing the forgetting factor in the bone conduction noise reduction strategy according to the first forgetting step length; In response to the frequency feature in the noise feature satisfying the second high frequency condition, the forgetting factor in the air conduction noise reduction strategy is reduced according to the second forgetting step size.

[0069] In this embodiment, the second low-frequency condition may be a frequency in the range of 20-200 Hz, or may be determined according to actual conditions. The second high-frequency condition may be a frequency in the range of 2000-20000 Hz, or may be determined according to actual conditions. The first forgetting step length and the second forgetting step length may be set based on experience.

[0070] When using the RLS algorithm, due to the relative stability of bone conduction noise, the forgetting factor can be set appropriately higher, which allows the algorithm to pay more attention to past data and better use historical information to generate accurate anti-phase signals to cope with slow changes in low-frequency noise. Due to the dynamics of air conduction noise, the forgetting factor can be appropriately reduced. This allows the algorithm to update the filter coefficients faster and better track the rapid changes in high-frequency noise. The air conduction frequency noise reduction strategy and the bone conduction frequency noise reduction strategy are determined by adjusting the forgetting factor.

[0071] Secondly, when the intensity feature in the noise feature meets the first intensity condition, the air conduction intensity noise reduction strategy and the bone conduction intensity noise reduction strategy can be determined based on the intensity feature. The first intensity condition can be that the intensity of the external noise is greater than the first intensity threshold. The first intensity threshold can be set based on experience. When this threshold is exceeded, it proves that the external environment is too noisy and the volume of the audio output needs to be increased.

[0072] Specifically, in response to the intensity feature in the noise feature satisfying the first intensity condition, determining the air conduction intensity noise reduction strategy and the bone conduction intensity noise reduction strategy based on the intensity feature, including: In response to an intensity feature in the noise feature satisfying a first intensity condition, determining an air conduction intensity noise reduction strategy based on the intensity feature and an air conduction intensity noise reduction formula; And, determining the bone conduction intensity noise reduction strategy based on the intensity characteristics and the bone conduction intensity noise reduction formula.

[0073] The air conduction intensity noise reduction strategy can be reflected in the sound volume. The air conduction intensity noise reduction formula can be , where the external noise intensity is , the first intensity threshold is , the initial volume of the air conduction audio is , is the volume adjustment coefficient, which indicates the volume increase for every 1dB exceeding the threshold. It can be set based on experiments and user experience. For example (It means that the volume increases by 0.5dB for every 1dB above the threshold.) At the same time, to ensure that the volume does not exceed the maximum volume of the device , you also need to add restrictions: .

[0074] The bone conduction strength noise reduction strategy can be reflected in the vibration intensity. The bone conduction strength noise reduction formula can be , the initial vibration intensity of bone conduction is (can be a dimensionless parameter, indicating the relative vibration intensity), the adjusted bone conduction vibration intensity is , the bone conduction vibration intensity adjustment coefficient is (For example , indicating that the vibration intensity increases by 3% for every 3dB above the threshold). At the same time, in order to prevent excessive vibration intensity from causing discomfort to the user, the upper limit of the vibration intensity is set to ,but .

[0075] In summary, we can obtain the air conduction frequency noise reduction strategy, bone conduction frequency noise reduction strategy, air conduction intensity noise reduction strategy and bone conduction intensity noise reduction strategy. The above four strategies are used as the first noise reduction strategy for noise reduction.

[0076] S104: Controlling the audio output of the target device based on the first audio output strategy and the first noise reduction strategy.

[0077] In this embodiment, the first audio output strategy is a strategy for how to allocate the proportion of bone conduction and air conduction in the audio output after adjusting the target bone conduction participation coefficient and the target air conduction participation coefficient preliminarily determined based on the audio frequency characteristics according to the preference information of the target person. It is intended to meet the user's personalized needs for audio listening. For example, for users who like heavy bass, this strategy can increase the bone conduction participation coefficient to highlight the low-frequency effect.

[0078] The first noise reduction strategy is a collection of noise reduction measures based on the noise characteristics of the external environment. These noise characteristics include the frequency characteristics and intensity characteristics of the noise monitored by the bone conduction device and the air conduction device. Based on these characteristics, the air conduction frequency noise reduction strategy, the bone conduction frequency noise reduction strategy, the air conduction intensity noise reduction strategy and the bone conduction intensity noise reduction strategy are determined respectively, and the combination forms the first noise reduction strategy, the purpose of which is to reduce the interference of external noise on the audio output.

[0079] Target device: refers to a device that has bone conduction and air conduction functions and can control audio output according to corresponding strategies, such as headphones, smart glasses with audio functions, etc.

[0080] Audio output refers to the process by which the target device ultimately plays sound to the user, including the volume, sound quality, the proportion of sound transmitted through bone conduction and air conduction, and the sound effect after noise reduction.

[0081] From the above, it can be concluded that the present disclosure determines the target bone conduction participation coefficient and the target air conduction participation coefficient through the frequency characteristics of the target audio, ensuring that the audio processing can be optimized for specific audio content, so that the audio output is more in line with the characteristics of the audio itself. The present disclosure adjusts the participation coefficient based on the preference information of the target person to obtain a personalized audio output strategy. Each user can customize the audio output according to their own auditory preferences, thereby obtaining a listening experience that is more in line with their personal tastes. The present disclosure dynamically adjusts the noise reduction strategy so that users can enjoy clear, high-quality audio content in different environments, improves the practicality of audio output and user experience, optimizes and balances bone conduction and air conduction, and improves the accuracy and reliability of audio processing.

[0082] In one embodiment of the present disclosure, determining a target bone conduction participation coefficient and a target air conduction participation coefficient based on the frequency characteristics of the target audio includes: Selecting a target audio output strategy from a plurality of standard audio output strategies based on the frequency characteristics of the target audio; the target audio output strategy includes a target bone conduction participation coefficient and a target air conduction participation coefficient; the standard audio output strategy includes a standard bone conduction participation coefficient and a standard air conduction participation coefficient; The process of determining a standard audio output strategy includes: In response to the frequency characteristics of the standard audio satisfying the low-frequency condition, increasing the reference value of the bone conduction participation coefficient based on the first low-frequency step length to obtain a standard bone conduction participation coefficient; and, reducing the reference value of the air conduction participation coefficient based on the first low-frequency step length to obtain a standard air conduction participation coefficient; In response to the frequency characteristics of the standard audio satisfying the intermediate frequency condition, reducing the reference value of the bone conduction participation coefficient based on the first intermediate frequency step to obtain a standard bone conduction participation coefficient; and, increasing the reference value of the air conduction participation coefficient based on the first intermediate frequency step length to obtain a standard air conduction participation coefficient; In response to the frequency characteristics of the standard audio satisfying the high frequency condition, reducing the reference value of the bone conduction participation coefficient based on the first high frequency step to obtain a standard bone conduction participation coefficient; And, based on the first high-frequency step, the reference value of the air conduction participation coefficient is increased to obtain a standard air conduction participation coefficient.

[0083] In this embodiment, the reference value of the bone conduction participation coefficient and the reference value of the air conduction participation coefficient can be determined based on experience. By calculating the matching degree between the frequency characteristics of the target audio and multiple standard audios, the standard audio output strategy corresponding to the standard audio with the highest matching degree can be used as the target audio output strategy, where the target audio output strategy includes: target bone conduction participation coefficient and target air conduction participation coefficient. The matching degree can be calculated by calculating cosine similarity or calculating Euclidean distance.

[0084] Bone conduction has a natural advantage in low-frequency sound conduction. This is because low-frequency sound has a longer wavelength and is more easily transmitted through solid media such as the skull. Therefore, when the audio presents low-frequency characteristics, such as in heavy bass music or audio content containing a lot of low-frequency ambient sound effects, the adjustment principle is to tend to increase the bone conduction participation coefficient. This can fully utilize the advantages of bone conduction, allowing users to more strongly feel the shock and rhythm brought by low-frequency sounds.

[0085] Air conduction is better for transmitting mid-frequency and high-frequency sounds. The mid-frequency part includes the fundamental tones of most instruments and the main part of the human voice, while the high-frequency part provides the details and brightness of the sound, such as the overtones of instruments and subtle ambient sound effects. Therefore, when the audio meets the mid-frequency or high-frequency conditions, such as when playing audiobooks with clear human voices (mid-frequency) or classical music with rich high-frequency instrument sounds (high frequency), the adjustment principle is to increase the air conduction participation coefficient to better restore the sound details of these frequency bands and improve the clarity and richness of the audio.

[0086] The low frequency condition may be a frequency in the range of 20-200 Hz, or may be determined according to actual conditions. The medium frequency condition may be a frequency in the range of 200-2000 Hz, or may be determined according to actual conditions. The high frequency condition may be a frequency in the range of 2000-20000 Hz, or may be determined according to actual conditions.

[0087] Alternatively, the low-frequency condition may be that the proportion of low-frequency band energy to total audio energy exceeds a certain threshold, or the proportion of low-frequency band duration to total duration reaches a certain value; the medium-frequency condition may be that the proportion of medium-frequency band energy to total audio energy exceeds a certain threshold, or the proportion of medium-frequency band duration to total duration reaches a certain value; the high-frequency condition may be that the proportion of high-frequency band energy to total audio energy exceeds a certain threshold, or the proportion of high-frequency band duration to total duration reaches a certain value, and the judgment method is consistent with the above-mentioned judgment method.

[0088] The first low frequency step length, the first intermediate frequency step length and the first high frequency step length can be determined experimentally. The above processing is performed by using multiple standard audio frequencies, and the adjusted bone conduction participation coefficient can be used as the standard bone conduction participation coefficient, and the adjusted air conduction participation coefficient can be used as the standard air conduction participation coefficient.

[0089] From the above, it can be concluded that the present disclosure selects the most suitable target audio output strategy from multiple standard audio output strategies based on the frequency characteristics of the target audio, ensuring that the audio output can closely fit the characteristics of the audio content, bringing a more personalized auditory experience to the user. By adjusting the participation coefficients of bone conduction and air conduction, this embodiment can accurately control the propagation ratio of sound in the skull and in the air, thereby satisfying the user's preference for sounds in different frequency bands. The audio processing method in the embodiment of the present disclosure analyzes the frequency characteristics of the target audio and adjusts the participation coefficients of bone conduction and air conduction accordingly, thereby achieving personalization and environmental adaptability of the audio output, improving the user's auditory experience, and also bringing the user a more convenient and intelligent use experience, and improving the accuracy and reliability of audio processing.

[0090] In one embodiment of the present disclosure, determining a noise feature of an external environment based on a first noise feature of the external environment and a second noise feature of the external environment includes: Determine a first noise intensity feature and a first noise frequency feature based on the first noise feature, and determine a second noise intensity feature and a second noise frequency feature based on the second noise feature; Performing weighted calculation on the first noise intensity feature and the second noise intensity feature to obtain a noise intensity feature; Performing weighted calculation on the first noise frequency feature and the second noise frequency feature to obtain a noise frequency feature; The noise characteristics of the external environment are obtained based on the noise intensity characteristics and the noise frequency characteristics.

[0091] In one embodiment of the present disclosure, the audio processing method further includes: in response to the frequency characteristics of the target audio satisfying the first frequency condition, reducing the reference value of the first frequency weight based on the first frequency step to obtain the first frequency weight, and increasing the reference value of the second frequency weight based on the first frequency step to obtain the second frequency weight; A noise frequency feature is obtained based on the first frequency weight, the first noise frequency feature, the second frequency weight, and the second noise frequency feature.

[0092] In one embodiment of the present disclosure, the audio processing method further includes: In response to the second noise frequency feature satisfying the second frequency condition, reducing the reference value of the first frequency weight based on the second frequency step length to obtain the first frequency weight, and increasing the reference value of the second frequency weight based on the second frequency step length to obtain the second frequency weight; A noise frequency feature is obtained based on the first frequency weight, the first noise frequency feature, the second frequency weight, and the second noise frequency feature.

[0093] In this embodiment, the first noise feature monitored by the bone conduction monitoring device includes a first noise intensity feature and a first noise frequency feature, and the second noise feature monitored by the air conduction monitoring device includes a second noise intensity feature and a second noise frequency feature. Similarly, the noise feature of the external environment obtained by calculation includes a noise intensity feature and a noise frequency feature. The first noise intensity feature and the second noise intensity feature may be weighted to obtain the noise intensity feature; the first noise frequency feature and the second noise frequency feature may be weighted to obtain the noise frequency feature. The first frequency weight is a weight corresponding to the first noise frequency feature, and the second frequency weight is a weight corresponding to the second noise frequency feature. The reference value of the first frequency weight and the reference value of the second frequency weight can be determined based on experiments.

[0094] Considering that the audio being played, i.e. the target audio, is mainly composed of mid-high frequency content, in order to better protect the quality of mid-high frequency audio, more attention should be paid to the suppression of mid-high frequency noise by the air conduction part. At this time, the weight of the noise frequency characteristics monitored by the bone conduction device can be reduced, and the weight of the noise frequency monitored by the air conduction device can be increased. The bone conduction frequency noise reduction strategy and the air conduction frequency noise reduction strategy determined by the noise frequency of the external environment calculated by the above processing are more in line with reality and improve the listening experience.

[0095] The first frequency condition may be that the ratio of the duration of the intermediate frequency and high frequency segments to the total duration in the target audio reaches a first ratio. The first ratio may be determined based on experience. When the ratio of the duration of the intermediate frequency and high frequency segments to the total duration reaches the first ratio, it indicates that most of the frequencies of the target audio are intermediate frequency and high frequency. At this time, the reference value of the first frequency weight may be reduced according to the preset first frequency step, and the reference value of the second frequency weight may be increased according to the preset first frequency step. The second frequency condition may be that the ratio of the duration of the intermediate frequency and high frequency segments in the noise of the external environment to the total duration reaches a second ratio. The second ratio may be determined based on experience. When the ratio of the duration of the intermediate frequency and high frequency segments to the total duration reaches the second ratio, it indicates that most of the frequencies in the noise of the external environment are intermediate frequency and high frequency. At this time, the reference value of the first frequency weight may be reduced according to the preset second frequency step length, and the reference value of the second frequency weight may be increased according to the preset second frequency step length. Considering the dominance and sensitivity of air conduction in the mid-high frequencies, it is possible to determine whether the second frequency condition is met based on the frequency characteristics of the noise in the external environment monitored by the air conduction device. When calculating the noise frequency characteristics of the external environment, the frequency weight is adjusted according to the second noise frequency characteristics, which can make the noise suppression strategy more targeted. For example, when the second noise frequency characteristics meet the second frequency condition, by reducing the first frequency weight and increasing the second frequency weight, the audio processing system can focus more on the high-frequency noise suppression monitored by air conduction, which can optimize the entire noise suppression process and improve the quality of the audio output.

[0096] When the frequency characteristic of the target audio satisfies the first frequency condition and the frequency characteristic of the second noise satisfies the second frequency condition at the same time, the first frequency step and the second frequency step can be added to adjust the weight, that is, in response to the frequency characteristic of the target audio satisfying the first frequency condition and the second noise frequency characteristic satisfying the second frequency condition, the reference value of the first frequency weight is reduced based on the third frequency step to obtain the first frequency weight, and the reference value of the second frequency weight is increased based on the third frequency step to obtain the second frequency weight; A noise frequency feature is obtained based on the first frequency weight, the first noise frequency feature, the second frequency weight, and the second noise frequency feature.

[0097] The third frequency step is the sum of the first frequency step and the second frequency step.

[0098] From the above, it can be concluded that the present disclosure comprehensively considers the results of the two monitoring methods through weighted calculation, so that the evaluation of the noise characteristics of the external environment is more comprehensive and accurate. This embodiment can dynamically adjust the first frequency weight and the second frequency weight according to the frequency characteristics of the target audio. When the target audio is mainly composed of mid- and high-frequency content, by reducing the weight of the noise frequency characteristics of bone conduction monitoring and increasing the weight of the noise frequency of air conduction monitoring, the quality of mid- and high-frequency audio can be better protected and the listening experience can be optimized. By adjusting the frequency weight, this embodiment makes the audio processing system focus more on high-frequency noise suppression of air conduction monitoring, thereby improving the quality of audio output and improving the accuracy and reliability of audio processing.

[0099] Corresponding to the audio processing method of the above embodiment, Figure 2 This is a structural block diagram of an audio processing device provided by an embodiment of the present disclosure. For the convenience of explanation, only the parts related to the embodiment of the present disclosure are shown. Figure 2 The audio processing device 20 includes: a coefficient determination module 21, a strategy adjustment module 22, a noise reduction strategy module 23 and an audio control module 24.

[0100] The coefficient determination module 21 is used to determine the target bone conduction participation coefficient and the target air conduction participation coefficient based on the frequency characteristics of the target audio; A strategy adjustment module 22, configured to adjust a target bone conduction participation coefficient and a target air conduction participation coefficient based on the preference information of the target person, to obtain a first audio output strategy; A noise reduction strategy module 23, configured to determine a first noise reduction strategy based on noise characteristics of an external environment; The audio control module 24 is configured to control the audio output of the target device based on the first audio output strategy and the first noise reduction strategy.

[0101] In one embodiment of the present disclosure, the coefficient determination module 21 is specifically used to: select a target audio output strategy from a plurality of standard audio output strategies based on the frequency characteristics of the target audio; the target audio output strategy includes a target bone conduction participation coefficient and a target air conduction participation coefficient; the standard audio output strategy includes a standard bone conduction participation coefficient and a standard air conduction participation coefficient; The audio processing device 20 further includes: a standard audio output strategy determination module, a standard audio output strategy determination module, configured to increase a reference value of the bone conduction participation coefficient based on a first low-frequency step length in response to the frequency characteristic of the standard audio satisfying a low-frequency condition, so as to obtain a standard bone conduction participation coefficient; and, reducing the reference value of the air conduction participation coefficient based on the first low-frequency step length to obtain a standard air conduction participation coefficient; In response to the frequency characteristics of the standard audio satisfying the intermediate frequency condition, reducing the reference value of the bone conduction participation coefficient based on the first intermediate frequency step to obtain a standard bone conduction participation coefficient; and, increasing the reference value of the air conduction participation coefficient based on the first intermediate frequency step length to obtain a standard air conduction participation coefficient; In response to the frequency characteristics of the standard audio satisfying the high frequency condition, reducing the reference value of the bone conduction participation coefficient based on the first high frequency step to obtain a standard bone conduction participation coefficient; And, based on the first high-frequency step, the reference value of the air conduction participation coefficient is increased to obtain a standard air conduction participation coefficient.

[0102] In one embodiment of the present disclosure, the noise reduction strategy module 23 is specifically configured to determine the noise characteristic of the external environment based on the first noise characteristic of the external environment and the second noise characteristic of the external environment; Determine the air conduction frequency noise reduction strategy and the bone conduction frequency noise reduction strategy based on the frequency characteristics in the noise characteristics; In response to an intensity feature in the noise feature satisfying a first intensity condition, determining an air conduction intensity noise reduction strategy and a bone conduction intensity noise reduction strategy based on the intensity feature; Determine a first noise reduction strategy based on an air conduction frequency noise reduction strategy, a bone conduction frequency noise reduction strategy, an air conduction intensity noise reduction strategy, and a bone conduction intensity noise reduction strategy; The first noise characteristic is obtained by monitoring a bone conduction device in the target device, and the second noise characteristic is obtained by monitoring an air conduction device in the target device.

[0103] In one embodiment of the present disclosure, the noise reduction strategy module 23 is further configured to determine a first noise intensity feature and a first noise frequency feature based on the first noise feature, and determine a second noise intensity feature and a second noise frequency feature based on the second noise feature; Performing weighted calculation on the first noise intensity feature and the second noise intensity feature to obtain a noise intensity feature; Performing weighted calculation on the first noise frequency feature and the second noise frequency feature to obtain a noise frequency feature; The noise characteristics of the external environment are obtained based on the noise intensity characteristics and the noise frequency characteristics.

[0104] In one embodiment of the present disclosure, the audio processing device 20 further includes: a first weight adjustment module; A first weight adjustment module is configured to, in response to the frequency characteristic of the target audio satisfying the first frequency condition, reduce a reference value of the first frequency weight based on the first frequency step to obtain the first frequency weight, and increase a reference value of the second frequency weight based on the first frequency step to obtain the second frequency weight; A noise frequency feature is obtained based on the first frequency weight, the first noise frequency feature, the second frequency weight, and the second noise frequency feature.

[0105] In one embodiment of the present disclosure, the audio processing device 20 further includes: a second weight adjustment module; A second weight adjustment module is configured to, in response to the second noise frequency feature satisfying the second frequency condition, reduce the reference value of the first frequency weight based on the second frequency step length to obtain the first frequency weight, and increase the reference value of the second frequency weight based on the second frequency step length to obtain the second frequency weight; A noise frequency feature is obtained based on the first frequency weight, the first noise frequency feature, the second frequency weight, and the second noise frequency feature.

[0106] In one embodiment of the present disclosure, the policy adjustment module 22 is specifically configured to determine a target preference adjustment policy from a plurality of standard preference adjustment policies based on the preference information of the target person; The target bone conduction participation coefficient and the target air conduction participation coefficient are adjusted based on the target preference adjustment strategy to obtain a first audio output strategy.

[0107] See also Figure 3 , Figure 3 A schematic block diagram of an electronic device provided by an embodiment of the present disclosure. Figure 3 The electronic device 300 in the embodiment shown may include: one or more processors 301, one or more input devices 302, one or more output devices 303 and one or more memories 304. The processors 301, input devices 302, output devices 303 and memories 304 communicate with each other via a communication bus 305. The memory 304 is used to store computer programs, which include program instructions. The processor 301 is used to execute the program instructions stored in the memory 304. The processor 301 is configured to call the program instructions to execute the functions of each module / unit in the above-mentioned device embodiments, such as Figure 2 The functions of modules 21 to 24 are shown.

[0108] It should be understood that in the embodiment of the present disclosure, the processor 301 may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0109] The input device 302 may include a touch panel, a fingerprint collection sensor (for collecting the user's fingerprint information and fingerprint direction information), a microphone, etc., and the output device 303 may include a display (LCD, etc.), a speaker, etc.

[0110] The memory 304 may include a read-only memory and a random access memory, and provide instructions and data to the processor 301. A portion of the memory 304 may also include a non-volatile random access memory. For example, the memory 304 may also store information about the device type.

[0111] In a specific implementation, the processor 301, input device 302, and output device 303 described in the embodiments of the present disclosure can execute the implementation methods described in the first and second embodiments of the audio processing method provided in the embodiments of the present disclosure, and can also execute the implementation methods of the electronic device described in the embodiments of the present disclosure, which will not be repeated here.

[0112] In another embodiment of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by the processor, all or part of the processes in the above-mentioned embodiment method are implemented, and the computer program can also be completed by instructing the relevant hardware through the computer program. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by the processor, the steps of each of the above-mentioned method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form, etc. The computer-readable medium can include: any entity or device capable of carrying computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium, etc.

[0113] The computer-readable storage medium may be an internal storage unit of the electronic device of any of the aforementioned embodiments, such as a hard disk or memory of the electronic device. The computer-readable storage medium may also be an external storage device of the electronic device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device. Furthermore, the computer-readable storage medium may also include both an internal storage unit of the electronic device and an external storage device. The computer-readable storage medium is used to store computer programs and other programs and data required by the electronic device. The computer-readable storage medium may also be used to temporarily store data that has been output or is to be output.

[0114] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this disclosure.

[0115] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the electronic devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0116] In the several embodiments provided in the present application, it should be understood that the disclosed electronic devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces or units, or it can be an electrical, mechanical or other form of connection.

[0117] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiments of the present disclosure.

[0118] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0119] The above are only specific embodiments of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present disclosure, and these modifications or replacements should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims

1. An audio processing method, characterized in that: include: Determine a target bone conduction participation coefficient and a target air conduction participation coefficient based on the frequency characteristics of the target audio; adjusting the target bone conduction participation coefficient and the target air conduction participation coefficient based on the preference information of the target person to obtain a first audio output strategy; Determining a first noise reduction strategy based on noise characteristics of the external environment; The audio output of the target device is controlled based on the first audio output policy and the first noise reduction policy.

2. The audio processing method according to claim 1, characterized in that: The step of determining a target bone conduction participation coefficient and a target air conduction participation coefficient based on the frequency characteristics of the target audio frequency includes: Selecting a target audio output strategy from a plurality of standard audio output strategies based on the frequency characteristics of the target audio; the target audio output strategy includes a target bone conduction participation coefficient and a target air conduction participation coefficient; the standard audio output strategy includes a standard bone conduction participation coefficient and a standard air conduction participation coefficient; The process of determining the standard audio output strategy includes: In response to the frequency characteristics of the standard audio satisfying the low-frequency condition, increasing the reference value of the bone conduction participation coefficient based on the first low-frequency step length to obtain the standard bone conduction participation coefficient; and, reducing the reference value of the air conduction participation coefficient based on the first low-frequency step length to obtain the standard air conduction participation coefficient; In response to the frequency characteristic of the standard audio satisfying the intermediate frequency condition, reducing the reference value of the bone conduction participation coefficient based on a first intermediate frequency step to obtain the standard bone conduction participation coefficient; and, increasing the reference value of the air conduction participation coefficient based on the first intermediate frequency step length to obtain the standard air conduction participation coefficient; In response to the frequency characteristic of the standard audio satisfying the high frequency condition, reducing the reference value of the bone conduction participation coefficient based on a first high frequency step to obtain the standard bone conduction participation coefficient; And, based on the first high-frequency step, the reference value of the air conduction participation coefficient is increased to obtain the standard air conduction participation coefficient.

3. The audio processing method according to claim 1, characterized in that: The determining of the first noise reduction strategy based on the noise characteristics of the external environment includes: Determining a noise characteristic of the external environment based on a first noise characteristic of the external environment and a second noise characteristic of the external environment; Determine an air conduction frequency noise reduction strategy and a bone conduction frequency noise reduction strategy based on the frequency characteristics in the noise characteristics; In response to an intensity feature in the noise feature satisfying a first intensity condition, determining an air conduction intensity noise reduction strategy and a bone conduction intensity noise reduction strategy based on the intensity feature; Determine a first noise reduction strategy based on the air conduction frequency noise reduction strategy, the bone conduction frequency noise reduction strategy, the air conduction intensity noise reduction strategy, and the bone conduction intensity noise reduction strategy; The first noise characteristic is obtained by monitoring a bone conduction device in the target device, and the second noise characteristic is obtained by monitoring an air conduction device in the target device.

4. The audio processing method according to claim 3, characterized in that: The determining the noise feature of the external environment based on the first noise feature of the external environment and the second noise feature of the external environment includes: Determine a first noise intensity feature and a first noise frequency feature based on the first noise feature, and determine a second noise intensity feature and a second noise frequency feature based on the second noise feature; Performing weighted calculation on the first noise intensity feature and the second noise intensity feature to obtain a noise intensity feature; Performing weighted calculation on the first noise frequency feature and the second noise frequency feature to obtain a noise frequency feature; The noise characteristics of the external environment are obtained based on the noise intensity characteristics and the noise frequency characteristics.

5. The audio processing method according to claim 4, characterized in that: Also includes: In response to the frequency characteristic of the target audio satisfying a first frequency condition, reducing a reference value of a first frequency weight based on a first frequency step to obtain a first frequency weight, and increasing a reference value of a second frequency weight based on the first frequency step to obtain a second frequency weight; The noise frequency feature is obtained based on the first frequency weight, the first noise frequency feature, the second frequency weight, and the second noise frequency feature.

6. The audio processing method according to claim 4, characterized in that: Also includes: In response to the second noise frequency characteristic satisfying a second frequency condition, reducing a reference value of the first frequency weight based on a second frequency step to obtain a first frequency weight, and increasing a reference value of the second frequency weight based on the second frequency step to obtain a second frequency weight; The noise frequency feature is obtained based on the first frequency weight, the first noise frequency feature, the second frequency weight, and the second noise frequency feature.

7. The audio processing method according to claim 1, characterized in that: The step of adjusting the target bone conduction participation coefficient and the target air conduction participation coefficient based on the preference information of the target person to obtain a first audio output strategy includes: determining a target preference adjustment strategy from a plurality of standard preference adjustment strategies based on the preference information of the target person; The target bone conduction participation coefficient and the target air conduction participation coefficient are adjusted based on the target preference adjustment strategy to obtain a first audio output strategy.

8. An audio processing device, characterized in that: include: A coefficient determination module, used to determine a target bone conduction participation coefficient and a target air conduction participation coefficient based on the frequency characteristics of the target audio; A strategy adjustment module, used to adjust the target bone conduction participation coefficient and the target air conduction participation coefficient based on the preference information of the target person, to obtain a first audio output strategy; A noise reduction strategy module, used to determine a first noise reduction strategy based on noise characteristics of an external environment; An audio control module is used to control the audio output of the target device based on the first audio output strategy and the first noise reduction strategy.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images