Audio processing method, open earphone and computer readable storage medium

Abstract

The invention discloses an audio processing method, an open earphone and a computer readable storage medium, and the audio processing method comprises the steps: adjusting the sound characteristics of first audio data according to the parameters of the contact position of the open earphone, so as to obtain the first audio data, carrying out the audio enhancement of the first audio data, and obtaining the first audio data; and playing the enhanced first audio data. The method comprises the following steps: acquiring corresponding first audio data based on a parameter of a contact position of an open earphone, so that sound characteristics of the acquired first audio data can adapt to a wearing position of the earphone and an ear canal structure of a wearer; and the first audio data is enhanced, so that the enhanced first audio data can adapt to the ear canal structure of the wearer, the frequency difference of the audio data when the earphone is in different contact positions can be repaired, the distortion of the first audio data is reduced, and the use experience of the user is further improved.

Description

Technical Field

[0001] The present application relates to the technical field of audio processing, and in particular to an audio processing method, an open-type earphone, and a computer-readable storage medium. Background Art

[0002] In the related art, headphones can be divided into closed, semi-open and open types according to the degree of communication between the sound-emitting unit of the headphones and the outside world. As users' demand for portability and comfort of open headphones increases, open headphones are favored by more and more users.

[0003] In the prior art, although open-back headphones can avoid ear hygiene problems caused by long-term wear, since open-back headphones are a certain distance away from the ear canal and are not sealed, the use of open-back headphones will result in insufficient bass. In the prior art, when audio data is processed, the low frequency of the audio data is usually enhanced by a harmonic signal. However, when combined with the harmonic signal, it is easy to cause signal waveform distortion. In addition, since the ear canal structures of different users are different, when the low frequency is enhanced by the harmonic signal, the high and low frequencies cannot be adjusted according to the differences in the ear canal structures, resulting in poor sound quality of the open-back headphones, affecting the user experience. Summary of the invention

[0004] To solve the above technical problems, the present application provides an audio processing method, an open-type earphone and a computer-readable storage medium.

[0005] To solve the above problems, the present application provides an audio processing method, which is applied to open-type headphones, the open-type headphones including a first headphone and a second headphone, the audio processing method including: in response to a startup operation of the open-type headphones, obtaining a contact position of the open-type headphones; obtaining first audio data based on parameters of the contact position, wherein the sound characteristics of the first audio data corresponding to different contact positions are different, and the first audio data is the original audio data to be played by the open-type headphones; performing audio enhancement on the first audio data, and playing the enhanced first audio data.

[0006] Optionally, before performing audio enhancement on the first audio data and playing the enhanced first audio data, the audio processing method also includes: obtaining a preset frequency response curve, performing audio acquisition on the first audio data to obtain second audio data; performing signal processing on the second audio data, the signal processing method including at least one of high-pass filtering, windowing, frequency domain transformation, smoothing processing and transfer function processing; fitting the processed second audio data with the frequency response curve to obtain a frequency response gain coefficient according to the fitting result, and performing audio enhancement on the first audio data according to the frequency response gain coefficient.

[0007] Optionally, before performing audio enhancement on the first audio data and playing the enhanced first audio data, the audio processing method also includes: detecting the distance between the first earphone and / or the second earphone and the center position of the wearer at a preset time interval to obtain a first distance parameter and a second distance parameter, the detection time of the second distance parameter being later than the detection time of the first distance parameter; calculating a first difference between the first distance parameter and the second distance parameter; and obtaining a corresponding frequency response gain coefficient based on the first difference to perform audio enhancement on the first audio data based on the frequency response gain coefficient.

[0008] Optionally, obtaining a corresponding frequency response gain coefficient according to the first difference to perform audio enhancement on the first audio data according to the frequency response gain coefficient includes: in response to the first difference being greater than a preset value, obtaining a corresponding first gain coefficient to perform audio enhancement on the first audio data according to the first gain coefficient; in response to the first difference being less than a preset value, obtaining a corresponding second gain coefficient to perform audio enhancement on the first audio data according to the second gain coefficient, wherein the second gain coefficient is greater than the first gain coefficient.

[0009] Optionally, the open earphone includes a first earphone and a second earphone; adjusting the sound characteristics of the first audio data according to the parameters of the contact position to obtain the first audio data, the first audio data being the original audio data to be played by the open earphone, including: adjusting the sound characteristics of the first audio data according to the parameters of the contact position of the first earphone and the second earphone to obtain the first audio data; performing audio enhancement on the first audio data and playing the enhanced first audio data, including: obtaining a third gain coefficient of the first earphone and a fourth gain coefficient of the second earphone; in response to the third gain coefficient and the fourth gain coefficient being unequal, compensating the third gain coefficient and the fourth gain coefficient to balance the gain effects of the first earphone and the second earphone; performing audio enhancement on the first audio data of the first earphone according to the compensated third gain coefficient, and, performing audio enhancement on the first audio data of the second earphone according to the compensated fourth gain coefficient.

[0010] Optionally, in response to the third gain coefficient and the fourth gain coefficient being unequal, compensation processing is performed on the third gain coefficient and the fourth gain coefficient to balance the gain effects of the first earphone and the second earphone, including: in response to the third gain coefficient being greater than the fourth gain coefficient, reducing the third gain coefficient according to a second difference between the third gain coefficient and the fourth gain coefficient, or increasing the fourth gain coefficient according to the second difference; in response to the third gain coefficient being less than the fourth gain coefficient, increasing the third gain coefficient according to a third difference between the fourth gain coefficient and the third gain coefficient, or reducing the fourth gain coefficient according to the third difference.

[0011] Optionally, the first earphone and the second earphone include a first sensor; in response to the start-up operation of the first earphone and / or the second earphone, obtaining at least one contact position of the first earphone or the second earphone includes: detecting the first position and the second position on opposite sides of the first earphone and / or the second earphone in contact with the skin by the first sensor to obtain the position parameter between the first position and the second position. Optionally, the first position and the second position may also include a plurality of contact surfaces; performing audio enhancement on the first audio data and playing the enhanced first audio data includes: adjusting the frequency response gain coefficient according to the number of contact surfaces to perform audio enhancement on the first audio data according to the adjusted frequency response gain coefficient.

[0012] To solve the above problems, the present application provides an open-type headset, including a processor and a memory connected to the processor, wherein program data is stored in the memory, and the processor calls the program data stored in the memory to execute the above audio processing method.

[0013] To solve the above problems, the present application provides a computer-readable storage medium, characterized in that program instructions are stored, and the program instructions are executed to implement the above audio processing method.

[0014] Different from the prior art, the audio processing method of the present application adjusts the sound characteristics of the first audio data according to the parameters of the contact position of the open earphone to obtain the first audio data, and performs audio enhancement on the first audio data to play the enhanced first audio data. The corresponding first audio data is obtained based on the parameters of the contact position of the open earphone, so that the sound characteristics of the obtained first audio data can adapt to the wearing position of the earphone and the ear canal structure of the wearer; and the first audio data is enhanced so that the enhanced first audio data can adapt to the ear canal structure of the wearer, and can repair the frequency difference of the audio data when the earphone is in different contact positions, reduce the distortion of the first audio data, and further improve the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. Among them:

[0016] Figure 1 is a flowchart of a first embodiment of an audio processing method provided by the present application;

[0017] Figure 2 is a flowchart of a second embodiment of the audio processing method provided by the present application;

[0018] Figure 3 is a flowchart of a third embodiment of the audio processing method provided by the present application;

[0019] Figure 4 It is a structural schematic diagram of an embodiment of the first position and the second position provided by the present application;

[0020] Figure 5 is a structural schematic diagram of an embodiment of an open-type earphone provided by the present application;

[0021] Figure 6 It is a structural schematic diagram of an embodiment of a computer-readable storage medium provided by the present application. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0023] It should be noted that if the embodiments of the present application involve directional indications (such as up, down, left, right, front, back...), the directional indications are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.

[0024] In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present application, the descriptions of "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or suggesting their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in the field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0025] Since open-back headphones are prone to insufficient bass, the prior art usually uses harmonic signals to enhance the low frequency of audio data when processing audio data. Specifically, the low frequency part of the audio data is independently enhanced by combining the amplitude of the harmonic signal. However, harmonics are unnecessary components in signal processing. When combined with harmonic signals, it is easy to cause signal waveform distortion, affecting the user experience. In addition, the existing audio processing methods only enhance the low frequency part of the audio data, without paying attention to the high frequency differences of the audio data.

[0026] In view of this, an embodiment of the present application proposes an audio processing method, which performs audio enhancement on first audio data through a frequency response gain coefficient, and can perform full-frequency enhancement on audio data when the earphone is in different contact positions, and the enhanced first audio data can adapt to the wearer's ear canal structure, thereby improving the user's experience.

[0027] See also Figure 1 , Figure 1 1 is a flow chart of the first embodiment of the audio processing method provided by the present application. Figure 1 As shown, in an embodiment of the present application, the audio processing method is applied to open headphones, and the audio processing method includes:

[0028] Step S11: in response to a start-up operation of the open-ear headphone, obtaining at least one contact position of the open-ear headphone.

[0029] Specifically, the open earphone includes but is not limited to a first earphone, a second earphone and an earphone compartment, the earphone compartment is used to accommodate the first earphone and the second earphone and charge the first earphone and the second earphone, the earphone compartment further includes an opening and closing member and a receiving cavity, the first earphone and the second earphone are respectively located in the receiving cavity, and the opening and closing member is used to expose the receiving cavity in an open state and cover the receiving cavity in a closed state. The first earphone can be one of the left earphone and the right earphone, and the second earphone can be the other of the left earphone and the right earphone.

[0030] It can be understood that the audio processing method of this embodiment can be applied to any earphone (left earphone or right earphone) of the open earphone, and can also be applied to the first earphone and the second earphone at the same time. The startup operation can be a contact operation such as touching, pressing, tapping, etc. made by the wearer on any part of the open earphone when the wearer wears the first earphone and / or the second earphone. The startup operation can also be an operation when the open earphone receives a voice command issued by the wearer. In an optional embodiment, when the first earphone and / or the second earphone are not worn, the startup operation can also be an operation when the wearer opens the opening and closing piece and the first earphone and / or the second earphone are exposed in the accommodating cavity. The startup operation is used to start the audio processing or audio enhancement function of the open earphone, which is not specifically limited here.

[0031] Specifically, when the wearer wears the open-ear headphones, the contact surface between the first earphone and / or the second earphone and the wearer's ear is the contact position. Depending on the structure of the open-ear headphones and the wearing habits of the user, the contact position of the first earphone and / or the second earphone may be at the helix, scaphoid, antihelix body, concha, etc., which are not specifically limited here. At least one contact position of the open-ear headphones is obtained to obtain parameters of the contact position.

[0032] Step S12: acquiring first audio data based on the parameters of the contact position, wherein the sound characteristics of the first audio data corresponding to different contact positions are different, and the first audio data is original audio data to be played by the open earphone.

[0033] The parameters of the contact position are obtained, and the corresponding first audio data are obtained according to the parameters of the contact position. Specifically, the open-type earphones pre-store a plurality of first audio parameters corresponding to the contact positions, and the sound characteristics of the first audio data corresponding to different contact positions are different. For example, the open-type earphones store the first audio parameters corresponding to the first position, the second position, the third position, and the fourth position, and determine whether the open-type earphones are located in one of the first position, the second position, the third position, and the fourth position based on the parameters of the contact position to obtain the corresponding first audio data.

[0034] The first audio data is the original audio data to be played by the open earphones. The first audio data with different sound characteristics is obtained according to the parameters of different contact positions, so that the first audio data generated when the open earphones are worn at different contact positions can adapt to the ear structure of the wearer.

[0035] Among them, the sound characteristics of the first audio data may include but are not limited to amplitude and / or frequency. When the parameters of the contact position of the open earphones are different, the difference in the first audio data can be reflected in at least one parameter difference such as loudness affected by amplitude, bass frequency or treble frequency; at this time, the contact position parameters of this embodiment can be reflected as modeling data of at least one contact position where the open earphones contact the wearer's skin, or the position parameters can also be reflected as distance data between different contact positions, which is not specifically limited here.

[0036] Step S13: performing audio enhancement on the first audio data to play the enhanced first audio data.

[0037] After the first audio data is obtained, a frequency response gain coefficient is obtained to perform audio enhancement on the first audio data according to the frequency response gain coefficient. A preset frequency response curve is stored in the open-type earphone, and the frequency response curve is used to make the frequency of the audio played by the open-type earphone close to the theoretical frequency. The frequency response gain coefficient of this embodiment is used to adjust the frequency response range of the first audio data to be close to the preset frequency response curve, so as to achieve audio enhancement of the first audio data at all frequencies.

[0038] In an embodiment of the present application, the audio processing method obtains corresponding first audio data according to the parameters of the contact position of the open earphone, so that the sound characteristics of the obtained first audio data can adapt to the wearing position of the earphone and the ear canal structure of the wearer; and enhances the first audio data so that the enhanced first audio data can adapt to the ear canal structure of the wearer, and can repair the frequency difference of the audio data when the earphone is in different contact positions, reduce the distortion of the first audio data, and further improve the user experience.

[0039] In one embodiment, see Figure 2 , Figure 2 2 is a flow chart of the second embodiment of the audio processing method provided by the present application. Figure 2 As shown, before step S13, the audio processing method further includes the following steps:

[0040] Step S21: obtaining a preset frequency response curve, and performing audio acquisition on the first audio data to obtain second audio data.

[0041] Specifically, the frequency response curve may be a frequency response curve generated by the user when setting the earphone, or may be a frequency response curve preset when the open earphone leaves the factory. After obtaining the first audio data according to the parameters of the contact position, the preset frequency response curve is further obtained, and the first audio data is collected by the built-in microphone of the open earphone to obtain the second audio data, that is, the second audio data is the audio data collected by the microphone when the first earphone and / or the second earphone outputs the first audio data.

[0042] Step S22: performing signal processing on the second audio data, wherein the signal processing method includes at least one of high-pass filtering, windowing, frequency domain transformation, smoothing processing and transfer function processing.

[0043] After acquiring the collected second audio data, the second audio data is subjected to signal processing, and the signal processing method includes at least one of high-pass filtering, windowing, frequency domain transformation, smoothing processing and transfer function processing. High-pass filtering is used to weaken the waveform of the low-frequency component and enhance the high-frequency waveform to adjust the attenuation degree of the second audio data; windowing is used to make the second audio data better meet the periodicity requirements of Fourier transform through the windowing function to improve the continuity of the collected data; frequency domain transformation is used to remove the noise of the second audio data through Fourier transform; smoothing processing is used to smooth the noise data through the sliding average method or the exponential sliding average method to further remove the noise of the second audio data; transfer function processing is used to highlight the high-frequency characteristics of the second audio data by pre-emphasizing the second audio data, and repair the high-frequency difference of the audio data when the earphone is in different contact positions.

[0044] Step S23: Fitting the processed second audio data with the frequency response curve to obtain a frequency response gain coefficient according to the fitting result, and performing audio enhancement on the first audio data according to the frequency response gain coefficient.

[0045] After signal processing is performed on the second audio data, the processed second audio data is obtained and the processed second audio data is fitted with the frequency response curve to obtain a frequency response gain coefficient according to the fitting result. The frequency response gain parameter can be understood as a gain parameter for enhancing or weakening the second audio data in each frequency range when fitting the processed second audio data with the frequency response curve. After the frequency response gain coefficient is obtained, the first audio data can be audio-enhanced according to the frequency response gain coefficient.

[0046] In an embodiment of the present application, the audio processing method acquires second audio data by performing audio sampling on first audio data, and fits the second audio data after signal processing with a preset frequency response curve to obtain a frequency response gain coefficient according to the fitting result, so that the first audio data can be audio-enhanced according to the frequency response gain coefficient to repair the frequency difference of the audio data when the open-ear headphones are in different contact positions, reduce the distortion of the first audio data, and further improve the user experience.

[0047] In one embodiment, see Figure 3 , Figure 3 FIG. 1 is a flow chart of the third embodiment of the audio processing method provided by the present application. Figure 3 As shown, before step S13, the audio processing method further includes the following steps:

[0048] Step S31: detecting the distance between the open earphone and the center position of the wearer at a preset time interval to obtain a first distance parameter and a second distance parameter, wherein the detection time of the second distance parameter is later than the detection time of the first distance parameter.

[0049] Specifically, the distance between the open earphone and the center position of the wearer is detected at a preset time interval, and the distance may be the distance between the contact position and the center position. The center position is a pre-set or identified position of the wearer for receiving audio data, for example, the center position may be the position of the wearer's ear canal, or the center position may be the position of the wearer's cavum concha. The first distance parameter and the second distance parameter are distance parameters obtained when the distance between the contact position and the center position is detected at a preset time interval, and the detection time of the second distance parameter is later than the detection time of the first distance parameter, that is, the second distance parameter is the distance between the open earphone and the center position of the wearer at the current time, and the second distance parameter is the distance between the open earphone and the center position of the wearer at the previous time interval.

[0050] Step S32: Calculate a first difference between the first distance parameter and the second distance parameter.

[0051] After obtaining the first distance parameter and the second distance parameter, a first difference between the first distance parameter and the second distance parameter is calculated.

[0052] Step S33: obtaining a corresponding frequency response gain coefficient according to the first difference, so as to perform audio enhancement on the first audio data according to the frequency response gain coefficient.

[0053] The corresponding frequency response gain coefficient is obtained according to the magnitude relationship of the first difference, so as to perform audio enhancement on the first audio data according to the frequency response gain coefficient. For example, the corresponding frequency response gain coefficient can be obtained according to the positive and negative relationship of the first difference, or the fifth frequency response gain coefficient is obtained when the first difference is greater than the preset threshold, and the sixth frequency response gain coefficient is obtained when the first difference is less than the preset threshold. The specific method of performing audio enhancement according to the frequency response gain coefficient is as shown in the above embodiment, which will not be repeated here.

[0054] In an embodiment of the present application, the audio processing method detects the distance between the open-type earphone and the center position of the wearer at a preset time interval to obtain a first distance parameter and a second distance parameter, and calculates a first difference between the first distance parameter and the second distance parameter, and obtains a corresponding frequency response gain coefficient according to the first difference, so as to perform audio enhancement on the first audio data according to the frequency response gain coefficient. The audio processing method of this embodiment realizes real-time detection of audio enhancement by calculating the distance between the open-type earphone and the center position of the wearer at the previous and next time intervals, and can also perform adaptive enhancement according to the change of the wearing position of the earphone in the scenario where the open-type earphone shakes, such as during sports, so as to further improve the effect of audio enhancement and enhance the user's experience.

[0055] In one embodiment, the open earphone includes a second sensor, which is used to detect the distance between the earphone and the center position to obtain a first distance parameter and a second distance parameter, wherein the second sensor performs distance detection by at least one method of ultrasound and infrared light.

[0056] Specifically, the second sensor is a distance sensor, and the second sensor can detect the distance between the contact plane where the earphone is located and the center position by ultrasonic ranging and infrared light ranging. At this time, the center position can be the concha cavity of the wearer. The audio processing method of this embodiment obtains the first distance parameter and the second distance parameter through the second sensor, and determines whether the open earphone moves according to the first difference between the first distance parameter and the second distance parameter, so as to perform adaptive enhancement according to the change of the wearing position of the earphone, improve the low-frequency effect of the first audio data, and repair the high-frequency difference caused by the difference in the ear canal structure of the wearer, so as to further improve the user experience.

[0057] In one embodiment, step S33 further includes: in response to the first difference being greater than a preset value, obtaining a corresponding first gain coefficient to perform audio enhancement on the first audio data according to the first gain coefficient; in response to the first difference being less than a preset value, obtaining a corresponding second gain coefficient to perform audio enhancement on the first audio data according to the second gain coefficient, wherein the second gain coefficient is greater than the first gain coefficient.

[0058] Specifically, the open-ear headphones may store a correspondence between a first difference and a frequency response gain coefficient. When the first difference is greater than a preset value, that is, the first earphone and / or the second earphone moves and approaches a center position within a preset time interval. At this time, the corresponding first gain coefficient is obtained to perform audio enhancement on the first audio data according to the first gain coefficient. When the first difference is less than a preset value, that is, the open-ear headphones move and move away from the center position within a preset time interval, at this time, the corresponding second gain coefficient is obtained to perform audio enhancement on the first audio data according to the second gain coefficient.

[0059] Since the open-type earphones and the ear canal are in a non-enclosed space, when the open-type earphones are moved closer to the center, the sound heard by the wearer when receiving audio data of the same loudness or frequency will be more obvious, that is, the low frequency and high frequency will be more significant. Therefore, the enhancement effect of the first audio data when the audio is enhanced according to the first gain coefficient can be appropriately reduced; when the open-type earphones are moved away from the center, the low frequency data and high frequency data received by the wearer will be further weakened. Therefore, the enhancement effect of the first audio data when the audio is enhanced according to the second gain coefficient can be appropriately increased. That is, the second gain coefficient is greater than the first gain coefficient.

[0060] In an optional embodiment, the preset value may be 0, that is, when the first difference is greater than 0, it is determined that the first earphone and / or the second earphone is approaching the center position within the preset time interval, and when the first difference is less than 0, it is determined that the first earphone and / or the second earphone is moving away from the center position within the preset time interval; or, the preset value may include a first preset value and a second preset value, and when the first difference is greater than the first preset value, it is determined that the first earphone and / or the second earphone is approaching the center position within the preset time interval, and when the first difference is less than the second preset value, it is determined that the first earphone and / or the second earphone is moving away from the center position within the preset time interval. In this case, the first preset value may be a positive value, and the second preset value may be a negative value, which is not limited here.

[0061] In an embodiment of the present application, the audio processing method calculates a first difference in the distance between the first earphone and / or the second earphone and the center position of the wearer in a previous and next time interval, and determines that the open earphone approaches the center position within the preset time interval when the first difference is greater than a preset value, and determines that the open earphone moves away from the center position within the preset time interval when the first difference is less than the preset value, so that the frequency response gain coefficient can be adjusted according to the change in the wearing position of the earphone when the open earphone shakes in scenarios such as sports, thereby achieving adaptive adjustment of audio enhancement, further improving the effect of audio enhancement, and improving the user experience.

[0062] In one embodiment, the open earphone includes a first earphone and a second earphone. Step S12 includes: adjusting the sound characteristics of the first audio data according to the parameters of the contact position of the first earphone and the second earphone to obtain the first audio data. Step S13 includes: obtaining a third gain coefficient of the first earphone and a fourth gain coefficient of the second earphone; in response to the third gain coefficient and the fourth gain coefficient being unequal, compensating the third gain coefficient and the fourth gain coefficient to balance the gain effects of the first earphone and the second earphone; performing audio enhancement on the first audio data of the first earphone according to the compensated third gain coefficient, and performing audio enhancement on the first audio data of the second earphone according to the compensated fourth gain coefficient.

[0063] Specifically, when the wearer wears the first earphone and the second earphone at the same time and starts the audio enhancement function of the first earphone and the second earphone, the third gain coefficient of the first earphone and the fourth gain coefficient of the second earphone are respectively obtained according to the steps of the above embodiment, and it is determined whether the third gain coefficient and the fourth gain coefficient are equal. In response to the third gain coefficient and the fourth gain coefficient being unequal, the third gain coefficient and the fourth gain coefficient are compensated to balance the gain effects of the first earphone and the second earphone. The compensation processing method may include numerically adjusting the coefficient with a larger value between the third gain coefficient and the fourth gain coefficient to reduce the difference between the third gain coefficient and the fourth gain coefficient, and / or numerically adjusting the coefficient with a smaller value between the third gain coefficient and the fourth gain coefficient to reduce the difference between the third gain coefficient and the fourth gain coefficient. Specific adjustment methods may include: when the third gain coefficient is not equal to the fourth gain coefficient, directly increasing or decreasing the third gain coefficient so that the adjusted third gain coefficient is equal to the fourth gain coefficient; or, when the third gain coefficient is not equal to the fourth gain coefficient, adjusting the larger or smaller one to the average of the third gain coefficient and the fourth gain coefficient; the third gain coefficient and the fourth gain coefficient may also be adjusted by other mathematical functions and parameters, which are not specifically limited here.

[0064] In an embodiment of the present application, in response to the third gain coefficient of the first earphone and the fourth gain coefficient of the second earphone being unequal, the audio processing method performs compensation processing on the third gain coefficient and the fourth gain coefficient to balance the gain effects of the first earphone and the second earphone, so that when the wearer receives audio data through the first earphone and the second earphone, the audio reception effects of the left and right ears can be balanced, thereby improving the user experience.

[0065] Further, the above-mentioned step of compensating the third gain coefficient and the fourth gain coefficient may further include: in response to the third gain coefficient being greater than the fourth gain coefficient, reducing the third gain coefficient according to the second difference between the third gain coefficient and the fourth gain coefficient, or increasing the fourth gain coefficient according to the second difference between the third gain coefficient and the fourth gain coefficient; in response to the third gain coefficient being less than the fourth gain coefficient, increasing the third gain coefficient according to the third difference between the fourth gain coefficient and the third gain coefficient, or reducing the fourth gain coefficient according to the third difference between the fourth gain coefficient and the third gain coefficient.

[0066] Specifically, when the third gain coefficient is greater than the fourth gain coefficient, the third gain coefficient is reduced according to the second difference between the third gain coefficient and the fourth gain coefficient, so that the adjusted third gain coefficient is equal to the fourth gain coefficient; or, the fourth gain coefficient is increased according to the second difference, so that the adjusted fourth gain coefficient is equal to the third gain coefficient. When the third gain coefficient is less than the fourth gain coefficient, the third gain coefficient is increased according to the third difference between the fourth gain coefficient and the third gain coefficient, so that the adjusted third gain coefficient is equal to the fourth gain coefficient; or, the fourth gain coefficient is reduced according to the third difference, so that the adjusted fourth gain coefficient is equal to the third gain coefficient.

[0067] In an embodiment of the present application, the third gain coefficient or the fourth gain coefficient is adjusted according to the second difference between the third gain coefficient and the fourth gain coefficient or the third difference between the fourth gain coefficient and the third gain coefficient, so that the adjusted third gain coefficient is equal to the fourth gain coefficient, so as to balance the gain effects of the first earphone and the second earphone, so that the wearer can maintain the balance of the audio reception effects of the left and right ears when receiving audio data through the first earphone and the second earphone, thereby improving the user experience.

[0068] In one embodiment, see Figure 4 , Figure 4 Schematic diagram of the structure of an embodiment of the first position and the second position provided by the present application. Figure 4 As shown, the open earphone includes a first sensor. Step S11 includes the following steps: detecting a first position and a second position of two opposite sides of the open earphone in contact with the skin by the first sensor to obtain position parameters between the open earphones.

[0069] Specifically, the first sensor is a contact sensor for detecting the contact position of the open earphone with the skin. The contact sensor may be a tactile sensor, an acoustic wave sensor, etc., which is not specifically limited here. The first sensor detects the first position and the second position on the opposite sides of the open earphone in contact with the skin. It can be understood that the first position and the second position are the positions of the skin contacted by the opposite sides of the first earphone or the second earphone, and the position parameters between the first position and the second position are further obtained by detecting the first position and the second position. Among them, the position parameters may be the distance between the first position and the second position, the angle of the relative angle, and the modeling data of the first position and the second position, etc.

[0070] In an embodiment of the present application, by obtaining the position parameters between the first position and the second position, the first audio data is output to the open earphone, so that the first audio data generated when the earphone is in different wearing positions can adapt to the ear structure of the wearer, reduce the high-frequency differences in the audio data caused by the ear canal structures of different wearers, improve the high-frequency effect of the first audio data, and further improve the user experience.

[0071] In one embodiment, the first position and the second position may further include a plurality of contact surfaces; step S13 includes: adjusting the frequency response gain coefficient according to the number of the contact surfaces, so as to perform audio enhancement on the first audio data according to the adjusted frequency response gain coefficient.

[0072] Specifically, the first position and the second position can be further subdivided into a number of contact surfaces. After detecting the first position and the second position contacted by the open-type earphone, the first contact surface of the first position and the second contact surface of the second position are further identified to obtain the number of contact surfaces. Due to the difference in the ear canal structure of the wearer and the influence of the wearing position of the earphone, there will be a difference in the number of contact surfaces contacted by the open-type earphone and the wearer's ear, resulting in different degrees of attenuation of the high-frequency sound waves of the audio data when the open-type earphone plays the audio data. Therefore, in order to further reduce the high-frequency differences caused by different ear canal structures, this embodiment further adjusts the frequency response gain coefficient according to the number of contact surfaces after obtaining the corresponding frequency response gain coefficient through the method of the above embodiment, so as to perform audio enhancement on the first audio data according to the adjusted frequency response gain coefficient. Among them, the method of adjusting the frequency response gain coefficient may include: when the number of contact surfaces is greater than a third preset value, increasing the frequency response gain coefficient according to a preset ratio, and when the number of contact surfaces is less than or equal to the third preset value, reducing the frequency response gain coefficient according to a preset ratio; or, when the number of contact surfaces is greater than the third preset value, reducing the frequency response gain coefficient according to a preset ratio, and when the number of contact surfaces is less than or equal to the third preset value, increasing the frequency response gain coefficient according to a preset ratio.

[0073] In an embodiment of the present application, the frequency response gain coefficient is adjusted by the number of contact surfaces, so that the first audio data generated when the earphone is in different wearing positions can adapt to the ear structure of the wearer, reduce the high-frequency differences in the audio data caused by the ear canal structures of different wearers, improve the high-frequency effect of the first audio data, and further improve the user experience.

[0074] In one embodiment, the open-type earphones may further include a third sensor, which may be an acceleration and / or angular velocity sensor such as a gyroscope. The audio processing method of this embodiment detects posture data such as the moving speed and position of the open-type earphones through the third sensor to obtain the corresponding frequency response gain coefficient based on the posture data or adjust the frequency response gain coefficient obtained through the above embodiment based on the posture data, which is not specifically limited here.

[0075] See also Figure 5 , Figure 5 Schematic diagram of the structure of an embodiment of the open-type earphone provided by the present application. Figure 5 As shown, the open earphone 100 includes a processor 101 and a memory 102 connected to the processor 101 , wherein the memory 102 stores program data, and the processor 101 retrieves the program data stored in the memory 102 to execute the above-mentioned audio processing method.

[0076] Optionally, in one embodiment, the processor 101 is used to execute program data to implement the following method: in response to a startup operation of the open-end earphones, obtaining at least one contact position of the open-end earphones; adjusting the sound characteristics of the first audio data according to the parameters of the contact position to obtain the first audio data, wherein the first audio data is the original audio data to be played by the open-end earphones; and performing audio enhancement on the first audio data to play the enhanced first audio data.

[0077] The processor 101 may also be referred to as a CPU (Central Processing Unit). The processor 101 may be an electronic chip having the ability to process signals. The processor 101 may also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0078] The memory 102 can be a memory stick, a TF card, etc., and can store all the information in the open earphone 100, including the input raw data, computer programs, intermediate operation results and final operation results are all stored in the memory 102. It stores and retrieves information according to the location specified by the processor 101. With the memory 102, the open earphone 100 has a memory function and can ensure normal operation. The memory 102 of the open earphone 100 can be divided into a main memory (internal memory) and an auxiliary memory (external memory) according to the purpose, and there is also a classification method of dividing it into an external memory and an internal memory. The external memory is usually a magnetic medium or an optical disk, etc., which can store information for a long time. The memory refers to the storage component on the motherboard, which is used to store the data and programs currently being executed, but is only used to temporarily store programs and data. If the power is turned off or the power is cut off, the data will be lost.

[0079] See also Figure 6 , Figure 6 Schematic diagram of the structure of an embodiment of the computer-readable storage medium provided by the present application. Figure 6 As shown, the computer-readable storage medium 110 stores program instructions 111 that can implement all the above methods.

[0080] If the integrated units of the functional units in the various embodiments of the present application are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium 110. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer-readable storage medium 110 includes several instructions in a program instruction 111 to enable a computer device (which can be a personal computer, a system server, or a network device, etc.), an electronic device (such as MP3, MP4, etc., or a mobile terminal such as a mobile phone, a tablet computer, a wearable device, or a desktop computer, etc.) or a processor to execute all or part of the steps of the methods of various implementation methods of the present application.

[0081] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-readable storage media 110 (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0082] The present application is described by flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by a computer-readable storage medium 110. These computer-readable storage media 110 can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the program instructions 111 executed by the processor of the computer or other programmable data processing device generate instructions for implementing the process in the flowchart. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0083] These computer-readable storage media 110 may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the program instructions 111 stored in the computer-readable storage medium 110 produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0084] These computer-readable storage media 110 can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing program instructions 111 executed on the computer or other programmable device for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0085] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0086] The logic and / or steps represented in the flowchart or described in other ways herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, device or equipment (which can be a personal computer, server, network device or other system that can fetch instructions from an instruction execution system, device or equipment and execute instructions), or used in combination with these instruction execution systems, devices or equipment. The above description is only an implementation method of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made by using the contents of the specification and drawings of this application, or directly or indirectly applied in other related technical fields, is also included in the patent protection scope of the present application.

[0087] The above description is only an implementation method of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly used in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. An audio processing method, characterized in that: Applied to open-ear headphones, the audio processing method includes: In response to a start-up operation of the open-type earphone, acquiring a contact position of the open-type earphone; Acquiring first audio data based on the parameters of the contact position, wherein the sound characteristics of the first audio data corresponding to different contact positions are different, and the first audio data is the original audio data to be played by the open earphone; Audio enhancement is performed on the first audio data, and the enhanced first audio data is played.

2. The audio processing method according to claim 1, characterized in that: Before performing audio enhancement on the first audio data and playing the enhanced first audio data, the audio processing method further includes: Acquire a preset frequency response curve, and perform audio acquisition on the first audio data to acquire second audio data; Performing signal processing on the second audio data, wherein the signal processing method comprises at least one of high-pass filtering, windowing, frequency domain transformation, smoothing processing and transfer function processing; The processed second audio data is fitted with the frequency response curve to obtain a frequency response gain coefficient according to the fitting result, and audio enhancement is performed on the first audio data according to the frequency response gain coefficient.

3. The audio processing method according to claim 1 or 2, characterized in that: Before performing audio enhancement on the first audio data and playing the enhanced first audio data, the audio processing method further includes: Detecting the distance between the open earphone and the center position of the wearer at a preset time interval to obtain a first distance parameter and a second distance parameter, wherein the detection time of the second distance parameter is later than the detection time of the first distance parameter; Calculating a first difference between the first distance parameter and the second distance parameter; The corresponding frequency response gain coefficient is acquired according to the first difference, so as to perform audio enhancement on the first audio data according to the frequency response gain coefficient.

4. The audio processing method according to claim 3, characterized in that: The step of acquiring the corresponding frequency response gain coefficient according to the first difference value, so as to perform audio enhancement on the first audio data according to the frequency response gain coefficient, includes: In response to the first difference being greater than a preset value, obtaining a corresponding first gain coefficient to perform audio enhancement on the first audio data according to the first gain coefficient; In response to the first difference being less than a preset value, a corresponding second gain coefficient is obtained to perform audio enhancement on the first audio data according to the second gain coefficient, wherein the second gain coefficient is greater than the first gain coefficient.

5. The audio processing method according to claim 1, characterized in that: The open-type earphone includes a first earphone and a second earphone; the sound characteristics of the first audio data are adjusted according to the parameters of the contact position to obtain the first audio data, and the first audio data is the original audio data to be played by the open-type earphone, including: adjusting the sound characteristics of the first audio data according to the parameters of the contact position between the first earphone and the second earphone to obtain the first audio data; The step of performing audio enhancement on the first audio data and playing the enhanced first audio data includes: Acquire a third gain coefficient of the first earphone and a fourth gain coefficient of the second earphone; In response to the third gain coefficient and the fourth gain coefficient being unequal, performing compensation processing on the third gain coefficient and the fourth gain coefficient to balance the gain effects of the first earphone and the second earphone; The first audio data of the first earphone is audio-enhanced according to the compensated third gain coefficient, and the first audio data of the second earphone is audio-enhanced according to the compensated fourth gain coefficient.

6. The audio processing method according to claim 5, characterized in that: In response to the third gain coefficient and the fourth gain coefficient being unequal, compensating the third gain coefficient and the fourth gain coefficient to balance the gain effects of the first earphone and the second earphone, comprising: In response to the third gain coefficient being greater than the fourth gain coefficient, reducing the third gain coefficient according to a second difference between the third gain coefficient and the fourth gain coefficient, or increasing the fourth gain coefficient according to the second difference; In response to the third gain coefficient being smaller than the fourth gain coefficient, the third gain coefficient is increased according to a third difference between the fourth gain coefficient and the third gain coefficient, or the fourth gain coefficient is decreased according to the third difference.

7. The audio processing method according to claim 1, characterized in that: The open-type earphone includes a first sensor; and in response to a start-up operation of the open-type earphone, obtaining at least one contact position of the open-type earphone includes: The first sensor detects a first position and a second position on opposite sides of the open earphone in contact with the skin to obtain a position parameter between the first position and the second position.

8. The audio processing method according to claim 7, characterized in that: The first position and the second position may further include a plurality of contact surfaces; and the step of performing audio enhancement on the first audio data and playing the enhanced first audio data includes: The frequency response gain coefficient is adjusted according to the number of the contact surfaces, so as to perform audio enhancement on the first audio data according to the adjusted frequency response gain coefficient.

9. An open-type headphone, characterized in that: It comprises a processor and a memory connected to the processor, wherein the memory stores program data, and the processor calls the program data stored in the memory to execute the audio processing method according to any one of claims 1-8.

10. A computer-readable storage medium, characterized in that: Program instructions are stored, and the program instructions are executed to implement the audio processing method according to any one of claims 1 to 8.

Images