Audio processing method and apparatus, computer-readable storage medium, and electronic device

Abstract

The application provides an audio processing method and device, a computer readable storage medium and an electronic device, and relates to the technical field of data processing. The audio processing method comprises the following steps: determining target frequency response information corresponding to to-be-played audio; determining loudspeaker path transfer function information corresponding to a current earphone user of an earphone; and determining local equalization parameters of the earphone based on the target frequency response information and the loudspeaker path transfer function information to play the to-be-played audio. The application determines the local equalization parameters of the earphone based on the loudspeaker path transfer function information corresponding to the current earphone user and the target frequency response information corresponding to the to-be-played audio to play the to-be-played audio, thereby achieving the purpose of adjusting the to-be-played audio based on the actual characteristics of the current earphone user, and further ensuring that the audio quality heard by the current earphone user is not affected by factors such as the user's own wearing habits and ear shape characteristics, and improving the consistency of the earphone product in terms of audio quality and user experience.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data processing, in particular to an audio processing method and device, a computer readable storage medium and an electronic device. BACKGROUND

[0002] In recent years, wireless earphones have been widely concerned due to their advantage of freeing users from the constraints of earphone wires, especially true wireless stereo (TWS) earphones.

[0003] However, due to different ear canal sizes, ear canal shapes and other ear type characteristics of different earphone users, and different earphone use states (including deep insertion state and shallow insertion state, etc.) of the same earphone user, different earphone users may also hear audio with different sound quality effects for the same to-be-played audio. Based on this, it can be known that the prior art cannot guarantee the sound quality effect of the earphone user listening to the audio, thereby leading to low user experience and satisfaction. SUMMARY

[0004] To solve the above technical problems, the present application is proposed. The embodiments of the present application provide an audio processing method and device, a computer readable storage medium and an electronic device.

[0005] In a first aspect, an embodiment of the present application provides an audio processing method applied to an earphone. The audio processing method comprises: determining target frequency response information corresponding to to-be-played audio; determining loudspeaker path transfer function information corresponding to a current earphone user of the earphone; and determining a local equalization parameter of the earphone based on the target frequency response information and the loudspeaker path transfer function information to play the to-be-played audio.

[0006] In combination with the first aspect, in some implementations of the first aspect, the loudspeaker path transfer function information corresponding to the current earphone user is determined by: determining loudspeaker path transfer function estimation information corresponding to the current earphone user; and adjusting the loudspeaker path transfer function estimation information based on the to-be-played audio and playback pickup information corresponding to the to-be-played audio to obtain the loudspeaker path transfer function information. The playback pickup information comprises audio information collected by a pickup microphone located at a preset position of a sound outlet of the earphone when the earphone plays the to-be-played audio.

[0007] In combination with the first aspect, in some implementations of the first aspect, the loudspeaker path transfer function estimation information corresponding to the current earphone user is determined by: determining loudspeaker path transfer function information corresponding to a plurality of historical earphone users of the earphone respectively; determining a matching relationship between the current earphone user and the plurality of historical earphone users; and determining the loudspeaker path transfer function estimation information based on the matching relationship and the loudspeaker path transfer function information corresponding to the plurality of historical earphone users respectively.

[0008] With reference to the first aspect, in some implementations of the first aspect, the method further includes: determining the matching relationship between the current earphone user and the plurality of historical earphone users includes: determining user information of the current earphone user, wherein the user information includes user identity information and / or user type information; determining user information of each of the plurality of historical earphone users; and determining the matching relationship based on the user information of the current earphone user and the user information of each of the plurality of historical earphone users.

[0009] With reference to the first aspect, in some implementations of the first aspect, the method further includes: determining the matching relationship between the current earphone user and the plurality of historical earphone users includes: determining user information of the current earphone user, wherein the user information includes user identity information and / or user type information; determining user information of each of the plurality of historical earphone users; and determining the matching relationship based on the user information of the current earphone user and the user information of each of the plurality of historical earphone users.

[0010] With reference to the first aspect, in some implementations of the first aspect, the method further includes: obtaining a custom equalization parameter corresponding to the current earphone user; and playing the to-be-played audio based on the custom equalization parameter and the local equalization parameter.

[0011] With reference to the first aspect, in some implementations of the first aspect, the method further includes: determining the target frequency response information corresponding to the to-be-played audio includes: determining a target frequency response model; and determining the target frequency response information corresponding to the to-be-played audio by using the target frequency response model.

[0012] The second aspect, an embodiment of the present application provides an audio processing device applied to an earphone. The audio processing device includes: a first determining module configured to determine target frequency response information corresponding to to-be-played audio; a second determining module configured to determine loudspeaker path transfer function information corresponding to a current earphone user of the earphone; and a third determining module configured to determine a local equalization parameter of the earphone based on the target frequency response information and the loudspeaker path transfer function information, so as to play the to-be-played audio.

[0013] The third aspect, an embodiment of the present application provides a computer readable storage medium, the storage medium stores a computer program, the computer program is used for executing the method mentioned in the first aspect.

[0014] The fourth aspect, an embodiment of the present application provides an electronic device, the electronic device includes: a processor; a memory for storing instructions executable by the processor; and the processor is configured to execute the method mentioned in the first aspect.

[0015] Since the loudspeaker path transfer function information is related to parameters such as ear canal size, ear canal shape and earphone wearing habits (such as earphone insertion depth) of the earphone user, different earphone users correspond to different loudspeaker path transfer function information. On this basis, the embodiment of the present application realizes the purpose of adjusting the to-be-played audio based on the actual characteristics of the current earphone user by determining the local equalization parameter of the earphone to play the to-be-played audio based on the loudspeaker path transfer function information corresponding to the current earphone user and the target frequency response information corresponding to the to-be-played audio. Thus, the audio quality listened to by the current earphone user is not affected by factors such as the user's own wearing habits and physiological parameters, and the consistency of the earphone product in terms of audio quality and user experience are improved. BRIEF DESCRIPTION OF DRAWINGS

[0016] The above and other objects, features and advantages of the present application will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings in which:

[0017] Figure 1 Fig. 1 shows a flowchart of an audio processing method provided by an exemplary embodiment of the present application.

[0018] Figure 2 Fig. 2 shows a flowchart of determining loudspeaker path transfer function information corresponding to a current earphone user of an earphone provided by an exemplary embodiment of the present application.

[0019] Figure 3 Fig. 3 shows a flowchart of determining loudspeaker path transfer function estimation information corresponding to a current earphone user provided by another exemplary embodiment of the present application.

[0020] Figure 4 Fig. 4 shows a logic diagram of determining loudspeaker path transfer function estimation information provided by an exemplary embodiment of the present application.

[0021] Figure 5 Fig. 5 shows a flowchart of determining a matching relationship between a current earphone user and a plurality of historical earphone users provided by an exemplary embodiment of the present application.

[0022] Figure 6 Fig. 6 shows a flowchart of an audio processing method provided by another exemplary embodiment of the present application.

[0023] Figure 7 Fig. 7 shows a flowchart of determining target frequency response information corresponding to a to-be-played audio provided by an exemplary embodiment of the present application.

[0024] Figure 8 Fig. 1 shows a structural schematic diagram of an audio processing device according to an example embodiment of the present application.

[0025] Figure 9 Fig. 2 shows a structural schematic diagram of an electronic device according to an example embodiment of the present application. DETAILED DESCRIPTION

[0026] The technical solutions in the embodiments of the present application will be clearly and completely described in connection with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative work fall within the scope of protection of the present application.

[0027] Figure 1 Fig. 3 shows a flowchart of an audio processing method according to an example embodiment of the present application. Specifically, the audio processing method according to the example embodiment of the present application is applied to a headset, such as a Bluetooth headset. As shown in Fig. 3, the audio processing method according to the example embodiment of the present application includes the following steps. Figure 1

[0028] Step S100, determining target frequency response information corresponding to the to-be-played audio.

[0029] For example, the target frequency response information represents the frequency response information of a system (including a circuit and a space) through which the digital audio received by the headset is finally converted from an electrical signal into an acoustic signal received by the eardrum of a human ear. Specifically, the target frequency response information corresponding to the to-be-played audio can be preset by a user or automatically generated according to the historical playing habits of the user.

[0030] Step S200, determining loudspeaker path transfer function information corresponding to a current headset user of the headset.

[0031] For example, the current headset user refers to a user who is currently using the headset.

[0032] For example, the loudspeaker path transfer function information is determined based on the frequency response of an electroacoustic conversion system between the input end of the loudspeaker and the eardrum of the human ear.

[0033] Step S300, determining a local equalization parameter of the headset based on the target frequency response information and the loudspeaker path transfer function information to play the to-be-played audio.

[0034] For example, the target frequency response information is Tg(f), the loudspeaker path transfer function information is G(f), and the local equalization parameter of the headset is EQ(f). Then, the ratio of the target frequency response information to the loudspeaker path transfer function information is the local equalization parameter of the headset, i.e., the following formula (1). e (f).​

[0035]

[0036] Since the equalization parameter can affect the playback quality of the audio to be played, that is, the playback quality of the audio to be played can be adjusted based on the target frequency response information and the loudspeaker path transfer function information.

[0037] Since the loudspeaker path transfer function information is related to the ear canal size, ear canal shape, and earphone wearing habit (such as the depth of the earphone) of the earphone user, different earphone users correspond to different loudspeaker path transfer function information. On this basis, the embodiment of the present application realizes the purpose of adjusting the audio to be played based on the actual characteristics of the current earphone user by determining the local equalization parameter of the earphone to play the audio to be played based on the loudspeaker path transfer function information corresponding to the current earphone user and the target frequency response information corresponding to the audio to be played. Thus, the audio quality heard by the current earphone user is not affected by the user's own wearing habit and physiological parameters, and the consistency of the earphone product in terms of audio quality and user experience are improved.

[0038] Figure 2 The flowchart shown is a flowchart for determining the loudspeaker path transfer function information corresponding to the current earphone user of the earphone provided by an exemplary embodiment of the present application. In Figure 1 The embodiment shown extends to Figure 2 The embodiment shown, the differences between Figure 2 The embodiment shown and Figure 1 The differences and the same of the embodiment shown will not be described again.

[0039] As Figure 2 In the audio processing method provided by the embodiment of the present application, the step of determining the loudspeaker path transfer function information corresponding to the current earphone user of the earphone includes the following steps.

[0040] Step S210, determining the loudspeaker path transfer function estimation information corresponding to the current earphone user.

[0041] Exemplarily, the loudspeaker path transfer function estimation information refers to the pre-estimated loudspeaker path transfer function information. For example, the loudspeaker path transfer function estimation information is determined based on the loudspeaker path transfer function information corresponding to the historical earphone user of the same type as the current earphone user, respectively using the adaptive filtering (Least Mean Square, LMS) algorithm, and the circuit and space system based on the earphone.

[0042] Step S220, adjusting the loudspeaker path transfer function estimation information based on the audio to be played and the playback pickup information corresponding to the audio to be played, to obtain the loudspeaker path transfer function information.

[0043] For example, the audio pickup information includes audio information collected by a microphone located at a preset position of the headphone's sound outlet when the headphones are playing the audio to be played.

[0044] Since the playback pickup information can characterize the playback sound quality of the audio to be played, the method mentioned in this application embodiment of adjusting the speaker path transfer function estimation information based on the playback pickup information to obtain the speaker path transfer function information can greatly improve the accuracy and real-time performance of the obtained speaker path transfer function information, thereby further ensuring the playback effect of the audio to be played relative to the current headphone user.

[0045] Figure 3 The diagram shown is a flowchart illustrating the process of determining the speaker path transfer function estimation information corresponding to the current headphone user, provided in another exemplary embodiment of this application. Figure 2 Extending from the illustrated embodiment Figure 3 The illustrated embodiment will be described in detail below. Figure 3 The illustrated embodiments and Figure 2 The differences between the embodiments shown are not repeated here, and the similarities are not repeated here.

[0046] like Figure 3 As shown, in the audio processing method provided in this application embodiment, the step of determining the speaker path transfer function estimation information corresponding to the current headphone user includes the following steps.

[0047] Step S211: Determine the speaker path transfer function information corresponding to each of the multiple historical headphone users.

[0048] For example, the historical headphone users mentioned in step S211 refer to headphone users who have previously used the headphone. Since the same headphone may typically be used by different headphone users, step S211 records multiple historical headphone users. However, it should be noted that this embodiment does not exclude the possibility of only one historical headphone user.

[0049] Step S212: Determine the matching relationship between the current headphone user and multiple historical headphone users.

[0050] For example, the matching relationship is determined based on user type. That is, if the user type of the current headphone user is the same as the user type of one or more historical headphone users, then a matching relationship can be considered to exist.

[0051] Step S213: Based on the matching relationship and the speaker path transfer function information corresponding to each of the multiple historical headphone users, determine the speaker path transfer function estimation information.

[0052] In some embodiments, if it is determined that there is a historical earphone user matched with the current earphone user based on the matching relationship, the loudspeaker path transfer function estimation information is determined based on the loudspeaker path transfer function information corresponding to the historical earphone user matched with the current earphone user. For example, the current earphone user is Zhang San, and there is also a historical earphone user Zhang San. It is considered that there is a matching relationship between the current earphone user and the historical earphone user, and the loudspeaker path transfer function estimation information corresponding to the historical earphone user is determined as the loudspeaker path transfer function estimation information corresponding to the current earphone user.

[0053] Therefore, it can be seen that the way of determining the loudspeaker path transfer function estimation information corresponding to the current earphone user by using the matching relationship can further reduce the difference between the determined loudspeaker path transfer function estimation information and the finally determined loudspeaker path transfer function information, and further reduce the calculation amount and calculation difficulty of obtaining the finally determined loudspeaker path transfer function information based on the loudspeaker path transfer function estimation information.

[0054] The following will be described in combination with Figure 4 For example, the specific implementation of determining the loudspeaker path transfer function information corresponding to the current earphone user based on the loudspeaker path transfer function estimation information corresponding to the current earphone user will be described.

[0055] Figure 4 As shown in the figure, a logic diagram for determining the loudspeaker path transfer function estimation information is provided in an exemplary embodiment of the present application. As shown in the figure, Figure 4 As shown in the figure, x(n) represents the audio to be played, e(n) represents the playback pickup information obtained based on the real loudspeaker path transfer function information G, that is, the audio information collected by the pickup microphone located at the preset position of the sound outlet of the earphone when the earphone plays the audio to be played, and e1(n) represents the playback pickup information obtained based on the loudspeaker path transfer function estimation information G1. Therefore, in actual application, the adaptive filter can be used to adjust the loudspeaker path transfer function estimation information G1 based on the difference information between e1(n) and e(n) until the audio signal components in e1(n) and e(n) are equivalent based on the minimized difference information, and then it is determined that the loudspeaker path transfer function estimation information G1 in the equivalent condition is equivalent to the loudspeaker path transfer function information G. Thus, the purpose of determining the loudspeaker path transfer function information corresponding to the current earphone user based on the loudspeaker path transfer function estimation information corresponding to the current earphone user is achieved.

[0056] Figure 5 As shown in the figure, a flowchart for determining the matching relationship between the current earphone user and multiple historical earphone users is provided in an exemplary embodiment of the present application. In Figure 3 Based on the embodiment shown in the figure, the following embodiments are extended Figure 5 Based on the embodiment shown in the figure, the following embodiments are extended Figure 5 The embodiment shown in the figure andFigure 3 The differences between the embodiments shown will not be described again.

[0057] As shown in the embodiments provided by the present application, the step of determining the matching relationship between the current earphone user and the plurality of historical earphone users in the audio processing method comprises the following steps. Figure 5

[0058] Step S2121, determining the user information of the current earphone user.

[0059] Step S2122, determining the user information of each of the plurality of historical earphone users.

[0060] Exemplarily, the user information comprises user identity information, such as user name information, user account information, etc.

[0061] Exemplarily, the user information comprises user type information, such as type information based on user age division, type information based on audio hobby division, etc.

[0062] Step S2123, determining the matching relationship based on the user information of the current earphone user and the user information of each of the plurality of historical earphone users.

[0063] The audio processing method mentioned in the embodiments of the present application enriches the determination mode of the matching relationship based on the user information of the current earphone user and the user information of each of the plurality of historical earphone users, and further improves the user experience satisfaction.

[0064] Figure 6 As shown in the embodiments provided by the present application, the step of determining the matching relationship between the current earphone user and the plurality of historical earphone users in the audio processing method comprises the following steps. Figure 1 The embodiments shown extend from the embodiments shown Figure 6 As shown in the embodiments provided by the present application, the step of determining the matching relationship between the current earphone user and the plurality of historical earphone users in the audio processing method comprises the following steps. Figure 6 The embodiments shown extend from the embodiments shown Figure 1 The differences between the embodiments shown will not be described again.

[0065] As shown in the embodiments provided by the present application, the step of determining the matching relationship between the current earphone user and the plurality of historical earphone users in the audio processing method comprises the following steps. Figure 6 Step S310, obtaining the custom equalization parameter corresponding to the current earphone user.

[0066] Exemplarily, the current earphone user inputs the custom equalization parameter by using the earphone or the electronic device connected with the earphone.

[0067] Step S320, playing the to-be-played audio based on the custom equalization parameter and the local equalization parameter.

[0068] ​​

[0069] In one embodiment of this application, after obtaining the user's custom equalization parameters, the earphone determines the user-customized equalization parameters based on the custom equalization parameters and the earphone's local equalization parameters.

[0070] For example, the current headphone user's custom equalizer parameter is EQ. a (f), the target frequency response information is Tg(f), and the local equalization parameter of the headphones is EQ. e (f) The user-defined equalization parameter is EQ' e (f), the formula is expressed as follows.

[0071] EQ a (f)·EQ e (f)·G(f)=EQ' e (f)·G(f)=EQ a (f)·Tg(f) (2)

[0072] Based on formula (2), if the current headphone user has not entered custom equalization parameters, the equalization parameters are set to... The target frequency response information is Tg(f). If the current headphone user inputs custom equalization parameters, the adjusted equalization parameters are set to EQ'. e (f) = EQ a (f)·EQ e (f), the adjusted target frequency response information is set to Tg'(f) = EQ a (f)·Tg(f), where Tg'(f) can be regarded as the target frequency response information Tg(f) after being customized by the current headphone user.

[0073] The audio processing method provided in this application embodiment obtains the custom equalization parameters corresponding to the current headphone user, and then plays the audio to be played based on the custom equalization parameters and the local equalization parameters, thereby achieving the purpose of customizing the equalization parameters corresponding to the audio to be played. Since it supports user-defined equalization parameters, this application embodiment meets the user's improvisational requirements, thereby further improving the user's listening experience.

[0074] Figure 7 The diagram shown is a schematic flowchart illustrating the process of determining the target frequency response information corresponding to the audio to be played, provided in an exemplary embodiment of this application. Figure 1 Extending from the illustrated embodiment Figure 7 The illustrated embodiment will be described in detail below. Figure 7 The illustrated embodiments and Figure 1 The differences between the embodiments shown are not repeated here, and the similarities are not repeated here.

[0075] like Figure 7As shown, in the audio processing method provided by the embodiments of the present application, the step of determining the target frequency response information corresponding to the audio to be played includes the following steps.

[0076] In step S110, the target frequency response model is determined.

[0077] Exemplarily, the target frequency response model mentioned in step S110 is a deep learning network model. In some embodiments, the input data of the target frequency response model is the audio to be played, and the output data is the target frequency response information corresponding to the audio to be played.

[0078] In step S120, the target frequency response information corresponding to the audio to be played is determined by using the target frequency response model.

[0079] The embodiments of the present application achieve the purpose of determining the target frequency response information matched with the audio to be played based on the characteristics of the audio to be played by determining the target frequency response model and then using the target frequency response model to determine the target frequency response information corresponding to the audio to be played.

[0080] In some embodiments, the training method of the target frequency response model mentioned above includes: determining a plurality of audio samples and target frequency response information corresponding to each of the plurality of audio samples, establishing an initial network model, and training the initial network model based on the plurality of audio samples and the target frequency response information corresponding to each of the plurality of audio samples to obtain the target frequency response model. The target frequency response information corresponding to the audio sample can be pre-set by the user or automatically generated according to the user's historical playing habits. That is, it can be understood that different audio samples correspond to different target frequency response information. For example, when the audio played by the earphone is switched from audio file A to audio file B, the target frequency response information will also be switched from the target frequency response information corresponding to audio file A to the target frequency response information corresponding to audio file B.

[0081] The embodiments of the present application can train the initial network model with the plurality of audio samples and the target frequency response information corresponding to each of the plurality of audio samples, and then obtain the target frequency response model capable of determining the target frequency response information corresponding to the audio to be played. Compared with the prior art in which all audio to be played corresponds to the same target frequency response information, the embodiments of the present application can fully take into account the actual situation of the audio to be played, and then use the target frequency response model to determine the target frequency response information that is more suitable for the audio to be played, thereby reducing the probability of repeated debugging by the user. In other words, the embodiments of the present application can customize the characteristics of the generated target frequency response model by using the plurality of audio samples and the target frequency response information corresponding to each of the plurality of audio samples, and further meet the individualized demand for the target frequency response information.

[0082] In some embodiments, multiple audio files and their respective target frequency response information are determined based on the user's historical playback data. For example, the user's historical playback data is obtained from the music player on the user's terminal, and multiple audio files and their respective target frequency response information are parsed from this data. Since the target frequency response information corresponding to the historical audio files is obtained from the user's historical playback data, it can be understood that the determined target frequency response information is user-approved or adjusted and conforms to the user's preferences.

[0083] The above text combined Figures 1 to 7 The method embodiments of this application are described in detail below, in conjunction with... Figure 8 and Figure 9 The present application provides a detailed description of the apparatus embodiments. It should be understood that the descriptions of the method embodiments correspond to the descriptions of the apparatus embodiments; therefore, any parts not described in detail can be found in the foregoing method embodiments.

[0084] Figure 8 The diagram shown is a structural schematic of an audio processing apparatus provided in an exemplary embodiment of this application. Figure 8 As shown, the audio processing apparatus provided in this application embodiment includes: a first determining module 100, a second determining module 200, and a third determining module 300. The first determining module 100 is used to determine the target frequency response information corresponding to the audio to be played. The second determining module 200 is used to determine the speaker path transfer function information corresponding to the current headphone user. The third determining module 300 is used to determine the local equalization parameters of the headphone based on the target frequency response information and the speaker path transfer function information to play the audio to be played.

[0085] In some embodiments, the second determining module 200 is further configured to determine the speaker path transfer function estimation information corresponding to the current headphone user, and adjust the speaker path transfer function estimation information based on the audio to be played and the playback pickup information corresponding to the audio to be played, so as to obtain the speaker path transfer function information.

[0086] In some embodiments, the second determining module 200 is further configured to: determine the speaker path transfer function information corresponding to each of the multiple historical headphone users, determine the matching relationship between the current headphone user and the multiple historical headphone users, and determine speaker path transfer function estimation information based on the matching relationship and the speaker path transfer function information corresponding to each of the multiple historical headphone users.

[0087] In some embodiments, the second determining module 200 is further configured to determine the user information of the current headphone user, determine the user information of each of the multiple historical headphone users, and determine a matching relationship based on the user information of the current headphone user and the user information of each of the multiple historical headphone users.

[0088] In some embodiments, the third determining module 300 is further configured to obtain the custom equalization parameters corresponding to the current headphone user, and play the audio to be played based on the custom equalization parameters and the local equalization parameters.

[0089] In some embodiments, the first determining module 100 is further configured to determine a target frequency response model and use the target frequency response model to determine the target frequency response information corresponding to the audio to be played.

[0090] Below, for reference Figure 9 This describes an electronic device according to embodiments of the present application. Figure 9 The diagram shown is a structural schematic of an electronic device provided in an exemplary embodiment of this application.

[0091] like Figure 9 As shown, the electronic device 400 provided in this application embodiment includes one or more processors 410 and memory 420.

[0092] The processor 410 may be a central processing unit (CPU) or other form of processing unit with data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 400 to perform desired functions.

[0093] The memory 420 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory. The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 410 may execute the program instructions to implement the audio processing methods of the various embodiments of this application described above and / or other desired functions. Various content, such as audio to be played, may also be stored in the computer-readable storage medium.

[0094] In one example, the electronic device 400 may also include an input device 430 and an output device 440, which are interconnected via a bus system and / or other forms of connection mechanism (not shown).

[0095] The input device 430 may include, for example, an audio switching button.

[0096] The output device 440 can output various information to the outside, including audio to be played. The output device 440 may include, for example, a display, a communication network, a speaker, and remote output devices connected thereto.

[0097] Of course, in order to simplify, Figure 9 Only some of the components in the electronic device 400 related to the present application are shown in the figure, and components such as buses, input / output interfaces, and the like are omitted. In addition, the electronic device 400 can include any other appropriate components according to specific application cases.

[0098] Exemplarily, the electronic device 400 can be at least one of a sound box, a voice recorder, and a hearing aid.

[0099] In addition to the method and device described above, an embodiment of the present application can also be a computer program product, which includes computer program instructions that, when executed by a processor, cause the processor to perform the steps of the audio processing method according to various embodiments of the present application described in the above “Exemplary Method” section of the present specification.

[0100] The computer program product can be written in any combination of one or more programming languages, including an object-oriented programming language such as Java, C++, and the like, and conventional procedural programming languages, such as the “C” programming language, or the like. The program code can execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server.

[0101] In addition, an embodiment of the present application can also be a computer readable storage medium, which stores computer program instructions, the computer program instructions, when executed by a processor, cause the processor to perform the steps of the audio processing method according to various embodiments of the present application described in the above “Exemplary Method” section of the present specification.

[0102] The computer readable storage medium can take any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium, for example, can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any combination of the above. More specific examples (a non-exhaustive list) of the readable storage medium include an electrical connection having one or more wires, a portable disc, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any appropriate combination of the above.

[0103] The above describes the basic principles of the present application in combination with specific embodiments, but it needs to be pointed out that the advantages, benefits, effects and the like mentioned in the present application are only examples and are not limiting, and these advantages, benefits, effects and the like cannot be considered as necessary for each embodiment of the present application. In addition, the above specific details disclosed are only for the purpose of example and understanding, and are not limiting, and the above details do not limit the present application to be necessarily implemented with the above specific details.

[0104] The block diagrams of the devices, apparatuses, equipment, systems involved in the present application are only illustrative examples and are not intended to require or imply the connection, arrangement, configuration shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, equipment, systems can be connected, arranged, configured in any manner. Words such as "include", "contain", "have" and the like are open-ended words, mean "including but not limited to", and can be used interchangeably. The words "or" and "and" used herein mean the word "and / or", and can be used interchangeably unless the context clearly indicates otherwise. The word "such as" used herein means the phrase "such as but not limited to", and can be used interchangeably.

[0105] It also needs to be pointed out that in the devices, equipment and methods of the present application, each component or each step can be decomposed and / or recombined. These decompositions and / or recombinations should be considered as equivalent solutions of the present application.

[0106] The above description of the disclosed aspects is provided so that any person skilled in the art can make or use the present application. Various modifications to these aspects will be apparent to those skilled in the art, and the general principles defined herein can be applied to other aspects without departing from the scope of the present application. Therefore, the present application is not intended to be limited to the aspects shown herein, but is intended to be accorded the widest scope consistent with the principles and novel features disclosed herein.

[0107] The above description has been given for the purpose of illustration and description. Furthermore, this description is not intended to limit the embodiments of the present application to the forms disclosed herein. Although a number of example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims

1. An audio processing method, characterized by, Applied to earphone, comprising: Determine the target frequency response information corresponding to the to-be-played audio; Determine the loudspeaker path transfer function information corresponding to the current earphone user of the earphone; Based on the target frequency response information and the loudspeaker path transfer function information, determine the local equalization parameter of the earphone to play the to-be-played audio; The local equalization parameter of the earphone is the ratio of the target frequency response information and the loudspeaker path transfer function information; The determination of the loudspeaker path transfer function information corresponding to the current earphone user of the earphone comprises: Determine the loudspeaker path transfer function estimation information corresponding to the current earphone user; Based on the loudspeaker path transfer function estimation information, determine the first playback pickup information; Based on the difference information between the first playback pickup information and the second playback pickup information corresponding to the to-be-played audio, adjust the loudspeaker path transfer function estimation information until the loudspeaker path transfer function estimation information is equivalent to the loudspeaker path transfer function information based on the minimized difference information, wherein the second playback pickup information represents the audio information collected by the pickup located at the predetermined position of the sound outlet of the earphone when the earphone plays the to-be-played audio.

2. The audio processing method of claim 1, wherein, The determination of the loudspeaker path transfer function estimation information corresponding to the current earphone user comprises: Determine the loudspeaker path transfer function information corresponding to each of the plurality of historical earphone users of the earphone; Determine the matching relationship between the current earphone user and the plurality of historical earphone users; Based on the matching relationship and the loudspeaker path transfer function information corresponding to each of the plurality of historical earphone users, determine the loudspeaker path transfer function estimation information.

3. The audio processing method of claim 2, wherein, The determination of the loudspeaker path transfer function estimation information based on the matching relationship and the loudspeaker path transfer function information corresponding to each of the plurality of historical earphone users comprises: If it is determined based on the matching relationship that there is a historical earphone user matched with the current earphone user, then based on the loudspeaker path transfer function information corresponding to the historical earphone user matched with the current earphone user, determine the loudspeaker path transfer function estimation information.

4. The audio processing method of any of claims 2 or 3, wherein, The determination of the matching relationship between the current earphone user and the plurality of historical earphone users comprises: Determine the user information of the current earphone user, wherein the user information includes user identity information and / or user type information; Determine the user information of each of the plurality of historical earphone users; Based on the user information of the current earphone user and the user information of each of the plurality of historical earphone users, determine the matching relationship.

5. The audio processing method of any one of claims 1-3, wherein, Also includes: Obtain the custom equalization parameter corresponding to the current earphone user; Based on the custom equalization parameter and the local equalization parameter, play the to-be-played audio.

6. The audio processing method of any one of claims 1-3, wherein, The determination of the target frequency response information corresponding to the to-be-played audio comprises: Determine the target frequency response model; Determine the target frequency response information corresponding to the to-be-played audio by using the target frequency response model.

7. An audio processing apparatus, characterized by comprising: Applied to earphone, comprising: A first determination module for determining the target frequency response information corresponding to the to-be-played audio; A second determining module is configured to determine loudspeaker path transfer function information corresponding to a current earphone user of the earphone; A third determining module is configured to determine a local equalization parameter of the earphone based on the target frequency response information and the loudspeaker path transfer function information, so as to play the to-be-played audio; The local equalization parameter of the earphone is a ratio of the target frequency response information to the loudspeaker path transfer function information; The determination of the loudspeaker path transfer function information corresponding to the current earphone user of the earphone comprises: Determining loudspeaker path transfer function estimation information corresponding to the current earphone user; Determining first playback pickup information based on the loudspeaker path transfer function estimation information; Adjusting the loudspeaker path transfer function estimation information based on difference information between the first playback pickup information and second playback pickup information corresponding to the to-be-played audio, until the loudspeaker path transfer function estimation information is equivalent to the loudspeaker path transfer function information based on minimized difference information, wherein the second playback pickup information represents audio information collected by a pickup microphone located at a preset position of a sound outlet of the earphone when the earphone plays the to-be-played audio.

8. A computer-readable storage medium, characterized in that, The storage medium stores instructions, and when the instructions are executed by a processor of an electronic device, the electronic device can execute the audio processing method in any one of claims 1 to 6.

9. An electronic device, comprising: The electronic device comprises: A processor; A memory for storing computer executable instructions; The processor is configured to execute the computer executable instructions to implement the audio processing method in any one of claims 1 to 6.

Images