Audio processing apparatus and method

Abstract

The present specification provides an audio processing apparatus and method. The audio processing device comprises a sound production module and an audio processing module, the sound production module comprises N sound production units, and each sound production unit outputs an audio signal of a predetermined frequency band during operation; the audio processing module carries out frequency division processing on initial audio data after obtaining the initial audio data, at least obtains M sub-audio data of corresponding M sub-frequency bands, each sub-frequency band corresponds to a preset frequency band output by a corresponding sound production unit in N sound production units, and according to target audio characteristics of the M sub-audio data, the M sub-audio data output by the corresponding sound production unit in the N sound production units are processed according to the target audio characteristics of the M sub-audio data. And performing audio adjustment on the corresponding M sub-audio data to obtain M pieces of tuned audio data, and inputting each piece of tuned audio data to the corresponding sound production unit. According to the technical scheme of the embodiment of the invention, the sound quality effect of audio processing of the plurality of sound production units can be improved.

Description

Technical Field

[0001] The present invention relates to the field of audio processing, and in particular to an audio processing device and method. Background Art

[0002] With the development of true wireless Bluetooth headset technology, people have higher and higher requirements for the sound quality of headsets.

[0003] In the related technical solution, the audio data is directly sent to the sound unit of the audio playback device such as the earphone for audio playback. However, since the mainstream earphones basically use one sound unit, it is difficult for a single sound unit to achieve a good audio playback effect, that is, a single sound unit leads to poor sound quality of audio processing.

[0004] Therefore, how to improve the sound quality of audio played by an audio player has become a technical problem that needs to be solved urgently.

[0005] The content of the background technology section is only the information known to the inventor personally, and does not mean that the above information has entered the public domain before the application date of this disclosure, nor does it mean that it can become the prior art of the present disclosure. Summary of the invention

[0006] The present specification provides an audio processing device and method, which can improve the sound quality of audio played by an audio playback device.

[0007] In a first aspect, this specification provides an audio processing device, comprising:

[0008] A sound module, comprising N sound units, each of which outputs an audio signal of a predetermined frequency band when in operation, wherein N is an integer greater than 1; and

[0009] An audio processing module is communicatively connected to the sound module, and the audio processing module is configured as follows:

[0010] Get the initial audio data,

[0011] The original audio data is subjected to frequency division processing to obtain at least M sub-audio data of corresponding M sub-frequency ranges, wherein each sub-frequency range corresponds to the predetermined frequency range output by the corresponding sound-emitting unit among the N sound-emitting units, and M is an integer greater than 1.

[0012] According to the target audio characteristics of the M sub-audio data, audio adjustments are performed on the corresponding M sub-audio data to obtain M adjusted audio data, and

[0013] Each of the M adjusted audio data is input into the corresponding sound emitting unit.

[0014] In some embodiments, based on the above solution, in order to perform audio adjustment on the M sub-audio data respectively, the audio processing module is configured to, for each of the sub-audio data:

[0015] The audio adjustment is performed on the sub-audio data according to an audio adjustment model corresponding to the target audio characteristic of the sub-audio data, wherein the audio adjustment model corresponds to the sub-frequency band where the sub-audio data is located.

[0016] In some embodiments, based on the above solution, the target audio characteristic includes a volume gain; before performing the audio adjustment on the sub-audio data, the audio processing module is further configured to:

[0017] Obtaining the volume gain of the sub-audio data of the sub-frequency band;

[0018] The audio adjustment model corresponding to the sub-audio data of the sub-frequency band is determined according to the corresponding relationship between the volume gain and the audio adjustment model.

[0019] In some embodiments, based on the above solution, the volume gain includes multiple volume levels, and different volume levels in the multiple volume levels correspond to different audio adjustment models.

[0020] In some embodiments, based on the above solution, the audio processing module is further configured to, for each of the M sub-bands:

[0021] Obtaining the adjusted audio data of a predetermined time length as sample data (sampledata);

[0022] Comparing the audio data of the sample data with reference audio data, the reference audio data being audio data corresponding to a reference audio curve of the audio adjustment model corresponding to the sub-frequency band;

[0023] The model parameters of the audio adjustment model are adjusted according to the comparison result.

[0024] In some embodiments, based on the above solution, the audio processing module is further configured as follows:

[0025] An updated backup corresponding to the reference audio data of the audio adjustment model is obtained, and the reference audio data is updated according to the updated backup.

[0026] In some embodiments, based on the above scheme, the audio adjustment model is an equalizer adjustment model, and the model parameters are equalizer parameters.

[0027] In some embodiments, based on the above scheme, the N sound units include a bone conduction sound unit and an air conduction sound unit, and the bone conduction sound unit outputs medium and high frequency audio signals when running, and the air conduction sound unit outputs low frequency audio signals when running.

[0028] In some embodiments, based on the above scheme, the initial audio data includes audio data of K channels, and the frequency band interval of each channel includes the m sub-frequency bands, where m=M / K, and K is an integer greater than or equal to 1.

[0029] In some embodiments, based on the above scheme, the K channels include a left channel and a right channel, the m sub-frequency bands corresponding to the left channel include mid-high frequencies of the left channel and low frequencies of the left channel, and the m sub-frequency bands corresponding to the right channel include mid-high frequencies of the right channel and low frequencies of the right channel.

[0030] In some embodiments, based on the above solution, the corresponding relationship between the sound channels and the sound emission units includes at least one of a one-to-many relationship and a many-to-one relationship.

[0031] In some embodiments, based on the above solution, the audio processing device is a headset.

[0032] In a second aspect, the present specification also provides an audio processing method, which is applied to an audio processing device, wherein the audio processing device includes N sound-emitting units, each of which is used to output an audio signal in a predetermined frequency band, wherein N is an integer greater than 1, and the method includes:

[0033] Obtaining initial audio data;

[0034] Performing frequency division processing on the initial audio data to obtain at least M sub-audio data of corresponding M sub-frequency ranges, wherein each sub-frequency range corresponds to the predetermined frequency range output by the corresponding sound-emitting unit among the N sound-emitting units, and M is an integer greater than 1;

[0035] According to the target audio characteristics of the M sub-audio data, respectively perform audio adjustments on the corresponding M sub-audio data to obtain M adjusted audio data; and

[0036] Each of the M adjusted audio data is input into the corresponding sound emitting unit.

[0037] In some embodiments, based on the above solution, the audio adjustment is performed on the corresponding M sub-audio data respectively, including, for each of the sub-audio data:

[0038] The audio adjustment is performed on the sub-audio data according to an audio adjustment model corresponding to the target audio characteristic of the sub-audio data, wherein the audio adjustment model corresponds to the sub-frequency band where the sub-audio data is located.

[0039] In some embodiments, based on the above solution, the target audio characteristic includes a volume gain, and before performing the audio adjustment on the sub-audio data, the method further includes:

[0040] Obtaining the volume gain of the sub-audio data of the sub-frequency band;

[0041] The audio adjustment model corresponding to the sub-audio data of the sub-frequency band is determined according to the corresponding relationship between the volume gain and the audio adjustment model.

[0042] In some embodiments, based on the above solution, the volume gain includes multiple volume levels, and different volume levels in the multiple volume levels correspond to different audio adjustment models.

[0043] In some embodiments, based on the above solution, the method further includes, for each sub-band of the M sub-bands:

[0044] Obtaining the adjusted audio data of a predetermined time length as sample data (sampledata);

[0045] Comparing the audio data of the sample data with reference audio data, the reference audio data being audio data corresponding to a reference audio curve of the audio adjustment model corresponding to the sub-frequency band;

[0046] The model parameters of the audio adjustment model are adjusted according to the comparison result.

[0047] In some embodiments, based on the above solution, the audio processing module is further configured as follows:

[0048] An updated backup corresponding to the reference audio data is obtained, and the reference audio data is updated according to the updated backup.

[0049] In some embodiments, based on the above scheme, the audio adjustment model is an equalizer adjustment model, and the model parameters are equalizer parameters.

[0050] In some embodiments, based on the above scheme, the N sound units include a bone conduction sound unit and an air conduction sound unit, and the bone conduction sound unit outputs medium and high frequency audio signals when running, and the air conduction sound unit outputs low frequency audio signals when running.

[0051] In some embodiments, based on the above scheme, the initial audio data includes audio data of K channels, and the frequency band interval of each channel includes m sub-bands, where m=M / K, and K is an integer greater than or equal to 1.

[0052] In some embodiments, based on the above scheme, the K channels include a left channel and a right channel, the m sub-frequency bands corresponding to the left channel include mid-high frequencies of the left channel and low frequencies of the left channel, and the m sub-frequency bands corresponding to the right channel include mid-high frequencies of the right channel and low frequencies of the right channel.

[0053] In some embodiments, based on the above solution, the corresponding relationship between the sound channels and the sound emission units includes at least one of a one-to-many relationship and a many-to-one relationship.

[0054] In some embodiments, based on the above solution, the audio processing device is a headset.

[0055] In a third aspect, the present specification also provides an audio processing system, comprising: at least one storage medium storing at least one instruction set for performing audio processing; and at least one processor communicatively connected to the at least one storage medium, wherein when the audio processing system is running, the at least one processor reads the at least one instruction set and executes the above-mentioned audio processing method according to the instructions of the at least one instruction set.

[0056] It can be seen from the above technical solutions that the audio processing device, audio processing method and system provided in the embodiments of this specification, on the one hand, perform frequency division processing on the initial audio data to obtain M sub-audio data of corresponding M sub-frequency bands, each sub-frequency band corresponds to a predetermined frequency band output by one of the N sound units, and can adapt the sub-frequency band where the sub-audio data is located to the working frequency band of the sound unit, thereby improving the sound quality effect of the audio played by the sound unit; on the other hand, according to the target audio characteristics of the sub-audio data, audio adjustment is performed on the sub-audio data, and the adjusted audio data is input into the corresponding sound unit, and according to the audio characteristics of the sub-audio data, audio adjustment can be performed on the sub-audio data to be played by the sound unit, so that the audio characteristics of the adjusted audio data of the sub-frequency band are more adapted to the audio characteristics of the corresponding sound unit, thereby ensuring that the sound emitted by each sound unit in the sound module has a better sound effect, thereby further improving the sound quality effect of the audio played by the sound unit.

[0057] Other functions of the audio processing device and method provided by this specification will be partially listed in the following description. Based on the description, the content introduced by the following figures and examples will be obvious to those of ordinary skill in the art. The creative aspects of the audio processing device and method provided by this specification can be fully explained by practicing or using the methods, devices and combinations described in the following detailed examples. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] In order to more clearly illustrate the technical solutions in the embodiments of this specification, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0059] Figure 1 A schematic diagram of an application scenario of an audio processing device provided according to an embodiment of this specification is shown;

[0060] Figure 2 A hardware structure diagram of an audio processing device provided according to an embodiment of this specification is shown;

[0061] Figure 3 A schematic diagram of the structure of an audio processing module provided according to an embodiment of this specification is shown;

[0062] Figure 4 Another structural schematic diagram of an audio processing module provided according to an embodiment of this specification is shown;

[0063] Figure 5 Another structural schematic diagram of an audio processing module provided according to an embodiment of this specification is shown;

[0064] Figure 6 Another structural schematic diagram of an audio processing module provided according to an embodiment of this specification is shown;

[0065] Figure 7 A schematic diagram showing the structure of another audio processing device provided according to an embodiment of this specification is shown;

[0066] Figure 8 A schematic diagram of a flow chart of an audio processing method provided according to an embodiment of this specification is shown;

[0067] Fig. 9 A schematic flow chart showing another audio processing method provided according to an embodiment of this specification; and

[0068] Fig.10A schematic diagram of a flow chart of adjusting model parameters of an audio adjustment model provided according to an embodiment of this specification is shown. DETAILED DESCRIPTION

[0069] The following description provides specific application scenarios and requirements of this specification, with the purpose of enabling those skilled in the art to make and use the contents of this specification. Various local modifications to the disclosed embodiments will be apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of this specification. Therefore, this specification is not limited to the embodiments shown, but to the widest scope consistent with the claims.

[0070] The terms used herein are only used for the purpose of describing specific example embodiments and are not restrictive. For example, unless the context clearly indicates otherwise, as used herein, the singular forms "a", "an" and "the" may also include plural forms. When used in this specification, the terms "include", "comprise" and / or "contain" mean that the associated integers, steps, operations, elements and / or components exist, but do not exclude the existence of one or more other features, integers, steps, operations, elements, components and / or groups or that other features, integers, steps, operations, elements, components and / or groups may be added in the system / method.

[0071] In view of the following description, these and other features of the present specification, as well as the operation and function of the related elements of the structure, and the economy of the combination and manufacture of the parts can be significantly improved. Reference is made to the accompanying drawings, all of which form a part of this specification. However, it should be clearly understood that the drawings are for illustration and description purposes only and are not intended to limit the scope of this specification. It should also be understood that the drawings are not drawn to scale.

[0072] The flowcharts used in this specification illustrate the operations implemented by the system according to some embodiments in this specification. It should be clearly understood that the operations of the flowcharts may not be implemented in sequence. On the contrary, the operations may be implemented in reverse order or simultaneously. In addition, one or more other operations may be added to the flowchart. One or more operations may be removed from the flowchart.

[0073] Before describing the specific embodiments of this specification, the application scenarios of this specification are introduced as follows.

[0074] This specification relates to the use scenarios of audio processing devices. An exemplary use scenario is as follows: after the audio processing device obtains the initial audio data output by the target device, it performs frequency division processing on the initial audio data to obtain sub-audio data of M sub-frequency bands, and plays the target sub-audio data corresponding to the sub-frequency band through the corresponding sounding units among the N sounding units, thereby forming a reverberation sound, where M and N are both integers greater than 1.

[0075] Figure 1 FIG. 1 shows a schematic diagram of an application scenario of an audio processing device provided according to an embodiment of this specification. Figure 1 As shown, the application scenario 001 may include an audio processing device 10 , a target device 20 , and a network 30 .

[0076] The audio processing device 10 may include a sound module 100 and an audio processing module 200, the sound module 100 includes N sound units 110, each sound unit 110 outputs an audio signal of a predetermined frequency band when in operation, wherein N is an integer greater than 1. The audio processing module 200 may be connected to the sound module 100 for communication. The audio processing module 200 may obtain initial audio data from the target device 20, and perform frequency division processing on the initial audio data to obtain sub-audio data of M sub-frequency bands, and play the sub-audio data corresponding to the sub-frequency band through the corresponding sound unit 110 in the N sound units 110 of the sound module 100, thereby forming a reverberation sound. In some embodiments, the audio processing device 10 may store data or instructions for executing the audio processing method described in this specification, and may execute or be used to execute the above data or instructions. In some embodiments, the audio processing device 10 may include a hardware device having a data information processing function and a necessary program required to drive the hardware device to work. For example, the audio processing device 10 may be a headset, a large home or commercial sound system, etc. The above audio processing method will be introduced in the subsequent content of this article.

[0077] The target device 20 may be an electronic device with an audio data output function. In some embodiments, the target device 20 may include a mobile device, a tablet computer, a laptop computer, a built-in device of a motor vehicle, or the like, or any combination thereof. In some embodiments, the mobile device may include a smart home device, a smart mobile device, a virtual reality device, an augmented reality device, or the like, or any combination thereof. In some embodiments, the smart home device may include a smart TV, a desktop computer, a smart speaker, or the like, or any combination thereof. In some embodiments, the smart mobile device may include a smart phone, a personal digital assistant, a gaming device, a navigation device, or the like, or any combination thereof. In some embodiments, the virtual reality device or the augmented reality device may include a virtual reality helmet, virtual reality glasses, a virtual reality handle, an augmented reality helmet, augmented reality glasses, an augmented reality handle, or the like, or any combination thereof. For example, the virtual reality device or the augmented reality device may include head-mounted glasses, a head-mounted display, or the like. In some embodiments, the built-in device in the motor vehicle may include an onboard computer, an onboard TV, or the like. In some embodiments, the target device 20 may include an audio acquisition device for acquiring audio data in the target space, thereby acquiring initial audio data. In some embodiments, the target device 20 may also receive initial audio data from other devices.

[0078] In some embodiments, the target device 20 may be installed with one or more application programs (APPs). The above APPs can provide users with the ability and interface to interact with the outside world. The above APPs include but are not limited to: web browser APP programs, search APP programs, chat APP programs, shopping APP programs, video APP programs, financial management APP programs, instant messaging tools, email clients, social platform software, etc. In some embodiments, a target APP may be installed on the target device 20. The above target APP can generate or obtain initial audio data, or the above target APP can receive initial audio data from other devices.

[0079] The network 30 is used to provide a medium for communication connection between the audio processing device 10 and the target device 20. The network 30 can facilitate the exchange of information or data. Figure 1 As shown, the audio processing device 10 and the target device 20 can be connected to the network 30 and transmit information or data to each other through the network 30. In some embodiments, the network 30 can be any type of wireless network. For example, the network 30 can include a telecommunications network, an intranet, the Internet, a local area network (LAN), a wide area network (WAN), a wireless local area network (WLAN), a metropolitan area network (MAN), a public switched telephone network (PSTN), a Bluetooth TM Network, ZigBee TMnetwork, near field communication (NFC) network or similar network. For example, the network 30 may be a Bluetooth TM In this case, the audio processing device 10 may be a Bluetooth-enabled TM (bluetooth TM ) protocol audio processing device; the target device 20 may be a device supporting Bluetooth TM The audio processing device 10 can communicate with the target device 20 based on Bluetooth TM In some embodiments, the audio processing device 10 can also perform data transmission with the target device 20 via a wired network or a local area network.

[0080] It should be understood that Figure 1 The number of audio processing devices 10, target devices 20 and networks 30 in the embodiment is only illustrative. Any number of audio processing devices 10, target devices 20 and networks 30 may be provided according to implementation requirements.

[0081] Figure 2 FIG. 1 shows a hardware structure diagram of an audio processing device 10 provided according to some embodiments of this specification. Figure 2 As shown, the audio processing device 10 may include: a sound module 100 and an audio processing module 200 .

[0082] In some embodiments, the sound module 100 may include N sound units 110, where N is an integer greater than 1. Each sound unit 110 outputs an audio signal of a predetermined frequency band when in operation. The sound unit 110 may include one or more devices that can emit sound, for example, the sound unit 110 may include one or more speakers. Different sound units 110 are used to output audio data of different frequency bands. In other words, different sound units 110 may have different working frequency bands. For example, the audio characteristics of some sound units 110 are to have better restoration of intermediate frequency audio data and / or to produce thicker and / or butter-like sound quality, then the working frequency band of these sound units 110 is the intermediate frequency band; the audio characteristics of some sound units 110 are to have better restoration of high frequency audio data and / or to produce pure and clear sound quality, then the working frequency band of these sound units 110 is the high frequency band.

[0083] Taking the case where the sound unit 110 includes a bone conduction sound unit and an air conduction sound unit, the bone conduction sound unit has a better sound effect for medium and high frequency audio data, and the predetermined frequency band corresponding to the bone conduction sound unit, that is, the working frequency band, is the medium and high frequency band; while the air conduction sound unit has a better sound effect for low frequency audio data, and the predetermined frequency band corresponding to the air conduction sound unit, that is, the working frequency band, is the low frequency band. For human ears, low frequency may refer to a frequency band of approximately 20 Hz to 150 Hz, medium frequency may refer to a frequency band of approximately 150 Hz to 5 kHz, high frequency may refer to a frequency band of approximately 5 kHz to 20 kHz, medium and low frequency may refer to a frequency band of approximately 150 Hz to 500 Hz, and medium and high frequency may refer to a frequency band of 500 Hz to 5 kHz.

[0084] Those skilled in the art should understand that the distinction of the above frequency bands is just an example to give a rough range. The definition of the above frequency bands can change with different industries, different application scenarios and different classification standards. For example, in some other application scenarios, low frequency refers to the frequency band of roughly 20Hz to 80Hz, medium-low frequency can refer to the frequency band of roughly 80Hz-160Hz, medium frequency can refer to the frequency band of roughly 160Hz to 1280Hz, medium-high frequency can refer to the frequency band of roughly 1280Hz-2560Hz, and high frequency can refer to the frequency band of roughly 2560Hz to 20KHz.

[0085] Further, the audio processing module 200 is configured to obtain initial audio data, perform frequency division processing on the initial audio data, and obtain at least M sub-audio data of corresponding M sub-frequency bands, where M is an integer greater than 1, and M is greater than or equal to N. Each sub-frequency band corresponds to a predetermined frequency band output by a corresponding sound-emitting unit among the N sound-emitting units, that is, each sub-frequency band among the M sub-frequency bands is adapted to the working frequency band of the corresponding sound-emitting unit 110. For example, if a sound-emitting unit 110 can emit clear sound quality in the high frequency band, but the sound performance in the intermediate frequency and low frequency bands is ordinary, then the predetermined frequency band (i.e., the working frequency band) corresponding to the sound-emitting unit 110 is the high frequency band, and the sub-audio data corresponding to the sound-emitting unit has more high-frequency audio data, and the amount of audio data in the intermediate frequency and low frequency parts is less or even absent.

[0086] The initial audio data may be digitized audio data of one or more channels. The initial audio data may include audio data of pulse code modulation (PCM) or other types of digitized audio data. Taking the initial audio data as PCM audio data as an example, the initial audio data may be a binary sequence directly formed by converting an analog signal by digital-to-analog conversion. There may be multiple ways for the audio processing module 200 to obtain the initial audio data. For example, the audio processing module 200 may directly receive the initial audio data sent by the target device 20, or may receive the initial audio data sent by the audio acquisition device, or may obtain at least one audio data as the initial audio data in a preset audio data set, or may also obtain the original audio data. Then, the audio processing module 200 may select audio data of one or more channels from the original audio data as the initial audio data, or the audio processing module 200 may further include an audio acquisition circuit. The above-mentioned audio processing module 200 may collect audio data through the audio acquisition circuit, and perform digital-to-analog conversion on the collected original audio data, thereby obtaining the initial audio data.

[0087] In some example embodiments, the initial audio data includes audio data of K channels, where K is an integer greater than or equal to 1. For example, let K=2, and the 2 channels include a left channel and a right channel. The frequency spectrum range of each channel may be the same, such as the frequency spectrum range of the left channel and the right channel is the same. In other example embodiments, there may be channels in the K channels whose frequency spectrum range is different from the frequency spectrum range of other channels. For example, let K=6, and the 6 channels include 5 full-bandwidth channels and 1 low-frequency channel, the frequency spectrum range of the 5 full-bandwidth channels is 3-20KHz, and the frequency spectrum range of the 1 low-frequency channel is 3-120Hz.

[0088] Further, in some exemplary embodiments, the frequency spectrum of the audio data of each of the K channels may include m sub-bands, m=M / K, and the i-th sounding unit 110 of the N sounding units 110 has a desired sound effect in the j-th predetermined frequency band, i is an integer in [1, N], and j is an integer in [1, m]. Taking the frequency spectrum of the initial audio data distributed in [20Hz, 20KHz] as an example, the m sub-bands may completely cover the entire frequency spectrum, or may cover a pre-set frequency spectrum range such as high frequency, medium frequency and low frequency, and there may be overlapping frequency bands between the m sub-bands, or they may be completely independent frequency bands, and so on.

[0089] It should be noted that, although the example in which each channel corresponds to the same number of sub-bands is used for description, those skilled in the art should understand that different channels may correspond to different numbers of sub-bands, which is also within the scope of the embodiments of this specification.

[0090] Further, in some exemplary embodiments, the initial audio data may be frequency-divided by software or by hardware. The following will describe in detail the two frequency-dividing processing methods, namely, software frequency-dividing processing and hardware frequency-dividing processing.

[0091] 1. Software frequency division processing

[0092] The audio processing module 200 may include at least one processor, which can execute instructions in the frequency division processing instruction set, and use the frequency division processing algorithm to perform frequency division processing on the initial audio data of K channels to obtain m sub-audio data of m sub-frequency bands of each channel, where M=K*m, K is an integer greater than or equal to 1. For example, if the initial audio data is 2 channels and there are 4 sound units, each channel corresponds to 2 sound units and 2 sub-frequency bands, then M=N=4, K=2, and m=2.

[0093] Taking the frequency division processing of the initial audio data of the j-th channel as an example, for the i-th sub-band of the j-th channel, retain the amplitude on the i-th sub-band, attenuate the amplitudes in other sub-bands, and obtain the sub-audio data of the i-th sub-band of the j-th channel, where i is any integer in [1, m], and j is any integer in [1, K]; or, for the i-th sub-band of the j-th channel, retain the audio data of the i-th sub-band, filter out the audio data of other sub-bands, and obtain the sub-audio data of the i-th sub-band of the j-th channel. In other words, the sub-audio data of the i-th sub-band of the j-th channel adapts to the audio characteristics of the i-th sound unit 110 corresponding to the j-th channel.

[0094] 2. Hardware frequency division processing:

[0095] The audio processing module 200 may include a frequency division circuit, and the initial audio data may be frequency divided by the frequency division circuit. For example, the audio processing module 200 may classify the initial audio data into a high-frequency band, a mid-frequency band, and a low-frequency band, etc., by the frequency division circuit. The circuit structure of the frequency division circuit includes a filter circuit composed of a capacitor and an inductor coil, for example, a high-frequency band is obtained by a high-pass filter circuit, a heavy-frequency band is obtained by a mid-pass filter circuit, and a low-frequency band is obtained by a low-pass filter. The specific processing method of the hardware frequency division may be the same as the processing method of the software frequency division.

[0096] For example, the multi-channel includes a left channel and a right channel. In the case of software frequency division processing and / or hardware frequency division processing, the audio processing module 200 performs frequency division processing on the audio data of each channel through a frequency division circuit and / or a distribution processing algorithm to obtain frequency division data of multiple sub-bands corresponding to the audio data of each channel. Among them, the multiple sub-bands corresponding to the left channel include the left channel high frequency, the left channel intermediate frequency and the left channel low frequency, and the multiple sub-bands corresponding to the right channel include the right channel high frequency, the right channel intermediate frequency and the right channel low frequency.

[0097] Furthermore, the audio processing module 200 performs audio adjustments on the corresponding M sub-audio data according to the target audio characteristics of the M sub-audio data to obtain M adjusted audio data, and inputs each of the M adjusted audio data into the corresponding sound unit 110.

[0098] In some example embodiments, the target audio characteristic may include a volume gain, and the corresponding M sub-audio data are respectively audio-adjusted according to the volume gains of the M sub-audio data. For example, the reference volume gain of each frequency point of the predetermined frequency band of the sound-emitting unit 110 corresponding to the target sub-frequency band is obtained, and the sub-audio data of each frequency point of the target sub-frequency band are respectively audio-adjusted according to the difference between the volume gain of the sub-audio data of each frequency point of the target sub-frequency band and the reference volume gain of each frequency point of the corresponding predetermined frequency band, so as to reduce the difference between the volume gain of the corresponding frequency point and the reference volume gain. For example, if the volume gain of the sub-audio data of a certain frequency point of the sub-frequency band is greater than the corresponding reference volume gain, the volume gain at the frequency point is reduced; if the volume gain of the sub-audio data at a certain frequency point of the sub-frequency band is less than the corresponding reference volume gain, the volume gain at the frequency point is increased. Among them, the reference volume gain can be the volume gain corresponding to the reference audio curve of the better sound effect of each sound-emitting unit set in advance.

[0099] In some example embodiments, the target audio characteristics may include timbre characteristics, and audio adjustments are performed on the corresponding M sub-audio data according to the timbre characteristics of the M sub-audio data. For example, in some embodiments, the timbre characteristics of the sub-audio data of each frequency point of the target sub-frequency band are determined, and audio adjustments are performed on the sub-audio data of each frequency point of the target sub-frequency band according to the timbre characteristics of the sub-audio data of each frequency point. For example, if the timbre characteristics include vocal characteristics, and the target sub-frequency band is a mid-frequency band, the gain of each frequency point of the mid-frequency band is increased to make the vocals more powerful; if the timbre characteristics include guitar characteristics, and the target sub-frequency band is a high-frequency band, the gain of each frequency point of the high-frequency band is appropriately increased to enhance the spatial sense of the guitar.

[0100] It should be noted that although the target audio characteristics are described as volume gain or timbre characteristics, those skilled in the art should understand that the target audio characteristics may also include other appropriate audio characteristics such as pitch, short-time energy, short-time average amplitude or spectrum width, which are also within the scope of the embodiments of this specification.

[0101] After performing audio adjustment processing on the sub-audio data of each sub-frequency band, the audio processing module 200 obtains the adjusted audio data corresponding to each sub-frequency band, and the adjusted audio data of each sub-frequency band is adapted to the audio characteristics of the corresponding sound-emitting unit 110, and the adjusted audio data corresponding to each sub-frequency band is respectively input to the corresponding sound-emitting unit. For example, the sub-audio data of m sub-frequency bands are respectively input to the corresponding m sound-emitting units 110, and each sound-emitting unit 110 converts the sub-audio data of the corresponding sub-frequency band into the target audio to form a reverberant sound.

[0102] In an exemplary embodiment, the initial audio data includes audio data of K channels, each channel corresponds to m sounding units 110, or at least two channels correspond to m sounding units. In the case where each channel corresponds to m sounding units, the audio processing module 200 inputs the sub-audio data of the m sub-frequency bands of each channel in the K channels to the corresponding m sounding units 110 respectively.

[0103] In the case where at least two channels correspond to m sounding units, the audio processing module 200 combines the sub-audio data of the sub-frequency bands corresponding to each of the at least two channels to obtain integrated audio data, and inputs the integrated audio data of each sub-frequency band to the sounding unit 110 of the corresponding frequency band. For example, assuming that the k1 channel and the k2 channel correspond to the same three sounding units, the sub-audio data of the three sub-frequency bands corresponding to the k1 channel are {m11, m12, m13}, and the sub-audio data of the three sub-frequency bands corresponding to the k2 channel are {m21, m22, m23}, the sub-audio data of the m sub-frequency bands corresponding to the k1 channel and the sub-audio data of the m sub-frequency bands corresponding to the k2 channel are combined to obtain integrated audio data, namely {(m11+m21), (m12+m22), (m13+m23)}, and the integrated audio data of each sub-frequency band are input to the sounding unit 110 of the corresponding frequency band.

[0104] according to Figure 2According to the technical solution in the example embodiment, on the one hand, the initial audio data is frequency-divided to obtain M sub-audio data of corresponding M sub-frequency bands, each sub-frequency band corresponds to a predetermined frequency band output by one of the N sound-emitting units, and the sub-frequency band where the sub-audio data is located can be adapted to the working frequency band of the sound-emitting unit, thereby improving the sound quality effect of the audio played by the sound-emitting unit; on the other hand, according to the target audio characteristics of the sub-audio data, the sub-audio data is audio-adjusted, and the adjusted audio data is input into the corresponding sound-emitting unit, and according to the audio characteristics of the sub-audio data, the sub-audio data to be played by the sound-emitting unit can be audio-adjusted, thereby making the audio characteristics of the adjusted audio data of the sub-frequency band more adapted to the audio characteristics of the corresponding sound-emitting unit, thereby ensuring that the sound emitted by each sound-emitting unit in the sound module has a better sound effect, thereby further improving the sound quality effect of the audio played by the sound-emitting unit.

[0105] In addition, in some example embodiments, after acquiring the original audio data of one channel, the audio processing module 200 may convert the original audio data of one channel into initial audio data of K channels. A channel may be understood as a channel of audio data, and one channel may correspond to a plurality of sound generating units 110. There may be multiple ways for the audio processing module 200 to convert the original audio data of one channel into initial audio data of K channels, for example, the audio processing module 200 may copy the original audio data into initial audio data of K channels, and perform frequency division processing on the initial audio data of each channel.

[0106] For example, the audio processing module 200 may include a copy circuit, through which the original audio data of one channel is copied into the initial audio data of K channels. In some embodiments, the original audio data of a single channel may be copied into the initial audio data of K channels by a processor integrated on the audio processing module 200 or an independent processor.

[0107] Figure 3 A schematic diagram of the structure of an audio processing module provided according to an embodiment of the present specification is shown.

[0108] Reference Figure 3 As shown, the audio processing module 200 includes an audio adjustment module 210, and the audio adjustment module 210 includes multiple audio adjustment modules 212, and the multiple audio adjustment modules 212 are configured to: for the sub-audio data of each sub-frequency band in the M sub-frequency bands: according to the audio adjustment model corresponding to the target audio characteristics of the sub-audio data, perform audio adjustment on the sub-audio data to obtain M adjusted audio data, wherein the audio adjustment model corresponds to the sub-frequency band where the sub-audio data is located. The audio adjustment model is an algorithm model for adjusting the audio characteristics or audio parameters of the sub-audio data of the sub-frequency band.

[0109] There may be various types of the audio adjustment module 210 . For example, the audio adjustment module 210 may include a DSP (Digital Signal Process) circuit or an equalizer circuit.

[0110] In an example embodiment, the audio characteristic includes a volume gain, and the audio adjustment module 212 is configured to: obtain the volume gain of the sub-audio data of the sub-frequency band; and determine the audio adjustment model corresponding to the sub-audio data of the sub-frequency band according to the corresponding relationship between the volume gain and the audio adjustment model. For example, the audio adjustment model includes an equalizer adjustment model, i.e., an EQ (Equalizer) algorithm, and the audio adjustment module 212 is configured to: determine the corresponding volume gain according to the audio characteristic of the sub-audio data of the sub-frequency band, determine the equalizer adjustment model corresponding to the sub-audio data of the sub-frequency band according to the corresponding volume gain, and perform audio adjustment processing on the sub-audio data of the sub-frequency band based on the determined equalizer adjustment model.

[0111] Furthermore, the volume gain includes multiple volume levels, different volume levels in the multiple volume levels correspond to different audio adjustment models, and the correspondence between the volume level and the audio adjustment model is pre-configured. The audio adjustment module 212 is configured to: determine the volume gain of the sub-audio data of the sub-frequency band, determine the volume level corresponding to the sub-audio data according to the volume gain of the sub-audio data, and determine the audio adjustment model corresponding to the sub-audio data of the sub-frequency band according to the correspondence between the volume level and the audio adjustment model. For example, assuming that the audio characteristic is the volume gain, the equalizer adjustment models corresponding to different volume levels are pre-set. Refer to the following Table 1:

[0112] Table 1. Correspondence between volume gain and audio adjustment model

[0113] Volume Level Audio gain range Audio Conditioning Model 1 0~25dB 1 2 25~50dB 2 3 50~75dB 3 4 75~99dB 4

[0114] Referring to Table 1 above, if the volume gain of the sub-audio data is in the range of 25 to 50 dB, the volume level corresponding to the sub-audio data is determined to be 2. According to the correspondence between the volume level and the audio adjustment model, the audio adjustment model corresponding to the sub-audio data of the sub-band is determined to be audio adjustment model 2, such as EQ adjustment model 2.

[0115] It should be noted that although the audio adjustment model is described as an equalizer adjustment model, those skilled in the art should understand that the audio adjustment model can also be other appropriate audio algorithm models, such as a dynamic range compression (DRC) model or a sound enhancement model, which is also within the scope of the embodiments of this specification.

[0116] In addition, in some other example embodiments, the model parameters of the audio adjustment model include equalizer parameters, and the equalizer parameters include gain parameters. The audio adjustment module 212 is configured to: determine the corresponding equalizer parameters according to the audio characteristics of the sub-audio data of the target sub-frequency band, determine the equalizer adjustment model corresponding to the sub-audio data of the target sub-frequency band according to the corresponding equalizer parameters, and perform audio adjustment processing on the sub-audio data of the target sub-frequency band based on the determined audio adjustment model.

[0117] For example, the audio adjustment module 212 determines the volume gain of the sub-audio data at the center frequency of the target sub-frequency band, and the reference volume gain of the center frequency of the predetermined frequency band of the sound-emitting unit 110 corresponding to the target sub-frequency band, and determines the corresponding equalizer parameter according to the difference between the volume gain of the volume data at the center frequency of the target sub-frequency band and the reference volume gain, and matches the corresponding equalizer model according to the equalizer parameter. For example, if the difference between the volume gain of the volume data at the center frequency of the target sub-frequency band and the reference volume gain is +10dB, the equalizer parameter is determined to be +10dB, and the corresponding equalizer model is matched according to the equalizer parameter.

[0118] according to Figure 3 The technical solution in the example embodiment adopts different audio adjustment models to perform audio adjustment for sub-audio data in different frequency bands, thereby realizing dynamic EQ adjustment for different frequency bands, and further improving the sound quality effect of audio playback by each sound unit of the sound module.

[0119] In addition, in an exemplary embodiment, the audio processing module 200 can obtain the volume gain of the sub-audio data of the current sub-band in the following two ways. The first way: determine the volume gain of the sub-audio data based on the sub-audio data of the current sub-band, for example, determine the average value of the volume gains of the sub-audio data of multiple frequency points of the current sub-band, and use the average value as the absolute volume gain of the sub-audio data of the current sub-band. The second way: determine the ratio of the volume gain of the sub-audio data of the current sub-band to the volume gains of the sub-audio data of M sub-bands, and determine the relative volume gain of the sub-audio data of the current sub-band based on the ratio, for example, multiply the volume gain of the sub-audio data of the current sub-band by the ratio.

[0120] According to the technical solution in the above-mentioned example embodiment, not only the absolute volume gain of the sub-audio data of the currently processed frequency band is taken into consideration, but also the volume gain of the audio data of the "overall" frequency band is referenced, and the relative volume gain of the sub-audio data of the current sub-band is determined by the proportion of the volume gain of the current frequency band in the volume gain of the overall frequency band, thereby reducing the influence of the change of the absolute volume gain of the current sub-band on the audio regulation.

[0121] Figure 4Another structural schematic diagram of an audio processing module provided according to an embodiment of this specification is shown.

[0122] Reference Figure 4 As shown, the audio processing module 200 also includes: a feedback module 220, the feedback module 220 includes multiple feedback modules 222, and the multiple feedback modules 222 are configured to: for each of the M sub-bands, obtain the adjusted audio data of a predetermined time length as sample data; compare the audio data of the sample data with the reference audio data, the reference audio data is the audio data corresponding to the reference audio curve of the audio adjustment model corresponding to the sub-band, and the reference audio curve is an audio curve such as a frequency response curve determined according to the better sound effect output by the sound-emitting unit corresponding to the sub-band; adjust the model parameters of the audio adjustment model according to the comparison result. For example, the audio adjustment model includes an equalizer adjustment model, and the model parameters include a gain parameter.

[0123] In some example embodiments, the audio data of the sample data of the sub-frequency band includes the volume gain of each frequency point of the sub-frequency band, and the reference audio data includes the reference volume gain of each frequency point of the corresponding frequency band. The feedback module 222 is configured to: obtain the adjusted audio data of a predetermined time length of the target sub-frequency band as the sample data, compare the volume gain of each frequency point of the sample data of the target sub-frequency band with the reference volume gain, and adjust the model parameters of the audio adjustment model according to the comparison result. For example, if the adjusted volume gain of each frequency point is greater than the reference volume gain, it means that the adjusted volume gain of each frequency point is large, and the gain parameter of the audio adjustment model needs to be reduced; if the adjusted volume gain of each frequency point is less than the reference volume gain, it means that the adjusted volume gain of each frequency point is small, and the gain parameter of the audio adjustment model needs to be increased.

[0124] In other example embodiments, the reference audio data is audio data corresponding to a reference audio curve of an audio adjustment model corresponding to a sub-band, the audio adjustment model is an equalizer adjustment model, the reference audio data includes reference model parameters of the equalizer adjustment model, the model parameters of the corresponding equalizer adjustment model are determined according to the audio data of the sample data, the model parameters in the sample data are compared with the reference model parameters, and the model parameters of the audio adjustment model are adjusted according to the comparison results. For example, if a gain parameter in the sample data is greater than a reference gain parameter, the gain parameter of the audio adjustment model is reduced.

[0125] It should be noted that although the model parameters include gain parameters as an example, those skilled in the art should understand that the model parameters may also include other appropriate parameters such as frequency band parameters or bandwidth parameters, which are also within the scope of the embodiments of this specification.

[0126] according to Figure 4The technical solution in the example embodiment compares the sample audio data of each sub-band with the reference audio data, and adjusts the model parameters of the audio adjustment model according to the comparison results. The model parameters of the audio adjustment model can be adjusted according to the difference between the actual sound effect of the sound unit and the reference sound effect, so that the actual sound effect of the sound unit can be consistent with the reference sound effect, thereby further improving the sound quality effect of the audio played by each sound unit of the sound module.

[0127] Further, in an example embodiment, the audio processing module 200 is also configured to: obtain an updated backup corresponding to the reference audio data of the audio adjustment model, and update the reference audio data of the audio adjustment model according to the updated backup. The reference audio data is the audio data corresponding to the reference audio curve of the audio adjustment model corresponding to the sub-band. For example, the reference audio data corresponding to the reference audio curve of the audio adjustment model of various sound effects are pre-set, and when the reference audio data of the target sound effect is updated, the updated backup corresponding to the reference audio data of the audio adjustment model of the target sound effect is obtained, and the reference audio data is updated according to the updated backup. There can be many types of target sound effects, for example, they can include heavy metal, light music, electronic music, classical, pop music or jazz. The audio processing device includes a memory, in which a backup area for reference audio data is provided. In response to an update request for a target sound effect initiated by a terminal device, an updated backup of the reference audio data of an audio adjustment model of the target sound effect is obtained via wireless transmission such as Bluetooth through OTA (Over-the-Air Technology), and the updated backup of the reference audio data of the target sound effect is stored in the backup area. According to the updated backup corresponding to the target reference sound effect in the backup area, the reference audio data corresponding to the target sound effect is updated.

[0128] According to the technical solution in the above-mentioned example embodiment, an updated backup of the reference audio data corresponding to the target sound effect is obtained, and the reference audio data of the target sound effect is updated. The original target sound effect can be updated with a target sound effect with better sound quality, thereby improving or changing the sound quality effect of the target sound effect.

[0129] In addition, if Figure 5As shown, the audio processing module 200 may also include a DAC (Digital to Analog Convertor) module 230, and the DAC module 230 may include at least one DAC 231. The audio processing module 200 can input the modulated audio data of the m sub-bands of each channel of the K channels to the corresponding m sound-emitting units 110 through the DAC 231 in the DAC module. When the DAC module 230 is working, it receives the modulated audio data of the K channels, converts the modulated audio data of the K channels into K analog electrical signals, and inputs the K analog electrical signals into the corresponding sound-emitting units 110. There may be multiple corresponding relationships between the DAC 231 in the DAC module 230 and the K sound-emitting units, for example, one-to-one, one-to-many, or many-to-many, etc.

[0130] Among them, Figure 6 As shown, the audio processing module 200 can combine the sub-audio data of the same sub-frequency band of at least two channels into one frame of audio data through a combination operation, thereby obtaining integrated audio data.

[0131] The integrated audio data includes at least two sub-audio data of the same sub-frequency band. For example, the integrated audio data includes sub-audio data of the ith sub-frequency band of the 1st channel and the Kth channel, where i is any integer in [1, m]. Through the ith identifier, the audio data to be played corresponding to the ith sub-frequency band can be identified in the integrated audio data. The digital audio interface 240 or the ith sounding unit 110 can identify the audio data to be played of the ith sounding unit based on the ith identifier.

[0132] After combining the sub-audio data of the same sub-frequency band of at least two channels, the audio processing module 200 can input the integrated audio data formed by the combination to the corresponding sound generating unit 110. Since the integrated audio data is still digitized audio data at this time, the audio processing module 200 can also include a digital audio interface 240, such as Figure 6 When the audio processing module 200 is working, the integrated audio data can be input to the N sound generating units of the corresponding frequency band through the digital audio interface 240 .

[0133] Among them, there can be many ways for the audio processing module 200 to input the integrated audio data into the corresponding N sound units through the digital audio interface 240. For example, after receiving the integrated audio data, the digital audio interface 240 directly sends the integrated audio data to the corresponding N sound units 110, and the N sound units 110 identify the corresponding audio data to be played in the integrated audio data. Alternatively, the digital audio interface 240 identifies the audio data to be played corresponding to each sound unit 110 in the integrated audio data, and sends the audio data to be played to the corresponding sound unit 110.

[0134] Among them, the digital audio interface (Digital Audio Interfaces, DAI) 240 can be understood as an interface for transmitting digital audio signals at the board level or between boards. Compared with the analog interface, the digital audio interface 240 has stronger anti-interference ability and simple hardware design. There can be many types of digital audio interface 240, for example, it can include at least one of I2S (a digital audio interface), TDM (a digital audio interface), PCM (a digital audio interface) and PDM (a digital audio interface). Among them, when the digital audio interface 240 identifies the target audio data corresponding to each sound unit 110 in the integrated audio data and sends the target audio data to the corresponding sound unit 110, the digital audio interface 240 needs to have the ability to identify the target audio data corresponding to each sound unit 110. Therefore, the digital audio interface 240 is now a digital audio interface 240 with identification and distribution functions. When the digital audio interface 240 is working, it receives integrated audio data, identifies the identifier of the sub-frequency band corresponding to each sound unit 110 and the audio data to be played of the sub-frequency band corresponding to the identifier in the integrated audio data, and sends the audio data to be played to the corresponding sound unit 110.

[0135] After receiving the corresponding audio data to be played, the N sound-emitting units can play the audio data to be played, thereby forming a reverberation sound. For example, the sound-emitting unit 110 sends the audio to be played to at least one speaker, and plays the audio to be played through at least one speaker. The corresponding target audio is played through the speakers in the N sound-emitting units 110, thereby forming a reverberation sound.

[0136] Among them, when the N sound-emitting units 110 are working, they can use the same phase to play the corresponding target audio at the same time, so as to avoid the mutual influence between different target audios in the reverberation sound, thereby affecting the sound quality of the reverberation sound.

[0137] Among them, the N sound-emitting units include at least high-frequency, medium-frequency and low-frequency speakers, and the high-frequency, medium-frequency and low-frequency can be set according to the actual spectrum of the initial audio data. The spectrum of the initial audio data includes K frequency bands, and the K frequency bands can cover high frequency, medium frequency and low frequency. As mentioned above, in some application scenarios, low frequency may refer to a frequency band of approximately 20Hz to 150Hz, medium frequency may refer to a frequency band of approximately 150Hz to 5KHz, high frequency may refer to a frequency band of approximately 5KHz to 20KHz, medium-low frequency may refer to a frequency band of approximately 150Hz to 500Hz, and medium-high frequency refers to a frequency band of 500Hz to 5KHz. Those of ordinary skill in the art will understand that the distinction between the above frequency bands is only given as an example to roughly give the interval. The definition of the above frequency bands may change with different industries, different application scenarios and different classification standards. For example, in some other application scenarios, low frequency refers to the frequency band of roughly 20Hz to 80Hz, mid-low frequency may refer to the frequency band of roughly 80Hz-160Hz, mid-frequency may refer to the frequency band of roughly 160Hz to 1280Hz, mid-high frequency may refer to the frequency band of roughly 1280Hz-2560Hz, and high frequency band may refer to the frequency band of roughly 2560Hz to 20KHz.

[0138] There may be many types of speakers, for example, air speakers and vibration conduction speakers, etc. The air speaker may be understood as a speaker that outputs air-conducted sound waves, and the vibration speaker may be understood as a speaker that outputs sound waves conducted by solid media (such as bone-conducted sound waves). The vibration speaker and the air conduction speaker may be two independent functional devices, or may be part of a single device that realizes multiple functions. Each of the N sound-emitting units 110 may include at least one of an air speaker and a vibration speaker.

[0139] In some embodiments, the audio processing device 10 may be a headset. There may be many types of headsets, for example, wired headsets, wireless headsets, or Bluetooth headsets, etc.

[0140] In some embodiments, the audio processing device 10 may also include an audio playback device that performs audio processing, for example, a hearing aid, a speaker, or other audio playback devices, and so on.

[0141] In some embodiments, the correspondence between the channels and the sounding units 110 may include at least one of a many-to-one relationship and a one-to-many relationship. The many-to-one relationship may be that multiple channels correspond to the same sounding unit 110. For example, taking the number of channels as K and the number of sounding units as N as an example, at least two channels correspond to the same sounding unit 110, so that the audio processing module 200 or the processor 400 sends the adjusted audio data of the K channels to the N sounding units 110. The one-to-many relationship may be that one channel may correspond to multiple sounding units 110. For example, taking the number of channels as K and the number of sounding units as N as an example, the m sub-bands of one channel correspond to m sounding units, N=m*K, so that the audio processing module 200 or the processor 400 sends the adjusted audio data of the K channels to the N sounding units 110.

[0142] In some embodiments, when at least one of the N sound units 110 changes or receives a sound effect adjustment request, the audio processing module 200 can adjust the corresponding relationship between the target audio characteristics and the audio adjustment model. There can be many situations in which the sound unit 110 changes, for example, it can include the failure of the sound unit to sound, the abnormality of the sound unit, or the change of the sound performance of the sound unit (for example, the sound unit changes from bone conduction sounding to air conduction sounding unit, etc.) or other changes, etc. The above-mentioned sound effect adjustment request can be a request to adjust the sound effect of the currently played audio. The sound effect can be the playback effect of the currently played audio, and the type of sound effect can be multiple, for example, it can include heavy metal, light music, electronic music, classical, pop music or jazz, etc. When at least one of the N sound units 110 changes in sound or receives a sound effect adjustment request, the audio processing module 200 or the processor 400 can adjust the corresponding relationship between the target audio characteristics and the audio adjustment model.

[0143] For example, the correspondence between the target audio characteristics and the audio adjustment model under different sound effects is pre-set, and when a sound effect adjustment request is received, the correspondence between the target audio characteristics and the audio adjustment model under the target sound effect is obtained according to the identifier of the target sound effect.

[0144] In the above description, the audio processing module 200 in the audio processing device 10 and other electronic devices cooperating therewith, such as DAC, spectrum adjustment device, etc., can be circuits or electronic devices integrated on one or more circuit boards and electrically connected to each other. The audio processing device 10 can also include a processor and a storage medium, and then the processor completes all or part of the functions of the audio processing module 200 and some electronic devices.

[0145] Figure 7A schematic diagram of the structure of another audio processing device provided according to an embodiment of this specification is shown.

[0146] Reference Figure 7 As shown, in addition to the hardware described above, such as the audio processing module 200 and the sound module, the audio processing device 10 may also include at least one storage medium 300 and at least one processor 400. In order to meet internal and external communication requirements, the audio processing device 10 may also include a communication port 500 and an internal communication bus 600.

[0147] The internal communication bus 600 may connect various system components, including the storage medium 300 , the processor 400 , and the communication port 500 .

[0148] The data communication between the audio processing device 10 and the outside world can be completed through the communication port 500. For example, the audio processing device 10 can obtain the initial audio data from the target device 20 through the communication port 500.

[0149] At least one storage medium 300 may include a data storage device. The data storage device may be a non-temporary storage medium or a temporary storage medium. For example, the data storage device may include one or more of a disk, a read-only storage medium (ROM), or a random access storage medium (RAM). When the audio processing device 10 is running, the storage medium 300 may also include at least one instruction set stored in the data storage device for acquiring initial audio data and processing the initial audio data. The instruction is a computer program code, and the computer program code may include a program, a routine, an object, a component, a data structure, a process, a module, etc. for executing the audio processing method provided in this specification.

[0150] At least one processor 400 can be connected to at least one storage medium 300 through an internal communication bus 600. The communication connection refers to any form of connection that can directly or indirectly receive information. At least one processor 400 is used to execute the above-mentioned at least one instruction set. When the audio processing device 10 is running, at least one processor 400 reads the at least one instruction set and executes the audio processing method provided in this specification according to the instructions of the at least one instruction set. The processor 400 can perform all the steps included in the audio processing method. The processor 400 can be in the form of one or more processors. In some embodiments, the processor 400 can include one or more hardware processors, such as a microcontroller, a microprocessor, a reduced instruction set computer (RISC), an application-specific integrated circuit (ASIC), an application-specific instruction set processor (ASIP), a central processing unit (CPU), a graphics processing unit (GPU), a physical processing unit (PPU), a microcontroller unit, a digital signal processor (DSP), a field programmable gate array (FPGA), an advanced RISC machine (ARM), a programmable logic device (PLD), any circuit or processor capable of performing one or more functions, etc., or any combination thereof. For the sake of illustration only, only one processor 400 is described in the audio processing device 10 in this specification. However, it should be noted that the audio processing device 10 in this specification may also include multiple processors 400, and therefore, the operations and / or method steps disclosed in this specification may be performed by one processor as described in this specification, or may be performed jointly by multiple processors. For example, if the processor 400 of the audio processing device 10 in this specification performs step A and step B, it should be understood that step A and step B may also be performed jointly or separately by two different processors 400 (for example, the first processor performs step A, the second processor performs step B, or the first and second processors perform steps A and B together).

[0151] In some embodiments, when the audio processing device 10 processes the initial audio data, all audio processing steps may be performed by the audio processing module 200, or may be completed jointly by the audio processing module 200, the storage medium 300 and the processor 400.

[0152] Among them, there are many ways for the audio processing module 200 to execute all the audio processing steps. For example, the audio processing module 200 obtains initial audio data; performs frequency division processing on the initial audio data to obtain at least M sub-audio data of corresponding M sub-frequency bands, wherein each sub-frequency band corresponds to a predetermined frequency band output by a corresponding sound unit among N sound units, and M is an integer greater than 1; performs audio adjustment on the corresponding M sub-audio data according to the target audio characteristics of the M sub-audio data to obtain M adjusted audio data, and inputs each of the M adjusted audio data into the corresponding sound unit to form a reverberation sound.

[0153] Among them, there may be multiple steps for the audio processing module 200, the storage medium 300 and the processor 400 to jointly complete the audio processing. For example, the audio processing module 200 or the processor 400 obtains the initial audio processing, the processor 400 obtains the control instruction in the storage medium 300, performs frequency division processing on the initial audio data, and obtains at least M sub-audio data of the corresponding M sub-frequency bands, and performs audio adjustment on the corresponding M sub-audio data according to the target audio characteristics of the M sub-audio data to obtain M adjusted audio data, and the processor 400 sends the M adjusted audio data to the DAC module 200 in the audio processing module 200. After receiving the M adjusted audio data, the DAC module 230 can convert the M adjusted audio data into analog electrical signals and send the analog electrical signals to the corresponding sound-emitting units 100, and each sound-emitting unit converts the corresponding adjusted audio data into target audio characteristics. Audio, forming a reverberation sound; or, the audio processing module 200 or the processor 400 obtains the initial audio processing, the processor 400 obtains the control instruction in the storage medium 300, and performs frequency division processing on the initial audio data based on the control instruction to obtain at least M sub-audio data of the corresponding M sub-frequency bands, and performs audio adjustment on the corresponding M sub-audio data according to the target audio characteristics of the M sub-audio data to obtain M adjusted audio data, the processor 400 combines the adjusted audio data of at least two channels to obtain integrated audio data, and sends the integrated audio data to the digital audio interface 240 in the audio processing module 200, the digital audio interface 240 sends the integrated audio data to the corresponding sound unit 110, the sound unit 110 identifies the corresponding adjusted audio data in the integrated audio data, and converts the adjusted audio data into the target audio to form a reverberation sound; and so on.

[0154] The audio processing method in the exemplary embodiment of this specification will be described in detail below with reference to the accompanying drawings.

[0155] Figure 8The flowchart of the audio processing method for an audio processing device provided according to an embodiment of the present specification is shown. The audio processing device 10 can execute the audio processing method P800 of the present specification. Specifically, the audio processing module 200 and / or the processor 400 in the audio processing device 10 can read the instruction set stored in the local storage medium, and then execute the audio processing method P800 described in the present specification according to the instruction set. Figure 8 As shown, method P800 may include: step S810 to step S840. Figure 8 The audio processing method of the embodiment of this specification is described in detail.

[0156] Reference Figure 8 As shown, in step S810, initial audio data is obtained.

[0157] For example, the audio processing module 200 or the processor 400 may obtain initial audio data. The method for obtaining the initial audio data may be referred to above and will not be described in detail here.

[0158] In step S820, the initial audio data is frequency-divided to obtain at least M sub-audio data of corresponding M sub-frequency bands, wherein each sub-frequency band corresponds to a predetermined frequency band output by a corresponding sound unit among the N sound units, M and N are both integers greater than 1, and each sound unit is used to output an audio signal of a predetermined frequency band.

[0159] In an exemplary embodiment, the initial audio data may be processed by frequency division by software or by hardware. For example, the audio processing module 200 or the processor 400 may perform frequency division processing on the initial audio data of K channels using a frequency division processing algorithm to obtain m sub-audio data of m sub-frequency bands of each channel, where M=K*m, K is an integer greater than or equal to 1, for example, if the initial audio data is 2 channels, there are 4 sounding units, and each channel corresponds to 2 sounding units and 2 sub-frequency bands, then M=N=4, K=2, and m=2.

[0160] Taking the example that the sound unit 110 includes a bone conduction sound unit and an air conduction sound unit, the bone conduction sound unit has a better sound effect for medium and high frequency audio data, and the predetermined frequency band corresponding to the bone conduction sound unit, that is, the working frequency band, is the medium and high frequency band; and the air conduction sound unit has a better sound effect for low frequency audio data, and the predetermined frequency band corresponding to the air conduction sound unit, that is, the working frequency band, is the low frequency band. The specific content of the frequency division processing can be referred to above, and will not be repeated here one by one.

[0161] In step S830, audio adjustments are performed on the corresponding M sub-audio data respectively according to the target audio characteristics of the M sub-audio data to obtain M adjusted audio data.

[0162] In an exemplary embodiment, the target audio characteristic may include a volume gain, and the corresponding M sub-audio data are respectively audio-adjusted according to the volume gains of the M sub-audio data. For example, the audio processing module 200 or the processor 400 obtains the reference volume gain of each frequency point of the predetermined frequency band of the sound-emitting unit 110 corresponding to the target sub-frequency band, and according to the difference between the volume gain of the sub-audio data of each frequency point of the target sub-frequency band and the reference volume gain of each frequency point of the corresponding predetermined frequency band, the sub-audio data of each frequency point of the target sub-frequency band are respectively audio-adjusted to reduce the difference between the volume gain of the corresponding frequency point and the reference volume gain. For example, if the volume gain of the sub-audio data of a certain frequency point of the sub-frequency band is greater than the corresponding reference volume gain, the volume gain at the frequency point is reduced; if the volume gain of the sub-audio data at a certain frequency point of the sub-frequency band is less than the corresponding reference volume gain, the volume gain at the frequency point is increased. The specific content of the audio adjustment of step S830 can be found in the above description, and will not be repeated here.

[0163] In step S840, each of the M adjusted audio data is input to a corresponding sound emitting unit.

[0164] In an exemplary embodiment, the initial audio data includes audio data of K channels, each channel corresponds to m sounding units 110, or at least two channels correspond to m sounding units, M=K*m, K is an integer greater than or equal to 1, for example, if the initial audio data is 2 channels, there are 4 sounding units, each channel corresponds to 2 sounding units and 2 sub-bands, then M=N=4, K=2, m=2. In the case where each channel corresponds to m sounding units, the audio processing module 200 inputs the sub-audio data of the m sub-bands of each channel in the K channels to the corresponding m sounding units 110. The specific content of step S840 can be found in the above description, and will not be repeated here.

[0165] according to Figure 8According to the technical solution in the example embodiment, on the one hand, the initial audio data is frequency-divided to obtain M sub-audio data of corresponding M sub-frequency bands, each sub-frequency band corresponds to a predetermined frequency band output by one of the N sound-emitting units, and the sub-frequency band where the sub-audio data is located can be adapted to the working frequency band of the sound-emitting unit, thereby improving the sound quality effect of the audio played by the sound-emitting unit; on the other hand, according to the target audio characteristics of the sub-audio data, the sub-audio data is audio-adjusted, and the adjusted audio data is input into the corresponding sound-emitting unit, and according to the audio characteristics of the sub-audio data, the sub-audio data to be played by the sound-emitting unit can be audio-adjusted, thereby making the audio characteristics of the adjusted audio data of the sub-frequency band more adapted to the audio characteristics of the corresponding sound-emitting unit, thereby ensuring that the sound emitted by each sound-emitting unit in the sound module has a better sound effect, thereby further improving the sound quality effect of the audio played by the sound-emitting unit.

[0166] In some embodiments, based on the above scheme, the above audio adjustment is performed on the corresponding M sub-audio data respectively, including, for each of the above sub-audio data:

[0167] The audio adjustment is performed on the sub-audio data according to an audio adjustment model corresponding to the target audio characteristics of the sub-audio data, wherein the audio adjustment model corresponds to the sub-frequency band where the sub-audio data is located.

[0168] In some embodiments, based on the above scheme, the above target audio characteristic includes a volume gain, and before performing the above audio adjustment on the above sub-audio data, the above method further includes:

[0169] Obtaining the volume gain of the sub-audio data of the above sub-frequency band;

[0170] According to the corresponding relationship between the volume gain and the audio adjustment model, the audio adjustment model corresponding to the sub-audio data of the sub-frequency band is determined.

[0171] In some embodiments, based on the above solution, the volume gain includes multiple volume levels, and different volume levels in the multiple volume levels correspond to different audio adjustment models.

[0172] In some embodiments, based on the above solution, the above method further includes, for each of the M sub-bands:

[0173] Obtaining the adjusted audio data of a predetermined time length as sample data (sampledata);

[0174] Comparing the audio data of the sample data with reference audio data, where the reference audio data is audio data corresponding to a reference audio curve of the audio adjustment model corresponding to the sub-frequency band;

[0175] The model parameters of the audio adjustment model are adjusted according to the comparison results.

[0176] In some embodiments, based on the above solution, the audio processing module is further configured as follows:

[0177] An updated backup corresponding to the reference audio data is obtained, and the reference audio data is updated according to the updated backup.

[0178] In some embodiments, based on the above scheme, the above audio adjustment model is an equalizer adjustment model, and the above model parameters are equalizer parameters.

[0179] In some embodiments, based on the above scheme, the above-mentioned N sound units include a bone conduction sound unit and an air conduction sound unit. The above-mentioned bone conduction sound unit outputs medium and high frequency audio signals when running, and the above-mentioned air conduction sound unit outputs low frequency audio signals when running.

[0180] In some embodiments, based on the above scheme, the above initial audio data includes audio data of K channels, and the frequency band interval of each channel includes m sub-bands, where m=M / K, and K is an integer greater than or equal to 1.

[0181] In some embodiments, based on the above scheme, the K channels include a left channel and a right channel, the m sub-frequency bands corresponding to the left channel include mid-high frequencies of the left channel and low frequencies of the left channel, and the m sub-frequency bands corresponding to the right channel include mid-high frequencies of the right channel and low frequencies of the right channel.

[0182] In some embodiments, based on the above scheme, the corresponding relationship between the above channels and the above sound emission units includes at least one of a one-to-many relationship and a many-to-one relationship.

[0183] In some embodiments, based on the above scheme, the above audio processing device can be headphones. Of course, the above audio processing device can also be other electronic devices, such as a sound device on a head-mounted VR device, a stereo sound device in a movie theater, and so on.

[0184] The above is a schematic scheme of the audio processing method of the embodiment of this specification. It should be noted that the technical scheme of the audio processing method and the technical scheme of the above-mentioned audio processing device belong to the same concept, and the details not described in detail in the technical scheme of the audio processing method can be referred to the description of the technical scheme of the above-mentioned audio processing device.

[0185] Fig. 9 A flow chart of another audio processing method provided according to an embodiment of this specification is shown.

[0186] Reference Fig. 9As shown, the initial audio data is processed by frequency division, and the sub-audio data of multiple sub-bands are obtained. For example, the initial audio data is stereo data, and the stereo data includes left channel data and right channel data. The left channel data and the right channel data are divided into frequency data to obtain high-frequency data in the left channel, low-frequency data in the left channel, high-frequency data in the right channel, and low-frequency data in the right channel. According to the audio gain of the sub-audio data of each sub-band, the corresponding audio adjustment model is matched from the audio adjustment model library. For example, the volume level of the audio gain of the sub-audio data is determined, and the audio adjustment model corresponding to the sub-audio data is determined from the audio adjustment model library based on the corresponding relationship between the preset volume level and the audio adjustment model. For example, the volume of the first volume level is the size of the original audio signal output by the power amplifier, the gain is 0dB, and each level is reduced by 3dB, the minimum volume level is -99db gain, and there are 16 volume levels in total), and several audio adjustment models in the audio adjustment library are automatically matched with the volume level of the sub-audio data. Audio adjustment is performed on the corresponding sub-audio data based on the matched audio adjustment model to obtain corresponding adjusted audio data.

[0187] Reference Fig. 9 As shown, the volume levels of the left channel mid-high frequency data, the left channel low frequency data, the right channel mid-high frequency data, and the right channel low frequency data are determined, and four pre-set EQ adjustment models are selected from the EQ adjustment model library according to the determined volume levels and configured to the corresponding audio channels respectively. The left channel mid-high frequency data is adjusted according to EQ adjustment model A; the left channel low frequency is adjusted according to EQ adjustment model B; the right channel mid-high frequency is adjusted according to EQ adjustment model C; and the right channel low frequency is adjusted according to EQ adjustment model D.

[0188] Further, refer to Fig. 9 As shown, the initial audio data is 2 channels, namely the left channel and the right channel, and there are 4 sounding units. Each channel corresponds to 2 sounding units and 2 sub-bands, then M=N=4, K=2, m=2, wherein the 2 sub-bands corresponding to the left channel include the middle and high frequencies of the left channel and the low frequencies of the left channel, and the 2 sub-bands corresponding to the right channel include the middle and high frequencies of the right channel and the low frequencies of the right channel. The left channel corresponds to a bone conduction speaker and an air conduction speaker; the right channel corresponds to a bone conduction speaker and an air conduction speaker, and the bone conduction speaker outputs middle and high frequency audio signals when in operation, and the air conduction speaker outputs low frequency audio signals when in operation. In the case where each channel corresponds to 2 sounding units, the audio processing module 200 inputs the adjusted audio data of the 2 sub-bands of each channel in the 2 channels to the corresponding 2 sounding units 110 respectively. The specific process can be referred to as described above, and will not be repeated here.

[0189] Fig.10A schematic diagram of a flow chart of adjusting model parameters of an audio adjustment model provided according to an embodiment of this specification is shown.

[0190] Reference Fig.10 As shown, the initial audio data is processed by frequency division to obtain sub-audio data of multiple sub-frequency bands. The corresponding audio adjustment model is matched from the audio adjustment model library according to the audio gain of the sub-audio data of each sub-frequency band. For example, the volume level of the audio gain of the sub-audio data of the sub-frequency band is determined, and based on the correspondence between the preset volume level and the audio adjustment model, the audio adjustment model corresponding to the sub-audio data is determined from the audio adjustment model library.

[0191] Further, for each of the M sub-bands, the adjusted audio data of a predetermined time length is obtained as sample data, for example, referring to Fig.10 As shown, a segment of sub-audio data is recorded as sample data for the target sub-frequency band; the audio data of the sample data is compared with the reference audio data, the reference audio data is the audio data corresponding to the reference audio curve of the audio adjustment model corresponding to the sub-frequency band, and the reference audio curve is an audio curve such as a frequency response curve determined by acoustic professionals based on the optimal sound effect output by the sound-emitting unit corresponding to the sub-frequency band; the model parameters of the audio adjustment model are adjusted according to the comparison results. For example, the audio adjustment model includes an equalizer model, and the model parameters include gain parameters. The specific process can be found in the above description, and will not be repeated here.

[0192] In addition, refer to Fig.10 As shown, an updated backup corresponding to the reference audio data of the audio adjustment model is obtained from the target device, and the reference audio data of the audio adjustment model is updated according to the updated backup. For example, the reference audio data corresponding to the reference audio curve of the audio adjustment model corresponding to various sound effects are pre-set, and when the reference audio data of the target sound effect is updated, the updated backup corresponding to the reference audio data of the audio adjustment model of the target sound effect is obtained, and the reference audio data is updated according to the updated backup. There can be many types of target sound effects, for example, heavy metal, light music, electronic music, classical, pop music or jazz. The audio processing device includes a memory, and a backup area of ​​the reference audio data is set in the memory. In response to the update request of the target sound effect initiated by the target device, the updated backup of the reference audio data of the audio adjustment model of the target sound effect is obtained by wireless transmission such as Bluetooth through OTA (Over-the-Air Technology, air download technology), and the updated backup of the reference audio data of the target sound effect obtained is stored in the backup area. According to the updated backup corresponding to the target reference sound effect in the backup area, the reference audio data corresponding to the target reference sound effect is updated.

[0193] In summary, the audio processing device and audio processing method provided in this specification, the audio processing device includes a sound module and an audio processing module, wherein the sound module includes N sound units, and each sound unit outputs an audio signal of a predetermined frequency band when in operation; after obtaining the initial audio data, the audio processing module performs frequency division processing on the initial audio data to obtain at least M sub-audio data of corresponding M sub-frequency bands, wherein each sub-frequency band corresponds to a predetermined frequency band output by a corresponding sound unit among the N sound units, and according to the target audio characteristics of the M sub-audio data, the corresponding M sub-audio data are respectively audio-adjusted to obtain M adjusted audio data, and each adjusted audio data is respectively input into the corresponding sound unit. On the one hand, the initial audio data is frequency-divided to obtain M sub-audio data of corresponding M sub-frequency bands, each sub-frequency band corresponding to a predetermined frequency band output by a sound unit among N sound units, so that the sub-frequency band where the sub-audio data is located can be adapted to the working frequency band of the sound unit, thereby improving the sound quality effect of the audio played by the sound unit; on the other hand, according to the target audio characteristics of the sub-audio data, the sub-audio data is audio-adjusted, and the adjusted audio data is input into the corresponding sound unit, so that according to the audio characteristics of the sub-audio data, the sub-audio data to be played by the sound unit can be audio-adjusted, so that the audio characteristics of the adjusted audio data of sub-frequency bands of different frequency bands are more adapted to the audio characteristics of the corresponding sound unit, thereby ensuring that the sound emitted by each sound unit in the sound module has a better sound effect, thereby further improving the sound quality effect of the audio played by the sound unit.

[0194] On the other hand, the present specification provides a non-transitory storage medium storing at least one set of executable instructions for audio processing. When the executable instructions are executed by the processor, the executable instructions instruct the processor to implement the steps of the audio processing method P800 described in the present specification. In some possible implementations, various aspects of the present specification can also be implemented in the form of a program product, which includes a program code. When the program product is run on the audio processing device 10, the program code is used to make the audio processing device 10 perform the steps of the audio processing method P800 described in the present specification. The program product for implementing the above method can use a portable compact disk read-only memory (CD-ROM) to include program code and can be run on the audio processing device 10. However, the program product of the present specification is not limited to this. In the present specification, the readable storage medium can be any tangible medium containing or storing a program, which can be used by the instruction execution system or used in combination with it. The program product can use any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media include: an electrical connection with one or more conductors, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. The computer-readable storage medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The readable storage medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, device, or device. The program code contained on the readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the above. Program code for performing the operations of the present specification may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the audio processing device 10, partially on the audio processing device 10, as a stand-alone software package, partially on the audio processing device 10 and partially on a remote computing device, or entirely on a remote computing device.

[0195] Some embodiments of the present specification are described above. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require a specific order or a continuous order to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0196] In summary, after reading this detailed disclosure, those skilled in the art will appreciate that the foregoing detailed disclosure may be presented only by way of example and may not be limiting. Although not explicitly stated herein, those skilled in the art will appreciate that this specification requires various reasonable changes, improvements and modifications to the embodiments. These changes, improvements and modifications are intended to be proposed by this specification and are within the spirit and scope of the exemplary embodiments of this specification.

[0197] In addition, certain terms in this specification have been used to describe embodiments of this specification. For example, "one embodiment", "an embodiment" and / or "some embodiments" mean that a particular feature, structure or characteristic described in conjunction with the embodiment may be included in at least one embodiment of this specification. Therefore, it can be emphasized and should be understood that two or more references to "an embodiment" or "one embodiment" or "an alternative embodiment" in various parts of this specification do not necessarily refer to the same embodiment. In addition, specific features, structures or characteristics may be appropriately combined in one or more embodiments of this specification.

[0198] It should be understood that in the foregoing description of the embodiments of this specification, in order to help understand a feature and for the purpose of simplifying this specification, this specification combines various features in a single embodiment, figure or its description. However, this does not mean that the combination of these features is necessary. When reading this specification, it is entirely possible for a person skilled in the art to mark out some of the devices as separate embodiments. In other words, the embodiments in this specification can also be understood as the integration of multiple secondary embodiments. This is also true when the content of each secondary embodiment is less than all the features of a single aforementioned disclosed embodiment.

[0199] Each patent, patent application, patent application publication, and other material, such as articles, books, specifications, publications, documents, articles, etc., cited herein may be incorporated herein by reference in its entirety for all purposes, except for any prosecution document history related thereto, any equivalent that may be inconsistent or conflicting with this document, or any equivalent prosecution document history that may have a limiting effect on the broadest scope of the claims now or later associated with this document. For example, if there is any inconsistency or conflict between the description, definition, and / or use of a term associated with any of the incorporated materials and the term, description, definition, and / or use associated with this document, the term in this document shall control.

[0200] Finally, it should be understood that the embodiments of the application disclosed herein are explanations of the principles of the embodiments of this specification. Other modified embodiments are also within the scope of this specification. Therefore, the embodiments disclosed in this specification are only used as examples and not as limitations. Those skilled in the art can adopt alternative configurations according to the embodiments in this specification to implement the applications in this specification. Therefore, the embodiments of this specification are not limited to the embodiments accurately described in the application.

Claims

1. An audio processing device, characterized in that: include: A sound module, comprising N sound units, each of which outputs an audio signal of a predetermined frequency band when in operation, wherein N is an integer greater than 1; and An audio processing module is communicatively connected to the sound module, and the audio processing module is configured as follows: Get the initial audio data, Performing frequency division processing on the initial audio data to obtain at least M sub-audio data of corresponding M sub-frequency bands, wherein each sub-frequency band corresponds to the predetermined frequency band output by the corresponding sounding unit among the N sounding units, M is an integer greater than 1, According to the target audio characteristics of the M sub-audio data, audio adjustments are respectively performed on the corresponding M sub-audio data to obtain M adjusted audio data, and Each of the M adjusted audio data is input into the corresponding sound emitting unit.

2. The audio processing device according to claim 1, characterized in that In order to perform audio adjustment on the M sub-audio data respectively, the audio processing module is configured to, for each of the sub-audio data: The audio adjustment is performed on the sub-audio data according to an audio adjustment model corresponding to the target audio characteristic of the sub-audio data, wherein the audio adjustment model corresponds to the sub-frequency band where the sub-audio data is located.

3. The audio processing device according to claim 2, characterized in that The target audio characteristic includes a volume gain; before performing the audio adjustment on the sub-audio data, the audio processing module is further configured to: Obtaining the volume gain of the sub-audio data of the sub-frequency band; The audio adjustment model corresponding to the sub-audio data of the sub-frequency band is determined according to the corresponding relationship between the volume gain and the audio adjustment model.

4. The audio processing device according to claim 3, characterized in that The volume gain includes multiple volume levels, and different volume levels in the multiple volume levels correspond to different audio adjustment models.

5. The audio processing device according to claim 2, characterized in that The audio processing module is further configured to, for each of the M sub-frequency bands: Obtaining modulated audio data of a predetermined time length as sample data; Comparing the audio data of the sample data with reference audio data, the reference audio data being audio data corresponding to a reference audio curve of the audio adjustment model corresponding to the sub-frequency band; The model parameters of the audio adjustment model are adjusted according to the comparison result.

6. The audio processing device according to claim 5, characterized in that The audio processing module is also configured as: An updated backup corresponding to the reference audio data of the audio adjustment model is obtained, and the reference audio data is updated according to the updated backup.

7. The audio processing device according to any one of claims 2 to 6, characterized in that: The audio adjustment model is an equalizer adjustment model, and the model parameters are equalizer parameters.

8. The audio processing device according to claim 1, characterized in that The N sound-generating units include a bone conduction sound-generating unit and an air conduction sound-generating unit. The bone conduction sound-generating unit outputs medium and high frequency audio signals when in operation, and the air conduction sound-generating unit outputs low frequency audio signals when in operation.

9. The audio processing device according to claim 1, characterized in that The initial audio data includes audio data of K channels, and the frequency band interval of each channel includes m sub-frequency bands, wherein m=M / K, and K is an integer greater than or equal to 1.

10. The audio processing device according to claim 9, characterized in that The K channels include a left channel and a right channel, the m sub-frequency bands corresponding to the left channel include left channel mid-high frequency and left channel low frequency, and the m sub-frequency bands corresponding to the right channel include right channel mid-high frequency and right channel low frequency.

11. The audio processing device according to claim 9, characterized in that The corresponding relationship between the sound channels and the sound generating units includes at least one of a one-to-many relationship and a many-to-one relationship.

12. The audio processing device according to claim 1, characterized in that The audio processing device is a headset.

13. An audio processing method, characterized in that: Applied to an audio processing device, the audio processing device includes N sound-emitting units, each of which is used to output an audio signal of a predetermined frequency band, wherein N is an integer greater than 1, and the method includes: Obtaining initial audio data; Performing frequency division processing on the initial audio data to obtain at least M sub-audio data of corresponding M sub-frequency bands, wherein each sub-frequency band corresponds to the predetermined frequency band output by the corresponding sounding unit among the N sounding units, and M is an integer greater than 1; According to the target audio characteristics of the M sub-audio data, respectively perform audio adjustments on the corresponding M sub-audio data to obtain M adjusted audio data; and Each of the M adjusted audio data is input into the corresponding sound emitting unit.

14. The method according to claim 13, characterized in that The performing audio adjustment on the corresponding M sub-audio data respectively includes, for each of the sub-audio data: The audio adjustment is performed on the sub-audio data according to an audio adjustment model corresponding to the target audio characteristic of the sub-audio data, wherein the audio adjustment model corresponds to the sub-frequency band where the sub-audio data is located.

15. The method according to claim 14, characterized in that The target audio characteristic includes a volume gain. Before performing the audio adjustment on the sub-audio data, the method further includes: Obtaining the volume gain of the sub-audio data of the sub-frequency band; The audio adjustment model corresponding to the sub-audio data of the sub-frequency band is determined according to the corresponding relationship between the volume gain and the audio adjustment model.

16. The method according to claim 15, characterized in that The volume gain includes multiple volume levels, and different volume levels in the multiple volume levels correspond to different audio adjustment models.

17. The method according to claim 14, characterized in that The method further includes, for each of the M sub-frequency bands: Obtaining modulated audio data of a predetermined time length as sample data; Comparing the audio data of the sample data with reference audio data, the reference audio data being audio data corresponding to a reference audio curve of the audio adjustment model corresponding to the sub-frequency band; The model parameters of the audio adjustment model are adjusted according to the comparison result.

18. The method according to claim 17, characterized in that The audio adjustment model is an equalizer adjustment model, and the model parameters are equalizer parameters.

19. The method according to claim 13, characterized in that The N sound-generating units include a bone conduction sound-generating unit and an air conduction sound-generating unit. The bone conduction sound-generating unit outputs medium and high frequency audio signals when in operation, and the air conduction sound-generating unit outputs low frequency audio signals when in operation.

20. The method according to claim 13, characterized in that The initial audio data includes audio data of K channels, and the frequency band interval of each channel includes m sub-frequency bands, wherein m=M / K, and K is an integer greater than or equal to 1.

21. The method according to claim 20, characterized in that The K channels include a left channel and a right channel, the m sub-frequency bands corresponding to the left channel include left channel mid-high frequency and left channel low frequency, and the m sub-frequency bands corresponding to the right channel include right channel mid-high frequency and right channel low frequency.

Images