Audio processing apparatus and method

Abstract

An audio processing apparatus (10) and method. The audio processing device (10) comprises a sound production module (100) and an audio processing module (200), the sound production module (100) comprises N sound production units (110), and each sound production unit (110) outputs an audio signal of a predetermined frequency band during operation; the audio processing module (200), after acquiring initial audio data, performs frequency division processing on the initial audio data to at least obtain M sub-audio data corresponding to M sub-bands, each sub-band corresponding to a predetermined band output by a corresponding sound production unit (110) among the N sound production units (110), and performs frequency division processing on the M sub-audio data according to a target audio characteristic of the M sub-audio data. And respectively performing audio adjustment on the corresponding M sub-audio data to obtain M pieces of tuned audio data, and respectively inputting each piece of tuned audio data to the corresponding sound production unit (110). The sound quality effect of audio processing of the plurality of sound production units (110) can be improved.

Description

Audio processing device and method Technical Field

[0001] This specification relates to the field of audio processing, and in particular to an audio processing device and method. Background Art

[0002] With the development of true wireless Bluetooth headset technology, people have higher and higher requirements for the sound quality of headsets.

[0003] In related technical solutions, audio data is directly sent to the sound unit of an audio playback device, such as headphones, for audio playback. However, since mainstream headphones generally use a single sound unit, a single sound unit cannot achieve good audio playback effects. In other words, a single sound unit results in poor audio processing quality.

[0004] Therefore, how to improve the sound quality of audio played by audio playback devices has become a technical problem that needs to be solved urgently.

[0005] The content of the background technology section is merely information known to the inventor personally, and does not mean that the above information has entered the public domain before the application date of this disclosure, nor does it mean that it can become the prior art of the present disclosure.

[0006] Summary of the Invention

[0007] This specification provides an audio processing device and method that can improve the sound quality of audio played by an audio playback device.

[0008] In a first aspect, this specification provides an audio processing device, comprising:

[0009] A sound module, comprising N sound units, each of which outputs an audio signal of a predetermined frequency band when in operation, wherein N is an integer greater than 1; and

[0010] An audio processing module is communicatively connected to the sound module, and the audio processing module is configured to:

[0011] Get the initial audio data,

[0012] Performing frequency division processing on the original audio data to obtain at least M sub-audio data corresponding to M sub-frequency ranges, wherein each sub-frequency range corresponds to the predetermined frequency range output by the corresponding sound-emitting unit among the N sound-emitting units, and M is an integer greater than 1.

[0013] According to the target audio characteristics of the M sub-audio data, audio adjustments are performed on the corresponding M sub-audio data to obtain M adjusted audio data, and

[0014] Each of the M adjusted audio data is input into the corresponding sound emitting unit.

[0015] In some embodiments, based on the above solution, in order to perform audio adjustments on the M sub-audio data respectively, the audio processing module is configured to, for each sub-audio data:

[0016] The audio adjustment is performed on the sub-audio data according to an audio adjustment model corresponding to the target audio characteristics of the sub-audio data, wherein the audio adjustment model corresponds to the sub-frequency band where the sub-audio data is located.

[0017] In some embodiments, based on the above solution, the target audio characteristic includes a volume gain; before performing the audio adjustment on the sub-audio data, the audio processing module is further configured to:

[0018] Obtaining a volume gain of the sub-audio data of the sub-frequency band;

[0019] The audio adjustment model corresponding to the sub-audio data of the sub-frequency band is determined according to the corresponding relationship between the volume gain and the audio adjustment model.

[0020] In some embodiments, based on the above solution, the volume gain includes multiple volume levels, and different volume levels in the multiple volume levels correspond to different audio adjustment models.

[0021] In some embodiments, based on the above solution, the audio processing module is further configured to, for each of the M sub-bands:

[0022] Obtaining modulated audio data of a predetermined time length as sample data;

[0023] Comparing the audio data of the sample data with reference audio data, where the reference audio data is audio data corresponding to a reference audio curve of the audio adjustment model corresponding to the sub-band;

[0024] The model parameters of the audio adjustment model are adjusted according to the comparison result.

[0025] In some embodiments, based on the above solution, the audio processing module is further configured to:

[0026] An updated backup corresponding to the reference audio data of the audio adjustment model is obtained, and the reference audio data is updated according to the updated backup.

[0027] In some embodiments, based on the above solution, the audio adjustment model is an equalizer adjustment model, and the model parameters are equalizer parameters.

[0028] In some embodiments, based on the above scheme, the N sound units include a bone conduction sound unit and an air conduction sound unit. When the bone conduction sound unit is running, it outputs medium and high frequency audio signals, and when the air conduction sound unit is running, it outputs low frequency audio signals.

[0029] In some embodiments, based on the above solution, the initial audio data includes audio data of K channels, and the frequency band interval of each channel includes the m sub-bands, where m=M / K, and K is an integer greater than or equal to 1.

[0030] In some embodiments, based on the above scheme, the K channels include a left channel and a right channel, the m sub-frequency bands corresponding to the left channel include the left channel mid-high frequency and the left channel low frequency, and the m sub-frequency bands corresponding to the right channel include the right channel mid-high frequency and the right channel low frequency.

[0031] In some embodiments, based on the above solution, the correspondence between the sound channels and the sound emitting units includes at least one of a one-to-many relationship and a many-to-one relationship.

[0032] In some embodiments, based on the above solution, the audio processing device is a headset.

[0033] In a second aspect, this specification also provides an audio processing method applied to an audio processing device, wherein the audio processing device includes N sound-emitting units, each of which is configured to output an audio signal in a predetermined frequency band, wherein N is an integer greater than 1, and the method includes:

[0034] Obtaining initial audio data;

[0035] Performing frequency division processing on the initial audio data to obtain at least M sub-audio data corresponding to M sub-frequency ranges, wherein each sub-frequency range corresponds to the predetermined frequency range output by a corresponding sound-emitting unit among the N sound-emitting units, and M is an integer greater than 1;

[0036] According to the target audio characteristics of the M sub-audio data, audio adjustments are performed on the corresponding M sub-audio data to obtain M adjusted audio data; and

[0037] Each of the M adjusted audio data is input into the corresponding sound emitting unit.

[0038] In some embodiments, based on the above solution, performing audio adjustment on the corresponding M sub-audio data respectively includes, for each sub-audio data:

[0039] The audio adjustment is performed on the sub-audio data according to an audio adjustment model corresponding to the target audio characteristics of the sub-audio data, wherein the audio adjustment model corresponds to the sub-frequency band where the sub-audio data is located.

[0040] In some embodiments, based on the above solution, the target audio characteristic includes a volume gain, and before performing the audio adjustment on the sub-audio data, the method further includes:

[0041] Obtaining a volume gain of the sub-audio data of the sub-frequency band;

[0042] The audio adjustment model corresponding to the sub-audio data of the sub-frequency band is determined according to the corresponding relationship between the volume gain and the audio adjustment model.

[0043] In some embodiments, based on the above solution, the volume gain includes multiple volume levels, and different volume levels in the multiple volume levels correspond to different audio adjustment models.

[0044] In some embodiments, based on the above solution, the method further includes, for each of the M sub-bands:

[0045] Obtaining modulated audio data of a predetermined time length as sample data;

[0046] Comparing the audio data of the sample data with reference audio data, where the reference audio data is audio data corresponding to a reference audio curve of the audio adjustment model corresponding to the sub-band;

[0047] The model parameters of the audio adjustment model are adjusted according to the comparison result.

[0048] In some embodiments, based on the above solution, the audio processing module is further configured to:

[0049] An updated backup corresponding to the reference audio data is obtained, and the reference audio data is updated according to the updated backup.

[0050] In some embodiments, based on the above solution, the audio adjustment model is an equalizer adjustment model, and the model parameters are equalizer parameters.

[0051] In some embodiments, based on the above scheme, the N sound units include a bone conduction sound unit and an air conduction sound unit. When the bone conduction sound unit is running, it outputs medium and high frequency audio signals, and when the air conduction sound unit is running, it outputs low frequency audio signals.

[0052] In some embodiments, based on the above solution, the initial audio data includes audio data of K channels, and the frequency band interval of each channel includes m sub-bands, where m=M / K, and K is an integer greater than or equal to 1.

[0053] In some embodiments, based on the above scheme, the K channels include a left channel and a right channel, the m sub-frequency bands corresponding to the left channel include the left channel mid-high frequency and the left channel low frequency, and the m sub-frequency bands corresponding to the right channel include the right channel mid-high frequency and the right channel low frequency.

[0054] In some embodiments, based on the above solution, the correspondence between the sound channels and the sound emitting units includes at least one of a one-to-many relationship and a many-to-one relationship.

[0055] In some embodiments, based on the above solution, the audio processing device is a headset.

[0056] In a third aspect, this specification also provides an audio processing system, comprising: at least one storage medium storing at least one instruction set for audio processing; and at least one processor communicatively connected to the at least one storage medium, wherein when the audio processing system is running, the at least one processor reads the at least one instruction set and executes the above-mentioned audio processing method according to the instructions of the at least one instruction set.

[0057] It can be seen from the above technical solutions that the audio processing device, audio processing method and system provided in the embodiments of this specification, on the one hand, perform frequency division processing on the initial audio data to obtain M sub-audio data of corresponding M sub-frequency bands, each sub-frequency band corresponds to a predetermined frequency band output by one of the N sound units, and can adapt the sub-frequency band where the sub-audio data is located to the working frequency band of the sound unit, thereby improving the sound quality effect of the audio played by the sound unit; on the other hand, according to the target audio characteristics of the sub-audio data, audio adjustment is performed on the sub-audio data, and the adjusted audio data is input into the corresponding sound unit, and according to the audio characteristics of the sub-audio data, audio adjustment can be performed on the sub-audio data to be played by the sound unit, so that the audio characteristics of the adjusted audio data of the sub-frequency band are more adapted to the audio characteristics of the corresponding sound unit, thereby ensuring that the sound emitted by each sound unit in the sound module has a better sound effect, thereby further improving the sound quality effect of the audio played by the sound unit.

[0058] Other features of the audio processing devices and methods provided in this specification are partially outlined in the following description. Based on the description, the following figures and examples will be readily apparent to those skilled in the art. The inventive aspects of the audio processing devices and methods provided in this specification can be fully demonstrated through practice or use of the methods, apparatuses, and combinations described in the following detailed examples. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] In order to more clearly illustrate the technical solutions in the embodiments of this specification, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0060] FIG1 is a schematic diagram showing an application scenario of an audio processing device provided according to an embodiment of this specification;

[0061] FIG2 shows a hardware structure diagram of an audio processing device provided according to an embodiment of this specification;

[0062] FIG3 shows a schematic structural diagram of an audio processing module provided according to an embodiment of this specification;

[0063] FIG4 shows another structural diagram of an audio processing module provided according to an embodiment of this specification;

[0064] FIG5 shows another structural diagram of an audio processing module provided according to an embodiment of this specification;

[0065] FIG6 shows another structural diagram of an audio processing module provided according to an embodiment of this specification;

[0066] FIG7 shows a schematic structural diagram of another audio processing device provided according to an embodiment of this specification;

[0067] FIG8 is a schematic flow chart showing an audio processing method according to an embodiment of this specification;

[0068] FIG9 shows a schematic flow chart of another audio processing method provided according to an embodiment of this specification; and

[0069] FIG10 is a schematic diagram showing a flow chart of adjusting model parameters of an audio adjustment model according to an embodiment of this specification. DETAILED DESCRIPTION

[0070] The following description provides specific application scenarios and requirements for this specification, with the goal of enabling those skilled in the art to make and use the contents of this specification. Various modifications to the disclosed embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of this specification. Therefore, this specification is not limited to the embodiments shown, but is intended to be accorded the broadest scope consistent with the claims.

[0071] The terms used herein are for the purpose of describing specific example embodiments only and are not intended to be limiting. For example, as used herein, the singular forms "a," "an," and "the" may also include the plural forms unless the context clearly indicates otherwise. When used in this specification, the terms "comprise," "include," and / or "contain" are intended to refer to the presence of the associated integers, steps, operations, elements, and / or components, but do not preclude the presence of one or more other features, integers, steps, operations, elements, components, and / or groups or the addition of other features, integers, steps, operations, elements, components, and / or groups in the system / method.

[0072] These and other features of this specification, as well as the operation and function of the associated elements of the structure, and the economical assembly and manufacture of the components, can be significantly improved with consideration of the following description. Reference is made to the accompanying drawings, all of which form a part of this specification. However, it should be expressly understood that the drawings are for illustration and description purposes only and are not intended to limit the scope of this specification. It should also be understood that the drawings are not drawn to scale.

[0073] The flowcharts used in this specification illustrate operations implemented by systems according to some embodiments of the present specification. It should be clearly understood that the operations of the flowcharts may not be implemented in sequence. Rather, the operations may be implemented in reverse order or simultaneously. Furthermore, one or more additional operations may be added to the flowcharts. One or more operations may be removed from the flowcharts.

[0074] Before describing the specific embodiments of this specification, the application scenarios of this specification are first introduced as follows.

[0075] This specification relates to the use scenarios of audio processing devices. An exemplary use scenario is as follows: After receiving initial audio data output by a target device, the audio processing device performs frequency division processing on the initial audio data to obtain sub-audio data in M ​​sub-frequency bands, and then plays the target sub-audio data corresponding to the sub-frequency bands through corresponding sound-emitting units among N sound-emitting units, thereby forming a reverberant sound, where M and N are both integers greater than 1.

[0076] FIG1 shows a schematic diagram of an application scenario of an audio processing device according to an embodiment of this specification. As shown in FIG1 , an application scenario 001 may include an audio processing device 10 , a target device 20 , and a network 30 .

[0077] The audio processing device 10 may include a sound module 100 and an audio processing module 200. The sound module 100 includes N sound units 110. Each sound unit 110 outputs an audio signal of a predetermined frequency band when in operation, where N is an integer greater than 1. The audio processing module 200 can be communicatively connected to the sound module 100. The audio processing module 200 can obtain initial audio data from the target device 20, perform frequency division processing on the initial audio data, obtain sub-audio data of M sub-frequency bands, and play the sub-audio data corresponding to the sub-frequency bands through the corresponding sound units 110 among the N sound units 110 of the sound module 100, thereby forming a reverberant sound. In some embodiments, the audio processing device 10 may store data or instructions for executing the audio processing method described in this specification, and may execute or be used to execute the above data or instructions. In some embodiments, the audio processing device 10 may include a hardware device with data information processing capabilities and the necessary programs required to drive the hardware device to operate. For example, the audio processing device 10 may be headphones, a large home or commercial audio system, etc. The above audio processing method will be introduced in the subsequent content of this article.

[0078] The target device 20 may be an electronic device with audio data output capabilities. In some embodiments, the target device 20 may include a mobile device, a tablet computer, a laptop computer, a built-in device in a motor vehicle, or the like, or any combination thereof. In some embodiments, the mobile device may include a smart home device, a smart mobile device, a virtual reality device, an augmented reality device, or the like, or any combination thereof. In some embodiments, the smart home device may include a smart TV, a desktop computer, a smart speaker, or the like, or any combination thereof. In some embodiments, the smart mobile device may include a smartphone, a personal digital assistant, a gaming device, a navigation device, or the like, or any combination thereof. In some embodiments, the virtual reality device or augmented reality device may include a virtual reality helmet, virtual reality glasses, a virtual reality controller, an augmented reality helmet, augmented reality glasses, an augmented reality controller, or the like, or any combination thereof. For example, the virtual reality device or augmented reality device may include head-mounted glasses, a head-mounted display, or the like. In some embodiments, the built-in device in a motor vehicle may include an onboard computer, an onboard television, or the like. In some embodiments, the target device 20 may include an audio acquisition device for acquiring audio data within the target space, thereby obtaining the initial audio data. In some embodiments, the target device 20 may also receive the initial audio data from other devices.

[0079] In some embodiments, the target device 20 may have one or more application programs (APPs) installed. These APPs can provide users with the ability and interface to interact with the outside world. These APPs include, but are not limited to, web browser APPs, search APPs, chat APPs, shopping APPs, video APPs, financial management APPs, instant messaging tools, email clients, social networking platform software, and the like. In some embodiments, the target device 20 may have a target APP installed. The target APP can generate or obtain initial audio data, or the target APP can receive initial audio data from other devices.

[0080] The network 30 is used to provide a medium for communication connection between the audio processing device 10 and the target device 20. The network 30 can facilitate the exchange of information or data. As shown in Figure 1, the audio processing device 10 and the target device 20 can be connected to the network 30 and transmit information or data to each other through the network 30. In some embodiments, the network 30 can be any type of wireless network. For example, the network 30 can include a telecommunications network, an intranet, the Internet, a local area network (LAN), a wide area network (WAN), a wireless local area network (WLAN), a metropolitan area network (MAN), a public switched telephone network (PSTN), a Bluetooth TM Network, ZigBee TM network, near field communication (NFC) network or similar network. For example, the network 30 may be a Bluetooth TM In this case, the audio processing device 10 may be a Bluetooth TM (bluetooth TM ) protocol audio processing device; the target device 20 may be a device that supports Bluetooth TM The audio processing device 10 can communicate with the target device 20 based on Bluetooth TM In some embodiments, the audio processing device 10 can also perform data transmission with the target device 20 via a wired network or a local area network.

[0081] It should be understood that the number of audio processing devices 10, target devices 20 and networks 30 in Figure 1 is merely illustrative and any number of audio processing devices 10, target devices 20 and networks 30 may be provided according to implementation requirements.

[0082] FIG2 shows a hardware structure diagram of an audio processing device 10 provided according to some embodiments of this specification. As shown in FIG2 , the audio processing device 10 may include: a sound module 100 and an audio processing module 200 .

[0083] In some embodiments, the sound module 100 may include N sound units 110, where N is an integer greater than 1. Each sound unit 110 outputs an audio signal in a predetermined frequency band when in operation. The sound unit 110 may include one or more devices that can emit sound, for example, the sound unit 110 may include one or more speakers. Different sound units 110 are used to output audio data in different frequency bands. In other words, different sound units 110 may have different operating frequency bands. For example, the audio characteristics of some sound units 110 are to have better restoration of mid-frequency audio data and / or produce a thicker and / or butter-like sound quality, then the operating frequency band of these sound units 110 is the mid-frequency band; the audio characteristics of some sound units 110 are to have better restoration of high-frequency audio data and / or produce a pure and clear sound quality, then the operating frequency band of these sound units 110 is the high-frequency band.

[0084] For example, if the sound unit 110 includes a bone conduction sound unit and an air conduction sound unit, the bone conduction sound unit has a better acoustic effect for mid- and high-frequency audio data, and the predetermined frequency band corresponding to the bone conduction sound unit, i.e., the operating frequency band, is the mid- and high-frequency band; while the air conduction sound unit has a better acoustic effect for low-frequency audio data, and the predetermined frequency band corresponding to the air conduction sound unit, i.e., the operating frequency band, is the low-frequency band. For the human ear, low frequency may refer to a frequency band of approximately 20 Hz to 150 Hz, mid frequency may refer to a frequency band of approximately 150 Hz to 5 kHz, high frequency may refer to a frequency band of approximately 5 kHz to 20 kHz, mid-low frequency may refer to a frequency band of approximately 150 Hz to 500 Hz, and mid-high frequency may refer to a frequency band of 500 Hz to 5 kHz.

[0085] Those skilled in the art should understand that the distinction between the above frequency bands is only an example to give a rough range. The definition of the above frequency bands can change with different industries, different application scenarios and different classification standards. For example, in other application scenarios, low frequency refers to the frequency band of approximately 20Hz to 80Hz, mid-low frequency can refer to the frequency band of approximately 80Hz-160Hz, mid-frequency can refer to the frequency band of approximately 160Hz to 1280Hz, mid-high frequency can refer to the frequency band of approximately 1280Hz-2560Hz, and high frequency can refer to the frequency band of approximately 2560Hz to 20KHz.

[0086] Furthermore, the audio processing module 200 is configured to obtain initial audio data and perform frequency division processing on the initial audio data to obtain at least M sub-audio data corresponding to M sub-bands, where M is an integer greater than 1, and M is greater than or equal to N. Each sub-band corresponds to a predetermined frequency band output by a corresponding sound-emitting unit among the N sound-emitting units. In other words, each of the M sub-bands is adapted to the working frequency band of the corresponding sound-emitting unit 110. For example, if a sound-emitting unit 110 can produce clear sound quality in the high frequency band, but the sound performance in the mid-frequency and low frequency bands is average, then the predetermined frequency band (i.e., the working frequency band) corresponding to the sound-emitting unit 110 is the high frequency band, and the sub-audio data corresponding to the sound-emitting unit will have more high-frequency audio data, while the amount of audio data in the mid-frequency and low-frequency parts will be small or even non-existent.

[0087] The initial audio data may be digitized audio data of one or more channels. The initial audio data may include pulse code modulated (PCM) audio data or other types of digitized audio data. For example, if the initial audio data is PCM audio data, the initial audio data may be a binary sequence directly generated by converting an analog signal to digital-to-analog. The audio processing module 200 may obtain the initial audio data in a variety of ways. For example, the audio processing module 200 may directly receive the initial audio data sent by the target device 20, or may receive the initial audio data sent by an audio acquisition device, or may obtain at least one audio data from a preset audio data set as the initial audio data, or may obtain the original audio data. The audio processing module 200 may then select audio data of one or more channels from the original audio data as the initial audio data. Alternatively, the audio processing module 200 may further include an audio acquisition circuit. The audio processing module 200 may acquire audio data via the audio acquisition circuit and perform digital-to-analog conversion on the acquired original audio data to obtain the initial audio data.

[0088] In some example embodiments, the initial audio data includes audio data of K channels, where K is an integer greater than or equal to 1. For example, let K=2, and the 2 channels include a left channel and a right channel. The spectral range of each channel can be the same, for example, the spectral range of the left channel and the right channel are the same. In other example embodiments, there may be channels in the K channels whose spectral range is different from the spectral range of other channels. For example, let K=6, and the 6 channels include 5 full-bandwidth channels and 1 low-frequency channel, the spectral range of the 5 full-bandwidth channels is 3-20KHz, and the spectral range of the 1 low-frequency channel is 3-120Hz.

[0089] Furthermore, in some exemplary embodiments, the frequency spectrum of the audio data of each of the K channels may include m sub-bands, where m = M / K, and the i-th sounding unit 110 among the N sounding units 110 has a desired acoustic effect in the j-th predetermined frequency band, where i is an integer in the range [1, N] and j is an integer in the range [1, m]. Taking the frequency spectrum of the initial audio data distributed in the range [20 Hz, 20 kHz] as an example, the m sub-bands may completely cover the entire frequency spectrum, or may cover pre-defined spectral ranges such as high frequency, mid-frequency, and low frequency. The m sub-bands may have overlapping frequency bands or may be completely independent frequency bands, and so on.

[0090] It should be noted that although the example in which each channel corresponds to the same number of sub-bands is used for description, those skilled in the art should understand that different channels may also correspond to different numbers of sub-bands, which is also within the scope of the embodiments of this specification.

[0091] Furthermore, in some exemplary embodiments, the frequency division processing of the initial audio data can be performed by software or by hardware. The following will describe in detail the two frequency division processing methods, namely, software frequency division processing and hardware frequency division processing.

[0092] 1. Software frequency division processing

[0093] The audio processing module 200 may include at least one processor, which can execute instructions in the frequency division processing instruction set, and use the frequency division processing algorithm to perform frequency division processing on the initial audio data of K channels to obtain m sub-audio data of m sub-bands of each channel, where M=K*m, K is an integer greater than or equal to 1. For example, if the initial audio data is 2 channels and there are 4 sound units, each channel corresponds to 2 sound units and 2 sub-bands, then M=N=4, K=2, and m=2.

[0094] Taking the frequency division processing of the initial audio data of the j-th channel as an example, for the i-th sub-band of the j-th channel, the amplitude on the i-th sub-band is retained, and the amplitudes in other sub-bands are attenuated to obtain the sub-audio data of the i-th sub-band of the j-th channel, where i is any integer in [1, m] and j is any integer in [1, K]. Alternatively, for the i-th sub-band of the j-th channel, the audio data of the i-th sub-band is retained, and the audio data of other sub-bands are filtered out to obtain the sub-audio data of the i-th sub-band of the j-th channel. In other words, the sub-audio data of the i-th sub-band of the j-th channel adapts to the audio characteristics of the i-th sound unit 110 corresponding to the j-th channel.

[0095] 2. Hardware frequency division processing:

[0096] The audio processing module 200 may include a frequency division circuit, and the frequency division circuit may be used to perform frequency division processing on the initial audio data. For example, the audio processing module 200 may classify the initial audio data into a high-frequency band, a mid-frequency band, and a low-frequency band, etc., through the frequency division circuit. The circuit structure of the frequency division circuit includes a filter circuit composed of a capacitor and an inductor coil, for example, a high-pass filter circuit is used to obtain a high-frequency band, a mid-pass filter circuit is used to obtain a heavy-frequency band, and a low-pass filter is used to obtain a low-frequency band. The specific processing method of hardware frequency division may be the same as the processing method of software frequency division.

[0097] For example, multiple channels include a left channel and a right channel. In the case of software frequency division processing and / or hardware frequency division processing, the audio processing module 200 performs frequency division processing on the audio data of each channel using a frequency division circuit and / or a distribution processing algorithm to obtain frequency division data of multiple sub-bands corresponding to the audio data of each channel. The multiple sub-bands corresponding to the left channel include left channel high frequency, left channel mid-frequency, and left channel low frequency, and the multiple sub-bands corresponding to the right channel include right channel high frequency, right channel mid-frequency, and right channel low frequency.

[0098] Furthermore, the audio processing module 200 performs audio adjustments on the corresponding M sub-audio data according to the target audio characteristics of the M sub-audio data to obtain M adjusted audio data, and inputs each of the M adjusted audio data into the corresponding sound unit 110.

[0099] In some example embodiments, the target audio characteristic may include volume gain, and audio adjustments are performed on the corresponding M sub-audio data based on the volume gains of the M sub-audio data. For example, reference volume gains for each frequency point in a predetermined frequency band of the sound-emitting unit 110 corresponding to the target sub-frequency band are obtained. Based on the difference between the volume gain of the sub-audio data at each frequency point in the target sub-frequency band and the reference volume gain for each frequency point in the corresponding predetermined frequency band, audio adjustments are performed on the sub-audio data at each frequency point in the target sub-frequency band to reduce the difference between the volume gain at the corresponding frequency point and the reference volume gain. For example, if the volume gain of the sub-audio data at a frequency point in the sub-frequency band is greater than the corresponding reference volume gain, the volume gain at that frequency point is reduced; if the volume gain of the sub-audio data at a frequency point in the sub-frequency band is less than the corresponding reference volume gain, the volume gain at that frequency point is increased. The reference volume gain may be a volume gain corresponding to a preset reference audio curve for optimal sound effects of each sound-emitting unit.

[0100] In some example embodiments, the target audio characteristics may include timbre characteristics, and audio adjustments are performed on the corresponding M sub-audio data according to the timbre characteristics of the M sub-audio data. For example, in some embodiments, the timbre characteristics of the sub-audio data of each frequency point in the target sub-frequency band are determined, and audio adjustments are performed on the sub-audio data of each frequency point in the target sub-frequency band according to the timbre characteristics of the sub-audio data of each frequency point. For example, if the timbre characteristics include vocal characteristics and the target sub-frequency band is a mid-frequency band, then the gain of each frequency point in the mid-frequency band is increased to make the vocals more powerful; if the timbre characteristics include guitar characteristics and the target sub-frequency band is a high-frequency band, then the gain of each frequency point in the high-frequency band is appropriately increased to enhance the spatial sense of the guitar.

[0101] It should be noted that although the target audio characteristics are volume gain or timbre characteristics as an example, those skilled in the art should understand that the target audio characteristics may also include other appropriate audio characteristics such as pitch, short-time energy, short-time average amplitude or spectrum width, which are also within the scope of the embodiments of this specification.

[0102] After performing audio conditioning on the sub-audio data of each sub-band, the audio processing module 200 obtains the adjusted audio data corresponding to each sub-band. The adjusted audio data of each sub-band is adapted to the audio characteristics of the corresponding sound-emitting unit 110 and is input into the corresponding sound-emitting unit. For example, the sub-audio data of m sub-bands are input into the corresponding m sound-emitting units 110. Each sound-emitting unit 110 converts the sub-audio data of the corresponding sub-band into the target audio, thereby forming a reverberant sound.

[0103] In an exemplary embodiment, the initial audio data includes audio data for K channels, where each channel corresponds to m sounding units 110, or at least two channels correspond to m sounding units. If each channel corresponds to m sounding units, the audio processing module 200 inputs the sub-audio data for the m sub-bands of each of the K channels to the corresponding m sounding units 110.

[0104] When at least two channels correspond to m sounding units, the audio processing module 200 combines the sub-audio data of the sub-frequency bands corresponding to each of the at least two channels to obtain integrated audio data, and inputs the integrated audio data of each sub-frequency band into the sounding unit 110 of the corresponding frequency band. For example, assuming that channel k1 and channel k2 both correspond to the same three sounding units, the sub-audio data of the three sub-frequency bands corresponding to channel k1 are {m11, m12, m13}, and the sub-audio data of the three sub-frequency bands corresponding to channel k2 are {m21, m22, m23}. The sub-audio data of the m sub-frequency bands corresponding to channel k1 are combined with the sub-audio data of the m sub-frequency bands corresponding to channel k2 to obtain integrated audio data, namely {(m11+m21), (m12+m22), (m13+m23)}, and the integrated audio data of each sub-frequency band is input into the sounding unit 110 of the corresponding frequency band.

[0105] According to the technical solution in the example embodiment of Figure 2, on the one hand, the initial audio data is frequency-divided to obtain M sub-audio data of corresponding M sub-frequency bands, each sub-frequency band corresponding to a predetermined frequency band output by one of the N sound units, and the sub-frequency band where the sub-audio data is located can be adapted to the working frequency band of the sound unit, thereby improving the sound quality effect of the audio played by the sound unit; on the other hand, according to the target audio characteristics of the sub-audio data, the sub-audio data is audio-adjusted, and the adjusted audio data is input into the corresponding sound unit, and according to the audio characteristics of the sub-audio data, the sub-audio data to be played by the sound unit can be audio-adjusted, thereby making the audio characteristics of the adjusted audio data of the sub-frequency band more adapted to the audio characteristics of the corresponding sound unit, thereby ensuring that the sound emitted by each sound unit in the sound module has a better sound effect, thereby further improving the sound quality effect of the audio played by the sound unit.

[0106] Furthermore, in some exemplary embodiments, after acquiring the raw audio data of one channel, the audio processing module 200 may convert the raw audio data of one channel into initial audio data of K channels. A channel may be understood as a channel of audio data, and one channel may correspond to multiple sound-emitting units 110. The audio processing module 200 may convert the raw audio data of one channel into initial audio data of K channels in various ways. For example, the audio processing module 200 may copy the raw audio data into initial audio data of K channels, and perform frequency division processing on the initial audio data of each channel.

[0107] For example, the audio processing module 200 may include a replication circuit that replicates the original audio data of one channel into the initial audio data of K channels. In some embodiments, the original audio data of a single channel may be replicated into the initial audio data of K channels by a processor integrated into the audio processing module 200 or an independent processor.

[0108] FIG3 shows a schematic structural diagram of an audio processing module provided according to an embodiment of this specification.

[0109] As shown in FIG3 , the audio processing module 200 includes an audio adjustment module 210, which includes multiple audio adjustment modules 212. The multiple audio adjustment modules 212 are configured to: for sub-audio data in each of M sub-frequency bands: perform audio adjustment on the sub-audio data according to an audio adjustment model corresponding to the target audio characteristics of the sub-audio data, thereby obtaining M adjusted audio data, wherein the audio adjustment model corresponds to the sub-frequency band in which the sub-audio data resides. The audio adjustment model is an algorithmic model that adjusts the audio characteristics or audio parameters of the sub-audio data in the sub-frequency band.

[0110] The audio adjustment module 210 may be of various types. For example, the audio adjustment module 210 may include a DSP (Digital Signal Process) circuit or an equalizer circuit.

[0111] In an exemplary embodiment, the audio characteristics include a volume gain, and the audio adjustment module 212 is configured to: obtain the volume gain of the sub-audio data of the sub-frequency band; and determine the audio adjustment model corresponding to the sub-audio data of the sub-frequency band based on the correspondence between the volume gain and the audio adjustment model. For example, the audio adjustment model includes an equalizer adjustment model, i.e., an EQ (Equalizer) algorithm. The audio adjustment module 212 is configured to: determine the corresponding volume gain based on the audio characteristics of the sub-audio data of the sub-frequency band, determine the equalizer adjustment model corresponding to the sub-audio data of the sub-frequency band based on the corresponding volume gain, and perform audio adjustment processing on the sub-audio data of the sub-frequency band based on the determined equalizer adjustment model.

[0112] Furthermore, the volume gain includes multiple volume levels, different volume levels in the multiple volume levels correspond to different audio adjustment models, and the correspondence between the volume level and the audio adjustment model is pre-configured. The audio adjustment module 212 is configured to: determine the volume gain of the sub-audio data of the sub-frequency band, determine the volume level corresponding to the sub-audio data based on the volume gain of the sub-audio data, and determine the audio adjustment model corresponding to the sub-audio data of the sub-frequency band based on the correspondence between the volume level and the audio adjustment model. For example, assuming that the audio characteristic is volume gain, the equalizer adjustment models corresponding to different volume levels are pre-set. Refer to Table 1 below:

[0113] Table 1. Correspondence between volume gain and audio adjustment model

[0114] Referring to Table 1 above, if the volume gain of the sub-audio data is in the range of 25 to 50 dB, the volume level corresponding to the sub-audio data is determined to be 2. According to the correspondence between the volume level and the audio adjustment model, the audio adjustment model corresponding to the sub-audio data of the sub-band is determined to be audio adjustment model 2, such as EQ adjustment model 2.

[0115] It should be noted that although the audio adjustment model is described as an equalizer adjustment model, those skilled in the art should understand that the audio adjustment model can also be other appropriate audio algorithm models, such as a dynamic range compression (DRC) model or a sound enhancement model, which is also within the scope of the embodiments of this specification.

[0116] Furthermore, in some other example embodiments, the model parameters of the audio adjustment model include equalizer parameters, and the equalizer parameters include gain parameters. The audio adjustment module 212 is configured to: determine corresponding equalizer parameters based on audio characteristics of the sub-audio data of the target sub-frequency band; determine an equalizer adjustment model corresponding to the sub-audio data of the target sub-frequency band based on the corresponding equalizer parameters; and perform audio adjustment processing on the sub-audio data of the target sub-frequency band based on the determined audio adjustment model.

[0117] For example, the audio adjustment module 212 determines the volume gain of the sub-audio data at the center frequency of the target sub-band, as well as the reference volume gain of the center frequency of the predetermined frequency band of the sound-emitting unit 110 corresponding to the target sub-band. Based on the difference between the volume gain of the volume data at the center frequency of the target sub-band and the reference volume gain, the corresponding equalizer parameter is determined, and the corresponding equalizer model is matched based on the equalizer parameter. For example, if the difference between the volume gain of the volume data at the center frequency of the target sub-band and the reference volume gain is +10dB, the equalizer parameter is determined to be +10dB, and the corresponding equalizer model is matched based on the equalizer parameter.

[0118] According to the technical solution in the example embodiment of Figure 3, different audio adjustment models are used to perform audio adjustment on sub-audio data in different frequency bands, thereby enabling dynamic EQ adjustment for different frequency bands, and further improving the sound quality of audio played by each sound unit of the sound module.

[0119] In addition, in an example embodiment, the audio processing module 200 can obtain the volume gain of the sub-audio data of the current sub-band in the following two ways. The first way: determine the volume gain of the sub-audio data based on the sub-audio data of the current sub-band, for example, determine the average value of the volume gains of the sub-audio data of multiple frequency points of the current sub-band, and use the average value as the absolute volume gain of the sub-audio data of the current sub-band. The second way: determine the ratio of the volume gain of the sub-audio data of the current sub-band to the volume gains of the sub-audio data of M sub-bands, and determine the relative volume gain of the sub-audio data of the current sub-band based on the ratio, for example, multiply the volume gain of the sub-audio data of the current sub-band by the ratio.

[0120] According to the technical solution in the above-mentioned example embodiment, not only the absolute volume gain of the sub-audio data of the currently processed frequency band is taken into consideration, but also the volume gain of the audio data of the "overall" frequency band is referred to, and the relative volume gain of the sub-audio data of the current sub-frequency band is determined by the proportion of the volume gain of the current frequency band in the volume gain of the overall frequency band, thereby reducing the impact of the change in the absolute volume gain of the current sub-frequency band on the audio adjustment.

[0121] FIG4 shows another structural diagram of an audio processing module provided according to an embodiment of this specification.

[0122] As shown in FIG4 , the audio processing module 200 further includes a feedback module 220, which includes multiple feedback modules 222. The multiple feedback modules 222 are configured to: obtain, for each of the M sub-bands, adjusted audio data of a predetermined length as sample data; compare the audio data of the sample data with reference audio data, where the reference audio data is audio data corresponding to a reference audio curve of an audio adjustment model corresponding to the sub-band, where the reference audio curve is an audio curve, such as a frequency response curve, determined based on the optimal sound effect output by the sound-emitting unit corresponding to the sub-band; and adjust model parameters of the audio adjustment model based on the comparison results. For example, the audio adjustment model includes an equalizer adjustment model, and the model parameters include a gain parameter.

[0123] In some example embodiments, the audio data of the sample data of the sub-band includes the volume gain of each frequency point of the sub-band, and the reference audio data includes the reference volume gain of each frequency point of the corresponding frequency band. The feedback module 222 is configured to: obtain the adjusted audio data of a predetermined time length of the target sub-band as sample data, compare the volume gain of each frequency point of the sample data of the target sub-band with the reference volume gain, and adjust the model parameters of the audio adjustment model according to the comparison result. For example, if the adjusted volume gain of each frequency point is greater than the reference volume gain, it means that the adjusted volume gain of each frequency point is large, and the gain parameter of the audio adjustment model needs to be lowered; if the adjusted volume gain of each frequency point is less than the reference volume gain, it means that the adjusted volume gain of each frequency point is small, and the gain parameter of the audio adjustment model needs to be increased.

[0124] In other example embodiments, the reference audio data is audio data corresponding to a reference audio curve of an audio adjustment model corresponding to a sub-band, the audio adjustment model is an equalizer adjustment model, the reference audio data includes reference model parameters of the equalizer adjustment model, the model parameters of the corresponding equalizer adjustment model are determined based on the audio data of the sample data, the model parameters in the sample data are compared with the reference model parameters, and the model parameters of the audio adjustment model are adjusted based on the comparison results. For example, if the gain parameter in the sample data is greater than the reference gain parameter, the gain parameter of the audio adjustment model is reduced.

[0125] It should be noted that although the model parameters include gain parameters as an example, those skilled in the art should understand that the model parameters may also include other appropriate parameters such as frequency band parameters or bandwidth parameters, which are also within the scope of the embodiments of this specification.

[0126] According to the technical solution in the example embodiment of Figure 4, the sample audio data of each sub-band is compared with the reference audio data, and the model parameters of the audio adjustment model are adjusted according to the comparison results. The model parameters of the audio adjustment model can be adjusted according to the difference between the actual sound effect of the sound unit and the reference sound effect, so that the actual sound effect of the sound unit can be consistent with the reference sound effect, and the sound quality effect of the audio played by each sound unit of the sound module can be further improved.

[0127] Furthermore, in an example embodiment, the audio processing module 200 is also configured to: obtain an updated backup corresponding to the reference audio data of the audio adjustment model, and update the reference audio data of the audio adjustment model according to the updated backup. The reference audio data is the audio data corresponding to the reference audio curve of the audio adjustment model corresponding to the sub-band. For example, the reference audio data corresponding to the reference audio curve of the audio adjustment model of various sound effects are pre-set. When the reference audio data of the target sound effect is updated, the updated backup corresponding to the reference audio data of the audio adjustment model of the target sound effect is obtained, and the reference audio data is updated according to the updated backup. There can be many types of target sound effects, for example, heavy metal, light music, electronic music, classical, pop music or jazz. The audio processing device includes a memory, in which a backup area for reference audio data is set. In response to an update request for a target sound effect initiated by a terminal device, an updated backup of the reference audio data of the audio adjustment model of the target sound effect is obtained via wireless transmission such as Bluetooth through OTA (Over-the-Air Technology), and the updated backup of the reference audio data of the target sound effect is stored in the backup area. According to the updated backup corresponding to the target reference sound effect in the backup area, the reference audio data corresponding to the target sound effect is updated.

[0128] According to the technical solution in the above-mentioned example embodiment, an updated backup of the reference audio data corresponding to the target sound effect is obtained, and the reference audio data of the target sound effect is updated. The original target sound effect can be updated with a target sound effect with better sound quality, thereby improving or changing the sound quality effect of the target sound effect.

[0129] In addition, as shown in FIG5 , the audio processing module 200 may further include a DAC (Digital to Analog Convertor) module 230, and the DAC module 230 may include at least one DAC 231. The audio processing module 200 can input the modulated audio data of the m sub-bands of each of the K channels into the corresponding m sound-emitting units 110 through the DAC 231 in the DAC module. When the DAC module 230 is in operation, it receives the modulated audio data of the K channels, converts the modulated audio data of the K channels into K analog electrical signals, and inputs the K analog electrical signals into the corresponding sound-emitting units 110. There may be various correspondences between the DAC 231 in the DAC module 230 and the K sound-emitting units, for example, one-to-one, one-to-many, or many-to-many, etc.

[0130] As shown in FIG6 , the audio processing module 200 may combine the sub-audio data of the same sub-frequency band of at least two channels into one frame of audio data through a combination operation, thereby obtaining integrated audio data.

[0131] The integrated audio data includes at least two sub-audio data of the same sub-frequency band. For example, the integrated audio data includes sub-audio data of the i-th sub-frequency band of the 1st channel and the K-th channel, where i is any integer in [1, m]. The i-th identifier can be used to identify the audio data to be played corresponding to the i-th sub-frequency band in the integrated audio data. The digital audio interface 240 or the i-th sound unit 110 can identify the audio data to be played of the i-th sound unit based on the i-th identifier.

[0132] After combining the sub-audio data of the same sub-frequency band of at least two channels, the audio processing module 200 can input the combined integrated audio data into the corresponding sound-emitting units 110. Since the integrated audio data is still digitized at this point, the audio processing module 200 can also include a digital audio interface 240, as shown in Figure 6. When the audio processing module 200 is in operation, the integrated audio data can be input into the N sound-emitting units of the corresponding frequency bands through the digital audio interface 240.

[0133] Among them, there are many ways for the audio processing module 200 to input the integrated audio data into the corresponding N sound units through the digital audio interface 240. For example, after receiving the integrated audio data, the digital audio interface 240 directly sends the integrated audio data to the corresponding N sound units 110, and the N sound units 110 identify the corresponding audio data to be played in the integrated audio data. Alternatively, the digital audio interface 240 identifies the audio data to be played corresponding to each sound unit 110 in the integrated audio data, and sends the audio data to be played to the corresponding sound unit 110.

[0134] Among them, the digital audio interface (Digital Audio Interfaces, DAI) 240 can be understood as an interface for transmitting digital audio signals at the board level or between boards. Compared with the analog interface, the digital audio interface 240 has stronger anti-interference ability and simple hardware design. There can be many types of digital audio interfaces 240, for example, it can include at least one of I2S (a digital audio interface), TDM (a digital audio interface), PCM (a digital audio interface) and PDM (a digital audio interface). Among them, when the digital audio interface 240 identifies the target audio data corresponding to each sound unit 110 in the integrated audio data and sends the target audio data to the corresponding sound unit 110, the digital audio interface 240 needs to have the ability to identify the target audio data corresponding to each sound unit 110. Therefore, the digital audio interface 240 is now a digital audio interface 240 with identification and distribution functions. When the digital audio interface 240 is working, it receives the integrated audio data, identifies the identifier of the sub-frequency band corresponding to each sound unit 110 and the audio data to be played in the sub-frequency band corresponding to the identifier in the integrated audio data, and sends the audio data to be played to the corresponding sound unit 110.

[0135] After receiving the corresponding audio data to be played, the N sound-emitting units can play the audio data to be played, thereby forming a reverberant sound. For example, the sound-emitting unit 110 sends the audio data to be played to at least one speaker, and the at least one speaker plays the audio data to be played. The speakers in the N sound-emitting units 110 play the corresponding target audio, thereby forming a reverberant sound.

[0136] Among them, when the N sound-emitting units 110 are working, they can use the same phase to play the corresponding target audio at the same time, so as to avoid the mutual influence between different target audios in the reverberation sound, thereby affecting the sound quality of the reverberation sound.

[0137] Among them, the N sound-emitting units include at least high-frequency, medium-frequency and low-frequency speakers, and the high-frequency, medium-frequency and low-frequency can be set according to the actual spectrum of the initial audio data. The spectrum of the initial audio data includes K frequency bands, and the K frequency bands can cover high-frequency, medium-frequency and low-frequency. As mentioned above, in some application scenarios, low frequency can refer to a frequency band of approximately 20Hz to 150Hz, medium frequency can refer to a frequency band of approximately 150Hz to 5KHz, high frequency can refer to a frequency band of approximately 5KHz to 20KHz, medium-low frequency can refer to a frequency band of approximately 150Hz to 500Hz, and medium-high frequency refers to a frequency band of 500Hz to 5KHz. Those skilled in the art will understand that the distinction between the above frequency bands is only given as an example. The definition of the above frequency bands may change with different industries, different application scenarios and different classification standards. For example, in some other application scenarios, low frequency refers to the frequency band of roughly 20Hz to 80Hz, mid-low frequency may refer to the frequency band of roughly 80Hz-160Hz, mid-frequency may refer to the frequency band of roughly 160Hz to 1280Hz, mid-high frequency may refer to the frequency band of roughly 1280Hz-2560Hz, and high frequency band may refer to the frequency band of roughly 2560Hz to 20KHz.

[0138] Among them, there can be many types of speakers, for example, they can include air speakers and vibration conduction speakers, etc. The air speaker can be understood as a speaker that outputs air-conducted sound waves, and the vibration speaker can be understood as a speaker that outputs sound waves conducted by a solid medium (such as bone-conducted sound waves). The vibration speaker and the air conduction speaker can be two independent functional devices, or they can be part of a single device that realizes multiple functions. Each of the N sound-emitting units 110 can include at least one of an air speaker and a vibration speaker.

[0139] In some embodiments, the audio processing device 10 may be a headset. There may be various types of headsets, such as wired headsets, wireless headsets, or Bluetooth headsets.

[0140] In some embodiments, the audio processing device 10 may further include an audio playback device that performs audio processing, such as a hearing aid, a speaker, or other audio playback devices, etc.

[0141] In some embodiments, the correspondence between channels and sound emitting units 110 may include at least one of a many-to-one relationship and a one-to-many relationship. The many-to-one relationship may be that multiple channels correspond to the same sound emitting unit 110. For example, taking K channels and N sound emitting units as an example, at least two channels correspond to the same sound emitting unit 110, so that the audio processing module 200 or the processor 400 sends the adjusted audio data of the K channels to the N sound emitting units 110. The one-to-many relationship may be that one channel corresponds to multiple sound emitting units 110. For example, taking K channels and N sound emitting units as an example, the m sub-bands of one channel correspond to m sound emitting units, N=m*K, so that the audio processing module 200 or the processor 400 sends the adjusted audio data of the K channels to the N sound emitting units 110.

[0142] In some embodiments, when at least one of the N sound-emitting units 110 changes or receives a sound effect adjustment request, the audio processing module 200 can adjust the correspondence between the target audio characteristics and the audio adjustment model. There are many situations in which the sound-emitting unit 110 changes, for example, it can include the sound-emitting unit failing to sound, the sound-emitting unit having an abnormality, or the sound performance of the sound-emitting unit changing (for example, the sound-emitting unit changes from bone conduction sounding to air conduction sounding unit, etc.) or other changes, etc. The above-mentioned sound effect adjustment request can be a request to adjust the sound effect of the currently playing audio. The sound effect can be the playback effect of the currently playing audio, and the type of sound effect can be various, for example, it can include heavy metal, light music, electronic music, classical, pop music or jazz, etc. When at least one of the N sound-emitting units 110 changes in sound or receives a sound effect adjustment request, the audio processing module 200 or the processor 400 can adjust the correspondence between the target audio characteristics and the audio adjustment model.

[0143] For example, the correspondence between the target audio characteristics under different sound effects and the audio adjustment model is pre-set. When a sound effect adjustment request is received, the correspondence between the target audio characteristics under the target sound effect and the audio adjustment model is obtained according to the identifier of the target sound effect.

[0144] In the above description, the audio processing module 200 and other associated electronic components, such as a DAC and a spectrum adjustment device, in the audio processing device 10 may be integrated circuits or electronic components electrically connected to one or more circuit boards. The audio processing device 10 may also include a processor and a storage medium, with the processor performing all or part of the functions of the audio processing module 200 and other electronic components.

[0145] FIG7 shows a schematic structural diagram of another audio processing device provided according to an embodiment of this specification.

[0146] 7 , in addition to the aforementioned hardware such as the audio processing module 200 and the sound module, the audio processing device 10 may further include at least one storage medium 300 and at least one processor 400. To meet internal and external communication requirements, the audio processing device 10 may further include a communication port 500 and an internal communication bus 600.

[0147] The internal communication bus 600 may connect various system components, including the storage medium 300 , the processor 400 , and the communication port 500 .

[0148] The data communication between the audio processing device 10 and the outside world can be completed through the communication port 500. For example, the audio processing device 10 can obtain initial audio data from the target device 20 through the communication port 500.

[0149] At least one storage medium 300 may include a data storage device. The data storage device may be a non-transitory storage medium or a temporary storage medium. For example, the data storage device may include one or more of a disk, a read-only storage medium (ROM), or a random access storage medium (RAM). When the audio processing device 10 is running, the storage medium 300 may also include at least one instruction set stored in the data storage device for obtaining initial audio data and processing the initial audio data. The instruction is a computer program code, which may include a program, routine, object, component, data structure, process, module, etc. for executing the audio processing method provided in this specification.

[0150] At least one processor 400 can be communicatively connected to at least one storage medium 300 via an internal communication bus 600. The communication connection refers to any form of connection capable of directly or indirectly receiving information. The at least one processor 400 is configured to execute the at least one instruction set described above. When the audio processing device 10 is in operation, the at least one processor 400 reads the at least one instruction set and, in accordance with the instructions of the at least one instruction set, executes the audio processing method provided herein. The processor 400 can perform all steps included in the audio processing method. The processor 400 can be in the form of one or more processors. In some embodiments, the processor 400 can include one or more hardware processors, such as a microcontroller, a microprocessor, a reduced instruction set computer (RISC), an application-specific integrated circuit (ASIC), an application-specific instruction set processor (ASIP), a central processing unit (CPU), a graphics processing unit (GPU), a physical processing unit (PPU), a microcontroller unit, a digital signal processor (DSP), a field-programmable gate array (FPGA), an advanced RISC machine (ARM), a programmable logic device (PLD), any circuit or processor capable of performing one or more functions, or any combination thereof. For illustrative purposes only, only one processor 400 is described in the audio processing device 10 in this specification. However, it should be noted that the audio processing device 10 in this specification may also include multiple processors 400. Therefore, the operations and / or method steps disclosed in this specification may be performed by one processor as described in this specification, or may be performed jointly by multiple processors. For example, if the processor 400 of the audio processing device 10 in this specification performs step A and step B, it should be understood that step A and step B may also be performed jointly or separately by two different processors 400 (for example, the first processor performs step A, the second processor performs step B, or the first and second processors perform steps A and B together).

[0151] In some embodiments, when the audio processing device 10 processes the initial audio data, all audio processing steps may be performed by the audio processing module 200 , or may be completed jointly by the audio processing module 200 , the storage medium 300 and the processor 400 .

[0152] Among them, there are many ways for the audio processing module 200 to perform all the audio processing steps. For example, the audio processing module 200 obtains initial audio data; performs frequency division processing on the initial audio data to obtain at least M sub-audio data of corresponding M sub-frequency bands, wherein each sub-frequency band corresponds to a predetermined frequency band output by a corresponding sound unit among N sound units, and M is an integer greater than 1; according to the target audio characteristics of the M sub-audio data, the corresponding M sub-audio data are audio-adjusted respectively to obtain M adjusted audio data, and each adjusted audio data of the M adjusted audio data is input into the corresponding sound unit respectively to form a reverberation sound.

[0153] Among them, there are many steps for the audio processing module 200, the storage medium 300 and the processor 400 to complete the audio processing together. For example, the audio processing module 200 or the processor 400 obtains the initial audio processing, the processor 400 obtains the control instruction in the storage medium 300, performs frequency division processing on the initial audio data, and obtains at least M sub-audio data of the corresponding M sub-frequency bands, and performs audio adjustment on the corresponding M sub-audio data according to the target audio characteristics of the M sub-audio data to obtain M adjusted audio data, and the processor 400 sends the M adjusted audio data to the DAC module 200 in the audio processing module 200. After receiving the M adjusted audio data, the DAC module 230 can convert the M adjusted audio data into analog electrical signals and send the analog electrical signals to the corresponding sound units 100. Each sound unit converts the corresponding adjusted audio data into target audio data. Audio, forming a reverberation sound; or, the audio processing module 200 or the processor 400 obtains the initial audio processing, the processor 400 obtains the control instruction in the storage medium 300, and performs frequency division processing on the initial audio data based on the control instruction to obtain at least M sub-audio data of the corresponding M sub-frequency bands, and performs audio adjustment on the corresponding M sub-audio data according to the target audio characteristics of the M sub-audio data to obtain M adjusted audio data, the processor 400 combines the adjusted audio data of at least two channels to obtain integrated audio data, and sends the integrated audio data to the digital audio interface 240 in the audio processing module 200, the digital audio interface 240 sends the integrated audio data to the corresponding sound unit 110, the sound unit 110 identifies the corresponding adjusted audio data in the integrated audio data, and converts the adjusted audio data into the target audio to form a reverberation sound; and so on.

[0154] The audio processing method in the exemplary embodiment of this specification will be described in detail below with reference to the accompanying drawings.

[0155] Figure 8 shows a flow chart of an audio processing method for an audio processing device provided according to an embodiment of this specification. The audio processing device 10 can execute the audio processing method P800 of this specification. Specifically, the audio processing module 200 and / or the processor 400 in the audio processing device 10 can read the instruction set stored in the local storage medium, and then, according to the instructions of the instruction set, execute the audio processing method P800 described in this specification. As shown in Figure 8, method P800 may include: steps S810 to S840. Below, the audio processing method of the embodiment of this specification will be described in detail with reference to Figure 8.

[0156] 8 , in step S810 , initial audio data is acquired.

[0157] For example, the audio processing module 200 or the processor 400 may obtain initial audio data. The method for obtaining the initial audio data may be referred to above and will not be described in detail here.

[0158] In step S820, the initial audio data is frequency-divided to obtain at least M sub-audio data corresponding to M sub-frequency bands, wherein each sub-frequency band corresponds to a predetermined frequency band output by a corresponding sound unit among the N sound units, M and N are both integers greater than 1, and each sound unit is used to output an audio signal of a predetermined frequency band.

[0159] In an exemplary embodiment, the initial audio data may be frequency-divided by software or by hardware. For example, the audio processing module 200 or the processor 400 may use a frequency-dividing processing algorithm to frequency-divide the initial audio data of K channels to obtain m sub-audio data of m sub-frequency bands of each channel, where M=K*m, K is an integer greater than or equal to 1. For example, if the initial audio data is 2 channels and there are 4 sounding units, each channel corresponds to 2 sounding units and 2 sub-frequency bands, then M=N=4, K=2, and m=2.

[0160] For example, if the sound unit 110 includes a bone conduction sound unit and an air conduction sound unit, the bone conduction sound unit has a better acoustic effect for mid- and high-frequency audio data, and the predetermined frequency band corresponding to the bone conduction sound unit, i.e., the operating frequency band, is the mid- and high-frequency band. The air conduction sound unit has a better acoustic effect for low-frequency audio data, and the predetermined frequency band corresponding to the air conduction sound unit, i.e., the operating frequency band, is the low-frequency band. The details of the frequency division process can be found above and will not be elaborated on here.

[0161] In step S830 , audio adjustments are performed on the corresponding M sub-audio data according to the target audio characteristics of the M sub-audio data to obtain M adjusted audio data.

[0162] In an exemplary embodiment, the target audio characteristic may include volume gain, and audio adjustments are performed on the corresponding M sub-audio data based on the volume gains of the M sub-audio data. For example, the audio processing module 200 or the processor 400 obtains the reference volume gain of each frequency point in the predetermined frequency band of the sound-emitting unit 110 corresponding to the target sub-frequency band, and based on the difference between the volume gain of the sub-audio data at each frequency point in the target sub-frequency band and the reference volume gain of each frequency point in the corresponding predetermined frequency band, audio adjustments are performed on the sub-audio data at each frequency point in the target sub-frequency band to reduce the difference between the volume gain of the corresponding frequency point and the reference volume gain. For example, if the volume gain of the sub-audio data at a frequency point in the sub-frequency band is greater than the corresponding reference volume gain, the volume gain at that frequency point is reduced; if the volume gain of the sub-audio data at a frequency point in the sub-frequency band is less than the corresponding reference volume gain, the volume gain at that frequency point is increased. The specific content of the audio adjustment in step S830 can be found in the above description and will not be repeated here.

[0163] In step S840, each of the M adjusted audio data is input to a corresponding sound emitting unit.

[0164] In an exemplary embodiment, the initial audio data includes audio data for K channels, each channel corresponding to m sounding units 110, or at least two channels corresponding to m sounding units, where M = K*m, where K is an integer greater than or equal to 1. For example, if the initial audio data includes two channels and four sounding units, with each channel corresponding to two sounding units and two sub-bands, then M = N = 4, K = 2, and m = 2. If each channel corresponds to m sounding units, the audio processing module 200 inputs the sub-audio data for the m sub-bands of each of the K channels into the corresponding m sounding units 110. The details of step S840 can be found above and will not be detailed here.

[0165] According to the technical solution in the example embodiment of Figure 8, on the one hand, the initial audio data is frequency-divided to obtain M sub-audio data of corresponding M sub-frequency bands, each sub-frequency band corresponding to a predetermined frequency band output by one of the N sound units, and the sub-frequency band where the sub-audio data is located can be adapted to the working frequency band of the sound unit, thereby improving the sound quality effect of the audio played by the sound unit; on the other hand, according to the target audio characteristics of the sub-audio data, the sub-audio data is audio-adjusted, and the adjusted audio data is input into the corresponding sound unit, and according to the audio characteristics of the sub-audio data, the sub-audio data to be played by the sound unit can be audio-adjusted, thereby making the audio characteristics of the adjusted audio data of the sub-frequency band more adapted to the audio characteristics of the corresponding sound unit, thereby ensuring that the sound emitted by each sound unit in the sound module has a better sound effect, thereby further improving the sound quality effect of the audio played by the sound unit.

[0166] In some embodiments, based on the above solution, the audio adjustment is performed on the corresponding M sub-audio data respectively, including, for each sub-audio data:

[0167] The audio adjustment is performed on the sub-audio data according to an audio adjustment model corresponding to the target audio characteristics of the sub-audio data, wherein the audio adjustment model corresponds to the sub-frequency band where the sub-audio data is located.

[0168] In some embodiments, based on the above solution, the target audio characteristic includes a volume gain, and before performing the audio adjustment on the sub-audio data, the method further includes:

[0169] Obtaining the volume gain of the sub-audio data of the above sub-frequency band;

[0170] The audio adjustment model corresponding to the sub-audio data of the sub-frequency band is determined according to the correspondence between the volume gain and the audio adjustment model.

[0171] In some embodiments, based on the above solution, the volume gain includes multiple volume levels, and different volume levels in the multiple volume levels correspond to different audio adjustment models.

[0172] In some embodiments, based on the above solution, the above method further includes, for each of the M sub-bands:

[0173] Obtaining modulated audio data of a predetermined time length as sample data;

[0174] Comparing the audio data of the sample data with reference audio data, where the reference audio data is audio data corresponding to a reference audio curve of the audio adjustment model corresponding to the sub-frequency band;

[0175] The model parameters of the audio adjustment model are adjusted according to the comparison results.

[0176] In some embodiments, based on the above solution, the audio processing module is further configured to:

[0177] An updated backup corresponding to the reference audio data is obtained, and the reference audio data is updated according to the updated backup.

[0178] In some embodiments, based on the above solution, the audio adjustment model is an equalizer adjustment model, and the model parameters are equalizer parameters.

[0179] In some embodiments, based on the above scheme, the above-mentioned N sound units include bone conduction sound units and air conduction sound units. When the above-mentioned bone conduction sound units are running, they output medium and high frequency audio signals, and when the above-mentioned air conduction sound units are running, they output low frequency audio signals.

[0180] In some embodiments, based on the above solution, the initial audio data includes audio data of K channels, and the frequency band interval of each channel includes m sub-bands, where m=M / K, and K is an integer greater than or equal to 1.

[0181] In some embodiments, based on the above scheme, the above K channels include a left channel and a right channel, the m sub-frequency bands corresponding to the above left channel include the left channel mid-high frequency and the left channel low frequency, and the m sub-frequency bands corresponding to the above right channel include the right channel mid-high frequency and the right channel low frequency.

[0182] In some embodiments, based on the above solution, the correspondence between the above sound channels and the above sound emitting units includes at least one of a one-to-many relationship and a many-to-one relationship.

[0183] In some embodiments, based on the above scheme, the above audio processing device can be headphones. Of course, the above audio processing device can also be other electronic devices, such as the sound device on a head-mounted VR device, the stereo sound device in a movie theater, etc.

[0184] The above is a schematic scheme of the audio processing method of the embodiment of this specification. It should be noted that the technical solution of this audio processing method and the technical solution of the above-mentioned audio processing device are based on the same concept. For details not described in detail in the technical solution of the audio processing method, please refer to the description of the technical solution of the above-mentioned audio processing device.

[0185] FIG9 shows a schematic flow chart of another audio processing method provided according to an embodiment of this specification.

[0186] As shown in FIG9 , the initial audio data is subjected to frequency division processing to produce sub-audio data in multiple sub-bands. For example, if the initial audio data is stereo data, the stereo data includes left channel data and right channel data. The left channel data and the right channel data are frequency-divided to obtain left channel mid-high frequency data, left channel low frequency data, right channel mid-high frequency data, and right channel low frequency data. A corresponding audio adjustment model is matched from an audio adjustment model library based on the audio gain of the sub-audio data in each sub-band. For example, the volume level of the audio gain of the sub-audio data is determined, and based on the pre-set correspondence between the volume level and the audio adjustment model, the audio adjustment model corresponding to the sub-audio data is determined from the audio adjustment model library. For example, the volume of the first volume level is the volume of the original audio signal output by the power amplifier, the gain is 0dB, and each level decreases by 3dB, the minimum volume level is -99dB gain, and there are 16 volume levels in total. Several audio adjustment models in the audio adjustment library are automatically matched to the volume level of the sub-audio data. Audio adjustment is performed on the corresponding sub-audio data based on the matched audio adjustment model to obtain corresponding adjusted audio data.

[0187] As shown in Figure 9, the volume levels of the left channel mid-high frequency data, the left channel low frequency data, the right channel mid-high frequency data, and the right channel low frequency data are determined. Based on the determined volume levels, four pre-set EQ adjustment models are selected from the EQ adjustment model library and assigned to the corresponding audio paths. The left channel mid-high frequency data is adjusted according to EQ adjustment model A; the left channel low frequency data is adjusted according to EQ adjustment model B; the right channel mid-high frequency data is adjusted according to EQ adjustment model C; and the right channel low frequency data is adjusted according to EQ adjustment model D.

[0188] Furthermore, as shown in FIG9 , the initial audio data is two channels, namely a left channel and a right channel, with four sounding units. Each channel corresponds to two sounding units and two sub-bands. Thus, M = N = 4, K = 2, and m = 2. The two sub-bands corresponding to the left channel include the left channel mid-high frequency and the left channel low frequency, while the two sub-bands corresponding to the right channel include the right channel mid-high frequency and the right channel low frequency. The left channel corresponds to a bone conduction speaker and an air conduction speaker; the right channel corresponds to a bone conduction speaker and an air conduction speaker. When the bone conduction speaker is in operation, it outputs mid-high frequency audio signals, while when the air conduction speaker is in operation, it outputs low frequency audio signals. When each channel corresponds to two sounding units, the audio processing module 200 inputs the adjusted audio data of the two sub-bands of each of the two channels into the corresponding two sounding units 110. The specific process can be found in the above description and will not be elaborated on here.

[0189] FIG10 is a schematic diagram showing a flow chart of adjusting model parameters of an audio adjustment model according to an embodiment of this specification.

[0190] As shown in FIG10 , the initial audio data is subjected to frequency division processing to generate sub-audio data of multiple sub-bands. A corresponding audio adjustment model is matched from an audio adjustment model library based on the audio gain of the sub-audio data of each sub-band. For example, the volume level of the audio gain of the sub-audio data of the sub-band is determined, and based on a pre-set correspondence between the volume level and the audio adjustment model, the audio adjustment model corresponding to the sub-audio data is determined from the audio adjustment model library.

[0191] Furthermore, for each of the M sub-bands, adjusted audio data of a predetermined time length is obtained as sample data. For example, as shown in FIG10 , a segment of sub-audio data is recorded for the target sub-band as sample data. The audio data of the sample data is compared with the reference audio data. The reference audio data is the audio data corresponding to the reference audio curve of the audio adjustment model corresponding to the sub-band. The reference audio curve is an audio curve such as a frequency response curve determined by acoustic professionals based on the optimal sound effect output by the sound-emitting unit corresponding to the sub-band. The model parameters of the audio adjustment model are adjusted according to the comparison results. For example, the audio adjustment model includes an equalizer model, and the model parameters include gain parameters. The specific process can be found in the above description, and will not be described here one by one.

[0192] Furthermore, as shown in FIG10 , an updated backup of the reference audio data of the audio adjustment model is obtained from the target device, and the reference audio data of the audio adjustment model is updated based on the updated backup. For example, reference audio data corresponding to the reference audio curves of the audio adjustment model corresponding to various sound effects are pre-set. When updating the reference audio data of a target sound effect, an updated backup of the reference audio data of the audio adjustment model of the target sound effect is obtained, and the reference audio data is updated based on the updated backup. The target sound effect can be of various types, including, for example, heavy metal, light music, electronic music, classical music, pop music, or jazz. The audio processing device includes a memory having a backup area for the reference audio data. In response to an update request for the target sound effect initiated by the target device, the device obtains an updated backup of the reference audio data of the audio adjustment model of the target sound effect via wireless transmission, such as Bluetooth, via OTA (Over-the-Air Technology). The obtained updated backup of the reference audio data of the target sound effect is stored in the backup area, and the reference audio data corresponding to the target reference sound effect is updated based on the updated backup of the target reference sound effect in the backup area.

[0193] To summarize, the audio processing device and audio processing method provided in this specification, the audio processing device includes a sound module and an audio processing module, wherein the sound module includes N sound units, and each sound unit outputs an audio signal of a predetermined frequency band when in operation; after obtaining the initial audio data, the audio processing module performs frequency division processing on the initial audio data to obtain at least M sub-audio data of the corresponding M sub-bands, wherein each sub-band corresponds to a predetermined frequency band output by a corresponding sound unit among the N sound units, and according to the target audio characteristics of the M sub-audio data, the corresponding M sub-audio data are audio-adjusted respectively to obtain M adjusted audio data, and each adjusted audio data is input into the corresponding sound unit respectively. On the one hand, the initial audio data is frequency-divided to obtain M sub-audio data of corresponding M sub-frequency bands, each sub-frequency band corresponding to a predetermined frequency band output by one of the N sound units, and the sub-frequency band where the sub-audio data is located can be adapted to the working frequency band of the sound unit, thereby improving the sound quality effect of the audio played by the sound unit; on the other hand, according to the target audio characteristics of the sub-audio data, the sub-audio data is audio-adjusted, and the adjusted audio data is input into the corresponding sound unit, and the sub-audio data to be played by the sound unit can be audio-adjusted according to the audio characteristics of the sub-audio data, so that the audio characteristics of the adjusted audio data of the sub-frequency bands of different frequency bands are more adapted to the audio characteristics of the corresponding sound unit, thereby ensuring that the sound emitted by each sound unit in the sound module has a better sound effect, thereby further improving the sound quality effect of the audio played by the sound unit.

[0194] Another aspect of this specification provides a non-transitory storage medium storing at least one set of executable instructions for performing audio processing. When executed by a processor, the executable instructions direct the processor to implement the steps of the audio processing method P800 described herein. In some possible implementations, various aspects of this specification may also be implemented as a program product comprising program code. When the program product is executed on an audio processing device 10, the program code is configured to cause the audio processing device 10 to perform the steps of the audio processing method P800 described herein. The program product for implementing the above method may comprise a portable compact disc read-only memory (CD-ROM) comprising the program code and may be executed on the audio processing device 10. However, the program product of this specification is not limited thereto. In this specification, a readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system. The program product may utilize any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or any combination thereof. More specific examples of computer-readable storage media include: an electrical connection having one or more conductors, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. The computer-readable storage medium may include a data signal propagated in baseband or as part of a carrier wave, which carries readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable storage medium may also be any readable medium other than a readable storage medium that can transmit, propagate, or transfer a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing. Program code for performing the operations of the present description may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the audio processing device 10, partially on the audio processing device 10, as a stand-alone software package, partially on the audio processing device 10 and partially on a remote computing device, or entirely on a remote computing device.

[0195] The foregoing description of some embodiments of the present disclosure is limited to the following. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in an order different from that described in the embodiments and still achieve the desired results. Furthermore, the processes depicted in the accompanying drawings do not necessarily require a specific or sequential order to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or potentially advantageous.

[0196] In summary, after reading this detailed disclosure, those skilled in the art will appreciate that the foregoing detailed disclosure may be presented by way of example only and may not be limiting. Although not expressly stated herein, those skilled in the art will understand that this specification encompasses various reasonable changes, improvements, and modifications to the embodiments. Such changes, improvements, and modifications are intended to be suggested by this specification and are within the spirit and scope of the exemplary embodiments of this specification.

[0197] Furthermore, certain terms in this specification have been used to describe embodiments of this specification. For example, “one embodiment,” “an embodiment,” and / or “some embodiments” mean that a particular feature, structure, or characteristic described in connection with that embodiment may be included in at least one embodiment of this specification. Therefore, it is emphasized and should be understood that two or more references to “an embodiment,” “one embodiment,” or “an alternative embodiment” in various parts of this specification do not necessarily refer to the same embodiment. Furthermore, particular features, structures, or characteristics may be appropriately combined in one or more embodiments of this specification.

[0198] It should be understood that in the foregoing descriptions of the embodiments of this specification, to facilitate understanding of a feature and to simplify this specification, various features are combined in a single embodiment, figure, or description thereof. However, this does not necessarily mean that these features are combined. When reading this specification, a person skilled in the art may label some of the devices as separate embodiments. In other words, the embodiments of this specification can also be understood as the integration of multiple sub-embodiments. This also applies when each sub-embodiment contains fewer than all the features of a single previously disclosed embodiment.

[0199] Each patent, patent application, patent application publication, and other materials, such as articles, books, specifications, publications, documents, articles, and the like, cited herein is hereby incorporated by reference in its entirety for all purposes, except for any prosecution document history related thereto, any equivalent that may be inconsistent or conflicting with this document, or any equivalent prosecution document history that may have a limiting effect on the broadest scope of the claims now or hereafter associated with this document. For example, if there is any inconsistency or conflict between the descriptions, definitions, and / or usage of terms associated with any incorporated material and the terminology, descriptions, definitions, and / or usage associated with this document, the terminology in this document shall control.

[0200] Finally, it should be understood that the embodiments of the application disclosed herein are illustrative of the principles of the embodiments of this specification. Other modified embodiments are also within the scope of this specification. Therefore, the embodiments disclosed in this specification are merely examples and not limitations. Those skilled in the art can adopt alternative configurations based on the embodiments in this specification to implement the application in this specification. Therefore, the embodiments of this specification are not limited to the embodiments precisely described in the application.

Claims

1. An audio processing device, characterized in that: include: A sound module, comprising N sound units, each of which outputs an audio signal of a predetermined frequency band when in operation, wherein N is an integer greater than 1; and An audio processing module is communicatively connected to the sound module, and the audio processing module is configured as follows: Get the initial audio data, The initial audio data is subjected to frequency division processing to obtain at least M sub-audio data of corresponding M sub-frequency bands, wherein each sub-frequency band corresponds to the predetermined frequency band output by the corresponding sounding unit among the N sounding units, and M is an integer greater than 1. According to the target audio characteristics of the M sub-audio data, audio adjustments are respectively performed on the corresponding M sub-audio data to obtain M adjusted audio data, and Each of the M adjusted audio data is input into the corresponding sound emitting unit.

2. The audio processing device according to claim 1, characterized in that In order to perform audio adjustment on the M sub-audio data respectively, the audio processing module is configured to, for each of the sub-audio data: The audio adjustment is performed on the sub-audio data according to an audio adjustment model corresponding to the target audio characteristic of the sub-audio data, wherein the audio adjustment model corresponds to the sub-frequency band where the sub-audio data is located.

3. The audio processing device according to claim 2, characterized in that The target audio characteristic includes a volume gain; before performing the audio adjustment on the sub-audio data, the audio processing module is further configured to: Obtaining the volume gain of the sub-audio data of the sub-frequency band; The audio adjustment model corresponding to the sub-audio data of the sub-frequency band is determined according to the corresponding relationship between the volume gain and the audio adjustment model.

4. The audio processing device according to claim 3, characterized in that The volume gain includes multiple volume levels, and different volume levels in the multiple volume levels correspond to different audio adjustment models.

5. The audio processing device according to claim 2, characterized in that The audio processing module is further configured to, for each of the M sub-frequency bands: Obtaining modulated audio data of a predetermined time length as sample data; Comparing the audio data of the sample data with reference audio data, the reference audio data being audio data corresponding to a reference audio curve of the audio adjustment model corresponding to the sub-frequency band; The model parameters of the audio adjustment model are adjusted according to the comparison result.

6. The audio processing device according to claim 5, characterized in that The audio processing module is further configured as: An updated backup corresponding to the reference audio data of the audio adjustment model is obtained, and the reference audio data is updated according to the updated backup.

7. The audio processing device according to any one of claims 2 to 6, characterized in that: The audio adjustment model is an equalizer adjustment model, and the model parameters are equalizer parameters.

8. The audio processing device according to claim 1, characterized in that The N sound-generating units include a bone conduction sound-generating unit and an air conduction sound-generating unit. The bone conduction sound-generating unit outputs medium and high frequency audio signals when in operation, and the air conduction sound-generating unit outputs low frequency audio signals when in operation.

9. The audio processing device according to claim 1, characterized in that The initial audio data includes audio data of K channels, and the frequency band interval of each channel includes m sub-frequency bands, wherein m=M / K, and K is an integer greater than or equal to 1.

10. The audio processing device according to claim 9, characterized in that The K channels include a left channel and a right channel, the m sub-frequency bands corresponding to the left channel include left channel mid-high frequency and left channel low frequency, and the m sub-frequency bands corresponding to the right channel include right channel mid-high frequency and right channel low frequency.

11. The audio processing device according to claim 9, characterized in that The corresponding relationship between the sound channels and the sound generating units includes at least one of a one-to-many relationship and a many-to-one relationship.

12. The audio processing device according to claim 1, characterized in that The audio processing device is a headset.

13. An audio processing method, characterized in that: Applied to an audio processing device, the audio processing device includes N sound-emitting units, each of which is used to output an audio signal of a predetermined frequency band, wherein N is an integer greater than 1, and the method includes: Obtaining initial audio data; Performing frequency division processing on the initial audio data to obtain at least M sub-audio data of corresponding M sub-frequency bands, wherein each sub-frequency band corresponds to the predetermined frequency band output by the corresponding sounding unit among the N sounding units, and M is an integer greater than 1; According to the target audio characteristics of the M sub-audio data, respectively perform audio adjustments on the corresponding M sub-audio data to obtain M adjusted audio data; and Each of the M adjusted audio data is input into the corresponding sound emitting unit.

14. The method according to claim 13, characterized in that The performing audio adjustment on the corresponding M sub-audio data respectively includes, for each of the sub-audio data: The audio adjustment is performed on the sub-audio data according to an audio adjustment model corresponding to the target audio characteristic of the sub-audio data, wherein the audio adjustment model corresponds to the sub-frequency band where the sub-audio data is located.

15. The method according to claim 14, characterized in that The target audio characteristic includes a volume gain. Before performing the audio adjustment on the sub-audio data, the method further includes: Obtaining the volume gain of the sub-audio data of the sub-frequency band; The audio adjustment model corresponding to the sub-audio data of the sub-frequency band is determined according to the corresponding relationship between the volume gain and the audio adjustment model.

16. The method according to claim 15, characterized in that The volume gain includes multiple volume levels, and different volume levels in the multiple volume levels correspond to different audio adjustment models.

17. The method according to claim 14, characterized in that The method further includes, for each of the M sub-frequency bands: Obtaining modulated audio data of a predetermined time length as sample data; Comparing the audio data of the sample data with reference audio data, the reference audio data being audio data corresponding to a reference audio curve of the audio adjustment model corresponding to the sub-frequency band; The model parameters of the audio adjustment model are adjusted according to the comparison result.

18. The method according to claim 17, characterized in that The audio adjustment model is an equalizer adjustment model, and the model parameters are equalizer parameters.

19. The method according to claim 13, characterized in that The N sound-generating units include a bone conduction sound-generating unit and an air conduction sound-generating unit. The bone conduction sound-generating unit outputs medium and high frequency audio signals when in operation, and the air conduction sound-generating unit outputs low frequency audio signals when in operation.

20. The method according to claim 13, characterized in that The initial audio data includes audio data of K channels, and the frequency band interval of each channel includes m sub-frequency bands, wherein m=M / K, and K is an integer greater than or equal to 1.

21. The method according to claim 20, characterized in that The K channels include a left channel and a right channel, the m sub-frequency bands corresponding to the left channel include left channel mid-high frequency and left channel low frequency, and the m sub-frequency bands corresponding to the right channel include right channel mid-high frequency and right channel low frequency.

Images