A method for audio coding and a coding and decoding device

Abstract

The present application provides an audio coding method and coding device, which can reduce coding redundancy and improve coding efficiency. The method includes: obtaining a current frame of an audio signal, the current frame of the audio signal includes a high-frequency band signal and a low-frequency band signal; performing a first coding according to the high-frequency band signal and the low-frequency band signal to obtain a first coding parameter of the current frame; performing a second coding according to the high-frequency band signal to obtain a second coding parameter of the current frame, the second coding parameter is used to represent information of a tone component of the high-frequency band signal; adjusting the spectrum of the high-frequency band signal after band expansion according to the information of the tone component of the high-frequency band signal to obtain an adjusted spectrum of the high-frequency band signal; performing a third coding according to the adjusted spectrum of the high-frequency band signal to obtain a third coding parameter; performing code stream multiplexing on the first coding parameter, the second coding parameter and the third coding parameter to obtain a coded code stream of the current frame.

Description

Technical Field

[0001] The present application relates to the field of media, and more specifically, to an audio encoding method and encoding and decoding device. Background Art

[0002] In order to reduce the coding bit rate, audio codecs often further use the correlation between signals in different frequency bands for coding. The basic principle is to use low-frequency band signals to encode high-frequency band signals through spectrum replication or band extension, so as to encode high-frequency band signals with fewer bits, thereby reducing the coding bit rate of the encoder. However, in real audio signals, there are often some tonal components in the high-frequency band spectrum that are not similar to the low-frequency band spectrum. Due to the limitation of the number of coding bits, when encoding the tonal component information in the high-frequency band signal, how to determine the tonal components that need to be encoded and efficiently use the limited number of coding bits to obtain better coding effects has become one of the key technologies affecting the coding quality. Summary of the invention

[0003] The present application provides an audio coding method and a coding and decoding device. The audio coding method can use a limited number of coding bits to obtain a better coding effect when high-frequency band signal coding includes frequency band extension coding and tone component coding.

[0004] In a first aspect, a method for audio encoding is provided, comprising: acquiring a current frame of an audio signal, the current frame of the audio signal comprising a high-frequency band signal and a low-frequency band signal; performing a first encoding according to the high-frequency band signal and the low-frequency band signal to obtain a first encoding parameter of the current frame of the audio signal, the first encoding comprising a frequency band extension encoding; performing a second encoding according to the high-frequency band signal to obtain a second encoding parameter of the current frame, the second encoding parameter being used to represent information of a tone component of the high-frequency band signal; adjusting a spectrum of the high-frequency band signal after frequency band extension processing according to the information of the tone component of the high-frequency band signal to obtain an adjusted spectrum of the high-frequency band signal, the spectrum of the high-frequency band signal after frequency band extension processing being obtained in the frequency band extension encoding process; performing a third encoding according to the adjusted spectrum of the high-frequency band signal to obtain a third encoding parameter; and performing code stream multiplexing on the first encoding parameter, the second encoding parameter and the third encoding parameter to obtain an encoding code stream of the current frame of the audio signal.

[0005] Therefore, the audio encoding method of the embodiment of the present application adjusts the spectrum of the high-band signal after the band extension processing according to the information of the pitch component of the high-band signal, obtains the spectrum of the adjusted high-band signal in the current frequency region, and then performs a third encoding on the spectrum of the adjusted high-band signal, thereby avoiding the encoding redundancy of the pitch component of the high-band signal caused by directly performing a third encoding on the spectrum of the high-band signal after the band extension processing.

[0006] In combination with the first aspect, in certain implementations of the first aspect, the information of the tone component includes one or more of the following parameters: mark information of the tone component, position information of the tone component, quantity information of the tone component, amplitude information of the tone component, or energy information of the tone component.

[0007] In combination with the first aspect, in certain implementations of the first aspect, the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes a current frequency region; adjusting the spectrum of the high frequency band signal after the band expansion processing according to the information of the tone components of the high frequency band signal to obtain the adjusted spectrum of the high frequency band signal includes: adjusting the spectrum of the high frequency band signal after the band expansion processing of the current frequency region according to the quantity information of the tone components of the current frequency region to obtain the adjusted spectrum of the high frequency band signal of the current frequency region.

[0008] Therefore, the audio encoding method of the embodiment of the present application adjusts the spectrum of the high-band signal after the band extension processing according to the quantity information of the pitch components of the high-band signal, obtains the spectrum of the adjusted high-band signal in the current frequency region, and then performs a third encoding on the spectrum of the adjusted high-band signal, thereby avoiding the encoding redundancy of the pitch components of the high-band signal caused by directly performing a third encoding on the spectrum of the high-band signal after the band extension processing.

[0009] In combination with the first aspect, in certain implementations of the first aspect, adjusting the frequency spectrum of the high-band signal after the band expansion processing of the current frequency region according to the quantity information of the tonal components of the current frequency region to obtain the spectrum of the adjusted high-band signal of the current frequency region includes: if the quantity information of the tonal components of the current frequency region meets a first preset condition, adjusting the frequency spectrum of the high-band signal after the band expansion processing of the current frequency region to obtain the spectrum of the adjusted high-band signal of the current frequency region.

[0010] In combination with the first aspect, in some implementations of the first aspect, the first preset condition is that the number of tonal components in the current frequency region is greater than or equal to a first threshold.

[0011] In combination with the first aspect, in certain implementations of the first aspect, the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes a current frequency region; the adjusting the spectrum of the high frequency band signal after the band expansion processing according to the information of the tone component of the high frequency band signal to obtain the adjusted spectrum of the high frequency band signal includes: adjusting the spectrum of the high frequency band signal after the band expansion processing of the current frequency region according to the tone component flag information of the current frequency region to obtain the adjusted spectrum of the high frequency band signal of the current frequency region, and the tone component flag information is used to mark whether there is a tone component in the current frequency region.

[0012] Therefore, the audio encoding method of the embodiment of the present application adjusts the spectrum of the high-band signal after the band extension processing according to the mark information of the pitch component of the high-band signal, obtains the spectrum of the adjusted high-band signal in the current frequency region, and then performs a third encoding on the spectrum of the adjusted high-band signal, thereby avoiding the encoding redundancy of the pitch component of the high-band signal caused by directly performing a third encoding on the spectrum of the high-band signal after the band extension processing.

[0013] In combination with the first aspect, in certain implementations of the first aspect, the frequency spectrum of the high-band signal after the band expansion processing of the current frequency region is adjusted according to the tone component mark information of the current frequency region to obtain the spectrum of the adjusted high-band signal of the current frequency region, including: if the value of the tone component mark information of the current frequency region is a first preset value, the frequency spectrum of the high-band signal after the band expansion processing of the current frequency region is adjusted to obtain the spectrum of the adjusted high-band signal of the current frequency region, wherein the value of the tone component mark information of the current frequency region being the first preset value indicates that there is a tone component in the current frequency region.

[0014] In combination with the first aspect, in certain implementations of the first aspect, the adjusting the spectrum of the high-band signal after the band expansion processing of the current frequency region to obtain the spectrum of the adjusted high-band signal of the current frequency region includes: setting the spectrum value of the high-band signal after the band expansion processing of the current frequency region to a second preset value to obtain the spectrum of the adjusted high-band signal of the current frequency region; or, performing weighted processing on the spectrum of the high-band signal after the band expansion processing of the current frequency region to obtain the spectrum of the adjusted high-band signal of the current frequency region.

[0015] In combination with the first aspect, in certain implementations of the first aspect, the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes a current frequency region; adjusting the spectrum of the high frequency band signal after the band expansion processing according to the information of the tone component of the high frequency band signal to obtain the adjusted spectrum of the high frequency band signal includes: adjusting the spectrum of the high frequency band signal after the band expansion processing of the current frequency region according to the position information of the tone component of the current frequency region to obtain the adjusted spectrum of the high frequency band signal of the current frequency region.

[0016] Therefore, the audio encoding method of the embodiment of the present application adjusts the spectrum of the high-band signal after the band extension processing according to the position information of the pitch component of the high-band signal, obtains the spectrum of the adjusted high-band signal in the current frequency region, and then performs a third encoding on the spectrum of the adjusted high-band signal, thereby avoiding the encoding redundancy of the pitch component of the high-band signal caused by directly performing a third encoding on the spectrum of the high-band signal after the band extension processing.

[0017] In combination with the first aspect, in certain implementations of the first aspect, the current frequency region includes at least one sub-band, the at least one sub-band includes the current sub-band, and according to the position information of the tone component of the current frequency region, the spectrum of the high-frequency band signal after the band expansion processing of the current frequency region is adjusted to obtain the spectrum of the adjusted high-frequency band signal of the current frequency region, including: if the position information of the tone component of the current frequency region meets the second preset condition, the spectrum of the high-frequency band signal after the band expansion processing of the current sub-band is adjusted to obtain the spectrum of the adjusted high-frequency band signal of the current sub-band.

[0018] At this time, the spectrum of the high-frequency band signal after the band expansion processing is adjusted according to the position information of the tone component of the high-frequency band signal, so that only the current sub-band corresponding to the tone component can be adjusted, avoiding adjustments to other sub-bands of the high-frequency band, reducing the impact on other sub-bands of the high-frequency band, and realizing fine-grained adjustment, saving the computing resources of the encoding and decoding equipment.

[0019] In combination with the first aspect, in certain implementations of the first aspect, the position information of the tone component of the current frequency region includes the serial number of the subband including the tone component in the current frequency region, and the second preset condition is that the serial number of the subband including the tone component includes the serial number of the current subband.

[0020] In combination with the first aspect, in some implementations of the first aspect, adjusting the spectrum of the high-band signal after the band extension processing of the current sub-band to obtain the spectrum of the adjusted high-band signal of the current sub-band includes:

[0021] The spectrum value of the high-band signal after the frequency band extension processing of the current sub-band is set to a second preset value to obtain the spectrum of the adjusted high-band signal of the current sub-band; or, the spectrum of the high-band signal after the frequency band extension processing of the current sub-band is weighted to obtain the spectrum of the adjusted high-band signal of the current sub-band.

[0022] In combination with the first aspect, in certain implementations of the first aspect, before adjusting the spectrum of the high-band signal after the band extension processing according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal, the method also includes: determining a starting frequency area according to the coding rate of the current frame, the starting frequency area being the frequency area with the smallest serial number within the frequency range where it is necessary to determine whether to adjust the spectrum of the high-band signal after the band extension processing; adjusting the spectrum of the high-band signal after the band extension processing according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal includes: starting from the starting frequency area, adjusting the spectrum of the high-band signal after the band extension processing according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal.

[0023] In combination with the first aspect, in certain implementations of the first aspect, determining the starting frequency area based on the coding rate of the current frame includes: if the coding rate of the current frame satisfies a third preset condition, then the starting frequency area is a first starting frequency area; or, if the coding rate of the current frame does not satisfy the third preset condition, then the starting frequency area is a second starting frequency area, and the frequency ranges corresponding to the first starting frequency area and the second starting frequency area are different.

[0024] In combination with the first aspect, in certain implementations of the first aspect, before adjusting the spectrum of the high-band signal after the band extension processing according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal, the method also includes: determining a first frequency area range according to the coding rate of the current frame, the first frequency area range being the range of the frequency area where it is necessary to determine whether to adjust the spectrum of the high-band signal after the band extension processing; adjusting the spectrum of the high-band signal after the band extension processing according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal includes: within the first frequency area range, adjusting the spectrum of the high-band signal after the band extension processing according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal.

[0025] In combination with the first aspect, in certain implementations of the first aspect, determining the first frequency area range based on the coding rate of the current frame includes: if the coding rate of the current frame satisfies a third preset condition, then the first frequency area range is the first range; or, if the coding rate of the current frame does not satisfy the third preset condition, then the first frequency area range is the second range, and the frequency ranges corresponding to the first range and the second range are not completely the same.

[0026] In combination with the first aspect, in certain implementations of the first aspect, the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region; before adjusting the spectrum of the high frequency band signal after the band extension processing according to the information of the tone component of the high frequency band signal to obtain the adjusted spectrum of the high frequency band signal, the method also includes: determining whether the current frequency region belongs to a first frequency region range according to the spectrum of the high frequency band signal after the band extension processing of the current frequency region, the first frequency region range being the range of the frequency region for determining whether to adjust the spectrum of the high frequency band signal after the band extension processing; if the current frequency region belongs to the first frequency region range, adjusting the spectrum of the high frequency band signal after the band extension processing according to the information of the tone component of the high frequency band signal to obtain the adjusted spectrum of the high frequency band signal includes: adjusting the spectrum of the high frequency band signal of the current frequency region according to the information of the tone component of the high frequency band signal to obtain the adjusted spectrum of the high frequency band signal of the current frequency region.

[0027] In combination with the first aspect, in certain implementations of the first aspect, if in the high-band signal spectrum of the current frequency region after band expansion processing, the number of frequency points whose absolute values ​​of spectrum values ​​are greater than the second threshold is less than the third threshold, then the current frequency region belongs to the first frequency region range.

[0028] Therefore, before adjusting the spectrum of the high-band signal after the band expansion processing, determining the range of the frequency region of the current frame for judging whether to perform spectrum adjustment is performed according to the coding rate of the current frame or the spectrum of the current frame after the band expansion processing, which has higher coding efficiency.

[0029] In a second aspect, a coding and decoding device is provided, comprising: an acquisition unit, configured to acquire a current frame of an audio signal, wherein the current frame of the audio signal comprises a high-frequency band signal and a low-frequency band signal; a processing unit, configured to perform a first encoding according to the high-frequency band signal and the low-frequency band signal to obtain a first encoding parameter of the current frame of the audio signal, wherein the first encoding comprises a frequency band extension encoding; the processing unit is further configured to perform a second encoding according to the high-frequency band signal to obtain a second encoding parameter of the current frame, wherein the second encoding parameter is used to represent information of a tone component of the high-frequency band signal; the processing unit is further configured to adjust a spectrum of the high-frequency band signal after frequency band extension processing according to the information of the tone component of the high-frequency band signal to obtain a spectrum of the adjusted high-frequency band signal, wherein the spectrum of the high-frequency band signal after frequency band extension processing is obtained in the frequency band extension encoding process; the processing unit is further configured to perform a third encoding according to the spectrum of the adjusted high-frequency band signal to obtain a third encoding parameter; the processing unit is further configured to perform code stream multiplexing on the first encoding parameter, the second encoding parameter and the third encoding parameter to obtain a coded code stream of the current frame of the audio signal.

[0030] In combination with the second aspect, in certain implementations of the second aspect, the information of the tone component includes one or more of the following parameters: mark information of the tone component, position information of the tone component, quantity information of the tone component, amplitude information of the tone component, or energy information of the tone component.

[0031] In combination with the second aspect, in certain implementations of the second aspect, the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region; the processing unit is specifically used to: adjust the spectrum of the high frequency band signal after the band expansion processing of the current frequency region according to the quantity information of the tonal components of the current frequency region to obtain the spectrum of the adjusted high frequency band signal of the current frequency region.

[0032] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is specifically used to: if the quantity information of the tonal components of the current frequency region meets the first preset condition, adjust the spectrum of the high-frequency band signal after the band expansion processing of the current frequency region to obtain the spectrum of the adjusted high-frequency band signal of the current frequency region.

[0033] In combination with the second aspect, in some implementations of the second aspect, the first preset condition is that the number of tonal components in the current frequency region is greater than or equal to a first threshold.

[0034] In combination with the second aspect, in certain implementations of the second aspect, the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region; the processing unit is specifically used to: adjust the high frequency band signal spectrum after the band expansion processing of the current frequency region according to the tone component mark information of the current frequency region to obtain the spectrum of the adjusted high frequency band signal of the current frequency region, and the tone component mark information is used to mark whether there is a tone component in the current frequency region.

[0035] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is specifically used to: if the value of the tone component mark information of the current frequency region is a first preset value, adjust the high-frequency band signal spectrum of the current frequency region after the band expansion processing to obtain the adjusted high-frequency band signal spectrum of the current frequency region, wherein the value of the tone component mark information of the current frequency region is the first preset value indicating that there is a tone component in the current frequency region.

[0036] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is specifically used to: set the spectrum value of the high-frequency band signal after the band expansion processing of the current frequency region to a second preset value to obtain the spectrum of the adjusted high-frequency band signal of the current frequency region; or, perform weighted processing on the spectrum of the high-frequency band signal after the band expansion processing of the current frequency region to obtain the spectrum of the adjusted high-frequency band signal of the current frequency region.

[0037] In conjunction with the second aspect, in some implementations of the second aspect, the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes a current frequency region; and the processing unit is specifically configured to:

[0038] According to the position information of the tonal component of the current frequency region, the spectrum of the high-band signal of the current frequency region after the band extension processing is adjusted to obtain the spectrum of the adjusted high-band signal of the current frequency region.

[0039] In combination with the second aspect, in certain implementations of the second aspect, the current frequency region includes at least one sub-band, the at least one sub-band includes the current sub-band, and the processing unit is specifically used to: if the position information of the tone component of the current frequency region meets the second preset condition, then adjust the high-frequency band signal spectrum of the current sub-band after the band expansion processing to obtain the adjusted high-frequency band signal spectrum of the current sub-band.

[0040] In combination with the second aspect, in certain implementations of the second aspect, the position information of the tone component of the current frequency region includes the serial number of the subband of the tone component included in the current frequency region, and the second preset condition is that the serial number of the subband including the tone component includes the serial number of the current subband.

[0041] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is specifically used to: set the spectrum value of the high-frequency band signal after the frequency band expansion processing of the current sub-band to a second preset value to obtain the spectrum of the adjusted high-frequency band signal of the current sub-band; or, perform weighted processing on the spectrum of the high-frequency band signal after the frequency band expansion processing of the current sub-band to obtain the spectrum of the adjusted high-frequency band signal of the current sub-band.

[0042] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is also used to: before adjusting the spectrum of the high-band signal after the band extension processing according to the information of the pitch component of the high-band signal to obtain the adjusted spectrum of the high-band signal, determine a starting frequency area according to the coding rate of the current frame, and the starting frequency area is the frequency area with the smallest serial number within the frequency range where it is necessary to determine whether to adjust the spectrum of the high-band signal after the band extension processing; adjusting the spectrum of the high-band signal after the band extension processing according to the information of the pitch component of the high-band signal to obtain the adjusted spectrum of the high-band signal, including: starting from the starting frequency area, adjusting the spectrum of the high-band signal after the band extension processing according to the information of the pitch component of the high-band signal to obtain the adjusted spectrum of the high-band signal.

[0043] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is specifically used to: if the encoding rate of the current frame satisfies a third preset condition, then the starting frequency area is the first starting frequency area; or, if the encoding rate of the current frame does not satisfy the third preset condition, then the starting frequency area is the second starting frequency area, and the frequency ranges corresponding to the first starting frequency area and the second starting frequency area are different.

[0044] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is also used to: before adjusting the spectrum of the high-band signal after the band extension processing according to the information of the pitch component of the high-band signal to obtain the adjusted spectrum of the high-band signal, determine a first frequency area range according to the coding rate of the current frame, the first frequency area range being the range of the frequency area where it is necessary to determine whether to adjust the spectrum of the high-band signal after the band extension processing; adjusting the spectrum of the high-band signal after the band extension processing according to the information of the pitch component of the high-band signal to obtain the adjusted spectrum of the high-band signal, including: within the first frequency area range, adjusting the spectrum of the high-band signal after the band extension processing according to the information of the pitch component of the high-band signal to obtain the adjusted spectrum of the high-band signal.

[0045] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is specifically used to: if the encoding rate of the current frame satisfies a third preset condition, then the first frequency area range is the first range; or, if the encoding rate of the current frame does not satisfy the third preset condition, then the first frequency area range is the second range, and the frequency range corresponding to the first range is not completely the same as the second range.

[0046] In conjunction with the second aspect, in some implementations of the second aspect, the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes a current frequency region; and the processing unit is further configured to:

[0047] Before adjusting the spectrum of the high-band signal after the band extension processing according to the information of the tone component of the high-band signal to obtain the spectrum of the adjusted high-band signal, determine whether the current frequency region belongs to the first frequency region range according to the spectrum of the high-band signal after the band extension processing of the current frequency region, and the first frequency region range is the range of the frequency region where it is necessary to determine whether to adjust the spectrum of the high-band signal after the band extension processing; if the current frequency region belongs to the first frequency region range, the processing unit is also used to: adjust the spectrum of the high-band signal in the current frequency region according to the information of the tone component of the high-band signal to obtain the spectrum of the adjusted high-band signal in the current frequency region.

[0048] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is specifically used to: if in the high-frequency band signal spectrum after band expansion processing of the current frequency region, the number of frequency points whose absolute values ​​of spectrum values ​​are greater than the second threshold is less than the third threshold, then the current frequency region belongs to the first frequency region range.

[0049] In a third aspect, a communication device is provided, comprising a processor, wherein the processor is connected to a memory, the memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory, so that the device executes the method in the above-mentioned first aspect or any possible implementation of the first aspect.

[0050] According to a fourth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed, the method according to the first aspect or any possible implementation manner of the first aspect is implemented.

[0051] In a fifth aspect, a chip is provided, characterized in that it includes a processor and an interface; the processor is used to read instructions to execute the method in the above-mentioned first aspect or any possible implementation of the first aspect.

[0052] Optionally, the chip may further include a memory, in which instructions are stored, and the processor is used to execute the instructions stored in the memory or instructions derived from other sources.

[0053] In a sixth aspect, a computer-readable storage medium is provided, characterized in that the computer-readable storage medium stores a coded bit stream obtained according to the method in the first aspect or any possible implementation of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] Figure 1 It is a schematic diagram of an application scenario of an embodiment of the present application;

[0055] Figure 2 It is a schematic diagram of an application scenario of an embodiment of the present application;

[0056] Figure 3 It is a schematic diagram of an application scenario of an embodiment of the present application;

[0057] Figure 4 It is a schematic diagram of an application scenario of an embodiment of the present application;

[0058] Figure 5 It is a schematic diagram of an application scenario of an embodiment of the present application;

[0059] Figure 6 It is a schematic diagram of an application scenario of an embodiment of the present application;

[0060] Figure 7 It is a schematic diagram of an application scenario of an embodiment of the present application;

[0061] Figure 8 is a schematic flow chart of an audio processing method according to an embodiment of the present application;

[0062] Fig. 9 is a schematic flowchart of a method for obtaining a second coding parameter of a current frequency region according to an embodiment of the present application;

[0063] Fig.10 is a schematic flow chart of an audio processing method according to an embodiment of the present application;

[0064] Fig.11 A schematic block diagram of a coding and decoding device according to an embodiment of the present application is shown;

[0065] Fig.12 A schematic diagram of the structure of a terminal device provided for this application;

[0066] Fig.13 A schematic diagram of the structure of an access network device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0067] The technical solution in this application will be described below in conjunction with the accompanying drawings.

[0068] The embodiments of the present application can be applied to stereo codecs in communication modules of terminal devices, wireless access network devices, and core network devices.

[0069] An application scenario of an embodiment of the present application is introduced below. Figure 1 A schematic diagram of an application scenario 100 of an embodiment of the present application is shown. Figure 1 The system architecture diagram of the embodiment of the present application applied on the terminal device side is shown. Figure 1 As shown, Figure 1The system includes a first terminal device 110, a second terminal device 120, a wireless or wired network communication device 130 and a wireless or wired network communication device 140. The first terminal device 110 and the second terminal device 120 can be a transmitting device or a receiving device. First, the first terminal device 110 is used as a transmitting device and the second terminal device 120 is used as a receiving device. In audio communication, the audio acquisition module in the first terminal device 110 is used to collect audio, the stereo encoder performs stereo encoding on the collected stereo signal, and the channel encoding module performs channel encoding to obtain a code stream, and then the signal is transmitted in a digital channel through the wireless or wired network communication device 130 on the transmitting side. The wireless or wired network communication device 140 on the receiving end side obtains the signal sent by the first terminal device 110 through a digital channel, and transmits the signal to the second terminal device 120. The second terminal device 120 performs channel decoding in the channel decoding module according to the received signal, and then decodes the stereo signal through the stereo decoder, and then performs audio playback in the audio playback module according to the decoded stereo signal. It should be understood that when the second terminal device 120 is a transmitting device and the first terminal device 110 is a receiving device, the first terminal device 110 can be referred to as a transmitting device and the second terminal device 120 can be understood as a receiving device, and no further details will be given here.

[0070] It should be understood that the wireless or wired network communication device 130 and the wireless or wired network communication device 140 may also be core network devices.

[0071] Figure 2 A schematic diagram of another application scenario 200 of an embodiment of the present application is shown. Figure 2 The system architecture diagram of the embodiment of the present application in the wireless access network device or core network device transcoding application is shown. Figure 2 As shown, Figure 2 The wireless access network equipment or core network equipment in the system includes a channel decoding module, other audio decoders, a stereo encoder and a channel coding module. Among them, corresponding stereo coding and decoding processing is required during transcoding. The wireless access network equipment or core network equipment performs channel decoding on the received signal in the channel decoding module, and then decodes the audio code stream through other audio decoders to obtain the audio code stream. The stereo encoder re-encodes the audio code stream, and then performs channel coding to transmit the audio signal.

[0072] Figure 3 A schematic diagram of another application scenario 300 of an embodiment of the present application is shown. Figure 3 The system architecture diagram of the embodiment of the present application in the wireless access network device or core network device transcoding application is shown. Figure 3 As shown, Figure 3 The wireless access network equipment or core network equipment in the system includes a channel decoding module, a stereo decoder, other audio encoders and a channel coding module. Among them, corresponding stereo coding and decoding processing is required during transcoding. The wireless access network equipment or core network equipment performs channel decoding on the received signal in the channel decoding module, and then decodes the audio code stream through the stereo decoder to obtain the audio code stream. Other audio encoders re-encode the audio code stream, and then perform channel coding to transmit the audio signal.

[0073] Stereo encoding and decoding processing can be part of a multi-channel codec. For example, multi-channel encoding of a collected multi-channel signal can be to obtain a stereo signal after down-mixing the collected multi-channel signal, and encode the obtained stereo signal; the decoding end decodes the code stream according to the stereo signal to obtain a stereo signal, and restores the multi-channel signal after up-mixing the stereo signal. Therefore, the embodiment of the present application can also be applied to the multi-channel codec in the communication module of the terminal device, the wireless access network device, and the core network device.

[0074] Figure 4 A schematic diagram of an application scenario 400 of an embodiment of the present application is shown. Figure 4 The system architecture diagram of the embodiment of the present application applied on the terminal device side is shown. Figure 4 As shown, Figure 4The system includes a first terminal device 410, a second terminal device 420, a wireless or wired network communication device 430 and a wireless or wired network communication device 440. The first terminal device 410 and the second terminal device 420 can be a transmitting device or a receiving device. First, the first terminal device 410 is used as a transmitting device and the second terminal device 420 is used as a receiving device. In audio communication, the audio acquisition module in the first terminal device 410 is used to collect audio, the multi-channel encoder performs multi-channel encoding on the collected multi-channel signal, the channel encoding module performs channel encoding, obtains a code stream, and then transmits the signal in a digital channel through the wireless or wired network communication device 430 on the transmitting side. The wireless or wired network communication device 440 on the receiving end side obtains the signal sent by the first terminal device 410 through a digital channel, and transmits the signal to the second terminal device 420. The second terminal device 420 performs channel decoding in the channel decoding module according to the received signal, and then decodes the multi-channel signal through the multi-channel decoder, and then performs audio playback in the audio playback module according to the decoded multi-channel signal. It should be understood that when the second terminal device 420 is a transmitting end device and the first terminal device 410 is a receiving end device, the first terminal device 410 can be referred to as a transmitting end device and the second terminal device 420 can be understood as a receiving end device, and no further details will be given here.

[0075] It should be understood that the wireless or wired network communication device 430 and the wireless or wired network communication device 440 may also be core network devices.

[0076] Figure 5 A schematic diagram of another application scenario 500 of an embodiment of the present application is shown. Figure 5 The system architecture diagram of the embodiment of the present application in the wireless access network device or core network device transcoding application is shown. Figure 5 As shown, Figure 5 The wireless access network equipment or core network equipment in the system includes a channel decoding module, other audio decoders, a multi-channel encoder and a channel coding module. Among them, corresponding multi-channel coding and decoding processing is required during transcoding. The wireless access network equipment or core network equipment performs channel decoding on the received signal in the channel decoding module, and then decodes the audio code stream through other audio decoders to obtain the audio code stream. The multi-channel encoder re-encodes the audio code stream, and then performs channel coding to transmit the audio signal.

[0077] Figure 6 A schematic diagram of another application scenario 600 of an embodiment of the present application is shown. Figure 6 The system architecture diagram of the embodiment of the present application in the wireless access network device or core network device transcoding application is shown. Figure 6 As shown, Figure 6 The wireless access network equipment or core network equipment in the system includes a channel decoding module, a multi-channel decoder, other audio encoders and a channel coding module. Among them, corresponding multi-channel coding and decoding processing is required during transcoding. The wireless access network equipment or core network equipment performs channel decoding on the received signal in the channel decoding module, and then decodes the audio code stream through the multi-channel decoder to obtain the audio code stream. Other audio encoders re-encode the audio code stream, and then perform channel coding to transmit the audio signal.

[0078] The embodiments of the present application can also be applied to the audio encoding module (Audio Encoding) and audio decoding module (Audio Decoding) in the virtual reality (VR) streaming service. Figure 7 As shown in the dotted box, Figure 7 A schematic diagram of another application scenario 700 of an embodiment of the present application is shown. The end-to-end processing flow of the audio signal is as follows: the sending end processes the audio signal and the video signal through the acquisition module (Acquisition) and divides them into audio signal and video signal. The audio signal is preprocessed (Audio Preprocessing), which includes filtering out the low-frequency part of the audio signal, usually with 20Hz or 50Hz as the demarcation point, extracting the direction information in the signal, and then performing audio encoding (Audio encoding); the video signal is visually stitched, projected and mapped, and then video encoding and image encoding are performed. The audio bitstream, video bitstream and image bitstream are packaged (File / Segment encapsulation) and sent (Delivery) to the decoding end. The decoding end first unpacks (File / Segment decapsulation), and then performs audio decoding (Audio decoding), video decoding and image decoding respectively. The decoded audio signal is subjected to audio binaural rendering (Audio rendering) processing. The rendered signal is mapped to the listener's headphones (headphones), which can be independent headphones or HTC The headphones on eyewear devices such as VIVE perform binaural video rendering on the decoded video signals and image signals, and the rendered signals are mapped to a display.

[0079] The terminal device in the embodiments of the present application may also be referred to as: user equipment (UE), mobile station (MS), mobile terminal (MT), access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication equipment, user agent or user device, etc.

[0080] The terminal device can be a wireless terminal or a wired terminal. The wireless terminal can be a device that provides voice and / or other business data connectivity to the user, a handheld device with wireless connection function, or other processing equipment connected to a wireless modem. The wireless terminal can communicate with one or more core networks via the Radio Access Network (RAN). The wireless terminal can be a mobile terminal, such as a mobile phone (or "cellular" phone) and a computer with a mobile terminal, for example, a portable, pocket-sized, handheld, computer-built-in or vehicle-mounted mobile device, which exchanges language and / or data with the wireless access network. For example, Personal Communication Service (PCS) phones, cordless phones, Session Initiation Protocol (SIP) phones, Wireless Local Loop (WLL) stations, Personal Digital Assistants (PDA) and other devices.A wireless terminal may also be referred to as a system, a subscriber unit, a subscriber station, a mobile station, a mobile station, a remote station, a remote terminal, an access terminal, a user terminal, a user agent, a user device or user equipment, a mobile internet device (MID), a wearable device, a virtual reality (VR) device, an augmented reality (AR) device, a wireless terminal in industrial control, a wireless terminal in self driving, a wireless terminal in remote medical surgery, a wireless terminal in smart grid, a wireless terminal in transportation safety, a wireless terminal in smart city, a wireless terminal in smart home, a vehicle-mounted device, a wearable device, a terminal device in a 5G network, or a public land mobile communication network (publicland mobile communication network) to be evolved in the future. The embodiments of the present application do not limit this.

[0081] As an example and not a limitation, in the embodiments of the present application, wearable devices may also be referred to as wearable smart devices, which are a general term for wearable devices that are intelligently designed and developed by applying wearable technology to daily wear, such as glasses, gloves, watches, clothing, and shoes. A wearable device is a portable device that is worn directly on the body or integrated into the user's clothes or accessories. Wearable devices are not only hardware devices, but also achieve powerful functions through software support, data interaction, and cloud interaction. Broadly speaking, wearable smart devices include full-featured, large-sized, and independent of smartphones to achieve complete or partial functions, such as smart watches or smart glasses, as well as devices that only focus on a certain type of application function and need to be used in conjunction with other devices such as smartphones, such as various types of smart bracelets and smart jewelry for vital sign monitoring.

[0082] In addition, in the embodiments of the present application, the terminal device may also be a terminal device in an Internet of Things (IoT) system. IoT is an important part of the future development of information technology. Its main technical feature is to connect objects to the network through communication technology, thereby realizing an intelligent network that interconnects people and machines and things.

[0083] The various terminal devices introduced above, if located on a vehicle (eg, placed in or installed in a vehicle), can be considered as vehicle-mounted terminal devices, which are also called on-board units (OBU).

[0084] In the embodiment of the present application, the terminal device may also include a relay. Alternatively, it can be understood that anything that can communicate data with the base station can be regarded as a terminal device.

[0085] The access network device in the embodiment of the present application may be a device for communicating with a terminal device, may be a base station, or an access point, or a network device, or may refer to a device in an access network that communicates with a wireless terminal through one or more sectors on an air interface. The network device may be used to convert received air frames to and from IP packets, and serve as a router between the wireless terminal and the rest of the access network, wherein the rest of the access network may include an Internet Protocol (IP) network. The network device may also coordinate the attribute management of the air interface. For example, the access network device can be a base station (Base Transceiver Station, BTS) in Global System of Mobile communication (GSM) or Code Division Multiple Access (CDMA), or a base station (NodeB, NB) in Wideband Code Division Multiple Access (WCDMA), or an evolved base station (evolved NodeB, eNB or eNodeB) in an LTE system, or a wireless controller in a cloud radio access network (CRAN) scenario, or the access device can be a relay station, an access point, a vehicle-mounted device, a wearable device, and an access device in a 5G network or a network device in a future evolved PLMN network, etc. It can be an access point (AP) in a WLAN, or it can be a gNB in ​​a new wireless system (new radio, NR) system. The embodiments of the present application are not limited. It should be noted that for the 5G system, under one base station, there may be one or more transmission reception points (Transmission Reception Point, TRP), and all TRPs belong to the same cell, wherein each TRP and terminal can use the measurement reporting method described in the embodiment of the present application. In another scenario, the network device can also be divided into a control unit (Control Unit, CU) and a data unit (Data Unit, DU). Under one CU, there may be multiple DUs, wherein each DU and terminal can use the measurement reporting method described in the embodiment of the present application. The difference between the CU-DU separation scenario and the multi-TRP scenario is that the TRP is just a radio frequency unit or an antenna device, and the protocol stack function can be implemented in the DU, for example, the physical layer function can be implemented in the DU.

[0086] In addition, in the embodiment of the present application, the access network device is a device in the access network (radio access network, RAN), or in other words, a RAN node that connects the terminal device to the wireless network. For example, as an example but not a limitation, the access network device can be listed as: gNB, transmission reception point (TRP), evolved Node B (eNB), radio network controller (RNC), Node B (NB), base station controller (BSC), base transceiver station (BTS), home base station (e.g., home evolved NodeB, or home Node B, HNB), base band unit (BBU), or wireless fidelity (Wifi) access point (AP), etc.

[0087] The access network device provides services for the cell, and the terminal device communicates with the access network device through the transmission resources used by the cell (for example, frequency domain resources, or spectrum resources). The cell may be a cell corresponding to the access network device (for example, a base station). The cell may belong to a macro base station or a base station corresponding to a small cell. The small cells here may include: metro cells, micro cells, pico cells, femto cells, etc. These small cells have the characteristics of small coverage and low transmission power, and are suitable for providing high-speed data transmission services.

[0088] The core network equipment can be a core network element, such as an Access and Mobility Management Function (AMF) entity, a Session Management Function (SMF) entity, a User Plane Function (UPF) entity, a Policy Control Function (PCF) entity, etc. The AMF entity provides mobility management functions in the core network, and is mainly responsible for access and mobility control, including registration management (RM) and connection management (CM), access authentication and access authorization, reachability management and mobility management, etc. The SMF entity is the session management function in the core network. In addition to performing mobility management on the terminal device, the AMF entity is also responsible for forwarding session management related messages between the terminal device and the SMF entity. The PCF entity is the policy management function in the core network, and is responsible for formulating policies related to mobility management, session management, billing, etc. for the terminal device. The UPF entity is the user plane function in the core network. It transmits data with the external data network through the interface and with the access network equipment through the interface. It mainly provides user plane support, including the connection point between PDU session and data network, packet routing and forwarding, packet detection and user plane policy execution, QoS processing for the user plane, downlink packet caching and triggering of downlink data notification, etc.

[0089] It should be understood that the functional units of the above-mentioned core network can work independently or be combined together to implement certain control functions. For example, AMF, SMF and PCF can be combined together as a management device to complete access control and mobility management functions such as access authentication, security encryption, and location registration of terminal devices, as well as session management functions such as recording, releasing and changing user-plane transmission paths, as well as analyzing some slice-related data (such as congestion) and terminal-related data. UPF, as a gateway device, mainly completes functions such as routing and forwarding of user-plane data, such as: responsible for data packet filtering, data transmission / forwarding, rate control, and generation of billing information for terminal devices.

[0090] The technical solutions of the embodiments of the present application can be applied to various communication systems, such as: global system for mobile communications (GSM) system, code division multiple access (CDMA) system, wideband code division multiple access (WCDMA) system, general packet radio service (GPRS), long term evolution (LTE) system, LTE frequency division duplex (FDD) system, LTE time division duplex (TDD), universal mobile telecommunication system (UMTS), worldwide interoperability for microwave access (WiMAX) communication system, fifth generation (5G) system or new radio (NR), in addition, it can also be applicable to the use of subsequent evolution systems, such as sixth generation 6G communication system, or even more advanced seventh generation 7G communication system.

[0091] With the progress of society and the continuous development of technology, users have higher and higher demands for audio services. Three-dimensional audio has become a new trend in the development of audio services because it can bring users a better immersive experience. To realize three-dimensional audio services, the original audio signal formats that need to be compressed and encoded can be divided into: channel-based audio signal formats, object-based audio signal formats, scene-based audio signal formats, and mixed signal formats of any three audio signal formats. Regardless of the format, the audio signal that the three-dimensional audio codec needs to compress and encode contains multiple signals. Generally, the three-dimensional audio codec uses the correlation between channels to downmix the multi-channel signals to obtain downmix signals and multi-channel encoding parameters. Generally speaking, the number of channels of the downmix signal is much smaller than the number of channels of the input signal. For example, a multi-channel signal is downmixed into a stereo signal, and then the downmix signal is encoded using the core encoder. It is also possible to further downmix the stereo signal into a mono signal and stereo encoding parameters. The number of bits used to encode the downmix signal and the multi-channel encoding parameters is much smaller than that of independently encoding the multi-channel input signal. In addition, in the core encoder, in order to reduce the encoding bit rate, the correlation between signals in different frequency bands is often further used for encoding.

[0092] The basic principle of encoding by using the correlation between signals in different frequency bands is to use low-frequency band signals to generate high-frequency band signals through methods such as spectrum replication or frequency band extension. Whether it is the latest 3GPP Enhanced Voice Services (EVS) audio codec, or the Moving Picture Experts Group High-Efficiency Advanced Audio Coding (MPEG HE-AAC), Unified Speech and Audio Coding (USAC) audio codec, they all use the correlation between signals in different frequency bands and use frequency band extension technology or spectrum replication technology to encode high-frequency band signals, so as to encode high-frequency band signals with fewer bits, thereby reducing the encoding bit rate of the encoder. However, in real audio signals, there are often some tonal components in the spectrum of the high-frequency band that are not similar to the spectrum of the low-frequency band.

[0093] Due to the limitation of coding bit number, when encoding the pitch component information in the high-frequency band signal, how to determine the pitch component to be encoded and efficiently use the limited coding bit number to obtain better coding effect becomes one of the key technologies affecting the coding quality.

[0094] At present, in the existing technology, the common practice is to perform peak search based on the power spectrum of the high-frequency band signal to obtain peak quantity information, peak position information, and peak energy or amplitude information; sort the searched peaks according to the energy or amplitude of the peaks, and select several peaks with large energy in turn as the tone components that need to be encoded.

[0095] When the high frequency band of the audio signal has been subjected to the first encoding including the frequency band extension encoding in the audio encoder, when the high frequency band signal is subjected to the second encoding, the prior art method of detecting and encoding the tone components does not take into account that a part of the tone components can be retained in the first encoding method and encoded in the third encoding, and this part of the tone components may be repeatedly encoded in the second encoding method, resulting in a waste of the number of encoding bits. Similarly, in the third encoding, the tone components that can be encoded in the second encoding method are not taken into account, and in the process of encoding the frequency band signal spectrum after the frequency band extension processing in the third encoding, the tone components that have been encoded in the second encoding may be repeatedly encoded, resulting in a waste of the number of encoding bits.

[0096] Therefore, the present application proposes an audio encoding method, which adjusts the spectrum of the high-band signal after band expansion processing according to the information of the pitch component of the high-band signal to obtain the adjusted spectrum of the high-band signal, and then performs a third encoding on the adjusted spectrum of the high-band signal to avoid coding redundancy of the pitch component of the high-band signal caused by directly performing a third encoding on the spectrum after the band expansion processing.

[0097] Combine the following Figure 8 A method for audio processing provided by the present application is described in detail. Figure 8 is a schematic flow chart of an audio processing method 800 of an embodiment of the present application. The method 800 can be applied in Figures 1 to 7 The scenario shown can of course also be applied to other communication scenarios, and the embodiments of the present application are not limited here.

[0098] It should also be understood that in the embodiments of the present application, the execution subject of the method may be a terminal device, an access network device, and a core network device. As an example but not a limitation, the execution subject of the method may also be a chip, a chip system, or a processor applied to a terminal device, an access network device, and a core network device. Among them, the terminal device, the access network device, and the core network device have codec functions and may also be referred to as codec devices.

[0099] like Figure 8 As shown, Figure 8 The method 800 shown in FIG. 8 may include S810 to S860. Figure 8 Each step in method 800 is described in detail.

[0100] S810: Acquire a current frame of an audio signal, where the current frame of the audio signal includes a high-frequency band signal and a low-frequency band signal.

[0101] It should be understood that the current frame of the audio signal can be any frame in the audio signal, and the current frame of the audio signal can include a high-frequency band signal and a low-frequency band signal, wherein the division of the high-frequency band signal and the low-frequency band signal can be determined by a frequency band threshold, a signal greater than or equal to the frequency band threshold is a high-frequency band signal, and a signal less than the frequency band threshold is a low-frequency band signal. The frequency band threshold can be an empirical value, or it can be determined based on the transmission bandwidth, the data processing capability of the encoding component and the decoding component, which is not limited here.

[0102] High-band signals and low-band signals are relative. For example, a signal below a certain frequency band threshold is a low-band signal, but a signal above the frequency band threshold is a high-band signal (the signal corresponding to the frequency can be classified as either a low-band signal or a high-band signal). The frequency band threshold varies depending on the bandwidth of the current frame. For example, when the current frame is a 0-8kHz wideband signal, the frequency band threshold can be 4kHz; when the current frame is a 0-16kHz ultra-wideband signal, the frequency band threshold can be 8kHz.

[0103] S820: Perform a first encoding according to the high-frequency band signal and the low-frequency band signal to obtain a first encoding parameter of a current frame of the audio signal, where the first encoding includes frequency band extension encoding.

[0104] In the first encoding process, it is necessary to process the high-band signal and the low-band signal of the current frame of the audio signal, extract multiple parameters, and encode the extracted parameters. At the same time, in the first encoding process, it is necessary to perform band extension encoding to determine which signals in the high-band signal can be encoded according to the low-band signal by adopting band extension technology or spectrum replication technology. In the process of band extension encoding, the signal spectrum before band extension processing, the signal spectrum after band extension processing, and the frequency range of the band extension processing can be obtained simultaneously. The signal spectrum after band extension processing includes spectrum components in the signal spectrum before band extension processing that cannot be reconstructed by band extension processing, or includes spectrum components with larger amplitude in the signal spectrum before band extension processing. For example, the frequency range of the current frame of the audio signal is 0-8kHz, wherein 0-4kHz is a low-frequency band signal and 4kHz-8kHz is a high-frequency band signal. According to the correlation between the signals, 4kHz-8kHz is band-extended encoded, but the amplitude of the 5kHz-6kHz signal spectrum is large and cannot be reconstructed using the band-extended processing, so band-extended encoding cannot be performed and needs to be performed in the subsequent third encoding process. The remaining 4kHz-5kHz and 6kHz-8kHz can be band-extended encoded.

[0105] The frequency range of the frequency band extension processing may be a frequency point range of the frequency band extension processing, such as a start frequency point and a cutoff frequency point of the intelligent gap filling (IGF) processing. The frequency range of the frequency band extension processing may also be characterized in other forms, such as a start frequency value and a cutoff frequency value.

[0106] During the encoding process, the high frequency band may be divided into K frequency regions (eg, tiles), and each frequency region may be divided into M bands (eg, scale factor bands (SFB)). The determination of the frequency band extension information may be performed in units of frequency regions or in units of bands.

[0107] The first coding parameter may include frequency band extension information. For example, frequency band extension coding may include IGF processing, and the frequency band extension information includes frequency band envelope information, spectrum whitening information, and the like.

[0108] The first encoding parameter may specifically include: a time domain noise shaping parameter, a frequency domain noise shaping parameter, and the like.

[0109] S830: Perform second encoding according to the high-frequency band signal to obtain a second encoding parameter of the current frame, where the second encoding parameter is used to represent information about a tone component of the high-frequency band signal.

[0110] In the second encoding process, the tone component information parameters of the high frequency band signal may be extracted, and then the tone component information parameters may be encoded to obtain the second encoding parameters of the current frame.

[0111] Optionally, the information of the tone component includes at least one or more of the following parameters: mark information of the tone component, position information of the tone component, quantity information of the tone component, amplitude information of the tone component, or energy information of the tone component. The second encoding may include tone component encoding. The second encoding parameters of the current frame may include position and quantity parameters of the tone component, and amplitude parameters or energy parameters of the tone component.

[0112] The high frequency band parameters of the current frame may also include position parameters, quantity parameters, and amplitude parameters or energy parameters of the tone components. The high frequency band parameters of the current frame may be understood as the second encoding parameters of the current frame.

[0113] Typically, the process of obtaining the second coding parameter of the current frame according to the high-frequency band signal is performed according to the frequency region division and / or sub-band division of the high-frequency band. For example, the high-frequency band corresponding to the high-frequency band signal includes at least one frequency region, and one frequency region includes at least one sub-band.

[0114] The number of frequency regions for which high-frequency band parameters need to be obtained can be pre-set, such as the high-frequency band corresponding to the high-frequency band signal includes 5 frequency regions, and it is pre-set that the high-frequency band parameters need to be obtained in 3 frequency regions. The 3 frequency regions for which the high-frequency band parameters need to be obtained can be 3 frequency regions specified among the 5 frequency regions, or can be any 3 frequency regions among the 5 frequency regions; the number of frequency regions for which the high-frequency band parameters need to be obtained can also be calculated according to a specific algorithm, which is not limited in the embodiments of the present application. The following is a further description taking the determination of the position quantity parameters of the tone components and the amplitude parameters of the tone components in a frequency region as an example. For example, the high-frequency band corresponding to the high-frequency band signal includes 5 frequency regions. The following describes the determination of the position quantity parameters of the tone components and the amplitude parameters of the tone components in frequency region 1.

[0115] Fig. 9 A schematic flow chart of a method 900 for obtaining a second coding parameter of a current frequency region is shown. The method 900 can be applied in Figures 1 to 7 The scenario shown can of course also be applied to other communication scenarios, and the embodiments of the present application are not limited here.

[0116] It should also be understood that in the embodiments of the present application, the execution subject of the method may be a terminal device, an access network device, and a core network device. As an example but not a limitation, the execution subject of the method may also be a chip, a chip system, or a processor applied to a terminal device, an access network device, and a core network device. Among them, the terminal device, the access network device, and the core network device have codec functions and may also be referred to as codec devices.

[0117] like Fig. 9 As shown, Fig. 9 The method 900 shown in FIG. 1 may include S910 to S940. Fig. 9 Each step in method 900 is described in detail.

[0118] S910, performing a peak search based on the high frequency band signal of the current frequency region to obtain the peak information of the current frequency region, wherein the peak information of the current frequency region includes: peak quantity information of the current frequency region, peak position information of the current frequency region, peak energy information of the current frequency region or peak amplitude information of the current frequency region.

[0119] Specifically, the power spectrum of the high-frequency band signal in the current frequency region can be obtained based on the high-frequency band signal in the current frequency region; the peak of the power spectrum can be searched based on the power spectrum of the high-frequency band signal in the current frequency region, and the number of peaks in the power spectrum can be used as the peak number information of the current region, the frequency point number corresponding to the peak in the power spectrum can be used as the peak position information of the current region, and the amplitude or energy of the peak in the power spectrum can be used as the peak amplitude information or energy information of the current region.

[0120] It is also possible to obtain the power spectrum ratio of the current frequency point in the current frequency area based on the high-frequency band signal of the current frequency area, where the power spectrum ratio of the current frequency point is the ratio of the value of the power spectrum of the current frequency point to the average value of the power spectrum of the current frequency area; perform a peak search in the current frequency area based on the power spectrum ratio of the current frequency point to obtain the number information of the peaks in the current frequency area, the position information of the peaks, the amplitude information of the peaks, or the energy information of the peaks. Among them, the amplitude information of the peaks or the energy information of the peaks includes: the power spectrum ratio of the peaks, where the power spectrum ratio of the peaks is the ratio of the value of the power spectrum of the frequency point corresponding to the peak to the average value of the power spectrum of the current frequency area. Of course, other technologies can also be used to perform peak search to obtain the peak number information, peak position information, and peak amplitude information or energy information of the current area, which is not limited in the embodiments of the present application.

[0121] In one embodiment of the present application, the peak position information and peak energy information of the current frequency region may be stored in the peak_idx and peak_val arrays, respectively, and the peak quantity information of the current frequency region may be recorded as peak_cnt.

[0122] S920: Perform peak screening on the peak information of the current frequency region to obtain information on candidate tone components of the current frequency region.

[0123] After the peak information of the current frequency region is acquired, peak screening is performed on the peak information of the current frequency region to obtain information of candidate tone components of the current frequency region.

[0124] The specific method of peak filtering can be to obtain the peak number information, peak position information, peak amplitude information or peak energy information after filtering the current frequency region based on the spectrum retention flag information of the frequency band expansion of the current frequency region and the peak number information, peak position information and peak amplitude information or peak energy information of the current frequency region.

[0125] The peak quantity information, peak position information, and peak amplitude information or peak energy information after the current frequency region is filtered are used as the information of the candidate tone components of the current frequency region. Among them, the peak amplitude information or the peak energy information may include the energy ratio of the peaks, or the power spectrum ratio of the peaks. The quantity information of the candidate tone components may be the peak quantity information after the peak filtering, the position information of the candidate tone components may be the peak position information after the peak filtering, the amplitude information of the candidate tone components may be the peak amplitude information after the peak filtering, and the energy information of the candidate tone components may be the peak energy information after the peak filtering.

[0126] S930: Perform tone component screening on the information of candidate tone components in the current frequency region to obtain information of target tone components in the current frequency region.

[0127] For example, the candidate tone components with the same subband number in the current frequency region may be merged to obtain information of the merged candidate tone components in the current frequency region; and the information of the target tone components in the current frequency region may be obtained based on the information of the merged candidate tone components in the current frequency region.

[0128] For another example, information about target tone components in the current frequency region is obtained based on information about candidate tone components in the current frequency region and information about the maximum number of tone components that can be encoded in the current frequency region.

[0129] For another example, the subband sequence number corresponding to the candidate tone component in the current frequency region of the current frame is obtained according to the position information of the candidate tone component in the current frequency region of the current frame; the subband sequence number corresponding to the candidate tone component in the current frequency region of the previous frame of the current frame is obtained; if the position information of the nth candidate tone component in the current frequency region of the current frame and the position information of the nth candidate tone component in the current frequency region of the previous frame meet the preset conditions, and the subband sequence number corresponding to the nth candidate tone component in the current frequency region of the current frame and the subband sequence number corresponding to the nth candidate tone component in the current frequency region of the previous frame are different, then the position information of the nth candidate tone component in the current frequency region of the current frame is corrected to obtain the information of the target tone component in the current frequency region, and the nth candidate tone component is any one of the candidate tone components in the current frequency region.

[0130] It can also be any combination of the above-mentioned multiple exemplary methods, which is not limited in the embodiments of the present application.

[0131] S940: Obtain a second encoding parameter of the current frequency region according to information of the target tone component of the current frequency region.

[0132] The above content specifically describes a method for obtaining the second encoding parameter of the current frequency region. The above method for obtaining the second encoding parameter of the current frequency region is only used as an example, and the embodiments of the present application are not limited to this.

[0133] S840, adjusting the spectrum of the high-band signal after the band extension processing according to the information of the tone component of the high-band signal to obtain an adjusted spectrum of the high-band signal, wherein the spectrum of the high-band signal after the band extension processing is obtained in the band extension encoding process.

[0134] The adjusting of the spectrum of the high-band signal after the band extension processing according to the information of the pitch component of the high-band signal may be performed according to one or more of the sign information, position information, quantity information, amplitude information or energy information of the pitch component to obtain an adjusted spectrum.

[0135] Typically, the frequency spectrum of the high-band signal after the frequency band expansion process is adjusted according to frequency regions and / or sub-band divisions. For example, the high-band corresponding to the high-band signal includes at least one frequency region, and one frequency region includes at least one sub-band.

[0136] Optionally, the frequency spectrum of the high-frequency band signal after the band extension process can be adjusted according to the quantity information of the tonal components of the high-frequency band signal. The high frequency band corresponding to the high-frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region. The frequency spectrum of the high-frequency band signal after the band extension process is adjusted according to the information of the tonal components of the high-frequency band signal to obtain the frequency spectrum of the adjusted high-frequency band signal, comprising: according to the quantity information of the tonal components of the current frequency region, the frequency spectrum of the high-frequency band signal after the band extension process in the current frequency region is adjusted to obtain the frequency spectrum of the adjusted high-frequency band signal in the current frequency region.

[0137] Therefore, the audio encoding method of the embodiment of the present application adjusts the spectrum of the high-band signal after the band extension processing according to the quantity information of the pitch components of the high-band signal, obtains the spectrum of the adjusted high-band signal in the current frequency region, and then performs a third encoding on the spectrum of the adjusted high-band signal, thereby avoiding the encoding redundancy of the pitch components of the high-band signal caused by directly performing a third encoding on the spectrum of the high-band signal after the band extension processing.

[0138] Optionally, adjusting the frequency spectrum of the high-band signal after the band expansion processing of the current frequency region according to the quantity information of the tonal components of the current frequency region to obtain the frequency spectrum of the adjusted high-band signal of the current frequency region includes: if the quantity information of the tonal components of the current frequency region satisfies a first preset condition, adjusting the frequency spectrum of the high-band signal after the band expansion processing of the current frequency region to obtain the frequency spectrum of the adjusted high-band signal of the current frequency region.

[0139] Optionally, the first preset condition is that the number of the tonal components in the current frequency region is greater than or equal to a first threshold value, such as when the first threshold value is 5, that is, when the number of the tonal components in the current frequency region is greater than or equal to 5, the high-frequency band signal spectrum after the band extension processing in the current frequency region is adjusted. It is understandable that the value of the first threshold value can also be other values, such as 4 or 6, etc., and the specific value can be set according to experience or needs.

[0140] Optionally, the first preset condition is that the number of tonal components in the current frequency region is in a first interval, and the first interval may be a number range. For example, when the first interval is [3, 5], that is, the number of tonal components in the current frequency region is greater than or equal to 3 and less than or equal to 5, the high-frequency band signal spectrum after the band expansion processing of the current frequency region is adjusted.

[0141] Optionally, the high frequency band signal spectrum after the band extension process of the current frequency region is adjusted, to obtain the spectrum of the adjusted high frequency band signal of the current frequency region, comprising: the adjusted spectrum value of the current frequency region is set to the second preset value. For example, when the quantity of the tone component of the p-th frequency region (tile) is greater than zero, the adjusted spectrum value of the p-th frequency region is set to zero. The adjusted spectrum value of the p-th frequency region is set to zero, thereby the spectrum component that IGF is retained is removed (i.e. the spectrum value is set to 0), so that no longer encoding is performed in the subsequent third encoded process, avoiding the coding redundancy of the tone component of the high frequency band signal that the spectrum after the band extension process is directly carried out to the third encoding.

[0142] Specifically, the frequency range of the current frame of the audio signal is 0-8kHz, wherein 0-4kHz is a low-frequency band signal, and 4kHz-8kHz is a high-frequency band signal. In the first coding process, according to the correlation between signals, the high-frequency band signal 4kHz-8kHz is subjected to band extension coding, but the amplitude is large in the 5kHz-6kHz signal spectrum, and the band extension process cannot be utilized for reconstruction, and the band extension coding cannot be performed, and it is necessary to perform coding in the subsequent third coding process, and the remaining 4kHz-5kHz and 6kHz-8kHz can perform band extension coding. In the second coding process, the tone component information in 5kHz-6kHz is detected, wherein the number of the tone components of 5kHz-6kHz is greater than zero, and the adjusted spectrum value of 5kHz-6kHz can be set to zero, so as not to perform coding in the subsequent third coding process, and avoid the second coding and the third coding to repeat the coding of the spectrum of 5kHz-6kHz, causing coding redundancy.

[0143] The pseudo code implementation of setting the adjusted spectrum value of the pth frequency region to zero is as follows:

[0144]

[0145] Among them, tone_cnt[p] is the number information of the tonal components of the p-th tile, tile[p] is the starting frequency of the p-th tile, tile[p+1] is the starting frequency of the p+1-th tile, tile[p+1]-1 is the cutoff frequency of the p-th tile, sb is the frequency number, and mdctSpectrumAfterIGF is the spectrum after band extension processing, that is, the spectrum after IGF processing.

[0146] Optionally, the adjusting the spectrum of the high-band signal after the band expansion processing of the current frequency region to obtain the spectrum of the adjusted high-band signal of the current frequency region includes: performing weighted processing on the spectrum of the high-band signal after the band expansion processing of the current frequency region to obtain the spectrum of the adjusted high-band signal of the current frequency region.

[0147] The weighted processing may be to weight the spectrum values ​​of all frequency points in the current frequency region with a preset weighting coefficient, or to weight the spectrum values ​​of all frequency points in the current frequency region with a calculated weighting coefficient. The method for calculating the weighting coefficient may be linear or nonlinear. The weighting coefficients corresponding to different frequency points may be the same or different. The embodiment of the present application does not limit the specific method for obtaining the weighting coefficient.

[0148] Optionally, the information of the tone component of the high-band signal also includes tone component flag information of the frequency region, and the frequency spectrum of the high-band signal after the band expansion processing can be adjusted according to the tone component flag information of the frequency region.

[0149] Optionally, the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region. The step of adjusting the spectrum of the high frequency band signal after the band extension processing according to the information of the tone component of the high frequency band signal to obtain the spectrum of the adjusted high frequency band signal comprises: adjusting the spectrum of the high frequency band signal after the band extension processing of the current frequency region according to the tone component flag information of the current frequency region to obtain the spectrum of the adjusted high frequency band signal of the current frequency region, wherein the tone component flag information is used to mark whether the current frequency region has a tone component.

[0150] Optionally, the tone component mark information is obtained by detecting the tone components in the current frequency region.

[0151] Optionally, if the value of the tone component mark information of the current frequency region is a first preset value, the spectrum of the high-frequency band signal after the band expansion processing of the current frequency region is adjusted to obtain the spectrum of the adjusted high-frequency band signal of the current frequency region, wherein the value of the tone component mark information of the current frequency region is the first preset value, indicating that the tone component exists in the current frequency region. For example, the value of the tone component mark information can be 0 or 1, wherein the value of the first preset value can also be 0 or 1, that is, in one embodiment, when the value of the tone component mark information of the current frequency region is 1, it indicates that the tone component exists in the current frequency region; or, in another embodiment, when the value of the tone component mark information of the current frequency region is 0, it indicates that the tone component exists in the current frequency region.

[0152] Optionally, the adjusting the spectrum of the high-band signal after the band expansion processing of the current frequency region to obtain the spectrum of the adjusted high-band signal of the current frequency region includes: setting the adjusted spectrum value of the current frequency region to a second preset value to obtain the spectrum of the adjusted high-band signal of the current frequency region; or, performing weighted processing on the spectrum of the high-band signal after the band expansion processing of the current frequency region to obtain the spectrum of the adjusted high-band signal of the current frequency region.

[0153] For example, if the value of the tone component mark information of the current frequency region is the second preset value 1, the high-frequency band signal spectrum after the band extension processing of the current frequency region is weighted. The weighted processing method can be to multiply the spectrum value after the band extension processing corresponding to each frequency point of the current frequency region by a preset weighting coefficient of 0.5 as the adjusted spectrum value of the current frequency region. It is understandable that the second preset value can also be set to other values.

[0154] Optionally, the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region; adjusting the spectrum of the high frequency band signal after the band expansion processing according to the information of the tone component of the high frequency band signal to obtain the adjusted spectrum of the high frequency band signal includes: adjusting the spectrum of the high frequency band signal after the band expansion processing of the current frequency region according to the position information of the tone component of the current frequency region to obtain the adjusted spectrum of the high frequency band signal of the current frequency region.

[0155] Therefore, the audio encoding method of the embodiment of the present application adjusts the spectrum of the high-band signal after the band extension processing according to the position information of the pitch component of the high-band signal, obtains the spectrum of the adjusted high-band signal in the current frequency region, and then performs a third encoding on the spectrum of the adjusted high-band signal, thereby avoiding the encoding redundancy of the pitch component of the high-band signal caused by directly performing a third encoding on the spectrum of the high-band signal after the band extension processing.

[0156] Optionally, the current frequency region includes at least one sub-band, the at least one sub-band includes the current sub-band, and according to the position information of the tone component of the current frequency region, the spectrum of the high-frequency band signal after the band expansion processing of the current frequency region is adjusted to obtain the spectrum of the adjusted high-frequency band signal of the current frequency region, including: if the position information of the tone component of the current frequency region meets the second preset condition, the spectrum of the high-frequency band signal after the band expansion processing of the current sub-band is adjusted to obtain the spectrum of the adjusted high-frequency band signal of the current sub-band.

[0157] At this time, the spectrum of the high-frequency band signal after the band expansion processing is adjusted according to the position information of the tone component of the high-frequency band signal, so that only the current sub-band corresponding to the tone component can be adjusted, avoiding adjustments to other sub-bands of the high-frequency band, reducing the impact on other sub-bands of the high-frequency band, and realizing fine-grained adjustment, saving the computing resources of the encoding and decoding equipment.

[0158] Optionally, the position information of the tone component in the current frequency region includes the sequence number of the subband including the tone component in the current frequency region, and the second preset condition is that the subband sequence number of the subband including the tone component includes the sequence number of the current subband.

[0159] Optionally, adjusting the high-frequency band signal spectrum after the frequency band expansion processing of the current sub-band to obtain the adjusted high-frequency band signal spectrum of the current sub-band includes: setting the adjusted spectrum value of the current sub-band to a second preset value to obtain the adjusted high-frequency band signal spectrum of the current sub-band; or performing weighted processing on the high-frequency band signal spectrum after the frequency band expansion processing of the current sub-band to obtain the adjusted high-frequency band signal spectrum of the current sub-band.

[0160] Specifically, the position information of the tone component of the current frequency region is the frequency point serial number corresponding to the tone component of the current frequency region. First, the subband serial number of the tone component of the current frequency region is determined according to the frequency point serial number corresponding to the tone component of the current frequency region and the subband division method of the current frequency region. If the subband serial number of the tone component includes the serial number of the current subband, the adjusted spectrum value of the current subband is set to zero. That is, the spectrum value of the subband corresponding to the tone component of the current frequency region after the band extension processing is adjusted to zero. For example, in the second encoding process, the frequency region of 5000Hz-6000Hz is divided into 5 sub-bands, among which 5000Hz-5200Hz is sub-band 1, 5200Hz-5400Hz is sub-band 2, 5400Hz-5600Hz is sub-band 3, 5600Hz-5800Hz is sub-band 4, and 5800Hz-6000Hz is sub-band 5. The tone component information of 5500Hz in the 5kHz-6kHz frequency region is detected, and 5500Hz belongs to sub-band 3. The spectrum value of sub-band 3 can be set to zero.

[0161] S850: Perform third encoding according to the adjusted spectrum of the high-frequency band signal to obtain third encoding parameters.

[0162] Optionally, the third encoding includes quantizing and encoding the spectral coefficients of the adjusted spectrum, such as performing scalar quantization / vector quantization and arithmetic encoding or interval encoding on the spectral coefficients of the adjusted spectrum.

[0163] Optionally, if the low-band spectrum is not encoded in the first encoding, the low-band spectrum still needs to be encoded in the third encoding.

[0164] S860: Perform code stream multiplexing on the first coding parameter, the second coding parameter, and the third coding parameter to obtain a coding code stream of the current frame of the audio signal.

[0165] Therefore, the audio encoding method of the embodiment of the present application adjusts the spectrum of the high-band signal after the band extension processing according to the information of the pitch component of the high-band signal, obtains the spectrum of the adjusted high-band signal in the current frequency region, and then performs a third encoding on the spectrum of the adjusted high-band signal, thereby avoiding the encoding redundancy of the pitch component of the high-band signal caused by directly performing a third encoding on the spectrum of the high-band signal after the band extension processing.

[0166] The above embodiment specifically describes the process in which the codec device adjusts the spectrum of the high-frequency band signal after the band extension process according to the information of the pitch component of the high-frequency band signal during encoding, obtains the spectrum of the adjusted high-frequency band signal of the current frequency region, and then performs the third encoding on the spectrum of the adjusted high-frequency band signal. The following specifically describes the processing flow of the codec device during decoding.

[0167] Fig.10 A schematic flow chart of a method 1000 for audio decoding is shown. The method 1000 can be applied in Figures 1 to 7 The scenario shown can of course also be applied to other communication scenarios, and the embodiments of the present application are not limited here.

[0168] It should also be understood that in the embodiments of the present application, the execution subject of the method may be a terminal device, an access network device, and a core network device. As an example but not a limitation, the execution subject of the method may also be a chip, a chip system, or a processor applied to a terminal device, an access network device, and a core network device. Among them, the terminal device, the access network device, and the core network device have codec functions and may also be referred to as codec devices.

[0169] like Fig.10 As shown, Fig.10 The method 1000 shown in FIG. 1 may include S1010 to S1040. Fig.10 Each step in method 1000 is described in detail.

[0170] S1010, obtaining a coded bit stream.

[0171] S1020: Demultiplex the encoded code stream to obtain a first encoding parameter of a current frame of the audio signal, a second encoding parameter of the current frame of the audio signal, and a third encoding parameter of the current frame of the audio signal.

[0172] The first encoding parameter, the second encoding parameter and the third encoding parameter may refer to the encoding method 800 and will not be described in detail here.

[0173] S1030: Obtain a first high-frequency band signal of the current frame and a first low-frequency band signal of the current frame according to the first encoding parameter and the third encoding parameter.

[0174] The first high-band signal may include at least one of a decoded high-band signal obtained by directly decoding according to the first coding parameter and the third coding parameter, and an extended high-band signal obtained by performing frequency band extension on the first low-band signal.

[0175] S1040: Obtain a second high-frequency band signal of the current frame according to the second encoding parameter, where the second high-frequency band signal includes a reconstructed tone signal.

[0176] The second coding parameter comprises the tone component information of the high frequency band signal. For example, the high frequency band parameter of the current frame comprises the positional quantity parameter of the tone component and the amplitude parameter or the energy parameter of the described tone component. For another example, the high frequency band parameter of the current frame comprises the positional parameter, the quantity parameter, and the amplitude parameter or the energy parameter of the described tone component of the tone component. The high frequency band parameter of the current frame can refer to coding method 800, and will not be repeated here.

[0177] Similar to the encoding end processing flow method, the process of obtaining the reconstructed high-frequency band signal of the current frame according to the high-frequency band parameters in the decoding end processing flow will also be performed according to the frequency region division and / or sub-band division of the high-frequency band. The high-frequency band corresponding to the high-frequency band signal includes at least one frequency region, and one of the frequency regions includes at least one sub-band. The number of frequency regions of the high-frequency band parameters that need to be determined can be predetermined or obtained from the bit stream.

[0178] Here, a further description is given by taking an example of obtaining a reconstructed high-frequency band signal of a current frame according to a position quantity parameter of a tone component and an amplitude parameter of the tone component in a frequency region.

[0179] Specifically, the position of the tone component in the current frequency region is determined according to the position quantity parameter of the tone component in the current frequency region; the amplitude or energy corresponding to the position of the tone component is determined according to the amplitude parameter or energy parameter of the tone component in the current frequency region; and the reconstructed high-frequency band signal is obtained according to the position of the tone component in the current frequency region and the amplitude or energy corresponding to the position of the tone component.

[0180] S1050: Obtain a decoded signal of the current frame according to the first low-frequency band signal, the first high-frequency band signal, and the second high-frequency band signal of the current frame.

[0181] In an embodiment of the present application, in step S840 of the above-mentioned method 800, before adjusting the spectrum of the high-band signal after the band extension processing according to the information of the pitch component of the high-band signal to obtain the spectrum of the adjusted high-band signal, it can also include: determining, according to the encoding rate of the current frame, the range of the frequency region of the current frame in which it is necessary to determine whether to adjust the spectrum of the high-band signal after the band extension processing.

[0182] It should be understood that after determining the range of the frequency region in which the current frame needs to be judged whether to perform spectrum adjustment, step S840 needs to be performed, that is, within the range of the frequency region in which the current frame needs to be judged whether to perform spectrum adjustment, determine whether to adjust the spectrum of the high-frequency band signal after the band expansion processing based on the information of the tonal component of the high-frequency band signal to obtain the spectrum of the adjusted high-frequency band signal.

[0183] Specifically, the frequency region where it is necessary to judge whether to adjust the spectrum of the high-frequency band signal after the band extension processing can also be called the pre-selected region. After determining the pre-selected region, the spectrum of the high-frequency band signal after the band extension processing is adjusted according to the information of the tone component of the high-frequency band signal to obtain the spectrum of the adjusted high-frequency band signal. In the pre-selected region of the current frame, it is necessary to further judge according to the tone component information of the pre-selected region and the preset value, preset condition, etc. If the tone component information in the pre-selected region of the current frame meets the preset value and preset condition, the spectrum of the pre-selected region of the current frame is adjusted; if the tone component information in the pre-selected region of the current frame does not meet the preset value and preset condition, the spectrum of the pre-selected region of the current frame is not adjusted.

[0184] It should be understood that this step can be performed at any position before step S840 in method 800 .

[0185] In one implementation, the determining the scope of the preselected area of ​​the current frame according to the coding rate of the current frame comprises: determining a first frequency area scope according to the coding rate of the current frame. The first frequency area scope is the scope of the preselected area. The adjusting the spectrum of the high-frequency band signal after the band extension processing according to the information of the tone component of the high-frequency band signal to obtain the adjusted spectrum of the high-frequency band signal comprises: adjusting the spectrum of the high-frequency band signal after the band extension processing according to the information of the tone component of the high-frequency band signal within the first frequency area scope to obtain the adjusted spectrum of the high-frequency band signal.

[0186] It should be understood that during encoding, the encoding rates of different frames may be different, so it is necessary to determine the range of the frequency region corresponding to each encoding rate and whether to adjust the high-frequency band signal spectrum after the band extension processing.

[0187] It should also be understood that the encoding rate of the current frame may be the average encoding rate of each channel of the current frame. The average encoding rate of each channel of the current frame may be determined based on the total encoding rate of the current frame and the number of channels.

[0188] Optionally, the determining of the first frequency region range according to the coding rate of the current frame includes: if the coding rate of the current frame satisfies a third preset condition, the first frequency region range is a first range, and the first range includes a starting frequency region of the first range and a cutoff frequency region of the first range; or, if the coding rate of the current frame does not meet the third preset condition, the first frequency region range is a second range, and the second range includes a starting frequency region of the second range and a cutoff frequency region of the second range, and the frequency ranges corresponding to the first range and the second range are not completely the same. Among them, the frequency ranges corresponding to the first range and the second range are not completely the same, which means that the frequency ranges corresponding to the first range and the second range may partially overlap, but are not completely the same.

[0189] For example, assuming that the total encoding rate of the encoder of the current frame is bitrate_tot and the number of channels is n_channels, the average encoding rate of each channel is bitrate_ch = bitrate_tot / n_channels. If the average encoding rate is greater than 24kb / s, the first frequency region is empty, that is, all frequency regions do not need to adjust the high frequency band signal spectrum after the band extension process. If the average encoding rate is less than or equal to 24kb / s, the first frequency region ranges from the second frequency region to the fourth frequency region.

[0190] For another example, the average coding rate of each channel is bitrate_ch. If the average coding rate is greater than 24 kb / s, the first frequency region ranges from the fourth frequency region, that is, the first range is the fourth frequency region. If the average coding rate is less than or equal to 24 kb / s, the first frequency region ranges from the second frequency region to the fourth frequency region, that is, the second range is from the second frequency region to the fourth frequency region.

[0191] Of course, the frequency region range corresponding to each rate that needs to determine whether to adjust the high-frequency band signal spectrum after the band extension processing can be determined according to different coding rates. Different frequency region ranges can also be controlled to be used under different coding rates according to more preset conditions.

[0192] For example, if the coding rate of current frame is greater than 48kb / s, the first frequency region scope is empty.Just all frequency regions do not need to adjust the high frequency band signal spectrum after the frequency band extension process.The coding rate of current frame is less than or equal to 48kb / s and greater than 24kb / s, and the first frequency region scope is the 4th frequency region, namely the first scope is the 4th frequency region, namely only in the 4th frequency region according to the pitch component information of the high frequency band signal, the high frequency band signal spectrum after the frequency band extension process is adjusted.When the coding rate of current frame is less than or equal to 24kb / s, the first frequency region scope is second frequency region to the 4th frequency region, namely the second scope is from second frequency region to the 4th frequency region.

[0193] In one implementation, determining the range of the preselected area of ​​the current frame according to the coding rate of the current frame includes: determining a starting frequency area according to the coding rate of the current frame, the starting frequency area being the frequency area with the smallest sequence number within the preselected area; adjusting the spectrum of the high-frequency band signal after the band extension processing according to the information of the tone component of the high-frequency band signal to obtain the adjusted spectrum of the high-frequency band signal includes: starting from the starting frequency area, adjusting the spectrum of the high-frequency band signal after the band extension processing according to the information of the tone component of the high-frequency band signal to obtain the adjusted spectrum of the high-frequency band signal.

[0194] Optionally, the determining the starting frequency region according to the coding rate of the current frame includes: if the coding rate of the current frame satisfies a third preset condition, the starting frequency region is a first starting frequency region; or, if the coding rate of the current frame does not satisfy the third preset condition, the starting frequency region is a second starting frequency region, and the frequency ranges corresponding to the first starting frequency region and the second starting frequency region are different. The frequency ranges corresponding to the first starting frequency region and the second starting frequency region are different, indicating that the frequency range corresponding to the first starting frequency region and the frequency range corresponding to the second starting frequency region are completely different.

[0195] For example, assuming that the total encoder rate is bitrate_tot and the number of channels is n_channels, the average encoding rate of each channel is bitrate_ch=bitrate_tot / n_channels. If the average encoding rate of each channel is greater than 24 kb / s, the starting frequency region is num_tiles, that is, from the num_tilesth frequency region to the frequency region with a higher frequency range of the current frame, the spectrum of the high-frequency band signal after the band extension processing can be further adjusted according to the information of the pitch component of the high-frequency band signal to obtain the adjusted spectrum of the high-frequency band signal; if the average encoding rate of each channel is less than or equal to 24 kb / s, the starting frequency region is 1, and the frequency region with the frequency region sequence number 1 and the frequency region with a higher frequency range can further adjust the spectrum of the high-frequency band signal after the band extension processing according to the information of the pitch component of the high-frequency band signal to obtain the adjusted spectrum of the high-frequency band signal.

[0196] If the value of the starting frequency region is greater than the sequence number of the highest frequency region in the current frame frequency range, it means that there is no frequency region that needs to adjust the spectrum after band expansion processing according to the information of the pitch component of the high-frequency band signal to obtain the adjusted spectrum.

[0197] For another example, described current frame comprises 4 frequency regions, are respectively frequency region 0, frequency region 1, frequency region 2 and frequency region 3, if the average coding rate of each passage is greater than 24kb / s, then starting frequency region is 2, namely in frequency region 2 and frequency region 3, can further according to the information of the tone component of high frequency band signal, the high frequency band signal spectrum after the band extension process is adjusted, to obtain the spectrum of the high frequency band signal after adjustment.If the average coding rate of each passage is less than or equal to 24kb / s, then starting frequency region is 1, namely in frequency region 1, frequency region 2, frequency region 3, can further according to the information of the tone component of high frequency band signal, the high frequency band signal spectrum after the band extension process is adjusted, to obtain the spectrum of the high frequency band signal after adjustment.If the average coding rate of each passage is greater than 48kb / s, then starting frequency region is 4, then represents that there is no frequency region need according to the information of the tone component of high frequency band signal, the spectrum after the band extension process is adjusted, to obtain the spectrum after adjustment.

[0198] In an embodiment of the present application, in step S840 in the above-mentioned method 800, before adjusting the spectrum of the high-band signal after the band extension processing according to the information of the pitch component of the high-band signal to obtain the spectrum of the adjusted high-band signal, it may also include: determining whether the current frequency region belongs to a first frequency region range according to the spectrum of the high-band signal after the band extension processing of the current frequency region, the first frequency region range is the range of the frequency region for which the spectrum of the high-band signal after the band extension processing needs to be adjusted, wherein the high frequency band corresponding to the high-band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region.

[0199] If the current frequency region belongs to the first frequency region range, adjusting the spectrum of the high-frequency band signal after the band expansion processing according to the information of the pitch component of the high-frequency band signal to obtain the adjusted spectrum of the high-frequency band signal includes: adjusting the spectrum of the high-frequency band signal of the current frequency region according to the information of the pitch component of the high-frequency band signal to obtain the adjusted spectrum of the high-frequency band signal of the current frequency region.

[0200] Optionally, if the number of frequency points whose absolute values ​​of spectrum values ​​are greater than the second threshold value in the high-band signal spectrum of the current frequency region after the band extension processing is less than the third threshold value, the current frequency region belongs to the first frequency region range. That is, if there are a small number of retained spectrum components in the spectrum of the current frequency region after the band extension processing, a judgment process of whether to perform spectrum adjustment can be performed.

[0201] For example, the second threshold value is T, and the 3rd threshold value is 10, and the current frequency region is 5100Hz-5500Hz, and the absolute value of the high frequency band signal spectrum after the band extension process in the current frequency region is greater than the quantity of the frequency point of T is less than 10, and the current frequency region is that 5100Hz-5500Hz belongs to the first frequency region scope.It is understandable that the value of the 3rd threshold value can also be other values, such as 9 or 11 etc., and specific value can be arranged according to experience or needs.Wherein, in one embodiment, the value of T can be set to 3 times (it should be noted that 3 times is only an example, can use other ways in actual applications) of the mean value of the high frequency band signal spectrum absolute value after the band extension process in the current frequency region, and for example the value of T can be 5.4,6.6, or 9.0 etc. positive real numbers.

[0202] It should be understood that this step needs to be performed after step S820 and before step S840 in method 800 .

[0203] Therefore, before adjusting the spectrum of the high-band signal after the band expansion processing, determining the range of the frequency region of the current frame for judging whether to perform spectrum adjustment is performed according to the coding rate of the current frame or the spectrum of the current frame after the band expansion processing, which has higher coding efficiency.

[0204] In an embodiment of the present application, when encoding the current frame of the audio signal, the number of frequency regions with priority in spectrum retention or the number of frequency regions with priority in tone reconstruction can also be determined according to the coding rate of the current frame. The spectrum retention priority means that the spectrum retained by the IGF in the frequency region with priority in spectrum retention is subjected to the third encoding. The tone reconstruction priority means that the spectrum of the high-frequency band signal after the band extension processing can be adjusted according to the information of the tone component of the high-frequency band signal obtained in the second encoding process, and the spectrum component retained by the IGF can be removed.

[0205] The following further describes two specific embodiments for determining the number of frequency regions with priority for spectrum preservation or the number of frequency regions with priority for tone reconstruction according to the coding rate of the current frame.

[0206] In a specific embodiment, the number of frequency regions with spectrum reservation priority is determined according to the coding rate of the current frame.

[0207] Assume the total encoder rate is bitrate_tot, the number of channels is n_channels, then the average encoding rate of each channel is bitrate_ch = bitrate_tot / n_channels. If the average encoding rate of each channel is less than or equal to the preset threshold, the strategy of spectrum preservation priority is adopted only in the frequency region with lower frequency, and the strategy of tone reconstruction priority is adopted in the frequency region with higher frequency. If the average encoding rate of each channel is greater than the preset threshold, the strategy of spectrum preservation priority is adopted in all frequency regions of the entire high frequency band.

[0208] The pseudo code for the specific implementation is as follows:

[0209]

[0210] Wherein, num_tiles_encFirst is the number of frequency domain regions that adopt the spectrum reservation priority strategy, and num_tiles is the total number of frequency regions in the high frequency band. num_tiles_encFirst is equal to the minimum number of frequency regions that need to determine whether to adjust the spectrum after the band extension process (the number starts from 0).

[0211] The spectrum after the band expansion processing is adjusted in the following way: in the frequency region where the tone reconstruction priority strategy is adopted, the spectrum components retained by the IGF are removed (i.e., the spectrum values ​​are set to 0), so as to achieve the purpose of mainly reconstructing the tone components in the spectrum of the decoded high-frequency band signal.

[0212] The specific pseudo code implementation is as follows:

[0213]

[0214]

[0215] Among them, num_tiles_encFirst is the number of frequency domain regions that adopt the spectrum reservation priority strategy, and num_tiles is the total number of frequency regions in the high-frequency band. num_tiles_encFirst is equal to the minimum number of frequency regions that need to determine whether to adjust the spectrum after the band extension processing (the number starts from 0). tone_cnt[p] is the number information of the tone components of the p-th tile, tile[p] is the starting frequency of the p-th tile, tile[p+1] is the starting frequency of the p+1-th tile, tile[p+1]-1 is the cutoff frequency of the p-th tile, sb is the frequency number, and mdctSpectrumAfterIGF is the spectrum after the band extension processing, that is, the spectrum after IGF processing.

[0216] In another specific embodiment, the number of frequency regions for which pitch reconstruction is prioritized is determined according to the coding rate of the current frame.

[0217] Assume the total encoder rate is bitrate_tot, the number of channels is n_channels, then the average encoding rate of each channel is bitrate_ch = bitrate_tot / n_channels. If the average encoding rate of each channel is less than or equal to the preset threshold, the strategy of spectrum preservation priority is adopted only in the frequency region with lower frequency, and the strategy of tone reconstruction priority is adopted in the frequency region with higher frequency. If the average encoding rate of each channel is greater than the preset threshold, the strategy of spectrum preservation priority is adopted in all frequency regions of the entire high frequency band.

[0218] The pseudo code for the specific implementation is as follows:

[0219]

[0220] Among them, num_tiles_reconFirst is the number of frequency regions using the tone reconstruction priority strategy.

[0221] The spectrum after the band expansion processing is adjusted in the following way: in the frequency region where the tone reconstruction priority strategy is adopted, the spectrum components retained by the IGF are removed (i.e., the spectrum values ​​are set to 0), so as to achieve the purpose of mainly reconstructing the tone components in the spectrum of the decoded high-frequency band signal.

[0222] The specific pseudo code implementation is as follows:

[0223]

[0224] Among them, num_tiles_reconFirst is the number of frequency regions that use the tone reconstruction priority strategy, num_tiles is the total number of frequency regions in the high-frequency band, tone_cnt[p] is the number information of the tone components of the p-th tile, tile[p] is the starting frequency of the p-th tile, tile[p+1] is the starting frequency of the p+1-th tile, tile[p+1]-1 is the cutoff frequency of the p-th tile, sb is the frequency sequence number, and mdctSpectrumAfterIGF is the spectrum after band extension processing, that is, the spectrum after IGF processing.

[0225] Combination of the above Figures 1 to 10 An audio processing method according to an embodiment of the present application is described in detail. Figures 11 to 13 The device of the embodiment of the present application is described in detail.

[0226] Fig.11 A schematic block diagram of a coding and decoding device 1100 according to an embodiment of the present application is shown.

[0227] In some embodiments, the apparatus 1100 may be a terminal device, or may be a chip or a circuit, such as a chip or a circuit that may be disposed in a terminal device.

[0228] In some embodiments, the apparatus 1100 may be an access network device, or may be a chip or a circuit, such as a chip or a circuit that may be disposed in an access network device.

[0229] In some embodiments, the apparatus 1100 may be a core network device, or may be a chip or a circuit, such as a chip or a circuit that may be disposed in a core network device.

[0230] In one possible manner, the apparatus 1100 may include a processing unit 1110 (ie, an example of a processor) and a transceiver unit 1130. In some possible implementations, the processing unit 1110 may also be referred to as a determination unit. In some possible implementations, the transceiver unit 1130 may include a receiving unit and a sending unit.

[0231] In one implementation, the transceiver unit 1130 may be implemented by a transceiver or a transceiver-related circuit or an interface circuit.

[0232] In one implementation, the device may further include a storage unit 1120. In one possible implementation, the storage unit 1120 is used to store instructions. In one implementation, the storage unit may also be used to store data or information. The storage unit 1120 may be implemented by a memory.

[0233] In some possible designs, the processing unit 1110 is used to execute the instructions stored in the storage unit 1120, so that the apparatus 1100 implements the steps performed by the terminal device in the above method. Alternatively, the processing unit 1110 can be used to call the data of the storage unit 1120, so that the apparatus 1100 implements the steps performed by the terminal device in the above method.

[0234] In some possible designs, the processing unit 1110 is used to execute the instructions stored in the storage unit 1120, so that the apparatus 1100 implements the steps performed by the access network device in the above method. Alternatively, the processing unit 1110 can be used to call the data of the storage unit 1120, so that the apparatus 1100 implements the steps performed by the access network device in the above method.

[0235] For example, the processing unit 1110, the storage unit 1120, and the transceiver unit 1130 can communicate with each other through the internal connection path to transmit control and / or data signals. For example, the storage unit 1120 is used to store a computer program, and the processing unit 1110 can be used to call and run the computer program from the storage unit 1120 to control the transceiver unit 1130 to receive signals and / or send signals, and complete the steps of the terminal device or access network device in the above method. The storage unit 1120 can be integrated in the processing unit 1110, or it can be set separately from the processing unit 1110.

[0236] Optionally, if the apparatus 1100 is a communication device (e.g., a terminal device or an access network device), the transceiver unit 1130 includes a receiver and a transmitter. The receiver and the transmitter may be the same or different physical entities. When they are the same physical entities, they may be collectively referred to as transceivers.

[0237] When the device 1100 is a terminal device or the device is an access network device or a core network device, the transceiver unit 1130 may be a sending unit or a transmitter when sending information, and the transceiver unit 1130 may be a receiving unit or a receiver when receiving information. The transceiver unit may be a transceiver, and the transceiver, transmitter or receiver may be a radio frequency circuit. When the device includes a storage unit, the storage unit is used to store computer instructions, and the processor is connected to the memory for communication. The processor executes the computer instructions stored in the memory, so that the device can execute method 200, method 500 or method 600. Among them, the processor may be a general-purpose central processing unit (CPU), a microprocessor, or an application-specific integrated circuit (ASIC).

[0238] Optionally, if the device 1100 is a chip or a circuit, the transceiver unit 1130 includes an input interface and an output interface.

[0239] When the device 1100 is a chip, the transceiver unit 1130 may be an input and / or output interface, a pin or a circuit, etc. The processing unit 1110 may execute the computer-executable instructions stored in the storage unit so that the device may execute method 200, method 500 or method 600. Optionally, the storage unit is a storage unit in the chip, such as a register, a cache, etc. The storage unit may also be a storage unit in the terminal located outside the chip, such as a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM), etc.

[0240] As an implementation, the function of the transceiver unit 1130 may be implemented by a transceiver circuit or a dedicated chip for transceiver. The processing unit 1110 may be implemented by a dedicated processing chip, a processing circuit, a processing unit or a general chip.

[0241] As another implementation method, it is possible to use a general-purpose computer to implement the codec device (e.g., terminal device, or access network device) provided in the embodiment of the present application. That is, the program code for implementing the functions of the processing unit 1110 and the transceiver unit 1130 is stored in the storage unit 1120, and the general-purpose processing unit implements the functions of the processing unit 1110 and the transceiver unit 1130 by executing the code in the storage unit 1120.

[0242] In some embodiments, the apparatus 1100 may be a codec device. When the apparatus 1100 is a codec device, or a chip or circuit disposed in the codec device, the acquisition unit 1140 is used to acquire a current frame of an audio signal, wherein the current frame of the audio signal includes a high-frequency band signal and a low-frequency band signal; the processing unit 1110 is used to perform a first encoding according to the high-frequency band signal and the low-frequency band signal to obtain a first encoding parameter of the current frame of the audio signal, wherein the first encoding includes a frequency band extension encoding; the processing unit 1110 is also used to perform a second encoding according to the high-frequency band signal to obtain a second encoding parameter of the current frame, wherein the second encoding parameter is used to represent the pitch component of the high-frequency band signal. The processing unit 1110 is also used for adjusting the spectrum of the high-frequency band signal after the band extension processing according to the information of the pitch component of the high-frequency band signal to obtain the spectrum of the adjusted high-frequency band signal, and the spectrum of the high-frequency band signal after the band extension processing is obtained in the band extension encoding process; the processing unit 1110 is also used for performing a third encoding according to the spectrum of the adjusted high-frequency band signal to obtain a third encoding parameter; the processing unit 1110 is also used for performing code stream multiplexing on the first encoding parameter, the second encoding parameter and the third encoding parameter to obtain the encoding code stream of the current frame of the audio signal.

[0243] Optionally, the information of the tone component includes one or more of the following parameters: mark information of the tone component, position information of the tone component, quantity information of the tone component, amplitude information of the tone component, mark information of the tone component or energy information of the tone component.

[0244] Optionally, the high frequency band of the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region; the processing unit 1110 is specifically used to: adjust the spectrum of the high frequency band signal after the band expansion processing of the current frequency region according to the quantity information of the tonal components of the current frequency region, so as to obtain the spectrum of the adjusted high frequency band signal of the current frequency region.

[0245] Optionally, the processing unit 1110 is specifically used to: if the quantity information of the tonal components of the current frequency region meets the first preset condition, adjust the spectrum of the high-frequency band signal after the band expansion processing of the current frequency region to obtain the spectrum of the adjusted high-frequency band signal of the current frequency region.

[0246] Optionally, the first preset condition is that the number of tonal components in the current frequency region is greater than or equal to a first threshold.

[0247] Optionally, the high frequency band of the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region; the processing unit 1110 is specifically used to: adjust the spectrum of the high frequency band signal after the band expansion processing of the current frequency region according to the tone component mark information of the current frequency region to obtain the spectrum of the adjusted high frequency band signal of the current frequency region, and the tone component mark information is used to mark whether there is a tone component in the current frequency region.

[0248] Optionally, the processing unit 1110 is specifically used to: if the value of the tone component mark information of the current frequency region is a first preset value, adjust the spectrum of the high-frequency band signal after the band expansion processing of the current frequency region to obtain the spectrum of the adjusted high-frequency band signal of the current frequency region, wherein the value of the tone component mark information of the current frequency region is the first preset value indicating that there is a tone component in the current frequency region.

[0249] Optionally, the processing unit 1110 is specifically used to: set the spectrum value of the high-frequency band signal after the band expansion processing of the current frequency region to a second preset value; or, perform weighted processing on the spectrum of the high-frequency band signal after the band expansion processing of the current frequency region to obtain the spectrum of the adjusted high-frequency band signal of the current frequency region.

[0250] Optionally, the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region; the processing unit 1110 is specifically used to: adjust the spectrum of the high frequency band signal after the band expansion processing of the current frequency region according to the position information of the tone components of the current frequency region, so as to obtain the spectrum of the adjusted high frequency band signal of the current frequency region.

[0251] Optionally, the current frequency region includes at least one sub-band, and the at least one sub-band includes the current sub-band. The processing unit 1110 is specifically used to: if the position information of the tone component of the current frequency region meets the second preset condition, adjust the high-frequency band signal spectrum of the current sub-band after the band expansion processing to obtain the adjusted high-frequency band signal spectrum of the current sub-band.

[0252] Optionally, the position information of the tone component in the current frequency region includes the sequence number of the subband including the tone component in the current frequency region, and the second preset condition is that the sequence number of the subband including the tone component includes the sequence number of the current subband.

[0253] Optionally, the processing unit 1110 is specifically used to: set the spectrum value of the high-frequency band signal after the frequency band expansion processing of the current sub-band to a second preset value to obtain the spectrum of the adjusted high-frequency band signal of the current sub-band; or, perform weighted processing on the spectrum of the high-frequency band signal after the frequency band expansion processing of the current sub-band to obtain the spectrum of the adjusted high-frequency band signal of the current sub-band.

[0254] Optionally, the processing unit 1110 is also used for: before adjusting the spectrum of the high-band signal after the band extension processing according to the information of the pitch component of the high-band signal to obtain the adjusted spectrum of the high-band signal, determining a starting frequency area according to the coding rate of the current frame, the starting frequency area being the frequency area with the smallest serial number within the frequency range where it is necessary to determine whether to adjust the spectrum of the high-band signal after the band extension processing; adjusting the spectrum of the high-band signal after the band extension processing according to the information of the pitch component of the high-band signal to obtain the adjusted spectrum of the high-band signal, comprises: starting from the starting frequency area, adjusting the spectrum of the high-band signal after the band extension processing according to the information of the pitch component of the high-band signal to obtain the adjusted spectrum of the high-band signal.

[0255] Optionally, the processing unit 1110 is specifically used to: if the encoding rate of the current frame satisfies a third preset condition, then the starting frequency area is the first starting frequency area; or, if the encoding rate of the current frame does not satisfy the third preset condition, then the starting frequency area is the second starting frequency area, and the frequency ranges corresponding to the first starting frequency area and the second starting frequency area are different.

[0256] Optionally, the processing unit 1110 is also used for: before adjusting the spectrum of the high-band signal after the band extension processing according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal, determining a first frequency area range according to the coding rate of the current frame, the first frequency area range being the range of the frequency area where it is necessary to determine whether to adjust the spectrum of the high-band signal after the band extension processing; adjusting the spectrum of the high-band signal after the band extension processing according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal, comprises: within the first frequency area range, adjusting the spectrum of the high-band signal after the band extension processing according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal.

[0257] Optionally, the processing unit 1110 is specifically used to: if the encoding rate of the current frame satisfies a third preset condition, then the first frequency region range is a first range; or, if the encoding rate of the current frame does not satisfy the third preset condition, then the first frequency region range is a second range, and the frequency range corresponding to the first range is not completely the same as the second range.

[0258] Optionally, the high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region; the processing unit 1110 is also used to: before adjusting the high frequency band signal spectrum after the band extension processing according to the information of the tone component of the high frequency band signal to obtain the adjusted spectrum of the high frequency band signal, determine whether the current frequency region belongs to a first frequency region range according to the high frequency band signal spectrum after the band extension processing of the current frequency region, and the first frequency region range is the range of the frequency region where it is necessary to determine whether to adjust the high frequency band signal spectrum after the band extension processing; if the current frequency region belongs to the first frequency region range, the processing unit is also used to: adjust the high frequency band signal spectrum of the current frequency region according to the information of the tone component of the high frequency band signal to obtain the adjusted spectrum of the high frequency band signal of the current frequency region.

[0259] Optionally, the processing unit 1110 is specifically used to: if the number of frequency points whose absolute values ​​of spectrum values ​​are greater than the second threshold in the high-band signal spectrum after band expansion processing of the current frequency region is less than a third threshold, then the current frequency region belongs to the first frequency region range.

[0260] Optionally, the acquisition unit 1140 is also used to: acquire a coded code stream; the processing unit 1110 is also used to demultiplex the coded code stream to obtain the first coding parameter, the second coding parameter and the third coding parameter of the current frame of the audio signal; the processing unit 1110 is also used to obtain a first high-frequency band signal of the current frame and a first low-frequency band signal of the current frame according to the first coding parameter and the third coding parameter, wherein the first high-frequency band signal includes: a decoded high-frequency band signal directly decoded according to the first coding parameter and the third coding parameter, and at least one of an extended high-frequency band signal obtained by band extension according to the first low-frequency band signal; the processing unit 1110 is also used to obtain a second high-frequency band signal of the current frame according to the second coding parameter, the second high-frequency band signal including a reconstructed tone signal; the processing unit 1110 is also used to obtain a decoded signal of the current frame according to the first low-frequency band signal, the first high-frequency band signal and the second high-frequency band signal of the current frame.

[0261] When the apparatus 1100 is configured in or is itself a codec device, each module or unit in the apparatus 1100 may be used to execute each action or processing procedure executed by the codec device in the above method, and a detailed description thereof is omitted here to avoid redundancy.

[0262] Fig.12 This is a schematic diagram of the structure of a terminal device 1200 provided in the present application. The terminal device 1200 can execute the actions executed by the terminal device in the above method embodiment.

[0263] For ease of explanation, Fig.12 Only the main components of the terminal device are shown. Fig.12 As shown, the terminal device 1200 includes a processor, a memory, a control circuit, an antenna, and an input and output device.

[0264] The processor is mainly used to process the communication protocol and communication data, as well as to control the entire terminal device, execute the software program, and process the data of the software program, for example, to support the terminal device to perform the actions described in the above-mentioned transmission precoding matrix indication method embodiment. The memory is mainly used to store software programs and data, for example, to store the codebook described in the above-mentioned embodiment. The control circuit is mainly used for conversion between baseband signals and radio frequency signals and processing of radio frequency signals. The control circuit and the antenna can also be called a transceiver, which is mainly used to send and receive radio frequency signals in the form of electromagnetic waves. Input and output devices, such as touch screens, display screens, keyboards, etc. are mainly used to receive data input by users and output data to users.

[0265] When the terminal device is turned on, the processor can read the software program in the storage unit, interpret and execute the instructions of the software program, and process the data of the software program. When data needs to be sent wirelessly, the processor performs baseband processing on the data to be sent, and outputs the baseband signal to the RF circuit. The RF circuit performs RF processing on the baseband signal and then sends the RF signal outward in the form of electromagnetic waves through the antenna. When data is sent to the terminal device, the RF circuit receives the RF signal through the antenna, converts the RF signal into a baseband signal, and outputs the baseband signal to the processor. The processor converts the baseband signal into data and processes the data.

[0266] Those skilled in the art will appreciate that for ease of description, Fig.12 Only one memory and processor are shown. In an actual terminal device, there may be multiple processors and memories. The memory may also be referred to as a storage medium or a storage device, etc., which is not limited in the embodiments of the present application.

[0267] For example, the processor may include a baseband processor and a central processing unit. The baseband processor is mainly used to process the communication protocol and communication data, and the central processing unit is mainly used to control the entire terminal device, execute software programs, and process data of the software programs. Fig.12 The processor in integrates the functions of the baseband processor and the central processing unit. Those skilled in the art will understand that the baseband processor and the central processing unit may also be independent processors, which are interconnected through technologies such as buses. Those skilled in the art will understand that the terminal device may include multiple baseband processors to adapt to different network standards, and the terminal device may include multiple central processing units to enhance its processing capabilities. The various components of the terminal device may be connected through various buses. The baseband processor may also be described as a baseband processing circuit or a baseband processing chip. The central processing unit may also be described as a central processing circuit or a central processing chip. The function of processing the communication protocol and communication data may be built into the processor, or may be stored in the storage unit in the form of a software program, and the processor executes the software program to implement the baseband processing function.

[0268] For example, in the embodiment of the present application, the antenna and control circuit with transceiver functions can be regarded as the transceiver unit 1210 of the terminal device 1200, and the processor with processing function can be regarded as the processing unit 1220 of the terminal device 1200. The processing unit 1220 can also realize the function of the acquisition unit. Fig.12 As shown, the terminal device 1200 includes a transceiver unit 1210 and a processing unit 1220. The transceiver unit may also be referred to as a transceiver, a transceiver, a transceiver device, etc. Optionally, the device used to implement the receiving function in the transceiver unit 1210 may be regarded as a receiving unit, and the device used to implement the sending function in the transceiver unit 1210 may be regarded as a sending unit, that is, the transceiver unit includes a receiving unit and a sending unit. Exemplarily, the receiving unit may also be referred to as a receiver, a receiver, a receiving circuit, etc., and the sending unit may be referred to as a transmitter, a transmitter, or a transmitting circuit, etc.

[0269] Fig.13A structural diagram of an access network device 1300 provided in an embodiment of the present application can be used to implement the functions of the access device in the above method. The access network device 1300 includes one or more radio frequency units, such as a remote radio unit (RRU) 1313 and one or more baseband units (BBU) (also referred to as digital units, digital units, DU) 1320. The RRU 1313 can be called a transceiver unit, a transceiver, a transceiver circuit, or a transceiver, etc., which may include at least one antenna 1311 and a radio frequency unit 1312. The RRU 1313 part is mainly used for the transmission and reception of radio frequency signals and the conversion of radio frequency signals and baseband signals, for example, for sending the signaling message described in the above embodiment to the terminal device. The BBU 1320 part is mainly used for baseband processing, controlling the base station, etc. The RRU 1313 and the BBU 1320 can be physically arranged together or physically separated, that is, a distributed base station.

[0270] The BBU 1320 is the control center of the base station, which can also be called a processing unit, and is mainly used to complete baseband processing functions, such as channel coding, multiplexing, modulation, spread spectrum, etc. For example, the BBU (processing unit) 1320 can be used to control the access network device to execute the operation flow of the access network device in the above method embodiment.

[0271] In one example, the BBU1320 may be composed of one or more single boards, and multiple single boards may jointly support a wireless access network of a single access standard (such as an LTE system, or a 5G system, or a future wireless access network system, etc.), or may respectively support wireless access networks of different access standards. The BBU1320 also includes a memory 1321 and a processor 1322. The memory 1321 is used to store necessary instructions and data. For example, the memory 1321 stores the codebook in the above embodiment, etc. The processor 1322 is used to control the base station to perform necessary actions, such as controlling the base station to execute the operation process of the network device in the above method embodiment. The memory 1321 and the processor 1322 can serve one or more single boards. That is, a memory and a processor may be separately set on each single board. It is also possible that multiple single boards share the same memory and processor. In addition, necessary circuits may be set on each single board.

[0272] In a possible implementation, with the development of system-on-chip (SoC) technology, all or part of the functions of parts 1320 and 1313 can be implemented by SoC technology, for example, by a base station function chip, which integrates devices such as a processor, a memory, and an antenna interface, and the program of the base station-related functions is stored in the memory, and the processor executes the program to implement the relevant functions of the base station. Optionally, the base station function chip can also read the memory outside the chip to implement the relevant functions of the base station.

[0273] It should be understood that Fig.13 The structure of the access network device in the example is only one possible form and should not constitute any limitation to the embodiments of the present application. The present application does not exclude the possibility of other forms of base station structures that may appear in the future.

[0274] It should be understood that in the embodiments of the present application, the processor may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0275] It should also be understood that the memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM).

[0276] The above embodiments can be implemented in whole or in part by software, hardware, firmware or any other combination. When implemented by software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media sets. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium. The semiconductor medium can be a solid-state hard disk.

[0277] An embodiment of the present application further provides a computer-readable medium on which a computer program is stored. When the computer program is executed by a computer, the steps performed by the encoding and decoding device in any of the above embodiments are implemented.

[0278] An embodiment of the present application further provides a computer program product, which, when executed by a computer, implements the steps performed by the encoding and decoding device in any of the above embodiments.

[0279] The embodiment of the present application also provides a system chip, which includes: a communication unit and a processing unit. The processing unit may be, for example, a processor. The communication unit may be, for example, a communication interface, an input / output interface, a pin or a circuit. The processing unit may execute computer instructions to enable the chip in the communication device to perform the steps performed by the encoding and decoding device provided in the embodiment of the present application.

[0280] Optionally, the computer instructions are stored in a storage unit.

[0281] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a coded bit stream obtained according to the method executed by the coding and decoding device in any of the above embodiments.

[0282] The various embodiments in this application may be used independently or in combination, which is not limited here.

[0283] In addition, various aspects or features of the present application can be implemented as methods, devices or products using standard programming and / or engineering techniques. The term "product" used in this application covers computer programs that can be accessed from any computer-readable device, carrier or medium. For example, computer-readable media may include, but are not limited to: magnetic storage devices (e.g., hard disks, floppy disks or tapes, etc.), optical disks (e.g., compact discs (CDs), digital versatile discs (DVDs), etc.), smart cards and flash memory devices (e.g., erasable programmable read-only memory (EPROM), cards, sticks or key drives, etc.). In addition, the various storage media described herein may represent one or more devices and / or other machine-readable media for storing information. The term "machine-readable medium" may include, but is not limited to, wireless channels and various other media capable of storing, containing and / or carrying instructions and / or data.

[0284] It should be understood that "and / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent three situations: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the previously associated objects are in an "or" relationship. "At least one" means one or more; "at least one of A and B" is similar to "A and / or B", describing the association relationship of associated objects, indicating that three relationships may exist. For example, at least one of A and B can represent three situations: A exists alone, A and B exist at the same time, and B exists alone.

[0285] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0286] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0287] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0288] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0289] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0290] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0291] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for audio encoding, characterized in that: include: Acquire a current frame of an audio signal, wherein the current frame of the audio signal includes a high-frequency band signal and a low-frequency band signal; Performing a first encoding according to the high-frequency band signal and the low-frequency band signal to obtain a first encoding parameter of a current frame of the audio signal, wherein the first encoding includes frequency band extension encoding; Performing second encoding according to the high-frequency band signal to obtain a second encoding parameter of the current frame, wherein the second encoding parameter is used to represent information of a tone component of the high-frequency band signal; adjusting the spectrum of the high-band signal after the band extension processing according to the information of the tone component of the high-band signal to obtain the spectrum of the adjusted high-band signal, wherein the spectrum of the high-band signal after the band extension processing is obtained in the band extension encoding process; Performing third encoding according to the adjusted spectrum of the high-frequency band signal to obtain third encoding parameters; The first encoding parameter, the second encoding parameter and the third encoding parameter are multiplexed to obtain an encoding code stream of a current frame of the audio signal.

2. The method according to claim 1, characterized in that The information of the tone components includes one or more of the following parameters: The identification information of the tone component, the position information of the tone component, the quantity information of the tone component, the amplitude information of the tone component or the energy information of the tone component.

3. The method according to claim 2, characterized in that The high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region; The step of adjusting the spectrum of the high-band signal after the band extension process according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal comprises: According to the quantity information of the tonal components of the current frequency region, the spectrum of the high-band signal of the current frequency region after the band extension processing is adjusted to obtain the spectrum of the adjusted high-band signal of the current frequency region.

4. The method according to claim 3, characterized in that The step of adjusting the frequency spectrum of the high-band signal of the current frequency region after the band extension processing according to the quantity information of the tonal components of the current frequency region to obtain the frequency spectrum of the adjusted high-band signal of the current frequency region comprises: If the quantity information of the tonal components of the current frequency region meets the first preset condition, the spectrum of the high-band signal of the current frequency region after the band extension processing is adjusted to obtain the spectrum of the adjusted high-band signal of the current frequency region.

5. The method according to claim 4, characterized in that The first preset condition is that the number of the tonal components in the current frequency region is greater than or equal to a first threshold.

6. The method according to claim 2, characterized in that The high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region; The step of adjusting the spectrum of the high-band signal after the band extension process according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal comprises: According to the tone component flag information of the current frequency region, the spectrum of the high-frequency band signal after the band expansion processing of the current frequency region is adjusted to obtain the spectrum of the adjusted high-frequency band signal of the current frequency region, and the tone component flag information is used to mark whether there is a tone component in the current frequency region.

7. The method according to claim 6, characterized in that The step of adjusting the frequency spectrum of the high-band signal of the current frequency region after the band extension processing according to the tone component flag information of the current frequency region to obtain the frequency spectrum of the adjusted high-band signal of the current frequency region comprises: If the value of the tone component flag information of the current frequency region is a first preset value, adjusting the spectrum of the high-band signal of the current frequency region after the band extension processing to obtain the spectrum of the adjusted high-band signal of the current frequency region, The fact that the value of the tone component flag information of the current frequency region is a first preset value indicates that there is a tone component in the current frequency region.

8. The method according to any one of claims 3 to 7, characterized in that The step of adjusting the spectrum of the high-band signal after the band extension processing of the current frequency region to obtain the spectrum of the adjusted high-band signal of the current frequency region includes: Setting the spectrum value of the high-band signal after the band extension processing of the current frequency region to a second preset value to obtain the spectrum of the adjusted high-band signal of the current frequency region; Alternatively, weighted processing is performed on the spectrum of the high-band signal after the band extension processing in the current frequency region to obtain the spectrum of the adjusted high-band signal in the current frequency region.

9. The method according to claim 2, characterized in that: The high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region; The step of adjusting the spectrum of the high-band signal after the band extension process according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal comprises: According to the position information of the tonal component of the current frequency region, the spectrum of the high-band signal of the current frequency region after the band extension processing is adjusted to obtain the spectrum of the adjusted high-band signal of the current frequency region.

10. The method according to claim 9, characterized in that The current frequency region includes at least one sub-band, and the at least one sub-band includes the current sub-band, The step of adjusting the frequency spectrum of the high-band signal of the current frequency region after the frequency band extension processing according to the position information of the tone component of the current frequency region to obtain the frequency spectrum of the adjusted high-band signal of the current frequency region comprises: If the position information of the tone component of the current frequency region meets the second preset condition, the spectrum of the high-band signal after the band extension processing of the current sub-band is adjusted to obtain the spectrum of the adjusted high-band signal of the current sub-band.

11. The method according to claim 10, characterized in that The position information of the tone component in the current frequency region includes the subband number of the subband including the tone component in the current frequency region, and the second preset condition is that the subband number of the subband including the tone component includes the number of the current subband.

12. The method according to claim 10 or 11, characterized in that: The step of adjusting the spectrum of the high-band signal after the frequency band extension processing of the current sub-band to obtain the spectrum of the adjusted high-band signal of the current sub-band comprises: Setting the spectrum value of the high-band signal after the frequency band extension processing of the current sub-band to a second preset value to obtain the spectrum of the high-band signal after adjustment in the current frequency region; Alternatively, weighted processing is performed on the spectrum of the high-band signal after the frequency band extension processing of the current sub-band to obtain the spectrum of the adjusted high-band signal of the current sub-band.

13. The method according to any one of claims 1 to 7 and 9 to 11, characterized in that Before adjusting the spectrum of the high-band signal after the band extension process according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal, the method further comprises: Determine a starting frequency region according to the coding rate of the current frame, wherein the starting frequency region is a frequency region with the smallest sequence number within a frequency range where it is necessary to determine whether to adjust the spectrum of the high-frequency band signal after the frequency band extension processing; The step of adjusting the spectrum of the high-band signal after the band extension process according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal comprises: Starting from the starting frequency region, the spectrum of the high-band signal after the band extension process is adjusted according to the information of the pitch component of the high-band signal to obtain an adjusted spectrum of the high-band signal.

14. The method according to claim 13, characterized in that The determining of the starting frequency region according to the coding rate of the current frame includes: If the encoding rate of the current frame satisfies a third preset condition, the starting frequency region is the first starting frequency region; or, If the encoding rate of the current frame does not satisfy the third preset condition, the starting frequency region is the second starting frequency region, and the frequency ranges corresponding to the first starting frequency region and the second starting frequency region are different.

15. The method according to any one of claims 1 to 7 and 9 to 11, characterized in that Before adjusting the spectrum of the high-band signal after the band extension process according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal, the method further comprises: Determine a first frequency region range according to the coding rate of the current frame, where the first frequency region range is a frequency region range where it is necessary to determine whether to adjust the spectrum of the high-frequency band signal after the frequency band extension processing; The step of adjusting the spectrum of the high-band signal after the band extension process according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal comprises: In the first frequency region, the spectrum of the high-band signal after the band extension process is adjusted according to the information of the tone component of the high-band signal to obtain an adjusted spectrum of the high-band signal.

16. The method according to claim 15, characterized in that Determining the first frequency region range according to the encoding rate of the current frame includes: If the encoding rate of the current frame satisfies a third preset condition, the first frequency region range is a first range; or, If the encoding rate of the current frame does not satisfy the third preset condition, the first frequency region range is the second range, and the frequency range corresponding to the first range is not completely the same as the frequency range corresponding to the second range.

17. The method according to any one of claims 1 to 7 and 9 to 11, characterized in that The high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region; Before adjusting the spectrum of the high-band signal after the band extension process according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal, the method further comprises: Determine, according to the high-frequency band signal spectrum after the frequency band extension processing of the current frequency region, whether the current frequency region belongs to a first frequency region range, where the first frequency region range is a range of a frequency region where it is necessary to determine whether to adjust the high-frequency band signal spectrum after the frequency band extension processing; If the current frequency region belongs to the first frequency region range, adjusting the spectrum of the high-band signal after the band extension processing according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal includes: The frequency spectrum of the high-band signal in the current frequency region is adjusted according to the information of the tone component of the high-band signal to obtain an adjusted frequency spectrum of the high-band signal in the current frequency region.

18. The method according to claim 17, characterized in that If the number of frequency points whose absolute values ​​of spectrum values ​​in the high-band signal spectrum after the band extension processing in the current frequency region are greater than the second threshold is less than the third threshold, the current frequency region belongs to the first frequency region range.

19. A coding and decoding device, characterized in that: include: An acquisition unit, configured to acquire a current frame of an audio signal, wherein the current frame of the audio signal includes a high-frequency band signal and a low-frequency band signal; a processing unit, configured to perform a first encoding according to the high-frequency band signal and the low-frequency band signal to obtain a first encoding parameter of a current frame of the audio signal, wherein the first encoding includes a frequency band extension encoding; The processing unit is further used for performing a second encoding according to the high frequency band signal to obtain a second encoding parameter of the current frame, wherein the second encoding parameter is used for representing information of a tone component of the high frequency band signal; The processing unit is further used to adjust the spectrum of the high-band signal after the band extension processing according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal, wherein the spectrum of the high-band signal after the band extension processing is obtained in the band extension encoding process; The processing unit is further configured to perform a third encoding according to the adjusted spectrum of the high-frequency band signal to obtain a third encoding parameter; The processing unit is further configured to perform code stream multiplexing on the first encoding parameter, the second encoding parameter and the third encoding parameter to obtain an encoding code stream of a current frame of the audio signal.

20. The coding and decoding device according to claim 19, characterized in that: The information of the tone components includes one or more of the following parameters: The identification information of the tone component, the position information of the tone component, the quantity information of the tone component, the amplitude information of the tone component or the energy information of the tone component.

21. The coding and decoding device according to claim 20, characterized in that: The high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region; The processing unit is specifically used for: According to the quantity information of the tonal components of the current frequency region, the spectrum of the high-band signal of the current frequency region after the band extension processing is adjusted to obtain the spectrum of the adjusted high-band signal of the current frequency region.

22. The coding and decoding device according to claim 21, characterized in that: The processing unit is specifically used for: If the quantity information of the tonal components of the current frequency region meets the first preset condition, the spectrum of the high-band signal of the current frequency region after the band extension processing is adjusted to obtain the spectrum of the adjusted high-band signal of the current frequency region.

23. The coding and decoding device according to claim 22, characterized in that: The first preset condition is that the number of the tonal components in the current frequency region is greater than or equal to a first threshold.

24. The coding and decoding device according to claim 23, characterized in that: The high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region; The processing unit is specifically used for: According to the tone component flag information of the current frequency region, the spectrum of the high-frequency band signal after the band expansion processing of the current frequency region is adjusted to obtain the spectrum of the adjusted high-frequency band signal of the current frequency region, and the tone component flag information is used to mark whether there is a tone component in the current frequency region.

25. The coding and decoding device according to claim 24, characterized in that: The processing unit is specifically used for: If the value of the tone component flag information of the current frequency region is a first preset value, adjusting the spectrum of the high-band signal of the current frequency region after the band extension processing to obtain the spectrum of the adjusted high-band signal of the current frequency region, The fact that the value of the tone component flag information of the current frequency region is a first preset value indicates that there is a tone component in the current frequency region.

26. The coding and decoding device according to any one of claims 21 to 25, characterized in that: The processing unit is specifically used for: Setting the spectrum value of the high-band signal after the band extension processing of the current frequency region to a second preset value to obtain the spectrum of the adjusted high-band signal of the current frequency region; Alternatively, weighted processing is performed on the spectrum of the high-band signal after the band extension processing in the current frequency region to obtain the spectrum of the adjusted high-band signal in the current frequency region.

27. The coding and decoding device according to claim 20, characterized in that: The high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region; The processing unit is specifically used for: According to the position information of the tonal component of the current frequency region, the spectrum of the high-band signal of the current frequency region after the band extension processing is adjusted to obtain the spectrum of the adjusted high-band signal of the current frequency region.

28. The coding and decoding device according to claim 27, characterized in that: The current frequency region includes at least one sub-band, and the at least one sub-band includes the current sub-band, The processing unit is specifically used for: If the position information of the tone component of the current frequency region meets the second preset condition, the spectrum of the high-band signal after the band extension processing of the current sub-band is adjusted to obtain the spectrum of the adjusted high-band signal of the current sub-band.

29. The coding and decoding device according to claim 28, characterized in that: The position information of the tone component in the current frequency region includes the serial number of the subband including the tone component in the current frequency region, and the second preset condition is that the serial number of the subband including the tone component includes the serial number of the current subband.

30. The coding and decoding device according to claim 28 or 29, characterized in that: The processing unit is specifically used for: Setting the spectrum value of the high-band signal after the frequency band extension processing of the current sub-band to a second preset value to obtain the spectrum of the high-band signal after adjustment of the current sub-band; Alternatively, weighted processing is performed on the spectrum of the high-band signal after the frequency band extension processing of the current sub-band to obtain the spectrum of the adjusted high-band signal of the current sub-band.

31. The coding and decoding device according to any one of claims 19 to 25 and 27 to 29, characterized in that: The processing unit is also used for: Before adjusting the spectrum of the high-band signal after the band extension processing according to the information of the pitch component of the high-band signal to obtain the spectrum of the adjusted high-band signal, determining a starting frequency region according to the coding rate of the current frame, the starting frequency region being a frequency region with a smallest sequence number within a frequency range where it is necessary to determine whether to adjust the spectrum of the high-band signal after the band extension processing; The step of adjusting the spectrum of the high-band signal after the band extension process according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal comprises: Starting from the starting frequency region, the spectrum of the high-band signal after the band extension process is adjusted according to the information of the pitch component of the high-band signal to obtain an adjusted spectrum of the high-band signal.

32. The coding and decoding device according to claim 31, characterized in that: The processing unit is specifically used for: If the encoding rate of the current frame satisfies a third preset condition, the starting frequency region is the first starting frequency region; or, If the encoding rate of the current frame does not satisfy the third preset condition, the starting frequency region is the second starting frequency region, and the frequency ranges corresponding to the first starting frequency region and the second starting frequency region are different.

33. The coding and decoding device according to any one of claims 19 to 25 and 27 to 29, characterized in that: The processing unit is also used for: Before adjusting the spectrum of the high-band signal after the band extension processing according to the information of the pitch component of the high-band signal to obtain the spectrum of the adjusted high-band signal, determining a first frequency region range according to the coding rate of the current frame, the first frequency region range being the range of the frequency region where it is necessary to determine whether to adjust the spectrum of the high-band signal after the band extension processing; The step of adjusting the spectrum of the high-band signal after the band extension process according to the information of the tone component of the high-band signal to obtain the adjusted spectrum of the high-band signal comprises: In the first frequency region, the spectrum of the high-band signal after the band extension process is adjusted according to the information of the tone component of the high-band signal to obtain an adjusted spectrum of the high-band signal.

34. The coding and decoding device according to claim 33, characterized in that: The processing unit is specifically used for: If the encoding rate of the current frame satisfies a third preset condition, the first frequency region range is a first range; or, If the encoding rate of the current frame does not satisfy the third preset condition, the first frequency region range is the second range, and the frequency range corresponding to the first range is not completely the same as the frequency range corresponding to the second range.

35. The coding and decoding device according to any one of claims 19 to 25 and 27 to 29, characterized in that: The high frequency band corresponding to the high frequency band signal includes at least one frequency region, and the at least one frequency region includes the current frequency region; The processing unit is also used for: Before adjusting the spectrum of the high-band signal after the band extension processing according to the information of the tonal component of the high-band signal to obtain the spectrum of the adjusted high-band signal, determining whether the current frequency region belongs to a first frequency region range according to the spectrum of the high-band signal after the band extension processing of the current frequency region, the first frequency region range being the range of the frequency region where it is necessary to determine whether to adjust the spectrum of the high-band signal after the band extension processing; The processing unit is also used for: If the current frequency region belongs to the first frequency region range, the frequency spectrum of the high frequency band signal of the current frequency region is adjusted to obtain an adjusted frequency spectrum of the high frequency band signal of the current frequency region.

36. The coding and decoding device according to claim 35, characterized in that: The processing unit is specifically used for: If the number of frequency points whose absolute values ​​of spectrum values ​​in the high-band signal spectrum after the band extension processing in the current frequency region are greater than the second threshold is less than the third threshold, the current frequency region belongs to the first frequency region range.

37. A communication device, comprising a processor, wherein the processor is connected to a memory, the memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory, so that the device performs the method according to any one of claims 1 to 18.

38. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed, the method according to any one of claims 1 to 18 is implemented.

39. A chip, characterized in that: Includes processor and interface; The processor is configured to read instructions to execute the audio encoding method according to any one of claims 1 to 18.

40. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a coded code stream obtained according to the method according to any one of claims 1 to 18.

Images