Audio coding method and related apparatus and computer readable storage medium

By using pitch component encoding configuration parameters to decode high-frequency band signals through an audio decoder, the problem of insufficient reconstruction of high-frequency band pitch components in three-dimensional audio encoding and decoding is solved, thus improving the quality of audio signals.

CN113948094BActive Publication Date: 2026-01-02HUAWEI TECH CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202010688152.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-07-16
Publication Date
2026-01-02
Estimated Expiration
2040-07-16

AI Technical Summary

Technical Problem

Existing technologies struggle to efficiently encode and reconstruct high-frequency tonal components in 3D audio encoding and decoding, resulting in insufficient audio signal quality.

Method used

The encoded bitstream is obtained through an audio decoder. The bitstream is demultiplexed using the configuration parameters of the tone component encoding to obtain the tone component parameters of the high-frequency band signal. The high-frequency and low-frequency band signals are then combined for decoding to recover the tone components of the high-frequency band.

Benefits of technology

It improves the quality of decoded audio signals, especially the accuracy of restoring the tonal components of high-frequency signals, thus enhancing the audio experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113948094B_ABST
    Figure CN113948094B_ABST
Patent Text Reader

Abstract

The embodiment of the present application provides an audio decoding method and related device, which can include: obtaining an encoded code stream; performing code stream demultiplexing on the encoded code stream to obtain a first encoding parameter of a current frame of an audio signal; performing code stream demultiplexing on the encoded code stream according to a configuration parameter of tonal component coding to obtain a second encoding parameter of the current frame, wherein the second encoding parameter of the current frame includes a tonal component parameter of the current frame; obtaining a first high-band signal and a first low-band signal of the current frame according to the first encoding parameter; obtaining a second high-band signal of the current frame according to the second encoding parameter and the configuration parameter of the tonal component coding; and obtaining a decoded signal of the current frame according to the first high-band signal, the second high-band signal and the first low-band signal. The scheme of the embodiment of the present application is beneficial to improving the quality of the decoded audio signal.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the field of audio technology, in particular to an audio coding method and a related communication device and a related computer readable storage medium. BACKGROUND

[0002] At present, with the progress of society and the continuous development of technology, users have higher and higher demands for audio services. How to provide users with higher quality services under the condition of limited coding bit rate, or how to provide users with the same quality services with lower coding bit rate, has always been the focus of audio coding research. Some international standard organizations (such as the 3rd Generation Partner Project (3GPP)) are also participating in the formulation of related standards to promote the development of audio services to high quality.

[0003] Three-dimensional audio has become a new trend in the development of audio services because it can bring users a better immersive experience. To achieve three-dimensional audio services, the format of the original audio signal that needs to be compressed and encoded can be divided into: a sound channel-based audio signal format, an object-based audio signal format, a scene-based audio signal format, and a mixed signal format based on any of the above three audio signal formats.

[0004] Among them, no matter which audio signal format, the audio signal that needs to be compressed and encoded by the three-dimensional audio codec contains multiple signals. Usually, the three-dimensional audio codec utilizes the correlation between channels to downmix the multiple signals to obtain a downmixed signal and multi-channel encoding parameters (usually, the number of channels of the downmixed signal is much smaller than that of the input signal, for example, a multi-channel signal is downmixed into a stereo signal). Then, a core encoder is used to encode the downmixed signal. It can also be selected to further downmix the stereo signal into a mono signal and stereo encoding parameters. The number of bits used to encode the downmixed signal and the multi-channel encoding parameters is much smaller than that of independently encoding the multi-channel input signal. In addition, in the core encoder, in order to reduce the coding bit rate, the correlation between different frequency band signals is often further utilized for encoding.

[0005] The principle of utilizing the correlation between different frequency band signals for encoding is to utilize the low frequency band signal to generate a high frequency band signal through spectrum replication or band extension, so as to encode the high frequency band signal with fewer bits, thereby reducing the coding bit rate of the entire encoder. However, in real audio signals, there are often some tone components in the spectrum of the high frequency band that are not similar to the spectrum of the low frequency band. The traditional technology has not been able to efficiently encode and reconstruct these tone components. SUMMARY

[0006] The embodiments of the present application provide a communication method and related device and computer readable storage medium.

[0007] The first aspect of the embodiments of the present application provides an audio decoding method, comprising:

[0008] The audio decoder acquires an encoded bitstream; performs bitstream demultiplexing on the encoded bitstream to obtain first encoding parameters of a current frame of an audio signal; performs bitstream demultiplexing on the encoded bitstream according to configuration parameters of tonal component coding to obtain second encoding parameters of the current frame, the second encoding parameters of the current frame comprising tonal component parameters of the current frame; acquires first high-band signals and first low-band signals of the current frame according to the first encoding parameters; acquires second high-band signals of the current frame according to the second encoding parameters and the configuration parameters of tonal component coding; and acquires a decoded signal of the current frame according to the first high-band signals, the second high-band signals and the first low-band signals.

[0009] The audio codec of the present application can be an Enhanced Voice Service (EVS) audio codec proposed by 3GPP, a Unified Speech and Audio Coding (USAC) audio codec, or a High-Efficiency Advanced Audio Coding (HE-AAC) audio codec of Moving Picture Experts Group (MPEG), and the like. Of course, the audio codec of the present application is not limited to the above-mentioned example types of audio codec.

[0010] In the example audio decoding scheme of the embodiments of the present application, the audio decoder can decode the encoded bitstream to obtain tonal component parameters of the current frame, and acquire second high-band signals of the current frame according to the tonal component parameters and the configuration parameters of tonal component coding. Since the second high-band signals carry tonal component information of the high frequency part, it is beneficial to more accurately restore the tonal components in the frequency range corresponding to the second high-band signals, thereby improving the quality of the decoded audio signal.

[0011] In some possible implementations, the audio decoding method can further comprise: acquiring a configuration bitstream; and performing bitstream demultiplexing on the configuration bitstream to obtain decoder configuration parameters, the decoder configuration parameters comprising the configuration parameters of tonal component coding, the configuration parameters of tonal component coding being used to indicate the number of frequency regions of tonal component coding and the sub-band width of each frequency region. For example, the configuration parameters of tonal component coding can comprise a number parameter of frequency regions of tonal component coding and a sub-band width parameter of each frequency region, and the like.

[0012] The configuration parameters can be obtained separately for each frame or can be the same for multiple frames. That is, the configuration bitstream can be obtained separately for each frame or can be the same for multiple frames.

[0013] When the configuration parameters can be obtained separately for each frame, the number of frequency regions for tonal component coding in the current frame can be the same as or different from the number of frequency regions for tonal component coding in the previous frame, and the subband width for tonal component coding of at least one frequency region in the current frame can be the same as or different from the subband width for tonal component coding of at least one frequency region in the previous frame.

[0014] When the configuration parameters are the same for multiple frames, the number of frequency regions for tonal component coding in the current frame can be the same as the number of frequency regions for tonal component coding in the previous frame, and the subband width for tonal component coding of at least one frequency region in the current frame can be the same as the subband width for tonal component coding of at least one frequency region in the previous frame (the current frame and the previous frame share the same configuration parameters).

[0015] It can be understood that, by using the tonal component coding configuration parameters included in the decoder configuration parameters in the configuration bitstream, the number of frequency regions for tonal component coding and the subband division manner in the frequency regions can be flexibly configured as needed.

[0016] In some possible implementation manners, the code stream demultiplexing of the configuration bitstream to obtain the decoder configuration parameters can include: obtaining, from the configuration bitstream, a number of frequency regions for tonal component coding parameter and a same subband width usage flag parameter, where the same subband width usage flag parameter is used to indicate whether the same subband width is used for different frequency regions; and obtaining, from the configuration bitstream, a subband width for tonal component coding of the at least one frequency region parameter according to the number of frequency regions for tonal component coding parameter and the same subband width usage flag parameter.

[0017] In some possible implementation manners, the obtaining, from the configuration bitstream, the subband width for tonal component coding of the at least one frequency region parameter according to the number of frequency regions for tonal component coding parameter and the same subband width usage flag parameter includes:

[0018] In a case where the flag parameter of using the same subband width is set as a value S1, the common subband width parameter (which can or can not be common to the current frame and other frames) of the at least one frequency region for tonal component coding is obtained from the configuration bitstream, and the subband width parameter of the atonal component coding of the at least one frequency region is equal to the common subband width parameter or is transformed based on the common subband width parameter (the transformation manner can be, for example, scaling up or down, and can also be other transformation manners satisfying requirements).

[0019] Or,

[0020] In a case where the flag parameter of using the same subband width is set as a value S2, the subband width parameter of the at least one frequency region for tonal component coding (which can or can not be common to the current frame and other frames) is obtained from the configuration bitstream, and the number of the subband width parameters of the at least one frequency region for tonal component coding is equal to the number of the frequency regions for tonal component coding indicated by the number parameter of the frequency regions for tonal component coding or is transformed based on the number parameter of the frequency regions for tonal component coding (the transformation manner can be, for example, scaling up or down, and can also be other transformation manners satisfying requirements).

[0021] It can be understood that, by using the flag parameter of using the same subband width, the subband width of the frequency region for tonal component coding and the like can be flexibly configured based on requirements.

[0022] In some possible implementation manners, the tonal component parameter of the current frame includes one or more of the following parameters: the frame-level tonal component flag parameter of the current frame, the frequency region-level tonal component flag parameter of the at least one frequency region of the current frame, the noise floor parameter of the at least one frequency region of the current frame, the position number information multiplexing parameter of the tonal component, the position number parameter of the tonal component, and the amplitude or energy parameter of the tonal component.

[0023] In some possible implementation manners, the configuration parameter of the tonal component coding includes a number parameter of the frequency region for tonal component coding; and the bitstream demultiplexing of the encoded bitstream according to the configuration parameter of the tonal component coding to obtain the second encoding parameter of the current frame of the audio signal includes: obtaining the frame-level tonal component flag parameter of the current frame from the encoded bitstream.

[0024] In a case where the frame-level tonal component flag parameter of the current frame is set as a value S3, tonal component parameters of N1 frequency regions of the current frame are obtained from the encoded bitstream, where the N1 is equal to the number of frequency regions of the tonal component coding of the current frame indicated by the number parameter of the tonal component coding frequency regions of the current frame.

[0025] In some possible implementation manners, the obtaining of the tonal component parameters of the N1 frequency regions of the current frame from the encoded bitstream comprises: obtaining a frequency region-level tonal component flag parameter of a current frequency region of the N1 frequency regions of the current frame from the encoded bitstream.

[0026] In a case where the frequency region-level tonal component flag parameter of the current frequency region of the current frame is set as a value S4, one or more of the following tonal component parameters of the current frequency region of the current frame are obtained from the encoded bitstream: a noise floor parameter, a tonal component position number information multiplexing parameter, a tonal component position number parameter, and a tonal component amplitude or energy parameter.

[0027] In some possible implementation manners, the obtaining of the tonal component position number information multiplexing parameter and the tonal component position number parameter of the current frequency region of the current frame from the encoded bitstream comprises: obtaining the tonal component position number information multiplexing parameter of the current frequency region of the current frame from the encoded bitstream.

[0028] In a case where the tonal component position number information multiplexing parameter of the current frequency region of the current frame is set as a value S5, the tonal component position number parameter of the current frequency region of the current frame is equal to the tonal component position number parameter of the current frequency region of a previous frame of the current frame; or the tonal component position number parameter of the current frequency region of the current frame is obtained based on a transformation of the tonal component position number parameter of the current frequency region of the previous frame of the current frame.

[0029] In a case where the tonal component position number information multiplexing parameter of the current frequency region of the current frame is set as a value S6, the tonal component position number parameter of the current frequency region of the current frame is obtained from the encoded bitstream.

[0030] It can be understood that, by using the tonal component position number information multiplexing parameter, the control of whether the tonal component position number information is multiplexed can be conveniently implemented, and in a case where the tonal component position number information is multiplexed, the bit transmission amount can also be reduced, thereby saving transmission resources.

[0031] In some possible implementation manners, the obtaining, from the encoded bitstream, the position number parameter of the tonal component of the current frequency region of the current frame comprises: obtaining, according to the width information of the current frequency region of the current frame and a subband width parameter of tonal component coding, a bit number occupied by the position number parameter of the tonal component of the current frequency region of the current frame; and obtaining, from the encoded bitstream, the position number parameter of the tonal component of the current frequency region of the current frame according to the bit number occupied by the position number parameter of the tonal component of the current frequency region of the current frame.

[0032] In some possible implementation manners, the width information of the current frequency region is determined according to a distribution of tonal component coding frequency regions, and the distribution of the tonal component coding frequency regions is determined according to the number parameter of the tonal component coding frequency regions.

[0033] In some possible implementation manners, the obtaining, from the encoded bitstream, the amplitude or energy parameter of the tonal component of at least one frequency region of the current frame comprises: if the frequency region level tonal component flag parameter of the current frequency region of the current frame is a set value S4, obtaining, from the encoded bitstream, the amplitude or energy parameter of the tonal component of the current frequency region of the current frame according to the position number parameter of the tonal component of the current frequency region of the current frame.

[0034] The second aspect of the present application provides an audio decoder, comprising:

[0035] An obtaining unit is configured to obtain an encoded bitstream.

[0036] A decoding unit is configured to: perform bitstream demultiplexing on the encoded bitstream to obtain a first encoding parameter of a current frame of an audio signal; perform bitstream demultiplexing on the encoded bitstream according to a configuration parameter of tonal component coding to obtain a second encoding parameter of the current frame of the audio signal, the second encoding parameter of the current frame comprising a tonal component parameter of the current frame; obtain a first high-band signal and a first low-band signal of the current frame according to the first encoding parameter; obtain a second high-band signal of the current frame according to the second encoding parameter and the configuration parameter of tonal component coding; and obtain a decoded signal of the current frame according to the first high-band signal, the second high-band signal and the first low-band signal.

[0037] In some possible implementation manners, the obtaining unit is further configured to obtain a configuration bitstream; and the decoding unit is further configured to perform bitstream demultiplexing on the configuration bitstream to obtain a decoder configuration parameter, wherein the decoder configuration parameter comprises the configuration parameter of tonal component coding, and the configuration parameter of tonal component coding is used to indicate a number of tonal component coding frequency regions and subband widths of respective frequency regions.

[0038] In some possible implementation, the decoding unit code stream demultiplexes the configuration bitstream to obtain decoder configuration parameters, including: obtaining a number of tonal component coded frequency regions parameter and a same subband width usage flag parameter from the configuration bitstream, wherein the same subband width usage flag parameter is used to indicate whether different frequency regions use the same subband width; and obtaining a tonal component coded subband width parameter of the at least one frequency region from the configuration bitstream according to the number of tonal component coded frequency regions parameter and the same subband width usage flag parameter.

[0039] In some possible implementation, the decoding unit obtains the tonal component coded subband width parameter of the at least one frequency region from the configuration bitstream according to the number of tonal component coded frequency regions parameter and the same subband width usage flag parameter, including:

[0040] In a case where the same subband width usage flag parameter is a set value S1, a common subband width parameter is obtained from the configuration bitstream, the tonal component coded subband width parameter of the at least one frequency region is equal to the common subband width parameter, or the tonal component coded subband width parameter of the at least one frequency region is transformed based on the common subband width parameter;

[0041] Or,

[0042] In a case where the same subband width usage flag parameter is a set value S2, the tonal component coded subband width parameter of the at least one frequency region is obtained from the configuration bitstream, wherein a number of the tonal component coded subband width parameter of the at least one frequency region is equal to a number of the tonal component coded frequency regions indicated by the number of tonal component coded frequency regions parameter, or the number of the tonal component coded subband width parameter of the at least one frequency region is transformed based on the number of tonal component coded frequency regions parameter.

[0043] In some possible implementation, the tonal component parameters of the current frame include one or more of the following parameters: a frame level tonal component flag parameter of the current frame, a frequency region level tonal component flag parameter of the at least one frequency region of the current frame, a noise floor parameter of the at least one frequency region of the current frame, a tonal component position number information multiplex parameter, a tonal component position number parameter, a tonal component amplitude or energy parameter.

[0044] In some possible implementation manners, the configuration parameter of the tonal component coding includes a number-of-frequency-region parameter of the tonal component coding; and the decoding unit performs bitstream demultiplexing on the encoded bitstream according to the configuration parameter of the tonal component coding to obtain a second coding parameter of the current frame of the audio signal, including: obtaining, from the encoded bitstream, a frame-level tonal component flag parameter of the current frame.

[0045] In a case where the frame-level tonal component flag parameter of the current frame is a set value S3, obtaining, from the encoded bitstream, tonal component parameters of N1 frequency regions of the current frame, where the N1 is equal to a number of frequency regions of the tonal component coding of the current frame indicated by the number-of-frequency-region parameter of the tonal component coding of the current frame.

[0046] In some possible implementation manners, the decoding unit obtains, from the encoded bitstream, the tonal component parameters of the N1 frequency regions of the current frame, including:

[0047] obtaining, from the encoded bitstream, a frequency-region-level tonal component flag parameter of a current frequency region of the N1 frequency regions of the current frame;

[0048] In a case where the frequency-region-level tonal component flag parameter of the current frequency region of the current frame is a set value S4, obtaining, from the encoded bitstream, one or more of the following tonal component parameters: a noise floor parameter of the current frequency region of the current frame, a position number information multiplex parameter of the tonal component, a position number parameter of the tonal component, and an amplitude or energy parameter of the tonal component.

[0049] In some possible implementation manners, the decoding unit obtains, from the encoded bitstream, the position number information multiplex parameter of the tonal component and the position number parameter of the tonal component of the current frequency region of the current frame, including: obtaining, from the encoded bitstream, the position number information multiplex parameter of the current frequency region of the current frame;

[0050] In a case where the position number information multiplex parameter of the current frequency region of the current frame is a set value S5, the position number parameter of the tonal component of the current frequency region of the current frame is equal to a position number parameter of the tonal component of the current frequency region of a previous frame of the current frame; or the position number parameter of the tonal component of the current frequency region of the current frame is obtained based on a transformation of the position number parameter of the tonal component of the current frequency region of the previous frame of the current frame.

[0051] In a case where the position number information multiplex parameter of the current frequency region of the current frame is a set value S6, obtaining, from the encoded bitstream, the position number parameter of the tonal component of the current frequency region of the current frame.

[0052] In some possible implementation manners, the decoding unit obtains, from the coded bitstream, the position number parameter of the tonal component of the current frequency region of the current frame, including:

[0053] According to the width information of the current frequency region of the current frame and the subband width parameter of the tonal component coding, a bit number occupied by the position number parameter of the tonal component of the current frequency region of the current frame is obtained; and according to the bit number occupied by the position number parameter of the tonal component of the current frequency region of the current frame, the position number parameter of the tonal component of the current frequency region of the current frame is obtained from the coded bitstream.

[0054] In some possible implementation manners, the width information of the current frequency region is determined by a distribution of the tonal component coding frequency region, and the distribution of the tonal component coding frequency region is determined by the number parameter of the tonal component coding frequency region.

[0055] In some possible implementation manners, the decoding unit obtains, from the coded bitstream, the amplitude or energy parameter of the tonal component of at least one frequency region of the current frame, including:

[0056] If the frequency region level tonal component flag parameter of the current frequency region of the current frame is a set value S4, the amplitude or energy parameter of the tonal component of the current frequency region of the current frame is obtained from the coded bitstream according to the position number parameter of the tonal component of the current frequency region of the current frame.

[0057] The third aspect of the embodiments of the present application provides an audio decoder, which can include: a processor, the processor and a memory are coupled, and the memory stores a program, when the program stored in the memory is executed by the processor, the first aspect provides any one of the methods.

[0058] The fourth aspect of the embodiments of the present application provides a communication system, including: an audio encoder and an audio decoder; the audio decoder is any one of the audio decoders provided by the embodiments of the present application.

[0059] The fifth aspect of the embodiments of the present application provides a computer readable storage medium, including a program, when the program runs on a computer, the computer executes any one of the methods provided by the first aspect.

[0060] The sixth aspect of the embodiments of the present application provides a network device, including a processor and a memory, the processor is coupled with the memory, and is used for reading and executing instructions stored in the memory, and realizing any one of the methods provided by the first aspect.

[0061] The network device is, for example, a chip or a system on chip.

[0062] The seventh aspect of the embodiment of the present application provides a computer readable storage medium, and the computer readable storage medium stores an encoded code stream.

[0063] The eighth aspect of the embodiment of the present application provides a computer program product, and the computer program product comprises a computer program. BRIEF DESCRIPTION OF DRAWINGS

[0064] The drawings needed to be used in the description of the embodiments or prior art will be briefly introduced as follows.

[0065] Figure 1 -A And Figure 1 -B The scene schematic diagram to which the audio coding and decoding scheme provided by the embodiment of the present application is applied to an audio terminal.

[0066] Figure 1 -C And Figure 1 -D The schematic diagram of audio coding and decoding of a network device in a wired or wireless network provided by the embodiment of the present application.

[0067] Figure 1 -E The schematic diagram of audio coding and decoding in audio communication provided by the embodiment of the present application.

[0068] Figure 1 -F And Figure 1 -G The schematic diagram of multi-channel coding and decoding of a network device in a wired or wireless network provided by the embodiment of the present application.

[0069] Figure 1 -H The schematic diagram of audio coding and decoding applied to virtual reality service provided by the embodiment of the present application.

[0070] Figure 2 The flow schematic diagram of an audio coding method provided by the embodiment of the present application.

[0071] Figure 3 The flow schematic diagram of a method for obtaining a second coding parameter of a current frame provided by the embodiment of the present application.

[0072] Figure 4-A The flow schematic diagram of an audio decoding method provided by the embodiment of the present application.

[0073] Figure 4-A The schematic diagram of combination of a high-frequency signal and a low-frequency signal provided by the embodiment of the present application.

[0074] Figure 4-B The schematic diagram of an audio decoder provided by the embodiment of the present application.

[0075] Figure 4-B Another schematic diagram of an audio decoder provided by an embodiment of the present application.

[0076] Figure 5 A schematic diagram of a communication system provided by an embodiment of the present application.

[0077] Figure 6 A schematic diagram of a network device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0078] The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.

[0079] The terms "first", "second", etc. in the specification and claims of the present application and the above drawings are used to distinguish different objects, rather than to describe a specific order.

[0080] Referring to Figure 7 , the network architecture to which the audio coding and decoding scheme of the present application can be applied will be introduced below. The audio coding and decoding scheme can be applied to an audio terminal (for example, a wired or wireless communication terminal) or a network device in a wired or wireless network.

[0081] Among them, Figure 8 and Figures 1 -A to 1 -G The scenario in which the audio coding and decoding scheme is applied to an audio terminal is shown, where the specific product form of the audio terminal can be Figure 1 -A terminal 1, terminal 2 or terminal 3, etc., but is not limited thereto. For example, in audio communication, the audio collector in the sending terminal can collect audio signals, the stereo encoder can perform stereo encoding on the audio signals collected by the audio collector, the channel encoder can perform channel encoding on the stereo encoded signals obtained by the stereo encoder to obtain a code stream, and the code stream is transmitted through a wireless network or a wired network. Correspondingly, the channel decoder in the receiving terminal performs channel decoding on the received code stream, and then the stereo decoder decodes the stereo signals, and then the audio playback device can play the audio.

[0082] Referring to Figure 1 -B and Figure 1 -A , if the network device in the wired or wireless network needs to realize transcoding, the network device can perform corresponding stereo encoding and decoding processing.

[0083] The stereo encoding and decoding process can be part of a multi-channel codec. For example, multi-channel encoding of the acquired multi-channel signal can be performed by mixing down the acquired multi-channel signal to obtain a stereo signal, and encoding the obtained stereo signal. At the decoding end, the multi-channel signal is obtained by decoding the multi-channel signal encoded bitstream and mixing up the decoded stereo signal. Therefore, the stereo encoding and decoding scheme can also be applied to the multi-channel codec in the communication module of the network device in the terminal, wired or wireless network.

[0084] Figure 1 -C For example, the audio acquisition device in the sending terminal can acquire an audio signal in an audio communication, the multi-channel encoder can perform multi-channel encoding on the audio signal acquired by the audio acquisition device, the channel encoder can perform channel encoding on the multi-channel encoded signal obtained by the multi-channel encoder to obtain a bitstream, and the bitstream can be transmitted through a wireless network or a wired network. Correspondingly, the channel decoder in the receiving terminal can perform channel decoding on the received bitstream, and then the multi-channel decoder can decode the multi-channel signal, which can then be played back by the audio playback device.

[0085] Referring to Figure 1 -D and Figure 1 -E If the network device in the wired or wireless network needs to implement transcoding, the network device can perform corresponding multi-channel encoding and decoding.

[0086] Referring to Figure 1 -F The audio encoding and decoding scheme of the present application can also be applied to the audio encoding and decoding module in the virtual reality (VR streaming) service.

[0087] For example, the processing flow of the audio signal from end to end can be as follows: the audio signal A is preprocessed by the acquisition module (Acquisition) after the acquisition module, the preprocessing operation includes filtering out the low frequency part in the signal, usually taking 20Hz or 50Hz as the demarcation point, extracting the azimuth information in the signal, then performing encoding processing (Audio encoding) and packaging (File / Segment encapsulation), and then sending (Delivery) to the decoding end. Correspondingly, the decoding end first performs unpacking (File / Segment decapsulation), then decoding (Audio decoding), performs binaural rendering (Audio rendering) processing on the decoded signal, and maps the rendered signal to the listener's headphones (headphones), which can be independent headphones or headphones on the HTC VIVE glasses device.

[0088] Specifically, the actual products to which the audio coding scheme of the present application can be applied can include wireless access network equipment, media gateway of core network, transcoding equipment, media resource server, mobile terminal, fixed network terminal, etc. It can also be applied to the audio codec in VR streaming service.

[0089] The audio codec of the present application can be the audio codec of Enhanced Voice Service (EVS) proposed by 3GPP, or the audio codec of Unified Speech and Audio Coding (USAC), or the audio codec of High-Efficiency Advanced Audio Coding (HE-AAC) of Moving Picture Experts Group (MPEG), etc. Of course, the audio codec of the present application is not limited to the above-mentioned example types of audio codec.

[0090] Some audio coding schemes will be specifically introduced below.

[0091] Referring to Figure 1 -G , Figure 1 -H A flowchart of an audio encoding method provided by an embodiment of the present application is shown. The audio encoding method can include:

[0092] 201. Obtain the configuration parameters of the audio codec, which include the configuration parameters of the pitch component encoding.

[0093] In the process of pitch component encoding, for example, the high frequency band of the audio frame can be divided into K frequency regions (tiles), and each frequency region can be divided into one or more subbands. The number of subbands in different frequency regions can be the same, partially the same, or completely different. The acquisition of the pitch component information can be performed in units of frequency regions.

[0094] When the acquisition of the pitch component information is performed in units of frequency regions, the configuration parameters of the pitch component encoding can include the frequency region number parameter of the pitch component encoding, and can also include the subband width parameter of the pitch component encoding.

[0095] The subband width parameter of the pitch component encoding can be represented by two parameters, i.e., a flag parameter indicating whether the same subband width is used, and a subband width parameter of the pitch component encoding of each frequency region.

[0096] The frequency region number parameter of the pitch component encoding indicates how many frequency regions in the high frequency band of the audio signal are detected, encoded, and reconstructed in terms of the pitch component.

[0097] The same subband width using flag parameter is used to indicate whether the same subband width is used in each frequency region where the tonal component coding is performed. Specifically, when the same subband width using flag parameter indicates that the same subband width is used in each frequency region where the tonal component coding is performed, the same subband width is used in each frequency region where the tonal component coding is performed. When the same subband width using flag parameter indicates that the same subband width is not used in each frequency region where the tonal component coding is performed, the same subband width is not used in some or any two frequency regions where the tonal component coding is performed.

[0098] The subband width parameter of the tonal component coding in a frequency region of the frequency regions is used to indicate the frequency width of the subbands included in the frequency region (the frequency width can be the number of frequency points of the subbands, and the frequency width of each subband in the same frequency region is the same).

[0099] The configuration parameter of the tonal component coding can be obtained by pre-setting or table lookup.

[0100] The configuration parameter can be obtained frame by frame or the same configuration parameter can be used for multiple frames.

[0101] When the configuration parameter is obtained frame by frame, the number of frequency regions of the tonal component coding in the current frame can be the same as or different from the number of frequency regions of the tonal component coding in the previous frame, and the subband width parameter of the tonal component coding in at least one frequency region of the current frame can be the same as or different from the subband width parameter of the tonal component coding in at least one frequency region of the previous frame.

[0102] When the same configuration parameter is used for multiple frames, the number of frequency regions of the tonal component coding in the current frame can be the same as the number of frequency regions of the tonal component coding in the previous frame, and the subband width parameter of the tonal component coding in at least one frequency region of the current frame can be the same as the subband width parameter of the tonal component coding in at least one frequency region of the previous frame (the current frame and the previous frame use the same configuration parameter).

[0103] 202. Obtain a current frame of an audio signal, wherein the current frame includes a high-band signal and a low-band signal.

[0104] The current frame can be any frame in the audio signal, and the current frame can include a high-band signal and a low-band signal. The high-band signal and the low-band signal can be determined by a frequency band threshold, i.e., a signal higher than the frequency band threshold is a high-band signal, and a signal lower than the frequency band threshold is a low-band signal. The frequency band threshold can be determined according to a transmission bandwidth, a data processing capability of an encoding component, and a data processing capability of a decoding component, and is not limited herein.

[0105] It can be understood that the high-band signal and the low-band signal are relative, e.g., a signal lower than a certain frequency threshold is a low-band signal, and a signal higher than the frequency threshold is a high-band signal (wherein the signal corresponding to the frequency threshold can be classified into a low-band signal or a high-band signal). The frequency threshold can be different according to different bandwidths of the current frame. For example, when the current frame is a wideband signal with a signal bandwidth of 0-8 kHz, the frequency threshold can be 4 kHz; and when the current frame is an ultrawideband signal with a signal bandwidth of 0-16 kHz, the frequency threshold can be 8 kHz.

[0106] It should be noted that in the embodiments of the present application, the high-band signal can be part or all of the signals in the high-frequency region. Specifically, the high-frequency region can be different according to different signal bandwidths of the current frame, and can also be different according to different frequency thresholds. For example, when the signal bandwidth of the current frame is 0-8 kHz, and the frequency threshold is 4 kHz, the high-frequency region is 4-8 kHz, and the high-band signal can be a signal covering the entire high-frequency region of 4-8 kHz, or can be a signal covering only part of the high-frequency region, e.g., the high-band signal can be 4-7 kHz, 5-8 kHz, 5-7 kHz, or 4-6 kHz and 7-8 kHz (i.e., the high-band signal can be discontinuous in the frequency domain), etc. For example, when the signal bandwidth of the current frame is 0-16 kHz, and the frequency threshold is 8 kHz, the high-frequency region is 8-16 kHz, and the high-band signal can be a signal covering the entire high-frequency region of 8-16 kHz, or can be a signal covering only part of the high-frequency region, e.g., the high-band signal can be 8-15 kHz, 9-16 kHz, 9-15 kHz, or (8-10 kHz+11-16 kHz, i.e., the high-band signal can be continuous or discontinuous in the frequency domain), etc. It can be understood that the frequency range covered by the high-band signal can be set as needed, or adaptively determined according to the frequency range to be encoded, e.g., adaptively determined according to the frequency range to be selected for tonal component.

[0107] 203. obtaining a first encoding parameter according to the high-band signal and the low-band signal of the current frame.

[0108] The first encoding parameter can specifically include a time-domain noise shaping parameter, a frequency-domain noise shaping parameter, a spectral quantization parameter, a band extension parameter, and the like.

[0109] 204. obtaining a second encoding parameter of the current frame according to the configuration parameter of the tonal component coding and the high-band signal of the current frame, the second encoding parameter including a tonal component parameter of the high-band signal of the current frame, the tonal component parameter being used to represent tonal component information of the high-band signal of the current frame, the tonal component information including position information, quantity information, and amplitude information or energy information of the tonal component. In some embodiments, the tonal component information can further include noise floor information of a frequency region.

[0110] In general, the process of obtaining the second encoding parameter of the current frame according to the high-band signal can be performed according to frequency region division and / or subband division of the high band. The high band corresponding to the high-band signal can include at least one frequency region, and one frequency region can include at least one subband.

[0111] In the configuration parameter of the tonal component coding, the frequency region quantity parameter of the tonal component coding is used to represent quantity information of frequency regions subjected to tonal component coding in the high band corresponding to the high-band signal. For example, if the frequency region quantity parameter of the tonal component coding is 3, it indicates that three frequency regions in the high band corresponding to the high-band signal are subjected to tonal component coding. The three frequency regions can be three specified frequency regions in all frequency regions of the high band, or selected from all frequency regions of the high band according to a preset rule.

[0112] In the configuration parameter of the tonal component coding, the same subband width flag parameter and the subband width parameter of the tonal component coding of each frequency region are used to represent width information (i.e., quantity of frequency points included) of subbands in each frequency region subjected to tonal component coding. In the tonal component coding method provided in the embodiments of the present application, at most one tonal component is coded in each subband of each frequency region. Therefore, the subband width parameter of the tonal component coding of a certain frequency region determines the maximum quantity of tonal components that can be coded in the frequency region.

[0113] 205. multiplexing the configuration parameter of the tonal component coding to obtain a configuration bitstream.

[0114] Since the configuration parameter can be obtained separately for each frame or the same configuration parameter can be shared by multiple frames (i.e., the configuration bitstream can be obtained separately for each frame or the same configuration bitstream can be shared by multiple frames), the configuration bitstream can be generated separately for each frame or a configuration bitstream shared by multiple frames can be generated for multiple frames.

[0115] It can be understood that, in the case that multiple frames share the same configuration parameter (i.e., multiple frames share the same configuration bitstream), if the current frame and another frame share the same configuration parameter, a configuration parameter of the tonal component coding of the previous frame can also be referred to as a configuration parameter of the tonal component coding of the current frame, and a configuration parameter of the tonal component coding of the current frame can also be referred to as a configuration parameter of the tonal component coding of the previous frame.

[0116] 206. The first encoding parameter and the second encoding parameter are bitstream multiplexed to obtain an encoded bitstream.

[0117] It can be seen that, since the second encoding parameter includes the tonal component parameter of the high-band signal of the current frame, the tonal component parameter is used to represent the tonal component information of the high-band signal of the current frame, therefore the audio decoder can decode the encoded bitstream to obtain the tonal component parameter of the current frame, and further obtain the second high-band signal of the current frame according to the tonal component parameter and the configuration parameter of the tonal component coding, since the second high-band signal carries the tonal component information of the high frequency part, therefore it is beneficial to more accurately restore the tonal component in the frequency range corresponding to the second high-band signal, thereby improving the quality of the decoded audio signal.

[0118] Referring to Figure 2 , Figure 2 A flowchart of a method for obtaining a second encoding parameter of a current frame provided by an embodiment of the present application.

[0119] The method for obtaining a second encoding parameter of a current frame can include:

[0120] 301. According to the configuration parameter of the tonal component coding and the high-band signal of a current frequency region in at least one frequency region of the current frame, obtain the noise floor parameter, the position quantity parameter of the tonal component and the amplitude or energy parameter of the tonal component of the current frequency region of the current frame.

[0121] According to the quantity parameter of the frequency region of the tonal component coding, the sub-band width parameter of each frequency region, and the high-band signal of a current frequency region in at least one frequency region of the current frame, the quantity information of the tonal component, the position information of the tonal component, the amplitude information or energy information of the tonal component, and the noise floor information in each frequency region can be obtained respectively.

[0122] According to the quantity information of the tonal component, the position information of the tonal component, the amplitude information or energy information of the tonal component, and the noise floor information in each frequency region, the position quantity parameter of the tonal component, the amplitude or energy parameter of the tonal component, and the noise floor parameter in each frequency region are obtained.

[0123] The position number parameter of the tonal component can further comprise a position number information multiplexing parameter. The position number information multiplexing parameter can be determined as follows: if the position number parameter of the tonal component of the current frequency region in at least one frequency region of the current frame is the same as the position number parameter of the tonal component of the current frequency region of the previous frame of the current frame, the position number information multiplexing parameter of the current frequency region of the current frame can be set as S5, otherwise, it can be set as S6. S5 is not equal to S6, for example, S5 = 1 and S6 = 0, or S5 = 0 and S6 = 1.

[0124] The specific method for determining the noise floor parameter of the current frequency region, the position number parameter of the tonal component of the current frequency region, and the amplitude parameter or energy parameter of the tonal component of the current frequency region according to the high-band signal of the current frequency region is not limited in the present application.

[0125] 302. Obtain the tonal component flag parameter of the frequency region level of the current frequency region of the current frame according to the number information of the tonal component of the current frequency region of the current frame.

[0126] For example, if the number information of the tonal component of the current frequency region of the current frame is greater than zero, the tonal component flag parameter of the frequency region level of the current frequency region is set as S4, otherwise, it is set as S8. S4 is not equal to S8, for example, S4 = 1 and S8 = 0, or S4 = 0 and S8 = 1.

[0127] 303. Obtain the frame-level tonal component flag parameter of the current frame according to the tonal component flag parameter of the frequency region level of at least one frequency region of the current frame.

[0128] For example, if the tonal component flag parameter of the frequency region level of at least one frequency region of the current frame is not S8, the frame-level tonal component flag parameter of the current frame is set as S3, otherwise, it is set as S7. S3 is not equal to S7, for example, S3 = 1 and S7 = 0, or S3 = 0 and S7 = 1.

[0129] The following examples the specific parameters that can be included in the configuration parameters of the tonal component encoding. The configuration parameters of the tonal component encoding can comprise, for example:

[0130] a. The number parameter of the frequency region of the tonal component encoding, which can be denoted as num_tiles_recon.

[0131] b. The flag parameter of using the same subband width, which can be denoted as flag_same_res. The flag parameter of using the same subband width is used to indicate whether the same subband width is used in different frequency regions.

[0132] c. The sub-band width parameters of the tonal component coding for each frequency region, denoted as tone_res[N1], where N1 is the number of frequency regions of the tonal component coding.

[0133] The following is an example description of the bitstream generation of the configuration parameters of the tonal component coding (using the same sub-band width for each frequency region, i.e., the flag parameter flag_same_res is S1):

[0134] extentElementConfigLength = 1

[0135] extentElementConfigPayload[0] = (num_tiles_recon - 1) << 5

[0136] flag_same_res = 1

[0137] extentElementConfigPayload[0] += (flag_same_res) << 4

[0138] tone_res_common = tone_res[0]

[0139] extentElementConfigPayload[0] += (tone_res_common / 8 - 1) << 2

[0140] where extentElementConfigLength represents the length (in bytes) of the configuration bitstream of the tonal component coding.

[0141] extentElementConfigPayload represents the configuration bitstream array of the tonal component coding, and tone_res_common represents the common sub-band width parameter of each frequency region.

[0142] For example, in the configuration bitstream generation, the number of frequency regions parameter num_tiles_recon of the tonal component coding can occupy 3 bits or other bit numbers, the flag parameter flag_same_res of using the same sub-band width can occupy 1 bit or other bit numbers, and the common sub-band width parameter tone_res_common can occupy 2 bits or other bit numbers.

[0143] The following is an example description of the specific parameters that can be included in the encoding bitstream parameters of the tonal component coding. The encoding bitstream parameters of the tonal component coding can include, for example:

[0144] a. A frame-level tonal component flag parameter, denoted as tone_flag.

[0145] b. A frequency region-level tonal component flag parameter for each frequency region, denoted as tone_flag_tile.

[0146] c. A position number parameter of the tonal component for each frequency region, denoted as tone_pos.

[0147] d. A position number information multiplexing parameter of the tonal component for each frequency region, denoted as is_same_pos.

[0148] e. An amplitude or energy parameter of the tonal component for each frequency region, denoted as tone_val_q.

[0149] f. A noise floor parameter for each frequency region, denoted as noise_floor.

[0150] A possible generation manner of the encoded bitstream of the tonal component coding is described as follows:

[0151] If the frame-level tonal component flag parameter tone_flag of the current frame is S7, i.e., there is no tonal component in the current frame, the frame-level tonal component flag parameter tone_flag of the current frame is written into the bitstream, and no other parameter of the tonal component coding of the current frame is written into the bitstream. That is, if there is no tonal component in the current frame (tone_flag is equal to S7), the encoded bitstream of the tonal component coding of the current frame only contains the frame-level tonal component flag parameter tone_flag of the current frame.

[0152] If the frame-level tonal component flag parameter tone_flag of the current frame is S3, i.e., there is a tonal component in the current frame, the frame-level tonal component flag parameter tone_flag of the current frame is written into the bitstream, and then the tonal component parameters of each frequency region are written into the bitstream in sequence, and the number of the frequency regions is equal to the frequency region number parameter num_tiles_recon of the tonal component coding.

[0153] For a current frequency region in at least one frequency region of the current frame, if a tone component flag parameter tone_flag_tile[p] (p is a frequency region serial number) of a frequency region level of the current frequency region is S8, i.e. there is no tone component in the current frequency region, the tone component flag parameter tone_flag_tile[p] of the frequency region level of the current frequency region is written into the code stream, and the current frequency region is no longer written into other parameters. If the tone component flag parameter tone_flag_tile[p] of the frequency region level of the current frequency region is S4, i.e. there is a tone component in the current frequency region, the tone component flag parameter tone_flag_tile[p] of the frequency region level of the current frequency region is written into the code stream, and then other parameters (including a position quantity information multiplex parameter, a position quantity parameter, an amplitude or energy parameter, a noise base parameter, etc.) of the current frequency region are written into the code stream in sequence.

[0154] The position quantity information multiplex parameter and the position quantity parameter are written into the code stream in the following manner: if the position quantity information multiplex parameter is_same_pos[p] (p is a frequency region serial number) of the current frequency region is S6, i.e. the position quantity parameter of the previous frame of the current frame is not multiplexed in the current frequency region of the current frame, the position quantity information multiplex parameter is_same_pos[p] and the position quantity parameter tone_pos[p] are written into the code stream; if the position quantity information multiplex parameter is_same_pos[p] of the current frequency region is S5, i.e. the position quantity parameter of the current frequency region of the previous frame is multiplexed in the current frequency region of the current frame, only the position quantity information multiplex parameter is_same_pos[p] is written into the code stream.

[0155] The amplitude or energy parameter is written into the code stream in the following manner: according to the quantity information tone_cnt[p] of the tone component of the current frequency region, the amplitude or energy parameter of each tone component of the current frequency region is written into the code stream.

[0156] The noise base parameter is written into the code stream in the following manner: the noise base parameter of the current frequency region is written into the code stream.

[0157] A possible generation manner of the encoding code stream of the tone component coding can be shown in the following pseudo code:

[0158]

[0159]

[0160] wherein BsPutBit(m) represents writing m bits into the encoding code stream, and num_subband represents the quantity of subbands in the frequency region, which can be determined by the width of the current frequency region and a subband width parameter of the tone component coding, for example.

[0161] wherein tone_cnt[p] represents the number of tonal component information in the frequency region, which can be obtained by a tonal component position number parameter, for example.

[0162] From the above, in the embodiment scheme of the present application, the audio encoder determines the frequency region information of the tonal component coding, and encodes the tonal component information in the frequency range corresponding to the frequency region information, so that the audio decoder can decode the audio signal according to the received tonal component information, which is beneficial to more accurately restore the tonal component in the frequency range corresponding to the frequency region information in the audio signal, thereby improving the quality of the decoded audio signal.

[0163] Referring to Figure 3 , Figure 3 A flowchart of an audio decoding method provided by an embodiment of the present application is shown. An audio decoding method can include:

[0164] 401. Obtain an encoded bitstream.

[0165] Before obtaining the encoded bitstream, the audio decoder can first obtain a configuration bitstream. The obtaining of the configuration bitstream can be performed every frame, or in the case of multiple frames sharing the configuration bitstream, the configuration bitstream can be obtained every several frames (the interval of obtaining the configuration bitstream can be adaptively adjusted), or the configuration bitstream can be obtained only when the audio decoder receives the first frame of the encoded bitstream.

[0166] The audio decoder performs bitstream demultiplexing on the configuration bitstream to obtain decoder configuration parameters, which include tonal component coding configuration parameters. The tonal component coding configuration parameters can be used to represent the number of frequency regions for tonal component coding and the subband width of each frequency region, etc. The tonal component coding configuration parameters can be used for the reconstruction of tonal components.

[0167] The tonal component coding configuration parameters can include, for example:

[0168] a. A number parameter of frequency regions for tonal component coding, which can be denoted as num_tiles_recon;

[0169] b. A flag parameter of using the same subband width, which can be denoted as flag_same_res; wherein the flag parameter of using the same subband width is used to represent whether the same subband width is used for different frequency regions.

[0170] c. A subband width parameter of tonal component coding for each frequency region, which can be denoted as tone_res[N1], wherein N1 is the number of frequency regions.

[0171] For example, the specific manner of parsing the configuration bitstream can be described as the following process:

[0172] A number parameter of the tonal component coded frequency region is obtained, for example, the number parameter of the tonal component coded frequency region occupies 3 bits:

[0173] num_tiles_recon = GetBits(3) + 1

[0174] Wherein, GetBits represents the process of obtaining a number of bits from the bitstream.

[0175] A flag parameter flag_same_res using the same sub-bandwidth is obtained. For example, the flag parameter using the same sub-bandwidth occupies 1 bit:

[0176] flag_same_res = GetBits(1)

[0177] According to the value of the flag parameter flag_same_res using the same sub-bandwidth, the sub-bandwidth parameter tone_res[N1] of the tonal component coding of each frequency region is parsed from the configuration bitstream, for example, the sub-bandwidth parameter of each frequency region occupies 2 bits:

[0178]

[0179] The above de-multiplexing process of the configuration bitstream can be described as:

[0180] If the value of the flag parameter flag_same_res using the same sub-bandwidth is S2, that is, the sub-bandwidth parameters of the tonal component coding of each frequency region are not completely the same, then according to the number parameter num_tiles_recon of the tonal component coded frequency region, the sub-bandwidth parameters tone_res[N1] of the tonal component coding of num_tiles_recon frequency regions are obtained from the configuration bitstream.

[0181] If the value of the flag parameter flag_same_res using the same sub-bandwidth is S1, that is, the sub-bandwidth parameters of the tonal component coding of each frequency region are the same, then the common sub-bandwidth parameter tone_res_common is obtained from the configuration bitstream, and the common sub-bandwidth parameter tone_res_common is assigned to the sub-bandwidth parameter tone_res[i] of the tonal component coding of each frequency region, wherein the number of frequency regions is equal to the number parameter num_tiles_recon of the tonal component coded frequency region.

[0182] It can be understood that, for the example process above, the number of frequency regions of tonal component coding occupies 3 bits, the same subband width flag occupies 1 bit, and the subband width of tonal component coding of each frequency region occupies 2 bits. For other bit numbers, the same logic can be used.

[0183] 402. performing code stream demultiplexing on the encoded bitstream to obtain first encoding parameters of a current frame of the audio signal; performing code stream demultiplexing on the encoded bitstream according to the configuration parameters of tonal component coding to obtain second encoding parameters of the current frame, the second encoding parameters of the current frame including tonal component parameters of the current frame.

[0184] The specific content of the first encoding parameters and the second encoding parameters can refer to the encoding method exemplified in the above embodiments, which will not be repeated here.

[0185] The code stream demultiplexing on the encoded bitstream includes: performing code stream demultiplexing on the encoded bitstream according to the configuration parameters of tonal component coding to obtain second encoding parameters of a current frame of the audio signal, the second encoding parameters including tonal component parameters of the current frame.

[0186] The encoding parameters of tonal component coding may, for example, include one or more of the following parameters:

[0187] a. a frame-level tonal component flag parameter, denoted as tone_flag;

[0188] b. a frequency region-level tonal component flag parameter of each frequency region, denoted as tone_flag_tile;

[0189] c. a position number parameter of tonal component of each frequency region, denoted as tone_pos;

[0190] d. a position number information multiplexing parameter of tonal component of each frequency region, denoted as is_same_pos;

[0191] e. an amplitude or energy parameter of tonal component of each frequency region, denoted as tone_val_q;

[0192] f. a noise floor parameter of each frequency region, denoted as noise_floor;

[0193] The method for parsing the encoded code stream can be described as follows: obtaining a frame-level tone component flag parameter tone_flag of a current frame from the encoded code stream, wherein if the frame-level tone component flag parameter of the current frame is S7, it indicates that the current frame does not have a tone component, and no other encoded parameter needs to be obtained from the encoded code stream; if the frame-level tone component flag parameter of the current frame is S3, it indicates that the current frame has a tone component, and the tone component parameters and noise base parameters of each frequency region need to be obtained from the encoded code stream, wherein the number of frequency regions is equal to the number of frequency regions for tone component coding parameter num_tiles_recon.

[0194] The method for parsing the encoded code stream can be described as follows: obtaining a frame-level tone component flag parameter tone_flag of a current frame from the encoded code stream, wherein if the frame-level tone component flag parameter of the current frame is S7, it indicates that the current frame does not have a tone component, and no other encoded parameter needs to be obtained from the encoded code stream; if the frame-level tone component flag parameter of the current frame is S3, it indicates that the current frame has a tone component, and the tone component parameters and noise base parameters of each frequency region need to be obtained from the encoded code stream, wherein the number of frequency regions is equal to the number of frequency regions for tone component coding parameter num_tiles_recon.

[0195] The method for obtaining the position number information multiplex parameter and the position number parameter of the current frequency region is as follows: obtaining the position number information multiplex parameter is_same_pos[p] of the current frequency region from the encoded code stream, and if the position number information multiplex parameter of the current frequency region is S6, the position number parameter tone_pos[p] of the tone component of the current frequency region is obtained from the encoded code stream according to the number of bits occupied by the position number parameter of the tone component of the current frequency region, wherein the number of bits occupied by the position number parameter of the tone component of the current frequency region is determined by the width information of the current frequency region and the subband width parameter tone_res[p] for tone component coding. The width information of the current frequency region is determined by the distribution of the frequency region for tone component coding, and the distribution of the frequency region for tone component coding is determined by the number of frequency regions for tone component coding parameter. If the position number information multiplex parameter of the current frequency region is S5, the position number parameter of the tone component of the current frequency region of the current frame is equal to the position number parameter of the tone component of the current frequency region of the previous frame of the current frame.

[0196] The method of obtaining the amplitude or energy parameter of the tonal component in the current frequency region can be: obtaining the amplitude or energy parameter of each tonal component in the current frequency region from the encoded bitstream according to the number information of the tonal components in the current frequency region. The number information of the tonal components in the current frequency region can be obtained from the position number parameter of the tonal components in the current frequency region.

[0197] The method of obtaining the noise floor parameter in the current frequency region can be, for example: obtaining the noise floor parameter in the current frequency region from the encoded bitstream.

[0198] An example method of parsing the encoded bitstream can be described as the following pseudo code:

[0199]

[0200] Wherein, tile_width is the width (i.e. the number of frequency points) of the current frequency region, tile[p] and tile[p+1] are the starting frequency point numbers of the pth and p+1th frequency regions, respectively.

[0201] 403. Obtain a first high-band signal of the current frame and a first low-band signal of the current frame according to the first encoding parameter.

[0202] The first high-band signal can include: a decoded high-band signal directly decoded according to the first encoding parameter, and / or an extended high-band signal obtained by band extension according to the first low-band signal.

[0203] 404. Obtain a second high-band signal of the current frame according to the second encoding parameter and the configuration parameter of the tonal component coding, wherein the second high-band signal includes a reconstructed tonal signal.

[0204] The second encoding parameter can include: the tonal component parameter of the high-band signal. The tonal component parameter of the high-band signal can include the position number parameter of the tonal component in each frequency region, the amplitude or energy parameter of the tonal component, and the noise floor parameter.

[0205] The second high-band signal of the current frame obtained according to the second encoding parameter, which includes a reconstructed tonal signal, can include: determining the distribution of the frequency region of the tonal component coding according to the number parameter of the frequency region of the tonal component coding; and reconstructing the tonal component in the frequency region of the tonal component coding according to the tonal component parameter of the high-band signal.

[0206] The determining the boundaries of the tonal component coded frequency regions according to the number of the tonal component coded frequency regions can specifically include: if the number of the tonal component coded frequency regions is less than or equal to the number of the frequency regions of the frequency band extension corresponding to the frequency band extension information, the boundaries of the tonal component coded frequency regions are the same as the boundaries of the frequency regions of the frequency band extension. The boundaries of the frequency regions can be, for example, the upper limit of the frequency region and / or the lower limit of the frequency region.

[0207] Specifically, if the number of the tonal component coded frequency regions is greater than the number of the frequency regions of the frequency band extension, in the tonal component coded frequency regions, the boundaries of a number of frequency regions with a frequency lower than the upper limit of the frequency band extension are the same as the boundaries of the frequency regions of the frequency band extension, and the boundaries of a number of frequency regions with a frequency higher than the upper limit of the frequency band extension can be determined according to the frequency band division manner.

[0208] The specific manner of determining the boundaries of the number of frequency regions with a frequency higher than the upper limit of the frequency band extension according to the frequency band division manner can be:

[0209] For a certain frequency region in the number of frequency regions with a frequency higher than the upper limit of the frequency band extension, the lower limit of the frequency of the certain frequency region is equal to the upper limit of the frequency of a frequency region adjacent to the certain frequency region and having a lower frequency, and the upper limit of the frequency of the certain frequency region is determined according to the sub-band division manner. The certain frequency region, for example, satisfies the following two conditions, where condition T1 is, for example, that the upper limit of the frequency of the certain frequency region is less than or equal to half of the sampling frequency, and condition T2 is, for example, that the width of the certain frequency region is less than or equal to a certain preset value. The width of the frequency region is the difference between the upper limit of the frequency and the lower limit of the frequency of the frequency region.

[0210] For example, the lower limit of the first frequency range of the tonal component coding is the same as the lower limit of the second frequency range of the band extension; when the number of frequency regions of the tonal component coding is less than or equal to the number of frequency regions of the band extension, the distribution of the frequency regions in the first frequency range is the same as the distribution of the frequency regions in the second frequency range indicated in the configuration information of the band extension, that is, the division manner of the frequency regions in the first frequency range is the same as the division manner of the frequency regions in the second frequency range. When the number of frequency regions of the tonal component coding is greater than the number of frequency regions of the band extension, the upper limit of the first frequency range is greater than the upper limit of the second frequency range, that is, the first frequency range covers and is greater than the second frequency range, the distribution of the frequency regions in the overlapping part of the first frequency range and the second frequency range is the same as the distribution of the frequency regions in the second frequency range, that is, the division manner of the frequency regions in the overlapping part of the first frequency range and the second frequency range is the same as the division manner of the frequency regions in the second frequency range, and the distribution of the frequency regions in the non-overlapping part of the first frequency range and the second frequency range is determined according to a preset manner, that is, the frequency regions in the non-overlapping part of the first frequency range and the second frequency range are divided according to the preset manner.

[0211] For example, the decoding end obtains the number of frequency regions of the tonal component coding from the configuration code stream.

[0212] If the number of frequency regions of the tonal component coding is greater than the number of frequency regions of the band extension, the corresponding relationship between the frequency boundary of the new frequency region and the SFB is obtained, and the specific manner is the same as that of the encoding end, that is, under the premise that the width of the new frequency region does not exceed a given value, the full band Fs / 2 is as close as possible.

[0213] The determination manner of the frequency boundary of the new frequency region and the SFB sequence number of the frequency region boundary is the same as that of the encoding end. The frequency region division table and the frequency region-SFB corresponding table are updated as follows:

[0214] tile[num_tiles_recon]=sfb_offset[sfbIdx]

[0215] tile_sfb_wrap[num_tiles_recon]=sfbIdx

[0216] Wherein, sfbIdx represents the SFB sequence number corresponding to the upper boundary of the new frequency region, and sfb_offset represents the SFB boundary table, wherein the lower limit of the i-th SFB is sfb_offset[i], and the upper limit is sfb_offset[i+1].

[0217] The reconstructing the tonal component according to the tonal component information of the high frequency band signal can specifically include: determining a frequency position of the tonal component in the current frequency region according to a position quantity parameter of the tonal component in the current frequency region; determining an amplitude or energy corresponding to the frequency position of the tonal component according to an amplitude parameter or energy parameter of the tonal component in the current frequency region; and obtaining a reconstructed high frequency band signal according to the frequency position of the tonal component in the current frequency region and the amplitude or energy corresponding to the frequency position of the tonal component.

[0218] 405. obtaining a decoded signal of the current frame according to the first low frequency band signal, the first high frequency band signal and the second high frequency band signal of the current frame.

[0219] Specifically, the first low frequency band signal, the first high frequency band signal and the second high frequency band signal of the current frame are combined to obtain the decoded signal of the current frame. The combination manner can be superposition or weighted superposition, and the like, which can be referred to Figure 4-A , Figure 4-A An example is shown to illustrate a possible manner of superposition combination of the first low frequency band signal, the first high frequency band signal and the second high frequency band signal to obtain the decoded signal of the current frame.

[0220] The high frequency band tonal component coding and decoding scheme exemplified by the embodiments of the present application determines the frequency region information that needs to be detected and coded, and codes the tonal component information in the frequency range corresponding to the frequency region information, so that the audio decoder can decode the audio signal according to the received tonal component information, which is beneficial to more accurately restore the tonal component in the audio signal in the frequency range corresponding to the frequency region information, thereby improving the quality of the decoded audio signal.

[0221] When the frequency range covered by the band extension processing can not reach the maximum bandwidth, the above-mentioned example scheme is beneficial to code the tonal component of the high frequency band in the frequency range not covered by the band extension processing. When the frequency range covered by the band extension processing is large and there is not enough coding bit number to code all the tonal component information in the frequency range covered by the band extension processing, the tonal component information in part of the frequency range can be selectively coded. It is found through experiments that the best coding quality can be obtained under different conditions.

[0222] Referring to Figure 4-B , the embodiments of the present application further provide an audio decoder 500, which comprises:

[0223] The obtaining unit 510 is configured to obtain an encoded bitstream.

[0224] The decoding unit 520 is configured to perform code stream demultiplexing on the encoded code stream to obtain a first encoding parameter of a current frame of the audio signal, perform code stream demultiplexing on the encoded code stream according to a configuration parameter of the tonal component coding to obtain a second encoding parameter of the current frame of the audio signal, the second encoding parameter of the current frame including a tonal component parameter of the current frame, obtain a first high-band signal and a first low-band signal of the current frame according to the first encoding parameter, obtain a second high-band signal of the current frame according to the second encoding parameter and the configuration parameter of the tonal component coding, and obtain a decoded signal of the current frame according to the first high-band signal, the second high-band signal and the first low-band signal.

[0225] In some possible implementation manners, the obtaining unit 510 is further configured to obtain a configuration code stream, and the decoding unit 520 is further configured to perform code stream demultiplexing on the configuration code stream to obtain a decoder configuration parameter, where the decoder configuration parameter includes the configuration parameter of the tonal component coding, and the configuration parameter of the tonal component coding is used to indicate a number of frequency regions of the tonal component coding and a subband width of each frequency region.

[0226] In some possible implementation manners, the decoding unit 520 performs code stream demultiplexing on the configuration code stream to obtain a decoder configuration parameter, including: obtaining, from the configuration code stream, a number parameter of the frequency regions of the tonal component coding and a same-subband-width flag parameter, where the same-subband-width flag parameter is used to indicate whether different frequency regions use a same subband width; and obtaining, from the configuration code stream, a tonal component coding subband width parameter of the at least one frequency region according to the number parameter of the frequency regions of the tonal component coding and the same-subband-width flag parameter.

[0227] In some possible implementation manners, the decoding unit 520 obtains, from the configuration code stream, a tonal component coding subband width parameter of the at least one frequency region according to the number parameter of the frequency regions of the tonal component coding and the same-subband-width flag parameter, including:

[0228] In a case where the same-subband-width flag parameter is a set value S1, a common subband width parameter is obtained from the configuration code stream, the tonal component coding subband width parameter of the at least one frequency region is equal to the common subband width parameter, or the tonal component coding subband width parameter of the at least one frequency region is obtained by transformation based on the common subband width parameter.

[0229] Or,

[0230] In a case where the flag parameter indicating whether the same subband width is used is set as a value S2, a subband width parameter of tonal component coding of at least one frequency region is obtained from the configuration bitstream, wherein a number of the subband width parameter of tonal component coding of the at least one frequency region is equal to a number of the frequency regions of tonal component coding indicated by the number parameter of the frequency regions of tonal component coding, or the number of the subband width parameter of tonal component coding of the at least one frequency region is transformed based on the number parameter of the frequency regions of tonal component coding.

[0231] In some possible implementation, the tonal component parameters of the current frame include one or more of the following parameters: a frame-level tonal component flag parameter of the current frame, a frequency region-level tonal component flag parameter of at least one frequency region of the current frame, a noise floor parameter of at least one frequency region of the current frame, a tonal component position number information multiplex parameter, a tonal component position number parameter, a tonal component amplitude or energy parameter.

[0232] In some possible implementation, the configuration parameters of tonal component coding include a number parameter of frequency regions of tonal component coding; the decoding unit 520 performs bitstream demultiplexing on the encoded bitstream according to the configuration parameters of tonal component coding to obtain second encoding parameters of a current frame of an audio signal, including: obtaining a frame-level tonal component flag parameter of the current frame from the encoded bitstream.

[0233] In a case where the frame-level tonal component flag parameter of the current frame is set as a value S3, tonal component parameters of N1 frequency regions of the current frame are obtained from the encoded bitstream, wherein the N1 is equal to a number of the frequency regions of tonal component coding of the current frame indicated by the number parameter of the frequency regions of tonal component coding of the current frame.

[0234] In some possible implementation, the decoding unit 520 obtains the tonal component parameters of N1 frequency regions of the current frame from the encoded bitstream, including:

[0235] obtaining a frequency region-level tonal component flag parameter of a current frequency region of the N1 frequency regions of the current frame from the encoded bitstream;

[0236] In a case where the frequency region-level tonal component flag parameter of the current frequency region of the current frame is set as a value S4, one or more of the following tonal component parameters are obtained from the encoded bitstream: a noise floor parameter of the current frequency region of the current frame, a tonal component position number information multiplex parameter, a tonal component position number parameter, a tonal component amplitude or energy parameter.

[0237] In some possible implementation, the decoding unit 520 obtains the position number information multiplex parameter and the position number parameter of the tonal component of the current frequency region of the current frame from the encoded bitstream, including: obtaining the position number information multiplex parameter of the current frequency region of the current frame from the encoded bitstream.

[0238] In a case where the position number information multiplex parameter of the current frequency region of the current frame is a set value S5, the position number parameter of the tonal component of the current frequency region of the current frame is equal to the position number parameter of the tonal component of the current frequency region of the previous frame of the current frame; or the position number parameter of the tonal component of the current frequency region of the current frame is obtained based on a transformation of the position number parameter of the tonal component of the current frequency region of the previous frame of the current frame.

[0239] In a case where the position number information multiplex parameter of the current frequency region of the current frame is a set value S6, the position number parameter of the tonal component of the current frequency region of the current frame is obtained from the encoded bitstream.

[0240] In some possible implementation, the decoding unit 520 obtains the position number parameter of the tonal component of the current frequency region of the current frame from the encoded bitstream, including:

[0241] According to the width information of the current frequency region of the current frame and the subband width parameter of the tonal component coding, a bit number occupied by the position number parameter of the tonal component of the current frequency region of the current frame is obtained; and the position number parameter of the tonal component of the current frequency region of the current frame is obtained from the encoded bitstream according to the bit number occupied by the position number parameter of the tonal component of the current frequency region of the current frame.

[0242] In some possible implementation, the width information of the current frequency region is determined by a distribution of the tonal component coding frequency region, and the distribution of the tonal component coding frequency region is determined by the number parameter of the tonal component coding frequency region.

[0243] In some possible implementation, the decoding unit 520 obtains the amplitude or energy parameter of the tonal component of at least one frequency region of the current frame from the encoded bitstream, including:

[0244] In a case where the frequency region level tonal component flag parameter of the current frequency region of the current frame is a set value S4, the amplitude or energy parameter of the tonal component of the current frequency region of the current frame is obtained from the encoded bitstream according to the position number parameter of the tonal component of the current frequency region of the current frame.

[0245] It can be understood that the functions of the various functional modules of the audio decoder 500 in the present embodiment, for example, can be based onFigure 4-B The method in the method embodiment is implemented.

[0246] Referring to Figure 5 The application embodiment further provides an audio decoder 600, which can include a processor 610, and a memory 620 coupled to the processor, and the memory 620 stores a program, and when the program instruction stored in the memory is executed by the processor, part or all steps of the audio decoding method in the application embodiment are implemented.

[0247] The processor 610 is also called a central processing unit (CPU). In specific applications, the components of the audio decoder are coupled together through a bus system. In addition to the data bus, the bus system can also include a power bus, a control bus, and a status signal bus, etc. The method disclosed in the application embodiment can be applied to the processor 610 or implemented by the processor 610. The processor 610 can be an integrated circuit chip with signal processing capability. In some implementation processes, part or all steps of the above method can be completed by integrated logic circuits or instructions in the form of software in the processor 610. The processor 610 can be a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a ready-to-program gate array or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component. The processor 610 can implement or execute the methods, steps and logic block diagrams disclosed in the application embodiment. The general-purpose processor 610 can be a microprocessor or any conventional processor. The steps of the method disclosed in combination with the application embodiment can be directly embodied as a hardware decoding processor for execution, or a combination of hardware and software modules in the decoding processor for execution.

[0248] The software module can be located in a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory or a register, etc. The storage medium is located in the memory 620, for example, the processor 610 can read the information in the memory 620, and combine the hardware to complete part or all steps of the above method.

[0249] The application embodiment further provides an audio encoder, which can include a processor, and a memory coupled to the processor, and the memory stores a program, and when the program instruction stored in the memory is executed by the processor, part or all steps of the audio encoding method in the application embodiment are implemented.

[0250] Referring to Figure 4-A The application embodiment further provides a communication system, which includes:

[0251] The audio encoder 710 and the audio decoder 720; the audio decoder 720 is any one of the audio decoders provided by the embodiments of the present application.

[0252] Referring to Figure 6 Figure 7 Figure 8 The embodiments of the present application also provide a network device 800, which comprises a processor 810 and a memory 820, wherein the processor 810 is coupled with the memory 820, and is configured to read and execute instructions stored in the memory, so as to implement part or all steps of the audio encoding / decoding method in the embodiments of the present application.

[0253] The network device 800 is, for example, a chip or a system on chip.

[0254] The embodiments of the present application also provide a computer readable storage medium, which stores a computer program, and the computer program is executed by hardware (for example, a processor) to complete part or all steps of the audio encoding / decoding method in the embodiments of the present application.

[0255] The embodiments of the present application also provide a computer readable storage medium, which stores a computer program, and the computer program is executed by hardware (for example, a processor) to complete part or all steps of the audio encoding / decoding method in the embodiments of the present application.

[0256] The embodiments of the present application also provide a computer program product comprising instructions, which, when executed on a computer device, cause the computer device to perform part or all steps of any one of the audio encoding / decoding methods in the embodiments of the present application.

[0257] In the embodiments described above, all or part of the embodiments can be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line) or wireless (such as infrared, wireless, microwave, etc.) mode. The computer readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. integrated with one or more available media. The available media can be magnetic media (such as floppy disk, hard disk, magnetic tape), optical media (such as optical disk), or semiconductor media (such as solid state disk), etc. In the above embodiments, the description of each embodiment is focused on each embodiment, and the part not described in detail in a certain embodiment can be referred to the related description of other embodiments.

[0258] In the above embodiments, the description of each embodiment is focused on each embodiment, and the part not described in detail in a certain embodiment can be referred to the related description of other embodiments.

[0259] In several embodiments provided in the present application, it should be understood that the disclosed device can also be implemented by other ways. For example, the device embodiments described above are only schematic, and the division of the units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the indirect coupling or direct coupling or communication connection between the units or components shown or discussed can be through some interface, device or unit, and can be electrical or other forms.

[0260] The units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or they can be distributed on a plurality of network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the scheme of the embodiments.

[0261] In addition, each of the functional units in the embodiments of the present application can be integrated in one processing unit, or each unit can exist alone physically, or two or more units can be integrated in one unit. The integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

[0262] When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on such an understanding, the technical solutions of the present application essentially, or the part that contributes to the prior art, or all or a part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes several instructions for causing a computer device (for example, a personal computer, a server, or a network device) to perform all or part of the steps of the methods described in the embodiments of the present application. The foregoing storage medium includes various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

Claims

1. An audio decoding method, characterized by, The method comprises: obtaining an encoded bitstream; bitstream demultiplexing the encoded bitstream to obtain first encoding parameters of a current frame of an audio signal; bitstream demultiplexing the encoded bitstream according to configuration parameters of tonal component coding to obtain second encoding parameters of the current frame, the second encoding parameters of the current frame comprising tonal component parameters of the current frame; obtaining a first high-band signal and a first low-band signal of the current frame according to the first encoding parameters; obtaining a second high-band signal of the current frame according to the second encoding parameters and the configuration parameters of tonal component coding; obtaining a decoded signal of the current frame according to the first high-band signal, the second high-band signal and the first low-band signal; wherein the method further comprises: obtaining a configuration bitstream; bitstream demultiplexing the configuration bitstream to obtain decoder configuration parameters, the decoder configuration parameters comprising the configuration parameters of tonal component coding, the configuration parameters of tonal component coding being used to indicate a number of frequency regions of tonal component coding and a sub-band width of each frequency region.

2. The method of claim 1, wherein, The bitstream demultiplexing the configuration bitstream to obtain decoder configuration parameters comprises: obtaining a number of frequency regions of tonal component coding parameter and a same sub-band width usage flag parameter from the configuration bitstream, wherein the same sub-band width usage flag parameter is used to indicate whether different frequency regions use the same sub-band width; and obtaining a tonal component coding sub-band width parameter of at least one frequency region from the configuration bitstream according to the number of frequency regions of tonal component coding parameter and the same sub-band width usage flag parameter.

3. The method of claim 2, wherein, The obtaining a tonal component coding sub-band width parameter of at least one frequency region from the configuration bitstream according to the number of frequency regions of tonal component coding parameter and the same sub-band width usage flag parameter comprises: in a case where the same sub-band width usage flag parameter is a set value S1, obtaining a common sub-band width parameter from the configuration bitstream, the tonal component coding sub-band width parameter of the at least one frequency region being equal to the common sub-band width parameter or being obtained by transformation based on the common sub-band width parameter; or, in a case where the same sub-band width usage flag parameter is a set value S2, obtaining the tonal component coding sub-band width parameter of the at least one frequency region from the configuration bitstream, wherein a number of the tonal component coding sub-band width parameter of the at least one frequency region is equal to a number of the frequency regions of tonal component coding indicated by the number of frequency regions of tonal component coding parameter or is obtained by transformation based on the number of frequency regions of tonal component coding parameter.

4. The method according to any one of claims 1 to 3, characterized in that, The tonal component parameter of the current frame comprises one or more of the following parameters: a frame-level tonal component flag parameter of the current frame, a frequency region-level tonal component flag parameter of at least one frequency region of the current frame, a noise floor parameter of at least one frequency region of the current frame, a tonal component position quantity information multiplex parameter, a tonal component position quantity parameter, and a tonal component amplitude or energy parameter.

5. The method of claim 4, wherein, The configuration parameter of the tonal component coding comprises a frequency region quantity parameter of the tonal component coding; The bitstream demultiplexing of the coded bitstream according to the configuration parameter of the tonal component coding comprises: obtaining a frame-level tonal component flag parameter of the current frame from the coded bitstream; in a case where the frame-level tonal component flag parameter of the current frame is a preset value S3, obtaining tonal component parameters of N1 frequency regions of the current frame from the coded bitstream, wherein the N1 is equal to a frequency region quantity parameter of the tonal component coding of the current frame indicated by the frequency region quantity parameter of the tonal component coding of the current frame.

6. The method of claim 5, wherein, The obtaining of the tonal component parameters of the N1 frequency regions of the current frame from the coded bitstream comprises: obtaining a frequency region-level tonal component flag parameter of a current frequency region of the N1 frequency regions of the current frame from the coded bitstream; in a case where the frequency region-level tonal component flag parameter of the current frequency region of the current frame is a preset value S4, obtaining one or more of the following tonal component parameters from the coded bitstream: a noise floor parameter of the current frequency region of the current frame, a tonal component position quantity information multiplex parameter, a tonal component position quantity parameter, and a tonal component amplitude or energy parameter.

7. The method of claim 6, wherein, The obtaining of the tonal component position quantity information multiplex parameter and the tonal component position quantity parameter of the current frequency region of the current frame from the coded bitstream comprises: obtaining a position quantity information multiplex parameter of the current frequency region of the current frame from the coded bitstream; in a case where the position quantity information multiplex parameter of the current frequency region of the current frame is a preset value S5, the tonal component position quantity parameter of the current frequency region of the current frame is equal to a tonal component position quantity parameter of a current frequency region of a previous frame of the current frame; or the tonal component position quantity parameter of the current frequency region of the current frame is obtained based on a transformation of the tonal component position quantity parameter of the current frequency region of the previous frame of the current frame; in a case where the position quantity information multiplex parameter of the current frequency region of the current frame is a preset value S6, obtaining the tonal component position quantity parameter of the current frequency region of the current frame from the coded bitstream.

8. The method of claim 7, wherein, The obtaining of the tonal component position quantity parameter of the current frequency region of the current frame from the coded bitstream comprises: According to the width information of the current frequency region of the current frame and the subband width parameter of the pitch component coding, a bit number occupied by a position number parameter of the pitch component of the current frequency region of the current frame is obtained; and according to the bit number occupied by the position number parameter of the pitch component of the current frequency region of the current frame, the position number parameter of the pitch component of the current frequency region of the current frame is obtained from the coded bitstream.

9. The method of claim 8, wherein, The width information of the current frequency region is determined by a distribution of the pitch component coded frequency region, and the distribution of the pitch component coded frequency region is determined by the number parameter of the pitch component coded frequency region.

10. The method according to any one of claims 6 to 9, characterized in that, The amplitude or energy parameter of the pitch component of at least one frequency region of the current frame is obtained from the coded bitstream, including: If the frequency region level pitch component flag parameter of the current frequency region of the current frame is a set value S4, the amplitude or energy parameter of the pitch component of the current frequency region of the current frame is obtained from the coded bitstream according to the position number parameter of the pitch component of the current frequency region of the current frame.

11. An audio decoding method, characterized by, Including: Obtaining a coded bitstream; Bitstream demultiplexing the coded bitstream to obtain a first encoding parameter of a current frame of an audio signal; Bitstream demultiplexing the coded bitstream according to a configuration parameter of pitch component coding to obtain a second encoding parameter of the current frame, the second encoding parameter of the current frame including a pitch component parameter of the current frame; Obtaining a first high frequency band signal and a first low frequency band signal of the current frame according to the first encoding parameter; Obtaining a second high frequency band signal of the current frame according to the second encoding parameter and the configuration parameter of the pitch component coding; Obtaining a decoded signal of the current frame according to the first high frequency band signal, the second high frequency band signal and the first low frequency band signal; Wherein, The pitch component parameter of the current frame includes one or more of the following parameters: a frame level pitch component flag parameter of the current frame, a frequency region level pitch component flag parameter of at least one frequency region of the current frame, a noise floor parameter of at least one frequency region of the current frame, a position number information multiplex parameter of the pitch component, a position number parameter of the pitch component, and an amplitude or energy parameter of the pitch component; The configuration parameter of the pitch component coding includes a number parameter of the pitch component coded frequency region. The bitstream demultiplexing the coded bitstream according to the configuration parameter of the pitch component coding to obtain a second encoding parameter of a current frame of an audio signal, including: Obtaining a frame level pitch component flag parameter of the current frame from the coded bitstream; In the case that the frame level pitch component flag parameter of the current frame is a set value S3, obtaining pitch component parameters of N1 frequency regions of the current frame from the coded bitstream, wherein the N1 is equal to the number of pitch component coded frequency regions of the current frame indicated by the number parameter of the pitch component coded frequency region of the current frame.

12. An audio decoder, characterized by Including: An obtaining unit is configured to obtain a coded bitstream; Bitstream demultiplexing the coded bitstream to obtain a first encoding parameter of a current frame of an audio signal; Bitstream demultiplexing the coded bitstream according to a configuration parameter of pitch component coding to obtain a second encoding parameter of the current frame, the second encoding parameter of the current frame including a pitch component parameter of the current frame; Obtaining a first high frequency band signal and a first low frequency band signal of the current frame according to the first encoding parameter; Obtaining a second high frequency band signal of the current frame according to the second encoding parameter and the configuration parameter of the pitch component coding; Obtaining a decoded signal of the current frame according to the first high frequency band signal, the second high frequency band signal and the first low frequency band signal; Wherein, The pitch component parameter of the current frame includes one or more of the following parameters: a frame level pitch component flag parameter of the current frame, a frequency region level pitch component flag parameter of at least one frequency region of the current frame, a noise floor parameter of at least one frequency region of the current frame, a position number information multiplex parameter of the pitch component, a position number parameter of the pitch component, and an amplitude or energy parameter of the pitch component; The configuration parameter of the pitch component coding includes a number parameter of the pitch component coded frequency region. The bitstream demultiplexing the coded bitstream according to the configuration parameter of the pitch component coding to obtain a second encoding parameter of a current frame of an audio signal, including: Obtaining a frame level pitch component flag parameter of the current frame from the coded bitstream; In the case that the frame level pitch component flag parameter of the current frame is a set value S3, obtaining pitch component parameters of N1 frequency regions of the current frame from the coded bitstream, wherein the N1 is equal to the number of pitch component coded frequency regions of the current frame indicated by the number parameter of the pitch component coded frequency region of the current frame. Including: An obtaining unit is configured to obtain a coded bitstream; The decoding unit is configured to: perform code stream demultiplexing on the encoded code stream to obtain a first encoding parameter of a current frame of the audio signal; perform code stream demultiplexing on the encoded code stream according to a configuration parameter of tonal component coding to obtain a second encoding parameter of the current frame of the audio signal, the second encoding parameter of the current frame comprising a tonal component parameter of the current frame; obtain a first high-band signal and a first low-band signal of the current frame according to the first encoding parameter; obtain a second high-band signal of the current frame according to the second encoding parameter and the configuration parameter of tonal component coding; and obtain a decoded signal of the current frame according to the first high-band signal, the second high-band signal, and the first low-band signal. The obtaining unit is further configured to: obtain a configuration code stream. The decoding unit is further configured to perform code stream demultiplexing on the configuration code stream to obtain a decoder configuration parameter, the decoder configuration parameter comprising the configuration parameter of tonal component coding, the configuration parameter of tonal component coding being used to indicate a number of frequency regions of tonal component coding and a subband width of each frequency region.

13. The audio decoder of claim 12, wherein, The decoding unit performs code stream demultiplexing on the configuration code stream to obtain a decoder configuration parameter, comprising: obtaining, from the configuration code stream, a number parameter of the frequency regions of tonal component coding and a same-subband-width flag parameter used to indicate whether different frequency regions use a same subband width; and obtaining, from the configuration code stream, a tonal component coding subband width parameter of at least one frequency region according to the number parameter of the frequency regions of tonal component coding and the same-subband-width flag parameter.

14. The audio decoder of claim 13, characterized by The decoding unit obtains, from the configuration code stream, the tonal component coding subband width parameter of the at least one frequency region according to the number parameter of the frequency regions of tonal component coding and the same-subband-width flag parameter, comprising: in a case where the same-subband-width flag parameter is a set value S1, obtaining a common subband width parameter from the configuration code stream, and the tonal component coding subband width parameter of the at least one frequency region is equal to the common subband width parameter or is obtained by transformation based on the common subband width parameter; or in a case where the same-subband-width flag parameter is a set value S2, obtaining the tonal component coding subband width parameter of the at least one frequency region from the configuration code stream, wherein a number of the tonal component coding subband width parameters of the at least one frequency region is equal to a number of the frequency regions of tonal component coding indicated by the number parameter of the frequency regions of tonal component coding or is obtained by transformation based on the number parameter of the frequency regions of tonal component coding. ​ 15. The audio decoder of any of claims 12 to 14, wherein, The tonal component parameter of the current frame comprises one or more of the following parameters: a frame-level tonal component flag parameter of the current frame, a frequency region-level tonal component flag parameter of at least one frequency region of the current frame, a noise floor parameter of at least one frequency region of the current frame, a tonal component position quantity information multiplex parameter, a tonal component position quantity parameter, and a tonal component amplitude or energy parameter.

16. The audio decoder of claim 15, wherein, The configuration parameter of the tonal component coding comprises a frequency region quantity parameter of the tonal component coding. The decoding unit performs bitstream demultiplexing on the encoded bitstream according to the configuration parameter of the tonal component coding to obtain a second encoding parameter of the current frame of the audio signal, comprising: obtaining a frame-level tonal component flag parameter of the current frame from the encoded bitstream; in a case where the frame-level tonal component flag parameter of the current frame is a preset value S3, obtaining tonal component parameters of N1 frequency regions of the current frame from the encoded bitstream, wherein the N1 is equal to the frequency region quantity parameter of the tonal component coding of the current frame indicated by the frequency region quantity parameter of the tonal component coding of the current frame.

17. The audio decoder of claim 16, wherein, The decoding unit obtains the tonal component parameters of the N1 frequency regions of the current frame from the encoded bitstream, comprising: obtaining a frequency region-level tonal component flag parameter of a current frequency region of the N1 frequency regions of the current frame from the encoded bitstream; in a case where the frequency region-level tonal component flag parameter of the current frequency region of the current frame is a preset value S4, obtaining one or more of the following tonal component parameters from the encoded bitstream: a noise floor parameter of the current frequency region of the current frame, a tonal component position quantity information multiplex parameter, a tonal component position quantity parameter, and a tonal component amplitude or energy parameter.

18. The audio decoder of claim 17, wherein, The decoding unit obtains the tonal component position quantity information multiplex parameter and the tonal component position quantity parameter of the current frequency region of the current frame from the encoded bitstream, comprising: obtaining a position quantity information multiplex parameter of the current frequency region of the current frame from the encoded bitstream; in a case where the position quantity information multiplex parameter of the current frequency region of the current frame is a preset value S5, the tonal component position quantity parameter of the current frequency region of the current frame is equal to a tonal component position quantity parameter of a current frequency region of a previous frame of the current frame; or the tonal component position quantity parameter of the current frequency region of the current frame is obtained based on a transformation of the tonal component position quantity parameter of the current frequency region of the previous frame of the current frame; in a case where the position quantity information multiplex parameter of the current frequency region of the current frame is a preset value S6, obtaining the tonal component position quantity parameter of the current frequency region of the current frame from the encoded bitstream.

19. The audio decoder of claim 18, wherein, The decoding unit obtains the tonal component position quantity parameter of the current frequency region of the current frame from the encoded bitstream, comprising: According to the width information of the current frequency region of the current frame and the subband width parameter of the tonal component coding, a bit number occupied by a position number parameter of the tonal component of the current frequency region of the current frame is obtained; and according to the bit number occupied by the position number parameter of the tonal component of the current frequency region of the current frame, the position number parameter of the tonal component of the current frequency region of the current frame is obtained from the coded bitstream.

20. The audio decoder of claim 19, wherein, The width information of the current frequency region is determined by a distribution of the tonal component coded frequency region, and the distribution of the tonal component coded frequency region is determined by the number parameter of the tonal component coded frequency region.

21. The audio decoder of any of claims 17 to 20, wherein, The decoding unit obtains the amplitude or energy parameter of the tonal component of at least one frequency region of the current frame from the coded bitstream, including: If the frequency region level tonal component flag parameter of the current frequency region of the current frame is a set value S4, the amplitude or energy parameter of the tonal component of the current frequency region of the current frame is obtained from the coded bitstream according to the position number parameter of the tonal component of the current frequency region of the current frame.

22. An audio decoder, characterized by Including: The obtaining unit is configured to obtain a coded bitstream; The decoding unit is configured to perform bitstream demultiplexing on the coded bitstream to obtain a first encoding parameter of a current frame of an audio signal; perform bitstream demultiplexing on the coded bitstream according to a configuration parameter of tonal component coding to obtain a second encoding parameter of the current frame of the audio signal, the second encoding parameter of the current frame including a tonal component parameter of the current frame; obtain a first high-band signal and a first low-band signal of the current frame according to the first encoding parameter; obtain a second high-band signal of the current frame according to the second encoding parameter and the configuration parameter of the tonal component coding; and obtain a decoded signal of the current frame according to the first high-band signal, the second high-band signal, and the first low-band signal. Wherein, The tonal component parameter of the current frame includes one or more of the following parameters: a frame level tonal component flag parameter of the current frame, a frequency region level tonal component flag parameter of at least one frequency region of the current frame, a noise floor parameter of at least one frequency region of the current frame, a position number information multiplex parameter of the tonal component, a position number parameter of the tonal component, and an amplitude or energy parameter of the tonal component. The configuration parameter of the tonal component coding includes a number parameter of the tonal component coded frequency region. The decoding unit performs bitstream demultiplexing on the coded bitstream according to the configuration parameter of the tonal component coding to obtain a second encoding parameter of a current frame of an audio signal, including: The frame level tonal component flag parameter of the current frame is obtained from the coded bitstream. In a case where the frame level tonal component flag parameter of the current frame is a set value S3, tonal component parameters of N1 frequency regions of the current frame are obtained from the coded bitstream, where the N1 is equal to a number of the tonal component coded frequency regions of the current frame indicated by the number parameter of the tonal component coded frequency region of the current frame.

23. An audio decoder, characterized by Including: A processor coupled to the memory, the memory storing a program which, when executed by the processor, implements the method of any one of claims 1-11.

24. A communication system, characterized by comprising: An audio encoder and an audio decoder; the audio decoder is as claimed in any one of claims 12-23.

25. A computer readable storage medium, comprising a program which, when executed on a computer, causes the computer to perform the method of any one of claims 1-11.

26. A network device, comprising a processor and a memory, wherein: the processor is coupled to the memory for reading and executing instructions stored in the memory to implement the method of any one of claims 1-11.

27. The network device of claim 26, wherein, The network device is a chip or a system on chip.

28. A computer readable storage medium, comprising: The computer readable storage medium stores an encoded bitstream, wherein the audio decoder as claimed in any one of claims 12-23 obtains a decoded signal of the current frame according to the encoded bitstream after obtaining the encoded bitstream.

29. A computer program product, characterised in that, The computer program product comprises a computer program which, when executed on a computer, performs the method of any one of claims 1-11.

Citation Information

Patent Citations

  • Method and apparatus for encoding and decoding high frequency band

    US20080270125A1

  • Signal processing device, method, and program

    US20130275142A1

  • Bandwidth extension parameter generation device, encoding apparatus, decoding apparatus, bandwidth extension parameter generation method, encoding method, and decoding method

    US20150162010A1