Audio signal encoding method, decoding method, encoding device and decoding device

Abstract

The present application provides an audio signal encoding method, decoding method, encoding device and decoding device, which are used to achieve higher quality audio encoding and decoding and improve user experience. The method includes: obtaining a current frame of an audio signal, the current frame including a high-band signal and a low-band signal; obtaining a parameter of the frequency band extension of the current frame according to the configuration information of the high-band signal, the low-band signal and the frequency band extension; obtaining frequency region information, the frequency region information is used to indicate a first frequency range in the high-band signal where tone component detection is required; performing tone component detection in the first frequency range to obtain information on the tone component of the high-band signal; and multiplexing the parameters of the frequency band extension and the tone component information to obtain a payload code stream.

Description

Technical Field

[0001] The present application relates to the field of communications, and in particular to an audio signal encoding method, decoding method, encoding device, and decoding device. Background Art

[0002] With the progress of society and the continuous development of technology, users have higher and higher demands for audio services. How to provide users with higher quality services under limited coding bit rate, or to provide users with the same quality services at a lower coding bit rate has always been the focus of audio codec research.

[0003] Usually, in the process of encoding audio data, the high-frequency part and the low-frequency part in the audio data are processed separately. In order to reduce the coding bit rate, the correlation between different frequency band signals is often further utilized for encoding. For example, a high-frequency band signal is generated by spectrum replication or band extension using a low-frequency band signal. However, there are often some tone components in the spectrum of the high-frequency band that are not similar to the spectrum of the low-frequency band, and the existing scheme cannot process these dissimilar tone components, which results in a low coding quality of the actual coded data. Therefore, how to obtain high-quality coded data has become a problem to be solved urgently. Summary of the invention

[0004] The present application provides an audio signal encoding method, a decoding method, an encoding device and a decoding device, which are used to achieve higher quality audio encoding and decoding and improve user experience.

[0005] In a first aspect, the present application provides an audio signal encoding method, comprising: obtaining a current frame of an audio signal, the current frame comprising a high-frequency band signal and a low-frequency band signal; obtaining a frequency band extension parameter of the current frame according to the high-frequency band signal, the low-frequency band signal and preset frequency band extension configuration information; obtaining frequency region information, the frequency region information being used to indicate a first frequency range in the high-frequency band signal where tone component detection is required; performing tone component detection in the first frequency range to obtain information on the tone components of the high-frequency band signal; and performing code stream multiplexing on the frequency band extension parameters and the tone component information to obtain a payload code stream.

[0006] Therefore, in an embodiment of the present application, the tone component can be detected according to the frequency range indicated by the frequency region information, and the frequency range is determined according to the configuration information of the frequency band extension and the sampling frequency of the audio signal, so that the information of the detected tone component can cover more frequency ranges where the tone components between the high-frequency band signal and the low-frequency band signal are not similar, and encoding is performed according to the tone component information covering more frequency ranges, thereby improving the encoding quality.

[0007] In a possible implementation, the method provided in the first aspect may further include: multiplexing the frequency region information to obtain a configuration code stream. Therefore, in the implementation of the present application, the frequency region information may be sent to a decoding device via a configuration code stream, so that the decoding device may perform decoding according to the frequency range indicated by the frequency region information included in the configuration code stream, thereby being able to decode information on dissimilar tonal components in high-frequency band signals and low-frequency band signals, further improving decoding quality.

[0008] In a possible implementation, obtaining frequency region information may include: determining the frequency region information according to the sampling frequency of the audio signal and configuration information. In the implementation of the present application, the audio signal has one or more frames, and the corresponding frequency region information may be determined when encoding each frame, or the same frequency region information may be used for multiple frames. A variety of implementations are provided, which may be adjusted according to actual application scenarios.

[0009] In a possible implementation, the frequency region information may include at least one of the following: a first quantity, identification information, relationship information, or a frequency region change quantity, wherein the first quantity is the number of frequency regions within the first frequency range, the identification information is used to indicate whether the first frequency range is the same as the second frequency range corresponding to the frequency band extension indicated by the configuration information, the relationship information is used to indicate the size relationship between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range, and the frequency region change quantity is the number of frequency regions where there is a difference between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range. Therefore, the frequency range where tone component detection is required can be accurately determined based on the frequency region information.

[0010] In a possible implementation, the configuration information of the frequency band extension includes the frequency band extension upper limit and / or the second number, the second number being the number of frequency regions within the second frequency range; the above method may also include: determining the first number according to one or more of the encoding rate of the current frame, the number of channels of the audio signal, the sampling frequency of the audio signal, the frequency band extension upper limit, or the second number. Therefore, in the implementation of the present application, the number of frequency regions requiring tone component detection can be accurately determined according to one or more of the encoding rate of the current frame, the number of channels of the audio signal, the sampling frequency, the frequency band extension upper limit, or the second number.

[0011] In a possible implementation manner, the upper limit of the frequency band extension includes one or more of the following: the highest frequency in the second frequency range, the highest frequency point number, the highest frequency band number, or the highest frequency area number.

[0012] In a possible implementation, the number of channels of the audio signal is at least one; the above-mentioned determining the first number based on one or more of the coding rate of the current frame, the number of channels of the audio signal, the sampling frequency, the upper limit of the frequency band extension, or the second number may include: determining a first judgment identifier of the current channel in the current frame based on the coding rate and the number of channels of the current frame, the coding rate of the current frame being the coding rate of the current frame; determining the first number of the current channels based on the first judgment identifier in combination with the second number; or, determining the second judgment identifier of the current channel in the current frame based on the sampling frequency and the upper limit of the frequency band extension; determining the first number of the current channels based on the second judgment identifier in combination with the second number; or, determining the first judgment identifier of the current channel in the current frame based on the coding rate and the number of channels of the current frame, and determining the second judgment identifier of the current channel in the current frame based on the sampling frequency and the upper limit of the frequency band extension; determining the first number of the current channels in the current frame based on the first judgment identifier and the second judgment identifier in combination with the second number.

[0013] Therefore, in the implementation manner of the present application, the first number can be determined by combining the second number in a variety of ways, so as to accurately determine the number of frequency regions that require tone component detection.

[0014] In a possible implementation, determining a first judgment identifier of a current channel in a current frame based on a coding rate and the number of channels of a current frame may include: obtaining an average coding rate of each channel in the current frame based on the coding rate and the number of channels of the current frame; and obtaining a first judgment identifier of the current channel based on the average coding rate and a first threshold.

[0015] In the implementation manner of the present application, a first judgment flag of the current channel can be obtained according to the average coding rate, so as to indicate whether the average coding rate is greater than a first threshold value by the first judgment flag, so that the first number obtained subsequently is more accurate.

[0016] In a possible implementation, the above-mentioned determination of the first judgment identifier of the current channel in the current frame based on the coding rate and the number of channels of the current frame may also include: determining the actual coding rate of the current channel based on the coding rate and the number of channels of the current frame; and obtaining the first judgment identifier of the current channel based on the actual coding rate of the current channel and a second threshold.

[0017] In the implementation manner of the present application, an actual coding rate may be allocated to each channel, so that the first judgment mark is used to indicate whether the actual coding rate of the current channel is greater than the second threshold, so that the first number obtained subsequently is more accurate.

[0018] In a possible implementation, the above-mentioned determination of the second judgment identifier of the current channel in the current frame based on the sampling frequency and the frequency band extension upper limit may include: when the frequency band extension upper limit includes the highest frequency, comparing whether the highest frequency included in the frequency band extension upper limit is the same as the highest frequency of the audio signal, and determining the second judgment identifier of the current channel in the current frame; or, when the frequency band extension upper limit includes the highest frequency band sequence number, comparing whether the highest frequency band sequence number included in the frequency band extension upper limit is the same as the highest frequency band sequence number of the audio signal, and determining the second judgment identifier of the current channel in the current frame, and the highest frequency band sequence number of the audio signal is determined by the sampling frequency.

[0019] In an implementation manner of the present application, the second judgment identifier can be determined by comparing the highest frequency included in the upper limit of the frequency band extension with the highest frequency of the audio signal, or by comparing the highest frequency point number, the highest frequency band number or the highest frequency area number included in the upper limit of the frequency band extension with the highest frequency point number, the highest frequency band number or the highest frequency area number corresponding to the audio signal to determine whether the highest frequency of the audio signal exceeds the frequency upper limit of the frequency band extension, thereby obtaining a more accurate first quantity.

[0020] In a possible implementation, the above-mentioned determination of the first number of current channels in the current frame may include: if both the first judgment identifier and the second judgment identifier meet the preset conditions, then adding one or more frequency regions based on the second number corresponding to the frequency band extension as the first number of current channels; or if the first judgment identifier or the second judgment identifier does not meet the preset conditions, then using the second number corresponding to the frequency band extension as the first number of current channels.

[0021] Therefore, in the implementation manner of the present application, when both the first judgment mark and the second judgment mark meet the preset conditions, it means that the frequency range of the tone component to be detected exceeds the frequency range corresponding to the frequency band extension, and the number of frequency regions needs to be increased so that the number of frequency regions for tone component detection can cover the frequency range corresponding to the frequency band extension, so that the information of the tone component finally obtained can cover the information of all tone components in the current frame of the tone signal, thereby improving the encoding quality. When the first judgment mark or the second judgment mark does not meet the preset conditions, the tone detection can be performed on the frequency range corresponding to the frequency band extension in the current frame, and the information of all tone components in the current frame can also be completely covered, thereby improving the encoding quality.

[0022] In one possible implementation, the lower limit of the first frequency range is the same as the lower limit of the second frequency range for frequency band expansion indicated by the configuration information; when the frequency region information includes a first number that is less than or equal to a second number corresponding to the frequency band expansion, the distribution of frequency regions within the first frequency range is the same as the distribution of frequency regions within the second frequency range indicated in the configuration information; when the first number is greater than the second number, the upper frequency limit of the first frequency range is greater than the upper frequency limit of the second frequency range, the distribution of frequency regions in the overlapping part of the first frequency range and the second frequency range is the same as the distribution of frequency regions in the second frequency range, and the distribution of frequency regions in the non-overlapping part of the first frequency range with the second frequency range is determined according to a preset method.

[0023] Therefore, in an embodiment of the present application, the lower limit of the first frequency range is the same as the lower limit of the second frequency range of the frequency band extension. Subsequently, the division method of the frequency regions within the first frequency range can be determined by comparing the number of frequency regions within the first frequency range with the number of frequency regions within the second frequency range, thereby accurately determining the frequency regions included in the first frequency range.

[0024] In a possible implementation, the frequency region in the non-overlapping portion of the first frequency range and the second frequency range satisfies the following conditions: the width of the frequency region in the non-overlapping portion of the first frequency range and the second frequency range is less than or equal to a preset value, and the upper frequency limit of the frequency region in the non-overlapping portion of the first frequency range and the second frequency range is less than or equal to the highest frequency of the audio signal. Therefore, in the implementation of the present application, the division method for the non-overlapping portion of the first frequency range and the second frequency range can be limited, that is, the width does not exceed the preset value, and the upper frequency limit of the frequency region is less than or equal to the highest frequency of the audio signal, so that a more reasonable division of the frequency region can be achieved.

[0025] In a possible implementation, the implementation of the present application divides the frequency range, and the first frequency range can be divided into one or more frequency regions, each of which can be divided into one or more frequency bands. In addition, the frequency bands in the frequency range can be sorted, and each frequency band has a different serial number, so that the magnitude of the frequency can be compared by comparing the serial numbers of the frequency bands.

[0026] In a possible implementation, the number of frequency regions within the first frequency range is a preset number. Therefore, in the implementation of the present application, the number of frequency regions that require tone component detection may also be set to a preset number, thereby directly reducing the workload.

[0027] Optionally, when the number of frequency regions within the first frequency range is a preset number, the preset number may be written into the configuration code stream or may not be written into the configuration code stream.

[0028] In a possible implementation manner, the information of the tone component may include a position quantity parameter of the tone component and an amplitude parameter or an energy parameter of the tone component.

[0029] In a possible implementation manner, the tone component information may also include a noise floor parameter of a high-frequency band signal.

[0030] In a second aspect, the present application provides a decoding method, comprising: obtaining a payload code stream; demultiplexing the payload code stream to obtain frequency band extension parameters and tone component information of a current frame of an audio signal; obtaining a high-frequency band signal of the current frame according to the frequency band extension parameters; reconstructing according to the tone component information and frequency region information to obtain a reconstructed tone signal, the frequency region information being used to indicate a first frequency range in the current frame in which tone component reconstruction is required; obtaining a decoded signal of the current frame according to the high-frequency band signal and the reconstructed tone signal.

[0031] In an embodiment of the present application, the frequency range in which the tone components need to be reconstructed can be determined based on the frequency region information. The frequency range is determined based on the configuration information of the frequency band extension and the sampling frequency of the audio signal. Thus, the tone components of the dissimilar components between the high-frequency band signal and the low-frequency band signal can be reconstructed based on the frequency region information, thereby improving the decoding quality.

[0032] In a possible implementation, the method may further include: obtaining a configuration code stream; and obtaining frequency region information according to the configuration code stream. Therefore, in the implementation of the present application, decoding can be performed according to the frequency range indicated by the frequency region information included in the configuration code stream, so that information of dissimilar tone components in the high-frequency band signal and the low-frequency band signal can be decoded, thereby improving decoding quality.

[0033] In one possible implementation, the frequency region information may include at least one of the following: a first quantity, identification information, relationship information, or a frequency region change quantity, wherein the first quantity is the number of frequency regions within the first frequency range, the identification information is used to indicate whether the first frequency range is the same as the second frequency range corresponding to the frequency band extension, the relationship information is used to indicate the size relationship between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range, and the frequency region change quantity is the number of frequency regions that have differences between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range.

[0034] In a possible implementation, reconstruction is performed based on tone component information and frequency region information to obtain a reconstructed tone signal, including: determining, based on the frequency region information, the number of frequency regions where tone components need to be reconstructed as a first number; based on the first number, determining each frequency region for tone component reconstruction within a first frequency range; within the first frequency range, reconstructing the tone components based on the tone component information to obtain a reconstructed tone signal.

[0035] Therefore, in the embodiments of the present application, the tone components can be reconstructed based on the frequency range indicated by the frequency region information, so that the information of dissimilar tone components in the high-frequency band signal and the low-frequency band signal can be decoded, thereby improving the decoding quality.

[0036] In a possible implementation, the lower limit of the first frequency range is the same as the lower limit of the second frequency range for band extension indicated by the configuration information, and the above-mentioned determination of each frequency region for tone component reconstruction in the first frequency range according to the first number may include: if the first number is less than or equal to the second number, the distribution of frequency regions in the first frequency range is determined according to the distribution of frequency regions in the second frequency range, and the second number is the number of frequency regions in the second frequency range; if the first number is greater than the second number, the upper frequency limit of the first frequency range is determined to be greater than the upper frequency limit of the second frequency range, and the distribution of frequency regions in the overlapping part of the first frequency range and the second frequency range is determined according to the distribution of frequency regions in the second frequency range, and the distribution of frequency regions in the non-overlapping part of the first frequency range and the second frequency range is determined in a preset manner, so as to obtain the distribution of each frequency region in the first frequency range. In the implementation of the present application, the lower limit of the first frequency range is the same as the lower limit of the second frequency range for band extension, and the number of frequency regions in the first frequency range can be compared with the number of frequency regions in the second frequency range to determine the division method of the frequency regions in the first frequency range, so as to accurately determine the frequency regions included in the first frequency range.

[0037] In a possible implementation, the frequency region within the non-overlapping portion of the first frequency range and the second frequency range satisfies the following conditions: the width of the frequency region within the non-overlapping portion of the first frequency range and the second frequency range is less than or equal to a preset value, and the upper frequency limit of the frequency region within the non-overlapping portion of the first frequency range and the second frequency range is less than or equal to the highest frequency of the audio signal. Therefore, in the implementation of the present application, the division method for the non-overlapping portion of the first frequency range with the second frequency range can be limited, that is, the width does not exceed the preset value, and the upper frequency limit of the frequency region is less than or equal to the highest frequency of the audio signal, so that a more reasonable division of the frequency region can be achieved.

[0038] In a third aspect, the present application provides an encoding device, including:

[0039] An audio acquisition module, used to acquire a current frame of an audio signal, the current frame including a high-frequency band signal and a low-frequency band signal;

[0040] A parameter acquisition module, used to obtain the frequency band extension parameters of the current frame according to the high frequency band signal, the low frequency band signal and the preset frequency band extension configuration information;

[0041] A frequency acquisition module, used for acquiring frequency region information, where the frequency region information is used for indicating a first frequency range in the high frequency band signal where tone component detection is required;

[0042] A tone component encoding module, used for performing tone component detection in a first frequency range to obtain information on the tone components of a high frequency band signal;

[0043] The code stream multiplexing module is used to perform code stream multiplexing on the information of the frequency band extension parameters and the tone components to obtain a payload code stream.

[0044] The beneficial effects produced by the third aspect and any possible implementation manner of the third aspect can be referred to the description of the first aspect and any possible implementation manner of the first aspect.

[0045] In a possible implementation manner, the encoding device may further include:

[0046] The code stream multiplexing module is also used to perform code stream multiplexing on the frequency region information to obtain a configuration code stream.

[0047] In a possible implementation manner, the frequency acquisition module is specifically configured to determine the frequency region information according to the sampling frequency of the audio signal and the configuration information of the frequency band extension.

[0048] In one possible implementation, the frequency region information includes at least one of the following: a first quantity, identification information, relationship information, or a frequency region change quantity, wherein the first quantity is the number of frequency regions within the first frequency range, the identification information is used to indicate whether the first frequency range is the same as the second frequency range corresponding to the frequency band extension, the relationship information is used to indicate the size relationship between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range, and the frequency region change quantity is the number of frequency regions that have differences between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range.

[0049] In a possible implementation manner, the frequency region information includes at least a first quantity, and the configuration information of the frequency band extension includes a frequency band extension upper limit and / or a second quantity, where the second quantity is the number of frequency regions within the second frequency range;

[0050] The frequency acquisition module is specifically used to determine the first quantity according to one or more of the encoding rate of the current frame, the number of channels of the audio signal, the sampling frequency, the upper limit of the frequency band extension, or the second quantity.

[0051] In a possible implementation manner, the upper limit of the frequency band extension includes one or more of the following: the highest frequency in the second frequency range, the highest frequency point number, the highest frequency band number, or the highest frequency area number.

[0052] In a possible implementation manner, the number of channels of the audio signal is at least one;

[0053] The frequency acquisition module is specifically used for:

[0054] Determine a first determination mark of a current channel in the current frame according to the encoding rate and the number of channels of the current frame, the encoding rate of the current frame being the encoding rate of the current frame; determine a first number of the current channel according to the first determination mark in combination with the second number;

[0055] or,

[0056] Determine a second determination mark of the current channel in the current frame according to the sampling frequency and the upper limit of the frequency band extension; determine a first number of the current channel according to the second determination mark and in combination with the second number;

[0057] or,

[0058] According to the encoding rate and the number of channels of the current frame, a first judgment identifier of the current channel in the current frame is determined, and according to the sampling frequency and the upper limit of the frequency band expansion, a second judgment identifier of the current channel in the current frame is determined; according to the first judgment identifier and the second judgment identifier, combined with the second number, the first number of the current channels in the current frame is determined.

[0059] In a possible implementation, the frequency acquisition module is specifically used to: obtain an average coding rate of each channel in the current frame according to the coding rate and the number of channels of the current frame; and obtain a first determination mark of the current channel according to the average coding rate and a first threshold.

[0060] In a possible implementation, the frequency acquisition module may be specifically used to: determine the actual coding rate of the current channel according to the coding rate of the current frame and the number of channels; and obtain a first determination identifier of the current channel according to the actual coding rate of the current channel and a second threshold.

[0061] In one possible implementation, the frequency acquisition module can be specifically used to: when the frequency band extension upper limit includes the maximum frequency, compare whether the maximum frequency included in the frequency band extension upper limit is the same as the maximum frequency of the audio signal, and determine the second judgment identifier of the current channel in the current frame; or, when the frequency band extension upper limit includes the highest frequency band sequence number, compare whether the highest frequency band sequence number included in the frequency band extension upper limit is the same as the highest frequency band sequence number of the audio signal, and determine the second judgment identifier of the current channel in the current frame, and the highest frequency band sequence number of the audio signal is determined by the sampling frequency.

[0062] In a possible implementation manner, the frequency acquisition module may be specifically used to:

[0063] If both the first determination mark and the second determination mark meet the preset condition, one or more frequency regions are added based on the second number corresponding to the frequency band extension as the first number of the current channel; or

[0064] If the first judgment flag or the second judgment flag does not meet the preset condition, the second number corresponding to the frequency band extension is used as the first number of the current channel.

[0065] In one possible implementation, the lower limit of the first frequency range is the same as the lower limit of the second frequency range for frequency band expansion indicated by the configuration information; when the frequency region information includes a first number that is less than or equal to a second number corresponding to the frequency band expansion, the distribution of frequency regions within the first frequency range is the same as the distribution of frequency regions within the second frequency range; when the first number is greater than the second number, the upper frequency limit of the first frequency range is greater than the upper frequency limit of the second frequency range, the distribution of frequency regions in the overlapping part of the first frequency range and the second frequency range is the same as the distribution of frequency regions within the second frequency range, and the distribution of frequency regions in the non-overlapping part of the first frequency range and the second frequency range is determined according to a preset method.

[0066] In a possible implementation, the width of the frequency region within the non-overlapping portion of the first frequency range and the second frequency range is less than a preset value, and the upper frequency limit of the frequency region within the non-overlapping portion of the first frequency range and the second frequency range is less than or equal to the highest frequency of the audio signal.

[0067] In a possible implementation manner, the frequency range corresponding to the high-frequency band signal includes at least one frequency region, wherein a frequency region includes at least one frequency band.

[0068] In a possible implementation manner, the number of frequency regions within the first frequency range is a preset number.

[0069] In a possible implementation manner, the tone component information includes a position quantity parameter of the tone component and an amplitude parameter or an energy parameter of the tone component.

[0070] In a possible implementation manner, the tone component information further includes a noise floor parameter of a high frequency band signal.

[0071] In a fourth aspect, the present application provides a decoding device, including:

[0072] The acquisition module is used to obtain the payload code stream;

[0073] A demultiplexing module, used for demultiplexing the payload code stream to obtain the frequency band extension parameters and tone component information of the current frame of the audio signal;

[0074] A frequency band extension decoding module, used for obtaining a high frequency band signal of a current frame according to frequency band extension parameters;

[0075] A reconstruction module, used for reconstructing according to the information of the tone component and the frequency region information to obtain a reconstructed tone signal, wherein the frequency region information is used for indicating a first frequency range in the current frame where the tone component needs to be reconstructed;

[0076] The signal decoding module is used to obtain a decoded signal of a current frame according to the high-frequency band signal and the reconstructed tone signal.

[0077] The beneficial effects produced by the fourth aspect and any possible implementation manner of the fourth aspect can be referred to the description of the second aspect and any possible implementation manner of the second aspect.

[0078] In a possible implementation manner, the acquisition module may also be used to: acquire a configuration code stream; and acquire frequency region information according to the configuration code stream.

[0079] In one possible implementation, the frequency region information includes at least one of the following: a first quantity, identification information, relationship information, or a frequency region change quantity, wherein the first quantity is the number of frequency regions within the first frequency range, the identification information is used to indicate whether the first frequency range is the same as the second frequency range corresponding to the frequency band extension, the relationship information is used to indicate the size relationship between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range, and the frequency region change quantity is the number of frequency regions that have differences between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range.

[0080] In one possible implementation, the reconstruction module can be specifically used to: determine, based on frequency region information, the number of frequency regions that require tone component reconstruction as a first number; determine, based on the first number, the frequency regions in a first frequency range for tone component reconstruction; and within the first frequency range, reconstruct the tone components based on the tone component information to obtain a reconstructed tone signal.

[0081] In a possible implementation, the lower limit of the first frequency range is the same as the lower limit of the second frequency range for frequency band expansion indicated by the configuration information. The acquisition module can be specifically used to: if the first number is less than or equal to the second number, determine the frequency area within the overlapping part of the first frequency range and the second frequency range according to the distribution of frequency areas within the second frequency range, and the second number is the number of frequency areas within the second frequency range; if the first number is greater than the second number, determine that the frequency upper limit of the first frequency range is greater than the frequency upper limit of the second frequency range, determine the distribution of frequency areas within the overlapping part of the first frequency range and the second frequency range according to the distribution of frequency areas within the second frequency range, and determine the distribution of frequency areas within the non-overlapping part of the first frequency range and the second frequency range according to a preset method, so as to obtain the distribution of each frequency area within the first frequency range.

[0082] In one possible implementation, the frequency region divided within the non-overlapping portion of the first frequency range and the second frequency range satisfies the following conditions: the width of the frequency region divided within the non-overlapping portion of the first frequency range and the second frequency range is less than a preset value, and the frequency upper limit of the frequency region divided within the non-overlapping portion of the first frequency range and the second frequency range is less than or equal to the highest frequency of the audio signal.

[0083] In a possible implementation manner, the tone component information includes a position quantity parameter of the tone component and an amplitude parameter or an energy parameter of the tone component.

[0084] In a possible implementation manner, the tone component information further includes a noise floor parameter of a high frequency band signal.

[0085] In a fifth aspect, the present application provides an encoding device, comprising: a processor and a memory, wherein the processor and the memory are interconnected via a line, and the processor calls the program code in the memory to execute the processing-related functions in the audio signal encoding method shown in any one of the first aspects above.

[0086] In a sixth aspect, the present application provides a decoding device, comprising: a processor and a memory, wherein the processor and the memory are interconnected via a line, and the processor calls the program code in the memory to execute the processing-related functions in the decoding method shown in any two items of the second aspect above.

[0087] In a seventh aspect, the present application provides a communication system, comprising: an encoding device and a decoding device, the encoding device being used to execute the audio signal encoding method shown in any one of the first aspect above, and the decoding device being used to execute the decoding method shown in any two of the second aspect above.

[0088] In an eighth aspect, an embodiment of the present application provides a digital processing chip, the chip comprising a processor and a memory, the memory and the processor being interconnected by lines, instructions being stored in the memory, and the processor being used to execute functions related to processing in the above-mentioned first aspect or any optional implementation manner of the first aspect, or the second aspect or any optional implementation manner of the second aspect.

[0089] In the ninth aspect, an embodiment of the present application provides a computer-readable storage medium, comprising instructions, which, when executed on a computer, enables the computer to execute the method of the above-mentioned first aspect or any optional implementation manner of the first aspect, or the second aspect or any optional implementation manner of the second aspect.

[0090] In the tenth aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the method of the above-mentioned first aspect or any optional implementation manner of the first aspect, or the second aspect or any optional implementation manner of the second aspect.

[0091] In an eleventh aspect, the present application provides a network device, which can be applied to a device such as an encoding device or a decoding device, and the network device is coupled to a memory, and is used to read and execute instructions stored in the memory, so that the network device implements the steps of the method provided in any implementation of any aspect of the first to second aspects of the present application. In a possible design, the port detection device is a chip or a system on a chip. BRIEF DESCRIPTION OF THE DRAWINGS

[0092] Figure 1 A schematic diagram of the architecture of a communication system provided for this application;

[0093] Figure 2 A schematic diagram of the structure of another communication system provided for this application;

[0094] Figure 3 A schematic diagram of the structure of a coding and decoding device provided by this application;

[0095] Figure 4 A schematic diagram of the structure of another encoding and decoding device provided by this application;

[0096] Figure 5 A flowchart of an audio signal encoding method provided by the present application;

[0097] Fig. 6A A schematic diagram of a frequency region division method provided in an embodiment of the present application;

[0098] Figure 6B A schematic diagram of another frequency region division method provided in an embodiment of the present application;

[0099] Figure 6C A schematic diagram of another frequency region division method provided in an embodiment of the present application;

[0100] Figure 7 A flowchart of a decoding method provided by the present application;

[0101] Figure 8 A schematic diagram of the structure of an encoding device provided in this application;

[0102] Fig. 9 A schematic diagram of the structure of a decoding device provided by the present application;

[0103] Fig.10 A schematic diagram of the structure of another encoding device provided by this application;

[0104] Fig.11 A schematic diagram of the structure of another decoding device provided in this application. DETAILED DESCRIPTION

[0105] The present application provides an audio signal encoding method, a decoding method, an encoding device and a decoding device, which are used to achieve higher quality audio encoding and decoding and improve user experience.

[0106] Firstly, the audio signal encoding method and decoding method provided by the present application can be applied to various systems with data transmission.

[0107] For example, see Figure 1 , a schematic diagram of the architecture of a communication system provided in this application.

[0108] The communication system may include multiple devices, such as terminals or servers, etc., and the multiple devices may be connected via a network.

[0109] The network can be a wired communication network or a wireless communication network, such as: the fifth generation mobile communication technology (5th-Generation, 5G) system, long term evolution (long term evolution, LTE) system, global system for mobile communication (global system for mobile communication, GSM) or code division multiple access (code division multiple access, CDMA) network, wideband code division multiple access (wideband code division multiple access, WCDMA) network, etc., and can also be wireless fidelity (wireless fidelity, WiFi), wide area network and other communication networks or communication systems.

[0110] The number of the terminal devices can be one or more. Figure 1 The terminal 1, terminal 2 or terminal 3 shown in the figure. Specifically, the terminal in the communication system may include a head mounted display device (Head Mount Display, HMD), the head mounted display device may be a combination of a VR box and a terminal, a VR all-in-one machine, a personal computer (personal computer, PC) VR, an augmented reality (augmented reality, AR) device, a mixed reality (mixed reality, MR) device, etc. The terminal device may also include a cellular phone (cellular phone), a smart phone (smart phone), a personal digital assistant (personal digital assistant, PDA), a tablet computer, a laptop computer (laptop computer), a personal computer (personal computer, PC), or a computing device deployed on the user side, etc.

[0111] The number of servers can be one or more. When there are multiple servers in the communication system, the multiple servers can be distributed servers or centralized servers. The specific adjustments can be made according to the actual application scenario, and this application does not limit this.

[0112] Specifically, the aforementioned terminal or server, etc., can be used as an encoding device or a decoding device. It can be understood that the aforementioned terminal or server can execute the audio signal encoding method provided by the present application, and can also execute the decoding method used by the present application. Of course, the encoding device and the decoding device can also be independent of each other, for example, one of the terminals can be used as an encoding device and the other terminal can be used as a decoding device.

[0113] More specifically, see Figure 2 , below, taking two terminals as an example, the communication system provided by this application is explained in more detail.

[0114] Wherein, both terminal 1 and terminal 2 may include an audio acquisition module, a multi-channel encoder, a channel encoder, a channel decoder, a multi-channel decoder and an audio playback module.

[0115] The following is a brief exemplary description of the method for encoding an audio signal by terminal 1 and the method for decoding by terminal 2. The specific steps of the steps can be referred to as follows: Figure 4 or Figure 5 Description in .

[0116] The audio acquisition module of the terminal 1 can acquire the audio signal. The audio acquisition module may include devices such as sensors, microphones, cameras, and recorders, or the audio acquisition module may directly receive audio signals sent by other devices.

[0117] If the audio signal is a multi-channel signal, the audio signal is encoded by a multi-channel encoder, and then the signal encoded by the multi-channel encoder is encoded by a channel encoder to obtain an encoded bit stream.

[0118] The coded code stream is then transmitted to the network device 1 in the communication network, which transmits it to the network device 2 through a digital channel, and then the network device 2 transmits the coded code stream to the terminal 2. The network device 1 or the network device 2 may be a forwarding device in the communication network, such as a router or a switch.

[0119] After receiving the coded code stream, the terminal 2 performs channel decoding on the coded code stream through a channel decoder to obtain a channel-decoded signal.

[0120] Then, the multi-channel decoder performs multi-channel decoding on the signal after channel decoding to obtain an audio signal. The audio playback module can play back the audio signal. The audio playback module may include devices such as speakers or headphones.

[0121] In addition, the audio signal can also be collected by the audio collection module of terminal 2, and a coded stream can be obtained through a multi-channel encoder and a channel encoder, and the coded stream can be sent to terminal 1 through a communication network. Then, the audio signal is decoded by a channel decoder and a multi-channel decoder of terminal 1 to obtain an audio signal, and the audio can be played through the audio playback module of terminal 1.

[0122] In another scenario, the encoding device in the communication system may be a forwarding device that does not have audio acquisition and audio playback functions. Figure 3 As shown, a schematic diagram of the structure of a coding device provided by the present application. Among them, the coding device may include a channel decoder 301, an audio decoder 302, a multi-channel encoder 303 and a channel encoder 304. When a coded stream is received, channel decoding can be performed by the channel decoder 301 to obtain a channel decoded signal. Then, the audio decoder 302 performs audio decoding on the channel decoded signal to obtain an audio signal. Subsequently, the multi-channel encoder 303 performs multi-channel encoding on the audio signal to obtain a multi-channel encoded signal, and finally, the channel encoder 304 performs channel encoding on the multi-channel encoded signal to obtain an updated coded stream, and the updated coded stream is sent to other devices to complete the forwarding of the coded stream.

[0123] In different scenarios, the types of encoders and decoders used may also be different. For example, Figure 4 As shown, after receiving the coded bitstream and decoding it through the channel decoder 401 to obtain a channel-decoded signal, the multi-channel decoder 402 performs multi-channel decoding on the channel-decoded signal to restore the audio signal. Then, the audio encoder 403 encodes the audio signal, and the channel encoder 404 performs channel encoding on the data encoded by the audio encoder 403 to obtain an updated coded bitstream.

[0124] In addition, the above-mentioned scenario of multi-channel audio signals is introduced. The aforementioned multi-channels can also be replaced by stereo signals, dual-channel signals, etc. Taking stereo signals as an example, the aforementioned multi-channel audio signals can be replaced by stereo signals, the multi-channel encoder can be replaced by a stereo encoder, or the multi-channel decoder can be replaced by a stereo decoder, etc.

[0125] The following takes a specific scenario as an example to introduce the encoding process of the audio signal. Three-dimensional audio has become a new trend in the development of audio services because it can bring users a better immersive experience. Three-dimensional audio can be understood as audio that includes multi-channels. To implement three-dimensional audio services, the original audio signal format that needs to be compressed and encoded can be divided into: channel-based audio signal format, object-based audio signal format, scene-based audio signal format, and a mixed signal format of any three audio signal formats. For the audio signals of the aforementioned formats, the audio signals that the audio encoder needs to compress and encode include multi-channel signals, which can also be understood as multiple channels. Generally, the audio encoder uses the correlation between channels to downmix the multi-channel signals to obtain a downmix signal and a multi-channel encoding parameter. Generally, the number of channels included in the downmix signal is much smaller than the number of channels of the input audio signal. For example, the multi-channel signal can be downmixed into a stereo signal. Then, the downmix signal is encoded. It is also possible to further downmix the stereo signal into a mono signal and a stereo encoding parameter, and encode the mono signal after blind mixing. The number of bits used to encode the downmix signal and the multi-channel encoding parameters is much smaller than that used to independently encode the multi-channel input signal, thereby reducing the workload of the encoder and the amount of data of the encoded bitstream obtained after encoding, thereby improving transmission efficiency.

[0126] In addition, in order to reduce the coding bit rate, the correlation between signals in different frequency bands is often further used for coding. The coding device encodes the low-frequency band signal and the correlation data between the low-frequency band signal and the high-frequency band, so as to encode the high-frequency band signal with a smaller number of bits, thereby reducing the coding bit rate of the entire encoder. For example, in the Enhanced Voice Services (EVS) codec in the 3rd Generation Partnership Project (3GPP), or the Moving Picture Experts Group (MPEG) codec, the correlation between signals in different frequency bands is utilized during the coding process, and the frequency band extension technology or spectrum replication technology is used to encode the high-frequency band signal. However, in actual audio signals, there are often some tone components in the spectrum of the high-frequency band that are not similar to the spectrum of the low-frequency band. If the dissimilar tone components are not encoded and reconstructed, it may lead to low quality of audio and video coding and decoding.

[0127] Therefore, the present application provides an audio signal encoding method and a decoding method for improving the encoding and decoding quality of audio signals. Even in a scenario where there are tonal components in the spectrum of the high-frequency band that are dissimilar to the spectrum of the low-frequency band, a high-quality encoded bitstream can be obtained, so that the decoding end can decode and obtain a high-quality audio signal, thereby improving the user experience.

[0128] The audio signal encoding method and decoding method provided in the present application are described in detail below.

[0129] First, the audio signal encoding method provided by the present application is introduced. Figure 5 , a flow chart of an audio signal encoding method provided in the present application is as described below.

[0130] 501. Obtain a current frame of an audio signal.

[0131] The current frame may be any frame in the audio signal, and the current frame may include a high-frequency band signal and a low-frequency band signal, wherein the frequency of the high-frequency band signal is higher than the frequency of the low-frequency band signal. The division of the high-frequency band signal and the low-frequency band signal may be determined by a frequency band threshold, wherein a signal higher than the frequency band threshold is a high-frequency band signal, and a signal lower than the frequency band threshold is a low-frequency band signal, and the determination of the frequency band threshold may be determined according to the transmission bandwidth and the processing capability of the encoder or decoder, and the present application does not limit this.

[0132] Among them, high-frequency band signals and low-frequency band signals are relative. For example, signals below a certain frequency (i.e., frequency band threshold) are low-frequency band signals, but signals above this frequency are high-frequency band signals (signals corresponding to this frequency can be classified as either low-frequency band signals or high-frequency band signals). The frequency will be different depending on the bandwidth of the current frame. For example, when the current frame is a broadband signal of 0-8khz, the frequency can be 4khz; when the current frame is an ultra-wideband signal of 0-16khz, the frequency can be 8khz.

[0133] It should be noted that the audio signal in the embodiment of the present application may include multiple frames. For example, the current frame may specifically refer to a certain frame in the audio signal. The encoding and decoding of the current frame of the audio signal is used as an example in the embodiment of the present application. The previous frame or the next frame of the current frame in the audio signal can be correspondingly encoded and decoded according to the encoding and decoding method of the current frame audio signal. The encoding and decoding process of the previous frame or the next frame of the current frame in the audio signal is no longer described one by one. In addition, the audio signal in the embodiment of the present application may be a monophonic audio signal, or it may be a stereo signal (or a multi-channel signal). Among them, the stereo signal may be the original stereo signal, or it may be a stereo signal composed of two signals (left channel signal and right channel signal) included in the multi-channel signal, or it may be a stereo signal composed of two signals generated by at least three signals included in the multi-channel signal, which is not limited in the embodiment of the present application.

[0134] It should also be noted that, in the implementation manner of the present application, the audio signal can be a multi-channel signal or a single-channel signal. When the audio signal is a multi-channel signal, the signal of each channel can be encoded. In the implementation manner of the present application, only the encoding process of the signal of one of the channels (hereinafter referred to as the current channel) is used as an example for exemplary description. In practical applications, the following steps 502-506 can be performed for each channel in the audio signal, and the present application will not repeat the repeated steps. It should be understood that the channels mentioned in the present application can also be replaced by channels. For example, the aforementioned multi-channels can also be replaced by multi-channels. For ease of understanding, they are referred to as channels in the following implementation manner.

[0135] 502. Obtain frequency band extension parameters of the current frame according to the high frequency band signal, the low frequency band signal and preset frequency band extension configuration information.

[0136] In the process of encoding the high-band signal and the low-band signal, the high-band can be divided into multiple frequency regions. The parameters of the frequency band extension can be determined in units of frequency regions, that is, each frequency region has its own frequency band extension parameters.

[0137] Specifically, the parameters of the frequency band extension may include different parameters in different scenarios, and the parameters specifically included in the parameters of the frequency band extension can be determined according to the actual application scenario. For example, in the scenario of time domain bandwidth extension, the parameters of the frequency band extension may include high-frequency band linear predictive coding (LPC) parameters, high-frequency band gain or filtering parameters, etc. In the scenario of frequency domain bandwidth extension, the parameters of the frequency band extension may also include parameters such as time domain envelope or frequency domain envelope.

[0138] The configuration information of the frequency band extension may be pre-configured information, which may be specifically determined according to the data processing capability of the encoder or decoder. In a possible implementation, the configuration information of the frequency band extension may include a frequency band extension upper limit or a second number, etc., and the second number is the number of frequency regions for frequency band extension. Specifically, the second frequency range corresponding to the frequency band extension may be indicated by the frequency band extension upper limit or the second number. For example, the frequency lower limit of the second frequency range may generally be fixed, such as the frequency band threshold in the aforementioned step 501, and the frequency upper limit of the second frequency range may be indicated by the frequency band extension upper limit, so that the second frequency range may be determined according to the determined frequency lower limit and frequency upper limit. For another example, if the configuration information includes a second number, the frequency lower limit of the second frequency range may generally be fixed, such as the frequency band threshold in the aforementioned step 501, then the boundary of the frequency region corresponding to the second frequency may be queried through a preset table, thereby determining the second frequency range.

[0139] Specifically, the upper limit of the frequency band extension included in the configuration information of the frequency band extension may include, but is not limited to, one or more of the following: the value of the highest frequency within the second frequency range, the highest frequency point sequence number, the highest frequency band sequence number, or the highest frequency area sequence number. Among them, the highest frequency point sequence number within the second frequency range is the sequence number of the frequency point with the highest frequency within the second frequency range, the highest frequency band sequence number is the sequence number of the frequency band with the highest frequency within the second frequency range, and the highest frequency area sequence number is the sequence number of the frequency area with the highest frequency within the second frequency range. Among them, the aforementioned highest frequency point sequence number, the highest frequency band sequence number, and the highest frequency area sequence number may increase with the increase of the frequency value, for example, the sequence number of the lower frequency point is less than the sequence number of the higher frequency point, the sequence number of the lower frequency band is less than the sequence number of the higher frequency band, and the sequence number of the lower frequency area is less than the sequence number of the higher frequency area. It should be noted that the numbering of the frequency point, frequency band, or frequency area may be numbered according to a preset order, or a fixed number may be assigned to each frequency point, frequency band, or frequency area, which may be adjusted according to the actual application scenario, and this application does not limit this.

[0140] In addition, according to the configuration information of the high-band signal, the low-band signal and the band extension, in addition to obtaining the parameters of the band extension of the current frame, the encoding parameters of the high-band signal or the low-band signal can also be obtained. For example, the time-domain noise shaping parameters, frequency-domain noise shaping parameters or spectrum quantization parameters of the high-band signal or the low-band signal can be obtained, wherein the time-domain noise shaping parameters and the frequency-domain noise shaping parameters are used to pre-process the spectral coefficients to be encoded, which can improve the quantization encoding efficiency of the spectral coefficients, and the spectrum quantization parameters are the quantized spectral coefficients and the corresponding gain parameters, etc.

[0141] 503. Get frequency region information

[0142] The frequency region information is used to indicate a first frequency range in a high frequency band signal of a current frame.

[0143] In the implementation manner of the present application, the frequency range that requires tone component detection is called the first frequency range, and the frequency range corresponding to the frequency band extension indicated by the configuration information is called the second frequency range, and the frequency lower limit of the first frequency range and the frequency lower limit of the second frequency range are the same, which will not be repeated below.

[0144] In a possible implementation manner, the frequency region information includes one or more of the following: a first quantity, identification information, relationship information, or a frequency region change quantity, and the like.

[0145] The first number is the number of frequency regions within the first frequency range.

[0146] It should be noted that in the present application, the frequency range can be divided into frequency tiles; each frequency tile can be divided into at least one frequency band according to a preset frequency band division method, and a frequency band can be understood as a scale factor band (SFB). For example, the frequency region can be divided into units of 1KHz, and then in each frequency region, the frequency band can be divided into units of 200Hz. It can be understood that the corresponding frequency widths of different frequency regions can be the same or different; the corresponding frequency widths of different frequency bands can be the same or different.

[0147] The identification information is used to indicate whether the first frequency range is the same as the second frequency range corresponding to the frequency band extension. For example, when the identification information includes 0, it indicates that the first frequency range is different from the second frequency range, and when the identification information includes 1, it indicates that the first frequency range is the same as the second frequency range.

[0148] The relationship information is used to indicate the size relationship between the first frequency range and the second frequency range. For example, 2 bits may be used to indicate the size relationship between the first frequency range and the second frequency range, such as the same, increasing or decreasing relationship. For example, when the relationship information includes 00, it indicates that the first frequency range is equal to the second frequency range; when the relationship information includes 01, it indicates that the first frequency range is greater than the second frequency range; when the relationship information includes 10, it indicates that the first frequency range is less than the second frequency range, etc.

[0149] The frequency region change number is the number of frequency regions that differ between the first frequency range and the second frequency range. For example, the frequency region change number may range from [-N, N], where N indicates that the first frequency range has N more frequency regions than the second frequency range, and -N indicates that the first frequency range has N fewer frequency regions than the second frequency range.

[0150] Typically, in actual application scenarios, the frequency region information includes at least the first quantity. Optionally, the frequency region information further includes but is not limited to one or more of identification information, relationship information, or a frequency region change quantity.

[0151] In addition, the first frequency range is indicated by the frequency region information, which can be understood as follows: when the frequency region information includes a first number, the boundary of each frequency region in the first number of frequency regions, that is, the frequency range covered by each frequency region, can be determined by querying a preset table, thereby obtaining the first frequency range. Among them, the lower boundary of the first frequency region in the first number of frequency regions is the lower boundary of the second frequency range for band expansion. It can be understood that when the first number of frequency regions are continuous in the frequency domain, the first frequency range can also be determined only based on the lower boundary of the first frequency region and the upper boundary of the last frequency region.

[0152] In addition, when the frequency region information includes identification information, if the identification information indicates that the first frequency range and the second frequency range are the same, the second frequency range can be used as the first frequency range. If the identification information indicates that the first frequency range and the second frequency range are not the same, the size relationship between the first frequency range and the second frequency range can be determined through the relationship information, for example, the first frequency range is greater than the second frequency range, or the second frequency range is greater than the first frequency range, etc. Of course, if the identification information indicates that the first frequency range and the second frequency range are the same, the frequency region information may also include relationship information, and at this time, the relationship information may also indicate that the first frequency range and the second frequency range are the same. When it is determined that the first frequency range and the second frequency range are not the same according to the identification information or the relationship information, the size relationship between the first frequency range and the second frequency range can be determined according to the relationship information, and then the number of frequency regions in the different frequency ranges between the first frequency range and the second frequency range is determined according to the number of frequency region changes, and then the specific range of the first frequency range is determined according to a preset method, such as looking up a table, according to a preset bandwidth planning method, etc. For example, if the first frequency range and the second frequency range are different, it is possible to determine which frequency range is larger between the first frequency range and the second frequency range based on the relational frequency information; if the first frequency range is larger than the second frequency range, a preset table may be queried based on the number of frequency regions of the non-overlapping portion of the first frequency range and the second frequency range, or the frequency regions may be divided according to a preset bandwidth to obtain the boundary of the frequency region of the non-overlapping portion of the first frequency range and the second frequency range, thereby determining the exact frequency range covered by the first frequency range.

[0153] Specifically, there are multiple ways to obtain frequency region information, which are introduced below respectively.

[0154] Method 1: determining the frequency region information according to the sampling frequency of the audio signal and the preset frequency band extension configuration information.

[0155] The frequency region information includes at least a first quantity, and the number of channels of the audio signal is at least one. The current channel in the at least one channel is taken as an example to exemplarily illustrate step 503. Step 503 may specifically include: determining the first number of the current channel according to one or more of the encoding rate of the current frame, the number of channels of the audio signal, the sampling frequency, the upper limit of the frequency band extension, or the second number.

[0156] Specifically, the first number can be determined according to the first judgment mark of the current channel, or according to the second judgment mark, or according to the first judgment mark and the second judgment mark of the current channel. Prior to this, the first judgment mark of each channel in the current frame can be determined according to the coding rate and the number of channels of the current frame, including the first judgment mark of the current channel, or the second judgment mark can be determined according to the sampling frequency and the upper limit of the frequency band expansion. The coding rate of the current frame is the total coding rate of all channels in the current frame.

[0157] More specifically, the specific manner of obtaining the first determination identifier of the current channel may include but is not limited to one or more of the following:

[0158] 1. According to the coding rate and the number of channels of the current frame, the average coding rate of each channel in the current frame is obtained; the average coding rate is compared with the first threshold value to obtain the first judgment mark of the current channel. For example, the average coding rate of each channel can be obtained by dividing the coding rate of the current frame by the number of channels. The average coding rate is compared with the first threshold value, and the first judgment mark of the current channel is obtained according to the comparison result. For example, when the average coding rate is higher than 24kbps (i.e., 24,000 bits per second) (i.e., the first threshold value, or other values, such as 32kbps or 128kbps, etc.), the value of the first judgment mark of the current channel is determined to be 1, and when the average coding rate is not higher than 24kbps, the first judgment mark of the current channel is determined to be 0.

[0159] 2. Determine the actual coding rate of each channel in the current frame according to the coding rate and the number of channels of the current frame; compare the actual coding rate of each channel with the second threshold value to obtain the first judgment mark of each channel. It can be understood that the actual coding rate can be allocated to each channel according to the total coding rate of the current frame. Compare the actual coding rate of each channel with the second threshold value to obtain the first judgment mark of each channel. Among them, the method of determining the actual coding rate of each channel can include multiple methods, for example, the coding rate can be randomly allocated to each channel, or the coding rate can be allocated to each channel according to the data size of each channel. The larger the data volume of the channel, the larger the allocated coding rate. Alternatively, the coding rate can be allocated to each channel in a fixed manner, etc. The specific allocation method can be adjusted according to the actual application scenario. For example, the total coding rate available for the current audio signal (i.e., the coding rate of the current frame) is 256kbps, and the audio signal has three channels, such as channel 1, channel 2, and channel 3, then the coding rate can be allocated to the three channels, such as 192kbps for channel 1, 44kbps for channel 2, and 20kbps for channel 3. Then, the actual coding rate of each channel is compared with 64kbps (i.e., the second threshold). When the actual coding rate of the current channel is higher than 64kbps, the value of the first judgment identifier of the current channel is determined to be 1. When the actual coding rate of the current channel is not higher than 64kbps, the first judgment identifier of the current channel is determined to be 0. The value of the first judgment identifier of channel 1 is 1, and the values ​​of the first judgment identifiers of channels 2 and 3 are 0.

[0160] More specifically, the specific method of obtaining the second judgment mark of the current channel may include: when the upper limit of the frequency band extension includes the value of the highest frequency, comparing whether the value of the highest frequency included in the upper limit of the frequency band extension is the same as the value of the highest frequency of the audio signal, and determining the second judgment mark, the highest frequency of the audio signal is usually half of the sampling frequency, of course, the sampling frequency can also be set to be greater than 2 times the highest frequency; or, when the upper limit of the frequency band extension includes the highest frequency band sequence number, comparing whether the highest frequency band sequence number included in the upper limit of the frequency band extension is the same as the highest frequency band sequence number of the audio signal, and determining the second judgment mark, the highest frequency band sequence number of the audio signal is determined by the sampling frequency, and the highest frequency band sequence number of the audio signal can be the sequence number of the frequency band where the highest frequency of the audio signal is located. In addition, the second judgment mark can be determined by comparing whether the highest frequency point sequence number included in the upper limit of the frequency band extension is the same as the highest frequency point sequence number of the audio signal, or comparing whether the highest frequency area sequence number included in the upper limit of the frequency band extension is the same as the highest frequency area sequence number of the audio signal, etc.

[0161] In addition, when the data included in the upper limit of the frequency band extension is of a different type from the data of the highest frequency of the acquired audio signal, the data included in the upper limit of the frequency band extension and the data of the highest frequency of the acquired audio signal can be converted to the same type, and then the data of the same type are compared to obtain a second judgment mark. For example, when the value of the highest frequency is included in the upper limit of the frequency band extension, and the highest frequency point sequence number of the audio signal is obtained, the value of the highest frequency corresponding to the highest frequency point sequence number of the audio signal can be determined, and the value of the highest frequency included in the upper limit of the frequency band extension is compared with the value of the corresponding highest frequency of the determined audio signal, thereby obtaining a second judgment mark.

[0162] For example, a specific method for determining the second judgment mark is that if the value of the highest frequency included in the upper limit of the frequency band extension is equal to the highest frequency of the audio signal, the value of the second judgment mark may be 0, otherwise the value of the second judgment mark is 1. For another example, the frequency band number corresponding to the upper limit of the frequency band extension is compared with the highest frequency band number of the audio signal. When the highest frequency band number included in the upper limit of the frequency band extension is equal to the highest frequency band number of the audio signal, the value of the second judgment mark may be 0, otherwise the value of the second judgment mark is 1. Usually, the highest frequency corresponding to the upper limit of the frequency band extension does not exceed the highest frequency of the audio signal.

[0163] Furthermore, a specific method of determining the first quantity may include:

[0164] If both the first judgment mark and the second judgment mark of the current channel meet the preset conditions, one or more frequency regions are added on the basis of the second number as the first number of the current channel, and the specific number of the added frequency regions can be adjusted according to the actual application scenario. Specifically, the preset condition can be: the average coding rate of the current channel is greater than the first threshold, or the actual coding rate of the current channel is greater than one of the second thresholds, and the highest frequency band number included in the upper limit of the frequency band extension is not equal to the highest frequency band number of the audio signal, or the highest frequency band number included in the upper limit of the frequency band extension is not equal to the highest frequency band number of the audio signal, or the highest frequency point number included in the upper limit of the frequency band extension is not equal to the highest frequency point number of the audio signal.

[0165] For example, the number of added frequency regions can be determined based on the difference between the highest frequency of the audio signal and the upper limit of the frequency band extension, and the difference between the highest frequency of the audio signal and the upper limit of the frequency band extension can be divided into one or more frequency regions, so that the upper limit of the frequency of the first frequency range is higher than the highest frequency corresponding to the upper limit of the frequency band extension, so that more information on tonal components in the high-frequency band signal can be detected. For example, the aforementioned preset condition can be that both the first judgment mark and the second judgment mark are 1. If both the first judgment mark and the second judgment mark of the current channel are 1, then one or more frequency regions are added on the basis of the second number as the first number of the current channel. Among them, the one or more added frequency regions can be obtained by dividing the part of the first frequency range that is higher than the upper limit of the frequency band extension according to a preset division method.

[0166] If at least one of the first judgment mark and the second judgment mark does not meet the preset condition, the second number is used as the first number. It can be understood that when the highest frequency of the audio signal is within the second frequency range, the second frequency range can be directly used as the first frequency range, and the first frequency range can be detected for tone components, which can also achieve a more comprehensive detection of tone components in the high frequency band signal.

[0167] For ease of understanding, a method for determining the first number of current channels is exemplarily described below by taking a specific application scenario as an example.

[0168] Generally, whether to add additional frequency regions (tiles) on the basis of the second number to obtain the first number of current channels can be determined by the following two conditions:

[0169] 1. When the overall coding rate of the audio signal is low, the bit consumption introduced by the additional tile may have a negative impact on the coding effect and may reduce the coding efficiency or coding quality. Therefore, you can first choose whether to add an additional tile based on the coding rate of each channel. Suppose the total encoder rate is bitrate_tot and the number of channels is n_channels, then the number of bits for each channel is bitrate_ch=bitrate_tot / n_channels. Alternatively, bitrate_ch can also be allocated to each channel separately according to bitrate_tot. Compare bitrate_ch with the preset first threshold. If it exceeds the first threshold, set the flag flag_addTile (i.e., the first judgment flag)=1, otherwise set flag_addTile=0.

[0170] 2. The frequency band extension processing, such as intelligent gap filling (IGF), can be compared with the cutoff SFB number and the total number of SFBs to determine whether the frequency range corresponding to the IGF can cover the full frequency band of the audio signal. If it cannot cover the full frequency band of the audio signal, one or more tiles are added.

[0171] The method of determining whether to add a tile based on the above two conditions is as follows:

[0172]

[0173] Among them, igfStopSfb is the IGF cutoff SFB number, nr_of_sfb_long is the total number of SFBs, flag_addTile is the first judgment flag, num_tiles is the number of tiles in the IGF frequency band, and num_tiles_detect is the number of tiles for tone component detection.

[0174] In a possible implementation, the number of frequency regions within the first frequency range may also be a preset number. Specifically, the preset number may be determined by a user or based on empirical values, and may be adjusted according to actual application scenarios.

[0175] Optionally, when the number of frequency regions within the first frequency range is a preset number, the preset number may be written into the configuration code stream or may not be written into the configuration code stream. For example, the number of frequency regions between the encoding device and the decoding device may be assumed to be the number of frequency regions included in the second frequency range plus N, where N may be a preset positive integer.

[0176] In addition to obtaining the first number of the current channel, other information of the current channel may also be obtained, such as identification information, relationship information, or the number of frequency region changes, etc. For example, the first frequency range and the second frequency range may be compared to see whether they are the same, thereby obtaining identification information; the size relationship between the first frequency range and the second frequency range may be compared, thereby obtaining relationship information; the difference between the first number and the second number may be compared, thereby obtaining the number of frequency region changes, etc.

[0177] Method 2: obtaining frequency region information used by a previous frame or a first frame of an audio signal as frequency region information of a current frame.

[0178] Among them, the frequency region information can be obtained by the aforementioned method 1 when encoding the previous frame of the current frame. When the current frame is obtained, the frequency region information can be directly read; the frequency region information can also be obtained by method 1 when encoding the first frame of the audio signal. For example, all frames included in the audio signal can be encoded using the same frequency region information, thereby reducing the workload of the encoding device and improving the encoding efficiency.

[0179] Therefore, in the implementation of the present application, the frequency region information can be obtained in a variety of ways, and the frequency region information used by each frame can be determined in real time and dynamically through method one, so that the frequency range indicated by the frequency region information can adaptively cover the frequency range in which the high-frequency band signal and the low-frequency band signal pitch components in each frame are not similar, thereby improving the encoding quality; the same frequency region information can also be shared by multiple frames, thereby reducing the workload of calculating the frequency region information, and improving the encoding quality and encoding efficiency. Therefore, the audio signal encoding method provided by the present application can flexibly adapt to more scenarios.

[0180] In addition, in addition to determining the first number of frequency regions that need to perform tone component detection, the boundaries of each frequency region that needs to perform tone component detection, that is, the first frequency region boundary, can also be determined based on the frequency region information, so that the first frequency range can be determined more accurately. It can be understood that after determining the number of frequency regions within the first frequency range, it is also necessary to determine the division method of each frequency region within the first frequency range.

[0181] Specifically, the lower limit of the first frequency range is the same as the lower limit of the second frequency range indicated by the configuration information for frequency band extension; when the first number is less than or equal to the second number, the distribution of frequency areas within the first frequency range is the same as the distribution of frequency areas within the second frequency range indicated in the configuration information, that is, the division method of frequency areas within the first frequency range is the same as the division method of frequency areas within the second frequency range. When the first number is greater than the second number, the upper frequency limit of the first frequency range is greater than the upper frequency limit of the second frequency range, that is, the first frequency range covers and is greater than the second frequency range, the distribution of frequency areas in the overlapping part of the first frequency range and the second frequency range is the same as the distribution of frequency areas in the second frequency range, that is, the division method of frequency areas in the overlapping part of the first frequency range and the second frequency range is the same as the division method of frequency areas in the second frequency range, and the distribution of frequency areas in the non-overlapping part of the first frequency range and the second frequency range is determined according to a preset method, that is, the frequency areas in the non-overlapping part of the first frequency range and the second frequency range are divided according to a preset method.

[0182] It can be understood that the division method of the frequency region of the frequency band extension is usually pre-configured, that is, the configuration information can include the division of each frequency region in the second frequency range. When the first number is less than or equal to the second number corresponding to the frequency band extension, the first frequency range can be divided according to the frequency region division method of the second frequency range, so as to obtain each frequency region in the first frequency range. For example, if the frequency region in the second frequency range is divided in units of 1KHz, the first frequency range can also be divided in units of 1KHz to obtain one or more frequency regions in the first frequency range. When the first number is greater than the second number corresponding to the frequency band extension, it can be determined that the upper frequency limit of the first frequency range is greater than the upper frequency limit of the second frequency range, the first frequency range can completely cover and be greater than the second frequency range, the part of the first frequency range that overlaps with the second frequency range can be divided according to the frequency region division method in the second frequency range, and the part of the first frequency range that does not overlap with the second frequency range, that is, the frequency region corresponding to the difference between the first number and the second number, can be divided according to a preset method, so as to accurately determine the boundaries of each frequency region included in the first frequency range where the tone component detection is required. The preset method may include according to a preset width, a frequency upper limit of the frequency region, etc.

[0183] For ease of understanding, for example, the scenario where the first number is less than or equal to the second number can be referred to in Fig. 6A , wherein the frequency regions within the first frequency range are divided in the same manner as the frequency regions within the second frequency range. For scenarios where the first number is greater than the second number, see Figure 6B , wherein the frequency region division method of the part of the first frequency range that overlaps with the second frequency range is the same as the frequency region division method of the second frequency range, and the division of the frequency region corresponding to the difference between the first number and the second number, which is one or more frequency regions in the first frequency range that are more than the second frequency range, can be performed in a preset manner, that is, for the non-overlapping part of the first frequency range and the second frequency range, the frequency region division method can be the same as or different from the frequency domain division method of the overlapping part. For example, the non-overlapping part can be divided into one or more frequency regions, and of course, the non-overlapping part can also be divided into the last frequency region of the overlapping part, such as Figure 6C shown.

[0184] Among them, if the non-overlapping part is divided into one or more frequency regions, the conditions that the divided frequency regions need to meet may include: the upper frequency limit of the frequency region is less than or equal to the highest frequency of the audio signal, usually the upper frequency limit of the frequency region is less than or equal to the highest frequency of the audio signal, and the width of the frequency region is less than or equal to a preset value.

[0185] It can be understood that the number of frequency region changes included in the aforementioned frequency region information is the number of frequency regions included in the non-overlapping portion of the first frequency range and the second frequency range.

[0186] In a specific scenario, the frequency bands in the frequency region can be numbered, and the frequency band number corresponding to the frequency upper limit of the frequency region in the non-overlapping part is less than or equal to the frequency band number corresponding to the highest frequency of the audio signal, and the width of the frequency region in the non-overlapping part is less than or equal to the preset value, and the frequency band number corresponding to the highest frequency of the audio signal is determined by the sampling frequency and the frequency band division method.

[0187] It should be understood that, for two adjacent frequency regions, the upper frequency limit of the frequency region with a lower frequency is the lower frequency limit of the frequency region with a higher frequency.

[0188] Therefore, in the implementation of the present application, the number of frequency regions within the first frequency range and the division method of each frequency region are determined, so that when the tone component detection is performed later, the detection can be performed according to the frequency region, and a more comprehensive tone component detection is obtained. For example, the tone component detection can be performed in units of frequency regions, or in units of frequency bands within a frequency region.

[0189] It can be understood that after determining the first number of frequency regions included in the first frequency range, the boundaries of the various frequency regions included in the first frequency range are also determined. Specifically, the method for determining the boundaries of the various frequency regions included in the first frequency range may include: if the first number is less than or equal to the second number, then the boundaries of the various frequency regions included in the first frequency range are determined according to the boundaries of the various frequency regions in the second frequency range. If the first number is greater than the second number, for the portion of the first frequency range that overlaps with the second frequency range, the boundaries of the various frequency regions included in the first frequency range can be determined according to the boundaries of the various frequency regions in the second frequency range, and for the portion of the first frequency range that does not overlap with the second frequency range, the frequency region can be divided according to a preset division method, and the boundary of the frequency region can be determined.

[0190] Specifically, the method for determining the boundaries of each frequency region within the first frequency range may include: if the first number is less than or equal to the second number, then the boundaries of each frequency region within the second frequency range corresponding to the frequency band expansion are used as the boundaries of each frequency region within the first frequency range; if the first number is greater than the second number, then the boundaries of each frequency region within the second frequency range are used as the boundaries of at least one low-frequency region within the first frequency range, and the boundary of at least one high-frequency region is determined according to a preset method, the low-frequency region is a frequency region in the first frequency range whose upper frequency limit is lower than the upper frequency band expansion limit, and the high-frequency region is a frequency region in the first frequency range whose lower frequency limit is higher than or equal to the upper frequency band expansion limit.

[0191] Among them, taking the first frequency region in at least one high-frequency region as an example for exemplary description, determining the boundary of at least one high-frequency region according to a preset method may specifically include: taking the frequency upper limit of a frequency region adjacent to the first frequency region and having a frequency lower than the first frequency region as the frequency lower limit of the first frequency region, determining the frequency upper limit of the first frequency region according to a preset method, and the first frequency region is included in at least one high-frequency region; wherein the frequency upper limit of the first frequency region is less than or equal to the highest frequency of the audio signal, and the width of the first frequency region is less than or equal to a preset value; or, the frequency band number corresponding to the frequency upper limit of the first frequency region is less than or equal to the frequency band number corresponding to the highest frequency of the audio signal, and the width of the first frequency region is less than or equal to the preset value, and the frequency band number corresponding to the highest frequency of the audio signal is determined by the sampling frequency and the preset frequency band division method.

[0192] The following uses a specific application scenario as an example to exemplify the method of determining each frequency region within the first frequency range.

[0193] Generally, after determining the number of tiles that need to detect tone components, it is also necessary to first determine the tile boundary for tone component detection according to the number of tiles for detecting tone components. The tile boundary can be the SFB number of the boundary, the frequency of the boundary, or both.

[0194] To improve the detection and coding efficiency of tonal components, the newly added tiles do not need to cover the entire remaining high frequency band from the IGF cutoff frequency to Fs / 2, so the maximum width of the newly added tiles can be limited to 128 frequency points, that is, the width of the frequency region is less than or equal to the preset value. Fs is the sampling frequency.

[0195] Exemplarily, the method for determining the width of the newly added tile and the method for updating the tile band table and the tile-sfb correspondence table are as follows:

[0196]

[0197] Among them, igfStopSfb is the end SFB number of IGF, sfbIdx is the SFB number, tileWidth_new is the width of the newly added tile, nr_of_sfb_long is the total number of SFBs, sfb_offset is the SFB boundary, the lower limit of the i-th SFB is sfb_offset[i], the upper limit is sfb_offset[i+1], tile_sfb_wrap represents the correspondence between tile and sfb, the starting SFB number of the i-th tile is tile_sfb_wrap[i], and the ending SFB number is tile_sfb_wrap[i+1]-1.

[0198] Therefore, in the embodiments of the present application, the boundaries of each frequency region within the first frequency range can be determined, so that the tone component detection can be performed more accurately.

[0199] 504. Perform tone detection in the first frequency range to obtain information about tone components of the high frequency band signal.

[0200] After the first frequency range indicated by the frequency region information is determined, tone component detection is performed on the first frequency range to obtain tone component information of the high frequency band signal.

[0201] Specifically, the tone component information may include a position and quantity parameter of the tone component, and an amplitude parameter or energy parameter of the tone component. Alternatively, the tone component information also includes a noise floor parameter of a high-frequency band signal. Wherein, the position and quantity parameter indicates that the position of the tone component and the quantity of the tone component are represented by the same parameter. In another embodiment, the tone component information may include a position parameter of the tone component, a quantity parameter of the tone component, and an amplitude parameter or energy parameter of the tone component; in this case, the position and quantity of the tone component are represented by different parameters.

[0202] More specifically, the first frequency range indicated in the frequency region information may include one or more frequency regions (tiles), a frequency region may include one or more frequency bands, and a frequency band may include one or more sub-bands. Step 504 may specifically include: determining a position quantity parameter of a tone component of the current frequency region and an amplitude parameter or energy parameter of a tone component of the current frequency region based on a high frequency band signal of the current frequency region in the first number of frequency regions in the high frequency band signal.

[0203] In addition to detecting the tone components in units of frequency regions, the tone components may also be detected in units of frequency bands or sub-bands, which will not be described in detail here.

[0204] Before determining the information of the tonal component of the current frequency region, it can be determined whether the current region includes the tonal component. When the tonal component is included in the current frequency region, the position quantity parameter of the tonal component of the current frequency region and the amplitude parameter or energy parameter of the tonal component of the current frequency region are determined according to the high frequency band signal of the current frequency region. Thus, only the parameters of the frequency region with the tonal component are obtained, thereby improving the coding efficiency.

[0205] Correspondingly, the information of the tone component of the current frame also includes tone component indication information, and the tone component indication information is used to indicate whether the current frequency region includes a tone component, so that the audio decoder can perform decoding according to the indication information, thereby improving decoding efficiency.

[0206] Among them, in one embodiment, determining the information of the tonal components of the current frequency region based on the high-frequency band signal of the current frequency region may include: performing a peak search in the current frequency region based on the high-frequency band signal of the current frequency region in at least one frequency region to obtain at least one of the peak quantity information, peak position information and peak amplitude information of the current region; determining the position quantity parameter of the tonal components of the current frequency region and the amplitude parameter or energy parameter of the tonal components of the current frequency region based on at least one of the peak quantity information, peak position information and peak amplitude information of the current frequency region.

[0207] The high-frequency band signal for peak search may be a frequency domain signal or a time domain signal.

[0208] Specifically, in one implementation, the peak search may be performed based on at least one of a power spectrum, an energy spectrum, or an amplitude spectrum in the current frequency region.

[0209] Among them, in one embodiment, determining the position quantity parameters of the tone components in the current frequency region and the amplitude parameters or energy parameters of the tone components in the current frequency region based on at least one of the peak quantity information, peak position information and peak amplitude information of the current frequency region may include: determining the position information, quantity information and amplitude information of the tone components in the current frequency region based on at least one of the peak quantity information, peak position information and peak amplitude information of the current frequency region; determining the position quantity parameters of the tone components in the current frequency region and the amplitude parameters or energy parameters of the tone components in the current frequency region based on the position information, quantity information and amplitude information of the tone components in the current frequency region.

[0210] 505. Perform code stream multiplexing on the frequency band extension parameters and the information of the tone components to obtain a payload code stream.

[0211] After obtaining the frequency band extension parameters and the information of the tone components of the high-frequency band signal, the frequency band extension parameters and the information of the tone components may be multiplexed to obtain a payload code stream.

[0212] Specifically, when performing bitstream multiplexing, in addition to multiplexing the information of the frequency band extension parameters and the tone components, the bitstream can also be multiplexed in combination with other information of the low-frequency band signal or the high-frequency band signal, such as combining the coding parameters of the low-frequency band, the time-domain noise shaping parameters, the frequency-domain noise shaping parameters or the spectrum quantization parameters, etc. for bitstream multiplexing, thereby obtaining a high-quality payload bitstream.

[0213] Specifically, when multiplexing bitstreams, signal type information can be used to indicate whether a certain frequency region or a certain frequency band has a tone component. If no tone component exists, signal type information indicating that a certain frequency region or frequency band does not have a tone component can be written into the bitstream, thereby indicating that a certain frequency region or frequency band does not have a tone component and improving decoding efficiency. If a tone component exists, the information of the tone component needs to be written into the bitstream, and at the same time, signal type information indicating which frequency regions have tone components is written into the bitstream, and parameters for frequency band expansion or time domain noise shaping parameters, frequency domain noise shaping parameters or spectrum quantization parameters are written into the bitstream to improve encoding quality.

[0214] 506. Perform code stream multiplexing on the frequency region information to obtain a configuration code stream.

[0215] After the frequency region information is obtained, the frequency region information may be subjected to code stream multiplexing to obtain a configuration code stream.

[0216] Specifically, the frequency region information can be written into the configuration code stream so that the decoding device can decode the audio signal according to the frequency region information included in the configuration code stream, thereby reconstructing the tone components of the frequency range indicated by the frequency region information to obtain high-quality decoded data.

[0217] It should be noted that step 506 in the embodiment of the present application is an optional step, and step 506 can be executed when the first frame of the audio signal is multiplexed, without having to execute step 506 when multiplexing the code stream for each frame, that is, multiple frames in the audio signal can share the same frequency region information, thereby reducing occupied resources and improving coding efficiency. Of course, step 506 can also be executed when encoding each frame, and the present application does not limit this.

[0218] It is understandable that the payload code stream may carry specific information of each frame of the audio signal, and the configuration code stream may carry configuration information common to each frame in the audio signal. The payload code stream and the configuration code stream may be independent code streams, or may be included in the same code stream, that is, the payload code stream and the configuration code stream may be different parts of the same code stream, which may be adjusted according to the actual application scenario, and this application does not limit this.

[0219] Therefore, in the embodiments of the present application, the tone component can be detected according to the frequency range indicated by the frequency region information, so that the information of the detected tone component can cover more frequency ranges where the tone components between the high-frequency band signal and the low-frequency band signal are not similar, thereby improving the encoding quality.

[0220] The above describes in detail the audio encoding method provided by the present application. The following describes in detail the decoding method provided by the present application.

[0221] See also Figure 7 , a flowchart of a decoding method provided in this application is as described below.

[0222] 701. Obtain a payload code stream.

[0223] The payload code stream may refer to the related description in the aforementioned step 505, which will not be described again here.

[0224] 702. Demultiplex the payload code stream to obtain the frequency band extension parameters and tone component information of the current frame of the audio signal.

[0225] After the payload code stream is acquired, the code stream is demultiplexed to obtain the frequency band extension parameter and tone component information of the current frame of the audio signal.

[0226] Specifically, the information of the tone component may include a position and quantity parameter of the tone component, and an amplitude parameter or an energy parameter of the tone component. The position and quantity parameter indicates that the position of the tone component and the quantity of the tone component are represented by the same parameter. In another embodiment, the information of the tone component includes a position parameter of the tone component, a quantity parameter of the tone component, and an amplitude parameter or an energy parameter of the tone component; in this case, the position and quantity of the tone component are represented by different parameters.

[0227] In a possible implementation, the frequency range corresponding to the high-frequency band signal includes at least one frequency region, a frequency region includes at least one frequency band, and a frequency band includes at least one sub-band; accordingly, the information on the tone component includes the position quantity parameters of the tone component of the high-frequency band signal of the current frame, including the position quantity parameters of the tone component of each of at least one frequency region, and the amplitude parameters or energy parameters of the tone component of the high-frequency signal of the current frame include the amplitude parameters or energy parameters of the tone component of each of at least one frequency region. It can be understood that the information on the tone component can be in units of frequency regions, of course, can also be in units of frequency bands or sub-bands, etc., and can be adjusted according to the actual application scenario.

[0228] In one possible implementation, demultiplexing the payload code stream to obtain information about the tone components of the current frame of the audio signal includes: acquiring position quantity parameters of the tone components of the current frequency region or the current frequency band of at least one frequency region; and parsing amplitude parameters or energy parameters of the tone components of the current frequency region or the current frequency band from the payload code stream according to the position quantity parameters of the tone components of the current frequency region or the current frequency band.

[0229] In addition, by demultiplexing the payload bitstream, in addition to obtaining the frequency band extension parameters and tone component information of the current frame of the audio signal, parameters related to the low-band signal can also be obtained, such as: low-band coding parameters, time domain noise shaping parameters, frequency domain noise shaping parameters, spectrum quantization parameters, etc.

[0230] It should be noted that, in the implementation manner of the present application, the audio signal may be a multi-channel signal or a single-channel signal. When the audio signal is a multi-channel signal, the payload code stream of the signal of each channel may be demultiplexed and the signal may be reconstructed. In the implementation manner of the present application, only the encoding process of the signal of one of the channels (hereinafter referred to as the current channel) is used as an example for exemplary description. In practical applications, steps 702-707 may be performed for each channel in the audio signal, and the present application will not repeat the repeated steps.

[0231] 703. Obtain a high-frequency band signal of the current frame according to the frequency band extension parameter.

[0232] The parameters of the frequency band extension may refer to the related description in the aforementioned step 502, which will not be described again here.

[0233] Specifically, in the scenario of time domain expansion, the time domain expansion can be performed according to the parameters of the frequency band expansion, such as the high-band LPC parameters, the high-band gain or the filtering parameters, to obtain the high-band signal. Alternatively, in the scenario of frequency domain expansion, the frequency domain expansion can be performed according to the parameters such as the time domain envelope or the frequency domain envelope, to obtain the high-band signal.

[0234] In addition, decoding can be performed according to the coding parameters of the low-band obtained by demultiplexing the code stream to obtain a low-band signal. When the frequency band is extended according to the parameters of the frequency band extension, the high-band signal can also be restored in combination with the low-band signal to obtain a more accurate high-band signal. It can be understood that after demultiplexing the payload code stream, the relevant information between the low-band signal and the high-band signal can be obtained. After obtaining the low-band signal, the high-band signal can be restored according to the low-band signal and the relevant information between the low-band signal and the high-band, thereby obtaining the high-band signal.

[0235] 704. Obtain configuration code stream.

[0236] The configuration code stream sent by the encoding device may be received, and the configuration code stream may include some configuration parameters when the encoding device performs encoding. The configuration code stream may refer to the relevant description in the aforementioned step 506, which will not be repeated here.

[0237] 705. Obtain frequency region information according to the configured code stream.

[0238] After the configuration code stream is obtained, the configuration code stream can be demultiplexed to obtain the frequency region information.

[0239] The frequency region information may refer to the related description in the aforementioned step 503, which will not be described again here.

[0240] It should be noted that steps 704-705 in the present application are optional steps. Steps 704-705 can be executed when a bit stream corresponding to a frame of the audio signal is received, that is, multiple frames can share frequency area information, or steps 704-705 can be executed when a bit stream corresponding to each frame of the audio signal is received. The specific steps can be adjusted according to the actual application scenario.

[0241] In addition, the encoding device may also send the configuration information of the frequency band extension to the decoding device through the configuration code stream, or the encoding device and the decoding device may share the preset configuration information, which may be adjusted according to the actual application scenario.

[0242] 706. Reconstruct according to the tone component information and the frequency region information to obtain a reconstructed tone signal.

[0243] After the frequency region information is acquired, the frequency range indicated by the frequency region information is reconstructed according to the tone component information to obtain a reconstructed tone signal.

[0244] In the following implementation modes of the present application, the frequency range that requires tone component reconstruction is referred to as the first frequency range, and the frequency range corresponding to the frequency band expansion is referred to as the second frequency range, and the frequency lower limit of the first frequency range is the same as the frequency lower limit of the second frequency range, which will not be repeated below.

[0245] The first frequency range can be divided into one or more frequency regions, and one frequency region can include one or more frequency bands. Reconstructing according to the information of the tone components and the frequency region information can specifically include: determining, according to the frequency region information, the number of frequency regions that need to reconstruct the tone components as a first number; determining, according to the first number, each frequency region for reconstructing the tone components within the first frequency range; and reconstructing the tone components within the first frequency range according to the information of the tone components to obtain a reconstructed tone signal.

[0246] More specifically, determining the frequency regions for tone component reconstruction within the first frequency range according to the first number may include: if the first number is less than or equal to the second number of frequency regions within the second frequency range, determining the distribution of frequency regions within the first frequency range according to the distribution of frequency regions within the second frequency range, that is, determining the frequency regions within the first frequency range according to the division method of frequency regions within the second frequency range; if the first number is greater than the second number, determining the distribution of frequency regions within the overlapped portion of the first frequency range and the second frequency range according to the distribution of frequency regions within the second frequency range, and determining the distribution of frequency regions within the non-overlapped portion of the first frequency range and the second frequency range according to a preset method, thereby obtaining the distribution of frequency regions within the first frequency range. It can be understood that if the first number is greater than the second number, the overlapped portion of the first frequency range and the second frequency range may be divided according to the frequency division method within the second frequency range, and the non-overlapped portion of the first frequency range and the second frequency range may be divided according to a preset method, thereby obtaining the frequency regions within the first frequency range for which tone component reconstruction is required. Thus, the number of frequency regions within the frequency range for which tone component reconstruction is required may be accurately determined in combination with the second number within the second frequency range.

[0247] Optionally, the frequency region within the portion of the first frequency range that does not overlap with the second frequency range may satisfy the following conditions: an upper frequency limit of the frequency region is less than or equal to the highest frequency of the audio signal, typically, the upper frequency limit of the frequency region is less than or equal to half of the sampling frequency, and the width of the frequency region is less than or equal to a preset value.

[0248] It should be understood that the configuration information of the frequency band extension can be obtained by configuring the code stream, or the configuration information of the frequency band extension can be obtained locally, and the second frequency range for frequency band extension and the distribution or division method of the frequency areas within the second frequency range can be determined by the configuration information, so as to determine the distribution of the frequency areas within the first frequency range according to the distribution of the frequency areas within the second frequency range indicated by the configuration information.

[0249] When reconstructing the tone components, the reconstruction may be performed in units of frequency regions or frequency bands. Referring to the related description in the aforementioned step 503, the number of tiles required for tone component reconstruction may be num_tiles_detect.

[0250] The reconstruction of tone components is described below by taking frequency regions as units. The reconstructed tone signal obtained after reconstruction can be a time domain signal or a frequency domain signal.

[0251] Specifically, the information of the tone component may include a position parameter, a quantity parameter, an amplitude parameter, etc. of the tone component, and the quantity parameter of the tone component indicates the quantity of the tone component. The reconstruction method of the tone component at a position may specifically be:

[0252] (1) Calculate the position of the pitch component.

[0253] Specifically, it may be: calculating the pitch component position according to the position parameter of the pitch component.

[0254] tone_pos=tile[p]+(sfb+0.5)*tone_res[p]

[0255] Among them, tile[p] is the starting frequency point of the pth frequency region, sfb is the subband number where the tone component exists in the frequency region, and tone_res[p] is the frequency domain resolution of the pth frequency region (i.e., the subband width information in the pth frequency region). The subband number where the tone component exists in the frequency region is the position parameter of the tone component. 0.5 means that the position of the tone component in the subband where the tone component exists is located at the center of the subband. Of course, the reconstructed tone component can also be located at other positions of the subband.

[0256] (2) Calculate the amplitude of the tonal component.

[0257] Specifically, the amplitude of the tone component may be calculated according to the amplitude parameter of the tone component.

[0258] Specifically, it can be:

[0259] tone_val=pow(2.0,0.25*tone_val_q[p][tone_idx]–4.0)

[0260] Among them, tone_val_q[p][tone_idx] represents the amplitude parameter corresponding to the tone_idx-th position parameter in the p-th frequency region, and tone_val represents the amplitude value of the frequency point corresponding to the tone_idx-th position parameter in the p-th frequency region.

[0261] The value range of tone_idx belongs to [0, tone_cnt[p]-1], and tone_cnt[p] is the number of tone components in the p-th frequency region.

[0262] (3) Reconstruct the audio signal based on the position and amplitude of the pitch component.

[0263] The frequency domain signal corresponding to the position tone_pos of the tone component satisfies:

[0264] pSpectralData[tone_pos]=tone_val

[0265] Among them, pSpectralData[tone_pos] represents the frequency domain signal corresponding to the position tone_pos of the tone component, tone_val represents the amplitude value of the frequency point corresponding to the tone_idx-th position parameter in the p-th frequency region. tone_pos represents the position of the tone component corresponding to the tone_idx-th position parameter in the p-th frequency region.

[0266] 707. Obtain a decoded signal of the current frame according to the high-frequency band signal and the reconstructed tone signal.

[0267] In addition to obtaining a decoded signal of the current frame according to the high-frequency band signal and the reconstructed tone signal, a more complete decoded signal of the current frame can also be obtained by combining the low-frequency band signal.

[0268] Specifically, after obtaining the reconstructed pitch signal, the pitch component is restored in combination with the high-frequency band signal to obtain the specific details and pitch components of the high-frequency band part in the current frame, and the current frame is restored in combination with the low-frequency band signal to obtain the current frame containing the complete pitch components.

[0269] Therefore, in the implementation manner of the present application, when restoring the tonal components, the decoding device can restore the tonal components within the first frequency range in combination with the frequency region information provided by the encoding device, so that the current frame obtained includes more complete tonal components. Even in scenarios where the high-frequency band spectrum often contains tonal components that are different from the low-frequency band spectrum, the current frame obtained by decoding can also have richer tonal components, thereby improving the decoding quality and thus improving the user experience.

[0270] The above has introduced in detail the audio signal encoding method and decoding method provided by the present application. Based on the above method, the following will introduce in detail the device provided by the present application.

[0271] First, the present application provides a coding device for performing the above Figure 5 The method for encoding audio signals shown in . Figure 8 , a structural schematic diagram of an encoding device provided in this application is described as follows.

[0272] The encoding device may include:

[0273] The audio acquisition module 801 is used to acquire a current frame of an audio signal, where the current frame includes a high-frequency band signal and a low-frequency band signal;

[0274] A parameter acquisition module 802, configured to obtain a frequency band extension parameter of a current frame according to a high frequency band signal, a low frequency band signal and preset frequency band extension configuration information;

[0275] A frequency acquisition module 803, used to acquire frequency region information, where the frequency region information is used to indicate a first frequency range in the high frequency band signal where tone component detection is required;

[0276] A tone component encoding module 804, configured to perform tone component detection in a first frequency range to obtain information on tone components of a high frequency band signal;

[0277] The code stream multiplexing module 805 is used to perform code stream multiplexing on the information of the frequency band extension parameters and the tone components to obtain a payload code stream.

[0278] In a possible implementation manner, the encoding device may further include:

[0279] The code stream multiplexing module 805 is further used to perform code stream multiplexing on the frequency region information to obtain a configuration code stream.

[0280] In a possible implementation manner, the frequency acquisition module 803 is specifically configured to determine the frequency region information according to the sampling frequency of the audio signal and the configuration information of the frequency band extension.

[0281] In one possible implementation, the frequency region information includes at least one of the following: a first quantity, identification information, relationship information, or a frequency region change quantity, wherein the first quantity is the number of frequency regions within the first frequency range, the identification information is used to indicate whether the first frequency range is the same as the second frequency range corresponding to the frequency band extension, the relationship information is used to indicate the size relationship between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range, and the frequency region change quantity is the number of frequency regions that have differences between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range.

[0282] In a possible implementation manner, the frequency region information includes at least a first quantity, and the configuration information of the frequency band extension includes a frequency band extension upper limit and / or a second quantity, where the second quantity is the number of frequency regions within the second frequency range;

[0283] The frequency acquisition module 803 is specifically configured to determine the first quantity according to one or more of the encoding rate of the current frame, the number of channels of the audio signal, the sampling frequency, the upper limit of the frequency band extension, or the second quantity.

[0284] In a possible implementation manner, the upper limit of the frequency band extension includes one or more of the following: the highest frequency in the second frequency range, the highest frequency point number, the highest frequency band number, or the highest frequency area number.

[0285] In a possible implementation manner, the number of channels of the audio signal is at least one;

[0286] The frequency acquisition module 803 is specifically used for:

[0287] Determine a first determination mark of a current channel in the current frame according to the encoding rate and the number of channels of the current frame, the encoding rate of the current frame being the encoding rate of the current frame; determine a first number of the current channel according to the first determination mark in combination with the second number;

[0288] or,

[0289] Determine a second determination mark of the current channel in the current frame according to the sampling frequency and the upper limit of the frequency band extension; determine a first number of the current channel according to the second determination mark and in combination with the second number;

[0290] or,

[0291] According to the encoding rate and the number of channels of the current frame, a first judgment identifier of the current channel in the current frame is determined, and according to the sampling frequency and the upper limit of the frequency band expansion, a second judgment identifier of the current channel in the current frame is determined; according to the first judgment identifier and the second judgment identifier, combined with the second number, the first number of the current channels in the current frame is determined.

[0292] In a possible implementation, the frequency acquisition module 803 is specifically used to: obtain an average coding rate of each channel in the current frame according to the coding rate and the number of channels of the current frame; and obtain a first determination mark of the current channel according to the average coding rate and the first threshold.

[0293] In a possible implementation, the frequency acquisition module 803 may be specifically used to: determine the actual coding rate of the current channel according to the coding rate of the current frame and the number of channels; and obtain a first determination identifier of the current channel according to the actual coding rate of the current channel and a second threshold.

[0294] In one possible implementation, the frequency acquisition module 803 may be specifically used to: when the frequency band extension upper limit includes the maximum frequency, compare whether the maximum frequency included in the frequency band extension upper limit is the same as the maximum frequency of the audio signal, and determine a second judgment identifier of the current channel in the current frame; or, when the frequency band extension upper limit includes the maximum frequency band sequence number, compare whether the maximum frequency band sequence number included in the frequency band extension upper limit is the same as the maximum frequency band sequence number of the audio signal, and determine the second judgment identifier of the current channel in the current frame, and the maximum frequency band sequence number of the audio signal is determined by the sampling frequency.

[0295] In a possible implementation manner, the frequency acquisition module 803 may be specifically used to:

[0296] If both the first determination mark and the second determination mark meet the preset condition, one or more frequency regions are added based on the second number corresponding to the frequency band extension as the first number of the current channel; or

[0297] If the first judgment flag or the second judgment flag does not meet the preset condition, the second number corresponding to the frequency band extension is used as the first number of the current channel.

[0298] In one possible implementation, the lower limit of the first frequency range is the same as the lower limit of the second frequency range for frequency band expansion indicated by the configuration information; when the frequency region information includes a first number that is less than or equal to a second number corresponding to the frequency band expansion, the distribution of frequency regions within the first frequency range is the same as the distribution of frequency regions within the second frequency range; when the first number is greater than the second number, the upper frequency limit of the first frequency range is greater than the upper frequency limit of the second frequency range, the distribution of frequency regions in the overlapping part of the first frequency range and the second frequency range is the same as the distribution of frequency regions within the second frequency range, and the distribution of frequency regions in the non-overlapping part of the first frequency range and the second frequency range is determined according to a preset method.

[0299] In one possible implementation, the frequency region within the non-overlapping portion of the first frequency range and the second frequency range satisfies the following conditions: the width of the frequency region within the non-overlapping portion of the first frequency range and the second frequency range is less than a preset value, and the frequency upper limit of the frequency region within the non-overlapping portion of the first frequency range and the second frequency range is less than or equal to the highest frequency of the audio signal.

[0300] In a possible implementation manner, the frequency range corresponding to the high-frequency band signal includes at least one frequency region, wherein a frequency region includes at least one frequency band.

[0301] In a possible implementation manner, the number of frequency regions within the first frequency range is a preset number.

[0302] In a possible implementation manner, the tone component information includes a position quantity parameter of the tone component and an amplitude parameter or an energy parameter of the tone component.

[0303] In a possible implementation manner, the tone component information further includes a noise floor parameter of a high frequency band signal.

[0304] Secondly, the present application provides a decoding device for performing the above Figure 7 See the decoding method shown in Fig. 9 , a structural schematic diagram of a decoding device provided by the present application is described as follows.

[0305] The decoding device may include:

[0306] An acquisition module 901 is used to acquire a payload code stream;

[0307] A demultiplexing module 902, configured to demultiplex the payload code stream to obtain the frequency band extension parameters and tone component information of the current frame of the audio signal;

[0308] A frequency band extension decoding module 903, configured to obtain a high frequency band signal of a current frame according to frequency band extension parameters;

[0309] A reconstruction module 904, configured to perform reconstruction according to the information of the tone component and the frequency region information to obtain a reconstructed tone signal, wherein the frequency region information is used to indicate a first frequency range in the current frame where the tone component reconstruction is required;

[0310] The signal decoding module 905 is used to obtain a decoded signal of the current frame according to the high-frequency band signal and the reconstructed tone signal.

[0311] In a possible implementation manner, the acquisition module 901 may also be used to: acquire a configuration bit stream; and acquire frequency region information according to the configuration bit stream.

[0312] In one possible implementation, the frequency region information includes at least one of the following: a first quantity, identification information, relationship information, or a frequency region change quantity, wherein the first quantity is the number of frequency regions within the first frequency range, the identification information is used to indicate whether the first frequency range is the same as the second frequency range corresponding to the frequency band extension, the relationship information is used to indicate the size relationship between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range, and the frequency region change quantity is the number of frequency regions that have differences between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range.

[0313] In a possible implementation, the reconstruction module 904 can be specifically used to: determine, based on frequency region information, the number of frequency regions that need to reconstruct tone components as a first number; determine, based on the first number, the frequency regions in a first frequency range for reconstructing tone components; and within the first frequency range, reconstruct the tone components based on the tone component information to obtain a reconstructed tone signal.

[0314] In a possible implementation, the lower limit of the first frequency range is the same as the lower limit of the second frequency range for frequency band expansion indicated by the configuration information. The acquisition module can be specifically used to: if the first number is less than or equal to the second number, determine the distribution of each frequency region within the first frequency range according to the distribution of frequency regions within the second frequency range, and the second number is the number of frequency regions within the second frequency range; if the first number is greater than the second number, determine that the frequency upper limit of the first frequency range is greater than the frequency upper limit of the second frequency range, determine the distribution of frequency regions within the overlapping part of the first frequency range and the second frequency range according to the distribution of frequency regions within the second frequency range, and determine the distribution of frequency regions within the non-overlapping part of the first frequency range and the second frequency range according to a preset method, so as to obtain each frequency region within the first frequency range.

[0315] In one possible implementation, the frequency region within the non-overlapping portion of the first frequency range and the second frequency range satisfies the following conditions: the width of the frequency region divided within the non-overlapping portion of the first frequency range and the second frequency range is less than a preset value, and the frequency upper limit of the frequency region divided within the non-overlapping portion of the first frequency range and the second frequency range is less than or equal to the highest frequency of the audio signal.

[0316] In a possible implementation manner, the tone component information includes a position quantity parameter of the tone component and an amplitude parameter or an energy parameter of the tone component.

[0317] In a possible implementation manner, the tone component information further includes a noise floor parameter of a high frequency band signal.

[0318] See also Fig.10, a schematic diagram of the structure of another encoding device provided by the present application. The encoding device 1000 may include a processor 1001, a memory 1002 and a transceiver 1003. The processor 1001, the memory 1002 and the transceiver 1003 are interconnected via a line. The memory 1002 stores program instructions and data.

[0319] The memory 1002 stores the aforementioned Figure 5 In a corresponding implementation manner, the steps executed by the encoding device correspond to program instructions and data.

[0320] Processor 1001, configured to execute the aforementioned Figure 5 The steps performed by the encoding device in any embodiment shown in the above may, for example, be performed as described above. Figure 5 Steps 501-505, etc. in.

[0321] The transceiver 1003 can be used to receive and send data, for example, it can be used to perform the above Figure 5 Step 506 in .

[0322] In one implementation, the encoding device 1000 may include a Fig.10 More or fewer components are merely illustrative in this application and are not limiting.

[0323] See also Fig.11 , a schematic diagram of the structure of another decoding device provided by the present application. The decoding device 1100 may include a processor 1101, a memory 1102 and a transceiver 1103. The processor 1101, the memory 1102 and the transceiver 1103 are interconnected via a line. The memory 1102 stores program instructions and data.

[0324] The memory 1102 stores the aforementioned Figure 7 In a corresponding implementation manner, the steps executed by the decoding device correspond to program instructions and data.

[0325] Processor 1101, used to execute the above Figure 7 The steps performed by the decoding device in any of the embodiments described above may, for example, be performed as described above. Figure 7 Steps 702, 703, 705-707, etc. in.

[0326] The transceiver 1103 can be used to receive and send data, for example, it can be used to perform the above Figure 7 Step 701 or 704 in .

[0327] In one implementation, the decoding device 1100 may include a Fig.11 More or fewer components are merely illustrative in this application and are not limiting.

[0328] The present application also provides a communication system, which may include: an encoding device and a decoding device.

[0329] The encoding device can be Figure 8 or Fig.10 The encoding device shown can be used to perform the aforementioned Figure 5 The steps performed by the encoding device in any of the embodiments shown in .

[0330] The decoding device can be Fig. 9 or Fig.11 The decoding device shown can be used to perform the aforementioned Figure 7 The steps performed by the decoding device in any of the embodiments shown in .

[0331] The present application provides a network device, which can be applied to a coding device or a decoding device, etc. The network device is coupled to a memory and is used to read and execute instructions stored in the memory, so that the network device implements the aforementioned Figure 5-7 In any of the embodiments, the steps of the method are performed by the encoding device or the decoding device. In one possible design, the network device is a chip or a system on chip.

[0332] The present application provides a chip system, which includes a processor for supporting an encoding device or a decoding device to implement the functions involved in the above aspects, for example, sending or processing the data and / or information involved in the above methods. In one possible design, the chip system also includes a memory, which is used to store necessary program instructions and data. The chip system can be composed of a chip, or it can include a chip and other discrete devices.

[0333] In another possible design, when the chip system is a chip in an encoding device or a decoding device, the chip includes: a processing unit and a communication unit. The processing unit may be, for example, a processor, and the communication unit may be, for example, an input / output interface, a pin or a circuit. The processing unit may execute the computer execution instructions stored in the storage unit to enable the chip in the encoding device or the decoding device to execute the above-mentioned Figure 5-7 The steps of the method performed by the encoding device or the decoding device in any one of the embodiments. Optionally, the storage unit is a storage unit in the chip, such as a register, a cache, etc. The storage unit may also be a storage unit located outside the chip in the OLT or ONU, such as a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM), etc.

[0334] An embodiment of the present application also provides a processor for coupling with a memory and for executing the methods and functions involving an encoding device or a decoding device in any of the above embodiments.

[0335] The present application also provides a computer-readable storage medium on which a computer program is stored. When the computer executes the computer program, the method flow related to the encoding device or decoding device in any of the above method embodiments is implemented. Correspondingly, the computer can be the above encoding device or decoding device.

[0336] It should be understood that the processors mentioned in the chip systems, encoding devices or decoding devices in the above embodiments of the present application, or the processors provided in the above embodiments of the present application, may be central processing units (CPUs), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

[0337] It should also be understood that the number of processors in the chip system, encoding device, or decoding device in the above embodiments of the present application can be one or more, and can be adjusted according to the actual application scenario. This is only an exemplary description and is not limited. The number of memories in the embodiments of the present application can be one or more, and can be adjusted according to the actual application scenario. This is only an exemplary description and is not limited.

[0338] It should also be understood that the memory or readable storage medium mentioned in the chip system, encoding device or decoding device in the above embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus RAM (DR RAM).

[0339] It should also be noted that when the encoding device or decoding device includes a processor (or processing unit) and a memory, the processor in this application can be integrated with the memory, or the processor and the memory can be connected through an interface. It can be adjusted according to the actual application scenario and is not limited.

[0340] The present application also provides a computer program or a computer program product including the computer program, which, when executed on a computer, enables the computer to implement the method flow executed by the encoding device or decoding device in any of the above method embodiments. Correspondingly, the computer may be the above encoding device or decoding device.

[0341] In the above Figure 5-7 In various embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.

[0342] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, a computer, a server, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server, or data center. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a server or a data center that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk (SSD)), etc.

[0343] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0344] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0345] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0346] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0347] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, server, or other network device, etc.) to execute the present application. Figure 5-7 The storage medium includes: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes.

[0348] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and need not be used to describe a specific order or sequential order. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, which is only to describe the distinction mode adopted by the objects of the same attributes when describing in the embodiments of the present application. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, so that the process, method, system, product or equipment comprising a series of units need not be limited to those units, but may include other units that are not clearly listed or inherent to these processes, methods, products or equipment.

[0349] The names of the messages / frames / information, modules or units, etc. provided in the embodiments of the present application are only examples, and other names may be used as long as the functions of the messages / frames / information, modules or units, etc. are the same.

[0350] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The singular forms of "a", "said" and "the" used in the embodiments of the present application are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that in the description of the present application, unless otherwise specified, " / " indicates that the objects associated before and after are in an "or" relationship, for example, A / B can represent A or B; "and / or" in the present application is only a description of the association relationship of the associated objects, indicating that there can be three relationships, for example, A and / or B, which can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural.

[0351] As used herein, the words “if” or “if” may be interpreted as “at the time of” or “when” or “in response to determining” or “in response to detecting”, depending on the context. Similarly, the phrases “if it is determined” or “if (stated condition or event) is detected” may be interpreted as “when it is determined” or “in response to determining” or “when detecting (stated condition or event)” or “in response to detecting (stated condition or event)”, depending on the context.

[0352] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for encoding an audio signal, characterized in that: include: Acquire a current frame of an audio signal, wherein the current frame includes a high-frequency band signal and a low-frequency band signal; Obtaining a frequency band extension parameter of the current frame according to the high frequency band signal, the low frequency band signal and preset frequency band extension configuration information; Acquire frequency region information according to the sampling frequency of the audio signal and the configuration information of the frequency band extension, the frequency region information is used to indicate a first frequency range in the high-frequency band signal where tone component detection is required, the frequency region information includes at least one of the following: a first quantity, identification information, relationship information, or a frequency region change quantity, the first quantity is the number of frequency regions within the first frequency range, the identification information is used to indicate whether the first frequency range is the same as a second frequency range corresponding to the frequency band extension indicated by the configuration information, the configuration information includes a frequency band extension upper limit and / or a second quantity, the second quantity is the number of frequency regions within the second frequency range, the frequency upper limit of the second frequency range is the frequency band extension upper limit, and the frequency lower limit of the second frequency range is a frequency band threshold; The relationship information is used to indicate the size relationship between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range, and the number of frequency region changes is the number of frequency regions that have differences between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range; Performing tone component detection in the first frequency range to obtain information on the tone components of the high frequency band signal; The parameters of the frequency band extension and the information of the tone components are multiplexed to obtain a payload code stream.

2. The method according to claim 1, characterized in that The method further comprises: The frequency region information is subjected to code stream multiplexing to obtain a configuration code stream.

3. The method according to claim 1, characterized in that The frequency region information includes at least the first quantity; The method further comprises: The first number is determined according to one or more of an encoding rate of the current frame, the number of channels of the audio signal, a sampling frequency of the audio signal, the frequency band extension upper limit, or the second number.

4. The method according to claim 3, characterized in that The frequency band extension upper limit includes one or more of the following: the highest frequency in the second frequency range, the highest frequency point number, the highest frequency band number or the highest frequency area number.

5. The method according to claim 4, characterized in that The number of channels of the audio signal is at least one; The determining the first quantity according to one or more of the encoding rate of the current frame, the number of channels of the audio signal, the sampling frequency of the audio signal, the upper limit of the frequency band extension, or the second quantity comprises: Determine a first determination mark of a current channel in the current frame according to the encoding rate of the current frame and the number of channels; determine a first number of the current channels according to the first determination mark and in combination with the second number; or, Determine a second determination mark of the current channel in the current frame according to the sampling frequency and the upper limit of the frequency band extension; determine a first number of the current channel according to the second determination mark and in combination with the second number; or, According to the encoding rate of the current frame and the number of channels, a first judgment identifier of the current channel in the current frame is determined, and according to the sampling frequency and the upper limit of the frequency band extension, a second judgment identifier of the current channel in the current frame is determined; according to the first judgment identifier and the second judgment identifier, combined with the second number, the first number of current channels in the current frame is determined.

6. The method according to claim 5, characterized in that Determining a first determination mark of a current channel in the current frame according to the encoding rate of the current frame and the number of channels includes: Obtaining an average coding rate of each channel in the current frame according to the coding rate of the current frame and the number of channels; The first judgment identifier of the current channel is obtained according to the average encoding rate and a first threshold.

7. The method according to claim 5, characterized in that Determining a first determination mark of a current channel in the current frame according to the encoding rate of the current frame and the number of channels includes: Determine an actual encoding rate of the current channel according to the encoding rate of the current frame and the number of channels; The first judgment identifier of the current channel is obtained according to the actual encoding rate of the current channel and the second threshold.

8. The method according to any one of claims 6, characterized in that When the frequency band extension upper limit includes the maximum frequency, determining the second judgment mark of the current channel in the current frame according to the sampling frequency and the frequency band extension upper limit includes: Compare whether the highest frequency included in the upper limit of the frequency band extension is the same as the highest frequency of the audio signal, and determine a second determination mark of the current channel in the current frame; or, When the frequency band extension upper limit includes the highest frequency band sequence number, determining the second determination mark of the current channel in the current frame according to the sampling frequency and the frequency band extension upper limit includes: The second judgment mark of the current channel in the current frame is determined by comparing whether the highest frequency band number included in the frequency band extension upper limit is the same as the highest frequency band number of the audio signal, wherein the highest frequency band number of the audio signal is determined by the sampling frequency.

9. The method according to any one of claims 5 to 8, characterized in that: The determining, in combination with the second quantity, a first quantity of the current channel in the current frame comprises: If both the first judgment mark and the second judgment mark meet the preset conditions, one or more frequency regions are added based on the second number within the second frequency range as the first number of the current channel; or, If the first judgment flag or the second judgment flag does not meet the preset condition, the second number corresponding to the frequency band extension is used as the first number of the current channels.

10. The method according to any one of claims 3 to 8, characterized in that: The frequency lower limit of the first frequency range is the same as the frequency lower limit of the second frequency range for frequency band extension indicated by the configuration information; When the first number is less than or equal to a second number of frequency regions within the second frequency range, the distribution of frequency regions within the first frequency range is the same as the distribution of frequency regions within the second frequency range; When the first number is greater than the second number, the frequency upper limit of the first frequency range is greater than the frequency upper limit of the second frequency range, the distribution of frequency areas in the overlapping part of the first frequency range and the second frequency range is the same as the distribution of frequency areas in the second frequency range, and the distribution of frequency areas in the non-overlapping part of the first frequency range and the second frequency range is determined according to a preset method.

11. The method according to claim 10, characterized in that A width of a frequency region within a non-overlapping portion of the first frequency range and the second frequency range is less than or equal to a preset value, and an upper frequency limit of a frequency region within a non-overlapping portion of the first frequency range and the second frequency range is less than or equal to a maximum frequency of the audio signal.

12. The method according to any one of claims 1 to 2, characterized in that: The number of frequency regions within the first frequency range is a preset number.

13. A decoding method, characterized in that: include: Get the payload stream; Demultiplexing the payload code stream to obtain the frequency band extension parameters and tone component information of the current frame of the audio signal; Obtaining a high-frequency band signal of the current frame according to the frequency band extension parameter; Reconstructing according to the information of the tone component and the frequency region information to obtain a reconstructed tone signal, the frequency region information is used to indicate a first frequency range in the current frame where tone component reconstruction is required, the frequency region information is obtained according to the sampling frequency of the audio signal and the configuration information of the frequency band extension, the frequency region information includes at least one of the following: a first quantity, identification information, relationship information or a frequency region change quantity, the first quantity is the number of frequency regions within the first frequency range, the identification information is used to indicate whether the first frequency range is the same as a second frequency range corresponding to the frequency band extension, the configuration information includes a frequency band extension upper limit and / or a second quantity, the second quantity is the number of frequency regions within the second frequency range, the frequency upper limit of the second frequency range is the frequency band extension upper limit, and the frequency lower limit of the second frequency range is a frequency band threshold; The relationship information is used to indicate the size relationship between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range, and the number of frequency region changes is the number of frequency regions that have differences between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range; A decoded signal of the current frame is obtained according to the high frequency band signal and the reconstructed tone signal.

14. The method according to claim 13, characterized in that The method further comprises: Get the configuration stream; The frequency region information is acquired according to the configuration code stream.

15. The method according to claim 13, characterized in that The reconstructing according to the information of the tone component and the frequency region information to obtain a reconstructed tone signal includes: According to the frequency region information, determining that the number of frequency regions requiring tone component reconstruction is the first number; Determining, according to the first quantity, frequency regions for reconstructing tone components within the first frequency range; In the first frequency range, the tone component is reconstructed according to the information of the tone component to obtain the reconstructed tone signal.

16. The method according to claim 15, characterized in that The frequency lower limit of the first frequency range is the same as the frequency lower limit of the second frequency range for frequency band extension indicated by the configuration information, and determining, according to the first quantity, frequency regions for tone component reconstruction within the first frequency range includes: If the first number is less than or equal to a second number, determining the distribution of frequency regions within the first frequency range according to the distribution of frequency regions within the second frequency range, the second number being the number of frequency regions within the second frequency range; If the first number is greater than the second number, it is determined that the frequency upper limit of the first frequency range is greater than the frequency upper limit of the second frequency range, and the distribution of frequency areas in the overlapping part of the first frequency range and the second frequency range is determined according to the distribution of frequency areas within the second frequency range, and the distribution of frequency areas in the non-overlapping part of the first frequency range and the second frequency range is determined according to a preset method to obtain the distribution of frequency areas within the first frequency range.

17. The method according to claim 16, characterized in that The width of the frequency region divided within the non-overlapping portion of the first frequency range and the second frequency range is less than or equal to a preset value, and the frequency upper limit of the frequency region divided within the non-overlapping portion of the first frequency range and the second frequency range is less than or equal to the highest frequency of the audio signal.

18. An encoding device, characterized in that: include: An audio acquisition module, used to acquire a current frame of an audio signal, wherein the current frame includes a high-frequency band signal and a low-frequency band signal; A parameter acquisition module, configured to obtain the frequency band extension parameters of the current frame according to the high frequency band signal, the low frequency band signal and preset frequency band extension configuration information; A frequency acquisition module, used for acquiring frequency region information according to the sampling frequency of the audio signal and the configuration information of the frequency band extension, the frequency region information is used for indicating a first frequency range in the high-frequency band signal where tone component detection is required, the frequency region information includes at least one of the following: a first quantity, identification information, relationship information or a frequency region change quantity, the first quantity is the number of frequency regions within the first frequency range, the identification information is used for indicating whether the first frequency range is the same as a second frequency range corresponding to the frequency band extension, the configuration information includes a frequency band extension upper limit and / or a second quantity, the second quantity is the number of frequency regions within the second frequency range, the frequency upper limit of the second frequency range is the frequency band extension upper limit, and the frequency lower limit of the second frequency range is a frequency band threshold; The relationship information is used to indicate the size relationship between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range, and the number of frequency region changes is the number of frequency regions that have differences between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range; A tone component encoding module, configured to perform tone component detection in the first frequency range to obtain information on the tone components of the high frequency band signal; The code stream multiplexing module is used to perform code stream multiplexing on the parameters of the frequency band extension and the information of the tone components to obtain a payload code stream.

19. The encoding device according to claim 18, characterized in that The encoding device also includes: The code stream multiplexing module is also used to perform code stream multiplexing on the frequency region information to obtain a configuration code stream.

20. The encoding device according to claim 18, characterized in that The frequency region information includes at least the first quantity; The frequency acquisition module is specifically used to determine the first number according to one or more of the encoding rate of the current frame, the number of channels of the audio signal, the sampling frequency of the audio signal, the frequency band extension upper limit or the second number.

21. The encoding device according to claim 20, characterized in that The frequency band extension upper limit includes one or more of the following: the highest frequency in the second frequency range, the highest frequency point number, the highest frequency band number or the highest frequency area number.

22. The encoding device according to claim 21, characterized in that The number of channels of the audio signal is at least one; The frequency acquisition module is specifically used for: Determine, according to the encoding rate of the current frame and the number of channels, a first determination mark of the current channel in the current frame, the encoding rate of the current frame being the encoding rate of the current frame; determine, according to the first determination mark and in combination with the second number, a first number of the current channels; or, Determine a second determination mark of the current channel in the current frame according to the sampling frequency and the upper limit of the frequency band extension; determine a first number of the current channel according to the second determination mark and in combination with the second number; or, According to the encoding rate of the current frame and the number of channels, a first judgment identifier of the current channel in the current frame is determined, and according to the sampling frequency and the upper limit of the frequency band extension, a second judgment identifier of the current channel in the current frame is determined; according to the first judgment identifier and the second judgment identifier, combined with the second number, the first number of current channels in the current frame is determined.

23. The encoding device according to claim 22, characterized in that The frequency acquisition module is specifically used for: Obtaining an average coding rate of each channel in the current frame according to the coding rate of the current frame and the number of channels; The first judgment identifier of the current channel is obtained according to the average encoding rate and a first threshold.

24. The encoding device according to claim 22, characterized in that The frequency acquisition module is specifically used for: Determine an actual encoding rate of the current channel according to the encoding rate of the current frame and the number of channels; The first judgment identifier of the current channel is obtained according to the actual encoding rate of the current channel and the second threshold.

25. The encoding device according to any one of claims 23-24, characterized in that The frequency acquisition module is specifically used for: When the upper limit of the frequency band extension includes the highest frequency, comparing whether the highest frequency included in the upper limit of the frequency band extension is the same as the highest frequency of the audio signal, and determining a second determination mark of the current channel in the current frame; or When the frequency band extension upper limit includes the highest frequency band sequence number, the highest frequency band sequence number included in the frequency band extension upper limit is compared with the highest frequency band sequence number of the audio signal to determine whether they are the same, and the second judgment identifier of the current channel in the current frame is determined, and the highest frequency band sequence number of the audio signal is determined by the sampling frequency.

26. The encoding device according to any one of claims 22 to 24, characterized in that: The frequency acquisition module is specifically used for: If both the first judgment mark and the second judgment mark meet the preset condition, adding one or more frequency regions as the first number of the current channel based on the second number corresponding to the frequency band extension; or, If the first judgment flag or the second judgment flag does not meet the preset condition, the second number corresponding to the frequency band extension is used as the first number of the current channels.

27. The encoding device according to any one of claims 20 to 24, characterized in that The frequency lower limit of the first frequency range is the same as the frequency lower limit of the second frequency range for frequency band extension indicated by the configuration information; When the frequency region information includes a first number that is less than or equal to a second number corresponding to the frequency band extension, the distribution of frequency regions within the first frequency range is the same as the distribution of frequency regions within the second frequency range; When the first number is greater than the second number, the frequency upper limit of the first frequency range is greater than the frequency upper limit of the second frequency range, the distribution of frequency areas in the overlapping part of the first frequency range and the second frequency range is the same as the distribution of frequency areas in the second frequency range, and the distribution of frequency areas in the non-overlapping part of the first frequency range and the second frequency range is determined according to a preset method.

28. The encoding device according to claim 27, characterized in that A width of a frequency region within a non-overlapping portion of the first frequency range and the second frequency range is smaller than a preset value, and a frequency upper limit of the frequency region within a non-overlapping portion of the first frequency range and the second frequency range is smaller than or equal to a maximum frequency of the audio signal.

29. The encoding device according to any one of claims 20 to 24, characterized in that The frequency range corresponding to the high-frequency band signal includes at least one frequency region, wherein one frequency region includes at least one frequency band.

30. The encoding device according to any one of claims 18 to 19, characterized in that: The number of frequency regions within the first frequency range is a preset number.

31. A decoding device, characterized in that: include: The acquisition module is used to obtain the payload code stream; A demultiplexing module, used for demultiplexing the payload code stream to obtain the frequency band extension parameters and tone component information of the current frame of the audio signal; A frequency band extension decoding module, used for obtaining a high frequency band signal of the current frame according to the frequency band extension parameters; a reconstruction module, configured to reconstruct according to the information of the tone component and the frequency region information to obtain a reconstructed tone signal, wherein the frequency region information is used to indicate a first frequency range in the current frame where tone component reconstruction is required, and the frequency region information is obtained according to the sampling frequency of the audio signal and the configuration information of the frequency band extension, and the frequency region information includes at least one of the following: a first quantity, identification information, relationship information, or a frequency region change quantity, wherein the first quantity is the number of frequency regions within the first frequency range, the identification information is used to indicate whether the first frequency range is the same as a second frequency range corresponding to the frequency band extension, and the configuration information includes a frequency band extension upper limit and / or a second quantity, wherein the second quantity is the number of frequency regions within the second frequency range, the frequency upper limit of the second frequency range is the frequency band extension upper limit, and the frequency lower limit of the second frequency range is a frequency band threshold; The relationship information is used to indicate the size relationship between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range, and the number of frequency region changes is the number of frequency regions that have differences between the first frequency range and the second frequency range when the first frequency range is different from the second frequency range; A signal decoding module is used to obtain a decoded signal of the current frame according to the high-frequency band signal and the reconstructed tone signal.

32. The decoding device according to claim 31, characterized in that The acquisition module is further used for: Get the configuration stream; The frequency region information is acquired according to the configuration code stream.

33. The decoding device according to claim 31, characterized in that The reconstruction module is specifically used for: According to the frequency region information, determining that the number of frequency regions requiring tone component reconstruction is the first number; Determining, according to the first quantity, frequency regions for reconstructing tone components in the first frequency range; In the first frequency range, the tone component is reconstructed according to the information of the tone component to obtain the reconstructed tone signal.

34. The decoding device according to claim 33, characterized in that The frequency lower limit of the first frequency range is the same as the frequency lower limit of the second frequency range for frequency band extension indicated by the configuration information, and the acquisition module is specifically configured to: If the first number is less than or equal to a second number, determining the distribution of each frequency region within the first frequency range according to the distribution of frequency regions within the second frequency range, the second number being the number of frequency regions within the second frequency range; If the first number is greater than the second number, it is determined that the frequency upper limit of the first frequency range is greater than the frequency upper limit of the second frequency range, and the distribution of frequency areas in the overlapping part of the first frequency range and the second frequency range is determined according to the distribution of frequency areas within the second frequency range, and the distribution of frequency areas in the non-overlapping part of the first frequency range and the second frequency range is determined according to a preset method to obtain the distribution of each frequency area within the first frequency range.

35. The decoding device according to claim 34, characterized in that The width of the frequency region divided within the non-overlapping portion of the first frequency range and the second frequency range is less than a preset value, and the upper frequency limit of the frequency region divided within the non-overlapping portion of the first frequency range and the second frequency range is less than or equal to the highest frequency of the audio signal.

36. A coding device, characterized in that include: The method comprises a processor, wherein the processor is coupled to a memory, wherein the memory stores a program, and when the program instructions stored in the memory are executed by the processor, the method according to any one of claims 1 to 12 is implemented.

37. A decoding device, characterized in that: include: The method comprises a processor, wherein the processor is coupled to a memory, wherein the memory stores a program, and when the program instructions stored in the memory are executed by the processor, the method according to any one of claims 13 to 17 is implemented.

38. A communication system, characterized in that: include: Encoding equipment and decoding equipment; The encoding device is an encoding device as claimed in any one of claims 18 to 30; The decoding device is a decoding device as described in any one of claims 31-35.

39. A computer-readable storage medium comprising a program, which, when executed on a computer, causes the computer to execute the method according to any one of claims 1 to 12 or 13 to 17.

40. A network device comprising a processor and a memory, characterized in that: The processor is coupled to the memory and is used to read and execute instructions stored in the memory to implement the steps of any one of claims 1-12 or 13-17.

41. The network device according to claim 40, characterized in that The network device is a chip or a system on chip.

Images