A signal encoding and decoding method, device, encoding device, decoding device and storage medium

Abstract

The present disclosure proposes a signal encoding and decoding method, device, decoding end, encoding end and storage medium, which belongs to the field of communication technology. The method includes: collecting an audio signal, the audio signal includes at least one object signal, performing signal feature analysis on the object signal to obtain an analysis result, and classifying the at least one object signal based on the analysis result to obtain at least one object signal set, and determining the encoding mode corresponding to each object signal set based on the classification result, wherein the object signal set includes at least one object signal, and finally encoding the object signal in the object signal set using the corresponding encoding mode to obtain at least one encoded object signal parameter information, and writing the object signal parameter information into the encoded code stream and sending it to the decoding end. The method provided in the present disclosure can improve the efficiency of compressed data and save bandwidth.

Description

Technical Field

[0001] The present disclosure relates to the field of communication technologies, and in particular to a signal encoding and decoding method, apparatus, encoding device, decoding device, and storage medium. Background Art

[0002] 3D audio has been widely used because it can give users a better sense of stereo and spatial immersion. When building a 3D audio experience, it is usually necessary to encode the collected audio signal and transmit the encoded signal to the playback device for playback.

[0003] In related technologies, when an audio signal includes a large number of object signals, its encoding method may include:

[0004] Method 1: Encode each object signal separately and multiplex all the encoded bits to form a coded bit stream;

[0005] Method 2: Jointly encode each object signal and multiplex the jointly encoded bits to form a coded bit stream;

[0006] Method 3: Encode one part of the object signals separately, and jointly encode each object signal of the other part, and multiplex the encoded bits to form an encoded bit stream.

[0007] However, Method 1, Method 2, and Method 3 in the related art do not take into account the correlation between object signals, which will result in a low data compression rate and fail to save bandwidth. Summary of the Invention

[0008] The present disclosure proposes a signal encoding and decoding method, apparatus, user equipment, network-side equipment, and storage medium to solve the technical problem that encoding methods in related technologies result in low data compression rates and an inability to save bandwidth.

[0009] A signal encoding and decoding method proposed in an embodiment of one aspect of the present disclosure is applied to an encoding end, including:

[0010] collecting an audio signal, where the audio signal includes at least one object signal;

[0011] Performing signal feature analysis on the object signal to obtain an analysis result;

[0012] classifying the at least one object signal based on the analysis result to obtain at least one object signal set, and determining a coding mode corresponding to each object signal set based on the classification result, wherein the object signal set includes at least one object signal;

[0013] The object signal in the object signal set is encoded using a corresponding encoding mode to obtain at least one encoded object signal parameter information, and the object signal parameter information is written into an encoded code stream and sent to a decoding end.

[0014] Another aspect of the present disclosure provides a signal encoding and decoding method, which is applied to a decoding end and includes:

[0015] Receive the encoded code stream sent by the encoding end;

[0016] The encoded code stream is decoded to obtain at least one decoded object signal set.

[0017] A signal encoding and decoding device provided in another embodiment of the present disclosure includes:

[0018] An analysis module, configured to perform signal feature analysis on the object signal to obtain an analysis result;

[0019] a processing module, configured to classify the at least one object signal based on the analysis result to obtain at least one object signal set, and determine a coding mode corresponding to each object signal set based on the classification result, wherein the object signal set includes at least one object signal;

[0020] The encoding module is configured to encode the object signal in the object signal set using a corresponding encoding mode to obtain at least one encoded object signal parameter information, and write the object signal parameter information into an encoded code stream and send it to a decoding end.

[0021] A signal encoding and decoding device provided in another embodiment of the present disclosure includes:

[0022] The receiving module is used to receive the encoded code stream sent by the encoding end;

[0023] A decoding module is used to decode the encoded code stream to obtain at least one decoded object signal set.

[0024] Another aspect of the present disclosure provides a communication device, which includes a processor and a memory, wherein the memory stores a computer program, and the processor executes the computer program stored in the memory to enable the device to perform the method provided in the above aspect.

[0025] Another aspect of the present disclosure provides a communication device, which includes a processor and a memory, wherein the memory stores a computer program, and the processor executes the computer program stored in the memory to enable the device to perform the method provided in the other aspect of the embodiment above.

[0026] A communication device provided in another embodiment of the present disclosure includes: a processor and an interface circuit;

[0027] The interface circuit is used to receive code instructions and transmit them to the processor;

[0028] The processor is configured to run the code instructions to execute the method proposed in one embodiment.

[0029] A communication device provided in another embodiment of the present disclosure includes: a processor and an interface circuit;

[0030] The interface circuit is used to receive code instructions and transmit them to the processor;

[0031] The processor is configured to execute the code instructions to perform the method proposed in another embodiment.

[0032] A computer-readable storage medium provided in yet another aspect of the present disclosure is configured to store instructions, which, when executed, implement the method provided in the first aspect of the present disclosure.

[0033] A computer-readable storage medium provided in yet another aspect of the present disclosure is configured to store instructions, which, when executed, implement the method provided in yet another aspect of the present disclosure.

[0034] In summary, in the signal encoding and decoding method, apparatus, encoding device, decoding device and storage medium provided in the embodiments of the present disclosure, a signal feature analysis will be performed on at least one object signal in the collected audio signal to obtain an analysis result. Afterwards, the object signal will be classified based on the analysis result to obtain at least one object signal set. At the same time, the encoding mode corresponding to each object signal set will be determined based on the classification result. Afterwards, the object signal in the object signal set will be encoded using the corresponding encoding mode. Among them, the signal feature analysis in the embodiments of the present disclosure includes an analysis of the mutual correlation parameter value of the signal or an analysis of the frequency band bandwidth range of the signal. It can be seen from this that in the embodiments of the present disclosure, when determining the encoding mode, the mutual correlation parameter value of the signal or the frequency band bandwidth range of the signal will be taken into account, thereby ensuring the compression rate of the signal and saving bandwidth. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] The above and / or additional aspects and advantages of the present disclosure will become apparent and readily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0036] Figure 1 A schematic diagram of a flow chart of a signal encoding and decoding method provided by one embodiment of the present disclosure;

[0037] Figure 2a A schematic flow chart of a signal encoding and decoding method provided in another embodiment of the present disclosure;

[0038] Figure 2b A block diagram of an ACELP coding principle provided by one embodiment of the present disclosure;

[0039] Figure 2c A block diagram of a frequency domain coding principle provided by one embodiment of the present disclosure;

[0040] Figure 2d A flowchart of a signal encoding method provided by one embodiment of the present disclosure;

[0041] Figure 3a A schematic flow chart of a signal encoding and decoding method provided in yet another embodiment of the present disclosure;

[0042] Figure 3b A flowchart of a signal encoding method provided in another embodiment of the present disclosure;

[0043] Figure 4a A schematic flow chart of a signal encoding and decoding method provided in yet another embodiment of the present disclosure;

[0044] Figure 4b A flowchart of a signal encoding method provided in one embodiment of the present disclosure;

[0045] Figure 5 A schematic flow chart of a signal encoding and decoding method provided in yet another embodiment of the present disclosure;

[0046] Figure 6 A schematic flow chart of a signal encoding and decoding method provided in yet another embodiment of the present disclosure;

[0047] Figure 7 A schematic flow chart of a signal encoding and decoding method provided in yet another embodiment of the present disclosure;

[0048] Figure 8a A schematic flow chart of a signal encoding and decoding method provided in yet another embodiment of the present disclosure;

[0049] Figure 8b A flowchart of a signal decoding method provided by one embodiment of the present disclosure;

[0050] Figure 8c A flowchart of a signal decoding method provided in yet another embodiment of the present disclosure;

[0051] Figure 9 A schematic structural diagram of a signal encoding and decoding device provided by an embodiment of the present disclosure;

[0052] Figure 10 A schematic structural diagram of a signal encoding and decoding device provided in another embodiment of the present disclosure;

[0053] Figure 11is a block diagram of a user equipment provided by one embodiment of the present disclosure;

[0054] Figure 12 A block diagram of a network-side device provided in one embodiment of the present disclosure. DETAILED DESCRIPTION

[0055] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all possible implementations consistent with the present disclosure. Rather, they are merely examples of apparatuses and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

[0056] The terms used in the embodiments of the present disclosure are for the purpose of describing specific embodiments only and are not intended to limit the embodiments of the present disclosure. The singular forms "a," "an," and "the" used in the embodiments of the present disclosure and the appended claims are also intended to include plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" as used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0057] It should be understood that although the terms first, second, third, etc. may be used to describe various information in the embodiments of the present disclosure, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other. For example, without departing from the scope of the embodiments of the present disclosure, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the words "if" and "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0058] The signal encoding and decoding method, apparatus, encoding device, decoding device, and storage medium provided by the embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.

[0059] Figure 1 This is a flow chart of a signal encoding and decoding method provided by an embodiment of the present disclosure, which is executed by the encoding end, such as Figure 1 As shown, the signal encoding and decoding method may include the following steps:

[0060] Step 101: Collect an audio signal, where the audio signal includes at least one object signal.

[0061] In one embodiment of the present disclosure, the encoding end may be a UE (User Equipment) or a base station. A UE may be a device that provides voice and / or data connectivity to a user. A terminal device may communicate with one or more core networks via a RAN (Radio Access Network). A UE may be an IoT terminal, such as a sensor device, a mobile phone (or "cellular" phone), and a computer with an IoT terminal. For example, it may be a fixed, portable, pocket-sized, handheld, computer-built-in, or vehicle-mounted device. For example, a station (STA), subscriber unit, subscriber station, mobile station, mobile, remote station, access point, remote terminal, access terminal, user terminal, or user agent. Alternatively, a UE may be a device on an unmanned aerial vehicle. Alternatively, a UE may be an in-vehicle device, such as a driving computer with wireless communication capabilities, or a wireless terminal connected to an external driving computer. Alternatively, the UE may also be a roadside device, for example, a street lamp, a signal lamp, or other roadside device with a wireless communication function.

[0062] Furthermore, in one embodiment of the present disclosure, the object signal may be an object signal corresponding to various musical instruments or a singing signal, wherein the object signal corresponding to the musical instrument may be, for example, a piano object signal, a flute object signal, a piccolo object signal, a clarinet object signal, etc.

[0063] Step 102: Perform signal feature analysis on the target signal to obtain an analysis result.

[0064] In one embodiment of the present disclosure, the signal feature analysis may be a signal cross-correlation parameter value analysis. In another embodiment of the present disclosure, the feature analysis may be a signal frequency band bandwidth range analysis. Cross-correlation parameter value analysis and frequency band bandwidth range analysis will be described in detail in subsequent embodiments.

[0065] Step 103: classify at least one object signal based on the analysis result to obtain at least one object signal set, and determine a coding mode corresponding to each object signal set based on the classification result, wherein the object signal set includes at least one object signal.

[0066] If the signal feature analysis method used in step 102 is different, the method for classifying the object signals and the method for determining the coding mode corresponding to each object signal set in this step will also be different.

[0067] Specifically, in one embodiment of the present disclosure, if the signal feature analysis method adopted in step 102 is a signal cross-correlation parameter value analysis method, then the object signal classification method in this step may be: a classification method based on the signal cross-correlation parameter value; the method for determining the coding mode corresponding to each object signal set may be: determining the coding mode corresponding to each object signal set based on the signal cross-correlation parameter value.

[0068] In another embodiment of the present disclosure, if the signal feature analysis method adopted in step 102 is a signal frequency band bandwidth range analysis method, then the object signal classification method in this step may be: a classification method based on the signal frequency band bandwidth range; the method for determining the coding mode corresponding to each object signal set may be: determining the coding mode corresponding to each object signal set based on the signal frequency band bandwidth range.

[0069] In addition, the detailed introduction of the above-mentioned "classification method based on the mutual correlation parameter value of the signal or the frequency bandwidth range of the signal" and "determining the encoding mode corresponding to each object signal set based on the mutual correlation parameter value of the signal or the frequency bandwidth range of the signal" will also be introduced in subsequent embodiments.

[0070] It should be noted that in one embodiment of the present disclosure, after at least one object signal set is obtained through classification, each object signal set may be preprocessed, wherein the preprocessing may include at least one of high-pass processing, pre-emphasis processing, and normalization processing.

[0071] Step 104: Encode the object signal in the object signal set using a corresponding encoding mode to obtain at least one encoded object signal parameter information, and write the encoded object signal parameter information into an encoding stream and send it to a decoding end.

[0072] It should be noted that, in one embodiment of the present disclosure, when the classification methods of the object signals in step 103 are different, the encoding conditions of at least one object signal set will also be different.

[0073] Furthermore, in an embodiment of the present disclosure, the object signals in the pre-processed object signal set are encoded using a corresponding encoding mode.

[0074] Furthermore, in one embodiment of the present disclosure, the method of writing the encoded object signal parameter information into the encoded bitstream and sending it to the decoding end may specifically include:

[0075] Step 1: Determine a classification side information parameter, which is used to indicate a classification method for the target signal. For example, the classification side information parameter may indicate whether the classification method for the target signal is based on a signal cross-correlation parameter value or a signal frequency bandwidth range.

[0076] Step 2: Determine the side information parameters corresponding to each object signal set. The side information parameters are used to indicate the coding mode corresponding to the object signal set.

[0077] Step 3: Multiplex the classified side information parameters, the side information parameters corresponding to each object signal set, and the encoded object signal parameter information to obtain a bitstream, and send the bitstream to the decoding end.

[0078] In one embodiment of the present disclosure, the classified side information parameters and the side information parameters corresponding to each object signal set are sent to the decoding end so that the decoding end can determine the corresponding encoding situation based on the classified side information parameters, and determine the encoding mode corresponding to each object signal set based on the side information parameters corresponding to each object signal set, so that each object signal set can be subsequently decoded using the corresponding decoding mode and decoding mode based on the encoding situation and encoding mode.

[0079] In summary, in the signal coding and decoding method provided in the embodiment of the present disclosure, a signal feature analysis will be performed on at least one object signal in the collected audio signal to obtain an analysis result. Afterwards, the object signal will be classified based on the analysis result to obtain at least one object signal set. At the same time, the encoding mode corresponding to each object signal set will be determined based on the classification result. Afterwards, the object signal in the object signal set will be encoded using the corresponding encoding mode. Among them, the signal feature analysis in the embodiment of the present disclosure includes an analysis of the mutual correlation parameter value of the signal or an analysis of the frequency band bandwidth range of the signal. It can be seen that in the embodiment of the present disclosure, when determining the encoding mode, the mutual correlation parameter value of the signal or the frequency band bandwidth range of the signal will be taken into account, thereby ensuring the compression rate of the signal and saving bandwidth.

[0080] Figure 2a This is a flow chart of a signal encoding and decoding method provided by an embodiment of the present disclosure, which is executed by the encoding end, such as Figure 2a As shown, the signal encoding and decoding method may include the following steps:

[0081] Step 201: Collect an audio signal, where the audio signal includes at least one object signal.

[0082] It can be understood that, in this embodiment, the at least one object signal is two or more object signals.

[0083] Step 202: Perform high-pass filtering on at least one object signal.

[0084] In one embodiment of the present disclosure, a filter may be used to perform high-pass filtering on the object signal.

[0085] The filter cutoff frequency is set to 20 Hz. The filter formula used by the filter can be shown in the following formula (1):

[0086]

[0087] Among them, a1, a2, b0, b1, and b2 are all constants. For example, b0 = 0.9981492, b1 = -1.9963008, b2 = 0.9981498, a1 = 1.9962990, and a2 = -0.9963056.

[0088] Step 203: Perform correlation analysis on the object signals after high-pass filtering to determine the cross-correlation parameter values between the object signals.

[0089] In one embodiment of the present disclosure, the above correlation analysis can be calculated using the following formula (2):

[0090]

[0091] Among them, η xy It is used to indicate the cross-correlation parameter value of the object signal X and the object signal Y, X i 、Y i are used to indicate the i-th object signal, The average value of the signal sequence used to indicate the object signal X, The average value of the signal sequence used to indicate the object signal Y.

[0092] It should be noted that the above-mentioned method of "calculating the mutual correlation parameter value using formula (2)" is an optional method provided in the embodiment of the present disclosure, and it should be recognized that other methods of calculating the mutual correlation parameter value between object signals in the art can also be applied to the present disclosure.

[0093] Step 204: Classify at least one object signal based on the analysis result to obtain at least one object signal set, and determine a coding mode corresponding to each object signal set based on the classification result, wherein the object signal set includes at least one object signal.

[0094] In one embodiment of the present disclosure, classifying at least one object signal based on an analysis result to obtain at least one object signal set, and determining a coding mode corresponding to each object signal set based on the classification result includes:

[0095] Based on the correlation level, a normalized correlation level interval is set. Based on the mutual correlation parameter of the signal and the normalized correlation level interval, at least one object signal is classified to obtain at least one object signal set. Subsequently, a corresponding coding mode can be determined based on the correlation level corresponding to the object signal set.

[0096] It can be understood that the number of normalized correlation degree intervals is determined according to the way of dividing the correlation degree. The present disclosure does not limit the way of dividing the correlation degree, and does not limit the lengths of different normalized correlation degree intervals. The corresponding number of normalized correlation degree intervals and different interval lengths can be set according to different ways of dividing the correlation degree.

[0097] In one embodiment of the present disclosure, the correlation degree is divided into four types: weak correlation, real correlation, significant correlation, and high correlation. Table 1 is a normalized correlation degree interval classification table provided in the embodiment of the present disclosure.

[0098] Normalized correlation interval Degree of relevance 0.00～±0.30 Weak correlation ±0.30-±0.50 Real Correlation ±0.50-±0.80 Significant correlation ±0.80-±1.00 Highly correlated

[0099] Based on the above content, as an example, the object signals whose mutual correlation parameter values are between the first interval can be divided into object signal set 1, and it is determined that the object signal set 1 corresponds to the independent coding mode;

[0100] dividing the object signals whose cross-correlation parameter values are between the second interval into an object signal set 2, and determining that the object signal set 2 corresponds to the joint coding mode 1;

[0101] dividing the object signals whose cross-correlation parameter values are between the third interval into an object signal set 3, and determining that the object signal set 3 corresponds to the joint coding mode 2;

[0102] The object signals whose mutual correlation parameter values are between the fourth interval are divided into object signal set 4, and it is determined that the object signal set 4 corresponds to joint coding mode 3.

[0103] Among them, in one embodiment of the present disclosure, the first interval can be [0.00~±0.30), the second interval can be [±0.30-±0.50), the third interval can be [±0.50-±0.80), and the fourth interval can be [±0.80-±1.00]. And, when the mutual correlation parameter value between the object signals is between the first interval, it means that the object signals are weakly correlated. At this time, in order to ensure the coding accuracy, an independent coding mode should be used for encoding. When the mutual correlation parameter value between the object signals is between the second interval, the third interval, and the fourth interval, it means that the mutual correlation between the object signals is high. At this time, a joint coding mode can be used for encoding to ensure the compression rate and save bandwidth.

[0104] Furthermore, in one embodiment of the present disclosure, the independent coding mode corresponds to a time domain processing method or a frequency domain processing method; wherein, when the object signal in the object signal set 1 is a speech signal or a speech-like signal, the independent coding mode adopts a time domain processing method; when the object signal in the object signal set 1 is an audio signal other than a speech signal or a speech-like signal (such as a music signal or a mixed signal of speech and music or a mixed signal of a noise signal and speech and music signals), the independent coding mode adopts a frequency domain processing method.

[0105] In one embodiment of the present disclosure, the above-mentioned time domain processing method can be implemented using the ACELP coding model. Figure 2b This is a block diagram of an ACELP encoding principle provided by an embodiment of the present disclosure. The specific principles of the ACELP encoder can be found in the prior art, and will not be elaborated on in detail in the embodiment of the present disclosure.

[0106] In one embodiment of the present disclosure, the frequency domain processing method may include a transform domain processing method. Figure 2c This is a block diagram of the frequency domain coding principle provided by the embodiment of the present disclosure. Figure 2c , the input object signal can be first transformed into the frequency domain by performing MDCT transformation through the transformation module, wherein the transformation formula and inverse transformation formula of MDCT transformation are respectively as follows: Formula (3) and Formula (4).

[0107]

[0108]

[0109] Afterwards, the psychoacoustic model is used to adjust each frequency band for the object signal transformed into the frequency domain, and the envelope coefficient of each frequency band is quantized by bit allocation using the quantization module to obtain the quantization parameter. Finally, the entropy coding module is used to entropy encode the quantization parameter to output the encoded object signal.

[0110] Step 205: Use the same coding core to encode all object signal sets using corresponding coding modes to obtain at least one encoded object signal parameter information, and write the encoded object signal parameter information into the encoding code stream and send it to the decoding end.

[0111] In one embodiment of the present disclosure, a method for encoding all object signal sets using corresponding coding modes may include:

[0112] The object signal set 1 is encoded using an independent coding mode;

[0113] The object signal set 2 is encoded using the joint coding mode 1;

[0114] The object signal set 3 is encoded using joint coding mode 2;

[0115] The object signal set 4 is encoded using joint coding mode 3.

[0116] Also, for the related introduction of “writing the encoded object signal parameter information into the encoded code stream and sending it to the decoding end”, reference may be made to the above embodiment, which will not be elaborated in detail in this embodiment.

[0117] Finally, based on the above description, Figure 2d A flowchart of a signal encoding method provided in an embodiment of the present disclosure.

[0118] In summary, in the signal coding and decoding method provided in the embodiment of the present disclosure, a signal feature analysis will be performed on at least one object signal in the collected audio signal to obtain an analysis result. Afterwards, the object signal will be classified based on the analysis result to obtain at least one object signal set. At the same time, the encoding mode corresponding to each object signal set will be determined based on the classification result. Afterwards, the object signal in the object signal set will be encoded using the corresponding encoding mode. Among them, the signal feature analysis in the embodiment of the present disclosure includes an analysis of the mutual correlation parameter value of the signal. It can be seen from this that in the embodiment of the present disclosure, when determining the encoding mode, the mutual correlation parameter value of the signal will be taken into account, thereby ensuring the compression rate of the signal and saving bandwidth.

[0119] Figure 3a This is a flow chart of a signal encoding and decoding method provided by an embodiment of the present disclosure, which is executed by the encoding end, such as Figure 3a As shown, the signal encoding and decoding method may include the following steps:

[0120] Step 301: Collect an audio signal, where the audio signal includes at least one object signal.

[0121] Step 302: Analyze the frequency bandwidth range of at least one target signal.

[0122] Step 303: Classify at least one object signal based on the analysis result to obtain at least one object signal set, and determine a coding mode corresponding to each object signal set based on the classification result, wherein the object signal set includes at least one object signal.

[0123] In one embodiment of the present disclosure, a method for classifying at least one object signal based on an analysis result to obtain at least one object signal set, and determining a coding mode corresponding to each object signal set based on the classification result may include:

[0124] Determine the bandwidth intervals corresponding to different frequency bands;

[0125] Based on the frequency band bandwidth range of the object signal and the bandwidth intervals corresponding to different frequency band bandwidths, at least one object signal is classified to obtain at least one object signal set, and a corresponding coding mode is determined based on the frequency band bandwidth corresponding to the at least one object signal set.

[0126] The frequency bandwidth of the signal generally includes narrowband, wideband, ultra-wideband, and fullband. Furthermore, the bandwidth interval corresponding to narrowband can be a first interval, the bandwidth interval corresponding to wideband can be a second interval, the bandwidth interval corresponding to ultra-wideband can be a third interval, and the bandwidth interval corresponding to fullband can be a fourth interval. At least one target signal can be classified to obtain at least one target signal set by determining the bandwidth interval to which the frequency bandwidth range of the target signal belongs. Subsequently, a corresponding coding mode is determined based on the frequency bandwidth corresponding to the at least one target signal set, where narrowband, wideband, ultra-wideband, and fullband correspond to narrowband coding mode, wideband coding mode, ultra-wideband coding mode, and fullband coding mode, respectively.

[0127] It should be noted that the embodiments of the present disclosure do not limit the lengths of different bandwidth intervals, and bandwidth intervals between different frequency bands may overlap.

[0128] And, as an example, the object signals whose frequency bandwidth range is within the first interval can be divided into an object signal set 1, and it is determined that the object signal set 1 corresponds to the narrowband coding mode;

[0129] dividing the object signals whose frequency bandwidth range is within the second interval into an object signal set 2, and determining that the object signal set 2 corresponds to a wideband coding mode;

[0130] dividing the object signals whose frequency bandwidth range is within the third interval into an object signal set 3, and determining that the object signal set 3 corresponds to an ultra-wideband coding mode;

[0131] The object signals whose frequency band bandwidth ranges between the fourth interval are divided into an object signal set 4, and it is determined that the object signal set 4 corresponds to the full-band coding mode.

[0132] In one embodiment of the present disclosure, the first interval may be 0-4kHz, the second interval may be 0-8kHz, the third interval may be 0-16kHz, and the fourth interval may be 0-20kHz. Furthermore, when the frequency bandwidth of the object signal is between the first interval, it indicates that the object signal is a narrowband signal, and the encoding mode corresponding to the object signal can be determined as: using relatively few bits for encoding (i.e., using a narrowband encoding mode); when the frequency bandwidth of the object signal is between the second interval, it indicates that the object signal is a wideband signal, and the encoding mode corresponding to the object signal can be determined as: using more bits for encoding (i.e., using a wideband encoding mode); when the frequency bandwidth of the object signal is between the third interval, it indicates that the object signal is an ultra-wideband signal, and the encoding mode corresponding to the object signal can be determined as: using relatively more bits for encoding (i.e., using an ultra-wideband encoding mode); when the frequency bandwidth of the object signal is between the fourth interval, it indicates that the object signal is a full-band signal, and the encoding mode corresponding to the object signal can be determined as: using more bits for encoding (i.e., using a full-band encoding mode).

[0133] Therefore, by using different bits to encode signals of different frequency bands, the compression rate of the signal can be ensured and the bandwidth can be saved.

[0134] Step 304: Use different coding cores to encode different object signal sets using corresponding coding modes to obtain at least one encoded object signal parameter information, and send the encoded object signal parameter information to a decoding end.

[0135] In one embodiment of the present disclosure, a method for encoding different object signal sets using different coding cores and corresponding coding modes may include:

[0136] After determining a specific coding mode based on the frequency bandwidth corresponding to the object signal set in step 302, a coding core corresponding to the coding mode may be determined based on the coding mode, and then the corresponding object signal set may be encoded based on the coding core.

[0137] For example, the coding mode corresponding to the object signal set 1 is: narrowband coding mode, then the narrowband coding core can be used to encode the object signal set 1;

[0138] The coding mode corresponding to the object signal set 2 is: broadband coding mode, and the broadband coding core can be used to encode the object signal set 2;

[0139] The coding mode corresponding to the object signal set 3 is: ultra-wideband coding mode, and the object signal set 3 can be encoded using the ultra-wideband coding core;

[0140] The encoding mode corresponding to the object signal set 4 is: full-band encoding mode, and the object signal set 4 can be encoded using the full-band encoding mode.

[0141] Also, for the introduction of “writing the encoded object signal parameter information into the encoded code stream and sending it to the decoding end”, please refer to the above embodiment, and the embodiment of this disclosure will not be repeated here.

[0142] Finally, based on the above description, Figure 3b A flowchart of a signal encoding method provided in an embodiment of the present disclosure.

[0143] In summary, in the signal encoding and decoding method provided in the embodiment of the present disclosure, a signal feature analysis will be performed on at least one object signal in the collected audio signal to obtain an analysis result. Thereafter, the object signal will be classified based on the analysis result to obtain at least one object signal set. At the same time, the encoding mode corresponding to each object signal set will be determined based on the classification result. Thereafter, the object signal in the object signal set will be encoded using the corresponding encoding mode. Among them, the signal feature analysis in the embodiment of the present disclosure includes the frequency band bandwidth range analysis of the signal. It can be seen that in the embodiment of the present disclosure, when determining the encoding mode, the frequency band bandwidth range of the signal will be taken into account, thereby ensuring the compression rate of the signal and saving bandwidth.

[0144] Figure 4a This is a flow chart of a signal encoding and decoding method provided by an embodiment of the present disclosure, which is executed by the encoding end, such as Figure 4a As shown, the signal encoding and decoding method may include the following steps:

[0145] Step 401: Collect an audio signal, where the audio signal includes at least one object signal.

[0146] Step 402: Analyze the frequency bandwidth range of at least one target signal.

[0147] Step 403: Acquire input command line control information, where the command line control information is used to indicate a bandwidth range of a frequency band to be encoded corresponding to the object signal.

[0148] In one embodiment of the present disclosure, the command line control information may be manually input into the encoding end. Furthermore, the frequency bandwidth range of the object signal to be encoded indicated by the command line control information is not the actual frequency bandwidth range of the object signal, but is user-defined.

[0149] For example, in one embodiment of the present disclosure, if the actual frequency bandwidth range of a certain object signal is narrow, but the user desires high-precision processing of the object signal, the frequency bandwidth range indicated by the command line control information corresponding to the object signal can be set to wide. Furthermore, if the actual frequency bandwidth range of a certain object signal is wide, but the user desires low-precision processing of the object signal, the frequency bandwidth range indicated by the command line control information corresponding to the object signal can be set to narrow.

[0150] Step 404: Classify the at least one object signal based on the command line control information and the analysis result to obtain at least one object signal set, and determine a coding mode corresponding to each object signal set based on the classification result.

[0151] In one embodiment of the present disclosure, the method of classifying the at least one object signal by integrating the command line control information and the analysis result to obtain at least one object signal set, and determining the coding mode corresponding to each object signal set based on the classification result may include:

[0152] When the frequency band bandwidth range indicated by the command line control information is different from the frequency band bandwidth range obtained from the analysis result, at least one object signal is preferentially classified based on the frequency band bandwidth range indicated by the command line control information, and the coding mode corresponding to each object signal set is determined based on the classification result.

[0153] When the frequency bandwidth range indicated by the command line control information is the same as the frequency bandwidth range obtained by the analysis result, classifying at least one object signal according to the frequency bandwidth range indicated by the command line control information or the frequency bandwidth range obtained by the analysis result, and determining the coding mode corresponding to each object signal set based on the classification result

[0154] For example, in one embodiment of the present disclosure, assuming that the analysis result of the object signal is an ultra-wideband signal, and the frequency band bandwidth range indicated by the command line control information of the object signal is a full-band signal, at this time, the object signal can be divided into object signal set 4 based on the command line control information, and the encoding mode corresponding to the object signal set 4 is determined to be: full-band encoding mode.

[0155] Step 405: Encode the object signal in the object signal set using a corresponding encoding mode to obtain at least one encoded object signal parameter information, and send the encoded object signal parameter information to a decoding end.

[0156] For the introduction of step 405, please refer to the above embodiment description. This disclosure is an embodiment and will not be described in detail here.

[0157] Finally, based on the above description, Figure 4bA flowchart of a signal encoding method provided in an embodiment of the present disclosure.

[0158] In summary, in the signal encoding and decoding method provided in the embodiment of the present disclosure, a signal feature analysis will be performed on at least one object signal in the collected audio signal to obtain an analysis result. Thereafter, the object signal will be classified based on the analysis result to obtain at least one object signal set. At the same time, the encoding mode corresponding to each object signal set will be determined based on the classification result. Thereafter, the object signal in the object signal set will be encoded using the corresponding encoding mode. Among them, the signal feature analysis in the embodiment of the present disclosure includes the frequency band bandwidth range analysis of the signal. It can be seen that in the embodiment of the present disclosure, when determining the encoding mode, the frequency band bandwidth range of the signal will be taken into account, thereby ensuring the compression rate of the signal and saving bandwidth.

[0159] Figure 5 This is a flow chart of a signal encoding and decoding method provided by an embodiment of the present disclosure, which is executed by a decoding end, such as Figure 7 As shown, the signal encoding and decoding method may include the following steps:

[0160] Step 501: Receive at least one encoded object signal parameter information sent by an encoding end.

[0161] In one embodiment of the present disclosure, the decoding end may be a UE (User Equipment) or a base station.

[0162] Step 502: Decode at least one encoded object signal parameter information to obtain at least one decoded object signal set.

[0163] In summary, in the signal coding and decoding method provided in the embodiment of the present disclosure, during the coding process, a signal feature analysis will be performed on at least one object signal in the collected audio signal to obtain an analysis result. Afterwards, the object signal will be classified based on the analysis result to obtain at least one object signal set. At the same time, the coding mode corresponding to each object signal set will be determined based on the classification result. Afterwards, the object signal in the object signal set will be encoded using the corresponding coding mode. Among them, the signal feature analysis in the embodiment of the present disclosure includes the frequency band bandwidth range analysis of the signal. It can be seen that in the embodiment of the present disclosure, when determining the coding mode, the frequency band bandwidth range of the signal will be taken into account, thereby ensuring the compression rate of the signal and saving bandwidth.

[0164] Figure 6 This is a flow chart of a signal encoding and decoding method provided by an embodiment of the present disclosure, which is executed by a decoding end, such as Figure 6 As shown, the signal encoding and decoding method may include the following steps:

[0165] Step 601: Receive the encoded code stream sent by the encoding end.

[0166] Step 602: parse the encoded bitstream to obtain classification side information parameters, side information parameters corresponding to each object signal set, and at least one encoded object signal parameter information.

[0167] The classification side information parameter indicates how the object signal is classified, and the side information parameter indicates the encoding mode corresponding to the object signal set. For more information about the classification side information and side information parameters, please refer to the above embodiments and will not be elaborated on in detail in this disclosure.

[0168] Step 603: Decode at least one encoded object signal parameter information to obtain at least one decoded object signal set.

[0169] In one embodiment of the present disclosure, the encoded object signal parameters are decoded based on the classification side information and the side information parameters to obtain at least one decoded object signal set. The specific decoding method will be described in detail in subsequent embodiments.

[0170] In summary, in the signal coding and decoding method provided in the embodiment of the present disclosure, during the coding process, a signal feature analysis will be performed on at least one object signal in the collected audio signal to obtain an analysis result. Afterwards, the object signal will be classified based on the analysis result to obtain at least one object signal set. At the same time, the coding mode corresponding to each object signal set will be determined based on the classification result. Afterwards, the object signal in the object signal set will be encoded using the corresponding coding mode. Among them, the signal feature analysis in the embodiment of the present disclosure includes the frequency band bandwidth range analysis of the signal. It can be seen that in the embodiment of the present disclosure, when determining the coding mode, the frequency band bandwidth range of the signal will be taken into account, thereby ensuring the compression rate of the signal and saving bandwidth.

[0171] Figure 7 This is a flow chart of a signal encoding and decoding method provided by an embodiment of the present disclosure, which is executed by a decoding end, such as Figure 7 As shown, the signal encoding and decoding method may include the following steps:

[0172] Step 701: Receive the encoded code stream sent by the encoding end.

[0173] Step 702: parse the encoded bitstream to obtain classification side information parameters, side information parameters corresponding to each object signal set, and at least one encoded object signal parameter information.

[0174] The classification side information parameter indicates how the object signal is classified, and the side information parameter indicates the encoding mode corresponding to the object signal set. For more information about the classification side information and side information parameter, please refer to the above embodiments and will not be further elaborated in this disclosure.

[0175] Step 703: Determine a classification method for the object signal based on the classification side information parameters.

[0176] As can be seen from the description of the above embodiments, when the object signals are classified in different ways, the corresponding encoding situations will also be different. Specifically, in one embodiment of the present disclosure, when the object signals are classified based on the mutual correlation parameter value of the signals, the corresponding encoding situation at the encoding end is to use the same coding core to encode all the object signal sets using the corresponding coding mode.

[0177] In another embodiment of the present disclosure, when the classification method of the object signal is: a classification method based on the frequency band bandwidth range, the encoding situation corresponding to the encoding end is: using different encoding cores to encode different object signal sets using corresponding encoding modes

[0178] Therefore, in this step, it is necessary to first determine the classification method of the object signal in the encoding process based on the classification side information parameters, so as to determine the encoding situation in the encoding process, and then decoding can be performed based on the encoding situation.

[0179] Step 704: Determine the encoding mode corresponding to each encoded object signal parameter information based on the side information parameters.

[0180] Step 705 : Decode each encoded object signal parameter information using a corresponding decoding mode based on the object signal classification method and the encoding mode corresponding to each encoded object signal parameter information.

[0181] In one embodiment of the present disclosure, a method for decoding each encoded object signal parameter information using a corresponding decoding mode based on the classification method of the object signal and the encoding mode corresponding to each encoded object signal parameter information may include:

[0182] First, the encoding situation in the encoding process is determined based on the classification method, and then the corresponding decoding mode is determined based on the encoding situation. After that, the corresponding decoding mode is used to decode each encoded object signal parameter information based on the corresponding encoding and decoding mode based on the encoding mode corresponding to each encoded object signal parameter information.

[0183] Specifically, in one embodiment of the present disclosure, if the encoding process determines, based on the classification mode, that the encoding condition is: using the same encoding core to encode all object signal sets using the corresponding encoding mode, then the decoding process determines that the decoding mode is: using the same decoding core to decode all encoded object signal parameter information. Specifically, during the decoding process, each encoded object signal parameter information is decoded using the corresponding decoding mode based on the encoding mode corresponding to each encoded object signal parameter information, thereby obtaining at least one decoded object signal set.

[0184] Furthermore, in another embodiment of the present disclosure, if the encoding process determines, based on the classification mode, that different encoding cores are used to encode different object signal sets using corresponding encoding modes, then the decoding process determines that different decoding cores are used to decode the encoded object signal parameter information. Specifically, during the decoding process, the encoded object signal parameter information is decoded using a corresponding decoding mode based on the encoding mode corresponding to each encoded object signal parameter information, thereby obtaining at least one decoded object signal set.

[0185] In summary, in the signal coding and decoding method provided in the embodiment of the present disclosure, during the coding process, a signal feature analysis will be performed on at least one object signal in the collected audio signal to obtain an analysis result. Afterwards, the object signal will be classified based on the analysis result to obtain at least one object signal set. At the same time, the coding mode corresponding to each object signal set will be determined based on the classification result. Afterwards, the object signal in the object signal set will be encoded using the corresponding coding mode. Among them, the signal feature analysis in the embodiment of the present disclosure includes the frequency band bandwidth range analysis of the signal. It can be seen that in the embodiment of the present disclosure, when determining the coding mode, the frequency band bandwidth range of the signal will be taken into account, thereby ensuring the compression rate of the signal and saving bandwidth.

[0186] Figure 8a This is a flow chart of a signal encoding and decoding method provided by an embodiment of the present disclosure, which is executed by a decoding end, such as Figure 8a As shown, the signal encoding and decoding method may include the following steps:

[0187] Step 801: Receive the encoded code stream sent by the encoding end.

[0188] Step 802: Decode the encoded code stream to obtain at least one decoded object signal set.

[0189] Step 803: Post-process at least one decoded object signal set.

[0190] In one embodiment of the present disclosure, the post-processing may be specifically the reverse process of the pre-processing in the aforementioned embodiment.

[0191] Also, for a detailed description of steps 801-803, please refer to the above embodiment description, and the embodiment of the present disclosure will not be repeated here.

[0192] Finally, based on the above description, Figure 8b A flowchart of a signal decoding method provided by an embodiment of the present disclosure. Figure 8c A flowchart of a signal decoding method provided by an embodiment of the present disclosure.

[0193] In summary, in the signal coding and decoding method provided in the embodiment of the present disclosure, during the coding process, a signal feature analysis will be performed on at least one object signal in the collected audio signal to obtain an analysis result. Afterwards, the object signal will be classified based on the analysis result to obtain at least one object signal set. At the same time, the coding mode corresponding to each object signal set will be determined based on the classification result. Afterwards, the object signal in the object signal set will be encoded using the corresponding coding mode. Among them, the signal feature analysis in the embodiment of the present disclosure includes the frequency band bandwidth range analysis of the signal. It can be seen that in the embodiment of the present disclosure, when determining the coding mode, the frequency band bandwidth range of the signal will be taken into account, thereby ensuring the compression rate of the signal and saving bandwidth.

[0194] Figure 9 This is a structural diagram of a signal encoding and decoding method and device provided by an embodiment of the present disclosure, which is applied to an encoding end, such as Figure 9 As shown, the apparatus 900 may include:

[0195] an acquisition module, configured to acquire an audio signal, wherein the audio signal includes at least one object signal;

[0196] An analysis module, used for performing signal feature analysis on the object signal to obtain analysis results;

[0197] a processing module, configured to classify at least one object signal based on the analysis result to obtain at least one object signal set, and determine a coding mode corresponding to each object signal set based on the classification result, wherein the object signal set includes at least one object signal;

[0198] The encoding module is configured to encode an object signal in the object signal set using a corresponding encoding mode to obtain at least one encoded object signal parameter information, and send the encoded object signal parameter information to a decoding end.

[0199] In summary, in the signal encoding and decoding device provided in the embodiment of the present disclosure, a signal feature analysis is performed on at least one object signal in the collected audio signal to obtain an analysis result. Thereafter, the object signal is classified based on the analysis result to obtain at least one object signal set. At the same time, the encoding mode corresponding to each object signal set is determined based on the classification result. Thereafter, the object signal in the object signal set is encoded using the corresponding encoding mode. Among them, the signal feature analysis in the embodiment of the present disclosure includes the frequency band bandwidth range analysis of the signal. It can be seen that in the embodiment of the present disclosure, when determining the encoding mode, the frequency band bandwidth range of the signal is taken into consideration, thereby ensuring the compression rate of the signal and saving bandwidth.

[0200] Optionally, in one embodiment of the present disclosure, the apparatus is further configured to:

[0201] The at least one object signal set is pre-processed.

[0202] Optionally, in one embodiment of the present disclosure, the encoding module is further configured to:

[0203] The object signals in the preprocessed object signal set are encoded using a corresponding encoding mode.

[0204] Optionally, in one embodiment of the present disclosure, the encoding module is further configured to:

[0205] determining a classification side information parameter, where the classification side information parameter is used to indicate a classification method for the object signal;

[0206] Determining side information parameters corresponding to each object signal set, where the side information parameters are used to indicate a coding mode corresponding to the object signal set;

[0207] The classification side information parameters, the side information parameters corresponding to each object signal set, and the encoded object signal parameter information are multiplexed to obtain an encoded code stream, and the encoded code stream is sent to a decoding end.

[0208] Optionally, in one embodiment of the present disclosure, the analysis module is further configured to:

[0209] performing high-pass filtering on the at least one object signal;

[0210] Correlation analysis is performed on the object signals after high-pass filtering to determine the cross-correlation parameter values between the object signals.

[0211] Optionally, in one embodiment of the present disclosure, the processing module is further configured to:

[0212] According to the correlation degree, set the normalized correlation degree interval;

[0213] Based on the mutual correlation parameters and normalized correlation degree intervals of the object signals, at least one object signal is classified to obtain at least one object signal set, and a corresponding encoding mode is determined based on the correlation degree corresponding to the at least one object signal set.

[0214] Optionally, in one embodiment of the present disclosure, the coding mode corresponding to the object signal set includes an independent coding mode or a joint coding mode.

[0215] Optionally, in an embodiment of the present disclosure, the independent coding mode corresponds to a time domain processing method or a frequency domain processing method;

[0216] Wherein, when the object signal in the object signal set is a speech signal or a speech-like signal, the independent coding mode adopts a time domain processing method;

[0217] When the object signal in the object signal set is an audio signal other than a speech signal or a speech-like signal, the independent coding mode adopts a frequency domain processing manner.

[0218] Optionally, in one embodiment of the present disclosure, the encoding module is further configured to:

[0219] The same coding core is used to encode all the object signal sets using corresponding coding modes.

[0220] Optionally, in one embodiment of the present disclosure, the analysis module is further configured to:

[0221] The frequency bandwidth range of the target signal is analyzed.

[0222] Optionally, in one embodiment of the present disclosure, the processing module is further configured to:

[0223] Determine the bandwidth intervals corresponding to different frequency bands;

[0224] Based on the frequency band bandwidth range of the object signal and the bandwidth intervals corresponding to different frequency band bandwidths, the at least one object signal is classified to obtain at least one object signal set, and the corresponding encoding mode is determined based on the frequency band bandwidth corresponding to the at least one object signal set.

[0225] Optionally, in one embodiment of the present disclosure, the processing module is further configured to:

[0226] Acquire input command line control information, where the command line control information is used to indicate a bandwidth range of a frequency band to be encoded corresponding to the object signal;

[0227] The at least one object signal is classified based on the command line control information and the analysis result to obtain at least one object signal set, and a coding mode corresponding to each object signal set is determined based on the classification result.

[0228] Optionally, in one embodiment of the present disclosure, the encoding module is further configured to:

[0229] Different coding cores are used to encode different object signal sets using corresponding coding modes.

[0230] Figure 10 A schematic diagram of a signal encoding and decoding method and apparatus provided by an embodiment of the present disclosure, which is applied to a decoding end such as Figure 10 As shown, the apparatus 1000 may include:

[0231] A receiving module, configured to receive at least one encoded object signal parameter information sent by an encoding end;

[0232] A decoding module is configured to decode the at least one encoded object signal parameter information to obtain at least one decoded object signal set.

[0233] In summary, in the signal encoding and decoding device provided in the embodiment of the present disclosure, a signal feature analysis is performed on at least one object signal in the collected audio signal to obtain an analysis result. Thereafter, the object signal is classified based on the analysis result to obtain at least one object signal set. At the same time, the encoding mode corresponding to each object signal set is determined based on the classification result. Thereafter, the object signal in the object signal set is encoded using the corresponding encoding mode. Among them, the signal feature analysis in the embodiment of the present disclosure includes the frequency band bandwidth range analysis of the signal. It can be seen that in the embodiment of the present disclosure, when determining the encoding mode, the frequency band bandwidth range of the signal is taken into consideration, thereby ensuring the compression rate of the signal and saving bandwidth.

[0234] Optionally, in one embodiment of the present disclosure, the apparatus is further configured to:

[0235] Performing code stream parsing on the encoded code stream to obtain classification side information parameters, side information parameters corresponding to each object signal set, and at least one encoded object signal parameter information;

[0236] The classification side information parameter is used to indicate a classification method of the object signal, and the side information parameter is used to indicate a coding mode corresponding to the object signal set.

[0237] Optionally, in one embodiment of the present disclosure, the decoding module is further configured to:

[0238] determining a classification method for the object signal based on the classification side information parameters;

[0239] Determining a coding mode corresponding to each encoded object signal parameter information based on the side information parameters;

[0240] Based on the classification method of the object signal and the encoding mode corresponding to each encoded object signal parameter information, a corresponding decoding mode is adopted to decode each encoded object signal parameter information.

[0241] Optionally, in an embodiment of the present disclosure, the classification side information parameter indicates that the classification method of the object signal is: classification based on a mutual correlation parameter value;

[0242] The decoding module is further configured to:

[0243] The same decoding core is used to decode each encoded object signal parameter information using a corresponding decoding mode based on the encoding mode corresponding to each encoded object signal parameter information, so as to obtain at least one decoded object signal set.

[0244] Optionally, in an embodiment of the present disclosure, the classification side information parameter indicates that the classification method of the object signal is: classification based on a frequency band bandwidth range;

[0245] The decoding module is further configured to:

[0246] Different decoding cores are used to decode different encoded object signal parameter information using corresponding decoding modes based on the encoding modes corresponding to the respective encoded object signal parameter information, to obtain at least one decoded object signal set.

[0247] Optionally, in one embodiment of the present disclosure, the apparatus is further configured to:

[0248] Post-processing is performed on the at least one decoded object signal set.

[0249] Figure 11 1 is a block diagram of a user equipment UE 1100 provided by one embodiment of the present disclosure. For example, UE 1100 may be a mobile phone, a computer, a digital broadcast terminal device, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0250] Reference Figure 11 UE 1100 may include at least one of the following components: a processing component 1102 , a memory 1104 , a power component 1106 , a multimedia component 1108 , an audio component 1110 , an input / output (I / O) interface 1112 , a sensor component 1113 , and a communication component 1116 .

[0251] Processing component 1102 generally controls the overall operation of UE 1100, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. Processing component 1102 may include at least one processor 1120 to execute instructions to perform all or part of the steps of the above-described method. In addition, processing component 1102 may include at least one module to facilitate interaction between processing component 1102 and other components. For example, processing component 1102 may include a multimedia module to facilitate interaction between multimedia component 1108 and processing component 1102.

[0252] The memory 1104 is configured to store various types of data to support the operation of the UE 1100. Examples of such data include instructions for any application or method operating on the UE 1100, contact data, phone book data, messages, pictures, videos, etc. The memory 1104 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0253] The power component 1106 provides power to various components of the UE 1100. The power component 1106 may include a power management system, at least one power supply, and other components associated with generating, managing, and distributing power to the UE 1100.

[0254] The multimedia component 1108 includes a screen that provides an output interface between the UE 1100 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes at least one touch sensor to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or slide action, but also detect the wake-up time and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1108 includes a front camera and / or a rear camera. When the UE 1100 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0255] The audio component 1110 is configured to output and / or input audio signals. For example, the audio component 1110 includes a microphone (MIC) that is configured to receive external audio signals when the UE 1100 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 1104 or transmitted via the communication component 1116. In some embodiments, the audio component 1110 further includes a speaker for outputting audio signals.

[0256] I / O interface 1112 provides an interface between processing component 1102 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0257] Sensor assembly 1113 includes at least one sensor for providing various status assessments for UE 1100. For example, sensor assembly 1113 can detect the open / closed state of device 1100, the relative positioning of components, such as the display and keypad of UE 1100. Sensor assembly 1113 can also detect changes in the position of UE 1100 or a component of UE 1100, the presence or absence of user contact with UE 1100, the orientation or acceleration / deceleration of UE 1100, and changes in the temperature of UE 1100. Sensor assembly 1113 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 1113 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 1113 may also include an accelerometer, a gyroscope, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0258] The communication component 1116 is configured to facilitate wired or wireless communication between UE1100 and other devices. UE1100 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1116 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1116 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0259] In an exemplary embodiment, UE1100 may be implemented by at least one application-specific integrated circuit (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic component to perform the above method.

[0260] Figure 12 1 is a block diagram of a network side device 1200 provided in an embodiment of the present disclosure. For example, the network side device 1200 may be provided as a network side device. Figure 12 The network side device 1200 includes a processing component 1211, which further includes at least one processor, and a memory resource represented by a memory 1232 for storing instructions that can be executed by the processing component 1222, such as an application. The application stored in the memory 1232 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 1210 is configured to execute instructions to perform any of the aforementioned methods applied to the network side device, such as Figure 1 The method shown.

[0261] The network side device 1200 may further include a power supply component 1226 configured to perform power management of the network side device 1200, a wired or wireless network interface 1250 configured to connect the network side device 1200 to a network, and an input / output (I / O) interface 1258. The network side device 1200 may operate based on an operating system stored in the memory 1232, such as Windows Server™, Mac OS X™, Unix™, Linux™, Free BSD™, or the like.

[0262] In the embodiments provided above, the methods provided in the embodiments of the present disclosure are described from the perspectives of the network-side device and the UE. To implement the various functions in the methods provided in the embodiments of the present disclosure, the network-side device and the UE may include hardware structures and software modules, and implement the aforementioned functions in the form of hardware structures, software modules, or hardware structures and software modules. Certain of the aforementioned functions may be implemented in the form of hardware structures, software modules, or hardware structures and software modules.

[0263] In the embodiments provided above, the methods provided in the embodiments of the present disclosure are described from the perspectives of the network-side device and the UE. To implement the various functions in the methods provided in the embodiments of the present disclosure, the network-side device and the UE may include hardware structures and software modules, and implement the aforementioned functions in the form of hardware structures, software modules, or hardware structures and software modules. Certain of the aforementioned functions may be implemented in the form of hardware structures, software modules, or hardware structures and software modules.

[0264] Embodiments of the present disclosure provide a communication device. The communication device may include a transceiver module and a processing module. The transceiver module may include a sending module and / or a receiving module. The sending module is configured to implement a sending function, and the receiving module is configured to implement a receiving function. The transceiver module may implement both the sending function and / or the receiving function.

[0265] The communication device may be a terminal device (such as the terminal device in the aforementioned method embodiment), or a device in a terminal device, or a device that can be used in conjunction with a terminal device. Alternatively, the communication device may be a network device, or a device in a network device, or a device that can be used in conjunction with a network device.

[0266] Another communication device provided in an embodiment of the present disclosure. The communication device can be a network device, a terminal device (such as the terminal device in the aforementioned method embodiment), a chip, a chip system, or a processor that supports the network device to implement the aforementioned method, or a chip, a chip system, or a processor that supports the terminal device to implement the aforementioned method. This device can be used to implement the method described in the aforementioned method embodiment. For details, please refer to the description of the aforementioned method embodiment.

[0267] The communication device may include one or more processors. The processor may be a general-purpose processor or a dedicated processor. For example, it may be a baseband processor or a central processing unit. The baseband processor may be used to process communication protocols and communication data, and the central processing unit may be used to control the communication device (e.g., network-side equipment, baseband chips, terminal equipment, terminal equipment chips, DU or CU, etc.), execute computer programs, and process computer program data.

[0268] Optionally, the communication device may further include one or more memories, on which a computer program may be stored. The processor executes the computer program to cause the communication device to perform the method described in the above method embodiment. Optionally, the memory may also store data. The communication device and memory may be provided separately or integrated.

[0269] Optionally, the communication device may further include a transceiver and an antenna. A transceiver may be referred to as a transceiver unit, a transceiver, or a transceiver circuit, and is used to implement transceiver functions. A transceiver may include a receiver and a transmitter. The receiver may be referred to as a receiver or a receiving circuit, and is used to implement a receiving function; the transmitter may be referred to as a transmitter or a transmitting circuit, and is used to implement a transmitting function.

[0270] Optionally, the communication device may further include one or more interface circuits. The interface circuits are configured to receive code instructions and transmit them to the processor. The processor executes the code instructions to enable the communication device to execute the method described in the above method embodiment.

[0271] The communication device is a terminal device (such as the terminal device in the above method embodiment): the processor is used to execute Figure 1-Figure 4a Any of the methods shown.

[0272] The communication device is a network device: the transceiver is used to perform Figure 5-Figure 7 Any of the methods shown.

[0273] In one implementation, the processor may include a transceiver for implementing receiving and transmitting functions. For example, the transceiver may be a transceiver circuit, an interface, or an interface circuit. The transceiver circuit, interface, or interface circuit for implementing the receiving and transmitting functions may be separate or integrated. The transceiver circuit, interface, or interface circuit may be used for reading and writing code / data, or may be used for transmitting or delivering signals.

[0274] In one implementation, the processor may store a computer program that runs on the processor and enables the communication device to perform the method described in the above method embodiment. The computer program may be fixed in the processor, in which case the processor may be implemented by hardware.

[0275] In one implementation, the communication device may include a circuit that can implement the functions of sending, receiving, or communicating in the aforementioned method embodiments. The processor and transceiver described in the present disclosure can be implemented on an integrated circuit (IC), an analog IC, a radio frequency integrated circuit RFIC, a mixed signal IC, an application specific integrated circuit (ASIC), a printed circuit board (PCB), an electronic device, etc. The processor and transceiver can also be manufactured using various IC process technologies, such as complementary metal oxide semiconductor (CMOS), N-type metal oxide semiconductor (nMetal-oxide-semiconductor, NMOS), P-type metal oxide semiconductor (positive channelmetal oxide semiconductor, PMOS), bipolar junction transistor (bipolar junction transistor, BJT), bipolar CMOS (BiCMOS), silicon germanium (SiGe), gallium arsenide (Gas), etc.

[0276] The communication device described in the above embodiments may be a network device or a terminal device (such as the terminal device in the aforementioned method embodiment), but the scope of the communication device described in this disclosure is not limited thereto, and the structure of the communication device may not be limited thereto. The communication device may be an independent device or may be part of a larger device. For example, the communication device may be:

[0277] (1) An independent integrated circuit (IC), or chip, or chip system or subsystem;

[0278] (2) a collection of one or more ICs, optionally including a storage component for storing data and computer programs;

[0279] (3) ASIC, such as modem;

[0280] (4) Modules that can be embedded in other devices;

[0281] (5) Receivers, terminal devices, intelligent terminal devices, cellular phones, wireless devices, handheld devices, mobile units, vehicle-mounted devices, network devices, cloud devices, artificial intelligence devices, etc.;

[0282] (6)Others, etc.

[0283] In the case where the communication device can be a chip or a chip system, the chip includes a processor and an interface. The number of processors can be one or more, and the number of interfaces can be multiple.

[0284] Optionally, the chip also includes a memory for storing necessary computer programs and data.

[0285] Those skilled in the art will also appreciate that the various illustrative logical blocks and steps listed in the embodiments of the present disclosure may be implemented by electronic hardware, computer software, or a combination of both. Whether such functionality is implemented by hardware or software depends on the specific application and the design requirements of the entire system. Those skilled in the art may use various methods to implement the described functionality for each specific application, but such implementation should not be construed as exceeding the scope of protection of the embodiments of the present disclosure.

[0286] An embodiment of the present disclosure also provides a system for determining the side link duration, which includes a communication device as a terminal device in the aforementioned embodiment (such as the first terminal device in the aforementioned method embodiment) and a communication device as a network device, or the system includes a communication device as a terminal device in the aforementioned embodiment (such as the first terminal device in the aforementioned method embodiment) and a communication device as a network device.

[0287] The present disclosure also provides a readable storage medium having instructions stored thereon, which implement the functions of any of the above method embodiments when executed by a computer.

[0288] The present disclosure also provides a computer program product, which implements the functions of any of the above method embodiments when executed by a computer.

[0289] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware or any combination thereof. When implemented using software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer programs. When the computer program is loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present disclosure are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer program can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer program can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a high-density digital video disc (DVD)), or a semiconductor medium (eg, a solid state disk (SSD)).

[0290] Those skilled in the art will understand that the various numerical numbers such as first and second involved in the present disclosure are only for the convenience of description and are not used to limit the scope of the embodiments of the present disclosure, and also indicate the order of precedence.

[0291] The at least one in the present disclosure can also be described as one or more, and the multiple can be two, three, four or more, which is not limited in the present disclosure. In the embodiments of the present disclosure, for a technical feature, the technical features in the technical feature are distinguished by "first", "second", "third", "A", "B", "C" and "D", and there is no order of precedence or size between the technical features described by "first", "second", "third", "A", "B", "C" and "D".

[0292] Other embodiments of the present invention will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the following claims.

[0293] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A signal encoding and decoding method, characterized in that: Applied to the encoding end, including: collecting an audio signal, where the audio signal includes at least one object signal; Performing signal feature analysis on the object signal to obtain an analysis result; classifying the at least one object signal based on the analysis result to obtain at least one object signal set, and determining a coding mode corresponding to each object signal set based on the classification result, wherein the object signal set includes at least one object signal; Encoding the object signal in the object signal set using a corresponding encoding mode to obtain at least one encoded object signal parameter information, and writing the object signal parameter information into an encoded code stream and sending it to a decoding end; The step of writing the object signal parameter information into the encoded code stream and sending it to the decoding end includes: determining a classification side information parameter, where the classification side information parameter is used to indicate a classification method for the object signal; Determining side information parameters corresponding to each object signal set, where the side information parameters are used to indicate a coding mode corresponding to the object signal set; The classification side information parameters, the side information parameters corresponding to each object signal set, and the encoded object signal parameter information are multiplexed to obtain an encoded code stream, and the encoded code stream is sent to a decoding end.

2. The method according to claim 1, wherein The method further comprises: The at least one object signal set is pre-processed.

3. The method according to claim 2, wherein The encoding of the object signal in the object signal set by using a corresponding encoding mode includes: The object signals in the preprocessed object signal set are encoded using a corresponding encoding mode.

4. The method according to claim 1, wherein The performing signal feature analysis on the object signal to obtain an analysis result includes: performing high-pass filtering on the at least one object signal; Performing correlation analysis on the object signals after high-pass filtering to determine the mutual correlation parameter values between the object signals; wherein the at least one object signal is two or more object signals.

5. The method according to claim 4, wherein The classifying the at least one object signal based on the analysis result to obtain at least one object signal set, and determining a coding mode corresponding to each object signal set based on the classification result, includes: According to the correlation degree, set the normalized correlation degree interval; Based on the mutual correlation parameter values and normalized correlation degree intervals of the object signals, at least one object signal is classified to obtain at least one object signal set, and a corresponding encoding mode is determined based on the correlation degrees corresponding to the at least one object signal set.

6. The method according to claim 4, wherein The coding mode corresponding to the object signal set includes an independent coding mode or a joint coding mode.

7. The method according to claim 6, wherein The independent coding mode corresponds to a time domain processing mode or a frequency domain processing mode; Wherein, when the object signal in the object signal set is a speech signal or a speech-like signal, the independent coding mode adopts a time domain processing method; When the object signal in the object signal set is an audio signal other than a speech signal or a speech-like signal, the independent coding mode adopts a frequency domain processing manner.

8. The method according to any one of claims 4 to 7, wherein: The encoding of the object signal set using a corresponding encoding mode includes: The same coding core is used to encode all the object signal sets using corresponding coding modes.

9. The method according to claim 1, wherein The performing signal feature analysis on the object signal to obtain an analysis result includes: The frequency bandwidth range of the target signal is analyzed.

10. The method according to claim 9, wherein The classifying the at least one object signal based on the analysis result to obtain at least one object signal set, and determining a coding mode corresponding to each object signal set based on the classification result, includes: Determine the bandwidth intervals corresponding to different frequency bands; Based on the frequency band bandwidth range of the object signal and the bandwidth intervals corresponding to different frequency band bandwidths, the at least one object signal is classified to obtain at least one object signal set, and the corresponding encoding mode is determined based on the frequency band bandwidth corresponding to the at least one object signal set.

11. The method according to claim 9, wherein The classifying the at least one object signal based on the analysis result to obtain at least one object signal set, and determining a coding mode corresponding to each object signal set based on the classification result, includes: Acquire input command line control information, where the command line control information is used to indicate a bandwidth range of a frequency band to be encoded corresponding to the object signal; The at least one object signal is classified based on the command line control information and the analysis result to obtain at least one object signal set, and a coding mode corresponding to each object signal set is determined based on the classification result.

12. The method according to any one of claims 9 to 11, wherein: The encoding of the object signal set using a corresponding encoding mode includes: Different coding cores are used to encode different object signal sets using corresponding coding modes.

13. A signal encoding and decoding method, characterized in that: Applied to the decoding end, including: Receive the encoded code stream sent by the encoding end; Decoding the encoded code stream to obtain at least one decoded object signal set; The coded bitstream includes at least one encoded object signal parameter information, the encoded object signal parameter information is obtained by encoding an object signal in the object signal set using a corresponding coding mode, different object signal sets are obtained by classifying at least one object signal based on an analysis result of the object signal, the coding mode corresponding to each object signal set is determined based on the classification result of the object signal set, and the analysis result of the object signal includes an analysis result obtained by performing a signal feature analysis on the object signal; The encoded code stream is obtained by multiplexing the classification side information parameters, the side information parameters corresponding to each object signal set, and the encoded object signal parameter information. The classification side information parameters are used to indicate the classification method of the object signal, and the side information parameters are used to indicate the encoding mode corresponding to the object signal set.

14. The method according to claim 13, wherein The method further comprises: Performing code stream parsing on the encoded code stream to obtain classification side information parameters, side information parameters corresponding to each object signal set, and at least one encoded object signal parameter information; The classification side information parameter is used to indicate a classification method of the object signal, and the side information parameter is used to indicate a coding mode corresponding to the object signal set.

15. The method according to claim 14, wherein The decoding of the encoded code stream to obtain at least one object signal set includes: determining a classification method for the object signal based on the classification side information parameters; Determining a coding mode corresponding to each encoded object signal parameter information based on the side information parameters; Based on the classification method of the object signal and the encoding mode corresponding to each encoded object signal parameter information, a corresponding decoding mode is adopted to decode each encoded object signal parameter information.

16. The method according to claim 15, wherein The classification side information parameter indicates that the object signal is classified in a manner of: classification based on a mutual correlation parameter value; The decoding of each encoded object signal parameter information by using a corresponding decoding mode based on the classification mode of the object signal and the encoding mode corresponding to each encoded object signal parameter information includes: The same decoding core is used to decode each encoded object signal parameter information using a corresponding decoding mode based on the encoding mode corresponding to each encoded object signal parameter information, so as to obtain at least one decoded object signal set.

17. The method according to claim 15, wherein The classification side information parameter indicates that the object signal is classified as follows: classification based on frequency band bandwidth range; The decoding of each encoded object signal parameter information by using a corresponding decoding mode based on the classification mode of the object signal and the encoding mode corresponding to each encoded object signal parameter information includes: Different decoding cores are used to decode different encoded object signal parameter information using corresponding decoding modes based on the encoding modes corresponding to the respective encoded object signal parameter information, to obtain at least one decoded object signal set.

18. The method according to claim 16 or 17, wherein: The method further comprises: Post-processing is performed on the at least one decoded object signal set.

19. A device based on signal coding and decoding, characterized in that: include: An analysis module, used for performing signal feature analysis on the object signal to obtain analysis results; a processing module, configured to classify at least one object signal based on the analysis result to obtain at least one object signal set, and determine a coding mode corresponding to each object signal set based on the classification result, wherein the object signal set includes at least one object signal; An encoding module, configured to encode an object signal in the object signal set using a corresponding encoding mode to obtain at least one encoded object signal parameter information, and write the object signal parameter information into an encoded code stream and send it to a decoding end; Wherein, the encoding module is further used for: determining a classification side information parameter, where the classification side information parameter is used to indicate a classification method for the object signal; Determining side information parameters corresponding to each object signal set, where the side information parameters are used to indicate a coding mode corresponding to the object signal set; The classification side information parameters, the side information parameters corresponding to each object signal set, and the encoded object signal parameter information are multiplexed to obtain an encoded code stream, and the encoded code stream is sent to a decoding end.

20. A device based on signal coding and decoding, characterized in that: include: The receiving module is used to receive the encoded code stream sent by the encoding end; a decoding module, configured to decode the encoded code stream to obtain at least one decoded object signal set; The coded bitstream includes at least one encoded object signal parameter information, the encoded object signal parameter information is obtained by encoding an object signal in the object signal set using a corresponding coding mode, different object signal sets are obtained by classifying at least one object signal based on an analysis result of the object signal, the coding mode corresponding to each object signal set is determined based on the classification result of the object signal set, and the analysis result of the object signal includes an analysis result obtained by performing a signal feature analysis on the object signal; The encoded code stream is obtained by multiplexing the classification side information parameters, the side information parameters corresponding to each object signal set, and the encoded object signal parameter information. The classification side information parameters are used to indicate the classification method of the object signal, and the side information parameters are used to indicate the encoding mode corresponding to the object signal set.

21. A communication device, characterized in that: The device includes a processor and a memory, wherein a computer program is stored in the memory, and the processor executes the computer program stored in the memory to enable the device to perform the method according to any one of claims 1 to 12.

22. A communication device, characterized in that: The device includes a processor and a memory, wherein a computer program is stored in the memory, and the processor executes the computer program stored in the memory to enable the device to perform the method according to any one of claims 13 to 18.

23. A communication device, characterized in that: include: processor and interface circuits; The interface circuit is used to receive code instructions and transmit them to the processor; The processor is configured to run the code instructions to perform the method according to any one of claims 1 to 12.

24. A communication device, characterized in that: include: processor and interface circuits; The interface circuit is used to receive code instructions and transmit them to the processor; The processor is configured to run the code instructions to perform the method according to any one of claims 13 to 18.

25. A computer-readable storage medium storing instructions, which, when executed, enable the method according to any one of claims 1 to 12 to be implemented.

26. A computer-readable storage medium storing instructions, which, when executed, enable the method according to any one of claims 13 to 18 to be implemented.

Images