System and method for generating high frequency components of a signal - Patents.com

Abstract

To mitigate the increase of different kinds of transposition orders and associated calculation processing loads.SOLUTION: A system for generating a high frequency component of a signal from a low frequency component of the signal comprises: an analysis filter bank for providing a set of analysis subband signals, which set includes at least two analysis subband signals, from the low frequency component of the signal, the analysis filter bank having a frequency resolution of Δf; a nonlinear processing unit for determining a set of synthesis subband signals from the set of analysis subband signals using a transposition order P, the set of synthesis subband signals comprising a portion of the set of analysis subband signals phase shifted by an amount derived from the transposition order P; and a synthesis filter bank for generating the high frequency component of the signal from the set of synthesis subband signals, the synthesis filter bank having a frequency resolution of FΔf, with F being a resolution factor. The transposition order P is different from the resolution factor F.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to audio coding systems that utilize harmonic transposition for high frequency reconstruction (HFR), as well as to digital effect processors, such as so-called exciters, where the generation of harmonic distortion adds brightness to the processed signal. In particular, the present application relates to a simple method for high frequency reconstruction. [Background technology]

[0002] In WO98 / 57436, the concept of transposition is established as a method for recreating a high frequency band from a low frequency band of an audio signal. The use of this concept in audio coding can result in significant bit rate reduction. In an audio coding system using HFR, a low bandwidth signal, referred to as the low frequency component of the signal, is provided to a core waveform coder, and the high frequencies, referred to as the high frequency components of the signal, are regenerated using very low bit rate additional side information describing the target spectral shape of the high frequency components at the decoder side and signal transposition. In the case of low bit rates, the bandwidth of the core coded signal (i.e., the low band signal or low frequency components) is narrow, so it becomes increasingly important to regenerate the high band signal (i.e., the high frequency components) with perceptually pleasing characteristics. The harmonic transposition defined in WO98 / 57436 works well for complex music content in the context of low crossover frequencies, i.e., the upper frequency limit of the low band signal is low. The principle of harmonic transposition is to map or correspond a sine wave of frequency ω to a sine wave of frequency Tω, where T>1 is an integer specifying the degree of transposition (i.e., the transposition order). In contrast, HFR using single backband modulation (SSB) maps a sine wave of frequency ω to a sine wave of frequency ω+Δω, where Δω is a constant frequency shift. For low bandwidth core signals (i.e., low band signals with a low upper frequency limit), SSB transposition usually introduces dissonant ringing artifacts, which is a disadvantage compared to harmonic transposition.

[0003] To achieve improved audio quality and synthesize the necessary bandwidth for highband signals, harmonic HFR methods typically use several orders of transposition. To implement multiple transpositions of various transposition orders, conventional methods require multiple filter banks in the analysis stage, synthesis stage, or both. Typically, a different filter bank is required for each different transposition order. When the core waveform coder operates at a lower sampling rate than the sampling rate of the final output signal, there is typically an additional requirement to convert the core signal to the sampling rate of the output signal, and such upsampling of the core signal is usually performed by adding yet another filter bank. Thus, the computational burden becomes significant with the increase in the variety of different transposition orders. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] WO 98 / 57436 Summary of the Invention [Problem to be solved by the invention]

[0005] An object of the embodiment is to at least alleviate the conventional problem that the computational load becomes significantly heavier as the number of different transposition orders increases. [Means for solving the problem]

[0006] According to one embodiment, the system comprises: 1. A system configured to generate high frequency components of a signal from low frequency components of the signal, comprising: an analysis filterbank configured to provide a set of analysis subband signals from the low frequency components of the signal, the set of analysis subband signals including at least two analysis subband signals; a non-linear processing unit configured to determine a set of synthesis subband signals from the set of analysis subband signals, the non-linear processing unit being configured to determine an n-th synthesis subband signal from the set of analysis subband signals from a k-th analysis subband signal and a (k+1)-th analysis subband signal of the set of analysis subband signals, the phase of the n-th synthesis subband signal being determined as the sum of a phase of the k-th analysis subband signal scaled by a first integer phase multiplier and a phase of the (k+1)-th analysis subband signal scaled by a second integer phase multiplier, the first and second integer phase multipliers being different; a synthesis filter bank configured to generate high frequency components of the signal based on the set of synthesis subband signals; It is a system having the following. [Brief description of the drawings]

[0007] [Figure 1] A diagram showing an example of processing using a first-order frequency domain (FD) harmonic transposer. [Diagram 2] A diagram showing an example of processing by a harmonic transposer using multiple orders. [Diagram 3] FIG. 1 shows a conventional example of a harmonic transposer that uses multiple orders of transposition while using a common analysis filter bank. [Figure 4] FIG. 1 shows a conventional example of a harmonic transposer that uses multiple orders of transposition while using a common synthesis filter bank. [Diagram 5] FIG. 13 shows an example of the processing of a harmonic transposer using multiple orders of transposition while using a common analysis filter bank and a common synthesis filter bank. [Figure 5b] 6 is a diagram showing an example of mapping of subband signals to the multiple transposers shown in FIG. 5. [Figure 5c] 6 is a diagram showing an example of mapping of subband signals to the multiple transposers shown in FIG. 5. [Figure 6] FIG. 1 illustrates a first embodiment of harmonic transposition using multiple orders of transposition in an HFR enhanced audio codec. [Figure 7] FIG. 7 is a diagram showing an example of performing subsampling in the example of FIG. 6. [Figure 8] FIG. 13 illustrates a second embodiment of harmonic transposition using multiple orders of transposition in an HFR enhanced audio codec. [Figure 9] FIG. 9 is a diagram showing an example of performing subsampling in the example of FIG. 8. [Figure 10] FIG. 13 illustrates a third embodiment of harmonic transposition using multiple orders of transposition in an HFR enhanced audio codec. [Figure 11] FIG. 11 is a diagram showing an example of performing subsampling in the example of FIG. 10. [Figure 12a] FIG. 1 illustrates the effect of harmonic transposition on a signal in the frequency domain. [Figure 12b] FIG. 1 illustrates a method for combining overlapping and non-overlapping transposed signals. [Figure 12c] FIG. 1 illustrates a method for combining overlapping and non-overlapping transposed signals. [Figure 13] FIG. 1 shows the effect of harmonic transposition of order T=2 when additional subsampling is performed on a frequency domain signal. [Figure 14] FIG. 13 shows the effect of harmonic transposition of order T=3 when additional subsampling is performed on a frequency domain signal. [Figure 15] Diagram showing the effect of harmonic transposition of order T=P when additional subsampling is performed on a frequency domain signal (non-overlapping case). [Figure 16] Diagram showing the effect of harmonic transposition of order T=P when additional subsampling is performed on a frequency domain signal (in the overlapping case). [Figure 17]FIG. 1 illustrates an example layout of a maximally decimating (i.e., fully sampled) transposer building block. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] The present invention provides a method to reduce the complexity of harmonic HFR methods by making pairs of analysis and synthesis filterbanks shareable across multiple harmonic transposers, or by using one or more harmonic transposers and upsamplers. The proposed frequency domain transposition involves mapping nonlinearly modified subband signals from the analysis filterbank to selected subbands of the synthesis filterbank. The nonlinear processing on the subband signals involves phase multiplications that multiply by a factor of 1. Furthermore, the present invention provides several ways to reduce the complexity of HFR systems.

[0009] In one embodiment, a system for generating high frequency components of a signal from low frequency components of the signal is described. The system includes an analysis filterbank for providing a set of analysis subband signals, typically including at least two analysis subband signals, from the low frequency components of the signal. The synthesis filterbank has a frequency resolution of Δf and a frequency resolution of L A L analysis subbands; A >1, and the index k of the analysis subband is k=0,...,L A-1 In particular, the analysis filterbank provides a set of complex analysis subband signals having magnitude samples and phase samples.

[0010] The system further comprises a non-linear processing unit for determining a set of synthesis subband signals from the set of analysis subband signals using a transposition order P, the set of synthesis subband signals typically comprising a portion of the set of analysis subband signals phase shifted by an amount derived from the transposition order P. In other words, the set of synthesis subband signals is determined based on a portion of the set of analysis subband signals phase shifted by an amount derived from the transposition order P. The phase shift of the analysis subband signals may be performed by multiplying phase samples of the analysis subband signals by an amount derived from the transposition factor P. In that case, the set of synthesis subband signals corresponds to a part or a subset of the set of analysis subband signals, the phase of the subband samples being multiplied by an amount derived from the transposition order. In particular, the amount derived from the transposition order may be a fraction of the transposition order.

[0011] The system includes a synthesis filter bank having a frequency resolution of FΔf that generates high frequency components of a signal from a set of synthesis subband signals, where F≧1 is a resolution factor, and the synthesis filter bank is L S number of synthesis subbands, L S >1, and the synthesis subband index n is n=0,...,L S -1. The transposition order P is different from the resolution factor F. The analysis filter bank has an analysis time stride Δt A The synthesis filter bank uses synthesis time width (synthesis time stride) Δt S Using the analysis time span Δt A and the composite time span Δt S may be equal.

[0012] Based on an analysis subband signal belonging to a set of analysis subband signals phase shifted by a transposition order P or a pair of analysis subband signals in a set of synthesis subband signals, the non-linear processing unit determines a synthesis subband signal of the set of subband signals, where a first member of the pair of subband signals has a phase shifted by a factor P' and a second member of the pair of subband signals has a phase shifted by a factor P", where P'+P"=P. The above processing may be performed on samples of the synthesis and analysis subband signals. In other words, the samples of the analysis subband signal may be determined based on samples of the analysis subband signals phase shifted by the transposition order P or based on a sample pair from a corresponding pair of analysis subband signals. The first sample of the sample pair is phase shifted by the factor P' and the second sample of the sample pair is phase shifted by the factor P".

[0013] The non-linear processor determines an n-th synthesis subband signal of the set of synthesis subband signals from a combination of a k-th analysis subband signal of the set of analysis subband signals and an adjacent (k+1)-th analysis subband signal. In particular, the non-linear processor determines a phase of the n-th synthesis subband signal as a sum of a phase shift of the k-th analysis subband signal and a phase shift of the (k+1)-th analysis subband signal. Alternatively or additionally, the non-linear processor determines a magnitude of the n-th synthesis subband signal as a product of a magnitude in exponential representation of the k-th analysis subband signal and a magnitude in exponential representation of the (k+1)-th analysis subband signal.

[0014] The analysis subband index k of the analysis subband signal contributing to the synthesis subband together with the synthesis subband index n may be given by an integer obtained by truncating (F / P)n. The remainder r of the truncation process is given by (F / P)nk. In this case, the nonlinear processor may determine the phase of the nth synthesis subband signal as the sum of the phase of the kth analysis subband signal shifted by P(1-r) and the phase of the (k+1)th analysis subband signal shifted by P(r). In particular, the nonlinear processor may determine the phase of the nth synthesis subband signal as the sum of the phase of the kth analysis subband signal multiplied by P(1-r) and the phase of the (k+1)th adjacent analysis subband signal multiplied by P(r). Alternatively or additionally, the nonlinear processor may determine the magnitude of the nth synthesis subband signal as the product of the (1-r)th power of the magnitude in exponential representation of the kth analysis subband signal and the rth power of the magnitude in exponential representation of the (k+1)th analysis subband signal.

[0015] In one embodiment, the analysis filter bank and the synthesis filter bank may be set at integer multiple positions, and the center frequencies of the analysis subbands may be given by kΔf and the center frequencies of the synthesis subbands may be given by nFΔf. In another embodiment, the analysis filter bank and the synthesis filter bank may be set at half integer multiple positions, and the center frequencies of the analysis subbands may be given by (k+(1 / 2))Δf and the center frequencies of the synthesis subbands may be given by (n+(1 / 2))FΔf, and the difference between the transposition order P and the resolution factor F may be an even number.

[0016] In another embodiment, a system for generating high frequency components of a signal from low frequency components of the signal is described, the system comprising an analysis filterbank for providing a set of analysis subband signals, the set including at least two analysis subband signals, from the low frequency components of the signal.

[0017] The system has a first transposition order P 1a first nonlinear processing unit for determining a first set of synthesis subband signals from the set of analysis subband signals using a first transposition order P 1 The system further includes a second transposition order P 2 a second nonlinear processor for determining a second set of synthesis subband signals from the set of analysis subband signals using a second transposition order P 2 a first transposition order P based on a portion of the set of analysis subband signals that has been phase shifted by an amount derived from 1 and the second transposition order P 2 The first and second non-linear processing sections may be constructed according to any of the features and configurations described herein.

[0018] The system combines the first and second sets of combination subband signals to generate a combined combination subband signal. Such combination may be performed, for example, by combining (e.g., adding and / or averaging) the combination subband signals in the first and second sets that correspond to the same frequency range. In other words, the combiner is configured to overlap combination subband signals in the first and second sets of combination subband signals that correspond to overlapping frequency ranges. Furthermore, the system may comprise a synthesis filter bank for generating high frequency components of the signal from the combined combination subband signal.

[0019] In another embodiment, a system for generating high frequency components of a signal from low frequency components of the signal is described. The system comprises an analysis filter bank having a frequency resolution of Δf. The analysis filter bank provides a set of analysis subband signals from the low frequency components of the signal. The system comprises a non-linear processor for determining an intermediate set of synthesis subband signals from the set of analysis subband signals using a transposition order P, the intermediate set of synthesis subband signals having a frequency resolution of PΔf. The intermediate set of synthesis subband signals comprises parts of the set of analysis subband signals that have been phase shifted by the transposition order P. In particular, the non-linear processor multiplies the phase of the complex analysis subband signals by the transposition order. The transposition order P may be, for example, the transposition order P or P as described above. 1 Or P 2 It should be noted that it may be possible to

[0020] The nonlinear processing unit interpolates one or more intermediate synthesis subband signals to determine a set of synthesis subband signals having a frequency resolution of FΔf, where F is a resolution factor, F≧1. In one embodiment, two or more intermediate synthesis subband signals are interpolated. The transposition order P may be different from the frequency resolution F.

[0021] The system includes a synthesis filter bank with a frequency resolution of FΔf, which generates high frequency components of the signal from a set of synthesis subband signals.

[0022] The system described herein further comprises a core decoder for converting the encoded bitstream into low-frequency components of the signal, which may be based on any of the following coding formats: DolbyE, Dolby Digital, AAA and HE-AAC. The system comprises a multi-channel analysis quadrature mirror filter (QMF) bank, which converts high-frequency and / or low-frequency components into a number of QMF subband signals, and / or the system comprises a high-frequency reconstruction processing module for modifying the QMF subband signals, and / or the system comprises a synthesis QMF bank for generating modified high-frequency components from the modified QMF subband signals. The system comprises a downsampling unit upstream of the analysis filter bank for reducing the sampling rate of the low-frequency components of the signal and outputting the low-frequency components at the reduced sampling rate.

[0023] In another embodiment, a system is described for generating a high-frequency component of a signal with a second sampling frequency from a low-frequency component of the signal with a first sampling frequency. In particular, the signal including low-frequency and high-frequency components may be at the second sampling frequency. The second sampling frequency is R times the first sampling frequency, where R≧1. The system comprises a T-th order harmonic transposer for generating a modulated high-frequency component from the low-frequency component, the modulated high-frequency component being determined based on a spectral portion of the low-frequency component transposed to a T-times higher frequency range. The modulated high-frequency component is the first sampling frequency multiplied by a factor S, where T>1 and S≦R. In other words, the modulated high-frequency component may be at a sampling frequency lower than the second sampling frequency. In particular, the modulated high-frequency component may be critically (or near-critically) sampled.

[0024] The system comprises a QMF bank for mapping the modulated high frequency components to at least one of X QMF subbands, where X is a multiple of S, to provide at least one QMF subband signal; and / or a high frequency reconstruction module for modifying the at least one QMF subband signal (e.g., scale one or more QMF subband signals); and / or a synthesis QMF bank for generating high frequency components from the modified at least one QMF subband signal.

[0025] The harmonic transposer comprises any of the above features and is constructed to perform any of the methods described herein. In particular, the harmonic transposer comprises an analysis filter bank for providing a set of analysis subband signals from low frequency components of the signal. The harmonic transposer comprises a non-linear processor with transposition order T for determining a set of synthesis subband signals from the set of analysis subband signals by modifying the phase of the set of analysis subband signals. As mentioned above, the modification of the phase includes multiplying the phase of the complex samples of the analysis subband signals. The harmonic transposer comprises a synthesis filter bank for generating modulated high frequency components of the signal from the set of synthesis subband signals.

[0026] The low-frequency component has a bandwidth that is B. The harmonic transposer generates a group of composite subband signals within the frequency range of (T-1)*B to T*B. In that case, the harmonic transposer modulates a group of composite subband signals to a baseband centered near zero frequency to generate a modulated high-frequency component. Such modulation may be performed by high-pass filtering a time-domain signal generated from a group of subband signals including a group of composite subband signals and modulating and / or time-sampling the filtered time-domain signal. Alternatively or additionally, such modulation may be performed by directly generating a modulated time-domain signal from a group of composite subband signals. This may be performed using a composite filter bank smaller than the normal size. If the composite filter bank has a normal size of L and the frequency range of (T-1)*B to T*B corresponds to the composite subband indices of k 0 to k 1 , assuming that the composite subband signals may be mapped to the subband indices of 0 to k 1 -k 0 (<L) in a composite filter bank of size k 1 -k 0 , that is, the composite filter bank has a size of k 1 -k 0 which is smaller than L.

[0027] This system further has downsampling means upstream of the harmonic transposer, and the downlink sampling means provides a low-frequency component critically (or in a way close to critical) downsampled by a first sampling frequency divided by a downsampling factor Q from the low-frequency component of the signal. In this case, various sampling frequencies in the system may be divided by the downsampling factor Q. In particular, the modulated high-frequency component may be at a first sampling frequency multiplied by a factor S and divided by the downsampling factor Q. X, which is the size of the analysis QMF bank, may be S / Q.

[0028] In another embodiment, a method for generating high frequency components of a signal from low frequency components of the signal is also described. The method includes providing a set of analysis subband signals from the low frequency components of the signal, the set of analysis subband signals including at least two analysis subband signals, using an analysis filter bank having a frequency resolution of Δf. The method further includes determining a set of synthesis subband signals from the set of analysis subband signals using a transposition order P. The set of synthesis subband signals is determined based on a portion of the set of analysis subband signals that is phase shifted by an amount derived from the transposition order P. The method further includes generating high frequency components of the signal from the set of synthesis subband signals using a synthesis filter bank having a frequency resolution of FΔf, where F≧1, F is a resolution factor, and the transposition order P is different from the resolution factor F.

[0029] In another embodiment, a method for generating high frequency components of a signal from low frequency components of the signal is also described, the method comprising the step of providing a set of analysis subband signals comprising at least two analysis subband signals from the low frequency components of the signal. The method further comprises the step of: 1 The method further comprises determining a first set of synthesis subband signals from the set of analysis subband signals using a first transposition order P 1 The method further comprises determining a second transposition order P based on a portion of the set of analysis subband signals that has been phase shifted by an amount derived from 2 The second set of synthesis subband signals is determined from the set of analysis subband signals using a second transposition order P 2 The first transposition order P is determined based on a portion of the set of analysis subband signals that has been phase shifted by an amount derived from 1 and the second transposition order P 2The first and second sets of synthesis subband signals are combined to generate a combined set of synthesis subband signals, from which high frequency components of the signal are generated.

[0030] In another embodiment, a method for generating high frequency components of a signal from low frequency components of the signal is also described. The method includes providing analysis subband signals having a frequency resolution of Δf from the low frequency components of the signal. The method further includes determining an intermediate set of synthesis subband signals having a frequency resolution of PΔf from the set of analysis subband signals using a transposition order P. The intermediate set of synthesis subband signals includes portions of the set of analysis subband signals phase shifted by the transposition order P. One or more of the intermediate synthesis subband signals are interpolated to determine a set of synthesis subband signals having a frequency resolution of FΔf, where F is a resolution factor, F≧1. The transposition order P may be different from the frequency resolution F. The high frequency components of the signal are generated from the set of synthesis subband signals.

[0031] In yet another embodiment, a method is described for generating a high frequency component of a signal with a second sampling frequency from a low frequency component of the signal with a first sampling frequency, the second sampling frequency being R times the first sampling frequency, where R≧1. The method includes generating a modulated high frequency component from the low frequency component by performing a harmonic transposition of order T. The modulated high frequency component is determined based on a portion of the low frequency component transposed to a T times higher frequency range, the modulated high frequency component being the first sampling frequency multiplied by a factor S, where T>1 and S <Rである。

[0032] In another embodiment, a set-top box for decoding a received signal including at least a signal is also described, the set-top box having a system for generating high frequency components of the signal from low frequency components of the signal, the system including any aspect and / or feature described herein.

[0033] Alternatively, a software program is also described which, when executed on a computing device, causes a processor to carry out any of the aspects and methods described herein.

[0034] As yet another aspect, a storage medium is also described which stores a software program which, when executed on a computing device, causes a processor to perform features of any of the aspects and methods described herein.

[0035] As another aspect, a computer program product is also described, which comprises instructions that, when executed on a computing device, cause the computer to carry out any of the aspects and methods described herein.

[0036] It should be noted that the examples and embodiments described in this application may be combined in any manner. In particular, it should be noted that the examples and embodiments described in relation to the system may be applied to the corresponding method, and vice versa. Furthermore, it should be noted that the disclosure of this application also encompasses claim combinations other than those explicitly set forth as dependent claims (i.e., the claims and their technical features may be combined in any order and in any manner). EXAMPLES

[0037] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings, which are not intended to limit the scope of the present invention.

[0038] The following embodiments are merely illustrative of the principles of the present invention for efficient synthesis of harmonic transposition. It will be understood that variations and modifications to the described embodiments and specific details will be apparent to those skilled in the art. It is therefore important to note that the present invention is defined only by the appended claims and not by the specific details presented in the following description and discussion.

[0039] FIG. 1 shows an example of the processing of a first-order frequency domain (FD) harmonic transposer 100. In its basic form, a T-th order harmonic transposer is, in theory, a device that shifts all signal components of an input signal to a frequency T times higher. To perform such processing in the frequency domain, an analysis filter bank (or transformer) 101 transforms the input signal from the time domain to the frequency domain and outputs complex subbands or subband signals, referred to as analysis subbands or analysis subband signals. The analysis subband signals are provided to a nonlinear processor 102, which modifies or adjusts the phase and / or amplitude according to a selected transposition order T. Typically, the nonlinear processor outputs a certain number of subband signals, which is equal to the number of input subband signals, i.e. the number of analysis subband signals. However, for advanced nonlinear processors, it is desirable to output a number of subband signals different from the number of input subband signals. In particular, two subband signals may be processed in the nonlinear processor to generate one output subband signal. This will be described in more detail below. The modified subband or subband signal, referred to as the analysis subband or synthesis subband signal, is provided to a synthesis filter bank 103 (transformer), which transforms the subband signal from the frequency domain to the time domain and outputs a transposed time domain signal.

[0040] Typically, each of the filter banks has a physical frequency resolution expressed in Hertz and a time stride parameter expressed in seconds. These two parameters (i.e., frequency resolution and time stride) define the discrete time parameters of the filter bank at the selected sampling rate. By choosing the physical time stride parameters (i.e., the time stride parameters measured in time units, e.g., seconds) of the analysis and synthesis filter banks to match, the output signal of the transposer 100 has the same sampling rate as the input signal. Furthermore, by omitting the nonlinear processing unit 102, a perfect reconstruction of the input signal at the output is achieved. This requires a careful design of the analysis and synthesis filter banks. On the other hand, if the output sampling rate is selected to be different from the input sampling rate, a sampling rate conversion is performed. This mode of operation is necessary, for example, when applying a signal transposition in which the desired output bandwidth is larger than half the input sampling rate, i.e., when the desired output bandwidth exceeds the Nyquist frequency of the input signal.

[0041] 2 shows an example of a multiple transposer system 200 including multiple harmonic transposers 201-1,...,201-P of different orders. An input signal to be transposed is applied to a bank of P individual transposers 201-1,201-2,...,201-P. Each individual transposer 201-1,201-2,...,201-P performs a harmonic transposition of the input signal as described in connection with FIG. 1. Typically, each individual transposer 201-1,201-2,...,201-P performs a harmonic transposition of a different transposition order T. As an example, transposer 201-1 may perform a transposition of order T=1, transposer 201-2 may perform a transposition of order T=2, and transposer 201-P may perform a transposition of order T=P. The results, ie, the output signals from the individual transposers 201-1, 201-2, . . . , 201-P, are summed in a combining section, summing section or combiner 202 to produce a summed transposer output.

[0042] It should be noted that each of the transposers 201-1, 201-2, ..., 201-P requires an analysis and synthesis filter bank as shown in Fig. 1. Furthermore, each transposer 201-1, 201-2, ..., 201-P typically changes the sampling rate of the input signal being processed by a different amount. As an example, the sampling rate of the output signal of the transposer 201-1 is P times higher than the sampling rate of the input signal to the transposer 201-P. This is due to the bandwidth expansion factor P used in the transposer 201-P, i.e., the use of a synthesis filter bank with P times more subchannels than the analysis filter bank. To do this, the sampling rate and the Nyquist frequency are increased by a factor P. As a result, the individual time domain signals need to be resampled to enable the synthesis of the various output signals in the synthesis unit 202. Resampling of the time domain signal can be performed on the input signal or the output signal for each individual transposer 201-1, 201-2, . . . , 201-P.

[0043] 3 shows an example of a multiple harmonic transposer or multiple transposer system 300 that uses a common analysis filter bank to perform transpositions of several orders. In the first stage of designing the multiple transposer 300, the individual transposers 201-1, 201-2, ..., 201-P in FIG. 2 are designed such that the analysis filter banks (reference numeral 101 in FIG. 1) of all the transposers 201-1, 201-2, ..., 201-P are identical and can be replaced by a single analysis filter bank 301. As a result, the time-domain input signal is transformed into a single set of frequency-domain subband signals (i.e., a single set of analysis subband signals). These subband signals are provided to various nonlinear processing units 302-1, 302-2, ..., 302-P for the transposition of various orders. As explained with respect to FIG. 1, the nonlinear processing units include phase and / or amplitude modifications of the subband signals, which are different for the transpositions of different orders. Thus, the differently modified subband signals or subbands are respectively fed to different synthesis filter banks 303-1, 303-2, ..., 303-P corresponding to different nonlinear processing units 302-1, 302-2, ..., 302-P, resulting in different transposed time-domain output signals which are summed in the synthesis unit 304 to obtain the summed transposer output.

[0044] It should be noted that if the synthesis filter banks 303-1, 303-2, ..., 303-P corresponding to different transposition orders operate at different sampling rates, e.g. by utilizing different bandwidth extensions, the time-domain output signals of the different synthesis filter banks 303-1, 303-2, ..., 303-P need to be resampled differently in order to align the P output signals to the same time unit or time grid before being summed in the synthesis unit 304.

[0045] FIG. 4 shows an example of a multi-harmonic transposer system 400 using a common synthesis filter bank 404 to transpose multiple orders. In the first stage of designing the multiple transposers 400, the individual transposers 201-1, 201-2, ..., 201-P in FIG. 2 are designed so that the synthesis filter bank of all the transposers is the same and can be replaced by a single synthesis filter bank 404. Note that, similar to the example shown in FIG. 3, the nonlinear processing units 402-1, 402-2, ..., 402-P are different for each transposition order. Furthermore, the analysis filter banks 401-1, 401-2, ..., 401-P are different for different transposition orders. Thus, a set of P analysis filter banks 401-1, 401-2, ..., 401-P determines a set of P analysis subband signals. These P groups of analysis subband signals are fed to corresponding nonlinear processing units 402-1, 402-2, ..., 402-P, which output P groups of modified subband signals. These P groups of subband signals are combined in the frequency domain in a synthesis unit 403, which outputs a group of combined subband signals as input to a single synthesis filter bank 404. The combination of signals in the synthesis unit 403 includes providing differently processed subband signals to different subband ranges and / or superposing the contributions of subband signals to overlapping subband ranges. In other words, the various analysis subband signals processed with different transposition orders cover overlapping frequency ranges. In that case, the individual contributions of the superposition are combined (i.e., added and / or averaged) by the synthesis unit 403. The time-domain output signals of the multiple transposers 400 are obtained from a common synthesis filter bank 404. Similar to the above, if the analysis filter banks 401-1, 401-2, ..., 401-P operate at different sampling rates, the time-domain signals input to the various analysis filter banks 401-1, 401-2, ..., 401-P need to be resampled to align the output signals of the various nonlinear processing units 402-1, 402-2, ..., 402-P to the same time units.

[0046] 5 shows an example of a multi-harmonic transposer system 500 with one common analysis filter bank 501 and one common synthesis filter bank 504, which utilizes multiple order transposition. In this case, each transposer 201-1, 201-2, ..., 201-P in FIG. 2 is designed such that both the analysis filter bank and the synthesis filter bank of P harmonic transposers are the same. If the conditions of the same analysis and synthesis filter bank for different P harmonic transposers are met, the same filter bank can be replaced by one analysis filter bank 501 and one synthesis filter bank 504. The advanced nonlinear processing units 502-1, 502-2, ..., 502-P output various contributions that are combined in a synthesis unit 503, which generates combined inputs for each subband of the synthesis filter bank 504. Similar to the multi-harmonic transposer 400 shown in FIG. 4, the combination of signals in the combination unit 503 involves feeding the differently processed signals of the non-linear processing units 502-1, 502-2, ..., 502-P to various subband ranges and superimposing the contributing outputs into overlapping subband ranges.

[0047] As mentioned above, the nonlinear processing unit 102 typically provides a number of subbands at the output corresponding to the number of subbands at the input. The nonlinear processing unit 102 typically modifies the phase and / or amplitude of the subbands or subband signals according to the transposition order T used. As an example, the subbands at the input are transformed to subbands of T times higher frequency at the output, i.e. subbands in the range [(k-(1 / 2))Δf, (k+(1 / 2))Δf] at the input to the nonlinear processing unit 102 (analysis subbands) are transformed to subbands in the range [(k-(1 / 2))TΔf, (k+(1 / 2))TΔf] at the output of the nonlinear processing unit 102 (synthesis subbands), where k is the subband index number and Δf is the frequency resolution of the analysis filter bank. To allow for the use of a common analysis filterbank 501 and a common synthesis filterbank 504, one or more of the advanced processing units 502-1, 502-2, ..., 502-P are configured to provide a number of output subbands that differs from the number of input subbands. In one embodiment, the number of input subbands to the advanced processing units 502-1, 502-2, ..., 502-P is approximately F / T times the number of output subbands, where T is the transposition order of the advanced processing unit and F is a filter bank resolution factor that will be introduced in the following description.

[0048] In the following, the principle of the advanced processing units 502-1, 502-2, ..., 502-P with respect to the nonlinear processing units 502-1, 502-2, ..., 502-P will be explained. For this purpose, the following is assumed.

[0049] ●The analysis filter bank and the synthesis filter bank share the same physical time stride parameter Δt.

[0050] The analysis filter bank has a physical frequency resolution Δf.

[0051] ●The synthesis filter bank has a physical frequency resolution FΔf, where the resolution factor F is an integer greater than or equal to 1 (F≧1).

[0052] Furthermore, it is assumed that the filter banks are evenly spaced, i.e., the subband with index 0 is centered around zero frequency, and the center frequency of the analysis filter bank is given by kΔf, where the analysis subband index k is k=0,1,...,L. A -1, and L A is the number of subbands in the analysis filter bank. The center frequency of the synthesis filter bank is given by nFΔf, and the synthesis subband index n is n=0,1,...,L s -1, and L s is the number of subbands in the synthesis filter bank.

[0053] 1, the resolution factor F is chosen to be F=T and the analysis subband k of the nonlinear processor is mapped to an analysis subband of the same index n=k. The nonlinear processor 102 typically multiplies the phase of the subband or subband signal by a factor T, i.e. for each sample of a subband of the filter bank, which can be written as: θ s (k) = Tθ A (k) (1) θ A (k) is the phase of the sample in analysis subband k, and θ s (k) is the phase of the samples of synthesis subband k. The magnitude or amplitude of the samples of the subband may be left unmodified or may be increased or decreased by a constant gain factor. Since T is an integer, the treatment of the equation in (1) does not depend on the definition of the phase angle.

[0054] If the resolution factor F is equal to the transposition order T (i.e., F=T), the frequency resolution (i.e., FΔf) of the synthesis filter bank depends on the transition order T. Therefore, it is necessary to use different transposition orders T for different filter banks in the analysis or synthesis processing stages. This is because the transposition order T specifies the degree of the physical frequency resolution, i.e., the degree of the frequency resolution Δf of the analysis filter bank and the frequency resolution FΔf of the synthesis filter bank.

[0055] In order to be able to use a common analysis filter bank 501 and a common synthesis filter bank 504 for different transposition orders T, this application proposes to set the frequency resolution of the synthesis filter bank to FΔf, i.e. to make the frequency resolution of the synthesis filter bank 504 independent of the transposition order T. The question then becomes how to perform a transposition of order T when the resolution factor F, which indicates the degree of the physical frequency resolution of the analysis and synthesis filter banks, does not have to obey the relationship F=T.

[0056] As explained above, according to the harmonic transposer principle, the input to a synthesis filter bank subband n with a center frequency nFΔf is determined by the analysis subband at a center frequency 1 / T times lower (nFΔf / T). The center frequency of the analysis subband is specified as kΔf using the analysis subband index k. Both expressions of the center frequency of the analysis subband index (i.e., nFΔf / T and kΔf) are equal (may correspond). Considering that n is an integer, the rational form of the expression nF / T can be expressed as the sum of the integer analysis subband index k and the remaining part r (r∈{0,1 / T,2 / T,...,(T-1) / T}) as follows: nF / T=k+r (2) It is therefore guaranteed that the input to the synthesis subband with synthesis subband index n is derived from the analysis subband or subband k with index given by equation (2) using a transposition of order T. Since nF / T is a rational number, the remainder or modulus r is not equal to 0 and the value k+r is greater than the analysis subband index k and less than the analysis subband index k+1. The input to the synthesis subband with synthesis subband index n is therefore derived from the analysis subband with analysis subband index k and k+1 using a transposition of order T, where k is given by equation (2).

[0057] As a result of the above analysis, the advanced nonlinear processing performed in the nonlinear processing units 502-1, 502-2, ..., 502-P generally involves considering two adjacent analysis subbands of index k and k+1 which contribute their output to a synthesis subband n. For a transposition order T, the phase adjustment performed by the nonlinear processing units 502-1, 502-2, ..., 502-P may therefore be determined by the following linear interpolation method: θ s (n) = T(1-r)θ A (k) +Trθ A (k+1) (3) Here, θ A (k) is the phase of the sample in analysis subband k, and θ A (k+1) is the phase of the sample in the analysis subband k+1, and θ s (k) is the phase of the samples of synthesis subband n. That is, when the remainder r is close to 0, the value of k+r is close to k, in which case the main contribution to the phase of the samples of the synthesis subband comes from the phase of the samples of the analysis subband of subband k. On the other hand, when the remainder r is close to 1, the value of k+r is close to k+1, in which case the main contribution to the phase of the samples of the synthesis subband comes from the phase of the samples of the analysis subband of subband k+1. It should be noted that the phase multiplication factors T(1-r) and Tr are both integers so that the phase adjustment in equation (3) is well-defined and independent of the definition of the phase angle.

[0058] Taking into account the magnitudes of the subband samples, the following geometric mean values ​​are selected to determine the magnitude of the synthesis subband samples: a S (n)=a A (k) (1-r) a A (k+1) r (4) a S (n) denotes the sample size of synthesis subband n, and a A (k) denotes the sample size of the analysis subband, and a A (k+1) denotes the sample magnitude of analysis subband k+1.

[0059] If the filter bank is arranged at odd positions, the center frequency of the analysis filter bank is given by (k+(1 / 2))Δf, where k=0,1,...,L A -1, and the center frequency of the synthesis filter bank is given by (n+(1 / 2))FΔf, n=0,1,...,L S -1, the formula corresponding to formula (2) above is derived by equating the center frequency of the transposed synthesis filter bank (n+(1 / 2))FΔf / T with the center frequency of the analysis filter bank (k+(1 / 2))Δf. Considering an integer index k and a remainder r∈[0,1], the following formula is derived for the filter bank at half integer multiples: (n+(1 / 2))F / T=k+1 / 2+r (5) It can be seen that if TF, the difference between the transposition order and the resolution factor, is even, then T(1-r) and Tr are both integers and the interpolation formulas of equations (3) and (4) can be used.

[0060] FIG. 5b illustrates how the analysis subbands are mapped to the synthesis subbands. FIG. 5b illustrates four example mappings for four different transposition orders T=1 to T=4. Each diagram illustrates how source bins 510 (i.e., analysis subbands) are mapped to target bins 530 (i.e., synthesis subbands). For ease of illustration, the resolution factor F is assumed to be 1. In other words, FIG. 5b illustrates how the analysis subband signals are mapped to the synthesis subband signals using equations (2) and (3). In the illustrated example, with F=1 and a maximum transposition order P=4, the analysis / synthesis filter banks are evenly configured.

[0061] For the illustrated example, equation (2) can be written as n / T=k+r. Thus, for a transposition order T=1, the analysis subband of index k is mapped to the corresponding synthesis subband n, with the remainder r being zero. This is shown in Figure 5b, where source bins 511 are mapped one-to-one to target bins 531.

[0062] For transposition order T=2, the remainder r can take values ​​of 0 and 1 / 2, and a source bin is associated with multiple target bins. From the opposite perspective, it can be said that each of the target bins 532, 535 receives contributions from at most two source bins. This is illustrated in FIG. 5b, where the target bin 535 receives contributions from source bins 512 and 515. However, the target bin 532 only receives contributions from the source bin 512. If the target bin 535 has an even index n (e.g., n=10), then equation (2) shows that the target bin 532 receives contributions from the source bin 512 with index k=n / 2 (i.e., k=5). In this case, the remainder r is zero, i.e., there is no contribution from the source bin 515 with index k+1 (i.e., k+1=6). For the target bin 535 with odd index n (e.g., n=11), the situation changes. In this case, equation (2) indicates that target bin 535 receives contributions from source bin 512 (index k=5) and source bin 515 (index k+1=6), and this is also true for higher transposition orders T (e.g., T=3 and T=4 as shown in FIG. 5b).

[0063] For F=2, equation (2) can be written as 2n / T=k+r, which is shown in Fig. 5c. For transposition order T=2, the analysis subband of index k is mapped to the corresponding synthesis subband n, and the remainder r is always zero. This can be seen from the one-to-one mapping of source bins 521 to target bins 514.

[0064] For a transposition order T=3, the remainder r can take values ​​of 0, 1 / 3, and 2 / 3, and a source bin is associated with multiple target bins. Inversely, each of the target bins 542, 545 can be said to receive contributions from at most two source bins. This is shown in FIG. 5c, where the target bin 545 receives contributions from source bins 522 and 525. If the target bin 545 has an index n=8, for example, then equation (2) indicates that k=5 and r=1 / 3, indicating that the target bin 545 receives contributions from source bin 522 (index k=5) and source bin 525 (index k+1=6). However, for a target bin 546 with index n=9, the remainder r becomes zero, and the target bin 546 only receives contributions from the source bin 525. This is also true for higher transposition orders T (e.g., T=4 as shown in FIG. 5c).

[0065] Further explanation of the above advanced nonlinear processing is as follows. The advanced nonlinear processing can be understood as a combination of performing a transposition of a given order T and mapping the transposed subband signals to a frequency grid (i.e., frequency grid FΔf) defined by a common synthesis filter bank. To explain this interpretation, refer to Fig. 5b or 5c again, where source bins 510 or 520 are synthesis subbands derived from analysis subbands with transposition order T. These synthesis subbands have a frequency grid given by TΔf. To generate a synthesis subband in a given frequency grid FΔf given by target bins 530 or 540, the source bins 510 or 520 (i.e., synthesis subbands with frequency grid TΔf) need to be mapped to a given frequency grid FΔf. This is done by interpolating one or more source bins 510 or 520 (i.e., synthesis subband signals in frequency grid TΔf) and determining target bins 530 or 540 (i.e., synthesis subband signals in frequency grid FΔf). In a preferred embodiment, linear interpolation is used, with the weight of the interpolation being proportional to the inverse of the difference between the center frequency of the target bin 530 or 540 and the corresponding source bin 510 or 520. As an example, if the difference is zero then the weight is 1, and if the difference is TΔf then the weight is 0.

[0066] In summary, a nonlinear processing method is described that allows determining the contribution of several analysis subbands to a synthesis subband due to transposition, which allows the use of a single common analysis and synthesis subband filter bank for various transposition orders, thereby significantly reducing the computational complexity of multiple harmonic transposers.

[0067] In the following, several embodiments of the multi-harmonic transposer or harmonic transposer system are described. In a typical process in the case of an audio source encoding / decoding system using high frequency reconstruction (HFR) such as SBR (Spectral Band Replication) as shown in, for example, WO98 / 57436, which is incorporated by reference in this application, a core decoder (i.e., a decoder of low frequency components of an audio signal) outputs a time domain signal to an HFR module or system (i.e., a module or system that performs reconstruction of high frequency components of an audio signal). The low frequency components have a bandwidth narrower than half the bandwidth of the original audio signal containing low and high frequency components. Therefore, the time domain signal containing low frequency components, referred to as the low band signal, may be sampled at half the sampling rate of the final output signal of the audio encoding / decoding system. In that case, the HFR module needs to effectively resample the core signal (i.e., the low band signal) to twice the sampling frequency to help add the core signal to the output signal. Therefore, the so-called bandwidth extension factor applied by the HFR module is equal to two.

[0068] After generation of the high frequency components, referred to as the HFR-product signal, the HFR-product signal is dynamically adjusted to match as closely as possible the high frequency components of the original signal (i.e., the high frequency components of the encoded native signal). This adjustment is typically performed by a so-called HFR processor that utilizes sender information. The sender information includes information about the spectral envelope of the high frequency components of the original signal, and the adjustment of the HFR-product signal includes adjusting the spectral envelope of the HFR-product signal.

[0069] To perform the adjustment of the HFR-generated signal according to the sender information, the HFR-generated signal is analyzed by a multi-channel Quadrature Mirror Filter (QMF) bank, which provides the spectral QMF subband signals of the HFR-generated signal. Then, the HFR processor performs the adjustment of the HFR-generated signal on the spectral QMF subband signals obtained from the analysis QMF bank. Finally, the adjusted QMF subband signals are synthesized in the analysis QMF bank. To perform a change in sampling frequency, for example to double the sampling frequency from the sampling frequency of the low band signal to the sampling frequency of the output signal of the audio encoding / decoding system, the number of analysis QMF bands may be different from the number of synthesis QMF bands. In one embodiment, the analysis QMF bank may generate 32 subband signals, and the synthesis QMF bank processor may process 64 QMF subbands, thereby providing a double sampling frequency. It should be noted that typically, the analysis and / or synthesis filter banks of the transposer may generate hundreds of analysis and / or synthesis subbands, providing a much higher frequency resolution than the QMF bank.

[0070] An example of a process for generating high frequency components of a signal is shown in the HFR system 600 of FIG. 6. The transmitted bit stream is received by a core decoder 601, which provides the frequency components of a decoded output signal at a sampling frequency fs. The low frequency components at sampling frequency fs are input to various individual transposers 602-1,...,602-P, each of which corresponds to a single transposer of transposition order T=2,...,P as shown in FIG. 1. The individual signals after transposition for T=1,2,...,P are separately applied to specific instances of individual analysis QMF banks 603-1,...,603-P. It should be noted that the low frequency components are considered as transposition signals of order T=1. The resampling of the core signal (i.e. the resampling of the low frequency components at sampling frequency fs) is performed by filtering the low frequency components using a downsampled QMF bank 603-1 (typically having 32 channels instead of 64 channels). As a result, 32 subband signals are generated, each QMF subband signal having a sampling frequency fs / 32.

[0071] The effect of a transposition of order T=2 at the sampling frequency fs on a signal is represented by a frequency diagram as shown in Fig. 12a. The frequency diagram 1210 shows the input signal to the transposer 602-2 with a bandwidth of B Hz. The input signal is divided (partitioned or segmented) into a number of analysis subband signals by the analysis filter bank. This is represented by a segmentation into frequency bands 1211. The analysis subband signals are shifted (transposed) to a frequency range T=2 times higher and the sampling frequency is doubled. The resulting frequency domain signal is shown in the frequency diagram 1220, which has the same frequency scale as the frequency diagram 1210 (one division or unit is the same). It can be seen that the subband 1211 has been transposed to the subband 1221. The transposition process is indicated by a dashed arrow. Furthermore, the periodic spectrum 1222 of the transposed subband signal is shown in the frequency diagram 1220. Alternatively, the transposition process may be shown as frequency diagram 1230, where the frequency axis is scaled, i.e. multiplied by a transposition factor T=2. In other words, frequency diagram 1230 corresponds to frequency diagram 1220 on a scale T=2 times larger. Each of subband signals 1231 has twice the bandwidth of segment 1211. This results in an output signal of transposer 602-2 with a sampling rate T=2 times higher than the input signal (i.e., a sampling rate of 2fs), while the temporal duration of the signal remains unchanged.

[0072] As shown in FIG. 6 and described above, the output signal of each transposer 602-2 with transposition order T=2 has a sampling frequency of 2fs. To generate QMF subband signals with a sampling frequency of fs / 32, an analysis QMF bank 603-2 with 64 channels should be used. Similarly, the output signal of each transposer 602-P with transposition order T=P has a sampling frequency of Pfs. To generate QMF subband signals with a sampling frequency of fs / 32, an analysis QMF bank 603-2 with 32P channels should be used. The subband signals from all instances of the analysis QMF banks 603-1,...,603-P have equal sampling frequencies if the size (i.e., the number of channels in each of the analysis QMF banks 603-1,...,603-P) is adapted to the signals resulting from the corresponding transposers 602-2,...,602-P. The set of QMF subband signals at sampling frequency fs / 32 is provided to the HFR processing module 604, where the spectrum adjustment of the high frequency components is performed according to the sender's information. Finally, the adjusted subband signals are synthesized into a time domain signal by a 64 channel inverse or synthesis QMF bank 605, which can effectively generate a decoded signal at sampling frequency 2fs from the QMF subband signals sampled at fs / 32.

[0073] As explained above, the transposer modules 602-2,...,602-P generate time domain signals with different sampling rates, such as sampling rates 2fs,...,Pfs, respectively. The resampling of the output signals of the transposer modules 602-2,...,602-P is performed by "inserting" or discarding subband channels in the subsequent corresponding QMF analysis banks 603-1,...,603-P. In other words, the resampling of the output signals of the transposer modules 602-2,...,602-P may be performed by using different numbers of QMF subbands in the subsequent respective analysis QMF banks 603-1,...,603-P and the synthesis QMF bank 605. Therefore, the output QMF subband signals from the QMF bands 602-2,...,602-P need to fit into the 64 channels that are finally sent to the synthesis QMF bank 605. This adaptation or mapping is done by mapping or adding the 32 QMF subband signals from the 32 channel analysis QMF bank 603-1 to the first 32 channels (i.e. the 32 low frequency channels) of the synthesis or inverse QMF bank 605. In fact, this is a filtered signal by upsampling the analysis QMF band 603-1 by a factor of 2. All subband signals coming from the 64 channel analysis QMF bank 603-2 may be directly mapped or added to the 64 channels of the inverse QMF bank 605. In view of the fact that the analysis QMF bank 603-2 is exactly the same size as the synthesis QMF bank 605, the individual signals after transposition are not resampled. The QMF banks 603-3,...,603-P have a number of output QMF subband signals that exceeds the 64 subband signals. The 64 channels on the low frequency side may then be mapped or added to the 64 channels of the synthesis QMF bank 605. The remaining channels on the high frequency side may be discarded. As a result of the 32P channel analysis QMF bank 603-P, the signals filtered by the QMF bank 603-P are downsampled by a factor P / 2.This resampling, which depends on the transposition order P, therefore results in all transposed signals having the same sampling frequency.

[0074] In other words, even if the transposer modules 602-2,...,602-P generate time domain signals with different sampling rates, it is desirable for the subband signals to have the same sampling rate when provided to the HFR processing module 604. This is achieved by using analysis QMF banks 603-3,...,603-P of different sizes, which are typically 32T, where T is the transposition factor or transposition order. Since the HFR processing module 604 and the synthesis QMF bank 605 typically operate on 64 subband signals (i.e. twice the size of the analysis QMF bank 603-1), all subband signals resulting from the analysis QMF banks 603-3,...,603-P with subband indices exceeding that number may be discarded. This is done because the output signals of the transposers 602-2,...,602-P effectively cover the frequency range above the Nyquist frequency of the output signals. The remaining subband signals (i.e., the subband signals that are mapped to the subbands of the synthesis QMF bank 605) may be summed to generate frequency-overlapping transposed signals (see FIG. 12b, described below), or alternatively combined to obtain non-overlapping transposed signals, for example as shown in FIG. 12c, described below. For non-overlapping transposed signals, a transposer 602-T of order T (T=2,...,P) is typically assigned to a specific frequency range, and the transposer 602-T generates frequency components exclusively for that specific frequency range. In one embodiment, the dedicated (individual) frequency range of the transposer 602-T is [(T-1)B,TB], where B is the bandwidth of the input signal to the transposer 602-T. In that case, the synthesis subband signals of the transposer 602-T outside the individual frequency range are ignored or discarded. Alternatively, a transposer 602-T may generate frequency components that overlap with frequency components of other transposers 602-2,...,602-P, in which case those overlapping frequency components are superimposed in the QMF subband domain.

[0075] As mentioned above, in an exemplary embodiment, multiple transposers 602-2,...,602-P are used to generate high frequency components of the output signal of the HFR module 600. It is assumed that the input signals to the transposers 602-2,...,602-P (i.e., the low frequency components of the output signal) have a bandwidth B Hz and a sampling rate fs, and the output signal of the HFR module 600 has a sampling rate 2fs. Thus, the high frequency components may cover a frequency range [B,fs]. Each of the transposers 602-2,...,602-P provides a contribution to the high frequency components, and the contributions may be overlapping and / or non-overlapping. In FIG. 12b, the high frequency components are generated by overlapping contributions from the various transposers 602-2,...,602-P. The frequency diagram 1241 shows the low frequency components (i.e., the input signals to the transposers 602-2,...,602-P). The frequency diagram 1242 shows the output signal of the second-order transposer 602-2, which contains subbands in the frequency range [B, 2B], indicated by the hatched frequency range in the diagram. The frequency range [0, B] generated by the transposer is typically ignored or discarded, since it is covered by the low-frequency input signal. This is indicated by the white frequency range in the diagram. The frequency diagram 1243 shows the output signal of the third-order transposer 602-3, which covers the frequency range [B, 3B], indicated by the hatched frequency range in the diagram. Similarly, the transposer 602-P generates an output signal covering the frequency range [B, PB], indicated in the frequency diagram 1244. Finally, the output signals and low-frequency components of the various transposers 602-2, ..., 602-P are mapped to QMF subbands using the analysis QMF bank 603-1, ..., 603-P, thereby generating a set of P QMF subbands. As can be seen from the frequency diagram 1245, the QMF subband covering the frequency range [0,B], indicated by reference numeral 1246, only has contributions from low frequency components (ie signals resulting from a first order transposition).The QMF subband covering the frequency range [B,2B], indicated at 1247, receives contributions from output signals of transposition order T=2,...,P. The QMF subband covering the frequency range [2B,3B], indicated at 1248, receives contributions from output signals of transposition order T=3,...,P, etc. The QMF subband covering the frequency range [(P-1)B,PB], indicated at 1249, receives contributions from output signals of transposition order T=P.

[0076] In contrast, in Fig. 12c, the transposers 602-2,...,602-P are arranged so that the frequency ranges of their output signals do not overlap. Frequency diagram 1251 shows the low frequency components. Frequency diagram 1252 shows the output signal of a second order transposer covering the frequency range [B,2B]. Frequency diagram 1253 shows the output signal of a third order transposer 602-3 covering the frequency range [2B,3B], and frequency diagram 1254 shows the output signal of a Pth order transposer 602-P covering the frequency range [(P-1)B,PB]. The signals of the low frequency components and the output signals of the transposers 602-2,...,602-P are respectively fed to analysis QMF banks 603-1,...,603-P providing a set of P QMF subbands. Typically, these QMF subbands do not have contributions of overlapping frequency ranges. This is shown in frequency diagram 1255. The QMF subband covering the frequency range [0,B], indicated by reference numeral 1256, receives only contributions from low frequency components (signals from the first transposition). The QMF subband covering the frequency range [B,2B], indicated by reference numeral 1257, receives contributions from the output signal of a transposer with transposition order T=2. The QMF subband covering the frequency range [2B,3B], indicated by reference numeral 1258, receives contributions from the output signal of a transposer with transposition order T=3. The QMF subband covering the frequency range [(P-1)B,PB], indicated by reference numeral 1259, receives contributions from the output signal of a transposer with transposition order T=P.

[0077] 12b and 12c show examples of the case where the output signals of the transposers 602-2,...,602-P are completely overlapped and not completely overlapped. It should be noted that mixed examples with partially overlapped output signals are also possible. It should be noted that the two examples of Fig. 12b and 12c show the system where the transposers 602-2,...,602-P are configured so that the frequency ranges of the respective output signals overlap or do not overlap. This may be done by applying a windowing in the transposer's spectral domain, for example by setting selected subband signals to zero. An alternative is to generate a wideband signal by appropriately combining the subband signals obtained from the analysis QMF bank 603-1,...,603-P with the transposers 602-2,...,602-P in both Fig. 12b and 12c, and to perform filtering of the transposition signal in the QMF subband domain. For example, in the non-overlapping case, only one of the analysis QMF banks 603-1,...,603-P contributes to the subband signals provided to the HFR processor 604 in each transposer output frequency range. In the overlapping case, the multiple subband signals are summed before being input to the HFR processor 604.

[0078] If all or part of the signals of the HFR system 600 are critically (closely) sampled, as shown in Figures 7 and 13-16 for the HFR system 700, a more efficient embodiment than the system of Figure 6 is obtained. This means that the output signal of the core decoder 701 and preferably other intermediate signals of the HFR system 700 (e.g., the output signals of the transposers 702-2,...,702-P) are critically sampled. For example, the core decoded signal at the output of the core decoder 701 is critically sampled by a rational factor Q=M 1 / M 2 It is downsampled by M 1 and M 2is a suitably chosen integer. The downsampling factor Q is the largest factor that forces the input signal of bandwidth B to approach being critically sampled. At the same time, Q is selected such that the size (32 / Q) of the QMF bank 703-1 remains an integer. Downsampling by a rational factor Q is performed in the downsampler 706, which produces an output signal at the sampling frequency fs / Q. To provide a critically sampled transposition signal, the transposers 702-2,...,702-P preferably output only a portion of the associated transposition signal (i.e., the frequency range actually used by the HFR processor 704). The frequency range associated with the transposer 702-T of transposition order T may be the range [(T-1)B,TB] of the input signal with bandwidth BHz in the non-overlapping case.

[0079] This means that the output from the downsampler 706 and the outputs from the transposers 702-2,...,702-P are critically sampled. The output signal of the second-order transposer 702-2 has a sampling frequency fs / Q equal to the output signal of the downsampler 706. However, it should be noted that the signal from the second-order transposer 702-2 is effectively a high-pass signal with a bandwidth of fs / (2Q), since the transposer 702-2 is designed to synthesize only the transposition frequency range from approximately B to 2B Hz.

[0080] For higher-order transposers, such as transposer 702-P, at least two situations are possible. The first situation is when the transposition signals overlap, i.e., the lower frequency part of the P-th transposition signal overlaps with the frequency range of the P-1-th transposition signal (see FIG. 12b). In this case, the output from the critically sampled transposer 702-P has a sampling frequency of Sfs / Q, where S=min(P-1,2Q-1). When S=P-1, the highest frequency of the P-th transposition signal is still lower than the Nyquist frequency of the output signal of the HFR system 700, and when S=2Q-1, the bandwidth of the P-th transposition signal is limited by the Nyquist frequency fs of the output signal of the HFR system 700. That is, the sampling frequency of the output signal of the transposer 702-P is never greater than (2-(1 / Q))fs, which corresponds to a signal covering a frequency range from fs / (2Q) (the highest frequency of the lower frequency signal) to the Nyquist frequency fs. Another situation is when the transposed signals are non-overlapping, where S=1 and cover different non-overlapping frequency ranges in the output signal of the inverse QMF bank 705 (i.e., in the output signal of the HFR system 700), but all of the transposed signals have the same sampling frequency (see FIG. 12c).

[0081] The effects of the above sub-sampling or down-sampling on the output signal of the core decoder 701 with a bandwidth of B Hz are shown in FIGS. 13-16. FIG. 13 schematically shows the signal transition from the output of the core decoder 701 to the output of the transposer 702-2 with a transition order T = 2. The frequency diagram 1310 shows the output signal of the core decoder with a bandwidth of B Hz. This signal is critically down-sampled by the down-sampler 706. The down-sampling factor Q is a rational value that ensures that the analysis QMF band 703-1 has an integer value 32 / Q with respect to the sub-band. Further, the down-sampler 706 provides an output signal that is critically sampled (i.e., an output signal having a sampling frequency fs / Q, which is close to twice the bandwidth of the core decode signal) (Q < fs / (2B)). Such a critically sampled signal is shown in the frequency diagram 1320. The critically sampled signal with a sampling frequency fs / Q is applied to the transposer 702-2 and segmented into a plurality of analysis sub-bands. Such a segmented signal is shown in the frequency diagram 1330. Next, non-linear processing is performed on the analysis sub-band signal, and the analysis sub-band signal is stretched to a frequency range T = 2 times higher and the sampling frequency becomes 2fs / Q. This is shown in the frequency diagram 1340 (alternatively, it may be shown as the frequency diagram 1330 with a scaled frequency axis). It should be noted that typically only a portion of the sub-bands that are transposed are considered in the HFR processing module 704. These relevant transposed sub-bands are shown as hatched sub-bands covering the frequency range [B, 2B] in the frequency diagram 1340. Only the hatched sub-bands need to be considered in the transposer synthesis filter bank, so the relevant range is modulated down to the baseband and the signal is down-sampled by a factor of 2 to the sampling frequency fs / Q.This is illustrated in frequency diagram 1360, where it can be seen that a signal covering the frequency range [B,2B] is modulated into the baseband range [0,B]. The fact that the modulated signal actually covers a higher frequency range [B,2B] is indicated by the references "B" and "2B".

[0082] It should be noted that the illustrated steps of transposition (frequency diagram 1340) and subsequent modulation to baseband (frequency diagram 1360) are shown for illustrative purposes only. Both of these operations may be performed by assigning the hatched subbands (frequency diagram 1340) to synthesis subbands of a synthesis filterbank that has half the number of subbands as the analysis filterbank. Such a mapping operation results in an output signal shown by frequency diagram 1360 modulated to baseband (centered around zero frequency). In the case of a non-overlapping example, the size of the synthesis filterbank is reduced compared to the analysis filterbank, making use of an achievable downsampling factor given by a ratio, that is, the ratio between the total frequency range [0,PB] covered by the output signal of the P-th order transposer 703-P and the actual frequency range [(P-1)B,PB] covered by the output signal of the P-th order transposer 703-P, i.e., the factor P.

[0083] Fig. 14 shows a schematic diagram of a signal transition from the output of the core decoder 702-1 to the output of the transposer 702-3 with transition order T=3 in the case of overlapping frequency ranges. The signal of bandwidth B shown in frequency diagram 1410 is downsampled by a factor Q in the downsampler 706 to generate the signal shown in frequency diagram 1420. The analysis subband shown in frequency diagram 1430 is transposed to a subband with a frequency T=3 times higher. The transposition subband is shown in frequency diagram 1440, where the sampling rate is increased from fs / Q to 3fs / Q. As explained with respect to Fig. 13, this may be expressed in a scale of three times the frequency axis. It can be seen that the frequency range of the third-order transposer 702-3 (i.e. the hatched frequency range [B,3B]) overlaps with the frequency range of the second-order transposer 702-2. As in Fig. 13, the hatched subbands are fed to a reduced size synthesis filterbank, which produces a signal containing only frequencies from the hatched frequencies. The highpass signal is then modulated down to baseband using downsampling by a factor of 3 / 2. The critically sampled output signal of transposer 703-2 with sampling frequency 2fs / Q is shown in frequency diagram 1460.

[0084] It should be noted that, as in Fig. 13, the transposition process shown in the frequency diagram 1440 and the modulation process to baseband shown in the frequency diagram 1460 are performed by mapping the hatched subbands in the frequency diagram 1440 to synthesis subbands of a synthesis filter bank of reduced size. In the case of the overlapping example, the size of the synthesis filter bank is reduced compared to the analysis filter bank, making it possible to utilize an achievable downsampling factor given by a ratio, which is the ratio between the total frequency range [0,PB] covered by the output signal of the P-th order transposer 703-P and the actual frequency range [B,PB] covered by the output signal of the P-th order transposer 703-P, i.e., the factor P / (P-1).

[0085] FIG. 15 shows a schematic diagram of a signal transition from the output of the downsampler 706 to the output of the transposer 702-P of transposition order T=P when the transposition frequency range does not overlap with the relevant frequency range (i.e., [(P-2)B, (P-1)B]) of the lower order transposer (T=P-1). As explained with respect to FIG. 13, the downsampled signal shown in frequency diagram 1530 is transposed by the transposer 702-P. The transposition subbands covering the relevant frequency range [(P-1)B, PB] are shown as hatched frequency ranges in frequency diagram 1540. The subbands corresponding to the hatched frequency ranges are applied to a synthesis filter of reduced size, which generates a signal containing only the frequency range [(P-1)B, PB]. This high-pass signal is then modulated to baseband and downsampled by a factor P. This results in a critically sampled output signal of the transposer 702-P shown in frequency diagram 1560. The output signal of the transposer 702-P has frequency components in the frequency range [(P-1)B,PB], which needs to be considered when mapping the transposer output to QMF subbands for HFR processing.

[0086] FIG. 16 shows a schematic diagram of a signal transition from the output of the downsampler 706 to the output of the transposer 702-P of transposition order T=P when the transposition frequency range overlaps with the relevant frequency range (i.e., [B, (P-1)B]) of the lower order transposer (T=2,...,P-1). As described with respect to FIG. 14, the downsampled signal shown in the frequency diagram 1630 is transposed in the transposer 702-P. The transposition subbands covering the frequency range [B,PB] are shown as hatched frequency ranges in the frequency diagram 1640. As in FIG. 14, it can be seen that the hatched subbands cover frequencies lower than (P-1)B. Thus, the hatched subbands overlap with the frequency ranges of the lower order transposers 702-2,...,702-P-1. Furthermore, due to the fact that the hatched subbands cover a range higher than [(P-1)B,PB], only a reduced downsampling factor can be used. As mentioned above, if the frequency range covered by the output signal of the P-th order transposer 702-P is [B,(P-1)B], then this downsampling factor is P / (P-1). This results in a downsampled output signal of the transposer with a sampling frequency of (P-1)fs / Q.

[0087] As mentioned above, it should be noted that the intermediate signals in transposer 702-P (i.e., the signals shown in frequency diagrams 1340, 1440, 1540, 1640, among others) are not signals that would physically appear in the HFR system shown in Figure 7. These signals are shown for illustrative purposes only and are shown as "virtual" signals in transposer 702-P to illustrate the effects of transposition and filtering when performing implicit downsampling.

[0088] Note that, as mentioned above, the output signal from the core decoder 701 may be critically pre-sampled at the sampling rate fs / Q before entering the HFR module 700. This can be done, for example, by using a smaller synthesis transform size than normal in the core decoder 701. In this case, the computational burden is reduced due to the smaller synthesis transform and obsolete downsampler used in the core decoder 701.

[0089] Another measure to improve the efficiency of the HFR system is combined into the individual transposers 602-2,...,602-P of Fig. 6 according to any of the methods described with respect to Fig. 3, 4 or 5. As an example, instead of the individual transposers 602-2,...,602-P for various transposition orders T=2,...,P, the multiple transposer systems 300, 400 or 500 may be used. A possible situation is shown in Fig. 8, where transposers with a transposition factor T of 2 or less are grouped together into a multiple transposer 802, which may be realized according to any of the forms described with respect to Fig. 3-5. The output from the multiple transposer 802 has a sampling frequency 2fs (i.e., a sampling frequency twice higher than the sampling frequency of the input signal to the multiple transposer 802). The output signal of the multiple transposer 802 is filtered by a single analysis QMF bank 803-2 with 64 channels.

[0090] As explained with respect to Fig. 6, the resampling of the core signal (i.e. the resampling of the output signal of the core decoder 801) may be performed by filtering the signal using a downsampled QMF bank 803-1 having only 32 channels. As a result, the set of QMF subband signals has QMF subband signals with a sampling frequency fs / 32. Two of the set of QMF subband signals are fed to the HFR processing module 804, and finally, the adjusted QMF subband signals are synthesized into a time domain signal by a 64-synthesized QMF bank 805. It should be noted that in the described example, the multiple transposer 802 generates a transposed time domain signal with twice the sampling rate fs. As explained with respect to Figs. 3, 4 and 5, this transposed time domain signal is the sum of several transposed signals with different transposition factors T, where T is greater than 1. The reason why the multiple transposers 802 provide an output signal with a sampling frequency of 2fs is because the output signal of the multiple transposers 802 covers the high frequency range of the output signal of the HFR module 800 (i.e., the range of at most [B, fs]), where B is the bandwidth of the low frequency components and fs is the Nyquist frequency of the output signal of the HFR module 800.

[0091] As explained with respect to FIG. 7, the efficiency of the HFR system 800 can be increased by increasing the level of subsampling of the time domain signal, i.e. preferably by providing critically downsampled signals at the output of the core decoder and at the output of the transposer. This is shown in FIG. 9, where the output signal of the core decoder 901 is downsampled in a downsampling unit 906, resulting in a downsampled signal at a sampling frequency fs / Q. This signal is provided to multiple transposers 902 and an analysis QMF bank 903-1. The output of the multiple transposers 902 is a combination of signals with transposition orders from T=2 to P, so that the output of the multiple transposers 902 has a sampling frequency Sfs / Q, where S=min(P-1,2Q-1). The transposition signal is provided to an analysis QMF bank 903-2 of size 32S / Q. As before, the two groups of QMF subband signals are processed in the HFR processor 904 and finally transformed into a time domain signal using the synthesis QMF bank 905 .

[0092] In one embodiment, if the multiple transposers are constructed to inform an unaltered copy of the core signal (i.e., an unaltered copy of the output signal of the core decoder), the QMF bank that analyzes the core signal (i.e., the analysis QMF bank 803-1 in FIG. 8) may be omitted. In transposer terms, this is equivalent to a transposition with a transposition factor T=1 (i.e., a first-order transposition). If a first-order transposition is added to the multiple transposer system 802 in FIG. 8, a block diagram of the HFR module 1000 so modified is shown in FIG. 10. As shown in FIG. 10, the signal decoded by the core decoder 1001 is simply used as an input to the multiple transposers 1002, i.e., the signal decoded by the core decoder 1001 is not provided to any additional elements of the HFR module 1000. The multiple transposers 1002 are constructed such that their sole output signal has a sampling frequency of 2fs. In other words, the multiple transposers 1002 generate a time domain signal at twice the sampling rate, which is the sum of several transposed signals with different transposition factors T, where T can take any value between 1 and P. This single output signal from the multiple transposers 1002 is analyzed by a 64 channel QMF bank 1003, and the QMF subband signals are then fed to an HFR processing module 1004, which adjusts the QMF subband signals using the information of the sender. The adjusted QMF subband signals are finally combined by a 64 channel combination QMF bank 1005.

[0093] Similar to the downsampling described with respect to Figures 7 and 9, the efficiency of the HFR module 1000 can be improved by utilizing subsampling of the time domain signal. Such an HFR module 1100 is shown in Figure 11. The received bitstream is decoded by a core decoder 1101, which provides a time domain signal with a sampling frequency fs. The time domain output signal is downsampled by a factor Q using a downsampling unit 1106. The downsampled signal with a sampling frequency fs / Q is provided to a multiple transposer 1102. The output from the multiple transposer 1102 has a sampling frequency Sfs / Q. However, since the transposition signal comprises the decoded and downsampled output signal from the core decoder 1101, the parameter S is selected as S = min (P, 2Q). The output signal of the multiple transposer 1102 is segmented into QMF subband signals using an analysis QMF bank 1103 with 32 S / Q channels. The QMF subband signals are conditioned using the transmit side information and then absorbed by the combined 64 channel QMF bank 1105 .

[0094] As mentioned above, the multiple transposers 802, 902, 1002 and 1102 shown in Figs. 8-11 may be based on any of the configurations related to Figs. 3-5. In addition, the transposer configuration shown in Fig. 2 may be used, although it is less computationally efficient compared to the multiple transposers of Figs. 3-5. In a first preferred embodiment, the HFR module configuration shown in Figs. 10 and 11 may be combined with multiple transposers described with respect to Fig. 5. An example of mapping the transposer analysis subbands to the transposer synthesis subbands is shown in Fig. 5b. In a second preferred embodiment, the HFR module configuration shown in Figs. 8 and 9 may be combined with multiple transposers described with respect to Fig. 5. An example of mapping the transposer analysis subbands to the transposer synthesis subbands is shown in Fig. 5c.

[0095] Together with the examples described with respect to Figures 7, 9, 11, 13-16, a general building block of a maximally decimated or critically sampled transposer may be formed. Such a building block 170 is shown in Figure 17. An input signal with sampling frequency fs is first processed by a downsampler 171 of factor Q and filtered by a transposer analysis filterbank 172. The analysis filterbank has N a and the filter bank size or transform size δ a The subband signals have a hop size or input signal stride of N samples. The subband signals are then processed by a nonlinear processor 173 using a transposition factor T. The nonlinear processor 173 performs any of the nonlinear processing described herein. In one embodiment, the nonlinear processing described with respect to Figures 5, 5b, 5c may be performed in the nonlinear processor 173. Finally, the subband signals are assembled (composed, summed, created) in a transposer synthesis filterbank 174 into a time domain signal at sampling frequency Rfs, where R is the desired resampling factor. The synthesis filterbank is a filter bank with a sampling frequency of N S and the filter bank size or transform size δ S The hop size or input signal stride is a set of samples. The expansion factor W for the analysis filter bank 172, the nonlinear processor 173 and the synthesis filter bank 174 is the ratio of the sampling frequency of the output signal from the synthesis filter bank to the input signal to the analysis filter bank:

[0096] W=Rf s / f s / Q=RQ (6) Filter bank or transform size N a and N s satisfies the following relationship:

[0097] N s =(W / T)N a (7) Hop size or signal stride δ a and δ S satisfies the following relationship:

[0098] δ S =Wδ a (8) The maximally decimated or critically sampled transposer building block 170 has the input signal to the analysis filter bank 172, the output from the synthesis filter bank 174, or both, exclusively covering the spectral bandwidth of interest for further processing, such as the HFR processing unit 704 in FIG. 7. Critical sampling of the input signal is obtained by filtering (possibly modulating after decimation) the input signal in the downsampler 171. In one embodiment, critical sampling of the output signal is achieved by mapping the subband signals into a synthesis filter bank 174 of the minimum necessary size, exclusively covering the subband channels relevant for further processing, e.g. as shown in equation (7). Figures 13-16 show the situation when the output from the synthesis filter bank exclusively covers the relevant spectral bandwidth and is maximally decimated.

[0099] A number of building blocks 170 are combined and configured to obtain critically sampled transposer systems of any number of transposition orders. In such systems, one or more modules 171-174 of the building blocks 170 may be shared between building blocks of different transposition orders. Typically, the input signals to the common analysis filter bank 301 are maximally decimated for the transposer building block 170 requiring the largest input signal bandwidth, while a system using a common analysis filter bank 301 as described in relation to FIG. 3 has maximally decimated output signals from the synthesis filter banks 303-1,...,303-P. A system using a common synthesis filter bank 404 as described in relation to FIG. 4 may have maximally decimated input signals for the analysis filter banks 401-1,...,401-P and maximally decimated output signals from the common synthesis filter bank 404. The system described with respect to FIG. 2 preferably has both a maximally decimated input signal to the analysis filter bank and a maximally decimated output signal from the synthesis filter bank. In this example, the system may simply be a parallel arrangement of multiple transposer building blocks 170. As described with respect to FIG. 5, a system utilizing both a common analysis filter bank 501 and a common synthesis filter bank 504 typically has a maximally decimated output signal from the common synthesis filter bank 504, while the input signal to the common synthesis filter bank 501 may be maximally decimated for signals whose transposition order requires the largest input signal bandwidth. In this system, the transposition factor T in equation (7) is replaced by the factor F described with respect to FIGS. 5, 5b and 5c. It should be noted that the summation units 202 in FIG. 2 and 304 in FIG. 3 are constructed to process and synthesize critically sampled subband signals from the synthesis filter bank of the transposer building block in the above example.As an example, the summing unit comprises a QMF analysis filterbank followed by means for combining subband signals or a time domain resampling modulation means followed by means for summing signals.

[0100] A multiple transposition scheme and system that enables the use of a common analysis filter bank and a common synthesis filter bank is described herein. To enable the use of a common analysis and synthesis filter bank, an advanced nonlinear processing scheme is described to perform a mapping from multiple analysis subbands to synthesis subbands. By utilizing a common analysis filter bank and a common synthesis filter bank, the multiple transposition scheme is improved to reduce the computational burden compared to conventional transposition schemes. In other words, by sharing a pair of analysis and synthesis filter banks for several harmonic transposers, or by combining one or more harmonic transposers with an upsampler, the computational burden of the harmonic HFR method is significantly reduced.

[0101] Additionally, various forms of HFR modules performing multiple transitions have been described. In particular, reduced complexity forms of HFR modules have been described that process critically downsampled signals. The described methods and systems may be used in various decoding devices, such as, for example, multimedia receivers, video / audio set-top boxes, mobile devices, audio players, video players, etc.

[0102] The methods and systems for transposition and / or high frequency reconstruction described herein may be implemented as software, firmware and / or hardware. Certain components may be implemented as software running on, for example, a digital signal processor or a microprocessor. Other components may be implemented as, for example, hardware and / or application specific integrated circuits. Signals used in the described methods and systems may be stored on media such as random access memory or optical storage media. The information may be transmitted over a network (including, for example, the Internet) such as a radio network, a satellite network, a wireless network or a wired network. Typical devices that utilize the methods and systems described herein are portable electronic devices or other consumer devices that store and / or use audio signals. The methods and systems may be used in computer systems (e.g., Internet web servers) that store and provide audio signals, such as music signals, for download.

[0103] The means according to the embodiment will be listed as examples below.

[0104] [Additional note 1] 1. A system for generating high frequency components of a signal from low frequency components of the signal, comprising: an analysis filter bank having a frequency resolution of Δf for providing a set of analysis subband signals comprising at least two analysis subband signals from the low frequency components of the signal; a nonlinear processing unit for determining a set of synthesis subband signals from the set of analysis subband signals using a transposition order P, the set of synthesis subband signals being determined based on a portion of the set of analysis subband signals that have been phase shifted by an amount derived from the transposition order P; a synthesis filter bank having a frequency resolution of FΔf for generating high frequency components of a signal from the set of synthesis subband signals, where F is a resolution factor, F≧1, and the transposition order P is different from the resolution factor F; A system having

[0105] [Additional note 2] an analysis subband signal belonging to the set of analysis subband signals phase shifted by the transposition order P, or a pair of analysis subband signals in said set of synthesis subband signals 2. The system of claim 1, wherein the nonlinear processing unit determines a composite subband signal of the set of subband signals based on:

[0106] [Additional note 3] The analysis filter bank is L A analysis subbands, L A >1, and the index k of the analysis subband is k=0,...,L A -1, The synthesis filter bank is L S number of synthesis subbands, L S >1, and the synthesis subband index n is n=0,...,L S- -1. The system according to claim 1, [Additional note 4] The system of claim 3, wherein the nonlinear processing unit determines an nth synthesis subband signal of the set of synthesis subband signals from a kth analysis subband signal and a (k+1)th analysis subband signal of the set of analysis subband signals.

[0107] [Additional note 5] The nonlinear processing unit: determining the phase of the n-th synthesis subband signal as the sum of a phase shift of the k-th analysis subband signal and a phase shift of the (k+1)-th analysis subband signal; and / or 5. The system of claim 4, further comprising: determining the magnitude of the n-th synthesis subband signal as the product of the magnitude in exponential notation of the k-th analysis subband signal and the magnitude in exponential notation of the (k+1)-th analysis subband signal.

[0108] [Additional note 6] The system of claim 5, wherein the analysis subband index k of the analysis subband signal that contributes to the synthesis subband together with the synthesis subband index n is given by an integer obtained by truncating (F / P)n, and the remainder r of (F / P)n is given by (F / P)nk.

[0109] [Additional note 7] The nonlinear processing unit: determining the phase of the n-th synthesis subband signal as the sum of the phase of the k-th analysis subband signal multiplied by P(1-r) and the phase of the (k+1)-th analysis subband signal multiplied by P(r); and / or The system of claim 6, further comprising: determining the magnitude of the nth synthesis subband signal as the product of the (1-r)th power of the magnitude in exponential representation of the kth analysis subband signal and the rth power of the magnitude in exponential representation of the (k+1)th analysis subband signal.

[0110] [Additional note 8] 8. The system of claim 1, wherein the analysis filter bank and the synthesis filter bank are set at integer multiple positions, the center frequency of the analysis subband is given by kΔf, and the center frequency of the synthesis subband is given by nFΔf.

[0111] [Additional note 9] the analysis filter bank and the synthesis filter bank are set at half-integer multiple positions, the center frequency of the analysis subband is given by (k+(1 / 2))Δf, and the center frequency of the synthesis subband is given by (n+(1 / 2))FΔf; 8. The system of claim 1, wherein a difference between the transposition order P and the resolution factor F is an even number.

[0112] [Additional Note 10] The analysis filter bank has an analysis time span Δt A Using The synthesis filter bank has a synthesis time span Δt S Using The analysis time span Δt A and the composite time span Δt S is equal to.

[0113] [Additional Note 11] the nonlinear processor determines a set of intermediate synthesis subband signals having a frequency resolution of PΔf from the set of analysis subband signals using the transposition order P, the set of intermediate synthesis subband signals being determined based on a portion of the set of analysis subband signals phase-shifted by the transposition order P; 2. The system of claim 1, wherein the nonlinear processing unit interpolates one or more intermediate synthesis subband signals to determine a synthesis subband signal of the set of synthesis subband signals having a frequency resolution of FΔf.

[0114] [Additional Note 12] 1. A system for generating high frequency components of a signal from low frequency components of the signal, comprising: an analysis filter bank for providing a set of analysis subband signals comprising at least two analysis subband signals from the low frequency components of the signal; First transposition order P 1a first nonlinear processing unit for determining a first set of synthesis subband signals from the set of analysis subband signals using 1 a first nonlinear processing unit determined based on a portion of the set of analysis subband signals that have been phase shifted by an amount derived from Second transposition order P 2 a second nonlinear processing unit for determining a second set of synthesis subband signals from the set of analysis subband signals using 2 and the first transposition order P is determined based on a portion of the set of analysis subband signals that has been phase shifted by an amount derived from 1 and the second transposition order P 2 a second nonlinear processing unit, a combiner for combining the first and second sets of combined subband signals to generate a combined set of combined subband signals; a synthesis filter bank for generating the high frequency components of the signal from the set of synthesis subband signals; A system having

[0115] [Additional Note 13] 13. The system of claim 12, wherein the synthesis unit overlaps synthesis subband signals belonging to the first and second groups of synthesis subband signals corresponding to overlapping frequency ranges.

[0116] [Additional Note 14] a core decoder for converting the encoded bitstream into the low frequency components of the signal; a quadrature mirror filter (QMF) bank for converting the high frequency components into a plurality of QMF subband signals; a high frequency reconstruction processing module for modifying said QMF subband signals; a synthesis QMF bank for generating modified high frequency components from said modified QMF subband signals; 14. The system according to claim 12 or 13, further comprising:

[0117] [Additional Note 15] 15. The system of claim 14, further comprising a downsampling unit upstream of the analysis filter bank for reducing a sampling rate of the low-frequency components of the signal and outputting the low-frequency components at a reduced sampling rate.

[0118] [Additional Note 16] 16. The system of claim 14 or 15, wherein the core decoder is based on an encoding format that is any one of Dolby E, Dolby Digital, AAA and HE-AAC.

[0119] [Additional Note 17] 1. A system for generating, from a low frequency component of a signal having a first sampling frequency, a high frequency component of the signal having a second sampling frequency that is R times the first sampling frequency, comprising: A T-th order harmonic transposer that generates modulated high-frequency components from the low-frequency components. the modulated high frequency component is determined based on a spectral portion of the low frequency component transposed to a frequency range T times higher, the modulated high frequency component being the first sampling frequency multiplied by a factor S, where R≧1, T>1 and S <Rである、システム。

[0120] [Additional Note 18] a quadrature mirror filter (QMF) bank for mapping the modulated high frequency components to at least one of X analysis QMF subbands, where X is a multiple of S, to provide at least one QMF subband signal; a high frequency reconstruction module for modifying said at least one QMF subband signal; a synthesis QMF bank for generating said high frequency components from said at least one modified QMF subband signal; 18. The system of claim 17, further comprising:

[0121] [Additional Note 19] The harmonic transposer includes: an analysis filterbank for providing a set of analysis subband signals from the low frequency components of the signal; a nonlinear processor with transposition order T for determining a set of synthesis subband signals from the set of analysis subband signals by modifying a phase of the set of analysis subband signals; a synthesis filter bank for generating modulated high frequency components of said synthesis subband signals from said set of synthesis subband signals; 19. The system according to claim 17 or 18, comprising:

[0122] [Additional Note 20] The low frequency component has a bandwidth of B, the set of composite subband signals is in a frequency range from (T-1)*B to T*B; 20. The system of claim 19, wherein the harmonic transposer modulates the set of composite subband signals to a baseband centered about zero frequency to generate the modulated high frequency components.

[0123] [Additional Note 21] 21. The system of claim 20, wherein the harmonic transposer maps the set of subband signals to subbands of the synthesis filter bank.

[0124] [Additional Note 22] The system according to any one of claims 17-21, wherein the harmonic transposer constitutes the system according to any one of claims 1-13.

[0125] [Additional Note 23] further comprising down-sampling means upstream of the harmonic transposer, the down-link sampling means providing, from the low frequency components of the signal, low frequency components that are critically down-sampled by the first sampling frequency divided by a down-sampling factor Q; the modulated high frequency component is the first sampling frequency multiplied by a factor S and divided by the downsampling factor Q; 23. The system of claim 18, wherein X is S / Q.

[0126] [Additional note 24] 1. A method for generating high frequency components of a signal from low frequency components of the signal, comprising the steps of: providing a set of analysis subband signals comprising at least two analysis subband signals from the low frequency components of the signal using an analysis filter bank having a frequency resolution of Δf; determining a set of synthesis subband signals from the set of analysis subband signals using a transposition order P, the set of synthesis subband signals being determined based on a portion of the set of analysis subband signals that have been phase shifted by an amount derived from the transposition order P; generating high frequency components of the signal from the set of synthesis subband signals using a synthesis filter bank having a frequency resolution of FΔf; wherein F≧1 and is a resolution factor, and the transposition order P is different from the resolution factor F.

[0127] [Additional note 25] 1. A method for generating high frequency components of a signal from low frequency components of the signal, comprising the steps of: providing a set of analysis subband signals comprising at least two analysis subband signals from the low frequency components of the signal; First transposition order P 1 determining a first set of synthesis subband signals from the set of analysis subband signals using 1 based on a portion of the set of analysis subband signals that have been phase shifted by an amount derived from Second transposition order P 2A step of determining a second set of synthesized sub-band signals from the group of analysis sub-band signals, wherein the second set of synthesized sub-band signals is based on a portion of the group of analysis sub-band signals whose phase is shifted by an amount derived from the second transposition order P 2 and is determined based on a portion of the group of analysis sub-band signals whose phase is shifted by an amount derived from the first transposition order P 1 and the second transposition order P 2 are different, the step; A step of synthesizing the first and second sets of synthesized sub-band signals to generate a synthesized set of synthesized sub-band signals; A step of generating the high-frequency component of the signal from the synthesized set of synthesized sub-band signals A method comprising:

[0128] [Appendix 26] A method for generating a high-frequency component of a signal from a low-frequency component of the signal at a first sampling frequency, the high-frequency component being at a second sampling frequency that is R times the first sampling frequency, comprising: A step of generating a modulated high-frequency component from the low-frequency component by performing a harmonic transposition of order T, wherein the modulated high-frequency component is determined based on a portion of the low-frequency component transposed to a frequency range T times higher, and the modulated high-frequency component is the first sampling frequency multiplied by a factor S, where R ≧ 1, T > 1, and S < R.

[0129] [Appendix 27] A set-top box for decoding a received signal including at least a signal, The system according to any one of Appendices 1-23 for generating a high-frequency component of the signal from a low-frequency component of the signal A set-top box having the same.

[0130] [Appendix 28] A software program for causing a processor of a computer device to execute the method according to any one of Appendices 24-26.

[0131] [Additional note 29] A storage medium storing a software program for causing a processor of a computer device to execute the method according to any one of appendixes 24-26.

[0132] [Additional note 30] A computer program comprising instructions for causing a computer to carry out the method according to any one of claims 24-26.

Claims

1. 1. A system configured to generate high frequency components of a signal from low frequency components of the signal, comprising: an analysis filterbank configured to provide a set of analysis subband signals from the low frequency components of the signal, the set of analysis subband signals including at least two analysis subband signals; a non-linear processing unit configured to determine a set of synthesis subband signals from the set of analysis subband signals, the non-linear processing unit being configured to determine an n-th synthesis subband signal from the set of synthesis subband signals from the k-th analysis subband signal and the (k+1)-th analysis subband signal of the set of analysis subband signals, the magnitude of the n-th synthesis subband signal depending on the magnitude in exponential notation of the k-th analysis subband signal and the magnitude in exponential notation of the (k+1)-th analysis subband signal, and the phase of the n-th synthesis subband signal depending on a transposition order T; a synthesis filter bank configured to generate high frequency components of the signal based on the set of synthesis subband signals; A system having

2. The analysis filter bank is L Ａ analysis subbands, L Ａ >1, and the index k of the analysis subband is k=0, . . . , L Ａ −1, The synthesis filter bank is L Ｓ number of synthesis subbands, and L Ｓ >1, and the synthesis subband index n is n=0, . . . , L Ｓ The system of claim 1, wherein the metric is -1.

3. The number of analysis subbands L Ａ is the number of synthesis subbands L Ｓ The system of claim 2 , wherein the

4. the analysis filter bank has a frequency resolution of Δf; The system of claim 1 , wherein the synthesis filter bank has a frequency resolution of FΔf, where F is a resolution factor, F≧1.

5. a core decoder configured to convert the encoded bitstream into low frequency components of said signal; an analysis quadrature mirror filter bank (QMF bank) configured to transform the high frequency components into a plurality of QMF subband signals; a high frequency reconstruction processing module configured to modify the QMF subband signals; a synthesis QMF bank configured to generate modified high frequency components from the modified QMF subband signals; The system of claim 1 further comprising:

6. 1. A method for generating high frequency components of a signal from low frequency components of the signal, comprising the steps of: providing a set of analysis subband signals from the low frequency components of the signal, the set of analysis subband signals including at least two analysis subband signals; determining a set of synthesis subband signals from the set of analysis subband signals, an n-th synthesis subband signal of the set of synthesis subband signals being determined from a k-th analysis subband signal and a (k+1)-th analysis subband signal of the set of analysis subband signals, a magnitude of the n-th synthesis subband signal depending on a magnitude in exponential notation of the k-th analysis subband signal and a magnitude in exponential notation of the (k+1)-th analysis subband signal, and a phase of the n-th synthesis subband signal depending on a transposition order T; generating high frequency components of the signal based on the set of composite subband signals; The method according to claim 1,

7. the set of analysis subband signals is generated from the low frequency components using an analysis filterbank; The method of claim 6 , wherein the high frequency components are generated from the set of synthesis subband signals using a synthesis filterbank.

8. A software program adapted to be executed by a processor, which, when executed on a computing device, causes the software program to carry out the steps of the method according to claim 6.

9. A storage medium containing a software program adapted to be executed by a processor, the software program causing the execution of the steps of the method according to claim 6 when executed on a computing device.

Images