System and method for generating high frequency components of a signal

Abstract

To mitigate the increase of different kinds of transposition orders and associated calculation processing loads.SOLUTION: A system for generating a high frequency component of a signal from a low frequency component of the signal comprises: an analysis filter bank for providing a set of analysis subband signals, which set includes at least two analysis subband signals, from the low frequency component of the signal, the analysis filter bank having a frequency resolution of Δf; a nonlinear processing unit for determining a set of synthesis subband signals from the set of analysis subband signals using a transposition order P, the set of synthesis subband signals comprising a portion of the set of analysis subband signals phase shifted by an amount derived from the transposition order P; and a synthesis filter bank for generating the high frequency component of the signal from the set of synthesis subband signals, the synthesis filter bank having a frequency resolution of FΔf, with F being a resolution factor. The transposition order P is different from the resolution factor F.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to audio coding systems that utilize harmonic transposition for high frequency reconstruction (HFR), and to digital effect processors such as so-called exciters, where the generation of harmonic distortion adds brightness to the processed signal. In particular, the present application relates to a simple method for high frequency reconstruction. [Background technology]

[0002] WO 98 / 57436 establishes the concept of transposition as a method for recreating high-frequency bands from low-frequency bands of an audio signal. Using this concept in audio coding can significantly reduce bit rates. In an audio coding system using HFR, a low-bandwidth signal, referred to as the low-frequency component of the signal, is provided to a core waveform coder, and high-frequency components, referred to as the high-frequency component of the signal, are regenerated using very low-bitrate additional side information describing the target spectral shape of the high-frequency component at the decoder side and signal transposition. At low bit rates, the bandwidth of the core coded signal (i.e., the low-band signal or low-frequency component) is narrow, so it becomes increasingly important to regenerate high-band signals (i.e., high-frequency components) with perceptually pleasing characteristics. The harmonic transposition defined in WO 98 / 57436 works well for complex musical content in situations with low crossover frequencies, i.e., when the upper frequency limit of the low-band signal is low. The principle of harmonic transposition is to map or correspond a sine wave of frequency ω to a sine wave of frequency Tω, where T>1 is an integer specifying the transposition order (i.e., the transposition degree). In contrast, HFR using single band modulation (SSB) maps a sine wave of frequency ω to a sine wave of frequency ω + Δω, where Δω is a constant frequency shift. For low-bandwidth core signals (i.e., low-band signals with a low upper frequency limit), SSB transposition typically introduces dissonant ringing artifacts, which is a disadvantage compared to harmonic transposition.

[0003] To achieve improved audio quality and synthesize the necessary bandwidth for highband signals, harmonic HFR methods typically use several orders of transposition. To implement multiple transpositions of various transposition orders, conventional methods require multiple filter banks in the analysis stage, the synthesis stage, or both. Typically, a different filter bank is required for each different transposition order. When the core waveform coder operates at a lower sampling rate than the sampling rate of the final output signal, there is typically an additional requirement to convert the core signal to the sampling rate of the output signal. Such upsampling of the core signal is usually performed by adding yet another filter bank. Therefore, the computational burden increases significantly with the number of different transposition orders. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Publication No. 98 / 57436 Summary of the Invention [Problem to be solved by the invention]

[0005] An object of the embodiment is to at least alleviate the conventional problem that the computational load becomes significantly heavier as the number of different transposition orders increases. [Means for solving the problem]

[0006] In one embodiment, the system comprises: 1. A system configured to generate high frequency components of a signal from low frequency components of the signal, comprising: an analysis filterbank configured to provide a set of analysis subband signals from the low frequency components of the signal, the set of analysis subband signals including at least two analysis subband signals; a non-linear processing unit configured to determine a set of synthesis subband signals from the set of analysis subband signals, the non-linear processing unit being configured to determine an n-th synthesis subband signal from the set of synthesis subband signals from a k-th analysis subband signal and a (k+1)-th analysis subband signal of the set of analysis subband signals, the phase of the n-th synthesis subband signal being determined as the sum of the phase of the k-th analysis subband signal scaled by a first integer phase multiplier and the phase of the (k+1)-th analysis subband signal scaled by a second integer phase multiplier, the first and second integer phase multipliers being different; a synthesis filter bank configured to generate high frequency components of the signal based on the set of synthesis subband signals; It is a system having the following. [Brief explanation of the drawings]

[0007] [Figure 1] A diagram showing an example of processing by a first-order frequency domain (FD) harmonic transposer. [Figure 2] A diagram showing an example of processing by a harmonic transposer using multiple orders. [Figure 3] FIG. 1 shows a conventional example of a harmonic transposer that uses multiple orders of transposition while using a common analysis filter bank. [Figure 4] FIG. 1 shows a conventional example of a harmonic transposer that utilizes multiple transposition orders while using a common synthesis filter bank. [Figure 5] FIG. 10 shows an example of a harmonic transposer process using multiple transposition orders while using a common analysis filter bank and a common synthesis filter bank. [Figure 5b] 6 is a diagram showing an example of mapping of subband signals to the multiple transposers shown in FIG. 5. [Figure 5c] 6 is a diagram showing an example of mapping of subband signals to the multiple transposers shown in FIG. 5. [Figure 6] FIG. 1 illustrates a first embodiment of harmonic transposition using multiple orders of transposition in an HFR enhanced audio codec. [Figure 7] FIG. 7 is a diagram showing an example of performing subsampling in the example of FIG. 6. [Figure 8] FIG. 10 illustrates a second embodiment of harmonic transposition using multiple orders of transposition in an HFR enhanced audio codec. [Figure 9] FIG. 9 is a diagram showing an example of performing subsampling in the example of FIG. 8. [Figure 10] FIG. 10 illustrates a third embodiment of harmonic transposition using multiple orders of transposition in an HFR enhanced audio codec. [Figure 11] FIG. 11 is a diagram showing an example of performing subsampling in the example of FIG. 10. [Figure 12a] 1A and 1B illustrate the effect of harmonic transposition on a signal in the frequency domain. [Figure 12b] FIG. 1 illustrates a method for combining overlapping and non-overlapping transposed signals. [Figure 12c] FIG. 1 illustrates a method for combining overlapping and non-overlapping transposed signals. [Figure 13] 1 shows the effect of harmonic transposition of order T=2 when additional subsampling is performed on a frequency domain signal. [Figure 14] 1 shows the effect of harmonic transposition of order T=3 when additional subsampling is performed on a frequency domain signal. [Figure 15] Diagram showing the effect of harmonic transposition of order T=P when additional subsampling is performed on a frequency domain signal (non-overlapping case). [Figure 16] Diagram showing the effect of harmonic transposition of order T=P when additional subsampling is performed on a frequency domain signal (in the overlapping case). [Figure 17]FIG. 1 illustrates an example layout of a maximally decimating (i.e., fully sampled) transposer building block. DETAILED DESCRIPTION OF THE INVENTION

[0008] The present invention provides a method for reducing the complexity of harmonic HFR methods by allowing pairs of analysis and synthesis filter banks to be shared by multiple harmonic transposers, or by using one or more harmonic transposers and upsamplers. The proposed frequency domain transposition involves mapping nonlinearly modified subband signals from the analysis filter bank to selected subbands of the synthesis filter bank. The nonlinear processing on the subband signals involves phase multiplication, which increases the signal multiplication factor by a factor of several. Furthermore, the present invention provides several ways to reduce the complexity of HFR systems.

[0009] In one embodiment, a system for generating high frequency components of a signal from low frequency components of the signal is described. The system includes an analysis filterbank that provides a set of analysis subband signals, typically including at least two analysis subband signals, from the low frequency components of the signal. The synthesis filterbank has a frequency resolution of Δf and a frequency resolution of L A analysis subbands, and L A >1, and the index k of the analysis subbands is k=0,...,L A-1 In particular, the analysis filterbank provides a set of complex analysis subband signals having magnitude samples and phase samples.

[0010] The system further comprises a nonlinear processing unit for determining a set of synthesis subband signals from the set of analysis subband signals using a certain transposition order P, where the set of synthesis subband signals typically comprises portions of the set of analysis subband signals whose phases have been shifted by an amount derived from the transposition order P. In other words, the set of synthesis subband signals is determined based on portions of the set of analysis subband signals whose phases have been shifted by an amount derived from the transposition order P. The phase shift of the analysis subband signals may be performed by multiplying phase samples of the analysis subband signals by an amount derived from the transposition factor P. In this case, the set of synthesis subband signals corresponds to a part or subset of the set of analysis subband signals, and the phases of the subband samples have been multiplied by an amount derived from the transposition order. In particular, the amount derived from the transposition order may be a fraction of the transposition order.

[0011] The system includes a synthesis filter bank with a frequency resolution of FΔf that generates high frequency components of a signal from a set of synthesis subband signals, where F≧1 is a resolution factor, and the synthesis filter bank is L S synthesis subbands, and L S >1, and the synthesis subband index n is n=0,...,L S -1. The transposition order P is different from the resolution factor F. The analysis filter bank has an analysis time stride Δt A The synthesis filter bank uses a synthesis time width (synthesis time stride) Δt S Using the analysis time interval Δt A and the composite time width Δt S may be equal.

[0012] Based on an analysis subband signal belonging to a set of analysis subband signals whose phases are shifted by a transposition order P, or a pair of analysis subband signals in a set of synthesis subband signals, the nonlinear processing unit determines a synthesis subband signal of the set of subband signals, where a first member of the pair of subband signals has a phase shifted by a factor P' and a second member of the pair of subband signals has a phase shifted by a factor P", where P'+P"=P. The above processing may be performed on samples of the synthesis and analysis subband signals. In other words, samples of the analysis subband signal may be determined based on samples of the analysis subband signals whose phases are shifted by the transposition order P, or based on sample pairs from a corresponding pair of analysis subband signals, where the first sample of the sample pair has a phase shifted by the factor P' and the second sample of the sample pair has a phase shifted by the factor P".

[0013] The nonlinear processor determines an nth synthesis subband signal from a combination of a kth analysis subband signal from the group of analysis subband signals and an adjacent (k+1)th analysis subband signal. In particular, the nonlinear processor determines the phase of the nth synthesis subband signal as the sum of the phase shift of the kth analysis subband signal and the phase shift of the (k+1)th analysis subband signal. Alternatively or additionally, the nonlinear processor determines the magnitude of the nth synthesis subband signal as the product of the magnitude in exponential notation of the kth analysis subband signal and the magnitude in exponential notation of the (k+1)th analysis subband signal.

[0014] The analysis subband index k of an analysis subband signal contributing to the synthesis subband together with the synthesis subband index n may be given by an integer obtained by truncating (F / P)n. The remainder r of the truncation process is given by (F / P)nk. In this case, the nonlinear processor may determine the phase of the nth synthesis subband signal as the sum of the phase of the kth analysis subband signal shifted by P(1-r) and the phase of the (k+1)th analysis subband signal shifted by P(r). In particular, the nonlinear processor may determine the phase of the nth synthesis subband signal as the sum of the phase of the kth analysis subband signal multiplied by P(1-r) and the phase of the (k+1)th adjacent analysis subband signal multiplied by P(r). Alternatively or additionally, the nonlinear processor may determine the magnitude of the nth synthesis subband signal as the product of the (1-r)th power of the magnitude in exponential notation of the kth analysis subband signal and the rth power of the magnitude in exponential notation of the (k+1)th analysis subband signal.

[0015] In one embodiment, the analysis filter bank and the synthesis filter bank are set at integer multiple positions, and the center frequencies of the analysis subbands are given by kΔf and the center frequencies of the synthesis subbands are given by nFΔf. In another embodiment, the analysis filter bank and the synthesis filter bank are set at half-integer multiple positions, and the center frequencies of the analysis subbands are given by (k+(½))Δf and the center frequencies of the synthesis subbands are given by (n+(½))FΔf, and the difference between the transposition order P and the resolution factor F may be even.

[0016] In another embodiment, a system for generating high frequency components of a signal from low frequency components of the signal is described, the system including an analysis filterbank providing a set of analysis subband signals, the set including at least two analysis subband signals, from the low frequency components of the signal.

[0017] The system includes a first nonlinear processing unit that determines a first set of synthesis subband signals from a set of analysis subband signals using a first transposition order P1, where the first set of synthesis subband signals is determined based on a portion of the set of analysis subband signals that has been phase-shifted by an amount derived from the first transposition order P1. The system includes a second nonlinear processing unit that determines a second set of synthesis subband signals from the set of analysis subband signals using a second transposition order P2, where the second set of synthesis subband signals is determined based on a portion of the set of analysis subband signals that has been phase-shifted by an amount derived from the second transposition order P2, where the first transposition order P1 and the second transposition order P2 are different. The first and second nonlinear processing units may be constructed according to any of the features and aspects described herein.

[0018] The system may combine the first and second sets of synthesis subband signals to generate a combined set of synthesis subband signals. Such combination may be performed, for example, by combining (e.g., adding and / or averaging) synthesis subband signals in the first and second sets that correspond to the same frequency range. In other words, the combiner is configured to overlap synthesis subband signals in the first and second sets that correspond to overlapping frequency ranges. The system may further include a synthesis filter bank that generates high-frequency components of the signal from the combined set of synthesis subband signals.

[0019] In another embodiment, a system for generating high-frequency components of a signal from low-frequency components of the signal is described. The system includes an analysis filter bank having a frequency resolution of Δf. The analysis filter bank provides a set of analysis subband signals from the low-frequency components of the signal. The system includes a nonlinear processor for determining an intermediate set of synthesis subband signals having a frequency resolution of PΔf from the set of analysis subband signals using a transposition order P. The intermediate set of synthesis subband signals includes portions of the set of analysis subband signals that have been phase-shifted by the transposition order P. In particular, the nonlinear processor multiplies the phases of the complex analysis subband signals by the transposition order. It should be noted that the transposition order P may be, for example, the transposition order P, P1, or P2, as described above.

[0020] The nonlinear processing unit interpolates one or more intermediate synthesis subband signals to determine a set of synthesis subband signals having a frequency resolution of FΔf, where F is a resolution factor, F≧1. In one embodiment, two or more intermediate synthesis subband signals are interpolated. The transposition order P may be different from the frequency resolution F.

[0021] The system includes a synthesis filter bank with a frequency resolution of FΔf, which generates the high frequency components of the signal from a set of synthesis subband signals.

[0022] The system described herein further comprises a core decoder for converting the encoded bitstream into low-frequency components of the signal, which may be based on any of the following encoding formats: Dolby E, Dolby Digital, AAA, and HE-AAC. The system comprises a multi-channel analysis quadrature mirror filter (QMF) bank, which converts high-frequency and / or low-frequency components into a plurality of QMF subband signals, and / or the system comprises a high-frequency reconstruction processing module for modifying the QMF subband signals, and / or the system comprises a synthesis QMF bank for generating modified high-frequency components from the modified QMF subband signals. The system comprises a downsampling unit upstream of the analysis filter bank for reducing the sampling rate of the low-frequency components of the signal and outputting the low-frequency components at the reduced sampling rate.

[0023] In another embodiment, a system for generating a high-frequency component of a signal having a second sampling frequency from a low-frequency component of the signal having a first sampling frequency is described. In particular, the signal including the low-frequency component and the high-frequency component may be at the second sampling frequency. The second sampling frequency is R times the first sampling frequency, where R≧1. The system includes a T-th order harmonic transposer for generating a modulated high-frequency component from the low-frequency component, the modulated high-frequency component being determined based on a spectral portion of the low-frequency component transposed to a T-times higher frequency range. The modulated high-frequency component is the first sampling frequency multiplied by a factor S, where T>1 and S≦R. In other words, the modulated high-frequency component may be at a sampling frequency lower than the second sampling frequency. In particular, the modulated high-frequency component may be critically (or near-critically) sampled.

[0024] The system includes a QMF bank that maps the modulated high-frequency components to at least one of X QMF subbands, where X is a multiple of S, to provide at least one QMF subband signal; and / or a high-frequency reconstruction module that modifies the at least one QMF subband signal (e.g., scales one or more QMF subband signals); and / or a synthesis QMF bank that generates high-frequency components from the modified at least one QMF subband signal.

[0025] A harmonic transposer may have any of the above features and may be configured to perform any of the methods described herein. In particular, the harmonic transposer may include an analysis filter bank that provides a set of analysis subband signals from low-frequency components of a signal. The harmonic transposer may include a nonlinear processor with transposition order T that determines a set of synthesis subband signals from the set of analysis subband signals by modifying the phases of the set of analysis subband signals. As described above, the phase modification may involve multiplying the phases of complex samples of the analysis subband signals. The harmonic transposer may include a synthesis filter bank that generates modulated high-frequency components of the set of synthesis subband signals from the set of synthesis subband signals.

[0026] The low-frequency component has a bandwidth that is B. The harmonic transposer generates a group of composite sub-band signals within the frequency range of (T-1)*B to T*B. In that case, the harmonic transposer modulates a group of composite sub-band signals to a baseband centered near zero frequency to generate a modulated high-frequency component. Such modulation may be performed by high-pass filtering a time-domain signal generated from a group of sub-band signals including a group of composite sub-band signals, and modulating and / or time-sampling the filtered time-domain signal. Alternatively or additionally, such modulation may be performed by directly generating a modulated time-domain signal from a group of composite sub-band signals. This may be performed using a composite filter bank smaller than the normal size. If the composite filter bank has a normal size of L and the frequency range of (T-1)*B to T*B corresponds to the composite sub-band indices of k0 to k1, the composite sub-band signals may be mapped to the sub-band indices of 0 to k1-k0 in a composite filter bank of size k1-k0 (<L), that is, the composite filter bank has a size of k1-k0 narrower than L.

[0027] This system further has downsampling means upstream of the harmonic transposer, and the downlink sampling means provides a low-frequency component critically (or in a way close to critical) downsampled by a first sampling frequency divided by the downsampling factor Q from the low-frequency component of the signal. In this case, various sampling frequencies in the system may be divided by the downsampling factor Q. In particular, the modulated high-frequency component may be the first sampling frequency multiplied by the factor S and divided by the downsampling factor Q. X, which is the size of the analysis QMF bank, may be S / Q.

[0028] In another embodiment, a method for generating high-frequency components of a signal from low-frequency components of the signal is also described. The method includes providing a set of analysis subband signals, including at least two analysis subband signals, from the low-frequency components of the signal using an analysis filterbank having a frequency resolution of Δf. The method further includes determining a set of synthesis subband signals from the set of analysis subband signals using a transposition order P. The set of synthesis subband signals is determined based on portions of the set of analysis subband signals that have been phase-shifted by an amount derived from the transposition order P. The method further includes generating high-frequency components of the signal from the set of synthesis subband signals using a synthesis filterbank having a frequency resolution of FΔf, where F≧1, F is a resolution factor, and the transposition order P is different from the resolution factor F.

[0029] In another embodiment, a method for generating high-frequency components of a signal from low-frequency components of the signal is also described. The method includes providing a set of analysis subband signals from the low-frequency components of the signal, the set including at least two analysis subband signals. The method includes determining a first set of synthesis subband signals from the set of analysis subband signals using a first transposition order P1. The first set of synthesis subband signals is determined based on portions of the set of analysis subband signals that have been phase-shifted by an amount derived from the first transposition order P1. The method further includes determining a second set of synthesis subband signals from the set of analysis subband signals using a second transposition order P2. The second set of synthesis subband signals is determined based on portions of the set of analysis subband signals that have been phase-shifted by an amount derived from the second transposition order P2. The first transposition order P1 and the second transposition order P2 are different. The first and second sets of composite subband signals are combined to generate a combined set of composite subband signals from which high frequency components of the signal are generated.

[0030] In another embodiment, a method for generating high-frequency components of a signal from low-frequency components of the signal is also described. The method includes providing analysis subband signals having a frequency resolution of Δf from the low-frequency components of the signal. The method further includes determining an intermediate set of synthesis subband signals having a frequency resolution of PΔf from the set of analysis subband signals using a transposition order P. The intermediate set of synthesis subband signals includes portions of the set of analysis subband signals phase-shifted by the transposition order P. One or more of the intermediate synthesis subband signals are interpolated to determine a set of synthesis subband signals having a frequency resolution of FΔf, where F is a resolution factor, F≧1. The transposition order P may be different from the frequency resolution F. The high-frequency components of the signal are generated from the set of synthesis subband signals.

[0031] In yet another embodiment, a method is described for generating a high frequency component of a signal having a second sampling frequency from a low frequency component of the signal having a first sampling frequency, the second sampling frequency being R times the first sampling frequency, where R≧1. The method includes generating a modulated high frequency component from the low frequency component by performing a harmonic transposition of order T. The modulated high frequency component is determined based on a portion of the low frequency component transposed to a T-times higher frequency range, the modulated high frequency component being the first sampling frequency multiplied by a factor S, where T>1 and S <Rである。

[0032] In another embodiment, a set-top box for decoding a received signal including at least a signal is also described, the set-top box having a system for generating high-frequency components of the signal from low-frequency components of the signal, the system including any aspect and / or feature described herein.

[0033] Alternatively, a software program is also described which, when executed on a computing device, causes a processor to perform any of the aspects and methods described herein.

[0034] In yet another aspect, a storage medium is also described that stores a software program that, when executed on a computing device, causes a processor to perform features of any of the aspects and methods described herein.

[0035] In another aspect, a computer program product is also described, which comprises instructions that, when executed on a computing device, cause the computer to carry out any of the aspects and methods described herein.

[0036] It should be noted that the examples and embodiments described in this application may be combined in any manner. In particular, examples and embodiments described in relation to a system may be applied to the corresponding method, and vice versa. Furthermore, it should be noted that the disclosure of this application also encompasses combinations of claims other than those explicitly set forth as dependent claims (i.e., the claims and their technical features may be combined in any order and in any manner). [Example]

[0037] Hereinafter, examples of the present invention will be described with reference to the accompanying drawings, which do not limit the scope of the present invention.

[0038] The examples described below are merely illustrative of the principles of the present invention for efficient synthesized harmonic transposition. It will be understood that variations and modifications to the described embodiments and specific details will be apparent to those skilled in the art. It is therefore important to note that the present invention is defined solely by the appended claims, and not by the specific details presented in the following description and discussion.

[0039] FIG. 1 illustrates an example of a first-order frequency-domain (FD) harmonic transposer 100. In its basic form, a T-th order harmonic transposer is, theoretically, a device that transposes (shifts) all signal components of an input signal to a frequency T times higher. To perform such processing in the frequency domain, an analysis filter bank (or transformer) 101 transforms the input signal from the time domain to the frequency domain and outputs complex subbands or subband signals, referred to as analysis subbands or analysis subband signals. The analysis subband signals are applied to a nonlinear processor 102, which modifies or adjusts their phase and / or amplitude according to a selected transposition order T. Typically, the nonlinear processor outputs a number of subband signals, which is equal to the number of input subband signals, i.e., the number of analysis subband signals. However, for advanced nonlinear processors, it may be desirable to output a number of subband signals different from the number of input subband signals. In particular, two subband signals may be processed by the nonlinear processor to generate one output subband signal, as will be described in more detail below. The modified subbands or subband signals, referred to as analysis subbands or synthesis subband signals, are applied to a synthesis filter bank 103 (transformer) which transforms the subband signals from the frequency domain to the time domain and outputs a transposed time domain signal.

[0040] Typically, each filter bank has a physical frequency resolution expressed in hertz and a time stride parameter expressed in seconds. These two parameters (i.e., frequency resolution and time stride) define the discrete-time parameters of the filter bank at a selected sampling rate. By selecting the physical time stride parameters (i.e., the time stride parameters measured in time units, e.g., seconds) of the analysis and synthesis filter banks to match, the output signal of the transposer 100 has the same sampling rate as the input signal. Furthermore, by omitting the nonlinear processing unit 102, perfect reconstruction of the input signal at the output is achieved. This requires careful design of the analysis and synthesis filter banks. On the other hand, if the output sampling rate is selected to be different from the input sampling rate, a sampling rate conversion is performed. This mode of operation is necessary, for example, when applying a signal transposition in which the desired output bandwidth is greater than half the input sampling rate, i.e., when the desired output bandwidth exceeds the Nyquist frequency of the input signal.

[0041] 2 illustrates an example of a multiple transposer system 200 including multiple harmonic transposers 201-1,...,201-P of different orders. An input signal to be transposed is applied to a bank of P individual transposers 201-1, 201-2,...,201-P. Each individual transposer 201-1, 201-2,...,201-P performs a harmonic transposition of the input signal as described in connection with FIG. 1. Typically, each individual transposer 201-1, 201-2,...,201-P performs a harmonic transposition of a different transposition order T. As an example, transposer 201-1 may perform a transposition of order T=1, transposer 201-2 may perform a transposition of order T=2, and transposer 201-P may perform a transposition of order T=P. The results, ie, the output signals from the individual transposers 201-1, 201-2, . . . , 201-P, are summed in a combining section, summing section, or combiner 202 to produce a summed transposer output.

[0042] It should be noted that each of transposers 201-1, 201-2, ..., 201-P requires an analysis and synthesis filter bank as shown in FIG. 1. Furthermore, each transposer 201-1, 201-2, ..., 201-P typically changes the sampling rate of the input signal being processed by a different amount. As an example, the sampling rate of the output signal of transposer 201-1 is P times higher than the sampling rate of the input signal to transposer 201-P. This is due to the bandwidth expansion factor P used in transposer 201-P, i.e., the use of a synthesis filter bank with P times more subchannels than the analysis filter bank. To achieve this, the sampling rate and Nyquist frequency are increased by a factor P. As a result, the individual time-domain signals need to be resampled to enable the synthesis unit 202 to combine the various output signals. Resampling of the time domain signal can be performed on the input signal or the output signal for each individual transposer 201-1, 201-2, . . . , 201-P.

[0043] FIG. 3 illustrates an example of a multiple harmonic transposer or multiple transposer system 300 that uses a common analysis filter bank to perform transpositions of various orders. The initial design stage for the multiple transposer 300 involves designing each of the individual transposers 201-1, 201-2, ..., 201-P in FIG. 2 so that the analysis filter banks (reference numeral 101 in FIG. 1) of all transposers 201-1, 201-2, ..., 201-P are identical and can be replaced by a single analysis filter bank 301. As a result, the time-domain input signal is transformed into a single set of frequency-domain subband signals (i.e., a single set of analysis subband signals). These subband signals are then applied to various nonlinear processors 302-1, 302-2, ..., 302-P in preparation for transpositions of various orders. As described with respect to FIG. 1, the nonlinear processors include phase and / or amplitude modifications of the subband signals, which are different for different transposition orders. Thus, the differently modified subband signals or subbands are respectively applied to different synthesis filter banks 303-1, 303-2, ..., 303-P corresponding to different nonlinear processing units 302-1, 302-2, ..., 302-P, resulting in different transposed time-domain output signals which are summed in the synthesis unit 304 to obtain the summed transposer output.

[0044] It should be noted that if the synthesis filter banks 303-1, 303-2, ..., 303-P corresponding to different transposition orders operate at different sampling rates, e.g., by utilizing different bandwidth extensions, the time-domain output signals of the different synthesis filter banks 303-1, 303-2, ..., 303-P need to be resampled differently in order to align the P output signals to the same time unit or time grid before being summed in the synthesis unit 304.

[0045] FIG. 4 shows an example of a multi-harmonic transposer system 400 employing multiple transposition orders using a common synthesis filter bank 404. In the initial design phase of the multiple transposers 400, the individual transposers 201-1, 201-2, ..., 201-P in FIG. 2 are designed so that the synthesis filter banks of all transposers are identical and can be replaced by a single synthesis filter bank 404. Note that, as in the example shown in FIG. 3, the nonlinear processors 402-1, 402-2, ..., 402-P are different for each transposition order. Furthermore, the analysis filter banks 401-1, 401-2, ..., 401-P are different for different transposition orders. Thus, a set of P analysis filter banks 401-1, 401-2, ..., 401-P determines P sets of analysis subband signals. These P sets of analysis subband signals are applied to corresponding nonlinear processors 402-1, 402-2, ..., 402-P, which output P sets of modified subband signals. These P sets of subband signals are combined in the frequency domain in a combiner 403, which outputs the combined set of subband signals as input to a single synthesis filter bank 404. The signal combination in the combiner 403 involves combining differently processed subband signals into different subband ranges and / or superimposing the contributions of subband signals into overlapping subband ranges. In other words, the various analysis subband signals processed with different transposition orders cover overlapping frequency ranges. In that case, the individual contributions of the superposition are combined (i.e., added and / or averaged) by the combiner 403. The time-domain output signals of the multiple transposers 400 are obtained from a common synthesis filter bank 404. Similar to the above, if the analysis filter banks 401-1, 401-2, ..., 401-P operate at different sampling rates, the time-domain signals input to the various analysis filter banks 401-1, 401-2, ..., 401-P need to be resampled to align the output signals of the various nonlinear processing units 402-1, 402-2, ..., 402-P to the same time units.

[0046] 5 shows an example of a multi-harmonic transposer system 500 using multiple transposition orders, including one common analysis filter bank 501 and one common synthesis filter bank 504. In this case, each transposer 201-1, 201-2, ..., 201-P in FIG. 2 is designed so that both the analysis filter bank and the synthesis filter bank of the P harmonic transposers are the same. If the conditions for the same analysis and synthesis filter bank for the P different harmonic transposers are met, the same filter bank can be replaced by one analysis filter bank 501 and one synthesis filter bank 504. The advanced nonlinear processors 502-1, 502-2, ..., 502-P output various contributions that are combined in a synthesis unit 503, which generates combined inputs for each subband of the synthesis filter bank 504. Similar to the multi-harmonic transposer 400 shown in FIG. 4, the signal synthesis in the synthesis unit 503 involves feeding the differently processed signals of the nonlinear processing units 502-1, 502-2, ..., 502-P into various subband ranges and superimposing the contributing outputs into overlapping subband ranges.

[0047] As mentioned above, the nonlinear processing unit 102 typically provides a number of subbands at its output that corresponds to the number of subbands at its input. The nonlinear processing unit 102 typically modifies the phase and / or amplitude of the subbands or subband signals according to the transposition order T used. As an example, the subbands at the input are transformed into subbands that are T times higher in frequency at the output, i.e., subbands in the range [(k-(1 / 2))Δf, (k+(1 / 2))Δf] at the input to the nonlinear processing unit 102 (analysis subbands) are transformed into subbands in the range [(k-(1 / 2))TΔf, (k+(1 / 2))TΔf] at the output of the nonlinear processing unit 102 (synthesis subbands), where k is the subband index number and Δf is the frequency resolution of the analysis filter bank. To allow for the use of a common analysis filterbank 501 and a common synthesis filterbank 504, one or more of the advanced processing units 502-1, 502-2, ..., 502-P are configured to provide a number of output subbands that differs from the number of input subbands. In one embodiment, the number of input subbands for the advanced processing units 502-1, 502-2, ..., 502-P is approximately F / T times the number of output subbands, where T is the transposition order of the advanced processing unit and F is a filter bank resolution factor that will be introduced below.

[0048] The principles of the advanced processing units 502-1, 502-2, ..., 502-P with respect to the nonlinear processing units 502-1, 502-2, ..., 502-P will be explained below. For this purpose, the following assumptions are made.

[0049] ●The analysis filter bank and the synthesis filter bank share the same physical time stride parameter Δt.

[0050] The analysis filter bank has a physical frequency resolution Δf.

[0051] ●The synthesis filter bank has a physical frequency resolution FΔf, where the resolution factor F is an integer greater than or equal to 1 (F≧1).

[0052] Furthermore, it is assumed that the filter banks are evenly spaced or at integer multiples, i.e., the subband with index 0 is centered around zero frequency, and the center frequency of the analysis filter bank is given by kΔf, where the analysis subband index k is k=0, 1,...,L A -1, and L A is the number of subbands in the analysis filter bank. The center frequency of the synthesis filter bank is given by nFΔf, and the synthesis subband index n is n=0,1,...,L s -1, and L s is the number of subbands in the synthesis filter bank.

[0053] When performing a conventional transposition of order T≧1 as shown in FIG. 1, the resolution factor F is chosen to be F=T, and the analysis subband k of the nonlinear processing unit is mapped to the analysis subband of the same index n=k. The nonlinear processing unit 102 typically multiplies the phase of the subband or subband signal by a factor T, i.e., for each sample of a subband of the filter bank, it can be written as: θ s (k)=Tθ A (k) (1) θ A (k) is the phase of the sample in analysis subband k, and θ s (k) is the phase of the sample of synthesis subband k. The magnitude or amplitude of the sample of the subband may be left unmodified or may be increased or decreased by a constant gain factor. Since T is an integer, the treatment of equation (1) does not depend on the definition of the phase angle.

[0054] When the resolution factor F is equal to the transposition order T (i.e., F=T), the frequency resolution (i.e., FΔf) of the synthesis filter bank depends on the transition order T. Therefore, it is necessary to use different transposition orders T for different filter banks in the analysis or synthesis processing stages. This is because the transposition order T determines the degree of physical frequency resolution, i.e., the degree of frequency resolution Δf of the analysis filter bank and the frequency resolution FΔf of the synthesis filter bank.

[0055] In order to be able to use a common analysis filter bank 501 and a common synthesis filter bank 504 for several different transposition orders T, it is proposed in this application to set the frequency resolution of the synthesis filter bank to FΔf, i.e. to make the frequency resolution of the synthesis filter bank 504 independent of the transposition order T. Therefore, the question arises as to how to perform a transposition of order T when the resolution factor F, which indicates the degree of physical frequency resolution of the analysis and synthesis filter banks, does not necessarily obey the relationship F=T.

[0056] As explained above, according to the harmonic transposer principle, the input to a synthesis filter bank subband n with a center frequency nFΔf is determined by an analysis subband at a center frequency 1 / T times lower (nFΔf / T). The center frequency of the analysis subband is specified as kΔf using the analysis subband index k. Both expressions of the center frequency of the analysis subband index (i.e., nFΔf / T and kΔf) are equal (may correspond). Considering that n is an integer, the rational expression nF / T can be expressed as the sum of the integer analysis subband index k and the remaining part r (r∈{0, 1 / T, 2 / T, ..., (T-1) / T}) as follows: nF / T=k+r (2) Therefore, it is guaranteed that the input to the synthesis subband with synthesis subband index n is derived from the analysis subband or subband k with index given by equation (2) using a transposition of order T. Since nF / T is a rational number, the remainder r is not equal to 0, and the value k+r is greater than the analysis subband index k and less than the analysis subband index k+1. Therefore, the input to the synthesis subband with synthesis subband index n is derived from the analysis subband with analysis subband index k and k+1 using a transposition of order T, where k is given by equation (2).

[0057] As a result of the above analysis, the advanced nonlinear processing performed in the nonlinear processing units 502-1, 502-2, ..., 502-P generally involves considering two adjacent analysis subbands of index k and k+1, which contribute their output to a synthesis subband n. For a transposition order T, the phase adjustment performed by the nonlinear processing units 502-1, 502-2, ..., 502-P may therefore be determined by the following linear interpolation method: θ s (n)=T(1-r)θ A (k)+Trθ A (k+1) (3) where θ A (k) is the phase of the sample in analysis subband k, and θ A (k+1) is the phase of the sample in analysis subband k+1, and θ s where (k) is the phase of the samples in synthesis subband n. That is, when the remainder r is close to 0, the value of k+r is close to k, in which case the main contribution to the phase of the samples in the synthesis subband comes from the phase of the samples in the analysis subband of subband k. On the other hand, when the remainder r is close to 1, the value of k+r is close to k+1, in which case the main contribution to the phase of the samples in the synthesis subband comes from the phase of the samples in the analysis subband of subband k+1. Note that both the phase multiplication factors T(1-r) and Tr are integers so that the phase adjustment in equation (3) is well-defined and independent of the definition of the phase angle.

[0058] Taking into account the magnitude of the subband samples, the following geometric mean values ​​are selected to determine the magnitude of the composite subband samples: a S (n)=a A (k) (1-r) a A (k+1) r (4) a S (n) denotes the sample size of synthesis subband n, and a A (k) indicates the sample size of the analysis subband, and a A (k+1) denotes the sample size of analysis subband k+1.

[0059] If the filter bank is arranged at half-integer multiple positions (oddly), the center frequency of the analysis filter bank is given by (k+(1 / 2))Δf, where k=0,1,...,L A -1, and the center frequency of the synthesis filter bank is given by (n+(1 / 2))FΔf, where n=0,1,...,L S -1, and the corresponding equation to equation (2) above is derived by equating the center frequency of the transposed synthesis filter bank (n+(1 / 2))FΔf / T with the center frequency of the analysis filter bank (k+(1 / 2))Δf. Considering an integer index k and a remainder r∈[0,1], the following equation is derived for filter banks at half integer multiples: (n+(1 / 2))F / T=k+1 / 2+r (5) It can be seen that if TF, i.e., the difference between the transposition order and the resolution factor, is even, then T(1-r) and Tr are both integers, and the interpolation formulas of equations (3) and (4) can be used.

[0060] FIG. 5b illustrates how analysis subbands are mapped to synthesis subbands. FIG. 5b shows four example mappings for four different transposition orders, T=1 through T=4. Each diagram shows how source bins 510 (i.e., analysis subbands) are mapped to target bins 530 (i.e., synthesis subbands). For ease of illustration, the resolution factor F is assumed to be 1. In other words, FIG. 5b illustrates how analysis subband signals are mapped to synthesis subband signals using equations (2) and (3). In the illustrated example, with F=1 and a maximum transposition order P=4, the analysis / synthesis filter banks are configured evenly.

[0061] For the illustrated example, equation (2) can be written as n / T=k+r. Thus, for a transposition order T=1, the analysis subband with index k is mapped to the corresponding synthesis subband n, with the remainder r being zero. This is shown in Figure 5b, where source bins 511 are mapped one-to-one to target bins 531.

[0062] For a transposition order T=2, the remainder r takes values ​​of 0 and 1 / 2, and a source bin corresponds to multiple target bins. Looking at it from the other perspective, each of target bins 532 and 535 receives contributions from at most two source bins. This is illustrated in FIG. 5b, where target bin 535 receives contributions from source bins 512 and 515. However, target bin 532 receives a contribution only from source bin 512. If target bin 535 has an even index n (e.g., n=10), equation (2) indicates that target bin 532 receives a contribution from source bin 512 with index k=n / 2 (i.e., k=5). In this case, the remainder r is zero, i.e., there is no contribution from source bin 515 with index k+1 (i.e., k+1=6). For target bin 535 with odd index n (e.g., n=11), the situation changes. In this case, equation (2) indicates that target bin 535 receives contributions from source bin 512 (index k=5) and source bin 515 (index k+1=6), and this is also true for higher transposition orders T (e.g., T=3 and T=4 as shown in FIG. 5b).

[0063] For F=2, equation (2) can be written as 2n / T=k+r, which is shown in Figure 5c. For transposition order T=2, the analysis subband with index k is mapped to the corresponding synthesis subband n, and the remainder r is always zero. This can be seen from the one-to-one mapping of source bins 521 to target bins 514.

[0064] For a transposition order T=3, the remainder r takes values ​​of 0, 1 / 3, and 2 / 3, and a source bin corresponds to multiple target bins. Looking at it from the other side, each of target bins 542 and 545 receives contributions from at most two source bins. This is illustrated in FIG. 5c, where target bin 545 receives contributions from source bins 522 and 525. If target bin 545 has index n=8, for example, then equation (2) indicates k=5 and r=1 / 3, indicating that target bin 545 receives contributions from source bin 522 (index k=5) and source bin 525 (index k+1=6). However, for target bin 546 with index n=9, the remainder r becomes zero, and target bin 546 receives contributions only from source bin 525. This is also true for higher transposition orders T (e.g., T=4 as shown in FIG. 5c).

[0065] A further explanation of the above-mentioned advanced nonlinear processing is as follows. The advanced nonlinear processing can be understood as a combination of performing a transposition of a given order T and mapping the transposed subband signals to a frequency grid (i.e., a frequency grid FΔf) defined by a common synthesis filter bank. To explain this interpretation, refer again to FIG. 5b or 5c, where source bins 510 or 520 are synthesis subbands derived from analysis subbands using a transposition order T. These synthesis subbands have a frequency grid given by TΔf. To generate a synthesis subband at a given frequency grid FΔf given by target bins 530 or 540, the source bins 510 or 520 (i.e., a synthesis subband with a frequency grid TΔf) need to be mapped to the given frequency grid FΔf. This is done by interpolating one or more source bins 510 or 520 (i.e., a synthesis subband signal at a frequency grid TΔf) to determine a target bin 530 or 540 (i.e., a synthesis subband signal at a frequency grid FΔf). In a preferred embodiment, linear interpolation is used, with the weight of the interpolation being proportional to the inverse of the difference between the center frequency of the target bin 530 or 540 and the corresponding source bin 510 or 520. As an example, if the difference is zero, the weight is 1, and if the difference is TΔf, the weight is 0.

[0066] In summary, a nonlinear processing method is described that allows for determining the contribution of several analysis subbands to a synthesis subband due to transposition, allowing for the use of a single common analysis and synthesis subband filter bank for various transposition orders, thereby significantly reducing the computational complexity of multiple harmonic transposers.

[0067] Several embodiments of a multi-harmonic transposer or harmonic transposer system are described below. In a typical process for an audio source encoding / decoding system using high frequency reconstruction (HFR) such as SBR (Spectral Band Replication) as disclosed in, for example, WO 98 / 57436, which is incorporated herein by reference, a core decoder (i.e., a decoder of the low-frequency components of the audio signal) outputs a time-domain signal to an HFR module or system (i.e., a module or system that performs reconstruction of the high-frequency components of the audio signal). The low-frequency components have a bandwidth narrower than half the bandwidth of the original audio signal containing low and high-frequency components. Therefore, the time-domain signal containing the low-frequency components, referred to as the low-band signal, may be sampled at half the sampling rate of the final output signal of the audio encoding / decoding system. In this case, the HFR module needs to effectively resample the core signal (i.e., the low-band signal) to twice the sampling frequency to facilitate adding the core signal to the output signal. Therefore, the so-called bandwidth extension factor applied by the HFR module is equal to two.

[0068] After generating the high frequency components, referred to as the HFR-derived signal, the HFR-derived signal is dynamically adjusted to match as closely as possible the high frequency components of the original signal (i.e., the high frequency components of the encoded native signal). This adjustment is typically performed by a so-called HFR processor that utilizes sender information. The sender information includes information about the spectral envelope of the high frequency components of the original signal, and the adjustment of the HFR-derived signal involves adjusting the spectral envelope of the HFR-derived signal.

[0069] To adjust the HFR-generated signal according to the sender's information, the HFR-generated signal is analyzed by a multi-channel Quadrature Mirror Filter (QMF) bank, which provides spectral QMF subband signals of the HFR-generated signal. Then, an HFR processor adjusts the HFR-generated signal on the spectral QMF subband signals obtained from the analysis QMF bank. Finally, the adjusted QMF subband signals are synthesized in the analysis QMF bank. To implement a sampling frequency change, e.g., doubling the sampling frequency from the sampling frequency of the low-band signal to the sampling frequency of the output signal of the audio encoding / decoding system, the number of analysis QMF bands may be different from the number of synthesis QMF bands. In one embodiment, the analysis QMF bank may generate 32 subband signals, and the synthesis QMF bank processor may process 64 QMF subbands, thereby providing a doubled sampling frequency. It should be noted that the analysis and / or synthesis filter banks of a transposer typically generate hundreds of analysis and / or synthesis subbands, providing much higher frequency resolution than a QMF bank.

[0070] An example of a process for generating high-frequency components of a signal is shown in the HFR system 600 of Figure 6. The transmitted bitstream is received by a core decoder 601, which provides the frequency components of a decoded output signal at a sampling frequency fs. The low-frequency components at sampling frequency fs are input to various individual transposers 602-1,...,602-P, each corresponding to a single transposer with transposition order T=2,...,P as shown in Figure 1. The individual transposed signals for T=1,2,...,P are separately applied to specific instances of individual analysis QMF banks 603-1,...,603-P. Note that the low-frequency components are considered to be transposed signals of order T=1. Resampling of the core signal (i.e., resampling of the low-frequency components at sampling frequency fs) is performed by filtering the low-frequency components using a downsampled QMF bank 603-1 (typically having 32 channels instead of 64). The result is 32 subband signals, each with a sampling frequency of fs / 32.

[0071] The effect of a transposition of order T=2 at sampling frequency fs on a signal is represented by a frequency diagram such as that shown in FIG. 12a. Frequency diagram 1210 shows the input signal to transposer 602-2, which has a bandwidth of B Hz. The input signal is divided (partitioned or segmented) into multiple analysis subband signals by the analysis filter bank. This is represented by the segmentation into frequency bands 1211. The analysis subband signals are then transposed (transposed) to a frequency range T=2 times higher, doubling the sampling frequency. The resulting frequency-domain signal is shown in frequency diagram 1220, which has the same frequency scale (one division or unit) as frequency diagram 1210. It can be seen that subband 1211 has been transposed to subband 1221. The transposition process is indicated by the dashed arrow. Furthermore, the periodic spectrum 1222 of the transposed subband signal is shown in frequency diagram 1220. Alternatively, the transposition process may be shown as frequency diagram 1230, where the frequency axis is scaled, i.e., multiplied by a transposition factor T=2. In other words, frequency diagram 1230 corresponds to frequency diagram 1220 on a scale T=2 times larger. Each of subband signals 1231 has twice the bandwidth of segment 1211. This results in an output signal of transposer 602-2 that has a sampling rate T=2 times higher than the input signal (i.e., a sampling rate of 2 fs), while the temporal duration of the signal remains unchanged.

[0072] As shown in FIG. 6 and described above, the output signal of each transposer 602-2 with transposition order T=2 has a sampling frequency of 2fs. To generate QMF subband signals with a sampling frequency of fs / 32, an analysis QMF bank 603-2 with 64 channels should be used. Similarly, the output signal of each transposer 602-P with transposition order T=P has a sampling frequency of Pfs. To generate QMF subband signals with a sampling frequency of fs / 32, an analysis QMF bank 603-2 with 32P channels should be used. If the size (i.e., the number of channels in each analysis QMF bank 603-1, ..., 603-P) is matched to the signal resulting from the corresponding transposer 602-2, ..., 602-P, the subband signals from all instances of the analysis QMF banks 603-1, ..., 603-P have the same sampling frequency. The set of QMF subband signals at sampling frequency fs / 32 is provided to the HFR processing module 604, where the spectrum adjustment of the high frequency components is performed according to the sender information. Finally, the adjusted subband signals are synthesized into a time domain signal by a 64 channel inverse or synthesis QMF bank 605, which can efficiently generate a decoded signal at sampling frequency 2fs from the QMF subband signals sampled at fs / 32.

[0073] As explained above, the transposer modules 602-2, ..., 602-P generate time-domain signals with various sampling rates, such as 2fs, ..., Pfs, respectively. The resampling of the output signals of the transposer modules 602-2, ..., 602-P is performed by "inserting" or discarding subband channels in the corresponding subsequent QMF analysis banks 603-1, ..., 603-P. In other words, the resampling of the output signals of the transposer modules 602-2, ..., 602-P may be performed by using different numbers of QMF subbands in the respective subsequent analysis QMF banks 603-1, ..., 603-P and the synthesis QMF bank 605. Therefore, the output QMF subband signals from the QMF bands 602-2, ..., 602-P must fit into the 64 channels that are ultimately sent to the synthesis QMF bank 605. This adaptation or mapping is performed by mapping or adding the 32 QMF subband signals from the 32-channel analysis QMF bank 603-1 to the first 32 channels (i.e., the 32 lower-frequency channels) of the synthesis or inverse QMF bank 605. In practice, this results in a filtered signal obtained by upsampling the analysis QMF band 603-1 by a factor of 2. All subband signals resulting from the 64-channel analysis QMF bank 603-2 may be directly mapped or added to the 64 channels of the inverse QMF bank 605. In view of the fact that the analysis QMF bank 603-2 is exactly the same size as the synthesis QMF bank 605, the individual signals after transposition are not resampled. The QMF banks 603-3,...,603-P have a larger number of output QMF subband signals than the 64 subband signals. In that case, the 64 lower-frequency channels may be mapped or added to the 64 channels of the synthesis QMF bank 605. The remaining higher-frequency channels may be discarded. As a result of the 32P channel analysis QMF bank 603-P, the signals filtered by the QMF bank 603-P are downsampled by a factor P / 2.This resampling, which depends on the transposition order P, therefore results in all transposed signals having the same sampling frequency.

[0074] In other words, even if the transposer modules 602-2,...,602-P generate time-domain signals with different sampling rates, it is desirable for the subband signals to have the same sampling rate when provided to the HFR processing module 604. This is achieved by using analysis QMF banks 603-3,...,603-P of different sizes, which are typically 32T, where T is the transposition factor or transposition order. Because the HFR processing module 604 and synthesis QMF bank 605 typically operate on 64 subband signals (i.e., twice the size of the analysis QMF bank 603-1), all subband signals resulting from the analysis QMF banks 603-3,...,603-P for subband indices exceeding that number may be discarded. This is done because the output signals of the transposers 602-2,...,602-P effectively cover the frequency range above the Nyquist frequency of the output signals. The remaining subband signals (i.e., the subband signals mapped to the subbands of the synthesis QMF bank 605) may be summed to generate frequency-overlapping transposed signals (see FIG. 12b, described below), or alternatively, combined to obtain non-overlapping transposed signals, as shown, for example, in FIG. 12c (described below). For non-overlapping transposed signals, a transposer 602-T of order T (T=2,...,P) is typically assigned to a specific frequency range, and the transposer 602-T generates frequency components exclusively for that specific frequency range. In one embodiment, the dedicated (individual) frequency range of the transposer 602-T is [(T-1)B,TB], where B is the bandwidth of the input signal to the transposer 602-T. In that case, the synthesized subband signals of the transposer 602-T outside the individual frequency range are ignored or discarded. Alternatively, transposer 602-T may generate frequency components that overlap with frequency components of other transposers 602-2,...,602-P, in which case those overlapping frequency components are superimposed in the QMF subband domain.

[0075] As described above, in an exemplary embodiment, multiple transposers 602-2,...,602-P are used to generate the high-frequency components of the output signal of the HFR module 600. It is assumed that the input signals to the transposers 602-2,...,602-P (i.e., the low-frequency components of the output signal) have a bandwidth of B Hz and a sampling rate of fs, and the output signal of the HFR module 600 has a sampling rate of 2fs. Thus, the high-frequency components may cover a frequency range [B,fs]. Each of the transposers 602-2,...,602-P provides a contribution to the high-frequency components, and these contributions may be overlapping and / or non-overlapping. In FIG. 12b, the high-frequency components are generated by overlapping contributions from the various transposers 602-2,...,602-P. Frequency diagram 1241 shows the low-frequency components (i.e., the input signals to the transposers 602-2,...,602-P). Frequency diagram 1242 shows the output signal of second-order transposer 602-2, which includes subbands in the frequency range [B, 2B], indicated by the hatched frequency range. The frequency range [0, B] generated by the transposer is typically ignored or discarded because it is covered by the low-frequency input signal. This is indicated by the white frequency range. Frequency diagram 1243 shows the output signal of third-order transposer 602-3, which covers the frequency range [B, 3B], indicated by the hatched frequency range. Similarly, transposer 602-P generates an output signal covering the frequency range [B, PB], as shown in frequency diagram 1244. Finally, the output signals and low-frequency components of the various transposers 602-2,...,602-P are mapped to QMF subbands using analysis QMF banks 603-1,...,603-P, thereby generating a set of P QMF subbands. As can be seen from the frequency diagram 1245, the QMF subband covering the frequency range [0, B], indicated by reference numeral 1246, only has contributions from low frequency components (ie signals resulting from a first order transposition).The QMF subband covering the frequency range [B, 2B], designated by reference numeral 1247, receives contributions from output signals with transposition order T=2,...,P. The QMF subband covering the frequency range [2B, 3B], designated by reference numeral 1248, receives contributions from output signals with transposition order T=3,...,P, etc. The QMF subband covering the frequency range [(P-1)B, PB], designated by reference numeral 1249, receives contributions from output signals with transposition order T=P.

[0076] In contrast, in Figure 12c, the transposers 602-2,...,602-P are configured so that the frequency ranges of their output signals do not overlap. Frequency diagram 1251 shows the low-frequency components. Frequency diagram 1252 shows the output signal of a second-order transposer covering the frequency range [B,2B]. Frequency diagram 1253 shows the output signal of a third-order transposer 602-3 covering the frequency range [2B,3B], and frequency diagram 1254 shows the output signal of a P-th order transposer 602-P covering the frequency range [(P-1)B,PB]. The low-frequency components and the output signals of the transposers 602-2,...,602-P are respectively applied to analysis QMF banks 603-1,...,603-P, which provide a set of P QMF subbands. Typically, these QMF subbands do not have contributions from overlapping frequency ranges. This is shown in frequency diagram 1255. The QMF subband covering the frequency range [0,B], designated by reference numeral 1256, receives contributions only from low-frequency components (signals from a first-order transposition). The QMF subband covering the frequency range [B,2B], designated by reference numeral 1257, receives contributions from the output signal of a transposer with transposition order T=2. The QMF subband covering the frequency range [2B,3B], designated by reference numeral 1258, receives contributions from the output signal of a transposer with transposition order T=3. The QMF subband covering the frequency range [(P-1)B,PB], designated by reference numeral 1259, receives contributions from the output signal of a transposer with transposition order T=P.

[0077] 12b and 12c show examples where the output signals of transposers 602-2, ..., 602-P overlap completely and do not overlap completely. Note that mixed examples with partially overlapping output signals are also possible. Note that the two examples in FIGS. 12b and 12c show systems where transposers 602-2, ..., 602-P are configured so that the frequency ranges of each output signal overlap or do not overlap. This can be done by applying windowing in the transposer's spectral domain, for example, by setting selected subband signals to zero. Alternatively, in both of FIGS. 12b and 12c, transposers 602-2, ..., 602-P can be appropriately combined with subband signals obtained from analysis QMF banks 603-1, ..., 603-P to generate a wideband signal and perform filtering of the transposed signal in the QMF subband domain. For example, in the non-overlapping case, only one of the analysis QMF banks 603-1,...,603-P contributes to the subband signals provided to the HFR processor 604 in each transposer output frequency range. In the overlapping case, multiple subband signals are summed before being input to the HFR processor 604.

[0078] If all or part of the signals in the HFR system 600 are critically (closely) sampled, as shown in Figures 7 and 13-16 for the HFR system 700, a more efficient embodiment than the system of Figure 6 is obtained. This means that the output signal of the core decoder 701 and preferably other intermediate signals of the HFR system 700 (e.g., the output signals of the transposers 702-2, ..., 702-P) are critically sampled. For example, the core-decoded signal at the output of the core decoder 701 is downsampled by a rational factor Q = M1 / M2, where M1 and M2 are appropriately selected integers. The downsampling factor Q is the largest factor that forces the input signal of bandwidth B to approach being critically sampled. At the same time, Q is selected so that the size of the QMF bank 703-1 (32 / Q) remains an integer. The downsampling by the rational factor Q is performed in the downsampler 706, which generates an output signal at the sampling frequency fs / Q. To provide a critically sampled transposed signal, transposers 702-2,...,702-P preferably output only a portion of the associated transposed signal (i.e., the frequency range actually used by HFR processor 704). The frequency range associated with transposer 702-T of transposition order T may be the range of the input signal [(T-1)B,TB] with bandwidth B Hz in the non-overlapping case.

[0079] This means that the output from downsampler 706 and the outputs from transposers 702-2,...,702-P are critically sampled. The output signal of second-order transposer 702-2 has a sampling frequency fs / Q equal to the output signal of downsampler 706. Note, however, that because transposer 702-2 is designed to synthesize only the transposition frequency range of approximately B to 2B Hz, the signal from second-order transposer 702-2 is effectively a high-pass signal with a bandwidth of fs / (2Q).

[0080] For higher-order transposers, such as transposer 702-P, at least two situations are possible. The first situation is when the transposition signals overlap, i.e., the lower frequency portion of the P-th transposition signal overlaps with the frequency range of the P-1-th transposition signal (see FIG. 12b). In this case, the critically sampled output from transposer 702-P has a sampling frequency of Sfs / Q, where S=min(P-1, 2Q-1). When S=P-1, the highest frequency of the P-th transposition signal is still lower than the Nyquist frequency of the output signal of HFR system 700. When S=2Q-1, the bandwidth of the P-th transposition signal is limited by the Nyquist frequency fs of the output signal of HFR system 700. That is, the sampling frequency of the output signal of transposer 702-P is never greater than (2-(1 / Q))fs, which corresponds to a signal covering a frequency range from fs / (2Q) (the highest frequency of the lower-frequency signal) to the Nyquist frequency fs. Another situation is when the transposed signals are non-overlapping, where S=1 and cover different non-overlapping frequency ranges in the output signal of the inverse QMF bank 705 (i.e., in the output signal of the HFR system 700), but all of the transposed signals have the same sampling frequency (see FIG. 12c).

[0081] The effects of the above sub-sampling or down-sampling on the output signal of the core decoder 701 with a bandwidth of B Hz are shown in FIGS. 13-16. FIG. 13 schematically shows the signal transition from the output of the core decoder 701 to the output of the transposer 702-2 with a transition order T = 2. The frequency diagram 1310 shows the output signal of the core decoder with a bandwidth of B Hz. This signal is critically down-sampled by the down-sampler 706. The down-sampling factor Q is a rational value that ensures that the analysis QMF band 703-1 has an integer value of 32 / Q for the sub-band. Further, the down-sampler 706 provides an output signal that is critically sampled (i.e., an output signal with a sampling frequency of fs / Q) (as close as possible to twice the bandwidth of the core decode signal) (Q < fs / (2B)). Such a critically sampled signal is shown in the frequency diagram 1320. The critically sampled signal with a sampling frequency of fs / Q is given to the transposer 702-2 and segmented into a plurality of analysis sub-bands. Such a segmented signal is shown in the frequency diagram 1330. Next, non-linear processing is performed on the analysis sub-band signal, stretching the analysis sub-band signal to a frequency range T = 2 times higher and the sampling frequency to 2fs / Q. This is shown in the frequency diagram 1340 (or may be shown as the frequency diagram 1330 with a scaled frequency axis). It should be noted that typically only a portion of the sub-bands that are transposed are considered in the HFR processing module 704. These relevant transposed sub-bands are shown in the frequency diagram 1340 as hatched sub-bands covering the frequency range [B, 2B]. Only the hatched sub-bands need to be considered in the transposer synthesis filter bank, so the relevant range is modulated down to the baseband and the signal is down-sampled by a factor of 2 to the sampling frequency of fs / Q.This is shown in frequency diagram 1360, where it can be seen that a signal covering the frequency range [B, 2B] is modulated into the baseband range [0, B]. The fact that the modulated signal actually covers a higher frequency range [B, 2B] is indicated by the references "B" and "2B".

[0082] It should be noted that the illustrated steps of transposition (frequency diagram 1340) and subsequent modulation to baseband (frequency diagram 1360) are shown for illustrative purposes only. Both of these processes may be performed by assigning the hatched subbands (frequency diagram 1340) to synthesis subbands of a synthesis filterbank that has half the number of subbands as the analysis filterbank. Such a mapping process results in an output signal modulated to baseband (centered around zero frequency) as shown in frequency diagram 1360. In the non-overlapping example, the size of the synthesis filterbank can be reduced compared to the analysis filterbank, utilizing an achievable downsampling factor given by a ratio between the total frequency range [0,PB] covered by the output signal of the P-th order transposer 703-P and the actual frequency range [(P-1)B,PB] covered by the output signal of the P-th order transposer 703-P, i.e., factor P.

[0083] Figure 14 shows a schematic diagram of a signal transition from the output of the core decoder 702-1 to the output of the transposer 702-3 with transition order T=3 in the case of overlapping frequency ranges. A signal of bandwidth B, shown in frequency diagram 1410, is downsampled by a factor Q in the downsampler 706 to generate the signal shown in frequency diagram 1420. The analysis subband, shown in frequency diagram 1430, is transposed to a subband with a frequency T=3 times higher. The transposition subband is shown in frequency diagram 1440, where the sampling rate is increased from fs / Q to 3fs / Q. As explained with respect to Figure 13, this may be expressed by scaling the frequency axis by a factor of three. It can be seen that the frequency range of the third-order transposer 702-3 (i.e., the hatched frequency range [B, 3B]) overlaps with the frequency range of the second-order transposer 702-2. As in Figure 13, the hatched subbands are applied to a reduced-size synthesis filterbank, producing a signal containing only frequencies from the hatched frequencies. The high-pass signal is then modulated down to baseband using downsampling by a factor of 3 / 2. The critically sampled output signal of transposer 703-2, with sampling frequency 2fs / Q, is shown in frequency diagram 1460.

[0084] 13, it should be noted that the transposition process shown in frequency diagram 1440 and the modulation process to baseband shown in frequency diagram 1460 are performed by mapping the hatched subbands in frequency diagram 1440 to synthesis subbands of a reduced-size synthesis filter bank. In the overlapping example, the size of the synthesis filter bank is reduced compared to the analysis filter bank, and an achievable downsampling factor given by a ratio between the total frequency range [0,PB] covered by the output signal of P-th order transposer 703-P and the actual frequency range [B,PB] covered by the output signal of P-th order transposer 703-P, i.e., the factor P / (P-1).

[0085] FIG. 15 shows a schematic diagram of a signal transition from the output of downsampler 706 to the output of transposer 702-P of transposition order T=P when the transposition frequency range does not overlap with the relevant frequency range (i.e., [(P-2)B, (P-1)B]) of the lower-order transposer (T=P-1). As described with reference to FIG. 13, the downsampled signal shown in frequency diagram 1530 is transposed by transposer 702-P. The transposition subbands covering the relevant frequency range [(P-1)B, P-B] are shown as hatched frequency ranges in frequency diagram 1540. The subbands corresponding to the hatched frequency ranges are applied to a reduced-size synthesis filter, which generates a signal containing only the frequency range [(P-1)B, P-B]. This high-pass signal is then modulated to baseband and downsampled by a factor P. This results in a critically sampled output signal of transposer 702-P shown in frequency diagram 1560. The output signal of transposer 702-P has frequency components in the frequency range [(P-1)B,PB], which needs to be considered when mapping the transposer output to QMF subbands for HFR processing.

[0086] FIG. 16 shows a schematic diagram of a signal transition from the output of downsampler 706 to the output of transposer 702-P of transposition order T=P when the transposition frequency range overlaps with the associated frequency range (i.e., [B, (P-1)B]) of the lower-order transposer (T=2,...,P-1). Similar to the description of FIG. 14, the downsampled signal shown in frequency diagram 1630 is transposed by transposer 702-P. The transposition subbands covering the frequency range [B, P-B] are shown as hatched frequency ranges in frequency diagram 1640. As in FIG. 14, it can be seen that the hatched subbands cover frequencies lower than (P-1)B. Thus, the hatched subbands overlap with the frequency ranges of lower-order transposers 702-2,...,702-P-1. Furthermore, because the hatched subbands cover a range higher than [(P-1)B,PB], only a reduced downsampling factor can be used. As mentioned above, if the frequency range covered by the output signal of the P-th order transposer 702-P is [B,(P-1)B], then this downsampling factor is P / (P-1). This results in a downsampled output signal of the transposer with a sampling frequency of (P-1)fs / Q.

[0087] As noted above, it should be noted that the intermediate signals within transposer 702-P (i.e., the signals shown in frequency diagrams 1340, 1440, 1540, and 1640, among others) are not signals that physically appear in the HFR system shown in Figure 7. These signals are shown for illustrative purposes only and are shown as "virtual" signals in transposer 702-P to illustrate the effects of transposition and filtering when performing implicit downsampling.

[0088] Note that, as mentioned above, the output signal from the core decoder 701 may be critically pre-sampled at the sampling rate fs / Q before entering the HFR module 700. This can be done, for example, by using a smaller synthesis transform size than normal in the core decoder 701. In this case, the computational burden is reduced due to the smaller synthesis transform and obsolete downsampler used in the core decoder 701.

[0089] Another measure to improve the efficiency of the HFR system is to combine the individual transposers 602-2,...,602-P of Figure 6 according to any of the methods described with reference to Figures 3, 4, or 5. As an example, multiple transposer systems 300, 400, or 500 may be used instead of the individual transposers 602-2,...,602-P for various transposition orders T=2,...,P. A possible scenario is shown in Figure 8, where transposers with a transposition factor T of 2 or less are grouped together into multiple transposers 802, which may be implemented according to any of the configurations described with reference to Figures 3-5. The output from the multiple transposers 802 has a sampling frequency of 2fs (i.e., a sampling frequency twice higher than the sampling frequency of the input signal to the multiple transposers 802). The output signal from the multiple transposers 802 is filtered by a single analysis QMF bank 803-2 having 64 channels.

[0090] As explained with reference to FIG. 6, resampling of the core signal (i.e., resampling of the output signal of the core decoder 801) may be performed by filtering the signal using a downsampled QMF bank 803-1 having only 32 channels. As a result, the set of QMF subband signals has QMF subband signals with a sampling frequency of fs / 32. Two of the set of QMF subband signals are provided to an HFR processing module 804, and finally, the adjusted QMF subband signals are synthesized into a time-domain signal by a 64-channel synthesis QMF bank 805. It should be noted that in the example explained, the multiple transposers 802 generate a transposed time-domain signal with twice the sampling rate fs. As explained with reference to FIGS. 3, 4, and 5, this transposed time-domain signal is the sum of several transposed signals with different transposition factors T, where T is greater than 1. The reason that the multiple transposers 802 provide output signals with a sampling frequency of 2fs is that the output signals of the multiple transposers 802 cover the high frequency range of the output signal of the HFR module 800 (i.e., the range of at most [B, fs]), where B is the bandwidth of the low frequency components and fs is the Nyquist frequency of the output signal of the HFR module 800.

[0091] As discussed with respect to FIG. 7, the efficiency of HFR system 800 can be increased by increasing the level of subsampling of the time-domain signal, i.e., preferably by providing critically downsampled signals at the output of the core decoder and the output of the transposer. This is shown in FIG. 9, where the output signal of core decoder 901 is downsampled in downsampling unit 906, resulting in a downsampled signal at sampling frequency fs / Q. This signal is provided to multiple transposers 902 and analysis QMF bank 903-1. The output of multiple transposers 902 is a combination of signals with transposition orders T=2 through P, so that the output of multiple transposers 902 has a sampling frequency Sfs / Q (where S=min(P-1, 2Q-1)). The transposed signal is provided to analysis QMF bank 903-2, which has a size of 32S / Q. As before, the two groups of QMF subband signals are processed in the HFR processor 904 and finally transformed into a time domain signal using the synthesis QMF bank 905 .

[0092] In one embodiment, if the multiple transposers are configured to deliver an unaltered copy of the core signal (i.e., an unaltered copy of the core decoder's output signal), the QMF bank that analyzes the core signal (i.e., analysis QMF bank 803-1 in FIG. 8 ) may be omitted. In transposer terms, this is equivalent to a transposition using a transposition factor T=1 (i.e., a first-order transposition). If a first-order transposition is added to the multiple transposer system 802 of FIG. 8 , a block diagram of the so-modified HFR module 1000 is shown in FIG. 10 . As shown in FIG. 10 , the signal decoded by the core decoder 1001 is simply used as an input to the multiple transposers 1002, i.e., the signal decoded by the core decoder 1001 is not provided to any additional elements of the HFR module 1000. The multiple transposers 1002 are configured so that their single output signal has a sampling frequency of 2fs. In other words, multiple transposers 1002 generate a time-domain signal at twice the sampling rate, which is the sum of several transposed signals with different transposition factors T, where T takes on a value between 1 and P. This single output signal from multiple transposers 1002 is analyzed by a 64-channel QMF bank 1003, and the QMF subband signals are then provided to an HFR processing module 1004, which adjusts the QMF subband signals using information from the transmitter. The adjusted QMF subband signals are finally combined by a 64-channel combination QMF bank 1005.

[0093] Similar to the downsampling described with respect to Figures 7 and 9, the efficiency of the HFR module 1000 can be improved by utilizing subsampling of the time-domain signal. Such an HFR module 1100 is shown in Figure 11. The received bitstream is decoded by a core decoder 1101, which provides a time-domain signal at a sampling frequency fs. The time-domain output signal is downsampled by a factor Q using a downsampling unit 1106. The downsampled signal at a sampling frequency fs / Q is applied to multiple transposers 1102. The output from the multiple transposers 1102 has a sampling frequency Sfs / Q. However, since the transposition signal comprises the decoded and downsampled output signal from the core decoder 1101, the parameter S is selected as S = min(P, 2Q). The output signal from the multiple transposers 1102 is segmented into QMF subband signals using an analysis QMF bank 1103 having 32 S / Q channels. The QMF subband signals are adjusted using the transmitter information and then absorbed by the combined 64-channel QMF bank 1105 .

[0094] As mentioned above, the multiple transposers 802, 902, 1002, and 1102 shown in Figures 8-11 may be based on any of the configurations shown in Figures 3-5. Furthermore, the transposer configuration shown in Figure 2 may be used, although it is less computationally efficient than the multiple transposers of Figures 3-5. In a first preferred embodiment, the HFR module configuration shown in Figures 10 and 11 may be combined with multiple transposers described with reference to Figure 5. An example of mapping transposer analysis subbands to transposer synthesis subbands is shown in Figure 5b. In a second preferred embodiment, the HFR module configuration shown in Figures 8 and 9 may be combined with multiple transposers described with reference to Figure 5. An example of mapping transposer analysis subbands to transposer synthesis subbands is shown in Figure 5c.

[0095] In conjunction with the examples described with respect to Figures 7, 9, 11, 13-16, a general building block for a maximally decimated or critically sampled transposer may be formed. Such a building block 170 is shown in Figure 17. An input signal at sampling frequency fs is first processed by a downsampler 171 of a factor Q and then filtered by a transposer analysis filterbank 172. The analysis filterbank has N a and the filter bank size or transform size is δ a The subband signals have a hop size or input signal stride of N samples. The subband signals are then processed by a nonlinear processing unit 173 using a transposition factor T. The nonlinear processing unit 173 performs any of the nonlinear processing described herein. In one embodiment, the nonlinear processing described with respect to Figures 5, 5b, and 5c may be performed in the nonlinear processing unit 173. Finally, the subband signals are assembled (assembled, combined, created) into a time-domain signal at sampling frequency Rfs in a transposer synthesis filter bank 174, where R is the desired resampling factor. The synthesis filter bank is configured to process N S and the filter bank size or transform size is δ S The hop size or input signal stride is in samples. The expansion factor W for the analysis filter bank 172, nonlinear processor 173, and synthesis filter bank 174 is the ratio of the sampling frequency of the output signal from the synthesis filter bank to the input signal to the analysis filter bank:

[0096] W=Rf s / f s / Q=RQ (6) filter bank or transform size N a and N s satisfies the following relationship:

[0097] N s =(W / T)N a (7) Hop size or signal stride δ a and δ S satisfies the following relationship:

[0098] δ S =Wδ a (8) The maximally decimated or critically sampled transposer building block 170 has the input signal to the analysis filterbank 172, the output from the synthesis filterbank 174, or both, which exclusively cover the spectral bandwidth of interest for further processing, such as the HFR processing unit 704 in FIG. 7. Critical sampling of the input signal is achieved by filtering (possibly modulating after decimation) the input signal in the downsampler 171. In one embodiment, critical sampling of the output signal is achieved by mapping the subband signals to a synthesis filterbank 174 of the minimum necessary size, exclusively covering the subband channels relevant for further processing, e.g., as shown in equation (7). Figures 13-16 illustrate the situation when the output from the synthesis filterbank exclusively covers the relevant spectral bandwidth and is maximally decimated.

[0099] Multiple building blocks 170 can be combined and configured to provide critically sampled transposer systems of any number of transposition orders. In such systems, one or more modules 171-174 of a building block 170 may be shared among building blocks of different transposition orders. Typically, a system using a common analysis filter bank 301, as described in connection with FIG. 3, has maximally decimated output signals from synthesis filter banks 303-1, ..., 303-P, while the input signal to the common analysis filter bank 301 is maximally decimated for the transposer building block 170 requiring the largest input signal bandwidth. A system using a common synthesis filter bank 404, as described in connection with FIG. 4, may have maximally decimated input signals for analysis filter banks 401-1, ..., 401-P and a maximally decimated output signal from the common synthesis filter bank 404. The system described with reference to FIG. 2 preferably has both a maximally decimated input signal to the analysis filter bank and a maximally decimated output signal from the synthesis filter bank. In this example, the system configuration may simply be multiple transposer building blocks 170 in parallel. As described with reference to FIG. 5, a system utilizing both a common analysis filter bank 501 and a common synthesis filter bank 504 typically has a maximally decimated output signal from the common synthesis filter bank 504, while the input signal to the common synthesis filter bank 501 may be maximally decimated for signals whose transposition order requires the largest input signal bandwidth. In this system, the transposition factor T in equation (7) is replaced by the factor F described with reference to FIGS. 5, 5b, and 5c. Note that the summation units 202 in FIG. 2 and 304 in FIG. 3 are configured to process and combine critically sampled subband signals from the synthesis filter bank of the transposer building block in the above example.As an example, the summing unit comprises a QMF analysis filter bank followed by means for combining subband signals or a time domain resampling modulation means followed by means for summing signals.

[0100] This application describes a multiple transposition scheme and system that enables the use of a common analysis filter bank and a common synthesis filter bank. To enable the use of a common analysis and synthesis filter bank, an advanced nonlinear processing scheme is described to map from multiple analysis subbands to synthesis subbands. By utilizing a common analysis filter bank and a common synthesis filter bank, the multiple transposition scheme is improved to reduce the computational burden compared to conventional transposition schemes. In other words, by sharing pairs of analysis and synthesis filter banks for multiple harmonic transposers, or by combining one or more harmonic transposers with an upsampler, the computational burden of the harmonic HFR method is significantly reduced.

[0101] Additionally, various forms of HFR modules that perform multiple transitions have been described. In particular, reduced complexity HFR module forms are described that process critically downsampled signals. The described methods and systems may be used in various decoding devices, such as multimedia receivers, video / audio set-top boxes, mobile devices, audio players, video players, etc.

[0102] The methods and systems for transposition and / or high-frequency reconstruction described herein may be implemented as software, firmware, and / or hardware. Certain components may be implemented, for example, as software running on a digital signal processor or microprocessor. Other components may be implemented, for example, as hardware and / or application-specific integrated circuits. The signals used in the described methods and systems may be stored on media such as random access memory or optical storage media. These may be transmitted over networks (including, for example, the Internet) such as radio, satellite, wireless, or wired networks. Typical devices that utilize the methods and systems described herein are portable electronic devices or other consumer devices that store and / or use audio signals. The methods and systems may also be used in computer systems (e.g., Internet web servers) that store and provide audio signals, such as music signals, for download.

[0103] The following will exemplify the means according to the embodiment.

[0104] [Additional note 1] 1. A system for generating high frequency components of a signal from low frequency components of the signal, comprising: an analysis filter bank having a frequency resolution of Δf for providing a set of analysis subband signals comprising at least two analysis subband signals from the low frequency components of the signal; a nonlinear processing unit for determining a set of synthesis subband signals from the set of analysis subband signals using a transposition order P, the set of synthesis subband signals being determined based on portions of the set of analysis subband signals that have been phase shifted by an amount derived from the transposition order P; a synthesis filter bank having a frequency resolution of FΔf for generating high frequency components of a signal from the set of synthesis subband signals, where F≧1 and is a resolution factor, and the transposition order P is different from the resolution factor F; A system having:

[0105] [Additional note 2] an analysis subband signal belonging to the set of analysis subband signals phase-shifted by the transposition order P, or a pair of analysis subband signals in said set of synthesis subband signals and a first member of the pair of subband signals has a phase shifted by a factor P', and a second member of the pair of subband signals has a phase shifted by a factor P'', where P'+P"=P.

[0106] [Additional note 3] The analysis filter bank is L A analysis subbands, and L A >1, and the index k of the analysis subbands is k=0,...,L A -1, The synthesis filter bank is L S synthesis subbands, and L S >1, and the synthesis subband index n is n=0,...,L S- -1. The system of claim 1, [Additional note 4] 4. The system of claim 3, wherein the nonlinear processing unit determines an nth synthesis subband signal of the set of synthesis subband signals from the kth analysis subband signal and the (k+1)th analysis subband signal of the set of analysis subband signals.

[0107] [Additional note 5] The nonlinear processing unit determining the phase of the nth synthesis subband signal as the sum of the phase shift of the kth analysis subband signal and the phase shift of the (k+1)th analysis subband signal; and / or 5. The system of claim 4, wherein the magnitude of the nth synthesis subband signal is determined as the product of the magnitude in exponential notation of the kth analysis subband signal and the magnitude in exponential notation of the (k+1)th analysis subband signal.

[0108] [Additional note 6] 6. The system of claim 5, wherein the analysis subband index k of the analysis subband signal that contributes to the synthesis subband together with the synthesis subband index n is given by an integer obtained by truncating (F / P)n, and the remainder r of (F / P)n is given by (F / P)nk.

[0109] [Additional note 7] The nonlinear processing unit determining the phase of the nth synthesis subband signal as the sum of the phase of the kth analysis subband signal multiplied by P(1-r) and the phase of the (k+1)th analysis subband signal multiplied by P(r); and / or 7. The system of claim 6, wherein the magnitude of the nth synthesis subband signal is determined as the product of the (1-r)th power of the magnitude in exponential notation of the kth analysis subband signal and the rth power of the magnitude in exponential notation of the (k+1)th analysis subband signal.

[0110] [Additional note 8] The system of any one of appendix 1 to 7, wherein the analysis filter bank and the synthesis filter bank are set at integer multiple positions, the center frequencies of the analysis subbands are given by kΔf, and the center frequencies of the synthesis subbands are given by nFΔf.

[0111] [Additional note 9] the analysis filter bank and the synthesis filter bank are set at half-integer multiple positions, the center frequency of the analysis subband is given by (k+(½))Δf, and the center frequency of the synthesis subband is given by (n+(½))FΔf; 8. The system of any one of claims 1-7, wherein the difference between the transposition order P and the resolution factor F is an even number.

[0112] [Additional Note 10] The analysis filter bank has an analysis time span Δt A Use The synthesis filter bank has a synthesis time width Δt S Use The analysis time interval Δt A and the composite time width Δt S is equal to the system described in any one of appendix 1-9.

[0113] [Additional Note 11] the nonlinear processing unit determines a set of intermediate synthesis subband signals having a frequency resolution of PΔf from the set of analysis subband signals using the transposition order P, the set of intermediate synthesis subband signals being determined based on portions of the set of analysis subband signals whose phases have been shifted by the transposition order P; 2. The system of claim 1, wherein the nonlinear processing unit interpolates one or more intermediate synthesis subband signals to determine a synthesis subband signal of the set of synthesis subband signals having a frequency resolution of FΔf.

[0114] [Additional Note 12] 1. A system for generating high frequency components of a signal from low frequency components of the signal, comprising: an analysis filter bank for providing a set of analysis subband signals comprising at least two analysis subband signals from the low frequency components of the signal; a first nonlinear processing unit that determines a first set of synthesis subband signals from the set of analysis subband signals using a first transposition order P1, the first set of synthesis subband signals being determined based on portions of the set of analysis subband signals that have been phase shifted by an amount derived from the first transposition order P1; a second nonlinear processing unit that determines a second set of synthesis subband signals from the set of analysis subband signals using a second transposition order P2, the second set of synthesis subband signals being determined based on portions of the set of analysis subband signals that have been phase shifted by an amount derived from the second transposition order P2, and the first transposition order P1 and the second transposition order P2 are different; a combiner for combining the first and second sets of combined subband signals to generate a combined set of combined subband signals; a synthesis filter bank for generating the high frequency components of the signal from the set of synthesized synthesis subband signals; A system having:

[0115] [Additional Note 13] 13. The system of claim 12, wherein the synthesis unit overlaps synthesis subband signals belonging to the first and second sets of synthesis subband signals corresponding to overlapping frequency ranges.

[0116] [Additional Note 14] a core decoder that converts the encoded bitstream into the low frequency components of the signal; a quadrature mirror filter (QMF) bank for converting the high frequency components into a plurality of QMF subband signals; a high frequency reconstruction processing module for modifying the QMF subband signals; a synthesis QMF bank for generating modified high frequency components from the modified QMF subband signals; 14. The system according to claim 12 or 13, further comprising:

[0117] [Additional Note 15] 15. The system according to claim 14, further comprising a downsampling unit upstream of the analysis filter bank for reducing the sampling rate of the low frequency components of the signal and outputting the low frequency components at the reduced sampling rate.

[0118] [Additional Note 16] 16. The system of claim 14 or 15, wherein the core decoder is based on an encoding method selected from the group consisting of Dolby E, Dolby Digital, AAA, and HE-AAC.

[0119] [Additional Note 17] A system for generating, from a low frequency component of a signal having a first sampling frequency, a high frequency component of the signal having a second sampling frequency that is R times the first sampling frequency, comprising: A T-th order harmonic transposer that generates modulated high frequency components from the low frequency components. the modulated high frequency component is determined based on a spectral portion of the low frequency component transposed to a frequency range T times higher, the modulated high frequency component being the first sampling frequency multiplied by a factor S, where R≧1, T>1 and S <Rである、システム。

[0120] [Additional Note 18] a QMF bank that maps the modulated high frequency components to at least one of X analysis quadrature mirror filter (QMF) subbands, where X is a multiple of S, to provide at least one QMF subband signal; a high frequency reconstruction module for modifying the at least one QMF subband signal; a synthesis QMF bank for generating the high frequency components from the at least one modified QMF subband signal; Item 18. The system according to item 17, further comprising:

[0121] [Additional Note 19] The harmonic transposer an analysis filterbank for providing a set of analysis subband signals from the low frequency components of the signal; a nonlinear processor with transposition order T for determining a set of synthesis subband signals from the set of analysis subband signals by modifying the phases of the set of analysis subband signals; a synthesis filter bank for generating modulated high frequency components of the synthesis subband signals from the set of synthesis subband signals; 19. The system according to claim 17 or 18, comprising:

[0122] [Additional Note 20] the low frequency component has a bandwidth of B; the set of composite subband signals is in a frequency range from (T-1)*B to T*B; 20. The system of claim 19, wherein the harmonic transposer modulates the set of composite subband signals to a baseband centered around zero frequency to generate the modulated high frequency components.

[0123] [Additional Note 21] 21. The system of claim 20, wherein the harmonic transposer maps the set of subband signals to subbands of the synthesis filter bank.

[0124] [Additional note 22] The system according to any one of appendices 17-21, wherein the harmonic transposer constitutes the system according to any one of appendices 1-13.

[0125] [Additional Note 23] further comprising downsampling means upstream of the harmonic transposer, the downlink sampling means providing, from the low frequency components of the signal, low frequency components that are critically downsampled by the first sampling frequency divided by a downsampling factor Q; the modulated high frequency component is the first sampling frequency multiplied by a factor S and divided by the downsampling factor Q; 23. The system of any one of claims 18-22, wherein X is S / Q.

[0126] [Additional note 24] 1. A method for generating high frequency components of a signal from low frequency components of the signal, comprising: providing a set of analysis subband signals comprising at least two analysis subband signals from the low frequency components of the signal using an analysis filter bank having a frequency resolution of Δf; determining a set of synthesis subband signals from the set of analysis subband signals using a transposition order P, the set of synthesis subband signals being determined based on portions of the set of analysis subband signals that have been phase shifted by an amount derived from the transposition order P; generating high frequency components of the signal from the set of synthesis subband signals using a synthesis filter bank having a frequency resolution of FΔf; wherein F≧1 and is a resolution factor, and wherein the transposition order P is different from the resolution factor F.

[0127] [Additional note 25] 1. A method for generating high frequency components of a signal from low frequency components of the signal, comprising: providing a set of analysis subband signals comprising at least two analysis subband signals from the low frequency components of the signal; determining a first set of synthesis subband signals from the set of analysis subband signals using a first transposition order P1, the first set of synthesis subband signals being determined based on portions of the set of analysis subband signals that have been phase shifted by an amount derived from the first transposition order P1; Determining a second set of synthesized sub-band signals from the set of analyzed sub-band signals using a second transposition order P2, wherein the second set of synthesized sub-band signals is determined based on a portion of the set of analyzed sub-band signals whose phase is shifted by an amount derived from the second transposition order P2, and the first transposition order P1 and the second transposition order P2 are different; Combining the first and second sets of synthesized sub-band signals to generate a combined set of synthesized sub-band signals; Generating the high-frequency component of the signal from the combined set of synthesized sub-band signals A method comprising:

[0128] [Appendix 26] A method for generating a high-frequency component of a signal at a second sampling frequency that is R times the first sampling frequency from a low-frequency component of the signal at the first sampling frequency, comprising: Generating a modulated high-frequency component from the low-frequency component by performing harmonic transposition of order T, wherein the modulated high-frequency component is determined based on a portion of the low-frequency component transposed to a frequency range T times higher, and the modulated high-frequency component is the first sampling frequency multiplied by a factor S, and R ≧ 1, T > 1, and S < R.

[0129] [Appendix 27] A set-top box for decoding a received signal including at least a signal, The system according to any one of Appendices 1 - 23 for generating a high-frequency component of the signal from a low-frequency component of the signal A set-top box comprising:

[0130] [Appendix 28] A software program for causing a processor of a computer device to execute the method according to any one of Appendices 24 - 26.

[0131] [Additional note 29] A storage medium storing a software program that causes a processor of a computer device to execute the method described in any one of appendixes 24-26.

[0132] [Additional note 30] A computer program having instructions for causing a computer to perform the method according to any one of claims 24-26.

Claims

1. 1. A system configured to generate high frequency components of a signal from low frequency components of the signal, comprising: an analysis filterbank configured to provide a set of analysis subband signals from the low frequency components of the signal, the set of analysis subband signals including at least two analysis subband signals; a non-linear processing unit configured to determine a set of synthesis subband signals from the set of analysis subband signals, the non-linear processing unit configured to determine an n-th synthesis subband signal from the set of synthesis subband signals from the k-th analysis subband signal and the (k+1)-th analysis subband signal of the set of analysis subband signals, wherein the magnitude of the n-th synthesis subband signal depends on the magnitude in exponential notation of the k-th analysis subband signal and the magnitude in exponential notation of the (k+1)-th analysis subband signal, the sum of the exponential part of the magnitude in exponential notation of the k-th analysis subband signal and the exponential part of the magnitude in exponential notation of the (k+1)-th analysis subband signal equals 1, and the phase of the n-th synthesis subband signal depends on a transposition order T; a synthesis filter bank configured to generate high frequency components of the signal based on the set of synthesis subband signals; A system having:

2. The analysis filter bank is L Ａ analysis subbands, and L Ａ >1, and the index k of the analysis subband is k=0, ...., L Ａ -1, The synthesis filter bank is L Ｓ synthesis subbands, and L Ｓ >1, and the index n of the synthesis subband is n=0, . . . , L Ｓ The system of claim 1, wherein the value is -1.

3. The number of analysis subbands L Ａ is the number of synthesis subbands L Ｓ The system of claim 2 , wherein:

4. the analysis filter bank has a frequency resolution of Δf; The system of claim 1 , wherein the synthesis filter bank has a frequency resolution of FΔf, where F is a resolution factor, where F≧1.

5. a core decoder configured to convert the encoded bitstream into low frequency components of said signal; an analysis quadrature mirror filter bank (QMF bank) configured to transform the high frequency components into a plurality of QMF subband signals; a high frequency reconstruction processing module configured to modify the QMF subband signals; a synthesis QMF bank configured to generate modified high frequency components from the modified QMF subband signals; The system of claim 1 further comprising:

6. 1. A method for generating high frequency components of a signal from low frequency components of the signal, comprising: providing a set of analysis subband signals from the low frequency components of the signal, the set of analysis subband signals including at least two analysis subband signals; determining a set of synthesis subband signals from the set of analysis subband signals, wherein an nth synthesis subband signal of the set of synthesis subband signals is determined from a kth analysis subband signal and a (k+1)th analysis subband signal of the set of analysis subband signals, the magnitude of the nth synthesis subband signal depends on the magnitude in exponential notation of the kth analysis subband signal and the magnitude in exponential notation of the (k+1)th analysis subband signal, the sum of the exponential part of the magnitude in exponential notation of the kth analysis subband signal and the exponential part of the magnitude in exponential notation of the (k+1)th analysis subband signal equals 1, and the phase of the nth synthesis subband signal depends on a transposition order T; generating high frequency components of the signal based on the set of composite subband signals; A method having the following.

7. the set of analysis subband signals is generated from the low frequency components using an analysis filterbank; The method of claim 6 , wherein the high frequency components are generated from the set of synthesis subband signals using a synthesis filter bank.

8. A software program adapted to be executed by a processor, the software program causing the steps of the method of claim 6 to be carried out when the software program is executed on a computing device.

9. A storage medium containing a software program adapted to be executed by a processor, the software program causing the execution of the steps of the method of claim 6 when executed on a computing device.

Images