Time-alignment of QMF based processing data
Patent Information
- Application Number
- HK42026126248
- Authority / Receiving Office
- HK · HK
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2013-11-27
- Filing Date
- 2026-07-16
- Publication Date
- 2026-09-11
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
(19) *EP004769394A2* (11) EP 4 769 394 A2 (12) EUROPEAN PATENT APPLICATION (43) Date of publication: 01.07.2026 Bulletin 2026 / 27 (21) Application number: 26164804.2 (22) Date of filing: 08.09.2014 (51) International Patent Classification (IPC): G10L 21 / 0388 (2013.01) (52) Cooperative Patent Classification (CPC): G10L 21 / 0388 (84) Designated Contracting States: AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR (30) Priority: 12.09.2013 US 201361877194 P 27.11.2013 US 201361909593 P (62) Document number(s) of the earlier application(s) in accordance with Art. 76 EPC: 21203084.5 / 3 975 179 19183863.0 / 3 582 220 17192420.2 / 3 291 233 14759217.4 / 3 044 790 (71) Applicant: Dolby International AB Dublin, D02 VK60 (IE) (72) Inventors: • KJOERLING, Kristofer 113 30 Stockholm (SE) • PURNHAGEN, Heiko 113 30 Stockholm (SE) • POPP, Jens 90429 Nuremberg (DE) (74) Representative: Dolby International AB Patent Group Europe 77 Sir John Rogerson’s Quay Block C Grand Canal Docklands Dublin, D02 VK60 (IE) Remarks: •This application was filed on 13.03.2026 as a divisional application to the application mentioned under INID code 62. •Claims filed after the date of filing of the application / after the date of receipt of the divisional application (Rule 68(4) EPC). (54) TIME‑ALIGNMENT OF QMF BASED PROCESSING DATA (57) Thepresent document relates to time-alignment of encoded data of an audio encoder with associated metadata, such as spectral band replication (SBR) me- tadata. An audio decoder (100, 300) configured to de- termine a reconstructed frame of an audio signal (237) from an access unit (110) of a received data stream is described. The access unit (110) comprises waveform data (111) and metadata (112), wherein the waveform data (111) and themetadata (112) areassociatedwith the same reconstructed frame of the audio signal (127). The audio decoder (100, 300) comprises awaveform proces- sing path (101, 102, 103, 104, 105) configured to gen- erate a plurality of waveform subband signals (123) from the waveform data (111), and a metadata processing path (108, 109) configured to generate decoded meta- data (128) from the metadata (111). EP 4 76 9 39 4 A 2 Processed by Luminess, 75001 PARIS (FR) Description CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application claims the benefit of priority toUnited States Provisional Patent ApplicationNo. 61 / 877,194 filed 12 September 2013 and United States Provisional Patent Application No. 61 / 909,593 filed 27 November 2013, each of which is hereby incorporated by reference in its entirety.
[0002] This application is a European divisional application of European patent application EP 21203084.5 (reference: D13096EP04), for which EPO Form 1001 was filed 18 October 2021. TECHNICAL FIELD OF THE INVENTION
[0003] Thepresent document relates to time-alignment of encodeddata of an audio encoderwith associatedmetadata, such as spectral band replication (SBR), in particular High Efficiency (HE) Advanced Audio Coding (AAC), metadata. BACKGROUND OF THE INVENTION
[0004] A technical problem in the context of audio coding is to provide audio encoding and decoding systems which exhibit a low delay, e.g. in order to allow for real-time applications such as live broadcasting. Furthermore, it is desirable to provide audio encoding and decoding systems that exchange encoded bitstreams which can be spliced with other bitstreams. In addition, computationally efficient audio encoding and decoding systems should be provided to allow for a cost efficient implementation of the systems. The present document addresses the technical problem of providing encoded bitstreams which can be spliced in an efficient manner, while at the same time maintaining latency at an appropriate level for live broadcasting. The present document describes an audio encoding and decoding system which allows for the splicing of bitstreams at reasonable coding delays, thereby enabling applications such as live broadcasting, where a broadcasted bitstream may be generated from a plurality of source bitstreams. SUMMARY OF THE INVENTION
[0005] According to an aspect an audio decoder configured to determine a reconstructed frame of an audio signal from an access unit of a received data stream is described. Typically, the data stream comprises a sequence of access unit for determining a respective sequence of reconstructed frames of the audio signal. A frame of the audio signal typically comprisesapre-determinednumberNof time-domainsamplesof theaudiosignal (withNbeinggreater thanone).Assuch the sequence of access units may describe the sequence of frames of the audio signal, respectively.
[0006] The access unit comprises waveform data and metadata, wherein the waveform data and the metadata are associatedwith the same reconstructed frameof the audio signal. In other words, thewaveformdata and themetadata for determining the reconstructed frameof theaudio signal are comprisedwithin thesameaccessunit. Theaccessunits of the sequence of access units may each comprise the waveform data and the metadata for generating a respective reconstructed frame of the sequence of reconstructed frames of the audio signal. In particular, the access unit of a particular frame may comprise (e.g. all) the data necessary for determining the reconstructed frame for the particular frame.
[0007] In an example, the access unit of a particular framemay comprise (e.g. all) the data necessary for performing an high frequency reconstruction (HFR) scheme for generating a highband signal of the particular framebased on a lowband signal of theparticular frame (comprisedwithin thewaveformdataof theaccessunit) andbasedon thedecodedmetadata.
[0008] Alternatively or in addition, the access unit of a particular frame may comprise (e.g. all) the data necessary for performing an expansion of the dynamic range of a particular frame. In particular, an expansion or an expanding of the lowband signal of the particular framemay be performed based on the decodedmetadata. For this purpose, the decoded metadatamay comprise oneormore expanding parameters. The oneormore expanding parametersmaybe indicative of one or more of: whether or not compression / expansion is to be applied to the particular frame; whether compression / expansion is to be applied in a homogeneousmanner for all the channels of amulti-channel audio signal (i.e. whether the same expanding gain(s) are to be applied for all the channels of a multi-channel audio signal or whether different expanding gain(s) are to be applied for the different channels of the multi-channel audio signal); and / or a temporal resolution of an expanding gain.
[0009] Theprovision of a sequenceof accessunitswith accessunits each comprising thedata necessary for generating a corresponding reconstructed frame of the audio signal, independent from a preceding or a succeeding access unit, is beneficial for splicing applications, as it allows the data stream to be spliced between two adjacent access units, without impacting theperceptual quality of a reconstructed frameof the audio signal at the (e.g. directly subsequent to the) splicing point. 2 EP 4 769 394 A2 5 10 15 20 25 30 35 40 45 50 55
[0010] In an example, the reconstructed frame of the audio signal comprises a lowband signal and a highband signal, wherein thewaveformdata is indicativeof the lowbandsignal andwherein themetadata is indicativeofa spectral envelope of the highband signal. The lowband signal may correspond to a component of the audio signal covering a relatively low frequency range (e.g. comprising frequencies smaller than a pre-determined cross over frequency). The highband signal may correspond to a component of the audio signal covering a relatively high frequency range (e.g. comprising frequencies higher than the pre-determined cross over frequency). The lowband signal and the highband signal may be complementary with regards to the frequency range covered by the lowband signal and by the highband signal. The audio decodermaybe configured toperformhigh frequency reconstruction (HFR) suchas spectral band replication (SBR) of the highband signal using the metadata and the waveform data. As such, the metadata may comprise HFR or SBR metadata indicative of the spectral envelope of the highband signal.
[0011] The audio decoder may comprise a waveform processing path configured to generate a plurality of waveform subband signals from the waveform data. The plurality of waveform subband signals may correspond to a representation of a time domain waveform signal in a subband domain (e.g. in a QMF domain). The time domain waveform signal may correspond to the above mentioned lowband signal, and the plurality of waveform subband signals may correspond to a plurality of lowband subband signals. Furthermore, the audio decoder may comprise a metadata processing path configured to generate decoded metadata from the metadata.
[0012] In addition, the audio decoder may comprise a metadata application and synthesis unit configured to generate the reconstructed frame of the audio signal from the plurality of waveform subband signals and from the decoded metadata. In particular, the metadata application and synthesis unit may be configured to perform an HFR and / or SBR scheme for generating a plurality of (e.g., scaled) highband subband signals from the plurality of waveform subband signals (i.e., in that case, from the plurality of lowband subband signals) and from the decoded metadata. The reconstructed frame of the audio signal may then be determined based on the plurality of (e.g. scaled) highband subband signals and based on the plurality of lowband signals.
[0013] Alternatively or in addition, the audio decoder may comprise an expanding unit configured to perform an expansion of or configured to expand the plurality of waveform subband signals using at least some of the decoded metadata, in particular using the one or more expanding parameters comprised within the decoded metadata. For this purpose, the expanding unitmaybe configured to apply oneormoreexpanding gains to theplurality ofwaveformsubband signals. The expanding unit may be configured to determine the one or more expanding gains based on the plurality of waveform subband signals, based on one or more pre-determined compression / expanding rules or functions and / or based on the one or more expanding parameters.
[0014] The waveform processing path and / or the metadata processing path may comprise at least one delay unit configured to time-align theplurality ofwaveformsubbandsignalsand thedecodedmetadata. Inparticular, theat least one delayunitmaybeconfigured toalign theplurality ofwaveformsubbandsignals and thedecodedmetadata, and / or to insert at least one delay into the waveform processing path and / or into themetadata processing path, such that an overall delay of thewaveformprocessing path corresponds to an overall delay ofmetadata processing path. Alternatively or in addition, the at least one delay unit may be configured to time-align the plurality of waveform subband signals and the decoded metadata such that the plurality of waveform subband signals and the decoded metadata are provided to the metadata application and synthesis unit just-in-time for the processing performed by themetadata application and synthesis unit. In particular, the plurality of waveform subband signals and the decoded metadata may be provided to the metadata application and synthesis unit such that themetadata application and synthesis unit does not need to buffer the plurality of waveform subband signals and / or the decodedmetadata prior to performing processing (e.g. HFRorSBRprocessing) on the plurality of waveform subband signals and / or on the decoded metadata.
[0015] In otherwords, the audio decodermaybe configured to delay theprovisioning of the decodedmetadata and / or of the plurality of waveform subband signals to the metadata application and synthesis unit, which may be configured to performanHFRscheme, such that the decodedmetadata and / or the plurality of waveform subband signals is provided as needed forprocessing.The inserteddelaymaybeselected to reduce (e.g. tominimize) theoverall delayof theaudiocodec (comprising theaudiodecoderandacorrespondingaudioencoder),whileat thesame timeenabling splicingof abitstream comprising the sequence of access units. As such, the audio decoder may be configured to handle time-aligned access units, which comprise the waveform data and the metadata for determining a particular reconstructed frame of the audio signal, with minimal impact on the overall delay of the audio codec. Furthermore, the audio decoder may be configured to handle time-alignedaccessunitswithout theneed for re-samplingmetadata.Bydoing this, theaudiodecoder is configured to determine a particular reconstructed frame of the audio signal in a computationally efficient manner and without deteriorating the audio quality. Hence, the audio decoder may be configured to allow for splicing applications in a computationally efficient manner, while maintaining high audio quality and low overall delay.
[0016] Furthermore, the use of at least one delay unit configured to time-align the plurality of waveform subband signals and the decoded metadata may ensure a precise and consistent alignment of the plurality of waveform subband signals and of the decoded metadata in the subband domain (where the processing of the plurality of waveform subband signals and of the decoded metadata is typically performed). 3 EP 4 769 394 A2 5 10 15 20 25 30 35 40 45 50 55
[0017] Themetadataprocessingpathmaycompriseametadatadelayunit configured todelay thedecodedmetadataby an integer multiple greater than zero of the frame length N of the reconstructed frame of the audio signal. The additional delay which is introduced by the metadata delay unit may be referred to as the metadata delay. The frame length N may correspond to the number N of time domain samples comprised within the reconstructed frame of the audio signal. The integermultiplemay be such that the delay introduced by themetadata delay unit is greater than a delay introduced by the processing of the waveform processing path (e.g. without considering an additional waveform delay introduced into the waveformprocessingpath). Themetadatadelaymaydependon the frame lengthNof the reconstructed frameof theaudio signal. This may be due to the fact that the delay caused by the processing within the waveform processing path depends on the frame lengthN. In particular, the integermultiplemaybe one for frame lengthsNgreater than 960and / or the integer multiple may be two for frame lengths N smaller than or equal to 960.
[0018] As indicated above, the metadata application and synthesis unit may be configured to process the decoded metadata and the plurality of waveform subband signals in the subband domain (e.g. in the QMF domain). Furthermore, the decoded metadata may be indicative of metadata (e.g. indicative of spectral coefficients describing the spectral envelope of the highband signal) in the subband domain. In addition, the metadata delay unit may be configured to delay the decodedmetadata. The use ofmetadata delays which are integermultiples greater zero of the frame length Nmay be beneficial, as this ensures a consistent alignment of the plurality of waveform subband signals and of the decoded metadata in the subband domain (e.g. for processingwithin themetadata application and synthesis unit). In particular, this ensures that the decodedmetadata can be applied to the correct frame of the waveform signal (i.e. to the correct frame of the plurality of waveform subband signals), without the need for resampling the metadata.
[0019] Thewaveformprocessingpathmaycompriseawaveformdelayunit configured todelay theplurality ofwaveform subband signals such that an overall delay of the waveform processing path corresponds to an integer multiple greater than zero of the frame length N of the reconstructed frame of the audio signal. The additional delay which is introduced by the waveform delay unit may be referred to as the waveform delay. The integer multiple of the waveform processing path may correspond to the integer multiple of the metadata processing path.
[0020] Thewaveform delay unit and / or themetadata delay unit may be implemented as buffers which are configured to store the plurality of waveform subband signals and / or the decodedmetadata for an amount of time corresponding to the waveformdelayand / or for anamountof timecorresponding to themetadatadelay.Thewaveformdelayunitmaybeplaced at any positionwithin thewaveformprocessing path upstreamof themetadata application and synthesis unit. As such, the waveform delay unit may be configured to delay the waveform data and / or the plurality of waveform subband signals (and / or any intermediate data or signals within the waveform processing path). In an example, the waveform delay unit may be distributed along the waveform processing path, wherein the distributed delay units each provide a fraction of the totalwaveformdelay. Thedistributionof thewaveformdelayunitmaybebeneficial for a cost efficient implementationof the waveformdelay unit. In a similarmanner to thewaveformdelay unit, themetadata delay unitmay be placedat any position within themetadata processing path upstreamof themetadata application and synthesis unit. Furthermore, thewaveform delay unit may be distributed along the metadata processing path.
[0021] Thewaveformprocessing pathmay comprise a decoding and de-quantization unit configured to decode and de- quantize the waveform data to provide a plurality of frequency coefficients indicative of the waveform signal. As such, the waveform datamay comprise ormay be indicative of the plurality of frequency coefficients, which allows the generation of the waveform signal of the reconstructed frame of the audio signal. Furthermore, the waveform processing path may comprise a waveform synthesis unit configured to generate the waveform signal from the plurality of frequency coefficients. The waveform synthesis unit may be configured to perform a frequency domain to time domain transform. In particular, the waveform synthesis unit may be configured to perform an inverse modified discrete cosine transform (MDCT). The waveform synthesis unit or the processing of the waveform synthesis unit may introduce a delay which depends on the frame length N of the reconstructed frame of the audio signal. In particular, the delay introduced by the waveform synthesis unit may correspond to half the frame length N.
[0022] Subsequent to reconstructing the waveform signal from the waveform data, the waveform signal may be processed in conjunction with the decoded metadata. In an example, the waveform signal may be used in the context of an HFR or SBR scheme for determining the highband signal, using the decoded metadata. For this purpose, the waveform processing path may comprise an analysis unit configured to generate the plurality of waveform subband signals from the waveform signal. The analysis unit may be configured to perform a time domain to subband domain transform, e.g. by applying a quadrature mirror filter (QMF) bank. Typically, a frequency resolution of the transform performed by the waveform synthesis unit is higher (e.g. by a factor of at least 5 or 10) than a frequency resolution of the transform performed by the analysis unit. This may be indicated by the terms "frequency domain" and "subband domain", wherein the frequency domain may be associated with a higher frequency resolution than the subband domain. The analysis unitmay introduceafixeddelaywhich is independent of the frame lengthNof the reconstructed frameof theaudio signal. The fixed delay which is introduced by the analysis unit may be dependent on the length of the filters of a filter bank usedby theanalysisunit.Bywayofexample, thefixeddelaywhich is introducedby theanalysisunitmaycorrespond to320 samples of the audio signal. 4 EP 4 769 394 A2 5 10 15 20 25 30 35 40 45 50 55
[0023] The overall delay of thewaveformprocessing pathmay further depend on a pre-determined lookahead between metadata and waveform data. Such a lookahead may be beneficial for increasing continuity between adjacent recon- structed frames of the audio signal. The pre-determined lookahead and / or the associated lookahead delay may correspond to 192 or 384 samples of the audio sample. The lookahead delay may be a lookahead in the context of the determination of HFR or SBR metadata indicative of the spectral envelope of the highband signal. In particular, the lookaheadmay allow a corresponding audio encoder to determine theHFRorSBRmetadata of the particular frameof the audio signal, basedonapre-determinednumberof samples fromadirectly succeeding frameof theaudio signal. Thismay be beneficial in caseswhere the particular frame comprises an acoustic transient. The lookahead delaymaybeapplied by a lookahead delay unit comprised within the waveform processing path.
[0024] As such, the overall delay of the waveform processing path, i.e. the waveform delay may be dependent on the different processing which is performed within the waveform processing path. Furthermore, the waveform delay may be dependent on the metadata delay, which is introduced in the metadata processing path. The waveform delay may correspond to an arbitrary multiple of a sample of the audio signal. For this reason, it may be beneficial to make use of a waveform delay unit which is configured to delay the waveform signal, wherein the waveform signal is represented in the time domain. In other words, it may be beneficial to apply the waveform delay on the waveform signal. By doing this, a precise and consistent application of awaveformdelay,which corresponds to anarbitrarymultiple of a sample of the audio signal, may be ensured.
[0025] Anexampledecodermay compriseametadata delayunit,which is configured toapply themetadatadelayon the metadata, wherein the metadata may be represented in the subband domain, and a waveform delay unit, which is configured to apply the waveform delay on the waveform signal which is represented in the time domain. The metadata delay unit may apply a metadata delay which corresponds to an integer multiple of the frame length N, and the waveform delay unit may apply a waveform delay which corresponds to an integer multiple of a sample of the audio signal. As a consequence, a precise and consistent alignment of the plurality of waveform subband signals and of the decoded metadata for processing within the metadata application and synthesis unit may be ensured. The processing of the plurality of waveform subband signals and of the decoded metadata may occur in the subband domain. The alignment of the plurality of waveform subband signals and of the decoded metadata may be achieved without re-sampling of the decoded metadata, thereby providing computationally efficient and quality preserving means for alignment.
[0026] As outlined above, the audio decoder may be configured to perform an HFR or SBR scheme. The metadata application and synthesis unit may comprise a metadata application unit which is configured to perform high frequency reconstruction (such as SBR) using the plurality of lowband subband signals and using the decoded metadata. In particular, the metadata application unit may be configured to transpose one or more of the plurality of lowband subband signals to generateaplurality of highbandsubbandsignals. Furthermore, themetadataapplication unitmaybe configured to apply the decoded metadata to the plurality of highband subband signals to provide a plurality of scaled highband subband signals. The plurality of scaled highband subband signals may be indicative of the highband signal of the reconstructed frame of the audio signal. For generating the reconstructed frame of the audio signal, the metadata application and synthesis unitmay further comprise a synthesis unit configured to generate the reconstructed frameof the audio signal from the plurality of lowband subband signals and from the plurality of scaled highband subband signals. The synthesis unit may be configured to perform an inverse transformwith respect to the transform performed by the analysis unit, e.g. by applying an inverseQMFbank. The number of filters comprisedwithin the filter bank of the synthesis unit may be higher than the number of filters comprised within the filter bank of the analysis unit (e.g. in order to account for the extended frequency range due to the plurality of scaled highband subband signals).
[0027] As indicated above, the audio decoder may comprise an expanding unit. The expanding unit may be configured to modify (e.g. increase) the dynamic range of the plurality of waveform subband signals. The expanding unit may be positioned upstream of the metadata application and synthesis unit. In particular, the plurality of expanded waveform subband signals may be used for performing the HFR or SBR scheme. In other words, the plurality of lowband subband signals used for performing the HFR or SBR scheme may correspond to the plurality of expanded waveform subband signals at the output of the expanding unit.
[0028] Theexpanding unit is preferable positioned downstreamof the lookahead delay unit. In particular, the expanding unit may be positioned between the lookahead delay unit and themetadata application and synthesis unit. By positioning theexpandingunit downstreamof the lookaheaddelayunit, i.e. byapplying the lookaheaddelay to thewaveformdataprior to expanding the plurality of waveform subband signals, it is ensured that the one or more expanding parameters comprised within the metadata are applied to the correct waveform data. In other words, performing expansion on the waveform data which has already been delayed by the lookahead delay ensures that the one or more expanding parameters from the metadata are in synchronicity with the waveform data.
[0029] As such, the decoded metadata may comprise one or more expanding parameters, and the audio decoder may comprise an expanding unit configured to generate a plurality of expanded waveform subband signals based on the plurality of waveform subband signals, using the one ormore expanding parameters. In particular, the expanding unitmay be configured to generate the plurality of expanded waveform subband signals using an inverse of a pre-determined 5 EP 4 769 394 A2 5 10 15 20 25 30 35 40 45 50 55 compression function. The one or more expanding parameters may be indicative of the inverse of the pre-determined compression function. The reconstructed frame of the audio signal may be determined from the plurality of expanded waveform subband signals.
[0030] As indicated above, the audio decoder may comprise a lookahead delay unit configured to delay the plurality of waveform subband signals in accordance to the pre-determined lookahead, to yield a plurality of delayed waveform subband signals. The expanding unit may be configured to generate the plurality of expandedwaveform subband signals by expanding the plurality of delayed waveform subband signals. In other words, the expanding unit may be positioned downstreamof the lookahead delay unit. This ensures synchronicity between the one ormore expanding parameters and the plurality of waveform subband signals, to which the one or more expanding parameters are applicable.
[0031] Themetadata application and synthesis unitmay be configured to generate the reconstructed frameof the audio signal by using the decoded metadata (notably by using the SBR / HFR related metadata) for a temporal portion of the plurality of waveform subband signals. The temporal portion may correspond to a number of time slots of the plurality of waveform subband signals. The temporal length of the temporal portion may be variable, i.e. the temporal length of the temporal portion of the plurality ofwaveformsubband signals towhich thedecodedmetadata is appliedmay vary fromone frame to thenext. In yet otherwords, the framing for thedecodedmetadatamayvary.Thevariationof the temporal lengthof a temporal portion may be limited to pre-determined bounds. The pre-determined bounds may correspond to the frame length minus the lookahead delay and to the frame length plus the lookahead delay, respectively. The application of the decodedwaveformdata (or parts thereof) for temporal portions of different temporal lengthsmaybebeneficial for handling transient audio signals.
[0032] The expanding unit may be configured to generate the plurality of expandedwaveform subband signals by using theoneormoreexpandingparameters for the same temporal portionof the plurality ofwaveformsubbandsignals. In other words, the framing of the one or more expanding parameters may be the same as the framing for the decoded metadata which is used by themetadata application and synthesis unit (e.g. the framing for the SBR / HFRmetadata). By doing this, consistency of the SBR scheme and of the companding scheme can be ensured and the perceptual quality of the coding system can be improved.
[0033] According to a further aspect, an audio encoder configured to encode a frame of an audio signal into an access unit of a data stream is described. The audio encoder may be configured to perform corresponding processing tasks with respect to the processing tasks performed by the audio decoder. In particular, the audio encoder may be configured to determine waveform data and metadata from the frame of the audio signal and to insert the waveform data and the metadata intoanaccessunit. Thewaveformdataand themetadatamaybe indicativeof a reconstructed frameof the frame of the audio signal. In other words, the waveform data and the metadata may enable the corresponding audio decoder to determine a reconstructed version of the original frame of the audio signal. The frame of the audio signal may comprise a lowband signal and a highband signal. Thewaveform datamay be indicative of the lowband signal and themetadatamay be indicative of a spectral envelope of the highband signal.
[0034] The audio encoder may comprise a waveform processing path configured to generate the waveform data from the frame of the audio signal, e.g. from the lowband signal (e.g. using an audio core decoder such as an Advanced Audio Coder, AAC). Furthermore, the audio encoder comprises a metadata processing path configured to generate the metadata from the frame of the audio signal, e.g. from the highband signal and from the lowband signal. By way of example, the audio encoder may be configured to perform High Efficiency (HE) AAC, and the corresponding audio decoder may be configured to decode the received data stream in accordance to HE AAC.
[0035] The waveform processing path and / or the metadata processing path may comprise at least one delay unit configured to time-align the waveform data and the metadata such that the access unit for the frame of the audio signal comprises thewaveform data and themetadata for the same frame of the audio signal. The at least one delay unit may be configured to time-align the waveform data and the metadata such that an overall delay of the waveform processing path corresponds to an overall delay of metadata processing path. In particular, the at least one delay unit may be a waveform delay unit configured to insert an additional delay in the waveform processing path, such that the overall delay of the waveform processing path corresponds to the overall delay of the metadata processing path. Alternatively or in addition, the at least one delay unit may be configured to time-align the waveform data and the metadata such that the waveform data and the metadata are provided to an access unit generation unit of the audio encoder just-in-time for generating a single access unit from thewaveform data and from themetadata. In particular, the waveform data and themetadatamay beprovided such that the single accessunitmaybegeneratedwithout theneed for a buffer for buffering thewaveformdata and / or the metadata.
[0036] The audio encoder may comprise an analysis unit configured to generate a plurality of subband signals from the frameof the audio signal, wherein the plurality of subband signalsmay comprise a plurality of lowband signals indicative of the lowband signal. The audio encodermay comprise a compression unit configured to compress the plurality of lowband signals using a compression function, to provide a plurality of compressed lowband signals. The waveform data may be indicative of the plurality of compressed lowband signals and themetadatamay be indicative of the compression function used by the compression unit. Themetadata indicative of the spectral envelope of the highband signal may be applicable 6 EP 4 769 394 A2 5 10 15 20 25 30 35 40 45 50 55 to thesameportionof theaudiosignal as themetadata indicativeof thecompression function. Inotherwords, themetadata indicative of the spectral envelope of the highband signal may be in synchronicity with the metadata indicative of the compression function
[0037] According to a further aspect, a data stream comprising a sequence of access units for a sequence of frames of an audio signal, respectively, is described. An access unit from the sequence of access units comprises waveform data and metadata. The waveform data and the metadata are associated with the same particular frame of the sequence of frames of the audio signal. The waveform data and the metadata may be indicative of a reconstructed frame of the particular frame. In anexample, the particular frameof the audio signal comprisesa lowband signal andahighbandsignal, wherein thewaveformdata is indicativeof the lowbandsignal andwherein themetadata is indicativeofa spectral envelope of the highband signal. The metadata may enable an audio decoder to generate the highband signal from the lowband signal, using an HFR scheme. Alternatively or in addition, the metadata may be indicative of a compression function applied to the lowbandsignal. Hence, themetadatamayenable theaudio decoder to performanexpansion of thedynamic range of the received lowband signal (using an inverse of the compression function).
[0038] According to a further aspect, amethod for determining a reconstructed frame of an audio signal from an access unit of a received data stream is described. The access unit comprises waveform data and metadata, wherein the waveformdata and themetadata are associatedwith the same reconstructed frameof the audio signal. In anexample, the reconstructed frame of the audio signal comprises a lowband signal and a highband signal, wherein the waveform data is indicative of the lowband signal (e.g. of frequency coefficients describing the lowband signal) andwherein themetadata is indicative of a spectral envelope of the highband signal (e.g. of scale factors for a plurality of scale factor bands of the highband signal). Themethod comprises generating a plurality of waveform subband signals from thewaveformdata and generating decoded metadata from the metadata. Furthermore, the method comprises time-aligning the plurality of waveform subband signals and the decoded metadata, as described in the present document. In addition, the method comprises generating the reconstructed frame of the audio signal from the time-aligned plurality of waveform subband signals and decoded metadata.
[0039] According toanotheraspect, amethod forencodinga frameofanaudiosignal intoanaccessunit of adatastream is described. The frame of the audio signal is encoded such that the access unit comprises waveform data andmetadata. The waveform data and the metadata are indicative of a reconstructed frame of the frame of the audio signal, In an example, the frame of the audio signal comprises a lowband signal and a highband signal, and the frame is encoded such that thewaveformdata is indicative of the lowband signal and such that themetadata is indicative of a spectral envelope of the highbandsignal. Themethodcomprisesgenerating thewaveformdata from the frameof the audio signal, e.g. from the lowband signal and generating themetadata from the frameof the audio signal, e.g. from the highband signal and from the lowband signal (e.g. in accordance to an HFR scheme). In addition, the method comprises time-aligning the waveform data and the metadata such that the access unit for the frame of the audio signal comprises the waveform data and the metadata for the same frame of the audio signal.
[0040] According to a further aspect, a software program is described. The software program may be adapted for execution on a processor and for performing the method steps outlined in the present document when carried out on the processor.
[0041] According to another aspect, a storagemedium (e.g. a non-transitory storagemedium) is described. The storage medium may comprise a software program adapted for execution on a processor and for performing the method steps outlined in the present document when carried out on the processor.
[0042] According to a further aspect, a computer program product is described. The computer program may comprise executable instructions for performing themethod steps outlined in the present document when executed on a computer.
[0043] It should be noted that the methods and systems including its preferred embodiments as outlined in the present patent application may be used stand-alone or in combination with the other methods and systems disclosed in this document. Furthermore, all aspects of the methods and systems outlined in the present patent application may be arbitrarily combined. In particular, the features of the claims may be combined with one another in an arbitrary manner. SHORT DESCRIPTION OF THE FIGURES
[0044] The invention is explained below in an illustrativemannerwith reference to theaccompanying drawings,wherein Fig. 1 shows a block diagram of an example audio decoder; Fig. 2a shows a block diagram of another example audio decoder; Fig. 2b shows a block diagram of an example audio encoder; and Fig. 3a shows a block diagram of an example audio decoder which is configured to perform audio expansion; Fig. 3b shows a block diagram of an example audio encoder which is configured to perform audio compression; and Fig. 4 illustrates an example framing of a sequence of frames of an audio signal. 7 EP 4 769 394 A2 5 10 15 20 25 30 35 40 45 50 55 DETAILED DESCRIPTION OF THE INVENTION
[0045] As indicated above, the present document relates to metadata alignment. In the following the alignment of metadata is outlined in the context of anMPEGHE (High Efficiency) AAC (Advanced Audio Coding) scheme. It should be noted, however, that theprinciplesofmetadataalignmentwhicharedescribed in thepresent document arealsoapplicable to other audio encoding / decoding systems. In particular, the metadata alignment schemes which are described in the present document are applicable to audio encoding / decoding systems which make use of HFR (High Frequency Reconstruction) and / or SBR (Spectral Bandwidth Replication) and which transmit HFR / SBR metadata from an audio encoder to a corresponding audio decoder. Furthermore, the metadata alignment schemes which are described in the present document are applicable to audio encoding / decoding systems which make use of applications in a subband (notable a QMF) domain. An example for such an application is SBR. Other examples are A-coupling, post-processing, etc. In the following, the metadata alignment schemes are described in the context of the alignment of SBR metadata. It should benoted, however, that themetadata alignment schemesare also applicable to other types ofmetadata, notably to other types of metadata in the subband domain.
[0046] An MPEG HE-AAC data stream comprises SBR metadata (also referred to as A-SPX metadata). The SBR metadata in a particular encoded frame of the data stream (also referred to as an AU (access unit) of the data stream) typically relates to waveform (W) data in the past. In other words, The SBR metadata and the waveform data comprised within anAUof the data stream typically do not correspond to the same frameof the original audio signal. This is due to the fact that after decoding of the waveform data, the waveform data is submitted to several processing steps (such as an IMDCT (inverse Modified Discrete Cosine Transform and a QMF (Quadrature Mirror Filter) Analysis) which introduce a signal delay. At the point where the SBRmetadata is applied to the waveform data, the SBRmetadata is in synchronicity with the processed waveform data. As such, the SBR metadata and the waveform data are inserted into the MPEG HE- AAC data stream such that the SBR metadata reaches the audio decoder, when the SBR metadata is needed for SBR processing at the audio decoder. This form of metadata delivery may be referred to as "Just-In-Time" (JIT) metadata delivery, as the SBRmetadata is inserted into the data stream such that the SBRmetadata can be directly applied within the signal or processing chain of the audio decoder.
[0047] JITmetadata deliverymay be beneficial for a conventional encode - transmit - decode processing chain, in order to reduce the overall coding delay and in order to reducememory requirements at the audio decoder. However, a splice of the data stream along the transmission path may lead to a mismatch between the waveform data and the corresponding SBRmetadata. Such amismatchmay lead to audible artifacts at the splicing point because wrong SBRmetadata is used for spectral band replication at the audio decoder.
[0048] In viewof the above, it is desirable to provide anaudio encoding / decoding systemwhichallows for the splicing of data streams, while at the same time maintaining a low overall coding delay.
[0049] Fig. 1 shows a block diagram of an example audio decoder 100which addresses the abovementioned technical problem. Inparticular, theaudiodecoder100ofFig. 1allows for thedecodingof datastreamswithAUs110whichcomprise the waveform data 111 of a particular segment (e.g. frame) of an audio signal and which comprise the corresponding metadata 112 of the particular segment of the audio signal. By providing audio decoders 100 that decode data streams comprisingAUs110with time-alignedwaveformdata 111and correspondingmetadata 112, consistent splicing of the data stream is enabled. In particular, it is ensured that the data streamcanbe spliced in such amanner that corresponding pairs of waveform data 111 and metadata 112 are maintained.
[0050] The audio decoder 100 comprises a delay unit 105 within the processing chain of the waveform data 111. The delay unit 105 may be placed post or downstream of the MDCT synthesis unit 102 and prior or upstream of the QMF synthesis unit 107 within the audio decoder 100. In particular, the delay unit 105 may be placed prior or upstream of the metadata application unit 106 (e.g. the SBR unit 106) which is configured to apply the decoded metadata 128 to the processed waveform data. The delay unit 105 (also referred to as the waveform delay unit 105) is configured to apply a delay (referred to as the waveform delay) to the processed waveform data. The waveform delay is preferably chosen so that the overall processing delay of the waveform processing chain or thewaveform processing path (e.g. from theMDCT synthesis unit 102 to the application of metadata in themetadata application unit 106) sums up to exactly one frame (or to an integermultiple thereof). By doing so, the parametric control data can be delayed by a frame (or amultiple thereof) and alignment within the AU 110 is achieved.
[0051] Fig. 1 shows components of an example audio decoder 100. The waveform data 111 taken from an AU 110 is decoded and de-quantized within a waveform decoding and de-quantization unit 101 to provide a plurality of frequency coefficients 121 (in the frequency domain). Theplurality of frequency coefficients 121 are synthesized into a (timedomain) lowband signal 122 using a frequency domain to time domain transform (e.g. an inverseMDCT,ModifiedDiscrete Cosine Transform) applied within the lowband synthesis unit 102 (e.g. the MDCT synthesis unit). Subsequently, the lowband signal 122 is transformed into a plurality of lowband subband signals 123 using an analysis unit 103. The analysis unit 103 may be configured to apply a quadrature mirror filter (QMF) bank to the lowband signal 122 to provide the plurality of lowband subband signals 123. Themetadata 112 is typically applied to the plurality of lowband subband signals 123 (or to 8 EP 4 769 394 A2 5 10 15 20 25 30 35 40 45 50 55 transposed versions thereof).
[0052] Themetadata112 from theAU110 isdecodedandde-quantizedwithinametadatadecodingandde-quantization unit 108 to provide the decodedmetadata 128. Furthermore, the audio decoder 100may comprise a further delay unit 109 (referred to as themetadata delay unit 109) which is configured to apply a delay (referred to as themetadata delay) to the decoded metadata 128. The metadata delay may correspond to an integer multiple of the frame length N, e.g. D1=N, wherein D1 is the metadata delay. As such, the overall delay of the metadata processing chain corresponds to D1, e.g. D1=N.
[0053] In order to ensure that the processed waveform data (i.e. the delayed plurality of lowband subband signals 123) and the processed metadata (i.e. the delayed decoded metadata 128) arrive at the metadata application unit 106 at the same time, the overall delay of the waveform processing chain (or path) should correspond to the overall delay of the metadata processing chain (or path) (i.e. to D1). Within the waveform processing chain, the lowband synthesis unit 102 typically inserts a delay of N / 2 (i.e. of half the frame length). The analysis unit 103 typically inserts a fixed delay (e.g. of 320 samples). Furthermore, a lookahead (i.e. a fixed offset betweenmetadata and waveform data) may need to be taken into account. In the case of MPEG HE-AAC such an SBR lookahead may correspond to 384 samples (represented by the lookahead unit 104). The lookahead unit 104 (which may also be referred to as the lookahead delay unit 104) may be configured to delay the waveform data 111 (e.g. delay the plurality of lowband subband signals 123) by a fixed SBR lookahead delay. The lookahead delay enables a corresponding audio encoder to determine the SBRmetadata based on a succeeding frame of the audio signal.
[0054] In order to provide anoverall delay of themetadata processing chainwhich corresponds to anoverall delay of the waveform processing chain, the waveform delay D2 should be such that: i.e. D2 = N / 2 - 320 - 384 (in case of D1=N).
[0055] Table 1shows thewaveformdelaysD2 for aplurality of different frame lengthsN. It canbeseen that themaximum waveformdelayD2 for thedifferent frame lengthsNofHE-AAC is928sampleswithanoverallmaximumdecoder latencyof 2177 samples. In otherwords, the alignment of thewaveformdata 111and the correspondingmetadata 112within a single AU 110 results in a maximum of 928 samples additional PCM delay. For the block of frame sizes N=1920 / 1536, the metadata is delayedby1 frame, and for framesizesN=960 / 768 / 512 / 384 themetadata is delayedby2 frames. Thismeans that theplayout delayat theaudiodecoder100 is increased independenceof theblocksizeN,and theoverall codingdelay is increased by 1 or 2 full frames. The maximum PCM delay at the corresponding audio encoder is 1664 samples (corresponding to the inherent latency of the audio decoder 100). Table 1 N Inverse MDCT (N / 2) QMF analysis SBR Lookahead Inherent latency (Σ) D2 Nb. of frames D1 QMF synthesis Overall Decoder latency 1920 960 320 384 1664 256 1 1920 257 2177 1536 768 320 384 1472 64 1 1536 257 1793 960 480 320 192 992 928 2 1920 257 2177 768 384 320 192 896 640 2 1536 257 1793 512 256 320 192 768 256 2 1024 257 1281 384 192 320 192 704 64 2 768 257 1025
[0056] As such, it is proposed in the present document to address the drawback of JIT metadata, by the use of signal- aligned-metadata112 (SAM)which is alignedwith the correspondingwaveformdata111 intoa singleAU110. In particular, it is proposed to introduce one ormore additional delay units into an audio decoder 100 and / or into a corresponding audio encoder such that every encoded frame (or AU) carries the (e.g. A-SPX)metadata it uses at a later processing stage, e.g. at the processing stage when the metadata is applied to the underlying waveform data.
[0057] It should be noted that - in principle - it could be considered to apply ametadata delay D1which corresponds to a fraction of the frame lengthN.By doing this, the overall coding delay could possibly be reduced.However, as showne.g. in Fig. 1, themetadatadelayD1 isapplied in theQMFdomain (i.e. in thesubbanddomain). In viewof thisand inviewof the fact that the metadata 112 is typically only defined once per frame, i.e. in view of the fact that the metadata 112 typically comprisesonededicatedparameter set per frame, the insertionofametadatadelayD1whichcorresponds toa fractionofa 9 EP 4 769 394 A2 5 10 15 20 25 30 35 40 45 50 55 frame lengthNmay lead to synchronization issueswith respect to thewaveformdata111.On theother hand, thewaveform delay D2 is applied in the time-domain (as shown in Fig. 1), where delays which correspond to a fraction of a frame can be implemented in a precise manner (e.g. by delaying the time domain signal by a number of samples which corresponds to thewaveformdelayD2).Hence, it is beneficial to delay themetadata 112by integermultiples of a frame (wherein the frame corresponds to the lowest time resolution for which the metadata 112 is defined) and to delay the waveform data 111 by a waveform delay D2 which may take on arbitrary values. A metadata delay D1 which corresponds to an integer multiple of the frame length N can be implemented in the subband domain in a precise manner, and a waveform delay D2 which corresponds to an arbitrary multiple of a sample can be implemented in the time domain in a precise manner. Consequently, the combination of a metadata delay D1 and a waveform delay D2 allows for an exact synchronization of the metadata 112 and the waveform data 111.
[0058] The application of a metadata delay D1 which corresponds to a fraction of the frame length N could be implemented by re-sampling the metadata 112, in accordance to the metadata delay D1. However, the re-sampling of the metadata 112 typically involves substantial computational costs. Furthermore, the re-sampling of the metadata 112 may lead to a distortion of themetadata 112, thereby affecting the quality of the reconstructed frame of the audio signal. In view of this, it is beneficial, in view of computational efficiency and in view of audio quality, to limit themetadata delayD1 to integer multiples of the frame length N.
[0059] Fig. 1 also shows the further processing of the delayed metadata 128 and the delayed plurality of lowband subband signals 123. The metadata application unit 106 is configured to generate a plurality of (e.g. scaled) highband subband signals 126 based on the plurality of lowband subband signals 123 and based on the metadata 128. For this purpose, the metadata application unit 106 may be configured to transpose one or more of the plurality of lowband subband signals 123 to generate a plurality of highband subband signals. The transposition may comprise a copy-up processof theoneormoreof theplurality of lowbandsubbandsignals 123.Furthermore, themetadataapplicationunit 106 may be configured to apply the metadata 128 (e.g. scale factors comprised within the metadata 128) to the plurality of highband subband signals, in order to generate the plurality of scaled highband subband signals 126. The plurality of scaled highband subband signals 126 is typically scaled using the scale factors, such that the spectral envelope of the plurality of scaled highband subband signals 126mimics the spectral envelope of the highband signal of an original frame of the audio signal (which corresponds to a reconstructed frame of the audio signal 127 that is generated based on the plurality of lowband subband signals 123 and from the plurality of scaled highband subband signals 126).
[0060] Furthermore, the audio decoder 100 comprises a synthesis unit 107 configured to generate the reconstructed frame of an audio signal 127 from the plurality of lowband subband signals 123 and from the plurality of scaled highband subband signals 126 (e.g. using an inverse QMF bank).
[0061] Fig. 2a shows a block diagram of another example audio decoder 100. The audio decoder 100 of Fig. 2a comprises the same components as the audio decoder 100 of Fig. 1. Furthermore, example components 210 for multi- channel audio processing are illustrated. It can be seen that in the example of Fig. 2a, the waveform delay unit 105 is positioned directly subsequent to the inverse MDCT unit 102. The determination of a reconstructed frame of an audio signal 127 may be performed for each channel of a multi-channel audio signal (e.g. of a 5.1 or a 7.1 multi-channel audio signal).
[0062] Fig. 2b shows a block diagram of an example audio encoder 250 corresponding to the audio decoder 100 of Fig. 2a. The audio encoder 250 is configured to generate a data stream comprising AUs 110 which carries pairs of corresponding waveform data 111 and metadata 112. The audio encoder 250 comprises a metadata processing chain 256, 257, 258, 259, 260 for determining the metadata. The metadata processing chain may comprise a metadata delay unit 256 for aligning the metadata with the corresponding waveform data. In the illustrated example, the metadata delay unit 256 of the audio encoder 250 does not introduce any additional delay (because the delay introduced by themetadata processing chain is greater than the delay introduced by the waveform processing chain).
[0063] Furthermore, theaudio encoder 250comprisesawaveformprocessing chain251, 252, 253, 254, 255configured to determine the waveform data from an original audio signal at the input of the audio encoder 250. The waveform processing chain comprises a waveform delay unit 252 configured to introduce an additional delay into the waveform processing chain, in order to align the waveform data with the corresponding metadata. The delay which is introduced by thewaveform delay unit 252may be such that the overall delay of themetadata processing chain (including thewaveform delay inserted by thewaveformdelay unit 252) corresponds to the overall delay of thewaveformprocessing chain. In case of a frame length N=2048, the delay of the waveform delay unit 252 may be 2048‑320 = 1728 samples.
[0064] Fig. 3a shows an excerpt of an audio decoder 300 which comprises an expanding unit 301. The audio decoder 300 of Fig. 3amay correspond to the audio decoder 100 of Figs. 1 and / or 2a and further comprises the expanding unit 301 which is configured to determine a plurality of expanded lowband signals from the plurality of lowband signals 123, using one ormore expanding parameters 310 taken from the decodedmetadata 128 of an access unit 110. Typically, the one or more expanding parameters 310 are coupled with SBR (e.g. A-SPX) metadata comprised within an access unit 110. In otherwords, the oneormore expanding parameters 310 are typically applicable to the sameexcerpt or portion of an audio signal as the SBR metadata. 10 EP 4 769 394 A2 5 10 15 20 25 30 35 40 45 50 55
[0065] As outlined above, themetadata 112 of an access unit 110 is typically associatedwith thewaveformdata 111 of a frame of an audio signal, wherein the frame comprises a pre-determined number N of samples. The SBR metadata is typically determined based on a plurality of lowband signals (also referred to as a plurality of waveform subband signals), wherein the plurality of lowband signals may be determined using a QMF analysis. The QMF analysis yields a time- frequency representation of a frame of an audio signal. In particular, the N samples of a frame of an audio signal may be represented byQ (e.g.Q=64) lowband signals, each comprisingN / Q time slots or slots. For a framewithN=2048 samples and for Q=64, each lowband signal comprises N / Q=32 slots.
[0066] In case of a transient within a particular frame, it may be beneficial to determine the SBR metadata based on samples of a directly succeeding frame. This feature is referred to as the SBR lookahead. In particular, the SBRmetadata may be determined based on a pre-determined number of slots from the succeeding frame. By way of example, up to 6 slots of the succeeding frame may be taken into consideration (i.e. Q*6=384 samples).
[0067] Theuseof theSBR lookahead is illustrated inFig. 4which showsa sequence of frames401, 402, 403 of an audio signal, using different framings 400, 430 for the SBR or HFR scheme. In the case of framing 400, the SBR / HFR scheme doesnotmakeuseof theflexibility providedby theSBR lookahead.Nevertheless, afixedoffset, i.e. a fixedSBR lookahead delay, 480 is used to enable theuseof theSBR lookahead. In the illustrated example, the fixedoffset corresponds to6 time slots. Asa result of this fixedoffset 480, themetadata112of aparticular accessunit 110of aparticular frame402 is partially applicable to time slots of waveform data 111 comprised within the access unit 110 which precedes the particular access unit 110 (and which is associated with the directly preceding frame 401). This is illustrated by the offset between the SBR metadata 411, 412, 413 and the frames 401, 402, 403. Hence, the SBR metadata 411, 412, 413 comprised within an access unit 110 may be applicable to waveform data 111 which is offset by the SBR lookahead delay 480. The SBR metadata 411, 412, 413 is applied to the waveform data 111 to provide the reconstructed frames 421, 422, 423.
[0068] The framing 430 makes use of the SBR lookahead. It can be seen that the SBR metadata 431 is applicable to more than32 timeslotsofwaveformdata111, e.g. due to theoccurrenceof a transientwithin frame401.On theother hand, the succeedingSBRmetadata 432 is applicable to less than 32 time slots of waveformdata 111. TheSBRmetadata 433 is again applicable to 32 time slots. Hence, the SBR lookahead allows for flexibility with regards to the temporal resolution of theSBRmetadata. It should be noted that, regardless the use of theSBR lookahead and regardless the applicability of the SBRmetadata431, 432, 433, the reconstructed frames421,422, 423aregeneratedusingafixedoffset480with respect to the frames 401, 402, 403.
[0069] Anaudioencodermaybeconfigured todetermine theSBRmetadataand theoneormoreexpandingparameters using the sameexcerpt or portion of the audio signal. Hence, if theSBRmetadata is determined using anSBR lookahead, the one or more expanding parameters may be determined and may be applicable for the same SBR lookahead. In particular, the one or more expanding parameters may be applicable for the same number of time slots as the corresponding SBR metadata 431, 432, 433.
[0070] The expanding unit 301 may be configured to apply one or more expanding gains to the plurality of lowband signals 123, wherein the one ormore expanding gains typically depend on the one ormore expanding parameters 310. In particular, the one ormore expanding parameters 310may have an impact on one ormore compression / expanding rules whichareused todetermined theoneormoreexpandinggains. Inotherwords, theoneormoreexpandingparameters310 may be indicative of the compression function which has been used by a compression unit of the corresponding audio encoder. The one or more expanding parameters 310 may enable the audio decoder to determine the inverse of this compression function.
[0071] The one or more expanding parameters 310 may comprise a first expanding parameter indicative of whether or not the corresponding audio encoder has compressed the plurality of lowband signals. If no compression has been applied, then no expansion will be applied by the audio decoder. As such, the first expanding parameter may be used to turn on or off the companding feature.
[0072] Alternatively or in addition, the one or more expanding parameters 310 may comprise a second expanding parameter indicative of whether or not the same one or more expansion gains are to be applied to all of the channels of a multi-channel audio signal. As such, the second expanding parameter may switch between a per-channel or a per-multi- channel application of the companding feature.
[0073] Alternatively or in addition, the one or more expanding parameters 310 may comprise a third expanding parameter indicative of whether or not to apply the same one or more expanding gains for all the time slots of a frame. As such, the third expanding parameter may be used to control the temporal resolution of the companding feature.
[0074] Using the one or more expanding parameters 310, the expanding unit 301 may determine the plurality of expanded lowbandsignals, byapplying the inverseof a compression functionappliedat the correspondingaudioencoder. The compression function which has been applied at the corresponding audio encoder is signaled to the audio decoder 300 using the one or more expanding parameters 310.
[0075] The expanding unit 301 may be positioned downstream of the lookahead delay unit 104. This ensures that the one or more expanding parameters 310 are applied to the correct portion of the plurality of lowband signals 123. In particular, this ensures that the one or more expanding parameters 310 are applied to the same portion of the plurality of 11 EP 4 769 394 A2 5 10 15 20 25 30 35 40 45 50 55 lowbandsignals123as theSBRparameters (within theSBRapplicationunit 106).Assuch, it is ensured that theexpanding operates on the same time framing 400, 430 as the SBR scheme. Due to the SBR lookahead, the framing 400, 430 may comprise a variable number of time slots, and by consequence, the expanding may operate on a variable number of time slots (as outlined in the context of Fig. 4). By placing theexpanding unit 301 downstreamof the lookaheaddelay unit 104, it is ensured that the correct framing 400, 430 is applied to the one ormore expanding parameters. As a result of this, a high quality audio signal can be ensured, even subsequent to a splicing point.
[0076] Fig. 3b shows an excerpt of an audio encoder 350 comprising a compression unit 351. The audio encoder 350 may comprise the components of the audio encoder 250 of Fig. 2b. The compression unit 351 may be configured to compress (e.g. reduce the dynamic range) of the plurality of lowband signals, using a compression function. Furthermore, the compression unit 351may be configured to determine one or more expanding parameters 310 which are indicative of the compression function that has been used by the compression unit 351, to enable a corresponding expanding unit 301 of an audio decoder 300 to apply an inverse of the compression function.
[0077] The compression of the plurality of lowband signals may be performed downstream of an SBR lookahead 258. Furthermore, the audio encoder 350 may comprise an SBR framing unit 353 which is configured to ensure that the SBR metadata is determined for the same portion of the audio signal as the one or more expanding parameters 310. In other words, the SBR framing unit 353 may ensure that the SBR scheme operates on the same framing 400, 430 as the companding scheme. In viewof the fact that theSBRschememayoperate onextended frames (e.g. in caseof transients), the companding scheme may also operate on extended frames (comprising additional time slots).
[0078] In thepresent document, anaudioencoderandacorrespondingaudio decoderhavebeendescribedwhichallow for the encoding of an audio signal into a sequence of time-aligned AUs comprising waveform data and metadata associatedwithasequenceof segmentsof theaudiosignal, respectively.Theuseof time-alignedAUsenables thesplicing of data streams with reduced artifacts at the splicing points. Furthermore, the audio encoder and audio decoder are designed such that the splicable data streams are processed in a computationally efficient manner and such that the overall coding delay remains low.
[0079] Themethodsand systemsdescribed in thepresent documentmaybe implementedas software, firmwareand / or hardware. Certain components may e.g. be implemented as software running on a digital signal processor or micro- processor.Other componentsmaye.g. be implementedashardware andor asapplication specific integrated circuits. The signals encountered in the described methods and systems may be stored on media such as random access memory or optical storage media. They may be transferred via networks, such as radio networks, satellite networks, wireless networks or wireline networks, e.g. the Internet. Typical devicesmaking use of themethods and systems described in the present document are portable electronic devices or other consumer equipment which are used to store and / or render audio signals.
[0080] Various aspects of the present invention may be appreciated from the following enumerated example embodi- ments (EEEs): EEE1. An audio decoder (100, 300) configured to determine a reconstructed frame of an audio signal (127) from an access unit (110) of a received data stream; wherein the access unit (110) comprises waveform data (111) and metadata (112); wherein thewaveformdata (111) and themetadata (112) are associatedwith the same reconstructed frame of the audio signal (127); wherein the audio decoder (100, 300) comprises - a waveform processing path (101, 102, 103, 104, 105) configured to generate a plurality of waveform subband signals (123) from the waveform data (111); - ametadata processing path (108, 109) configured to generate decodedmetadata (128) from themetadata (111); and - ametadata application and synthesis unit (106, 107) configured to generate the reconstructed frameof the audio signal (127) from the plurality of waveform subband signals (123) and from the decodedmetadata (128); wherein the waveform processing path (101, 102, 103, 104, 105) and / or the metadata processing path (108, 109) comprise at least one delay unit (105, 109) configured to time-align the plurality of waveform subband signals (123) and the decoded metadata (128). EEE2.Theaudio decoder (100, 300) ofEEE1,wherein theat least onedelayunit (105, 109) is configured to time-align the plurality of waveform subband signals (123) and the decoded metadata (128) such that an overall delay of the waveform processing path (101, 102, 103, 104, 105) corresponds to an overall delay of metadata processing path (108, 109). EEE3. The audio decoder (100, 300) of any previous EEE, wherein the at least one delay unit (105, 109) is configured to time-align theplurality ofwaveformsubbandsignals (123) and thedecodedmetadata (128) such that theplurality of waveform subband signals (123) and the decoded metadata (128) are provided to the metadata application and synthesis unit (106, 107) just-in-time for the processing performed by the metadata application and synthesis unit 12 EP 4 769 394 A2 5 10 15 20 25 30 35 40 45 50 55 (106, 107). EEE4. The audio decoder (100, 300) of any previous EEE, wherein the metadata processing path (108, 109) comprises ametadata delay unit (109) configured to delay the decodedmetadata (128) by an integermultiple greater zero of a frame length N of the reconstructed frame of the audio signal (127). EEE5. The audio decoder (100, 300) of EEE 4, wherein the integer multiple is such that the delay introduced by the metadata delay unit (109) is greater than a delay introduced by the processing of thewaveform processing path (101, 102, 103, 104, 105). EEE6. The audio decoder (100, 300) of any of EEEs 4 to 5, wherein the integer multiple is one for frame lengths N greater than 960 and wherein the integer multiple is two for frame lengths N smaller than or equal to 960. EEE7.Theaudiodecoder (100,300)of anypreviousEEE,wherein thewaveformprocessingpath (101,102, 103,104, 105) comprises awaveformdelay unit (105) configured to delay the plurality of waveform subband signals (123) such that an overall delay of the waveform processing path corresponds to an integer multiple greater than zero of a frame length N of the reconstructed frame of the audio signal (127). EEE8.Theaudiodecoder (100,300)of anypreviousEEE,wherein thewaveformprocessingpath (101,102, 103,104, 105) comprises - a decoding and de-quantization unit (101) configured to decode and de-quantize the waveform data (111) to provide a plurality of frequency coefficients (121) indicative of the waveform signal; - awaveform synthesis unit (102) configured to generate thewaveform signal (122) from the plurality of frequency coefficients (121); and - an analysis unit (103) configured to generate the plurality of waveform subband signals (123) from the waveform signal (122). EEE9. The audio decoder (100, 300) of EEE 8, wherein - the waveform synthesis unit (102) is configured to perform a frequency domain to time domain transform; - the analysis unit (103) is configured to perform a time domain to subband domain transform; and - a frequency resolutionof the transformperformedby thewaveformsynthesis unit (102) is higher thana frequency resolution of the transform performed by the analysis unit (103). EEE10. The audio decoder (100, 300) of EEE 9, wherein - the waveform synthesis unit (102) is configured to perform an inverse modified discrete cosine transform; and - the analysis unit (103) is configured to apply a quadrature mirror filter bank. EEE11. The audio decoder (100, 300) of any of EEEs 8 to 10, wherein - the waveform synthesis unit (102) introduces a delay which depends on a frame length N of the reconstructed frame of the audio signal (127); and / or - the analysis unit (103) introduces a fixed delay which is independent of the frame length N of the reconstructed frame of the audio signal (127). EEE12. The audio decoder (100, 300) of EEE 11, wherein - the delay introduced by the waveform synthesis unit (102) corresponds to half the frame length N; and / or - the fixed delay introduced by the analysis unit (103) corresponds to 320 samples of the audio signal. EEE13. The audio decoder (100, 300) of any of EEEs 8 to 12, wherein the overall delay of the waveform processing path (101, 102, 103, 104, 105) depends on a pre-determined lookahead betweenmetadata (112) andwaveform data (111). EEE14. The audio decoder (100, 300) of EEE 13, wherein the pre-determined lookahead corresponds to 192 or 384 samples of the audio sample. EEE15. The audio decoder (100, 300) of any previous EEE, wherein - the decoded metadata (128) comprises one or more expanding parameters (310); - the audio decoder (100, 300) comprises an expanding unit (301) configured to generate a plurality of expanded waveformsubband signals basedon theplurality ofwaveformsubband signals, using theoneormoreexpanding parameters (310); and 13 EP 4 769 394 A2 5 10 15 20 25 30 35 40 45 50 55 - the reconstructed frameof the audio signal (127) is determined from the plurality of expandedwaveformsubband signals. EEE16. The audio decoder (100, 300) of EEE 15, wherein - theaudiodecoder (100, 300) comprisesa lookaheaddelayunit (104) configured todelay theplurality ofwaveform subband signals (123) in accordance to a pre-determined lookahead, to yield a plurality of delayed waveform subband signals (123); and - the expanding unit (301) is configured to generate the plurality of expanded waveform subband signals by expanding the plurality of delayed waveform subband signals. EEE17. The audio decoder (100, 300) of any of EEEs 15 to 16, wherein - the expanding unit (301) is configured to generate the plurality of expanded waveform subband signals using an inverse of a pre-determined compression function; and - the one or more expanding parameters (310) are indicative of the inverse of the pre-determined compression function. EEE18. The audio decoder (100, 300) of any of EEEs 15 to 17, wherein - the metadata application and synthesis unit (106, 107) is configured to generate the reconstructed frame of the audio signal (127) by using the decoded metadata (128) for a temporal portion of the plurality of waveform subband signals (123); and - the expanding unit (301) is configured to generate the plurality of expanded waveform subband signals by using the one or more expanding parameters (310) for the same temporal portion of the plurality of waveform subband signals. EEE19. The audio decoder (100, 300) of EEE 18, wherein a temporal length of the temporal portion of the plurality of waveform subband signals (123) is variable. EEE20. The audio decoder (100, 300) of any of EEEs 8 to 19, wherein the waveform delay unit (105) is configured to delay the waveform signal (122); wherein the waveform signal (122) is represented in the time domain. EEE21.Theaudio decoder (100, 300)of anypreviousEEE,wherein themetadataapplicationandsynthesisunit (106, 107) is configured to process the decodedmetadata (128) and the plurality of waveform subband signals (123) in the subband domain. EEE22. The audio decoder (100, 300) of any previous EEE, wherein - the reconstructed frame of the audio signal (127) comprises a lowband signal and a highband signal; - the plurality of waveform subband signals (123) are indicative of the lowband signal; - the metadata (112) is indicative of a spectral envelope of the highband signal; and - the metadata application and synthesis unit (106, 107) comprises a metadata application unit (106) which is configured to perform high frequency reconstruction using the plurality of waveform subband signals (123) and the decoded metadata (128). EEE23. The audio decoder (100, 300) of EEE 22, wherein the metadata application unit (106) is configured to - transpose one or more of the plurality of waveform subband signals (123) to generate a plurality of highband subband signals; and - apply the decoded metadata (128) to the plurality of highband subband signals to provide a plurality of scaled highband subband signals (126); wherein the plurality of scaled highband subband signals (126) is indicative of the highband signal of the reconstructed frame of the audio signal (127). EEE24. The audio decoder (100, 300) of EEE 23, wherein the metadata application and synthesis unit (106, 107) further comprises a synthesis unit (107) configured to generate the reconstructed frameof the audio signal (127) from the plurality of waveform subband signals (123) and from the plurality of scaled highband subband signals (126). EEE25. The audio decoder (100, 300) of EEE 24 referring back to EEE 9, wherein the synthesis unit (107) is configured to perform an inverse transform with respect to the transform performed by the analysis unit (103). EEE26.Anaudioencoder (250, 350) configured toencodea frameofanaudio signal intoanaccessunit (110) of adata 14 EP 4 769 394 A2 5 10 15 20 25 30 35 40 45 50 55 stream;wherein theaccessunit (110) compriseswaveformdata (111)andmetadata (112);wherein thewaveformdata (111) and themetadata (112) are indicativeof a reconstructed frameof the frameof theaudio signal; wherein theaudio encoder (250, 350) comprises - a waveform processing path (251, 252, 253, 254, 255) configured to generate the waveform data (111) from the frame of the audio signal; and - ametadataprocessingpath (256, 257,258, 259, 260) configured togenerate themetadata (111) from the frameof the audio signal; wherein the waveform processing path and / or the metadata processing path comprise at least one delay unit (252, 256) configured to time-align the waveform data (111) and the metadata (128) such that the access unit (110) for the frame of the audio signal comprises the waveform data (111) and the metadata (111) for the same frame of the audio signal. EEE27. The audio encoder (250, 350) of EEE 26, wherein the at least one delay unit (252, 256) is configured to time- align thewaveformdata (111) and themetadata (111) such that anoverall delayof thewaveformprocessingpath (251, 252, 253, 254, 255) corresponds to an overall delay of the metadata processing path (256, 257, 258, 259, 260). EEE28. The audio encoder (250, 350) of any of EEEs 26 to 27, wherein the at least one delay unit (105, 109) is configured to time-align the waveform data (111) and the metadata (111) such that the waveform data (111) and the metadata (111) are provided to an access unit generation unit of the audio encoder (250, 350) just-in-time for generating a single access unit (110) from the waveform data (111) and from the metadata (111). EEE29. The audio encoder (250, 350) of any of EEEs26 to 28,wherein thewaveformprocessing path (251, 252, 253, 254, 255) comprises awaveformdelay unit (252) configured to insert a delay into thewaveformprocessing path (251, 252, 253, 254, 255). EEE30. The audio encoder (250, 350) of any of EEEs 26 to 29, wherein - the frame of the audio signal comprises a lowband signal and a highband signal; - the waveform data (111) is indicative of the lowband signal; - the metadata (112) is indicative of a spectral envelope of the highband signal; - the waveform processing path (251, 252, 253, 254, 255) is configured to generate the waveform data (111) from the lowband signal; and - the metadata processing path (256, 257, 258, 259, 260) is configured to generate the metadata (111) from the lowband signal and from the highband signal. EEE31. The audio encoder (250, 350) of EEE 30, wherein - the audio encoder (250, 350) comprises an analysis unit (257) configured to generate a plurality of subband signals from the frame of the audio signal; - the plurality of subband signals comprises a plurality of lowband signals indicative of the lowband signal; - theaudio encoder (250, 350) comprisesa compressionunit (351) configured to compress theplurality of lowband signals using a compression function, to provide a plurality of compressed lowband signals; - the waveform data (111) is indicative of the plurality of compressed lowband signals; and - the metadata (112) is indicative of the compression function used by the compression unit (351). EEE32.Theaudio encoder (250, 350) ofEEE31,wherein themetadata (112) indicativeof the spectral envelopeof the highband signal is applicable to the same portion of the audio signal as the metadata (112) indicative of the compression function. EEE33. A data stream comprising a sequence of access units (110) for a sequence of frames of an audio signal, respectively; wherein an access unit (110) from the sequence of access units (110) comprises waveform data (111) andmetadata (112); wherein thewaveformdata (111) and themetadata (112) are associatedwith the sameparticular frame of the sequence of frames of the audio signal; wherein the waveform data (111) and the metadata (112) are indicative of a reconstructed version of the particular frame. EEE34. Thedata streamofEEE33,wherein theparticular frameof the audio signal comprises a lowband signal and a highband signal; wherein thewaveformdata (111) is indicative of the lowband signal; andwherein themetadata (112) is indicative of a spectral envelope of the highband signal. EEE35. The data stream of any of EEEs 33 to 34, wherein the metadata (112) is indicative of a compression function applied to the lowband signal. EEE36. A method for determining a reconstructed frame of an audio signal (127) from an access unit (110) of a received data stream; wherein the access unit (110) compriseswaveform data (111) andmetadata (112); wherein the waveform data (111) and the metadata (112) are associated with the same reconstructed frame of the audio signal 15 EP 4 769 394 A2 5 10 15 20 25 30 35 40 45 50 55 (127); wherein the method comprises - generating a plurality of waveform subband signals (123) from the waveform data (111); - generating decoded metadata (128) from the metadata (111); - time-aligning the plurality of waveform subband signals (123) and the decoded metadata (128); and - generating the reconstructed frameof the audio signal (127) from the time-aligned plurality of waveform subband signals (123) and decoded metadata (128). EEE37. A method for encoding a frame of an audio signal into an access unit (110) of a data stream; wherein the access unit (110) comprises waveform data (111) and metadata (112); wherein the waveform data (111) and the metadata (112) are indicative of a reconstructed frameof the frameof the audio signal; wherein themethod comprises - generating the waveform data (111) from the frame of the audio signal; - generating themetadata (111) from the frame of the audio signal; and time-aligning the waveform data (111) and themetadata (128) such that the access unit (110) for the frame of the audio signal comprises thewaveform data (111) and the metadata (111) for the same frame of the audio signal. Claims 1. An audio decoder apparatus for decoding an audio signal, the apparatus comprising: awaveformprocessingpath,wherein thewaveformprocessingpath is configured togeneratea representationof a time domain waveform signal in a subband domain from waveform data obtained from an access unit of a received data stream that comprises the audio signal; ametadataprocessingpathconfigured togeneratedecodedmetadata frommetadatacorresponding to thesame access unit, wherein thewaveformdata and themetadata are associatedwith a same reconstructed frame of the audio signal, wherein the metadata processing path comprises a metadata delay unit configured to apply a metadata delay to the decodedmetadata for allowing to time-align an overall delay of the waveform data and the decoded metadata, wherein the metadata delay has a value greater than zero, and wherein the value of the metadata delay is a fraction of a frame length; and ametadata applicationand synthesis unit configured togenerate the reconstructed frameof the audio signal from the processed waveform data and from the delayed decoded metadata; wherein the processed waveform data and the decoded metadata are time-aligned, such that an overall delay of the waveform processing path corresponds to an overall delay of the metadata processing path. 2. A method of decoding an audio signal, the method comprising: generating, using a waveform processing path, a representation of a time domain waveform signal in a subband domain from waveform data obtained from an access unit of a received data stream that comprises the audio signal; generating, using a metadata processing path, decoded metadata from metadata corresponding to the same access unit, wherein thewaveformdata and themetadata are associatedwith a same reconstructed frame of the audio signal, wherein the metadata processing path comprises a metadata delay unit configured to apply a metadata delay to the decodedmetadata for allowing to time-align an overall delay of the waveform data and the decoded metadata, wherein the metadata delay has a value greater than zero, and wherein the value of the metadata delay is a fraction of a frame length; and generating, using a metadata application and synthesis unit, the reconstructed frame of the audio signal from the processed waveform data and from the delayed decoded metadata; wherein the processed waveform data and the decoded metadata are time-aligned, such that an overall delay of the waveform processing path corresponds to an overall delay of metadata processing path. 3. A non-transitory storagemedium adapted for execution on a processor and for causing the processor to perform the method of claim 2 when carried out on the processor. 16 EP 4 769 394 A2 5 10 15 20 25 30 35 40 45 50 55 17 EP 4 769 394 A2 18 EP 4 769 394 A2 19 EP 4 769 394 A2 20 EP 4 769 394 A2 21 EP 4 769 394 A2 22 EP 4 769 394 A2 23 EP 4 769 394 A2 REFERENCES CITED IN THE DESCRIPTION This list of references cited by the applicant is for the reader’s convenience only. It does not form part of the European patent document. Even though great care has been taken in compiling the references, errors or omissions cannot be excluded and the EPO disclaims all liability in this regard. Patent documents cited in the description • US 61877194
[0001] • US 61909593
[0001] • EP 21203084
[0002] (19) *EP004769394A3* (11) EP 4 769 394 A3 (12) EUROPEAN PATENT APPLICATION (88) Date of publication A3: 15.07.2026 Bulletin 2026 / 29 (43) Date of publication A2: 01.07.2026 Bulletin 2026 / 27 (21) Application number: 26164804.2 (22) Date of filing: 08.09.2014 (51) International Patent Classification (IPC): G10L 21 / 0388 (2013.01) (52) Cooperative Patent Classification (CPC): G10L 21 / 0388 (84) Designated Contracting States: AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR (30) Priority: 12.09.2013 US 201361877194 P 27.11.2013 US 201361909593 P (62) Document number(s) of the earlier application(s) in accordance with Art. 76 EPC: 21203084.5 / 3 975 179 19183863.0 / 3 582 220 17192420.2 / 3 291 233 14759217.4 / 3 044 790 (71) Applicant: Dolby International AB Dublin, D02 VK60 (IE) (72) Inventors: • KJOERLING, Kristofer 113 30 Stockholm (SE) • PURNHAGEN, Heiko 113 30 Stockholm (SE) • POPP, Jens 90429 Nuremberg (DE) (74) Representative: Dolby International AB Patent Group Europe 77 Sir John Rogerson’s Quay Block C Grand Canal Docklands Dublin, D02 VK60 (IE) (54) TIME‑ALIGNMENT OF QMF BASED PROCESSING DATA (57) Thepresent document relates to time-alignment of encoded data of an audio encoder with associated metadata, such as spectral band replication (SBR) me- tadata. An audio decoder (100, 300) configured to de- termine a reconstructed frame of an audio signal (237) from an access unit (110) of a received data stream is described. The access unit (110) comprises waveform data (111) and metadata (112), wherein the waveform data (111) and themetadata (112) areassociatedwith the same reconstructed frame of the audio signal (127). The audio decoder (100, 300) comprises awaveform proces- sing path (101, 102, 103, 104, 105) configured to gen- erate a plurality of waveform subband signals (123) from the waveform data (111), and a metadata processing path (108, 109) configured to generate decoded meta- data (128) from the metadata (111). EP 4 76 9 39 4 A 3 Processed by Luminess, 75001 PARIS (FR) 2 EP 4 769 394 A3 5 10 15 20 25 30 35 40 45 50 55 3 EP 4 769 394 A3 5 10 15 20 25 30 35 40 45 50 55 4 EP 4 769 394 A3 5 10 15 20 25 30 35 40 45 50 55 摘要 本文档涉及音频编码器的编码数据与诸如频带复制(SBR)元数据之类的关联元数据 的时间对齐。描述了一种被配置为根据接收到的数据流的存取单元(110)来确定音频 信号(237)的重构帧的音频解码器(100,300)。存取单元(110)包括波形数据 (111)和元数据(112),其中波形数据(111)和元数据(112)与音频信号(127) 的同一重构帧相关联。音频解码器(100,300)包括被配置为根据波形数据(111)生 成多个波形子带信号(123)的波形处理路径(101,102,103,104,105),以及被配 置为根据元数据(111)生成解码后的元数据(128)的元数据处理路径(108,109)。
Claims
1. An audio decoder apparatus for decoding an audio signal, the apparatus comprising: a waveform processing path, wherein the waveform processing path is configured to generate a representation of a time domain waveform signal in a subband domain from waveform data obtained from an access unit of a received data stream that comprises the audio signal; a metadata processing path configured to generate decoded metadata from metadata corresponding to the same access unit, wherein the waveform data and the metadata are associated with a same reconstructed frame of the audio signal, wherein the metadata processing path comprises a metadata delay unit configured to apply a metadata delay to the decoded metadata for allowing to time-align an overall delay of the waveform data and the decoded metadata, wherein the metadata delay has a value greater than zero, and wherein the value of the metadata delay is a fraction of a frame length; and a metadata application and synthesis unit configured to generate the reconstructed frame of the audio signal from the processed waveform data and from the delayed decoded metadata; wherein the processed waveform data and the decoded metadata are time-aligned, such that an overall delay of the waveform processing path corresponds to an overall delay of the metadata processing path.
2. A method of decoding an audio signal, the method comprising: generating, using a waveform processing path, a representation of a time domain waveform signal in a subband domain from waveform data obtained from an access unit of a received data stream that comprises the audio signal; generating, using a metadata processing path, decoded metadata from metadata corresponding to the same access unit, wherein the waveform data and the metadata are associated with a same reconstructed frame of the audio signal, wherein the metadata processing path comprises a metadata delay unit configured to apply a metadata delay to the decoded metadata for allowing to time-align an overall delay of the waveform data and the decoded metadata, wherein the metadata delay has a value greater than zero, and wherein the value of the metadata delay is a fraction of a frame length; and generating, using a metadata application and synthesis unit, the reconstructed frame of the audio signal from the processed waveform data and from the delayed decoded metadata; wherein the processed waveform data and the decoded metadata are time-aligned, such that an overall delay of the waveform processing path corresponds to an overall delay of metadata processing path.
3. A non-transitory storage medium adapted for execution on a processor and for causing the processor to perform the method of claim 2 when carried out on the processor.
