Audio signal processing method and apparatus for controlling loudness level

By acquiring loudness metadata through an audio signal processing device and adjusting the output loudness level using QSHI and loudness gain, the inconvenience caused by differences in audio signal loudness is resolved, and the audio signal loudness level is stabilized and sound quality is maintained.

CN116962954BActive Publication Date: 2026-11-17GAUDI AUDIO LAB
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310881169.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-10-07
Filing Date
2020-03-12
Publication Date
2026-11-17
Estimated Expiration
2040-03-12

AI Technical Summary

Technical Problem

Existing technologies struggle to effectively adjust the output loudness level of audio signals, forcing users to frequently adjust device volume to accommodate loudness differences in different content, thus impacting convenience.

Method used

The loudness metadata of the input audio signal is obtained by an audio signal processing device. The output loudness level is adjusted using the Quality Safety Histogram Index (QSHI) and loudness gain to ensure that the loudness of the output audio signal is within a predetermined range and to avoid affecting the sound quality.

Benefits of technology

It achieves effective normalization of the loudness level of the audio signal, improves the convenience of user experience and the stability of sound quality, ensures that the output loudness level is close to the actual perception of the listener, and avoids loudness fluctuations affecting sound quality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116962954B_ABST
    Figure CN116962954B_ABST
Patent Text Reader

Abstract

This disclosure relates to an audio signal processing method and apparatus for controlling loudness levels. An audio signal processing apparatus includes: a receiver for receiving an input audio signal; a processor for generating loudness metadata corresponding to the input audio signal; and an output unit for transmitting the loudness metadata generated by the processor. The processor is configured to acquire loudness information analyzed from input content, acquire loudness information about the input audio signal by measuring the loudness of the input audio signal, generate loudness metadata by converting the loudness information, and transmit the generated loudness metadata data to an output device via the output unit to output the input audio signal.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of patent application No. 202080020871.3 (PCT / KR2020 / 003489), filed with the China Patent Office on September 13, 2021, with an international application date of March 12, 2020, entitled "Audio Signal Processing Apparatus for Controlling Loudness Level". Technical Field

[0002] This invention relates to an audio signal processing method and an audio signal processing apparatus for effectively playing back audio signals, and more specifically, to an audio signal processing method and an audio signal processing apparatus for providing users with a more immersive audio signal by adjusting the loudness level of the audio signal of the output content. Background Technology

[0003] As the methods of delivering audio to users have shifted from analog to digital, it has become possible to play back sounds with a wider volume range. Furthermore, the volume of audio signals can be diversified according to the content corresponding to the audio signal. This is because the loudness intended for each audio content can be set differently during the audio content generation process. Accordingly, international standards organizations (such as the International Telecommunication Union (ITU) and the European Broadcasting Union (EBU)) have published standards for audio loudness. However, because the methods and standards for measuring loudness vary from country to country, it is difficult to apply the standards published by international standards organizations.

[0004] Content creators attempt to generate and deliver a large volume of content with varying loudness to users. This stems from the psychoacoustic property that the perceived sound quality of an audio signal improves as its amplitude increases. This has led to a competitive race known as the loudness wars. As a result, loudness differences exist between individual pieces of content or between multiple pieces of content, and users may experience the inconvenience of repeatedly adjusting their device's volume to play back the corresponding content. Therefore, improving the ease of use for content playback devices necessitates a technology to normalize the loudness of audio content. Summary of the Invention

[0005] Technical issues

[0006] In an audio signal processing method that plays back content including audio signals, an embodiment of the present invention is to effectively adjust the output loudness level of the corresponding content.

[0007] Technical solutions

[0008] According to an embodiment of the present invention, an audio signal processing apparatus includes: a receiver for receiving an input audio signal; a processor for generating loudness metadata corresponding to the input audio signal; and an output device for transmitting the loudness metadata generated by the processor. The processor may be configured to obtain loudness information about the input audio signal by measuring its loudness; generate loudness metadata by converting the loudness information; and send the generated loudness metadata via the output device to an output device for outputting the input audio signal. The loudness information may include information representing the Quality Safety Histogram Index (QSHI) of the input audio signal, and the QSHI may represent a threshold loudness level at which cognitive sound quality impairment does not occur.

[0009] The processor can be configured to obtain the QSHI based on the loudness histogram of the input audio signal.

[0010] The processor can be configured to acquire the loudness histogram based on the distribution of at least one short-term loudness level of the input audio signal; and can acquire the QSHI based on the loudness histogram. The short-term loudness levels can be measured in segments shorter than the entire segment of the input audio signal.

[0011] The loudness histogram may be an amplitude histogram associated with the peak envelope or root mean square (RMS) of each segment of the input audio signal.

[0012] The processor can be configured to, when outputting the input audio signal according to a target loudness level, predict a loudness parameter based on a loudness histogram of the input audio signal; obtain a predicted loudness histogram of the input audio signal based on the predicted loudness parameter; and obtain the QSHI based on the obtained predicted loudness histogram.

[0013] The loudness information may include the overall loudness level of the input audio signal, the QHSI may be greater than the overall loudness level of the input audio signal, and the overall loudness level may be a loudness level calculated based on loudness measurements obtained from a set time point set by the audio signal processing device.

[0014] The QHSI can be a parameter that is corrected based on whether post-processing is performed on the input audio signal in the output device.

[0015] The processor can configure the QHSI such that the short-term loudness level of the entire segment of the input audio signal output from the output device is less than or equal to a predetermined level.

[0016] According to another aspect of the present invention, an audio signal processing apparatus includes a processor configured to adjust the output loudness level of an input audio signal. The processor may be configured to receive loudness metadata corresponding to the input audio signal; parse the loudness metadata to obtain loudness information of the input audio signal; determine a loudness gain of the input audio signal based on the loudness information and a target loudness level; and adjust the output loudness level of the input audio signal based on the loudness gain. The loudness information may include information representing the Quality Safety Histogram Index (QSHI) of the input audio signal, and the QSHI may represent a threshold loudness level at which cognitive sound quality impairment does not occur.

[0017] The processor can be configured to: compare the target loudness level of the input audio signal with the QSHI; and determine the loudness gain based on the comparison result.

[0018] The processor can be configured to determine the loudness gain based on the smaller of the target loudness level of the input audio signal and the QSHI.

[0019] The processor can be configured to receive the overall loudness level of the input audio signal; and to determine the loudness gain based on the overall loudness level of the input audio signal, the QSHI, and the target loudness level. The overall loudness level can be a loudness level calculated based on loudness measurements obtained from a set time point set by a device for measuring the loudness of the input audio signal.

[0020] The QSHI can be a loudness parameter calculated based on the loudness histogram of the input audio signal.

[0021] The loudness histogram can be an amplitude histogram of the short-term loudness level of the input audio signal over time, and the short-term loudness level can be measured in segments shorter than the entire segment of the input audio signal.

[0022] The loudness histogram may be an amplitude histogram associated with the peak envelope or root mean square (RMS) of each segment of the input audio signal.

[0023] The QSHI can be a parameter calculated based on a predicted loudness histogram predicted from the loudness histogram of the input audio signal, and the predicted loudness histogram can be a histogram generated based on the loudness parameters predicted when the input audio signal is output according to the target loudness level.

[0024] The QHSI can be greater than the overall loudness level of the input audio signal, and the overall loudness level can be a loudness level calculated based on loudness measurements obtained from a set time point set by a device for measuring the loudness of the input audio signal.

[0025] The processor can be configured to generate an output audio signal by adjusting the output loudness level of the input audio signal according to the loudness gain; and to output the output audio signal by applying a loudness limiter to limit the loudness level of the output audio signal to the output audio signal.

[0026] The QSHI can be a loudness parameter determined based on the number of times the limiter is driven in the audio signal processing device.

[0027] The processor can be configured to perform post-processing on the input audio signal; receive post-processing information representing the characteristics of post-processing on the input audio signal; correct the acquired QSHI based on the post-processing information; and determine the loudness gain based on the corrected QSHI.

[0028] The processor can be configured to correct the QSHI based on the post-processing information and the pre-stored function.

[0029] The processor can be configured to correct the QSHI based on the post-processing information and a pre-stored lookup table. The pre-stored lookup table may include information regarding QSHI correction for the characteristics of the post-processing.

[0030] Information regarding QSHI correction may include information representing a QSHI correction value based on post-processing characteristics. The processor may be configured to retrieve a QSHI correction value corresponding to the post-processing of the input audio signal according to the pre-stored lookup table; and to correct the QSHI by adding the QSHI correction value to the retrieved QSHI.

[0031] The loudness gain can be a fixed gain with a fixed value throughout the entire segment of the input audio signal.

[0032] The loudness gain can be a gain that varies over time during the playback of the input audio signal.

[0033] The processor can be configured to generate an output audio signal by adjusting the output loudness level of the input audio signal according to the loudness gain. The QHSI can be a set of parameters such that the short-term loudness level of the entire segment of the output audio signal is less than or equal to a predetermined level.

[0034] Beneficial effects

[0035] In the apparatus and method according to embodiments of the present invention, the loudness level of an audio signal can be effectively normalized when playback content includes audio signals. Furthermore, the apparatus and method according to embodiments of the present invention can provide users with convenience for improving sound quality and adjusting volume.

[0036] In particular, according to embodiments of the present invention, the loudness level can be controlled without affecting sound quality. Furthermore, an audio signal processing apparatus according to another aspect of the present invention can use loudness metadata to provide output content with a more stable output loudness level. In addition, loudness normalization can be performed, approximating the loudness actually perceived by the listener. Attached Figure Description

[0037] Figure 1 This is a view illustrating the loudness level changing over time during playback of multiple contents according to an embodiment of the present invention.

[0038] Figure 2 This is a schematic diagram illustrating a system including a first audio signal processing device and a second audio signal processing device according to an embodiment of the present invention.

[0039] Figure 3 This is a flowchart illustrating a method for adjusting the loudness level of an input audio signal according to an embodiment of the present invention.

[0040] Figure 4 This is a block diagram illustrating a method for extracting loudness information of an input audio signal using an audio signal processing apparatus according to an embodiment of the present invention.

[0041] Figure 5 The frequency response of the primary prefilter as defined in ITU-R BS.1770-4 is shown.

[0042] Figure 6 The frequency response of the secondary pre-filter is shown.

[0043] Figure 7 This is a view illustrating a method for a server to generate loudness metadata of an input audio signal according to an embodiment of the present invention.

[0044] Figure 8 This is a view illustrating a method by which a client uses loudness metadata to output an input audio signal according to an embodiment of the present invention.

[0045] Figure 9 This is a view showing a histogram of each short loudness amplitude of the input audio signal according to an embodiment of the present invention.

[0046] Figure 10This is a block diagram illustrating a system according to an embodiment of the present invention, wherein the audio signal processing apparatus optimizes the loudness gain of the input audio signal taking into account the target loudness level and cognitive sound quality degradation.

[0047] Figure 11 and Figure 12 This is a view showing the fixed gain of the loudness level and target loudness level used for the input audio signal over time.

[0048] Figure 13 and Figure 14 These are schematic diagrams illustrating a method for adjusting the output loudness level of an input audio signal according to an embodiment of the present invention.

[0049] Figure 15 This is a view illustrating a method by which an audio signal processing apparatus according to an embodiment of the present invention acquires loudness information of an input audio signal.

[0050] Figure 16 This is a view illustrating a method by which an audio signal processing apparatus according to an embodiment of the present invention adjusts the output loudness level of an input audio signal.

[0051] Figure 17 This is a view illustrating a method by which an audio signal processing apparatus according to an embodiment of the present invention adjusts the output loudness level of an input audio signal based on a target loudness range.

[0052] Figure 18 This is a view illustrating a method by which an audio signal processing apparatus according to an embodiment of the present invention measures the loudness of input content.

[0053] Figure 19 This is a flowchart illustrating the operation of an audio signal processing apparatus according to an embodiment of the present invention.

[0054] Figure 20 This is a block diagram illustrating the configuration of an audio signal processing apparatus 2000 according to an embodiment of the present invention.

[0055] Figure 21 This is a view showing the peak envelope of the input audio signal for each time period according to an embodiment of the present invention.

[0056] Figure 22 This is a view illustrating a method by which an audio signal processing apparatus according to an embodiment of the present invention uses smoothing to adjust the output loudness level using an input audio signal. Detailed Implementation

[0057] In the following description, embodiments of the invention will be described in detail with reference to the accompanying drawings, enabling those skilled in the art to readily implement these embodiments. However, the invention can be embodied in many different forms and is not limited to the embodiments set forth herein. Furthermore, for clarity of description, irrelevant sections have been omitted from the drawings, and the same reference numerals denote the same elements throughout the specification. Additionally, when a portion is referred to as "comprising" any component, unless otherwise stated, it means that the portion may further include other components rather than exclude them.

[0058] This disclosure relates to a method for adjusting the output loudness level of input content using an audio signal processing apparatus. In this disclosure, the input content may be content comprising an audio signal. In this disclosure, the input content may be referred to as an input audio signal. Furthermore, loudness can indicate the magnitude of a sound perceived through hearing. Loudness level can be a numerical value indicating loudness. For example, loudness level can be expressed using units such as loudness weighted relative to full scale K (LKFS) or loudness unit relative to full scale (LUFS). Additionally, loudness level can be indicated using units such as sone or phon.

[0059] In the following text, refer to Figure 1 This will describe the loudness of the audio signal. Figure 1 This is a view illustrating the loudness level changing over time during playback of multiple contents according to an embodiment of the present invention. (Reference) Figure 1 This shows the average loudness, short-term loudness, and loudness dynamic range over time. The average loudness level can be a single loudness value corresponding to a single content. The average loudness level may differ for each content (content 1, content 2, and content 3). Figure 1 In the diagram, the solid line represents the average loudness level for each content (content 1, content 2, and content 3). Figure 1 The average loudness can represent the overall loudness. The overall loudness and short-term loudness mentioned above can follow the definitions of loudness standards, such as ITU-R BS.1770-4, EBU R 128, EBU TECH 3341 and EBU TECH 3342.

[0060] According to an embodiment, the short-term loudness level can be a loudness level measured in a segment shorter than the entire segment of the input audio signal. The short-term loudness level can also be a loudness measurement of a portion of the content. In this case, the portion can be a part included in a measurement window. The audio signal processing apparatus can acquire multiple short-term loudness levels for a single content. Furthermore, the average loudness level can be the average of the multiple short-term loudness levels.

[0061] exist Figure 1In this context, each of the multiple pieces of content being played back and switched has different loudness characteristics. For example, when switching between different content on a platform providing image services, advertising content may be inserted between the content to be switched. In this case, the audio signal processing device may have difficulty maintaining the loudness level within a predetermined range. Furthermore, the difference in loudness dynamic range between different pieces of content can be significant. In such an environment, the audio signal processing device may be unable to provide the loudness level within the range expected by the listener.

[0062] Specifically, when content is switched, the listener may first notice a rapid change in the short-term loudness level. Therefore, the listener may need to adjust the volume of the device outputting the audio signal. Furthermore, when playing back the switched content, the listener may need to adjust the volume again to set the appropriate gain based on the average loudness. For example, when playing back switched content at a volume adjusted based on the loudness of the initial segment of the switched content, the loudness level can increase or decrease rapidly depending on the characteristics of the content. When the loudness level increases or decreases so rapidly that the content becomes indistinguishable, the listener may need to adjust the volume of the device outputting the audio signal again.

[0063] Therefore, the audio signal processing apparatus according to embodiments of the present invention can control the output loudness level of the input content, thereby increasing the convenience for the listener. Specifically, the audio signal processing apparatus can adjust the loudness level based on the loudness gain of the input content. In this case, the audio signal processing apparatus can use loudness metadata that includes loudness information of the input audio signal.

[0064] According to embodiments of the present invention, the loudness level of input content created by different standards or without a specific standard can be normalized based on a target loudness level. Here, the target loudness level can be the loudness level that the audio signal processing device wants to output. For example, the target loudness level can be set by the content creator of the input content. In this case, the audio signal processing device can receive information about the target loudness along with the input content. Furthermore, the target loudness level can be set to different values ​​depending on the type of the input content. In this case, the audio signal processing device can determine the target loudness level based on the type of the input content. The target loudness level can be set to a default value pre-stored in the audio signal processing device. In this case, the target loudness level can be set to a value independent of the input content or the type of the input content. The audio signal processing device can adjust the output loudness level of the input content based on the target loudness level.

[0065] According to an embodiment, the audio signal processing apparatus can obtain a loudness gain based on the relationship between the loudness level of the input content and the target loudness level. The relationship between the loudness level of the input content and the target loudness level can include the difference or ratio between the loudness level of the input content and the target loudness level.

[0066] For example, an audio signal processing apparatus may acquire a loudness gain based on the relationship between a representative loudness level of the input content and a target loudness level. Here, the representative loudness level may be a loudness level representing the loudness levels of all segments of the input content. The audio signal processing apparatus may receive the representative loudness level of the input content along with the input content. Alternatively, the audio signal processing apparatus may acquire the representative loudness level based on loudness information analyzed from the input content. In this case, the audio signal processing apparatus may acquire loudness information based on loudness measurements of the input content. In this disclosure, the loudness information of the input audio signal may include loudness metadata converted to a metadata format.

[0067] Furthermore, the audio signal processing device can adjust the output loudness level of the input content based on loudness gain. Specifically, the audio signal processing device can output an audio signal whose loudness level is adjusted by applying loudness gain to the input content.

[0068] According to an embodiment of the present invention, the audio signal processing apparatus can adjust the output loudness level of the input audio signal by using loudness metadata of the input audio signal. As a result, the audio signal processing apparatus can control the loudness level of the input content without affecting the sound quality of the input audio signal included in the input content.

[0069] For example, a predetermined target loudness level may be greater than the representative loudness level of the input audio signal. In this case, outputting the input audio signal according to the predetermined target loudness level may affect the sound quality. Therefore, the audio signal processing device can obtain a loudness gain based on loudness characteristics and a predetermined target loudness. The audio signal processing device can obtain a loudness gain based on loudness characteristics without affecting the sound quality of the input audio signal. The audio signal processing device can adjust the output loudness level of the input content based on the obtained loudness gain.

[0070] In this scenario, the audio signal processing device can obtain loudness information by using loudness metadata of the input audio signal. Specifically, the audio signal processing device can receive loudness metadata of the input audio signal from an external device. The external device can analyze the loudness characteristics of the input audio signal and generate loudness metadata of the input audio signal based on the analyzed loudness characteristics. Furthermore, the external device can send the loudness metadata of the input audio signal to the audio signal processing device.

[0071] In the following text, reference will be made to Figure 2 A method for adjusting the output loudness level of input content is described according to an embodiment of the present invention. Figure 2 This is a schematic diagram illustrating a system 200 including a first audio signal processing device 210 and a second audio signal processing device 220 according to an embodiment of the present invention. Figure 2 In this context, the first audio signal processing device 210 can be a server. Figure 2 In this context, the second audio signal processing device 220 can be a client device.

[0072] Figure 2 The illustration depicts a series of operations performed by a server-client architecture system to normalize the loudness of input content, but this disclosure is not limited thereto. For example, a reference signal processing device can be used to perform the operation. Figure 2 A series of operations described.

[0073] According to an embodiment, the first audio signal processing device 210 can generate loudness metadata of the input audio signal. The first audio signal processing device 210 can send the generated loudness metadata to the second audio signal processing device 220, which will then output the corresponding input audio signal. The second audio signal processing device 220 can receive the loudness metadata from the first audio signal processing device 210. Furthermore, the second audio signal processing device 220 can adjust the output loudness level of the input audio signal based on the received loudness metadata. Specifically, the second audio signal processing device 220 can determine the loudness gain to be applied to the input audio signal based on the loudness metadata. Moreover, the second audio signal processing device 220 can adjust the loudness level of the input audio signal based on the determined loudness gain.

[0074] Specifically, the first audio signal processing device 210 can receive input content. In this disclosure, the input content can be an input audio signal composed of multiple frames. Next, the first audio signal processing device 210 can measure the loudness level of the input content. The first audio signal processing device 210 can obtain the loudness measurement value of the audio signal by using a loudness filter based on auditory scales. Specifically, the loudness filter can be at least one of an inverse filter of an equal-loudness curve or a K-weighted filter that approximates it.

[0075] For example, the first audio signal processing apparatus 210 can acquire loudness measurements by applying a loudness filter to at least some segments of the received input content. Here, some segments can be a unit of time used to acquire a loudness measurement. Some segments may include at least one frame. In this disclosure, the unit of time used to acquire a loudness measurement may be referred to as a measurement window.

[0076] The first audio signal processing apparatus 210 can acquire loudness measurements for each measurement window used for input content. In this case, depending on the length of the measurement window, the acquired loudness measurement can be an instantaneous loudness level or a short-term loudness level. The instantaneous loudness level can be a measurement value measured over a shorter time period compared to the short-term loudness level. For example, the length of the measurement window used to acquire an instantaneous loudness level can be 400 milliseconds (ms). Alternatively, the length of the measurement window used to acquire a short-term loudness level can be 3 seconds. However, this disclosure is not limited thereto. The length of the measurement window used for loudness analysis can vary depending on the input content. According to an embodiment, the length of the measurement window can be determined based on additional information about the input content. Reference will be made later. Figure 8 Describe a method for determining the length of a measurement window using an audio signal processing device.

[0077] Next, the first audio signal processing device 210 can acquire loudness information of the input content based on loudness measurements used for the input content. The loudness information may include at least one loudness measurement used for the input content. Furthermore, the loudness information may include information calculated based on the loudness measurements used for the input content. The first audio signal processing device 210 can update the loudness information in real time. For example, the loudness information may include at least one of a comprehensive loudness level, a short-term loudness level, or an instantaneous loudness level. The first audio signal processing device 210 can acquire a comprehensive loudness level representing a combination of multiple loudness measurements from the start of loudness measurements used for the input content to the current time point.

[0078] In this disclosure, the overall loudness level can represent the loudness level integrated from a set time point already set in the device used to measure the loudness level. According to an embodiment, the overall loudness level can be a loudness level calculated based on the loudness level measured from a set time point already set in the first audio signal processing apparatus 210. For example, the overall loudness level can be an average loudness level calculated based on loudness measurements for each segment obtained from the set time point. In this case, the loudness measurements for each segment can represent a short-term loudness level or an instantaneous loudness level.

[0079] According to an embodiment, the overall loudness level can be obtained based on the average of the effective loudness measurements taken from the set time point to the current time point. Here, the effective loudness measurement value can be a loudness measurement value that satisfies at least one criterion requirement among multiple loudness measurements taken from the set time point to the current time point.

[0080] For example, an effective loudness measurement value can be a loudness measurement value whose loudness level is higher than a certain level. First, the first audio signal processing device 210 can calculate a first average of loudness measurements among a plurality of loudness measurements whose loudness level is higher than a first threshold. In this case, the first threshold can be a value set based on the minimum audible amplitude. Next, the first audio signal processing device 210 can calculate a second average of loudness measurements among the loudness measurements used to calculate the first average whose loudness level is higher than a second threshold. In this case, the second threshold can be a value obtained by subtracting a predetermined value from the first average. Furthermore, the first audio signal processing device 210 can use the second average as the overall loudness level of the input content. At the same time, the first audio signal processing device 210 can reset the setting time point of the overall loudness level according to specific requirements.

[0081] Next, the first audio signal processing device 210 can generate loudness metadata based on the loudness information. For example, the first audio signal processing device 210 can remove unnecessary information from the loudness information and generate loudness metadata in a syntax that the second audio signal processing device 220 can understand. Additionally, the first audio signal processing device 210 can generate loudness metadata that includes additional information related to the input audio signal. The additional information related to the input audio signal may include at least one of the following: length, type, content provider, content creator, popularity, number of views, album, and channel of the input audio signal. As a result, the first audio signal processing device 210 enables another device that outputs the input audio signal to adjust the output loudness level of the input audio signal by using the additional information.

[0082] For example, the input audio signal could be from the same content creator as a previously played-out audio signal. In this case, the input audio signal and the previously played-out audio signal could have similar sonic characteristics, such as style / pitch. Therefore, the means for outputting the input audio signal (e.g., the second audio signal processing device 220) could determine the loudness gain of the input audio signal based on the target loudness level of the previously played-out audio signal. In this case, the second audio signal processing device 220 could be used to include loudness metadata containing additional information.

[0083] Next, the loudness metadata generated by the first audio signal processing device 210 can be stored in a metadata database (hereinafter, "DB"). The first audio signal processing device 210 can receive a request for loudness metadata of the input audio signal from the second audio signal processing device 220. In this case, the first audio signal processing device 210 can send the loudness metadata of the corresponding input audio signal to the second audio signal processing device 220.

[0084] According to an embodiment of the present invention, the second audio signal processing device 220 can obtain loudness information of an input audio signal from the first audio signal processing device 210. Specifically, the second audio signal processing device 220 can request loudness metadata of the input audio signal from the first audio signal processing device 210. Additionally, the second audio signal processing device 220 can receive loudness metadata of the input audio signal from the first audio signal processing device 210. The second audio signal processing device 220 can obtain loudness information of the input audio signal based on the received loudness metadata.

[0085] The second audio signal processing device 220 can acquire a loudness gain applied to the input content based on loudness information. Specifically, the second audio signal processing device 220 can acquire a loudness gain based on loudness information and a target loudness level. According to an embodiment, the second audio signal processing device 220 can acquire a loudness gain applied to a specific frame of the input content. The loudness gain applied to each frame of some specific segments of the input content can be dynamically adjusted over time. The loudness gain applied to each frame of the remaining segments besides the specific segments can be a static gain that is not dynamically adjusted. Furthermore, the loudness gain of some specific segments of the input content can be limited to values ​​within a specific range.

[0086] Next, the second audio signal processing device 220 can adjust the output loudness level of the input content based on loudness gain. For example, the second audio signal processing device 220 can adjust the output loudness level by applying loudness gain to the input content. According to an embodiment, loudness gain can be applied to each frame constituting the input content. In this case, the second audio signal processing device 220 can adjust the output loudness level of the input content by multiplying the audio signal corresponding to each frame by the loudness gain. The second audio signal processing device 220 can obtain output content whose output loudness level is adjusted by loudness gain from the input content. In addition, the second audio signal processing device 220 can output the obtained output content. For example, the second audio signal processing device 220 can play back the output content. Alternatively, the second audio signal processing device 220 can send the output content to a playback device via a wired / wireless interface.

[0087] Furthermore, the second audio signal processing device 220 can control the dynamic range of the adjusted output loudness level. This is because when the output loudness level of a specific frame used for the input content exceeds a predetermined dynamic range, audio quality distortion caused by clipping will occur. The second audio signal processing device 220 can control the dynamic range of the output loudness level based on the predetermined dynamic range. For example, the second audio signal processing device 200 can use processing such as limiters and dynamic range compressors (DRC) to control the dynamic range of the output loudness level.

[0088] Figure 3 This is a flowchart illustrating a method for adjusting the loudness level of an input audio signal according to an embodiment of the present invention. For ease of description, in Figure 3 In this context, a series of operations for adjusting the output loudness level of the input audio signal are described as being performed by a single audio signal processing device, but this disclosure is not limited thereto. For example, see reference... Figure 3 Some of the operations described can be performed by the server, while the rest can be performed by the client.

[0089] exist Figure 3 In step S301, the audio signal processing device may perform post-processing operations on the input audio signal. For example, the audio signal processing device may perform at least one operation on the input audio signal, namely, equalization or sound field mode. In this case, the equalization and sound field mode performed by the audio signal processing device may be typical operations of a media playback system.

[0090] In step S303, the audio signal processing device can extract loudness information of the input audio signal. According to an embodiment, when step S301 is executed, in step S303, the audio signal processing device can extract loudness information based on the frequency characteristics of post-processing. The audio signal processing device can obtain loudness level information (post-processing weight, w_Proc) for each band, modified by post-processing, based on the frequency characteristics of post-processing. Furthermore, the audio signal processing device can use w_Proc to extract loudness information.

[0091] For example, when the above equalization is performed on the input audio signal, w_Proc may include equalization curve information in the corresponding frequency domain. The audio signal processing device may extract loudness information of the input audio signal based on the equalization curve information. When the above sound field mode is applied to the input audio signal, w_Proc may include at least one of the reverberation information or characteristic information of the filter used in the corresponding sound field mode.

[0092] According to another embodiment, the environment in which the input and output audio signals are generated can be an environment with non-uniform frequency characteristics and low response to low frequencies, such as a small speaker used in a mobile phone. In this case, w_Proc can include frequency characteristic information of the corresponding output environment. Finally, the audio signal processing device can adjust the output loudness level of the input content based on w_Proc. As a result, the audio signal processing device can provide an output loudness level adjustment that reflects the characteristics of the device from which the input and output audio signals are generated.

[0093] According to embodiments of this disclosure, the loudness information extracted in step S303 may include at least one of the comprehensive luminance L_Integ, the Quality Safety Histogram Index (QSHI), or the loudness difference dL_Proc obtained through post-processing. In this case, L_Integ may conform to the ITU-R BS.1770-4 standard specification. Furthermore, QSHI may represent the threshold loudness level at which cognitive sound quality impairment caused by the output terminal limiter will not occur. In this disclosure, QSHI may include the maximum target loudness Max_TL. QSHI may be calculated based on an automated algorithm or defined by the content creator. Reference will be made later. Figure 4 This describes a detailed method for obtaining QSHI. Additionally, dL_Proc can be a predicted value for the change in loudness of the input audio signal after post-processing. The audio signal processing apparatus can obtain dL_Proc based on post-processing information set by the user. The audio signal processing apparatus can obtain dL_Proc based on at least one of the characteristics of the input audio signal for each frequency or w_Proc.

[0094] In step S305, the audio signal processing device can determine the loudness gain G_target of the input audio signal. For example, the audio signal processing device can determine the loudness gain G_target based on the loudness information extracted in step S303 and a predetermined target loudness level L_target. In this case, the predetermined target loudness level can be a user-set value. In step S307, the audio signal processing device can output the output audio signal by applying the final loudness gain to the input audio signal post-processed in step S301.

[0095] In this case, the output audio signal can be a signal passed through a limiter. The audio signal processing device can output a first output audio signal by applying a final loudness gain to the post-processed input audio signal. Furthermore, the audio signal processing device can generate a second output audio signal by applying a limiter to the first output audio signal. Finally, the audio signal processing device can output the second output audio signal to which the limiter has been applied.

[0096] In the following text, reference will be made to Figure 4 It describes in detail the method for extracting loudness information using an audio signal processing device. Figure 4 This is a block diagram illustrating a method for extracting loudness information of an input audio signal using an audio signal processing apparatus according to an embodiment of the present invention. For ease of description, in... Figure 4 In this context, each unit / component is described as performing each operation. However, this disclosure is not limited thereto. For example, Figure 4 The operation of each unit / component of the loudness information extraction unit 400 can be a series of operations performed by a processor included in the audio signal processing device.

[0097] Reference Figure 4 The loudness information extraction unit 400 may include a loudness measurement unit 401, a loudness analysis unit 402 for each frequency, a post-processing loudness prediction unit 403, and a QSHI extraction unit 404. The loudness information extraction unit 400 can perform reference... Figure 3 The operation described in step S303.

[0098] According to an embodiment, the loudness measurement unit 401 can acquire loudness measurements of the input audio signal. For example, the loudness measurement unit 401 can acquire at least one of the short-term loudness level or the comprehensive loudness level of the input audio signal. Specifically, the loudness measurement unit 401 can acquire comprehensive loudness information L_Integ and short-term loudness information L_ShortTerm from the input audio signal through a process as exemplified in the standard specification ITU-R BS.1770-4.

[0099] According to an embodiment, the loudness analysis unit 402 for each frequency can obtain the loudness ratio (multi-band weighted loudness WLoud_MB) for each frequency of the entire input audio signal. For example, the loudness analysis unit 402 for each frequency can obtain WLoud_MB by applying a k-weighted filter to the input audio signal. The loudness analysis unit 402 for each frequency can calculate WLoud_MB by transforming the frequency of the signal to which the k-weighted filter has been applied.

[0100] In the following text, the detailed method for calculating WLoud_MB for each frequency using the loudness analysis unit 402 will be described with reference to Equations 1 through 8.

[0101] [Equation 1]

[0102] x_k=filter(h_kweight,x_in),

[0103] or

[0104] x_k=filter(h_pre2_kweight, filter(h_pre1_kweight, x_in))

[0105] In Equation 1, x_k represents the input audio signal x_in to which a k-weighted filter has been applied. In Equation 1, "filter(A,B)" represents the operation of filtering the input audio signal B using filter coefficients A. In Equation 1, h_kweight can represent a single k-weighted filter. Furthermore, each of h_pre2_kweight and h_pre1_kweight can represent a primary pre-filter and a secondary pre-filter as defined in ITU-R BS.1770-4. The loudness analysis unit 402 for each frequency can filter and then apply the k-weighted filter coefficients to the input audio signal. Figure 5 The frequency response of the primary pre-filter as defined in ITU-R BS.1770-4 is shown. Furthermore, Figure 6 The frequency response of the secondary pre-filter is shown.

[0106] As shown in Equation 2, the frame-by-frame signal of signal x_k obtained through Equation 1 can be represented. In Equation 2, x_frame[l] represents the signal of the i-th frame of signal x_k. Here, NF can represent the length of the frame, and NH can represent the jump size.

[0107] [Equation 2]

[0108] x_frame[l]=x_k[((l-1)*NH+1): ((l-1)*NH+NF)]

[0109] Next, referring to Equation 3, the loudness analysis unit 402 for each frequency can obtain xw_frame[l][-] by windowing x_frame[l]. In this case, the loudness analysis unit 402 for each frequency can obtain xw_frame[l][-] by using a rectangular window function, where all coefficients of the window function are 1. Alternatively, the loudness analysis unit 402 for each frequency can obtain xw_frame[l][-] by using various window functions such as the Hamming window function or the Hanning window function. Windowing can be an operation for frequency analysis of the input audio signal. In Equation 3, wind[n] represents the nth coefficient of the window function, and n can be the number of samples in the window. For example, when NF is 512, the value of n can be any from 1 to 512.

[0110] [Equation 3]

[0111] xw_frame[l][n] = x_frame[l][n] * wind[n], for n = 1, 2, ..., NF

[0112] Furthermore, the loudness analysis unit 402 for each frequency can perform a Discrete Fourier Transform (DFT) on xw_frame[l][-]. As shown in Equation 4, the frequency domain signal XW_frame[l] can be represented by the Discrete Fourier Transform of xw_frame[l][-]. In Equation 4, DFT{x} represents the Discrete Fourier Transform of the signal 'x' in the time domain.

[0113] [Equation 4]

[0114] XW_frame[1]=DFT{xw_frame[1][1:NF]}

[0115] Next, referring to Equation 5, the loudness analysis unit 402 for each frequency can obtain the power of each frequency interval (bin) of the frequency signal XW_frame[l] used for transformation. In Equation 5, P_frame_bin[l][k] represents the power of the k-th frequency interval of the i-th frame. Additionally, conj(x) represents the conjugate function of 'x'.

[0116] [Equation 5]

[0117] P_frame_bin[l][k] = XW_frame[l][k] * conj(XW_frame[l][k]), for k = 1, 2, ..., NF

[0118] Next, referring to Equation 6, the loudness analysis unit 402 for each frequency can obtain the power for each frequency band of the i-th frame P_frame_band[l][b] by mapping P_frame_bin[l][k] to a predetermined frequency band. In Equation 6, band[b] represents the index of the starting frequency bin of band b. That is, the loudness analysis unit 402 for each frequency can obtain the power for each frequency band by summing the power of each frequency bin from band[b] to band[b+1]-1. In Equation 6, sum_{y}(x) can represent the sum of each index of the function 'x' with index k as a factor. In this case, "y" can represent the range of indices used for the corresponding operation.

[0119] [Equation 6]

[0120] (P_frame_band[1][b])

[0121] =sum_{k from band[b] to band[b+1]-1}(P_frame_bin[1][k])

[0122] Referring to Equation 7, the loudness analysis unit 402 for each frequency can obtain the power of each frequency band for the entire segment of the input audio signal P_band[b] based on the power of each frequency band of the i-th frame P_frame_band[l][b]. The loudness analysis unit 402 for each frequency can obtain the power of each frequency band of the entire segment of the input audio signal P_band[b] by summing the power obtained for each frequency band P_frame_band[l][b] for each frame from the same frequency band. In Equation 7, NumberOfFrames represents the total number of frames. Additionally, I, representing the frame index, is defined in the range from 1 to NumberOfFrames.

[0123] [Equation 7]

[0124] P_band[b] = sum_{l from 1 to NumberOfFrames}(P_frame_bin[l][k])

[0125] Next, referring to Equation 8, the loudness analysis unit 402 for each frequency can obtain the loudness ratio of WLoud_MB[b] for each frequency band based on the power for each frequency band P_band[b]. Specifically, the loudness analysis unit 402 for each frequency can normalize the power P_band[b] for each specific frequency band based on the sum of the power for each frequency band. In Equation 8, NumberOfBands represents the total number of divided frequency bands. Additionally, B, representing the frequency band index, is defined in the range of 1 to NumberOfBands.

[0126] [Equation 8]

[0127] WLoud_MB[b] = P_band[b] / [sum_{b from 1 to NumberOfBands}(P_band[b])]

[0128] WLoud_MB[b], calculated by Equation 8, represents the ratio of the combined loudness level of each frequency band of the input audio signal. For example, the input audio signal can be a 2-band signal, the combined loudness level of the input audio signal can be L_Integ=-20LKFS, and WLoud_MB

[10] =0.8 and WLoud_MB[1]=0.2. In this case, the loudness level of the first frequency band of the input audio signal can be predicted as -20+10*log10(0.8)=-20.97LKFS, while the loudness level for the second frequency band can be predicted as -20+10*log10(0.2)=-26.99LKFS.

[0129] According to an embodiment, the post-processing loudness prediction unit 403 may obtain the loudness difference through post-processing based on at least one of the loudness level information w_Proc of each band changed by post-processing or the loudness ratio WLoud_MB for each frequency of the entire input audio signal.

[0130] In this case, the post-processing loudness prediction unit 403 can use the loudness ratio WLoud_MB of each frequency of the entire input audio signal obtained by the loudness analysis unit 402 for each frequency. Additionally, the loudness level information w_Proc for each band, changed by post-processing, can be obtained based on the characteristics of post-processing of the input audio signal. The characteristics of post-processing of the input audio signal can be determined based on information input by the user.

[0131] Specifically, a user-defined equalizer can be applied, whereby for each of the NumberOfBands frequency bands, the gain of each band of the corresponding equalizer can be set to w_ProcBand_dB in decimal, and the total gain of the corresponding equalizer can be set to w_ProcGain_dB. In this case, the loudness analysis unit 402 for each frequency can obtain the loudness ratio WLoud_MB[b] for each frequency band based on the gain w_ProcBand_dB for each frequency band and the total gain w_ProcGain_dB. As shown in Equation 9, the method by which the loudness analysis unit 402 for each frequency band calculates the loudness ratio for each frequency band can be represented.

[0132] [Equation 9]

[0133] w_Proc[b]=10^((w_ProcBand_dB[b]+0.5*w_ProcGain_dB) / 10)

[0134] For 1 < b < NumberOfBands

[0135] Furthermore, as shown in Equation 10, the method by which the post-processing loudness prediction unit 403 obtains the loudness difference dL_Proc through post-processing can be represented.

[0136] [Equation 10]

[0137] dL_Proc = 10 * log10(sum_{b from 1 to NumberOfBands}(WLoud_MB[b] * w_Proc[b]))

[0138] According to an embodiment, the QSHI extraction unit 404 can extract the Quality and Safety Histogram Index (QSHI) based on the short-term loudness information L_ShortTerm. As described above, the Quality and Safety Histogram Index (hereinafter, QSHI) can be a threshold loudness level at which cognitive sound quality impairment will not occur. The QSHI extraction unit 404 can obtain the QSHI based on the short-term loudness information L_ShortTerm obtained by the loudness measurement unit 401.

[0139] For example, the QSHI extraction unit 404 can obtain the QSHI by analyzing short-term loudness information L_ShortTerm. In this case, the short-term loudness information L_ShortTerm may include one or more short-term loudness levels of the input audio. Specifically, the QSHI extraction unit 404 can obtain a histogram of each short-term loudness amplitude for the input audio signal based on one or more short-term loudness levels. Furthermore, the QSHI extraction unit 404 can obtain the QSHI of the input audio signal based on the histogram obtained for each short-term loudness amplitude.

[0140] In the following sections, with reference to Equations 11 and 12, a detailed method for the QSHI extraction unit 404 to extract QSHI from the short-term loudness information L_ShortTerm of the input audio signal will be described. In Equation 11, L_ShortTerm_Sorted represents the arrangement of one or more short-term loudness levels in order of amplitude and the order of the levels contained in the short-term loudness information L_ShortTerm of the input audio signal. For example, the QSHI extraction unit 404 may arrange one or more short-term loudness levels in descending order.

[0141] [Equation 11]

[0142] L_ShortTerm_Sorted=sort[L_ShortTerm,'descending')

[0143] Furthermore, the QSHI extraction unit 404 can obtain the loudness level corresponding to a predetermined index among one or more short loudness levels of the input audio signal based on L_ShortTerm_Sorted. In Equation 12, EffectiveIndex can represent a predetermined effective index. Specifically, the predetermined effective index EffectiveIndex can indicate the short loudness level of a predetermined amplitude level among one or more short loudness levels of the input audio signal. That is, the QSHI extraction unit 404 can obtain the short loudness level with the largest EffectiveIndex among one or more short loudness levels of the input audio signal. In this case, the short loudness level with the largest EffectiveIndex among one or more short loudness levels of the input audio signal can be referred to as the effective short loudness level L_ShortTerm_Effective of the input audio signal.

[0144] [Equation 12]

[0145] L_ShortTerm_Effective=L_ShortTerm_Sorted[EffectiveIndex]

[0146] Next, the QSHI extraction unit 404 can obtain the QSHI based on at least one of the effective short-term loudness level L_ShortTerm_Effective or the comprehensive loudness level of the input audio signal. Alternatively, the QSHI can be a value greater than or equal to the comprehensive loudness level.

[0147] Additionally, the QSHI extraction unit 404 can acquire the effective short-term loudness level L_ShortTerm_Effective_Shift that will change when the input audio signal is output according to a predetermined target loudness level. Specifically, the QSHI extraction unit 404 can predict the short-term loudness information L_ShortTerm_Shft that will change based on the short-term loudness information L_ShortTerm of the input audio signal. In this case, the short-term loudness information L_ShortTerm_Shft may include one or more short-term loudness levels that will change when the input audio signal is output according to a predetermined target loudness level. In this case, the QSHI extraction unit 404 can acquire QSHI based on the acquired L_ShortTerm_Effective_Shift. For example, when L_ShortTerm_Effective_Shift[EffectiveIndex] is restricted to a threshold less than or equal to the short-term loudness level, QSHI may be the maximum target loudness.

[0148] For example, the L_ShortTerm_Effective_Shift of the input audio signal can be used as the short-term loudness level threshold L_Threshold. The QSHI extraction unit 404 can correct the maximum target loudness based on L_ShortTerm_Effective_Shift. The QSHI extraction unit 404 can use the corrected maximum target loudness as the QSHI value. Alternatively, the QSHI extraction unit 404 can select the larger of the maximum target loudness adjusted as described above and the combined loudness of the input audio signal as the QSHI value.

[0149] Using the method described above, the audio signal processing device can relatively effectively prevent the limiter from degrading the sound quality of the input audio signal. This is because, throughout the entire segment of the input audio signal, the limiter may degrade the sound quality in the portion with a relatively high volume setting.

[0150] According to an embodiment, QSHI can be configured such that the number of short-term loudness levels of one or more short-term loudness levels of the input audio signal that are greater than a specific value is less than the value of EffectiveIndex. In this case, EffectiveIndex can be a value determined based on the characteristics of the limiter of the audio signal processing device. For example, EffectiveIndex can be changed according to the degree of sound quality degradation caused by the operation of the limiter. Additionally, the short-term loudness threshold L_Threshold can be a value determined based on the characteristics of the limiter of the audio signal processing device. For example, the short-term loudness threshold L_Threshold can be changed according to the degree of sound quality degradation caused by the operation of the limiter.

[0151] According to a specific embodiment, the input audio signal can have a relatively large dynamic range. For example, the overall loudness level of the input audio signal can be L_Integ = -24LKFS, and the effective short-term loudness level can be extracted as L_ShortTerm_Effective = -10LKFS. In this case, when EffectiveIndex = 10 and the short-term loudness threshold = -7LKFS, QSHI can be calculated as -21LKFS.

[0152] In the above embodiments, a method for extracting the QSHI of an input audio signal based on a histogram for each short-term loudness level has been described, but this disclosure is not limited thereto. For example, the QSHI of the input audio signal can be defined as a value arbitrarily set by the creator of the content including the input audio signal or by the operator of the sound system outputting the input audio signal. Alternatively, the audio signal processing apparatus can obtain the QSHI by performing histogram analysis on at least one of the peak envelope or its RMS of the input audio signal, in addition to the short-term loudness level.

[0153] According to an embodiment, the QSHI of the input audio signal can vary depending on the changes in the histogram used for each short-term loudness amplitude. For example, the histogram used for each short-term loudness amplitude can vary depending on whether post-processing determined based on user input is present. In this case, the QSHI of the input audio signal can be changed to different values ​​based on a predetermined table. Alternatively, the QSHI of the input audio signal can be changed to a value calculated based on the characteristics of the post-processing.

[0154] Furthermore, a method for determining the loudness gain of an input audio signal based on the loudness information described above will be described according to an embodiment of the present disclosure. Equation 13 represents the overall loudness level L_IntegProc of the change in the input audio signal when a post-processing procedure is performed on the input audio signal. The audio signal processing apparatus can obtain the overall loudness level L_IntegProc of the change in the input audio signal based on the loudness difference dL_Proc caused by the post-processing. Referring to Equation 13, the audio signal processing apparatus can obtain the changed overall loudness level L_IntegProc by adding the loudness difference dL_Proc caused by the post-processing to the overall loudness level L_IntegProc of the input audio signal.

[0155] [Equation 13]

[0156] L_IntegProc=L_Integ+dL_Proc

[0157] The audio signal processing device can calculate the loudness gain for adjusting the output loudness level based on the QSHI, the predetermined target loudness level L_Target, and the overall loudness level changed by post-processing.

[0158] In the above embodiments, the target loudness level L_Target can be a user-set value. However, this disclosure is not limited thereto. For example, the predetermined target loudness level L_Target can be a default value provided by the playback system of the input and output audio signals. Alternatively, the predetermined target loudness level L_Target can be a value set based on the playback environment of the input and output audio signals. The audio signal processing apparatus can apply a loudness gain G_Target to a first intermediate audio signal post-processed from the input audio signal. For practical reasons, post-processing can be performed after multiplying the input audio signal before post-processing by the loudness gain G_Target. In addition, the audio signal processing apparatus can output a second intermediate audio signal to which the loudness gain G_Target has been applied via a limiter.

[0159] Meanwhile, multimedia streaming services are a widely used method in the current media market. A system providing multimedia streaming services typically consists of a server storing content to be streamed and user devices (i.e., clients). In this case, on the client side, multimedia streaming services can be provided in the form of playback within an application or the Web. Each of the server and client can be an audio signal processing device performing the operations described in this disclosure. In this server-client architecture, the server can provide loudness information by performing input content analysis. Additionally, the client can adjust the output loudness level of the input content based on the loudness information provided by the server. Specifically, the server can send loudness metadata, including loudness information of the input audio signal, to the client. The client can receive the loudness metadata of the input audio signal from the server. Furthermore, the client can obtain a loudness gain applied to the input audio signal based on the loudness metadata of the input audio signal.

[0160] Figure 7 This is a view illustrating a method by which a server generates loudness metadata of an input audio signal according to an embodiment of the present invention. The server according to an embodiment of the present invention can generate and / or output an audio stream by encoding the input audio signal. The server according to an embodiment of the present invention can extract loudness information of the input audio signal. For example, Figure 7 The server can execute reference Figure 3 The loudness information extraction step S303 describes the operation and reference. Figure 4 The operation described in the loudness information extraction unit 400 is as follows. Additionally, the server can generate loudness metadata that includes the extracted loudness information. The server can output the generated loudness metadata to an external device. For example, the server can send the generated loudness metadata to the client as a metadata stream.

[0161] Figure 8 This is a view illustrating a method by which a client outputs an input audio signal using loudness metadata according to an embodiment of the present invention. The client according to an embodiment of the present invention can receive an audio stream. Furthermore, the client can obtain the input audio signal by decoding the received audio stream. The client can perform a post-processing procedure on the input audio signal. In this case, whether to perform a post-processing procedure and its characteristics can be determined based on input received from the user or predetermined values ​​stored in the system.

[0162] According to embodiments of the present invention, a client can determine the loudness gain of an input audio signal based on loudness metadata of the input audio signal. For example, the client can receive loudness metadata in the form of a metadata stream. The client can obtain the loudness information of the input audio signal by parsing the loudness metadata of the input audio signal. Specifically, the client can obtain the above-mentioned reference from the loudness metadata of the input audio signal. Figure 3 and Figure 4 The description includes at least one of WLoud_MB, L_Integ, and QSHI. The client can determine the loudness gain of the input audio signal based on the acquired loudness information. The client can adjust the output loudness level by applying the loudness gain to the input audio signal. The client can generate an output audio signal by applying a limiter to an intermediate audio signal whose output loudness level has been adjusted. Furthermore, the client can output this output audio signal.

[0163] According to an embodiment, Figure 8 The client can execute the reference Figure 3 The post-processing steps S301, loudness gain determination step S305, and loudness gain application step S307 describe the operations and references. Figure 4 The operation described in the post-processing loudness prediction unit 403.

[0164] Furthermore, musical content can have varying loudness levels depending on its age and / or genre. For example, classical music tends to have relatively low overall loudness levels to provide a wide dynamic range, while 2000s pop music tends to have relatively high overall loudness levels. Specifically, the overall loudness level of 2000s pop music might range from approximately -13 to approximately -8 LKFS, while a quiet movement in a classical piece might have an overall loudness level of approximately -30 LKFS.

[0165] When determining the target loudness level, -23 to -24 LKFS, defined as a broadcast standard, can be used. However, this may not provide sufficient volume relative to external noise in noisy environments (such as in a subway). Therefore, the audio signal processing apparatus according to embodiments of the present invention can determine different target loudness levels depending on the playback environment. When the target loudness level for 2000s pop music is set to -10, the volume of the 2000s pop music may not change significantly. On the other hand, when music with a relatively low overall loudness level (such as classical music or music from the 1970s and 1980s) is set to -10, the volume change may be larger.

[0166] Figure 9 This is a view showing a histogram of each short-term loudness amplitude for an input audio signal according to an embodiment of the present invention. (Referring to...) Figure 9 In the described embodiment, the type of input audio signal might be classical music. Furthermore, in the reference... Figure 9In the described embodiment, the overall loudness of the input audio signal may be approximately -21 LKFS. For example, the target loudness level of the corresponding input audio signal may be L_Target = -10 LKFS. In this case, the histogram of each short-term loudness amplitude is shifted to the right by +11 LKFS. In this case, segments with short-term loudness levels greater than -7 LKFS are generated.

[0167] According to an embodiment, in segments with short loudness levels greater than -7LKFS, sound quality degradation caused by the limiter may occur. Therefore, the audio signal processing apparatus according to an embodiment of the present invention can perform loudness normalization of the input audio signal based on QSHI as described above. In this case, although the performance of loudness normalization may be relatively reduced, a best-effort approach can be used for optimal alignment to prevent damage to sound quality.

[0168] According to embodiments of the present invention, an audio signal processing apparatus can use a loudness gain correction method based on the loudness information of an input audio signal to approximate a target loudness level as closely as possible. The audio signal processing apparatus can also use appropriate methods to provide equalization without altering the loudness level.

[0169] Equalization adjusts the energy used for each frequency of the input audio signal to obtain the desired tone. In this case, the overall energy may increase depending on the degree of adjustment of the input audio signal. In this case, the input audio signal may be clipped. Furthermore, limiters may impair the sound quality of the input audio signal. Therefore, the audio signal processing apparatus according to an embodiment of the present invention can set the predetermined target loudness level L_Target, the combined loudness level L_Integ, and QSHI to the same arbitrary value. In this case, as in Equation 14, G_Target represents the loudness gain of the input audio signal. That is, the audio signal processing apparatus can obtain a linear loudness gain G_Target. This is because the target loudness level L_Target, the combined loudness level L_Integ, and QSHI cancel each other out.

[0170] [Equation 14]

[0171] G_Target=power(10,-dL_Proc) / 20

[0172] An audio signal processing device can apply the loudness gain G_Target of Equation 14 to the input audio signal. The audio signal processing device can provide an output loudness level identical to the loudness level of the input audio signal by correcting for loudness changes caused by post-processing. The audio signal processing device can maintain the loudness level of the input content by correcting for loudness changes caused by post-processing. The audio signal processing device can use loudness difference in post-processing to set the loudness level of the intermediate audio signal to be the same as the loudness level of the input audio signal. In this case, the intermediate audio signal can be a signal post-processed from the input audio signal. This means that the audio signal processing device changes the pitch relative to the input audio signal through post-processing, but provides the same loudness level as the original input audio signal. Meanwhile, through the above reference... Figure 3 and Figure 4 The described method allows obtaining the loudness difference through post-processing. The post-processed loudness difference can be obtained based on either a provided WLoud_MB or a WLoud_MB based on content-specific characteristics.

[0173] Figure 10 This is a block diagram illustrating an audio signal processing apparatus according to an embodiment of the present invention, which optimizes the loudness gain of an input audio signal by taking into account a target loudness level and cognitive sound quality degradation. The audio signal processing apparatus can determine a target loudness level acceptable to a dynamic processor based on the target loudness level and loudness information of the input audio signal. Here, the dynamic processor can represent a signal processing procedure that clips the signal according to the loudness level, such as the limiter or compressor described above. The loudness information of the input audio signal can include at least one of the following: comprehensive loudness level, short-term loudness level, instantaneous loudness level, sample peak value, true peak value, loudness range, or root mean square (RMS).

[0174] The following describes a detailed embodiment of an audio signal processing apparatus for determining the loudness gain of an input audio signal. According to the embodiment, the maximum value of the target loudness level, which can be set by the user, can be approximately -10 LKFS, and the overall loudness of the input audio signal can be approximately -22 LKFS. Furthermore, the tenth short-term loudness level among the plurality of short-term loudness levels of the input audio signal can be approximately -18 LKFS. In this case, the tenth short-term loudness level can be referenced as described above. Figure 4 The QSHI extraction unit 404 describes a detailed embodiment of the effective short-term loudness level L_ShortTerm_Effective. Specifically, -18 LKFS can be used as an indicator to determine whether the sound quality has been degraded by DRC. When the maximum value of the target loudness level is approximately -10 LKFS, the maximum amplification can be approximately 12 loudness units (LU). In this case, the audio signal processing device can obtain the QSHI based on the tenth short-term loudness level with the amplified maximum amplification.

[0175] An audio signal processing apparatus can compare a predetermined target loudness level input by a user with the QSHI. The audio signal processing apparatus can determine the loudness gain of the input audio signal based on the comparison result. For example, the audio signal processing apparatus can determine the loudness gain of the input audio signal based on the smaller of the input predetermined target loudness level and the QSHI. In the above embodiment, to obtain an index for determining DRC sound quality degradation, the tenth short-term loudness level from the top is selected when short-term loudness levels are arranged in descending order, but this disclosure is not limited thereto. Additionally, the audio signal processing apparatus can obtain the QSHI by performing histogram analysis on at least one of the peak envelope or RMS other than the short-term loudness levels.

[0176] Figure 11 and Figure 12 It is a view showing the fixed gain of the loudness level of the input audio signal and the target loudness level over time. Figure 11 A fixed gain is shown for adjusting the loudness level of a first input audio signal with a loudness distribution less than the target loudness level to the target loudness level. In this case, clipping the first input audio signal in segments greater than 0 dBFS causes excessive pitch distortion. As mentioned above, there are limitations to the loudness level adjustment method using a fixed gain in order to obtain a value close to the target loudness level. Therefore, the audio signal processing apparatus can apply a gain less than the fixed gain value to segments (2) and (4) of the first input audio signal.

[0177] Reference Figure 12 The second input audio signal has a higher frequency response than the previous one. Figure 11 The first input audio signal has a wider dynamic range. Therefore, when the audio signal processing device applies a fixed gain for the target loudness level to the second input audio signal, the loudness level in some segments may be relatively small. Therefore, the audio signal processing device can apply a gain greater than the fixed gain value to segments (1) and (3) of the second input audio signal.

[0178] According to another embodiment, the audio signal processing apparatus can apply gain enhancement. For example, the audio signal processing apparatus can acquire a target loudness range. Based on the acquired target loudness range, the audio signal processing apparatus can set an additional gain for each segment of the input audio signal. Specifically, the audio signal processing apparatus can apply the set additional gain to segments of the input audio signal that have loudness levels outside the target loudness range over time.

[0179] As described above, the audio signal processing apparatus according to embodiments of the present invention can adjust the output loudness level of an input audio signal by applying different gains over time to the input audio signal. The audio signal processing apparatus can adjust the output loudness level of the input content based on loudness metadata of the input audio signal. In this case, the loudness metadata of the input audio signal may include information that changes over time. To apply different gains over time, the audio signal processing apparatus can refer to the metadata that changes over time and normalize the output loudness level of the input audio signal according to a target loudness level and a target loudness range. Therefore, in this disclosure, the audio signal processing apparatus can overcome the limitations described above when compensation for loudness normalization is performed by applying a fixed gain to the input audio signal.

[0180] Figure 13 and Figure 14 These are schematic diagrams illustrating methods for adjusting the output loudness level of an input audio signal according to embodiments of the present invention. Figure 13 An embodiment is shown in which loudness information of an input audio signal is extracted and the output loudness level of the input audio signal is adjusted in a single audio signal processing device. In this case, the audio signal processing device can measure the loudness level of the input audio signal. The audio signal processing device can obtain the loudness information of the input content from the loudness measurement value. (Refer to...) Figure 19 This describes in detail a method for an audio signal processing device to measure the loudness level of an input audio signal in real time.

[0181] Figure 14 The above references are shown. Figure 7 and Figure 8 The server-client architecture is described below. First, the server can extract the loudness information of the input audio signal by analyzing it. Furthermore, the server can generate loudness metadata by converting the loudness information of the input audio signal into metadata format. Next, the client can receive the input audio signal and can receive the loudness metadata of the input audio signal separately from the input audio signal. Additionally, the client can obtain the loudness information used in adjusting the output loudness level of the input audio signal by parsing the loudness metadata. Furthermore, the client can obtain the loudness gain of the input audio signal based on the loudness information and a predetermined target loudness level. The client can adjust the output loudness level of the input audio signal based on the loudness gain of the input audio signal.

[0182] Figure 15 This is a view illustrating a method by which an audio signal processing apparatus according to an embodiment of the present invention acquires loudness information of an input audio signal. The audio signal processing apparatus can acquire loudness information by analyzing the input audio signal. For example, Figure 15 The method can be found in Figure 7It runs on the server. The audio signal processing device can output loudness information in the form of loudness metadata.

[0183] According to an embodiment, loudness information may include static loudness metadata and dynamic loudness metadata. Static loudness metadata may include at least one static loudness parameter. For example, static loudness metadata may include at least one of the following: overall loudness level, maximum sample peak, loudness range (LRA), peak-to-loudness range (PLR), album overall loudness, relative threshold, minimum instantaneous loudness, maximum instantaneous loudness, or per-frame sample of the input audio signal.

[0184] An audio signal processing apparatus can acquire static loudness metadata of an input audio signal. Specifically, the audio signal processing apparatus can measure at least one of the instantaneous loudness or short-term loudness level of the input audio signal based on an auditory scale and by using a loudness filter. The audio signal processing apparatus can generate static loudness metadata that includes at least one static loudness parameter.

[0185] Dynamic loudness metadata can represent loudness information that changes over time. Dynamic loudness metadata can include at least one dynamic loudness parameter. For example, dynamic loudness metadata can include at least one of a short-term loudness level that changes over time or a peak value of the input audio signal. (Refer to...) Figure 21 This describes in detail the method for obtaining peak envelopes using an audio signal processing device.

[0186] According to an embodiment, the audio signal processing apparatus can acquire dynamic loudness metadata of an input audio signal. For example, the audio signal processing apparatus can acquire short-term loudness measurements for a specific segment of the input audio signal. The signal processing apparatus can acquire the peak envelope of the input audio signal for the corresponding segment. The audio signal processing apparatus can generate dynamic loudness metadata including at least one dynamic loudness parameter. Furthermore, the audio signal processing apparatus can correct for time delays or leading edges of dynamic loudness parameters, such as short-term loudness measurements and peak values. For example, the audio signal processing apparatus can vary the dynamic loudness range. (See reference...) Figure 21 Describe in detail.

[0187] An audio signal processing device can acquire the short-term loudness levels of sample values ​​input before and after a specific time point. As a result, the audio signal processing device can more stably control the loudness level by utilizing changes in the loudness of the input audio signal. For example, the audio signal processing device can acquire the short-term loudness levels of sample values ​​input before and after a specific time point by varying the time reference value of an already acquired dynamic loudness parameter. Alternatively, the audio signal processing device can acquire the short-term loudness levels of sample values ​​input before and after a specific time point by using a buffer. In this case, the audio signal processing device can set a sufficient look-ahead time.

[0188] Figure 16 This is a view illustrating a method by which an audio signal processing apparatus adjusts the output loudness level of an input audio signal according to an embodiment of the present invention. The audio signal processing apparatus can obtain a loudness gain of the input audio signal based on loudness metadata and a target loudness level. Specifically, the audio signal processing apparatus can calculate a gain parameter based on the target loudness level and static loudness metadata. The audio signal processing apparatus can obtain a loudness gain applied to a specific frame of the input audio signal based on the calculated gain parameter and dynamic loudness metadata. For example, the audio signal processing apparatus can parse the dynamic loudness metadata to obtain at least one of a peak envelope or a short-term loudness level corresponding to the corresponding frame. The audio signal processing apparatus can obtain a loudness gain applied to a corresponding frame based on at least one of a peak envelope and a short-term loudness level corresponding to the corresponding frame. Specifically, the audio signal processing apparatus can obtain a loudness gain applied to a corresponding frame based on the calculated short-term loudness level corresponding to the corresponding frame and the gain parameter. In this case, the loudness gain applied to the corresponding frame can be limited so that clipping based on the loudness level does not occur in the corresponding frame. An audio signal processing apparatus can correct the loudness gain applied to a corresponding frame based on the peak envelope, thereby preventing clipping based on loudness level in that frame. The audio signal processing apparatus can generate an intermediate audio signal by applying a final loudness gain to the input audio signal. Furthermore, the audio signal processing apparatus can generate an output audio signal by applying a limiter to the intermediate audio signal. The audio signal processing apparatus can output this output audio signal. According to another embodiment, when the loudness gain difference between each frame for adjacent frames is greater than or equal to a predetermined size, the audio signal processing apparatus can correct the loudness gain for each frame. In this case, the audio signal processing apparatus can use a method called smoothing to adjust the loudness gain smoothly. Therefore, the audio signal processing apparatus can prevent pitch distortion caused by changes in loudness gain per frame or sudden, significant increases in volume level. (Refer to...) Figure 22 This describes in detail the method by which an audio signal processing device performs loudness gain smoothing.

[0189] Figure 17 This is a view illustrating a method by which an audio signal processing apparatus according to an embodiment of the present invention adjusts the output loudness level of an input audio signal based on a target loudness range. The audio signal processing apparatus can perform the calculations described above. Figure 16 The target loudness range is also considered during the process of determining the gain parameters. (See reference...) Figure 12 The target loudness range may be narrower than the dynamic range of the input audio signal. When listening to video / sound at low volumes depending on the environment, or listening to music in noisy environments (such as on the subway or on the street), it is necessary to reduce the dynamic range of the input audio signal for playback.

[0190] Therefore, the audio signal processing device can calculate the gain parameter of the input audio signal based on the target loudness range of the input audio signal. In this case, the gain parameter may include a gain ratio for loudness compression. The audio signal processing device can apply additional boost gain to frames with short-term loudness less than a predetermined amplitude among the multiple frames included in the input audio signal, based on the gain ratio. The audio signal processing device can also apply additional cut-off gain to frames with short-term loudness greater than a predetermined amplitude among the multiple frames included in the input audio signal, based on the gain ratio. Therefore, the audio signal processing device can adjust the output loudness level of the entire segment of the input audio signal to approximate the target loudspeaker level.

[0191] According to an additional embodiment, the audio signal processing apparatus can perform loudness normalization for each time period based on loudness parameters measured differently for each time period. Specifically, the audio signal processing apparatus can determine the loudness gain G_loud for each time period of the input audio signal based on the target loudness level L_T, the comprehensive loudness level L_I, the short-term loudness level L_S, the relative threshold L_Rel, the background noise level L_Noise, and the peak envelope P. Here, L_Rel can be a value obtained by adding a predetermined value to the average of the dynamic loudness parameters that are effective throughout the entire segment of the input audio signal. In this case, the predetermined value can be approximately -20 LU. Furthermore, the dynamic loudness parameter can be an instantaneous loudness level or a short-term loudness level.

[0192] For example, L_Rel can be a value calculated based on the average of short-term loudness levels that have a value at least greater than the effective loudness level in the short-term loudness levels of each segment of the input audio signal. L_Rel can also be a value calculated based on the average of instantaneous loudness levels that have a value at least greater than the effective loudness level in the short-term loudness levels of each segment of the input audio signal. Here, the effective loudness level can be a value set based on a loudness level that is difficult to perceive audibly. The effective loudness level can also be a value set based on the loudness level of an audio signal with almost no sound. For example, the effective loudness level can be a value set based on approximately -70LKFS.

[0193] Additionally, L_Noise can be a value calculated based on at least one of the loudness level of a segment of the input audio signal that has almost no sound or the loudness level of a segment that corresponds to a very low background noise level in the input audio signal.

[0194] According to embodiments, each of L_T, L_I, L_S, L_Rel, L_Noise, and P can be obtained using the aforementioned loudness metadata. Additionally, the time period may include frames. In the described embodiments, the short-term loudness level L_S can be replaced by a representative loudness value representing a specific time period. For example, the short-term loudness level L_S can be replaced by the instantaneous loudness level of the input audio signal. Equation 16 below describes a method by which the audio signal processing apparatus obtains the loudness gain G_loud for each time period based on L_T, L_I, L_S, L_Rel, L_Noise, and P.

[0195] [Equation 16]

[0196]

[0197] Where 1≥r1≥r2>0

[0198] In Equation 16, r_1 and r_2 can represent loudness compression ratios used to control the dynamic range of the output audio signal relative to the input audio signal. r_1 can be a loudness compression ratio used to obtain the loudness gain of the corresponding segment in a segment where the input loudness level of the input audio signal is at least less than the combined loudness level. r_1 can be set based on at least one of LRA, PLR, or the instantaneous loudness maximum value representing the input loudness range. r_1 can be any constant between 0 and 1. r_2 can be a compression ratio used to obtain the loudness gain of the corresponding segment in a segment where the input loudness level of the input audio signal is less than the combined loudness level and the input loudness level of the input audio signal is less than L_Rel. In this case, r_2 can be set to a value at least less than r_1 to minimize the boost of noise components. The audio signal processing device can perform smoothing on G_loud[n] to apply the smoothed G_loud[n] to the input audio signal. Additionally, clippingThreshold can represent the maximum allowed sample peak envelope. clippingThreshold can be a value set based on at least one of QSHI, truePeak, and maximum allowed sample peak envelope. For example, clippingThreshold can be the same value as QSHI. Alternatively, clippingThreshold can be a value arbitrarily set in the audio signal processing device or in the audio delivery system.

[0199] In the following text, reference will be made to Figure 18 A method for acquiring loudness measurement values ​​using an audio signal processing apparatus according to an embodiment of the present invention is described in detail. Figure 18 This is a view illustrating a method for measuring the loudness of input content using an audio signal processing apparatus according to an embodiment of the present invention. According to the embodiment, the audio signal processing apparatus can measure the loudness of the input content based on the aforementioned measurement windows. Furthermore, the audio signal processing apparatus can acquire loudness measurement values ​​for each measurement window of the input content. The audio signal processing apparatus can acquire loudness information based on the loudness measurement values ​​for each measurement window.

[0200] exist Figure 18 In one embodiment, the audio signal processing device can obtain the measurement value for each measurement window based on the length of the measurement window 801. In this case, the length of the measurement window 801 can be a default value pre-stored in the audio signal processing device. According to an embodiment of the invention, the length of the measurement window 801 can change depending on the input content. For example, the audio signal processing device can obtain the length of the measurement window corresponding to the input content based on additional information about the input content. Figure 18In one embodiment, the length of the measurement window corresponding to the input content can be approximately 400 ms. The audio signal processing device can acquire a loudness measurement corresponding to a specific segment of approximately 400 ms in length among all segments of the input content.

[0201] According to an embodiment, the length of the measurement window can be obtained based on additional information. For example, the length of the measurement window can be obtained based on the loudness range of the input content. Here, the loudness range can be a value representing the loudness level distribution of all segments of the content. The loudness range can be indicated by using a unit representing a relative measurement quantity, such as LU. The audio signal processing device can obtain information about the loudness range of the input content from the additional information. Next, the audio signal processing device can determine the length of the measurement window based on the loudness range of the input content. In this case, the length of the measurement window of the input content can be set to a value smaller than the length of the measurement window of other content whose loudness range is wider than that of the input content. For example, when the loudness range of the first input content is greater than the loudness range of the second input content, the length of the measurement window of the first input content can be greater than the length of the measurement window of the second input content.

[0202] Furthermore, the audio signal processing apparatus can acquire the loudness measurement value for each measurement window based on the measurement period used to acquire the measurement values ​​of the input content. In this disclosure, the measurement period can represent the time distance of moving the measurement window. (See also...) Figure 18 The first measurement value 802 can be a loudness measurement value corresponding to a segment (300ms to 700ms) based on the time point at which the input content begins playback. Additionally, the first measurement value 803 can be a loudness measurement value corresponding to a segment (400ms to 800ms) based on the time point at which the input content begins playback. When the time length from the time point at which the input content begins playback to the current time point is less than the length of the measurement window, the audio signal processing device can acquire a loudness measurement value in the most recent measurement period after the current time point. In this case, the audio signal processing device can acquire a loudness measurement value corresponding to a segment shorter than the length of the measurement window.

[0203] Specifically, the audio signal processing device can determine the measurement period based on additional information. For example, the measurement period can be determined based on the length of the input content. For instance, when the length of the second input content is greater than the length of the first input content, the measurement period of the first input content can be shorter than the measurement period of the second input content. Furthermore, the audio signal processing device can acquire loudness measurements for each measurement window based on the determined measurement period. Figure 18In one embodiment, the measurement period can be approximately 100 ms. The audio signal processing device can acquire a loudness measurement value for each measurement window by moving the measurement window every 100 ms. Additionally, the audio signal processing device can be based on... Figure 18 The above loudness information is obtained by measuring multiple loudness values.

[0204] Figure 19 This is a flowchart illustrating the operation of an audio signal processing apparatus according to an embodiment of the present invention. The audio signal processing apparatus according to an embodiment of the present invention can receive an input audio signal (step S1901). In this case, the input audio signal may include a reference... Figure 2 The input content is described. Next, the audio signal processing device can receive loudness metadata corresponding to the input audio signal (step S1902).

[0205] Next, the audio signal processing apparatus can obtain the loudness information of the input audio signal by parsing loudness metadata (step S1903). According to an embodiment of the present invention, the loudness information may include information representing each of the comprehensive loudness levels of the input audio signal, at least one short-term loudness level, Quality Safety Histogram Index (QSHI), dynamic range of the input audio signal, loudness energy at each frequency, loudness ratio at each frequency, or peak envelope. For the method by which the audio signal processing apparatus obtains each piece of information included in the loudness information, the above-described reference can be applied. Figures 2 to 18 The described embodiments.

[0206] QSHI can represent the threshold loudness level at which cognitive sound quality impairment will not occur. This can be based on the above... Figure 3 Step S303 Figure 4 QSHI extraction unit 404 and reference Figure 10 The embodiments described obtain the QSHI. For example, the QSHI can be a loudness parameter calculated based on a loudness histogram of the input audio signal. In this case, the loudness histogram can be an amplitude histogram of the short-term loudness levels of the input audio signal over time. Alternatively, the loudness histogram can be an amplitude histogram associated with the peak envelope or root mean square (RMS) of each segment of the input audio signal. The QHSI can be greater than the overall loudness level of the input audio signal.

[0207] According to an embodiment, QSHI is a parameter calculated based on a predicted loudness histogram predicted from the loudness histogram of the input audio signal. In this case, the predicted loudness histogram may be a histogram generated based on the loudness parameters predicted when the input audio signal is output according to the target loudness level.

[0208] According to an embodiment, QSHI can be determined based on the number of times the limiter is driven in the audio signal processing device. In this case, the audio signal processing device can output an output audio signal by applying a loudness limiter, which limits the loudness level of the output audio signal, to the output audio signal. In this case, the output audio signal can be a signal that adjusts the output loudness level of the input audio signal according to the loudness gain. QHSI can be a parameter set such that the short-term loudness level of the entire segment of the output audio signal is less than or equal to a predetermined level.

[0209] Next, the audio signal processing device can obtain the loudness gain of the input audio signal based on the loudness information and the target loudness level (S1904). According to one embodiment, the loudness gain of the input audio signal can be a fixed gain with a fixed value throughout the entire segment of the input audio signal. According to another embodiment, the loudness gain of the input audio signal can be a gain that changes over time during playback of the input audio signal.

[0210] According to an embodiment of the present invention, the audio signal processing apparatus can receive the overall loudness of an input audio signal. Furthermore, the audio signal processing apparatus can determine a loudness gain based on the overall loudness, QSHI, and target loudness level of the input audio signal.

[0211] According to an embodiment, the audio signal processing apparatus can compare the target loudness level of the input audio signal with the QSHI (Quantity of Loudness). Furthermore, the audio signal processing apparatus can determine a loudness gain based on the comparison result. The audio signal processing apparatus can determine the loudness gain based on the smaller of the target loudness level and the QSHI of the input audio signal. For this purpose, a reference can be applied. Figure 10 The specific embodiments described herein.

[0212] According to an embodiment, the audio signal processing apparatus can obtain the loudness gain of the input audio signal based on the QSHI corrected from the QSHI of the input audio signal. For example, the audio signal processing apparatus can perform post-processing on the input audio signal. In this case, the audio signal processing apparatus can receive post-processing information representing the characteristics of the post-processing of the input audio signal. Furthermore, the audio signal processing apparatus can correct the pre-obtained QSHI based on the post-processing information. According to an embodiment, the audio signal processing apparatus can correct the pre-obtained QSHI based on the post-processing information and a pre-stored function. The audio signal processing apparatus can correct the pre-obtained QSHI based on the post-processing information and a pre-stored lookup table. In this case, the pre-stored lookup table can include information about QSHI correction based on the characteristics of the post-processing. Additionally, the information about QSHI correction can include information representing the QSHI correction value based on the characteristics of the post-processing. The audio signal processing apparatus can obtain the QSHI correction value corresponding to the post-processing of the input audio signal based on the pre-stored lookup table. The audio signal processing apparatus can correct the QSHI by adding the QSHI correction value to the obtained QSHI. The audio signal processing device can determine the loudness gain of the input audio signal based on the QSHI corrected by the above method.

[0213] According to an embodiment, the audio signal processing apparatus can determine the loudness gain of the input audio signal based on the loudness energy of each frequency and post-processing information representing the characteristics of post-processing of the input audio signal. The audio signal processing apparatus can also determine the loudness gain of the input audio signal based on the loudness level for each band, which is changed through post-processing.

[0214] According to an embodiment, the audio signal processing apparatus can obtain a loudness level for each band modified by post-processing based on the loudness energy of each frequency and post-processing information representing the characteristics of post-processing of the input audio signal. The audio signal processing apparatus can obtain the loudness level for each band modified by post-processing based on the loudness ratio of each frequency and the post-processing information of the input audio signal. The loudness level for each band modified by post-processing can be calculated based on the dot product of the loudness ratios of each frequency of the input audio signal. The loudness level for each band modified by post-processing can also be a parameter obtained based on cognitive loudness characteristics. The audio signal processing apparatus can obtain the loudness level for each band modified by post-processing of the input audio signal based on a loudness filter based on an auditory scale. Specifically, the loudness filter can be at least one of an inverse filter of an equal-loudness curve or a K-weighted filter approximating the inverse filter. When the loudness level of a specific frame among a plurality of frames included in the input audio signal is less than or equal to a relative threshold, the audio signal processing apparatus may not calculate the loudness level for each band modified by post-processing corresponding to the corresponding frame. For example, the loudness level for each band, which is changed by post-processing of the input audio signal, can be a parameter set based on at least one of the types of the input audio signal or user input.

[0215] The loudness ratio and / or loudness energy of each frequency of the input audio signal can be values ​​calculated based on loudness measurements of the input audio signal. The loudness ratio of each frequency of the input audio signal can be a parameter obtained based on cognitive loudness characteristics. The audio signal processing device can obtain the loudness ratio of each frequency of the input audio signal based on a loudness filter based on an auditory scale. Specifically, the loudness filter can be at least one of an inverse filter of an equal-loudness curve or a K-weighted filter approximating that inverse filter. When the loudness level of a specific frame among multiple frames included in the input audio signal is less than or equal to a relative threshold, the audio signal processing device may not calculate the loudness ratio of each frequency corresponding to the corresponding frame. See also... Figure 4 The embodiment described uses a loudness analysis unit 402 for each frequency to obtain the loudness ratio for each frequency. As another example, the loudness ratio for each frequency of the input audio signal can be a parameter set based on at least one of the types of the input audio signal or user input.

[0216] An audio signal processing device can acquire post-processing information about an input audio signal based on user input. In this case, the user input can be input related to the input audio signal. Alternatively, the user can be a user of the audio signal processing device. The post-processing information can include information representing each of the output characteristics of the audio signal processing device, the type of the input audio signal, the post-processing mode according to the user input, the type of equalization, and at least one of reverberation or room compensation. For a method by which the audio signal processing device determines the loudness gain of the input audio signal based on loudness levels changed for each band through post-processing, references can be applied. Figure 3 The embodiment described in step S303.

[0217] According to an embodiment, an audio signal processing apparatus can determine the loudness gain of an input audio signal based on a loudness difference. The loudness difference can be a predicted value of the loudness change of the input audio signal due to post-processing. The audio signal processing apparatus can acquire the loudness difference based on post-processing information set by a user. The audio signal processing apparatus can acquire the loudness difference based on at least one of the loudness level for each band or the characteristics of the input audio signal for each frequency, altered by post-processing. The loudness difference can be calculated based on the dot product of the loudness ratios for each frequency of the input audio signal. The loudness difference can be a parameter obtained based on cognitive loudness characteristics. The audio signal processing apparatus can acquire the loudness difference of the input audio signal based on a loudness filter based on an auditory scale. Specifically, the loudness filter can be at least one of an inverse filter of an equal-loudness curve or a K-weighted filter of an approximate inverse filter. When the loudness level of a specific frame among multiple frames included in the input audio signal is less than or equal to a relative threshold, the audio signal processing apparatus may not calculate the loudness difference corresponding to the corresponding frame. For the method by which the audio signal processing apparatus acquires the loudness difference, a reference can be applied. Figure 4 Loudness analysis unit 402 for each frequency and Figure 4 The embodiment described in the post-processing loudness prediction unit 403.

[0218] According to an embodiment, the audio signal processing apparatus can determine the loudness gain of the input audio signal based on loudness information of each frame of the input audio signal. The audio signal processing apparatus can obtain the loudness gain of each frame of the input audio signal based on the loudness information of each frame of the input audio signal. The loudness gain of the input audio signal can be a gain that changes over time during playback of the input audio signal. According to an embodiment, the audio signal processing apparatus can receive loudness metadata including loudness information for each frame of the input audio signal. The audio signal processing apparatus can obtain the loudness information for each frame of the input audio signal by parsing the loudness metadata. The loudness information for each frame can include dynamic loudness parameters. According to an embodiment, the loudness information for each frame can include information representing the peak envelope for each frame. The peak envelope for each frame can be obtained based on the maximum absolute value of the audio signal included in a frame having a predetermined length.

[0219] According to an embodiment, the audio signal processing apparatus can determine the loudness gain for each frame of the input audio signal based on the peak envelope of each frame of the input audio signal. The audio signal processing apparatus can determine the loudness gain for each frame of the input audio signal based on a target loudness level and the peak envelope of each frame of the input audio signal. For example, the audio signal processing apparatus can set the loudness gain for each frame based on the target loudness level so as not to exceed the peak envelope for each frame. Furthermore, the audio signal processing apparatus can adjust the output loudness level of the corresponding frame of the input audio signal based on the loudness gain for each frame. The above-described reference can be applied to the method by which the audio signal processing apparatus determines the loudness gain based on loudness information for each frame. Figure 17 The described embodiments.

[0220] Next, the audio signal processing apparatus can adjust the output loudness level of the input audio signal based on the loudness gain (S1905). According to an embodiment, the audio signal processing apparatus can generate an output audio signal by adjusting the output loudness level of the input audio signal. In this case, the audio signal processing apparatus can use the determined loudness gain. According to an embodiment, the audio signal processing apparatus can output the generated output audio signal by applying a loudness limiter to it.

[0221] According to an additional embodiment of the invention, the audio signal processing apparatus can adjust the output loudness level of the input audio signal based on the segment loudness gain of some segments within a whole segment of the input audio signal. According to the embodiment, the audio signal processing apparatus can obtain a loudness gain corresponding to a specific segment based on a loudness parameter corresponding to that segment of the input audio signal. For example, the loudness parameter corresponding to a specific segment of the input audio signal may include at least one representative value for that segment. In this case, the representative value may include at least one of the maximum absolute value of the loudness level of the input audio signal corresponding to the segment or a short-term loudness level.

[0222] According to an embodiment, the audio signal processing apparatus can determine the loudness gain for each time period of the input audio signal based on a target loudness level, a combined loudness level, and an input loudness level. In this case, the input loudness level can be a loudness level representing a specific segment. For example, the input loudness level can be a short-term loudness level. The audio signal processing apparatus can compare at least two or more of the following: target loudness level, combined loudness level, input loudness level, relative threshold, background noise level L_Noise, or peak envelope. Furthermore, the audio signal processing apparatus can determine the loudness gain for each time period of the input audio signal based on the comparison results.

[0223] For example, an audio signal processing device can compare a target loudness level with a combined loudness level. An audio signal processing device can also compare an input loudness level with a combined loudness level. When the target loudness level is less than the combined loudness level and the input loudness level is greater than the combined loudness level, the audio signal processing device can apply a first loudness gain for each segment to the input audio signal of the corresponding segment.

[0224] For example, when the target loudness level is greater than the overall loudness level, the input loudness level is less than the overall loudness level, and the input loudness level is greater than the relative threshold, the audio signal processing device can apply the second loudness gain for each segment to the input audio signal of the corresponding segment.

[0225] For example, when the target loudness level is greater than the overall loudness level, the input loudness level is less than the overall loudness level, the input loudness level is less than the relative threshold, and the input loudness level is greater than the background noise level, the audio signal processing device can apply the third loudness gain for each segment to the input audio signal of the corresponding segment.

[0226] For example, when the target loudness level is greater than the overall loudness level, the input loudness level is less than the overall loudness level, the input loudness level is less than the relative threshold, and the input loudness level is less than the background noise level, the audio signal processing device can apply the fourth loudness gain for each segment to the input audio signal of the corresponding segment. In this case, the fourth loudness gain for each segment can be the loudness gain of the frame preceding the corresponding frame. For example, when the target loudness level is greater than the overall loudness level, the input loudness level corresponding to the Nth frame is less than the overall loudness level, the input loudness level corresponding to the Nth frame is less than the relative threshold, and the input loudness level corresponding to the Nth frame is less than the background noise level, the audio signal processing device can use the loudness gain corresponding to the (N-1)th frame as the loudness gain corresponding to the Nth frame.

[0227] According to another embodiment, the fourth loudness gain for each segment can represent a fixed gain applied to the entire input audio signal. Additionally, each of the first loudness gain, the second loudness gain, and the third loudness gain for each segment can be a gain corrected using a different method than the fourth loudness gain for each segment. Furthermore, the first loudness gain, the second loudness gain, and the third loudness gain for each segment can be gains with different values.

[0228] According to an embodiment, the representative loudness value of the Nth segment of the input audio signal can be the representative value corresponding to a segment adjacent to the Nth segment of the input audio signal. For example, the representative loudness value of a specific Nth segment of the input audio signal can be the representative value corresponding to the (N+L)th or (NL)th segment. In this case, L can be an index value corresponding to a segment shorter than the time segment used to obtain the representative value. For example, the time segment used to obtain the representative value can be three seconds. Alternatively, the audio signal processing device can obtain the representative value of a specific segment of the input audio signal based on a delayed input audio signal. In this case, the audio signal processing device can obtain at least one loudness measurement value for obtaining the representative value by delaying the input audio signal based on a predetermined delay time.

[0229] According to an embodiment, the audio signal processing apparatus can acquire a fixed loudness gain applied to the entire input audio signal. In this case, the audio signal processing apparatus can correct the fixed loudness gain based on a loudness parameter corresponding to a specific segment of the input audio signal. Furthermore, the audio signal processing apparatus can adjust the output loudness level of the input audio signal for the corresponding segment based on the corrected gain. For the method by which the input audio signal processing apparatus adjusts the output loudness level of the input audio signal based on the segment loudness gain of some segments of the entire input audio signal, the method described above can be applied. Figure 17 The described embodiments.

[0230] Figure 20 This is a block diagram illustrating the configuration of an audio signal processing apparatus 2000 according to an embodiment of the present invention. According to the embodiment, the audio signal processing apparatus 2000 may include a receiver 2100, a processor 2200, and an output unit 2300. However, not all... Figure 10 All components shown are essential components of the audio signal processing apparatus. The audio signal processing apparatus 2000 may further include components not shown in the diagram. Figure 20 The components shown are as described. For example, the audio signal processing apparatus according to an embodiment may further include a storage unit (not shown). Furthermore, it may be omitted. Figure 20 The audio signal processing apparatus 2000 shown in the figure includes at least some components. For example, the audio signal processing apparatus according to the embodiment may not include at least one of the receiver 2100 or the output unit 2300.

[0231] Receiver 2100 can receive input content input to audio signal processing device 2000. Receiver 2100 can receive input content whose output loudness level is adjusted by processor 2200. As described above, the input content may include an audio signal. In this case, the audio signal may include at least one of surround sound signal, object signal, or channel signal. The audio signal may be an object signal or a mono signal. The audio signal may be a multi-object signal or a multi-channel signal. According to an embodiment, receiver 2100 may include an input terminal for receiving input content transmitted wiredly. Alternatively, receiver 2100 may include a wireless receiving module for receiving input content transmitted wirelessly.

[0232] According to an embodiment, the audio signal processing apparatus 2000 may include a separate decoder. In this case, the receiver 2100 may receive an encoded bitstream of input content. Furthermore, the encoded bitstream can be decoded back into input content by the decoder. Additionally, the receiver 2100 may receive additional information related to the input content.

[0233] According to an embodiment, receiver 2100 may include a transmitting / receiving device for sending data to and receiving data from an external device via a network. In this case, the data may include at least one of a bitstream of input content or additional information. Receiver 2100 may include a wired transmitting / receiving terminal for receiving data transmitted in a wired manner. Alternatively, receiver 2100 may include a wireless transmitting / receiving terminal for receiving data transmitted wirelessly. In this case, receiver 2100 may use Bluetooth or Wi-Fi communication methods to receive data transmitted wirelessly. Furthermore, receiver 2100 may receive data transmitted according to mobile communication standards such as LTE and LTE-Advanced, but this disclosure is not limited thereto. Receiver 2100 may receive data in various forms transmitted according to various wired and wireless communication standards.

[0234] The processor 2200 can control the overall operation of the audio signal processing device 2000. The processor 2200 can control each component of the audio signal processing device 2000. The processor 2200 can perform various data and signal calculations and processing. The processor 2200 can be implemented as hardware in the form of a semiconductor chip or electronic circuit, or it can be implemented as software controlling the hardware. The processor 2200 can be implemented in a combination of hardware and software. For example, the processor 2200 can control the operation of the receiver 2100 and the output device 2300 by executing at least one program. Additionally, the processor 2200 can execute at least one program to perform the aforementioned reference... Figures 1 to 19 The aforementioned operation.

[0235] According to an embodiment, processor 2200 can adjust the output loudness level of the input content. For example, processor 2200 can adjust the output loudness level of the input content based on loudness gain. Loudness information can be the loudness characteristics of the input content analyzed from the input content. In this case, loudness gain can be obtained based on loudness information. Furthermore, processor 2200 can output the output content whose output loudness level has been adjusted according to the input content. In this case, processor 2200 can output the output content through output device 2300, which will be described later.

[0236] Output device 2300 can output output content. Output device 2300 can output output content whose output loudness level has been adjusted by processor 2200 from the input content. Here, the output content may include an output audio signal. In this case, the output audio signal may include at least one of a surround sound signal, an object signal, or a channel signal. The output audio signal may be a multi-object signal or a multi-channel signal. Additionally, the output audio signal may include two-channel output audio signals respectively corresponding to the listener's two ears. The output audio signal may include binaural two-channel output audio signals. Output device 2300 can output an audio headphone signal whose output loudness level has been adjusted by processor 2200.

[0237] According to an embodiment, the output device 2300 may include an output means for outputting output content. For example, the output device 2300 may include an output terminal for outputting an audio signal to an external device. In this case, the audio signal processing device 2000 may output the audio signal to an external device connected to the output terminal. The output device 2300 may include a wireless transmitter / receiver module for outputting the audio signal to an external device. In this case, the output device 2300 may use a wireless communication method (such as Bluetooth or Wi-Fi) to output the audio signal to an external device.

[0238] Additionally, the output unit 2300 may include a speaker. In this case, the audio signal processing device 2000 can output the output audio signal through the speaker. Furthermore, the output unit 2300 may further include a converter (e.g., a digital-to-analog converter DAC) that converts the digital audio signal into an analog audio signal. Additionally, the output unit 2300 may include a display device for outputting a video signal included in the output content.

[0239] As described above, the audio signal processing apparatus 2200 may further include a storage unit (not shown). The storage unit may store at least one of the data or programs used for processing and controlling the processor 2200. Furthermore, the storage unit may store loudness information. The storage unit may store loudness information extracted from received loudness metadata. The storage unit may store the received target loudness level. Furthermore, the storage unit may store loudness measurements acquired by the processor 2200. Furthermore, the storage unit may store results calculated in the processor 2200. For example, the storage unit may store a loudness gain determined based on the loudness information. Furthermore, the storage unit may store data input to or output from the audio signal processing apparatus 2000.

[0240] The storage unit may include at least one memory. In this case, the memory may include at least one of the following storage media: flash memory, hard disk storage, multimedia card micro storage, card memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, magnetic disk, or optical disk.

[0241] Figure 21 This is a view illustrating the peak envelope of the input audio signal for each time period according to an embodiment of the present invention. Figure 21 In one embodiment, the peak envelope for each time period can be a value obtained based on a loudness measurement taken from the input audio signal. Figure 21 In the diagram, the solid line indicates the loudness measurement of the input audio signal over time. Furthermore, the first dashed line (-*-) indicates the representative value for each time interval of the loudness measurement of the input audio signal over time. The audio signal processing device can obtain the peak envelope for each time interval based on the representative value for each time interval. In this case, the corresponding representative value is calculated based on the value of the input buffer to the loudness meter, thus an error will occur based on the actual input audio signal.

[0242] exist Figure 21 In the diagram, the value indicated by the second dashed line (-Δ-) can be a representative value for each time segment obtained through a time delay of approximately 15 ms. The audio signal processing device can obtain the representative value for each time segment by applying the time delay to the input audio signal. Therefore, the audio signal processing device can correct the acquired peak envelope to better correspond to loudness variations in the input audio signal. In this case, the delay duration for the time delay can be set based on the length of the measurement frame of the input audio signal. A reference... Figure 21 The described method for correcting the time delay of the peak envelope is applied to the reference. Figure 15 Other dynamic loudness parameters described. For example, an audio signal processing device can obtain a short-term loudness level by using a time delay.

[0243] Figure 22This is a view illustrating a method by which an audio signal processing apparatus according to an embodiment of the present invention uses smoothing to adjust the output loudness level of an input audio signal. According to an embodiment of the present invention, the audio signal processing apparatus can adjust the output loudness level of an input audio signal such that the loudness gain is smoothly changed by smoothing. In this case, since smoothing (causal processing) is performed based on loudness measurements of the input audio signal, the audio signal processing apparatus may not be able to appropriately provide the required parameters for the corresponding frame relative to the actual loudness change.

[0244] Accordingly, the audio signal processing device can perform a smoothing operation on the loudness gain of the input audio signal by using a loudness parameter obtained through a time delay. In this case, the loudness parameter obtained through the time delay can be obtained from the above reference. Figure 21 The method described retrieves the parameters.

[0245] exist Figure 22 In this diagram, the values ​​indicated by solid lines represent the loudness gain for each frame of the input audio signal. In this case, the values ​​indicated by solid lines can represent the loudness gain without applying smoothing. Alternatively, the values ​​indicated by the third dashed line (--) and the fourth dashed line (-·-) can represent the loudness gain with smoothing applied from the loudness gain for each frame. In this case, each loudness gain for each frame indicated by the third dashed line (--) can represent the first loudness gain for each frame (smoothed from the varying input) obtained based on a measurement with applied time delay. On the other hand, each loudness gain for each frame indicated by the fourth dashed line (-·-) can represent the second loudness gain for each frame (smoothed from the original input) obtained based on a measurement without applied time delay.

[0246] Reference Figure 22 The second loudness gain for each frame can be varied to more closely resemble the loudness level of the input audio signal, compared to the first loudness gain used for each frame. (Reference) Figure 22 In one section, where the frame index, serving as the horizontal axis, is approximately 110 to approximately 130, the loudness gain for each frame of the input audio signal for which no smoothing has been applied is rapidly decreased. In the corresponding section, the first loudness gain for each frame gradually decreases compared to the second loudness gain for each frame. The second loudness gain for each frame decreases rapidly compared to the first loudness gain for each frame. Furthermore, the first loudness gain for each frame begins to decrease for a predetermined frame compared to the second loudness gain for each frame. Therefore, the audio signal processing device can prevent the listener from experiencing sudden changes in loudness by using the first loudness gain for each frame, obtained based on measurements to which a time delay has been applied.

[0247] According to an embodiment of the present invention, the audio signal processing apparatus may apply a loudness gain determined for each segment to the input audio signal in order to process the characteristics of the input audio signal according to a target loudness level. In this case, an excessively large loudness gain value may be applied to a particular segment. Therefore, clipping greater than 0 dBFS or greater than a predefined value (threshold) may occur. Therefore, the audio signal processing apparatus may apply a limiter to the output audio signal. As a result, the audio signal processing apparatus may apply the limiter to segments of the output audio signal whose loudness level has been adjusted from the input audio signal and is greater than a predetermined loudness level.

[0248] In this context, a method (causal processing) is used to process the output audio signal processed in the limiter in real time or sequentially according to the limiter parameters associated with the limiter. When an audio signal processing device uses a limiter, it may cause unexpected pitch distortion. As mentioned above, the audio signal processing device can adjust the output loudness level of the input audio signal by using a loudness gain determined for each segment. In this case, the loudness gain determined for each segment may be a gain that takes into account the peak envelope for each segment. The audio signal processing device can predict clipping or the generation of segments with a level exceeding the target loudness level in the corresponding segment based on the peak envelope of each segment. Furthermore, the audio signal processing device can determine the loudness gain for each segment of the input audio signal based on the above prediction. That is, the audio signal processing device can perform inverse correction of the loudness gain based on the prediction. Therefore, the audio signal processing device can prevent pitch distortion of the output audio signal caused by the limiter.

[0249] Some embodiments may also be implemented in the form of a recording medium including computer-executable instructions (such as computer-executable program modules). A computer-readable medium can be any available medium accessible by a computer and can include volatile and non-volatile media, as well as removable and non-removable media. Furthermore, a computer-readable medium can include a computer storage medium. A computer storage medium can include volatile and non-volatile media, as well as removable and non-removable media, implemented using any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data).

[0250] Although this disclosure has been described with reference to specific embodiments, it is not limited thereto. Therefore, those skilled in the art will readily understand that various modifications and alterations can be made thereto without departing from the scope of this disclosure. That is, although this disclosure has been described with reference to embodiments incorporating adjusted loudness levels of audio signals, it is equally applicable to and extends to various multimedia signals, including video signals and audio signals. Therefore, anything that can be readily inferred by those skilled in the art from the detailed description and embodiments of this disclosure is within the scope of this disclosure.

Claims

1. An audio signal processing apparatus for controlling loudness levels, the audio signal processing apparatus comprising: Receiver, the receiver being used to receive input audio signals; A processor for generating loudness metadata corresponding to the input audio signal; as well as An output device, the output device being used to transmit the loudness metadata generated in the processor, The processor is configured as follows: Measure the loudness of the input audio signal to obtain loudness information of the input audio signal; Transform the loudness information to generate the loudness metadata; and The generated loudness metadata is output to an output device for outputting the input audio signal through the output device, wherein the loudness information includes information representing the loudness ratio for each frequency of the input audio signal. The loudness ratio for each frequency of the input audio signal will be used by an audio signal processing device, which uses the loudness metadata to control the loudness level of the input audio signal to obtain a loudness difference that is changed through post-processing.

2. The audio signal processing apparatus according to claim 1, wherein The post-processing includes at least one of equalization, reverberation, and room compensation.

3. The audio signal processing apparatus according to claim 1, wherein The post-processing includes applying the output characteristics of an audio signal processing device, which uses the loudness metadata to control the loudness level of the input audio signal.

4. The audio signal processing apparatus according to claim 1, wherein Based on information representing the loudness level of each frequency band changed by the post-processing, the audio signal processing device, which controls the loudness level of the input audio signal by using the loudness metadata, seeks to obtain the loudness difference changed by the post-processing.

5. The audio signal processing apparatus according to claim 4, wherein Based on the dot product of the loudness levels of each frequency band changed by the post-processing and the loudness ratio of each frequency of the input audio signal, the audio signal processing device that controls the loudness level of the input audio signal by using the loudness metadata aims to obtain the loudness difference changed by the post-processing.

6. The audio signal processing apparatus according to claim 5, wherein The loudness difference altered by the post-processing is a parameter that the audio signal processing device aims to obtain by controlling the loudness level of the input audio signal using the loudness metadata, based on cognitive loudness characteristics.

7. The audio signal processing apparatus according to claim 6, wherein, The audio signal processing device, which controls the loudness level of the input audio signal using the loudness metadata based on a K-weighted filter, obtains the loudness difference altered by the post-processing.

8. An audio signal processing apparatus for controlling loudness levels, the audio signal processing apparatus comprising: A processor for adjusting the output loudness level of an input audio signal, wherein the processor is configured to: Receive loudness metadata corresponding to the input audio signal; The loudness metadata is parsed to obtain loudness information of the input audio signal, wherein the loudness information includes information representing the loudness ratio for each frequency of the input audio signal; The loudness difference, altered through post-processing, is obtained based on the loudness ratio for each frequency of the input audio signal. The loudness gain of the input audio signal is determined based on the loudness difference altered by the post-processing and the target loudness level; and The output loudness level of the input audio signal is adjusted based on the loudness gain.

9. The audio signal processing apparatus according to claim 8, wherein The processor outputs a generated output audio signal by applying a loudness limiter to the input audio signal.

10. The audio signal processing apparatus according to claim 8, wherein The post-processing includes at least one of equalization, reverberation, and room compensation.

11. The audio signal processing apparatus according to claim 8, wherein The post-processing includes applying the output characteristics of an audio signal processing device, which uses the loudness metadata to control the loudness level of the input audio signal.

12. The audio signal processing apparatus according to claim 8, wherein The processor obtains the loudness difference after post-processing based on information representing the loudness level of each frequency band that has changed through post-processing.

13. The audio signal processing apparatus according to claim 12, wherein The processor obtains the loudness difference after post-processing based on the dot product of the loudness levels of each frequency band changed by the post-processing and the loudness ratio of each frequency of the input audio signal.

14. The audio signal processing apparatus according to claim 13, wherein The loudness difference obtained through the post-processing is a parameter based on cognitive loudness characteristics.

15. The audio signal processing apparatus according to claim 14, wherein The processor obtains the loudness difference after post-processing based on a K-weighted filter.

16. A method for generating loudness metadata for an input audio signal using an audio signal processing apparatus, comprising: Receive input audio signals; Measure the loudness of the input audio signal to obtain loudness information of the input audio signal; The loudness information is converted to generate the loudness metadata; as well as The generated loudness metadata is output to an output device for outputting the input audio signal, wherein the loudness information includes information representing the loudness ratio of each frequency of the input audio signal. The loudness ratio of each frequency of the input audio signal will be used by an audio signal processing device, which uses the loudness metadata to control the loudness level of the input audio signal to obtain loudness differences that are changed through post-processing.

17. A method for adjusting the output loudness level of an input audio signal using an audio signal processing device, comprising: Receive loudness metadata corresponding to the input audio signal; The loudness metadata is parsed to obtain loudness information of the input audio signal, wherein the loudness information includes information representing the loudness ratio of each frequency of the input audio signal; The loudness difference, altered through post-processing, is obtained based on the loudness ratio of each frequency of the input audio signal. The loudness gain of the input audio signal is determined based on the loudness difference altered by the post-processing and the target loudness level; and The output loudness level of the input audio signal is adjusted based on the loudness gain.

Citation Information

Patent Citations

  • Prevention of signal clipping due to decrease in amplifier supply voltage

    CN108463947A

  • Low-frequency effects haptic conversion system

    CN109375778A