Loudness measuring device and program

The loudness measuring device analyzes metadata to determine playback position and applies filters for accurate loudness measurement of object-based audio signals, addressing the inability of conventional devices to measure these signals effectively and reducing processing costs.

JP7587432B2Active Publication Date: 2024-11-20NIPPON HOSO KYOKAI
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2021012333
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-01-31
Filing Date
2021-01-28
Publication Date
2024-11-20
Estimated Expiration
2041-01-28

AI Technical Summary

Technical Problem

Conventional loudness measurement devices are unable to accurately measure the loudness value of object-based audio signals, as they require playback position information from metadata for weighting and processing, which is not supported by existing methods.

Method used

A loudness measuring device that analyzes metadata to determine playback position, applies perceptual correction filters, and performs weighting and summation to calculate the loudness value of object-based audio signals, without requiring rendering processing.

Benefits of technology

Enables accurate loudness measurement of object-based audio signals, reducing signal processing costs and ensuring consistent loudness values across different playback formats.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007587432000003
    Figure 0007587432000003
  • Figure 0007587432000004
    Figure 0007587432000004
  • Figure 0007587432000005
    Figure 0007587432000005
Patent Text Reader

Abstract

To measure a loudness value of a sound signal of an object-based system.SOLUTION: A loudness measuring device 1 includes: a metadata analysis unit 14 that analyzes metadata concerning an object base sound signal, and acquires reproduction position information indicating a reproduction position of each channel; a K characteristic filtering unit 11 that subjects the object base sound signal to filter processing with an audibility correction filter; a mean square unit 12 that generates a power signal which is a mean square of the signal subjected to the filter processing; a weighting unit 13 that determines a weighting coefficient for each channel based on the reproduction position information, and performs weighting; and an addition unit 15 that calculates an added value of signals of respective channels weighted by the weighting unit 13.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] A loudness measurement device and program capable of measuring the loudness value of an object-based audio signal are provided. [Background technology]

[0002] As a method for measuring the level of an audio signal contained in broadcast content, etc., a method for measuring a loudness value that indicates the loudness of a sound close to human sensation has been standardized, and loudness measuring devices (loudness meters) based on this method have been put into practical use and are in operation (for example, see Non-Patent Document 1 and Patent Document 1).

[0003] Conventional broadcast audio is mixed at the program production site, and the finished program audio is transmitted to homes. Each television receiver reproduces the transmitted audio signal as is, and this reproduction method is called a channel-based method (or channel-based sound method). For example, Non-Patent Document 2 describes a sound system compatible with the channel-based method.

[0004] In recent years, it has been proposed to transmit sound materials (object sounds) from the program production site and information (metadata) such as their composition and playback position to homes, and then synthesize (render) them according to the purpose on each television receiver to complete the program audio (see, for example, Non-Patent Document 3). This type of playback method is called the object-based method (or object-based audio method).

[0005] Metadata in the object-based method has been standardized by the International Telecommunication Union (ITU), as described in, for example, Non-Patent Document 4 and Non-Patent Document 5. In addition, Non-Patent Document 6 describes a metadata format based on the S-ADM (Audio Definition Model), and Non-Patent Document 7 describes the specifications of the BW64 (Broadcast Wave 64 Bit) audio file format capable of transmitting multi-channel files and metadata. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2015-158543 A [Non-patent literature]

[0007] [Non-Patent Document 1] "Loudness Operational Guidelines for Digital Television Broadcasting Programs", ARIB TR-B32, Association of Radio Industries and Businesses, ed. 1.5 [Non-Patent Document 2] “Advanced sound system for program production”, Recommendation ITU-R BS.2051-2, 07 / 2018 [Non-Patent Document 3] Hiroki Kubo and 1 other, "Next-generation audio broadcasting services using object-based audio," Proceedings of the Acoustical Society of Japan, September 2018, 1-1-1 [Non-Patent Document 4] “Audio Definition Model”, Recommendation ITU-R BS.2076-2, 10 / 2019 [Non-Patent Document 5] “Common definitions for the Audio Definition Model”, Recommendation ITU-R BS.2094-1, 06 / 2017 [Non-Patent Document 6] “A serial representation of the Audio Definition Model (S-ADM)”, Recommendation ITU-R BS.2125-0, 01 / 2019 [Non-Patent Document 7] “Long-form file format for the international exchange of audio program materials with metadata”, Recommendation ITU-R BS.2088-1, 10 / 2019 Summary of the Invention [Problem to be solved by the invention]

[0008] Conventional loudness measurement devices measure the loudness value of a channel-based audio signal based on the standard described in Non-Patent Document 1, but cannot measure the loudness value of an object-based audio signal (object-based audio signal). Since object-based audio signals are rendered in accordance with the speaker arrangement of the playback environment based on metadata, in order to measure the loudness value, it is necessary to perform a predetermined weighting according to playback position information of the audio signal described in the metadata.

[0009] In view of the above circumstances, an object of the present invention is to provide a loudness measurement device and a program capable of measuring the loudness value of an object-based audio signal. [Means for solving the problem]

[0010] A loudness measuring device according to one embodiment is a loudness measuring device that measures the loudness value of a multi-channel object-based audio signal, and includes a metadata analysis unit that analyzes metadata related to the object-based audio signal and acquires playback position information indicating the playback position of each channel, a K-characteristic filter unit that performs filtering on the object-based audio signal using an auditory weighting filter, a square mean unit that generates a power signal by taking the square mean of the signal processed by the K-characteristic filter unit, a weighting unit that determines a weighting coefficient for each channel based on the playback position information and performs weighting, and an addition unit that calculates a sum of the signals of each channel weighted by the weighting unit.

[0011] In one embodiment, the metadata analysis unit may further acquire gain information indicating the gain of each channel, and further include a gain processing unit that multiplies the object-based audio signal by a gain in accordance with the gain information, and the K-characteristic filter unit may perform a filter process on the object-based audio signal after processing by the gain processing unit.

[0012] In one embodiment, the metadata analysis unit may further acquire matrix information indicating coefficients to be used for a matrix calculation of the object-based audio signal, and may further include a matrix processing unit that performs a matrix calculation on the object-based audio signal using the coefficients in accordance with the matrix information, and the K-characteristic filter unit may perform a filter process on the object-based audio signal after processing by the matrix processing unit.

[0013] In one embodiment, the metadata analysis unit further acquires matrix information indicating coefficients to be used for a matrix calculation of the object-based audio signal and gain information indicating the gain of each channel, and further includes a matrix / gain processing unit that performs a matrix calculation and gain multiplication on the object-based audio signal in accordance with the matrix information and the gain information, and the K characteristic filter unit may perform a filter process on the object-based audio signal after processing by the matrix / gain processing unit.

[0014] In addition, a loudness measuring device according to one embodiment is a loudness measuring device that measures the loudness value of an object-based audio signal of multiple channels, and includes a rendering processing unit that performs a rendering process on the object-based audio signal based on a description of metadata related to the object-based audio signal and acquires playback position information indicating the playback position of each channel, a K-characteristic filter unit that performs a filter process on the object-based audio signal after processing by the rendering processing unit using an auditory weighting filter, a square mean unit that generates a power signal by taking the square mean of the signal processed by the K-characteristic filter unit, a weighting unit that determines a weighting coefficient for each channel based on the playback position information and performs weighting, and an addition unit that calculates a sum of the signals of each channel weighted by the weighting unit.

[0015] Moreover, a program according to an embodiment causes a computer to function as the loudness measurement device. Effect of the Invention

[0016] According to the present invention, it is possible to measure the loudness value of an object-based audio signal. [Brief description of the drawings]

[0017] [Figure 1] 1 is a block diagram showing an example of the configuration of a loudness measuring device according to a first embodiment. [Figure 2A]FIG. 13 is a diagram showing an example of metadata described in relation to playback position information. [Figure 2B] FIG. 13 is a diagram showing an example of metadata described in relation to playback position information. [Figure 2C] FIG. 13 is a diagram showing an example of metadata in which description of playback position information is omitted. [Diagram 3] FIG. 13 is a diagram showing an example of metadata described in A2.3 Example of S-ADM XML derived from ADM XML in Non-Patent Document 6. [Figure 4] FIG. 2 is a diagram illustrating an example of metadata. [Diagram 5] FIG. 11 is a block diagram showing an example of the configuration of a loudness measuring device according to a second embodiment. [Figure 6] FIG. 13 is a diagram showing an example of metadata described regarding gain information. [Figure 7] FIG. 11 is a block diagram showing an example of the configuration of a loudness measuring device according to a third embodiment. [Figure 8] FIG. 13 is a diagram showing a first example of metadata described in relation to matrix information. [Figure 9] FIG. 13 is a diagram showing a second example of metadata described in relation to matrix information. [Figure 10] FIG. 13 is a block diagram showing an example of the configuration of a loudness measuring device according to a fourth embodiment. [Figure 11A] FIG. 13 is a diagram showing a first example of the configuration of a matrix gain processing unit in a loudness measuring device according to a fourth embodiment. [Figure 11B] FIG. 13 is a diagram showing a second example configuration of the matrix gain processing unit in the loudness measuring device according to the fourth embodiment. [Figure 11C] FIG. 13 is a diagram showing a third example configuration of a matrix gain processing unit in a loudness measuring device according to a fourth embodiment. [Figure 12] FIG. 13 is a block diagram showing an example of the configuration of a loudness measuring device according to a fifth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] Hereinafter, the embodiment will be described in detail with reference to the drawings. The loudness measurement device according to the embodiment performs loudness measurement according to the standard described in Non-Patent Document 1 as an example. Furthermore, metadata related to the input object-based audio signal is in a format conforming to the ADM (Audio Definition Model) described in Non-Patent Documents 4 and 5, and the loudness measurement device reads metadata from a digital audio signal including metadata in the S-ADM format defined in Non-Patent Document 6, or from a file (BW64, BWF format, etc.) defined in Non-Patent Document 7, but is not limited to this. Furthermore, a numerical value to be used when metadata is not read may be determined in advance and used for measurement instead of the metadata to be read. As the numerical value to be determined in advance, the speaker arrangement (audioPackFormat) and the speaker position (audioChannelFormart) defined as common definitions in Non-Patent Document 5, the start time (start) and the signal gain (gain) whose numerical values ​​are determined when omitted in Non-Patent Document 4, and combinations of frequently used metadata may be set independently.

[0019] (First embodiment) A loudness measuring device according to the first embodiment will be described below. Fig. 1 is a diagram showing an example of the configuration of the loudness measuring device according to the first embodiment. The loudness measuring device 1 shown in Fig. 1 includes a K-weighting filter section 11, a root mean square section 12, a weighting section 13, a metadata analysis section 14, a summing section 15, a decibel scale conversion section 16, and a gating section 17. The loudness measuring device 1 measures the loudness value of a multi-channel object-based audio signal.

[0020] The K-weighting filter unit 11 receives the input object-based audio signal x kFor (k=1 to m), filtering is performed using a hearing weighting filter defined in recommendation ITU-R BS.1770, and the result is output to the root mean square unit 12. The K-weighting filter unit 11 is composed of two pre-filters. The first-stage filter is a filter that simulates the head acoustic effect. The second-stage filter is a high-pass filter that has RLB characteristics (modified B-weighting). The K-weighting filter unit 11 enables measurements close to the human hearing characteristics.

[0021] In order to obtain the power of the signal, the root mean square unit 12 generates a power signal by taking the root mean square of the signal processed by the K characteristic filter for each channel, and outputs the power signal to the weighting unit 13 .

[0022] The metadata analysis unit 14 receives and decodes metadata related to the object-based audio signal. The metadata analysis unit 14 then analyzes the metadata and obtains an azimuth angle θ m and elevation angle φ m The weighting unit 13 obtains the playback position information and outputs the playback position information to the weighting unit 13.

[0023] A specific example of how the metadata analysis unit 14 acquires playback position information is shown below. Fig. 2 is a diagram showing an example of metadata described in relation to playback position information. Note that the underlines are added for explanatory purposes. From the description of <position coordinate="azimuth">30.0, the metadata analysis unit 14 determines that the azimuth angle (θ) is 30.0°. Also, from the description of <position coordinate="elevation">0.0, the metadata analysis unit 14 determines that the elevation angle (φ) is 0.0°.

[0024] Incidentally, for most channel-based sound systems currently in practical use, such as mono and stereo (0+2+0), the amount of metadata to be described can be reduced by predetermining a common definition (see, for example, Non-Patent Document 5). Therefore, instead of inputting playback position information and the like as metadata, the metadata analysis unit 14 may obtain it from a predetermining common definition.

[0025] For example, in FIG. 2B, it can be determined that the azimuth angle θ=0.0° and the elevation angle φ=0.0° from the description of <position coordinate="azimuth"> and <position coordinate="elevation">. <audiopackformatidref>Combining the description of AP_00010001 with the common definition in Non-Patent Document 5, the definition in TABLE 2 indicates that audioChannelID is AC_00010003, and the definition in TABLE 1 indicates that AC_00010003 corresponds to an azimuth angle (Azimuth) θ=0.0° and an elevation angle (Elevation) φ=0.0°, so elements such as audioChannelFormat can be omitted and metadata can be described as in Fig. 2C. In this case, to analyze the metadata in Fig. 2C, the metadata analysis unit 14 holds common definitions such as those shown in TABLES 1 and 2 in Non-Patent Document 5 in advance, and acquires playback position information from the common definition.

[0026] The correspondence between the number of the audio channel where the audio signal is actually recorded (physical channel number) and the order of the audio signals listed in the metadata (channel number to which weighting is applied) is determined by <audioTrackUIDRef> and <audioTrack trackID> in the case of S-ADM input (see non-patent document 6), and by <trackIndex> in the case of file input (see non-patent document 7).

[0027] Fig. 3 is a diagram showing an example of metadata described in A2.3 Example of S-ADM XML derived from ADM XML. in Non-Patent Document 6. Note that the underlines are added for explanatory purposes. For example, by tracing the ID-related metadata as in Fig. 1 in Non-Patent Document 4, in the example of metadata for S-ADM input shown in Fig. 3, it can be seen that channel 1 of the input signal is a physical channel number from <audioTrack trackID="1"> corresponding to <audioTrackUIDRef>ATU_00000001.

[0028] FIG. 4 is a diagram showing an example of metadata. Note that the underlines are added for explanatory purposes. In the example of metadata of a file input shown in FIG. 4, since AT_00031001_01 corresponds to <audioTrackUIDRef>ATU_00000001, it is understood that the physical channel (track) 1 is the channel to which the weighting of the audio channel AC_00031001 on the metadata is applied. That is, the metadata analysis unit 14 analyzes from the description in FIG. 2 and the description in FIG. 3 or FIG. 4 that the playback position of the object-based audio signal x1 is the azimuth angle θ1=30.0° and the elevation angle φ1=0.0°.

[0029] The weighting unit 13 determines a weighting coefficient for each channel according to the azimuth angle and elevation angle based on the playback position information input from the metadata analysis unit 14. For example, the weighting unit 13 determines a weighting coefficient according to the following Table 1. According to Table 1, when the metadata analysis unit 14 analyzes the playback position of the object-based audio signal x1 as azimuth angle θ1=30.0° and elevation angle φ1=0.0° as described above, the weighting unit 13 determines the weighting coefficient for channel 1 to be 1.0.

[0030] [Table 1]

[0031] Then, the weighting unit 13 weights the power signal input from the square mean unit 12 by multiplying it by the determined weighting coefficient, and outputs the result to the summing unit 15. It is known that the sound heard by a person is affected by the auricle, head, shoulders, etc. differently depending on the direction of arrival (the angle of incidence of the sound to the ear), and as a result, the volume heard also changes, and the weighting unit 13 can correct this change in volume.

[0032] The summation unit 15 calculates the sum of the signals of each channel weighted by the weighting unit 13 and outputs the sum to the decibel scale conversion unit 16 .

[0033] The decibel scale conversion unit 16 converts the sum input from the weighting unit 13 into a decibel scale using the following equation (1) to obtain a loudness value L K and outputs it to the gating unit 17.

[0034]

number

[0035] The gating unit 17 converts the loudness value L input from the decibel scale conversion unit 16 into K The average loudness value is calculated by applying a gating function consisting of four elements: gating block, overlap method, absolute gating, and relative gating to the input signal. For details, see Non-Patent Document 1.

[0036] As described above, the loudness measuring device 1 analyzes metadata related to the object-based audio signal to obtain playback position information, and performs weighting based on the playback position information. Therefore, the loudness measuring device 1 can measure the loudness value of the object-based audio signal. In addition, since the loudness measuring device 1 does not perform rendering processing, it is possible to reduce signal processing costs and further to uniquely determine the loudness value regardless of the playback format.

[0037] Second Embodiment Next, a loudness measuring device according to a second embodiment will be described. Fig. 5 is a diagram showing an example of the configuration of a loudness measuring device according to the second embodiment. The loudness measuring device 2 shown in Fig. 5 includes a K-characteristic filter section 11, a root mean square section 12, a weighting section 13, a metadata analysis section 14, a summing section 15, a decibel scale conversion section 16, a gating section 17, and a gain processing section 18. The loudness measuring device 2 of this embodiment is different from the loudness measuring device 1 of the first embodiment in that it further includes a gain processing section 18.

[0038] The metadata analysis unit 14 analyzes metadata related to the object-based audio signal to obtain gain information indicating the gain of each channel of the object-based audio signal, and outputs the gain information to the gain processing unit 18. For specific examples, see Section 12 of Non-Patent Document 4. The metadata analysis unit 14 also obtains playback position information in the same way as in the first embodiment, and outputs the playback position information to the weighting unit 13.

[0039] 6 is a diagram showing an example of metadata described regarding gain information, where the underlining is added for the purpose of explanation.

[0040] As described above, in the case of S-ADM input, the correspondence between each channel number and metadata is determined by <audioTrackUIDRef> and <audioTrack trackID> (see non-patent document 6), and in the case of file input, the correspondence is determined by <trackIndex> (see non-patent document 7).

[0041] For example, in the metadata example shown in FIG. 3, <audioTrackUIDRef> is ATU_00000001, and referring to FIG. 6, <gain> is 1.0, and the ATU_00000001 of S-ADM corresponds to <audioTrack trackID="1">, so the metadata analysis unit 14 determines that the gain of channel 1 (object-based audio signal x1) of the input signal is 1.0 times. Also, in the metadata example shown in FIG. 4, ATU_00000001 corresponds to trackIndex=1, so the metadata analysis unit 14 determines that the gain of channel (track) 1 of the file is 1.0 times. That is, the metadata analysis unit 14 analyzes that the gain of the object-based audio signal x1 is 1.0 times based on the description in FIG. 6 and the description in FIG. 3 or FIG. 4.

[0042] The gain processing unit 18 calculates the gain of the object-based audio signal x according to the gain information input from the metadata analysis unit 14. k (k=1~m) are multiplied by the gain to obtain the signal y k (k=1 to m) and outputs it to the K characteristic filter unit 11.

[0043] The K-weighting filter unit 11 receives the object-based audio signal y k Filter processing is performed for (k=1 to m). The subsequent processing is the same as in the first embodiment, so a description thereof will be omitted.

[0044] As described above, the loudness measurement device 2 analyzes metadata related to the object-based audio signal to obtain gain information, and multiplies the gain based on the gain information. Therefore, the loudness measurement device 2 can measure the loudness value of the object-based audio signal even when gain adjustment is performed. Moreover, the loudness measurement device 2 does not perform rendering processing as in the first embodiment, so that the signal processing cost can be reduced, and furthermore, the loudness value can be uniquely determined regardless of the playback format.

[0045] (Third embodiment) Next, a loudness measuring device according to a third embodiment will be described. Fig. 7 is a diagram showing an example of the configuration of a loudness measuring device according to the third embodiment. The loudness measuring device 3 shown in Fig. 7 includes a K-characteristic filter section 11, a root mean square section 12, a weighting section 13, a metadata analyzing section 14, a summing section 15, a decibel scale converting section 16, a gating section 17, and a matrix processing section 19. The loudness measuring device 3 of this embodiment is different from the loudness measuring device 1 of the first embodiment in that it further includes a matrix processing section 19.

[0046] In the object-based method, an object sound can be reproduced from multiple channels with a predetermined gain. For example, in content with a multi-channel sound format such as 5.1 surround or 22.2 channels, matrix processing is performed when performing a process called divergence, such as distributing an audio signal to multiple channels near a main channel to give width to the sound image of an object sound or to prevent a commentary sound from being buried in background sounds on other channels. The loudness measuring device 3 makes it possible to measure the loudness value when matrix processing is performed.

[0047] The metadata analysis unit 14 analyzes metadata related to the object-based audio signal, obtains matrix information indicating coefficients used in matrix calculation of the object-based audio signal, and outputs the matrix information to the matrix processing unit 19. The metadata analysis unit 14 also obtains playback position information in the same manner as in the first embodiment, and outputs the playback position information to the weighting unit 13.

[0048] Fig. 8 is a diagram showing a first example of metadata described in relation to matrix information. Note that the underlines are added for explanatory purposes. Here, an example is shown in which the input signal x3 (AC_00010003) of the third channel is routed to the output signal y1 (AC_00010001) of the first channel and the output signal y2 (AC_00010002) of the second channel by matrix processing. From the description of the underlined portion in Fig. 8, the metadata analysis unit 14 determines that the coefficient for the input signal x3 to obtain the output signal y1 and the output signal y2 is 0.354813.

[0049] Fig. 9 is a diagram showing a second example of metadata described in relation to matrix information. Note that the underlines are added for explanatory purposes. Here, an example is shown in which the input signal x1 (AC_00010001) of the first channel and the input signal x2 (AC_00010002) of the second channel are combined and output from the output signal y3 (AC_00010003) of the third channel. From the description of the underlined portion in Fig. 9, the metadata analysis unit 14 determines that the coefficient for the input signal x1 and the input signal x2 to obtain the output signal y3 is 0.707106.

[0050] The matrix processing unit 19 processes the object-based audio signal x according to the matrix information input from the metadata analysis unit 14. k (k=1~m) is used to perform matrix calculations on the signal y k (k=1 to p) are generated and output to the K-weighting filter unit 11. Specifically, in the example shown in Fig. 8 described above, the value of the output signal y1 is the value obtained by multiplying the value of the input signal x3 by 0.354813, and the value of the output signal y2 is the value obtained by multiplying the value of the input signal x3 by 0.354813. In addition, in the example shown in Fig. 9 described above, the value of the output signal y3 is the sum of the value obtained by multiplying the value of the input signal x1 by 0.707106 and the value obtained by multiplying the value of the input signal x3 by 0.707106.

[0051] The K-characteristic filter unit 11 receives the object-based audio signal y k Filter processing is performed for (k=1 to p). The subsequent processing is the same as in the first embodiment, so a description thereof will be omitted.

[0052] As described above, the loudness measurement device 3 analyzes metadata related to the object-based audio signal to obtain matrix information, and performs a matrix calculation based on the matrix information. Therefore, the loudness measurement device 3 can measure the loudness value of the object-based audio signal even when divergence processing or mix processing is performed. Moreover, the loudness measurement device 3 does not perform rendering processing as in the first embodiment, so that the signal processing cost can be reduced, and furthermore, it is possible to uniquely determine the loudness value regardless of the playback format.

[0053] (Fourth embodiment) Next, a loudness measuring device according to a fourth embodiment will be described. Fig. 10 is a diagram showing an example of the configuration of a loudness measuring device according to the fourth embodiment. The loudness measuring device 4 shown in Fig. 10 includes a K-characteristic filter section 11, a root mean square section 12, a weighting section 13, a metadata analysis section 14, a summing section 15, a decibel scale conversion section 16, a gating section 17, and a matrix gain processing section 20. The loudness measuring device 4 of this embodiment is different from the loudness measuring device 1 of the first embodiment in that it further includes a matrix gain processing section 20.

[0054] In this embodiment, the matrix / gain processing unit 20 performs gain processing in addition to matrix processing. For this purpose, the metadata analysis unit 14 analyzes metadata related to the object-based audio signal, and acquires matrix information indicating coefficients used in the matrix calculation of the object-based audio signal, as in the third embodiment, and outputs the matrix information to the matrix / gain processing unit 20. The metadata analysis unit 14 also acquires gain information indicating the gain of each channel, as in the second embodiment, and outputs the gain information to the matrix / gain processing unit 20. The metadata analysis unit 14 also acquires playback position information, as in the first embodiment, and outputs the playback position information to the weighting unit 13.

[0055] The matrix / gain processing unit 20 processes the object-based audio signal x according to the matrix information and gain information input from the metadata analysis unit 14. k (k=1 to m) is multiplied by a matrix and the signal y k (k=1 to p) and output it to the K characteristic filter unit 11.

[0056] 11 is a diagram showing an example of the configuration of the matrix / gain processing unit 20. In the example shown in FIG. 11A, the matrix / gain processing unit 20 includes a matrix processing unit 201 and a first gain processing unit 202. The matrix processing unit 201 calculates a gain for the input signals x1 to x m Matrix calculation is performed on the signals y'1 to y' p and outputs the signal y′1 to y′ to the first gain processing unit 202. The first gain processing unit 202 calculates the signal y′1 to y′ p Gain processing is performed on the output signals y1 to y p Request.

[0057] 11B, the matrix / gain processing unit 20 includes a second gain processing unit 203 and a matrix processing unit 201. The second gain processing unit 203 calculates a gain for the input signals x1 to x2 in accordance with the gain information input from the metadata analysis unit 14. m Gain processing is performed on the output signals y'1 to y' m and outputs the signal y′1 to y′ to the matrix processing unit 201. The matrix processing unit 201 calculates the signal y′1 to y′ m A matrix operation is performed on the output signals y1 to y p Request.

[0058] 11C, the matrix / gain processing unit 20 includes a second gain processing unit 203, a matrix processing unit 201, and a first gain processing unit 202. The second gain processing unit 203 calculates a gain for the input signals x1 to x m Gain processing is performed on the output signals y'1 to y' m and outputs the signal y′1 to y′ to the matrix processing unit 201. The matrix processing unit 201 calculates the signal y′1 to y′ m Matrix calculation is performed on the signal y”1~y” p The first gain processing unit 202 obtains the signal y″1 to y″ in accordance with the gain information input from the metadata analysis unit 14. p Gain processing is performed on the output signals y1 to y p Request.

[0059] The K-weighting filter unit 11 receives the object-based audio signal y k Filter processing is performed for (k=1 to p). The subsequent processing is the same as in the first embodiment, so a description thereof will be omitted.

[0060] As described above, the loudness measurement device 4 analyzes metadata related to the object-based audio signal to obtain matrix information and gain information, and performs matrix calculation and gain multiplication based on the matrix information and gain information. Therefore, the loudness measurement device 4 can measure the loudness value of the object-based audio signal even when gain adjustment is performed in addition to divergence processing and mix processing. Moreover, the loudness measurement device 4 does not perform rendering processing as in the first embodiment, so that it is possible to reduce signal processing costs and further to uniquely determine the loudness value regardless of the playback format.

[0061] Fifth embodiment Next, a loudness measuring device according to a fifth embodiment will be described. Fig. 12 is a diagram showing an example of the configuration of the loudness measuring device according to the fifth embodiment. The loudness measuring device 5 shown in Fig. 12 includes a K-characteristic filter section 11, a mean square section 12, a weighting section 13, a summing section 15, a decibel scale conversion section 16, a gating section 17, and a rendering processing section 21. The loudness measuring device 5 of this embodiment is different from the loudness measuring device 1 of the first embodiment in that it further includes a rendering processing section 21 and includes a metadata analysis section 14 in the rendering processing section 21.

[0062] The rendering processing unit 21 has a metadata analysis unit 14. The metadata analysis unit 14 analyzes metadata related to the object-based audio signal, and not only processes the gain information described in the second embodiment and the matrix information described in the third embodiment, but also converts the object-based audio signal into a channel-based audio signal in accordance with the speaker arrangement during playback. Since the rendering processing unit 21 is inserted before the root mean square unit 12, phase information is also taken into consideration when adding audio signals. For details of the rendering process, please refer to the following literature, for example. "Audio Definition Model renderer for advanced sound systems", Recommendation ITU-R BS. 2127-0, 06 / 2019

[0063] The metadata analysis unit 14 acquires the playback position information in the same manner as in the first embodiment, and outputs it to the weighting unit 13.

[0064] The rendering processing unit 21 renders the object-based audio signal x according to the rendering information acquired by the metadata analysis unit 14. k Rendering is performed on (k=1 to m) to obtain an n-channel audio signal y k For example, n=5 when playing back with 5.1ch speakers, and n=7 when playing back with 7.1ch speakers.

[0065] The K-characteristic filter unit 11 converts the object-based audio signal y k Filter processing is performed for (k=1 to n). The subsequent processing is the same as in the first embodiment, so a description thereof will be omitted.

[0066] As described above, the loudness measurement device 5 analyzes metadata related to the object-based audio signal, performs rendering processing on the object-based audio signal, and then measures the loudness value. Therefore, the loudness measurement device 5 measures the loudness value for each playback format, but since the measured loudness value more closely matches the actual hearing sensation, it is possible to measure the loudness value with higher accuracy.

[0067] <program> It is also possible to use a computer capable of executing program instructions to function as the above-mentioned embodiment. The computer can be realized by storing a program describing the processing contents for realizing the functions of the loudness measuring devices 1 to 5 in the storage unit of the computer and reading and executing the program by the processor of the computer, and at least a part of the processing contents may be realized by hardware. Here, the computer may be a general-purpose computer, a dedicated computer, a workstation, a PC (Personal Computer), an electronic notepad, etc. The program instructions may be program codes, code segments, etc. for performing necessary tasks. The processor may be a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), etc.

[0068] The program may be recorded on a computer-readable recording medium. By using such a recording medium, the program can be installed on a computer. Here, the recording medium on which the program is recorded may be a non-transient recording medium. The non-transient recording medium is not particularly limited, and may be, for example, a CD-ROM, a DVD-ROM, or the like. The program may also be provided by downloading via a network.

[0069] Although the above-mentioned embodiment has been described as a representative example, it is clear to those skilled in the art that many modifications and substitutions can be made within the spirit and scope of the present invention. Therefore, the present invention should not be interpreted as being limited by the above-mentioned embodiment, and various modifications and changes are possible without departing from the scope of the claims. For example, it is possible to combine multiple components described in the embodiment into one, or to divide one into multiple components. [Explanation of symbols]

[0070] 1,2,3,4,5 Loudness measuring device 11 K-weighting filter section 12 Mean Square Section 13 Weighting section 14 Metadata Analysis Section 15. Addition Section 16 Decibel scale converter 17 Gating section 18 Gain processing section 19,201 Matrix processing section 20 Matrix gain processing section 21 Rendering Processor 202 First gain processing section 203 Second gain processing section< / audiopackformatidref>

Claims

1. A loudness measurement device for measuring a loudness value of a multi-channel object-based audio signal, comprising: a metadata analysis unit that analyzes metadata related to the object-based audio signal and obtains playback position information indicating a playback position of each channel; a K-weighting filter unit that performs filtering on the object-based audio signal using a hearing weighting filter; a mean square unit for generating a power signal by taking the mean square of the signal processed by the K characteristic filter unit; a weighting unit that determines a weighting coefficient for each channel based on the playback position information and performs weighting; an adder for calculating a sum of the signals of each channel weighted by the weighting unit; A loudness measuring device comprising:

2. The metadata analysis unit further acquires gain information indicating a gain of each channel; a gain processing unit that multiplies the object-based audio signal by a gain in accordance with the gain information; The loudness measuring device according to claim 1 , wherein the K-weighting filter section performs a filter process on the object-based audio signal after the processing by the gain processing section.

3. the metadata analysis unit further acquires matrix information indicating coefficients used in a matrix calculation of the object-based audio signal; a matrix processing unit that performs a matrix operation on the object-based audio signal using the coefficients according to the matrix information; The loudness measuring device according to claim 1 , wherein the K-weighting filter section performs a filter process on the object-based audio signal after the processing by the matrix processing section.

4. the metadata analysis unit further acquires matrix information indicating coefficients used in a matrix calculation of the object-based audio signal, and gain information indicating a gain of each channel; a matrix / gain processing unit that performs a matrix operation and a gain multiplication on the object-based audio signal according to the matrix information and the gain information, 2. The loudness measuring device according to claim 1, wherein the K-weighting filter section performs a filter process on the object-based audio signal after the processing by the matrix / gain processing section.

5. A loudness measurement device for measuring a loudness value of a multi-channel object-based audio signal, comprising: a rendering processing unit that performs a rendering process on the object-based audio signal based on a description of metadata related to the object-based audio signal and obtains playback position information indicating a playback position of each channel; a K-weighting filter unit that performs filtering using an auditory weighting filter on the object-based audio signal that has been processed by the rendering processing unit; a mean square unit for generating a power signal by taking the mean square of the signal processed by the K characteristic filter unit; a weighting unit that determines a weighting coefficient for each channel based on the playback position information and performs weighting; an adder for calculating a sum of the signals of each channel weighted by the weighting unit; A loudness measuring device comprising:

6. A program for causing a computer to function as the loudness measuring device according to any one of claims 1 to 5.

Citation Information

Patent Citations

  • Loudness measuring device and loudness measurement method

    JP2015158543A

  • Efficient encoding of audio scenes containing audio objects

    JP2016522911A

  • Object-based audio signal balancing method

    JP2019501563A