Sound environment analysis system, sound environment analysis method, and program

Abstract

The present disclosure addresses the problem of providing a sound environment analysis system capable of accurately estimating the position and size of a sound source. A sound environment analysis system (1) comprises a sensor (SN1) and an estimation unit (13). The sensor (SN1) acquires sound data in a space. The estimation unit (13) estimates the position and size of the sound source in the space on the basis of the sound data. The sensor (SN1) includes a plurality of sound sensor arrays (SA1). Each of the plurality of sound sensor arrays (SA1) includes a plurality of sound sensors (SE1). The estimation unit (13) includes a sound source localization processing unit and a sound source position estimation unit. The sound source localization processing unit estimates the arrival direction of the sound on the basis of the sound data and the position information of each of the plurality of sound sensor arrays (SA1). The sound source position estimation unit estimates the position of the sound source on the basis of the arrival direction of the sound.

Description

Sound environment analysis system, sound environment analysis method, and program

[0001] The present disclosure relates to a sound environment analysis system, a sound environment analysis method, and a program, and particularly to a sound environment analysis system, a sound environment analysis method, and a program for analyzing sounds generated in a space.

[0002] It has been proposed to provide a comfortable sound environment in a space such as an office. For example, in the sound information processing method of Patent Document 1, sounds are stored by type and the types of sounds are classified.

[0003] However, in the sound information processing method of Patent Document 1, when different sounds are generated from a plurality of sound sources, each sound may not be classified.

[0004] Japanese Patent Application Laid-Open No. 2020-44824

[0005] An object of the present disclosure is to provide a sound environment analysis system, a sound environment analysis method, and a program capable of accurately estimating the position and size of a sound source.

[0006] A sound environment analysis system according to an aspect of the present disclosure includes a sensor and an estimation unit. The sensor acquires sound data in the space. The estimation unit estimates the position and size of a sound source in the space based on the sound data. The sensor includes a plurality of sound sensor arrays. Each of the plurality of sound sensor arrays includes a plurality of sound sensors. The estimation unit includes a sound source localization processing unit and a sound source position estimation unit. The sound source localization processing unit estimates the arrival direction of sound in each of the plurality of sound sensor arrays based on the sound data and the position information of each of the plurality of sound sensor arrays. The sound source position estimation unit estimates the position of the sound source based on the arrival direction of sound in each of the plurality of sound sensor arrays.

[0007] A sound environment analysis method according to one aspect of the present disclosure includes an estimation step. In the estimation step, the location and magnitude of a sound source in a space are estimated based on sound data acquired by a sensor that acquires sound data in the space. The sensor includes a plurality of sound sensor arrays. Each of the plurality of sound sensor arrays includes a plurality of sound sensors. The estimation step includes a sound source localization processing step and a sound source position estimation step. In the sound source localization processing step, the direction of arrival of sound at each of the plurality of sound sensor arrays is estimated based on the sound data and the position information of each of the plurality of sound sensor arrays. In the sound source position estimation step, the position of the sound source is estimated based on the direction of arrival of sound at each of the plurality of sound sensor arrays and the position information of each of the plurality of sound sensor arrays.

[0008] A program according to one aspect of this disclosure causes one or more processors to execute the sound environment analysis method.

[0009] Figure 1 is a block diagram of the sound environment analysis system according to Embodiment 1. Figure 2 is a plan view of the space in which the sound environment analysis system is installed. Figure 3 is a block diagram of the estimation unit of the sound environment analysis system. Figure 4 is a schematic diagram showing the operation of the sound environment analysis system. Figure 5 is a plan view of the heat map generated by the sound environment analysis system. Figure 6 is a flowchart showing the operation of the sound environment system. Figure 7 is a block diagram of the estimation unit of the sound environment analysis system according to Embodiment 2. Figure 8 is a flowchart showing the operation of the sound environment system according to Embodiment 3. Figure 9 is a schematic diagram showing the noise determination operation in the sound environment system.

[0010] The sound environment analysis system, sound environment analysis method, and program according to the embodiments will be described in detail below with reference to the drawings. However, the figures described in the embodiments below are schematic diagrams, and the ratios of the size and thickness of each component do not necessarily reflect the actual dimensional ratios. The configurations described in the embodiments below are merely examples of the disclosure. The disclosure is not limited to the embodiments below, and various modifications are possible depending on the design, etc., as long as the effects of the disclosure can be achieved.

[0011] (Embodiment 1) (1) Overview The sound environment analysis system 1 (see Figure 1) is a system that analyzes the sound generation state that occurs in space SP1 (see Figure 2).

[0012] Space SP1 is a space that is divided into a single section, such as an office, store, factory, warehouse, building, school, welfare facility, or hospital.

[0013] (2) The constituent sound environment analysis system 1, as shown in Figure 1, comprises a sound data acquisition unit 11, a storage unit 12, and an estimation unit 13. The sound environment analysis system 1 includes a sound environment analysis device 10 and a sensor SN1. The sound environment analysis device 10 comprises a sound data acquisition unit 11, a storage unit 12, an estimation unit 13, a proposal unit 14, an image generation unit 15, and a display control unit 16.

[0014] Sensor SN1 is a sensor that acquires sound data from space SP1. Sensor SN1 includes multiple (two in Figure 1, three in Figure 2) sound sensor arrays SA1. As shown in Figure 2, the multiple sound sensor arrays SA1 are arranged in space SP1, separated from each other. Here, it is preferable that the multiple sound sensor arrays SA1 are positioned so that any location in space SP1 is visible from at least two of the sound sensor arrays SA1. "A location in space SP1 is visible from the sound sensor arrays SA1" means that there are no sound-blocking structures such as walls on the line segment connecting the location in space SP1 and the sound sensor arrays SA1. That is, in Figure 2, it is preferable that at least two of the three line segments connecting any location in space SP1 to each of the multiple sound sensor arrays SA1a, SA1b, and SA1c do not intersect with sound-blocking structures such as walls.

[0015] Each of the multiple sound sensor arrays SA1 includes multiple (two in Figure 1) sound sensors SE1. Each of the multiple sound sensors SE1 is an element that converts sound into an electronic signal, for example, a microphone. In the sound sensor array SA1, the multiple sound sensors SE1 differ from each other in at least one of their installation position and directivity. The sound sensor array SA1 includes, for example, four sound sensors SE1 arranged in an X shape in a plan view.

[0016] The sound data acquisition unit 11 acquires data from each of the multiple sound sensor arrays SA1 included in the sensor SN1, for example. The sound data acquisition unit 11 performs A / D conversion on each of the electrical signals output by the multiple sound sensors SE1. The sound data acquisition unit 11 stores the sound data for each sound sensor SE1 in the storage unit 12.

[0017] The memory unit 12 stores the position information of each of the multiple sound sensor arrays SA1. For example, the memory unit 12 stores the installation position of each of the multiple sound sensor arrays SA1 and the orientation of each of the multiple sound sensors SE1 within each sound sensor array SA1. Here, the position information of each of the multiple sound sensor arrays SA1 is, for example, three-dimensional information indicating the position within space SP1. Note that the position information of each of the multiple sound sensor arrays SA1 may also be two-dimensional information when space SP1 is viewed from a planar perspective, without including height information.

[0018] Furthermore, the storage unit 12 stores the sound data output by the sound data acquisition unit 11.

[0019] The estimation unit 13 estimates the position of the sound source within the spatial SP1 and the loudness of the sound source based on the sound data.

[0020] As shown in Figure 3, the estimation unit 13 includes a sound source localization processing unit 131 and a sound source position estimation unit 132.

[0021] The sound source localization processing unit 131 estimates the direction of arrival of sound in the multiple sound sensor arrays SA1 based on sound data and the position information of each of the multiple sound sensor arrays SA1. The sound source localization processing unit 131 includes a direction estimation unit 133 and a sound source enhancement unit 134.

[0022] The direction estimation unit 133 estimates the direction of the sound source, for example, based on the MUSIC (Multiple Signal Classification) method. Specifically, the direction estimation unit 133 converts each of the multiple sound data obtained from multiple sound sensors SE1 included in one of the multiple sound sensor arrays SA1 into frequency distribution data using FFT (Fast Fourier Transformation). Next, the direction estimation unit 133 calculates a spatial correlation matrix based on the position of each of the multiple sound sensors SE1 included in the one sound sensor array SA1 and the frequency distribution data of the sound data, calculates its eigenvalues, and calculates the spatial spectrum of space SP1. This allows the direction of the sound source as seen from one sound sensor array SA1, assuming that there is one sound source in space SP1.

[0023] The direction estimation unit 133 performs the above-described process on each of the multiple sound sensor arrays SA1 to estimate the sound source direction for each of the multiple sound sensor arrays SA1, based on the position of the sound sensor array SA1. When the position information of each of the multiple sound sensor arrays SA1 is three-dimensional information, the direction estimation unit 133 estimates, for example, the horizontal direction and the vertical direction as the sound source direction. The horizontal direction is information that indicates the number of clockwise rotations from the reference direction to the sound source direction when viewing space SP1 from a plan view. For example, if the reference direction is to the right in a plan view, and the sound source direction is to the left in a plan view, the horizontal direction is 180°. The vertical direction is, for example, the elevation angle or depression angle when viewing the sound source direction from the sound sensor array SA1. If the positional information of each of the multiple sound sensor arrays SA1 is two-dimensional, the direction estimation unit 133 may estimate the direction of the sound source when the spatial SP1 is considered as a plane viewed from above.

[0024] The sound source enhancement unit 134 performs processing to enhance sound from a specific direction for each of the multiple sound sensor arrays SA1, based on the estimated direction of the sound source direction with respect to the position of each sound sensor array SA1. When there is only one sound source in space SP1, the multiple sound sensor arrays SA1 estimate the same sound source position, so the multiple half-lines pointing from each of the multiple sound sensor arrays SA1 toward the sound source direction intersect at a single point where the sound source is located. On the other hand, when there are multiple sound sources in space SP1, the position of each sound source may not be uniquely determined. For example, when there are multiple sound sources in space SP1, the multiple sound sensor arrays SA1 estimate the positions of different sound sources, and the intersection point of the multiple half-lines pointing from each of the multiple sound sensor arrays SA1 toward the sound source direction may not indicate the position of the sound source. Furthermore, for example, if multiple sound sources exist within space SP1, one or more sound sensor arrays SA1 may misidentify the direction of the sound source by estimating the sound source position as if the sound from multiple sound sources that have interfered with each other were coming from a single sound source, and as a result, there may be no sound source on the half-line extending from that sound sensor array SA1 towards the direction of the sound source. Therefore, the sound source enhancement unit 134 estimates the direction of arrival of one or more sounds for each of the multiple sound sensor arrays SA1.

[0025] Specifically, the sound source enhancement unit 134 generates frequency distribution data for each of the multiple sound sensor arrays SA1 that emphasizes sound from a specific direction, so that combinations of orientations can be made between the two sound sensor arrays SA1 that result in similar frequency distributions. For example, as shown in Figure 4, sound from sound source SS1 arrives at sound sensor array SA1a from direction θb and at sound sensor array SA1b from direction θd. Therefore, the frequency distribution of sound from direction θb at sound sensor array SA1a and the frequency distribution of sound from direction θd at sound sensor array SA1b are similar. Similarly, sound from sound source SS2 arrives at sound sensor array SA1a from direction θa and at sound sensor array SA1b from direction θc. Therefore, the frequency distribution of sound from direction θa at sound sensor array SA1a and the frequency distribution of sound from direction θc at sound sensor array SA1b are similar. The sound source enhancement unit 134 generates combinations of specific directions for each of the two or more sound sensor arrays SA1 such that the frequency distribution in a specific direction of the sound sensor array SA1a is similar to the frequency distribution in a specific direction of the sound sensor array SA1b. The sound source enhancement unit 134 outputs the specific directions for each of the two or more sound sensor arrays SA1 and the frequency distribution data for those specific directions to the sound source position estimation unit 132 for the generated combinations.

[0026] The sound source position estimation unit 132 estimates the position of one or more sound sources based on the direction of sound arrival at each of the multiple sound sensor arrays SA1, which has been estimated by the sound source localization processing unit 131. If multiple sound sources exist in space SP1, the sound source position estimation unit 132 estimates the position of each of the multiple sound sources. Specifically, as shown in Figure 4, the sound source position estimation unit 132 estimates the position of sound source SS1 based on the combination of the orientation θb of sound sensor array SA1a and the orientation θd of sound sensor array SA1b. Similarly, the sound source position estimation unit 132 estimates the position of sound source SS2 based on the combination of the orientation θa of sound sensor array SA1a and the orientation θc of sound sensor array SA1b.

[0027] Furthermore, the estimation unit 13 estimates the sound state in space SP1 based on the estimated sound source location and the sound data corresponding to each of the multiple sound sensor arrays SA1. The sound state in space is, for example, the magnitude of the sound pressure.

[0028] The proposal unit 14 makes suggestions for improving the sound environment within the spatial SP1 based on the results of the estimation unit 13. For example, the proposal unit 14 simulates the sound environment within the spatial SP1 based on user input and proposes what measures can be taken to improve the sound environment within the spatial SP1.

[0029] The image generation unit 15 generates an image showing the location of the sound source and the loudness of the sound source within the space SP1, based on the results of the estimation unit 13. The image is a heat map HM1 showing the state of sound in the space, as shown in Figure 5, for example. The heat map HM1 includes, for example, regions AR1, AR2, AR3, and AR4. Region AR1 is the region where the sound pressure is less than the first level. Region AR2 is the region where the sound pressure is between the first level and the second level. Region AR3 is the region where the sound pressure is between the second level and the third level. Region AR4 is the region where the sound pressure is at or above the third level.

[0030] The display control unit 16 displays the heatmap HM1, which is an image generated by the image generation unit 15, on a display device, for example.

[0031] The sound environment analysis system 1 includes a computer system. The computer system mainly consists of a processor and memory as hardware. The functions of the sound environment analysis system 1 in this disclosure are realized by the processor executing a program recorded in the memory of the computer system. The program may be pre-recorded in the memory of the computer system, provided via a telecommunication line, or provided on a non-temporary recording medium such as a memory card, optical disk, or hard disk drive that can be read by the computer system. The processor of the computer system consists of one or more electronic circuits including semiconductor integrated circuits (ICs) or large-scale integrated circuits (LSIs). The integrated circuits such as ICs and LSIs referred to here are named differently depending on the degree of integration, and include integrated circuits called system LSIs, VLSIs (Very Large Scale Integrations), or ULSIs (Ultra Large Scale Integrations). Furthermore, FPGAs (Field-Programmable Gate Arrays) that are programmed after the manufacture of the LSI, or logic devices that allow for the reconstruction of junction relationships or circuit compartments within the LSI, can also be used as processors. Multiple electronic circuits may be integrated onto a single chip or distributed across multiple chips. Multiple chips may be integrated onto a single device or distributed across multiple devices. The computer system referred to here includes a microcontroller having one or more processors and one or more memories. Therefore, the microcontroller also consists of one or more electronic circuits, including semiconductor integrated circuits or large-scale integrated circuits.

[0032] Furthermore, it is not essential for the sound environment analysis system 1 to have multiple functions integrated into a single housing; the components of the sound environment analysis system 1 may be distributed across multiple housings. For example, the sound data acquisition unit 11, storage unit 12, estimation unit 13, proposal unit 14, image generation unit 15, and display control unit 16 do not all need to be components of the sound environment analysis device 10; at least one component may be a component of a different device. Moreover, at least some of the functions of the sound environment analysis system 1, for example, some of the functions of the proposal unit 14, may be implemented by the cloud (cloud computing), etc.

[0033] Conversely, at least some of the functions of the sound environment analysis system 1, which are dispersed across multiple components in the embodiment, may be integrated into a single housing.

[0034] (3) Operation diagram 6 is a flowchart showing the operation of the sound environment analysis system 1 according to Embodiment 1.

[0035] The multiple sound sensor array SA1 of the sound environment analysis system 1 acquires sound data (step S1). The sound data acquisition unit 11 of the sound environment analysis system 1 stores the sound data acquired from the multiple sound sensors SE1 of the multiple sound sensor array SA1 in the storage unit 12.

[0036] Next, the estimation unit 13 of the sound environment analysis system 1 estimates the direction of the sound source (step S2). The direction estimation unit 133 of the estimation unit 13 estimates the direction of the sound source for each of the multiple sound sensor arrays SA1, for example, using the MUSIC method.

[0037] Next, the estimation unit 13 of the sound environment analysis system 1 performs sound enhancement (step S3). The sound source enhancement unit 134 of the estimation unit 13 enhances sound in a specific direction in each of the multiple sound sensor arrays SA1 so that the enhanced spectra are similar.

[0038] Next, the estimation unit 13 of the sound environment analysis system 1 estimates the sound source location (step S4). The sound source location estimation unit 132 of the estimation unit 13 identifies one or more sound sensor arrays SA1 with similar spectra and the direction from each of the one or more sound sensor arrays SA1. The sound source location estimation unit 132 then estimates the location of the sound source located in the direction identified from each of the one or more sound sensor arrays SA1. For example, as shown in Figure 4, the location of the sound source SS1 is determined based on the orientation θb of sound sensor array SA1a, the orientation θd of sound sensor array SA1b, and the respective position information of sound sensor arrays SA1a and SA1b. This makes it possible to estimate the location of each of the multiple sound sources even when multiple sound sources exist within the space SP1.

[0039] Next, the proposal unit 14 of the sound environment analysis system 1 makes suggestions for improving the sound environment within the space SP1 (step S5). Specifically, based on the location of the sound source estimated in step S4 and the input from the user, the proposal unit 14 performs a simulation, for example, to determine whether or not the sound in the seats will be reduced.

[0040] Next, the image generation unit 15 of the sound environment analysis system 1 generates an image (step S6). The estimation unit 13 estimates the sound state of the space SP1 based on one or more sound source locations and the sound data from each of the multiple sound sensor arrays SA1. The image generation unit 15 visualizes the sound state of the space SP1 estimated by the estimation unit 13 as a heat map HM1, for example, as shown in Figure 5.

[0041] Next, the display control unit 16 of the sound environment analysis system 1 causes the image to be displayed (step S7). The display control unit 16 causes the heat map HM1 to be displayed on the display device.

[0042] (4) The sound environment analysis system 1 according to Embodiment 1 includes a sensor SN1 and an estimation unit 13. The sensor SN1 acquires sound data in the space SP1. The estimation unit 13 estimates the position and size of a sound source in the space SP1 based on the sound data. The sensor SN1 includes a plurality of sound sensor arrays SA1. Each of the plurality of sound sensor arrays SA1 includes a plurality of sound sensors SE1. The estimation unit 13 includes a sound source localization processing unit 131 and a sound source position estimation unit 132. The sound source localization processing unit 131 estimates the arrival direction of sound in each of the plurality of sound sensor arrays SA1 based on the sound data and the position information of each of the plurality of sound sensor arrays SA1. The sound source position estimation unit 132 estimates the position of the sound source based on the arrival direction of sound in each of the plurality of sound sensor arrays SA1. Thereby, in the sound environment analysis system 1 according to Embodiment 1, it is possible to accurately estimate the position and size of the sound source.

[0043] Further, the sound environment analysis system 1 according to Embodiment 1 includes a storage unit 12. The storage unit 12 stores the position information of each of the plurality of sound sensor arrays SA1. Thereby, in the sound environment analysis system 1 according to Embodiment 1, it is possible to estimate the position and size of each of one or more sound sources using the plurality of sound sensor arrays SA1.

[0044] Further, in the sound environment analysis system 1 according to Embodiment 1, the storage unit 12 stores the position information of each of the plurality of sound sensor arrays SA1 as three-dimensional information. The sound source position estimation unit 132 estimates the position of the sound source as three-dimensional information. Thereby, in the sound environment analysis system 1 according to Embodiment 1, it is possible to analyze the sound environment in the space SP1 in detail considering the three-dimensional shape of the space SP1.

[0045] Further, the sound environment analysis system 1 according to Embodiment 1 includes an image generation unit 15. The image generation unit 15 generates a heat map HM1 indicating the position and size of the sound source in the space SP1. Thereby, in the sound environment analysis system 1 according to Embodiment 1, it becomes easy for the administrator, user, etc. of the space SP1 to check the sound environment.

[0046] Also, in the sound environment analysis system 1 according to Embodiment 1, the image generation unit 15 generates a heat map HM1 indicating the state of sound in the space SP1. Thereby, in the sound environment analysis system 1 according to Embodiment 1, it becomes possible to easily compare the layout of the space SP1 and the sound environment, so that it becomes easy to check and improve the sound environment.

[0047] Also, the sound environment analysis system 1 according to Embodiment 1 includes a display control unit 16. The display control unit 16 displays the heat map HM1. Thereby, in the sound environment analysis system 1 according to Embodiment 1, it becomes possible to visualize the sound environment of the space SP1, so that it becomes even easier for the administrator, user, etc. of the space SP1 to check the sound environment.

[0048] Also, the sound environment analysis system 1 according to Embodiment 1 includes a proposal unit 14. The proposal unit 14 makes a proposal for improving the sound environment of the space SP1. Thereby, in the sound environment analysis system 1 according to Embodiment 1, it becomes easy to improve the sound environment based on the analysis result of the space SP1.

[0049] The sound environment analysis method according to Embodiment 1 has estimation steps S2 and S4. In the estimation steps S2 and S4, based on the sound data acquired by the sensor SN1 that acquires the sound data in the space SP1, the position and size of the sound source in the space SP1 are estimated. The sensor SN1 includes a plurality of sound sensor arrays SA1. Each of the plurality of sound sensor arrays SA1 includes a plurality of sound sensors SE1. The estimation steps S2 and S4 include a sound source localization processing step S2 and a sound source position estimation step S4. In the sound source localization processing step S2, based on the sound data and the position information of each of the plurality of sound sensor arrays SA1, the arrival direction of the sound in each of the plurality of sound sensor arrays SA1 is estimated. In the sound source position estimation step S4, based on the arrival direction of the sound in each of the plurality of sound sensor arrays SA1 and the position information of each of the plurality of sound sensor arrays SA1, the position of the sound source is estimated. The program according to Embodiment 1 causes one or more processors to implement the sound environment analysis method according to Embodiment 1. Thereby, in the sound environment analysis method and program according to Embodiment 1, it becomes possible to accurately estimate the position and size of the sound source.

[0050] (Embodiment 2) (1) The sound environment analysis system 1 according to configuration embodiment 2 is equipped with an estimation unit 13a (see Figure 7) instead of the estimation unit 13. The estimation unit 13a is equipped with a sound source localization processing unit 131a instead of the sound source localization processing unit 131. The sound source localization processing unit 131a is equipped with a noise calculation unit 135 in addition to the configuration of the sound source localization processing unit 131. Furthermore, the estimation unit 13a is equipped with a noise estimation unit 136.

[0051] The noise calculation unit 135 calculates the noise level at each of the multiple sound sensor arrays SA1 based on the sound data. The noise level is an indicator of loudness as perceived by human hearing, and may be, for example, the sound pressure level of the sound, or a value that takes into account the sensitivity characteristics of human hearing, time masking, frequency masking, etc. Here, the noise calculation unit 135 is equipped with, for example, an A-weighting filter as defined in IEC 61052. The A-weighting filter is a frequency-weighted filter that takes human hearing into consideration. The noise calculation unit 135 converts the sound data at each of the multiple sound sensor arrays SA1 into a noise level that reaches the human ear by applying the A-weighting filter. The noise calculation unit 135 may also use a time-weighted filter such as a time constant filter. Furthermore, the noise calculation unit 135 may apply both a frequency-weighted filter and a time-weighted filter.

[0052] The noise estimation unit 136 estimates the distribution of noise intensity in space SP1 based on the noise level at each of the multiple sound sensor arrays SA1 and the position information of each of the multiple sound sensor arrays SA1. Noise intensity is an index indicating loudness as perceived by human hearing, and may be, for example, the sound pressure level of sound, or a value that takes into account the sensitivity characteristics of human hearing, time masking, frequency masking, etc. Here, noise intensity is sound pressure that takes into account the characteristics of human hearing. Alternatively, for example, noise intensity may be loudness as defined in ISO standards, a speech leakage index formulated by the Architectural Institute of Japan, or speech intelligibility. The noise estimation unit 136 maps the noise levels at each of the multiple sound sensor arrays SA1 output by the noise calculation unit 135 to the distribution of noise intensity in space SP1 based on the position information of each of the multiple sound sensor arrays SA1. The noise estimation unit 136 then estimates the distribution of noise levels in the spatial SP1 based on, for example, the positions of one or more sound sources estimated by the sound source position estimation unit 132.

[0053] The image generation unit 15 generates an image showing the location of the sound source and the loudness of the sound source within the space SP1, based on the results of the estimation unit 13a. The image is, for example, a heat map HM1 showing the sound state within the space. The sound state within the space is, for example, an index indicating loudness.

[0054] In the sound environment analysis system 1 according to Embodiment 2, it is possible to estimate the distribution of noise levels within the space SP1, taking into account human hearing, instead of the distribution of sound levels within the space SP1. Therefore, it becomes easier to provide a comfortable sound environment for the person using the space SP1, for example, by prioritizing measures against sounds that are easily heard by people.

[0055] (2) Effects The sound environment analysis system 1 according to Embodiment 2 comprises a noise calculation unit 135 and a noise estimation unit 136. The noise calculation unit 135 calculates the noise level at each of the multiple sound sensor arrays SA1 based on sound data. The noise estimation unit 136 estimates the distribution of noise magnitude in space SP1 based on the noise level at each of the multiple sound sensor arrays SA1 and the position information of each of the multiple sound sensor arrays SA1. As a result, the sound environment analysis system 1 according to Embodiment 2 can estimate the noise state in space SP1, making it easy to provide a comfortable sound environment.

[0056] (Embodiment 3) (1) Configuration The sound environment analysis system 1 according to Embodiment 3 has the same configuration as the sound environment analysis system 1 according to Embodiment 2 (see Figure 7). In the sound environment analysis system 1 according to Embodiment 3, the operation of the noise estimation unit 136 is different from that of the sound environment analysis system 1 according to Embodiment 2, so this will be explained in detail below.

[0057] The noise estimation unit 136 estimates the distribution of noise magnitude in space SP1 based on the noise level at each of the multiple sound sensor arrays SA1 and the position information of each of the multiple sound sensor arrays SA1. In the sound environment analysis system 1 according to Embodiment 3, the noise estimation unit 136 estimates the distribution of noise magnitude in space SP1 by estimating the position of one or more sound sources that are noise sources from the positions of multiple sound sources estimated by the sound source position estimation unit 132.

[0058] The image generation unit 15 generates an image showing the location of the sound source and the loudness of the sound source within the space SP1, based on the results of the estimation unit 13a. The image is, for example, a heat map HM1 showing the sound state within the space.

[0059] (2) Operation diagram 8 is a flowchart showing the operation of the sound environment analysis system 1 according to embodiment 3. For each step in the flowchart of Figure 8 that is the same as any of the steps in the flowchart of Figure 6, the same reference numerals are used and detailed explanations are omitted.

[0060] The multiple sound sensor array SA1 of the sound environment analysis system 1 acquires sound data (step S1).

[0061] Next, the estimation unit 13a of the sound environment analysis system 1 estimates the direction of the sound source (step S2).

[0062] Next, the estimation unit 13a of the sound environment analysis system 1 performs sound enhancement (step S3).

[0063] Next, the estimation unit 13a of the sound environment analysis system 1 estimates the sound source location (step S4).

[0064] Next, the estimation unit 13a of the sound environment analysis system 1 performs noise determination (step S11). Specifically, the noise estimation unit 136 of the estimation unit 13a identifies the source of the noise from the multiple sound sources estimated by the sound source location estimation unit 132 of the estimation unit 13a in step S4.

[0065] As described above, the sound source position estimation unit 132 estimates the position of one or more sound sources based on the direction of sound arrival at each of the multiple sound sensor arrays SA1. However, depending on the accuracy of the direction of sound arrival at each of the multiple sound sensor arrays SA1, the estimated position of one sound source may not converge to a single point.

[0066] Figure 9 is an example of a heatmap HM2 showing the positions of multiple sound sources estimated by the sound source position estimation unit 132 in step S4. In Figure 9, region AR11 is a collection of estimated values ​​for multiple sound sources, as a result of the sound source position estimation unit 132 estimating the position of sound source SS11. Due to reasons such as the sound from the sound source being directional, the sound reflecting within space SP1, or the sound source moving, a sound source may be estimated as a virtual image around the sound source, and a single sound source may be estimated as a collection of multiple sound sources within a predetermined range.

[0067] Similarly, region AR12 is a collection of estimated values ​​for multiple sound sources, resulting from the sound source position estimation unit 132 estimating the position of sound source SS12. Region AR13 is a collection of estimated values ​​for multiple sound sources, resulting from the sound source position estimation unit 132 estimating the position of sound source SS13. Region AR14 is a collection of estimated values ​​for multiple sound sources, resulting from the sound source position estimation unit 132 estimating the position of sound source SS14.

[0068] The noise estimation unit 136 of the estimation unit 13a identifies the positions of the sound sources SS11, SS12, SS13, and SS14, which are the sound sources of the noise, from each of the multiple regions AR11, AR12, AR13, and AR14. The noise estimation unit 136 then performs smoothing processing on the heat map HM2, for example, such as a Gaussian filter. As a result, sound sources with low volume that are close to sound sources with high volume are removed, and thus a portion of the sound sources as virtual images contained in each of the regions AR11, AR12, AR13, and AR14 is removed.

[0069] Furthermore, the noise estimation unit 136 extracts the local maximum point (maximum point) where the sound intensity is locally at its highest. This extracts the original sound sources SS11, SS12, SS13, and SS14. The noise estimation unit 136 then removes each of the estimated sound sources within a predetermined range around the local maximum point if its sound intensity falls below a threshold, treating them as virtual images. The predetermined range is, for example, an area corresponding to a 1m square in space SP1. The threshold is defined, for example, by the ratio of the sound intensity at the local maximum point. This removes virtual sound sources other than the actual noise sources SS11, SS12, SS13, and SS14.

[0070] Next, the suggestion unit 14 of the sound environment analysis system 1 makes suggestions for improving the sound environment within the space SP1 (step S5).

[0071] Next, the image generation unit 15 of the sound environment analysis system 1 generates an image (step S6). Here, the image generation unit 15 generates an image if there is one or more sound sources estimated by the estimation unit 13 for the period to be displayed, and does not generate an image if there is no one or more sound sources estimated by the estimation unit 13 for the period to be displayed.

[0072] Next, the display control unit 16 of the sound environment analysis system 1 causes the image to be displayed (step S7). The display control unit 16 causes the heat map HM1 to be displayed on the display device.

[0073] (3) Effects In the sound environment analysis system 1 according to Embodiment 3, the sound source location estimation unit 132 estimates the locations of multiple sound sources. Based on the distribution of noise magnitude in the space SP1, the noise estimation unit 136 estimates the location of one or more sound sources SS11 to SS14, which are the noise sources, from among the locations of multiple sound sources estimated by the sound source location estimation unit 132. As a result, the accuracy of sound source location estimation is improved in the sound environment analysis system 1 according to Embodiment 3.

[0074] (Other modifications according to the embodiment) (1) The sound environment analysis system 1 according to Embodiments 1 and 2 comprises one sound environment analysis device 10, but each element of the sound environment analysis device 10 may be part of different devices.

[0075] (2) In embodiments 1 and 2, the sound data acquisition unit 11 performs A / D conversion on each of the electrical signals output by the sound sensor SE1. However, for example, each of the multiple sound sensor array SA1 may have an A / D conversion function and output the sound data after A / D conversion to the sound environment analysis device 10. Alternatively, for example, each of the sound sensor SE1 may have an A / D conversion function.

[0076] (3) In embodiments 1 and 2, the image generation unit 15 generates an image showing the position of the sound source and the loudness of the sound source within the spatial SP1. However, the image generation unit 15 may, for example, generate an image showing the results of the simulation performed by the proposal unit 14, in addition to or instead of the image showing the position of the sound source and the loudness of the sound source within the spatial SP1.

[0077] (Aspect) The sound environment analysis system (1) according to the first aspect comprises a sensor (SN1) and an estimation unit (13). The sensor (SN1) acquires sound data in a space (SP1). The estimation unit (13) estimates the position and magnitude of sound sources in the space (SP1) based on the sound data. The sensor (SN1) includes a plurality of sound sensor arrays (SA1). Each of the plurality of sound sensor arrays (SA1) includes a plurality of sound sensors (SE1). The estimation unit (13) includes a sound source localization processing unit (131) and a sound source position estimation unit (132). The sound source localization processing unit (131) estimates the direction of arrival of sound in each of the plurality of sound sensor arrays (SA1) based on the sound data and the position information of each of the plurality of sound sensor arrays (SA1). The sound source position estimation unit (132) estimates the position of the sound source based on the direction of arrival of the sound at each of the multiple sound sensor arrays (SA1).

[0078] According to the sound environment analysis system (1) described above, it is possible to accurately estimate the location and size of the sound source.

[0079] The sound environment analysis system (1) according to the second embodiment further comprises a storage unit (12) in the first embodiment. The storage unit (12) stores the position information of each of the plurality of sound sensor arrays (SA1).

[0080] According to the sound environment analysis system (1) described above, it is possible to estimate the position and magnitude of one or more sound sources using a plurality of sound sensor arrays (SA1).

[0081] In the sound environment analysis system (1) according to the third embodiment, as in the second embodiment, the memory unit (12) stores the positional information of each of the multiple sound sensor arrays (SA1) as three-dimensional information. The sound source position estimation unit (132) estimates the position of the sound source as three-dimensional information.

[0082] According to the sound environment analysis system (1) described above, it is possible to analyze the sound environment within a space (SP1) in detail, taking into account the three-dimensional shape of the space (SP1).

[0083] The sound environment analysis system (1) according to the fourth embodiment further comprises a noise calculation unit (135) and a noise estimation unit (136) in any of the first to third embodiments. The noise calculation unit (135) calculates the noise level at each of the plurality of sound sensor arrays (SA1) based on sound data. The noise estimation unit (136) estimates the distribution of noise magnitude in space (SP1) based on the noise level at each of the plurality of sound sensor arrays (SA1) and the positional information of each of the plurality of sound sensor arrays (SA1).

[0084] According to the sound environment analysis system (1) described above, the noise level in the space (SP1) can be estimated, making it easy to provide a comfortable sound environment.

[0085] In the fifth embodiment of the sound environment analysis system (1), in the fourth embodiment, the sound source location estimation unit (132) estimates the locations of multiple sound sources. The noise estimation unit (136) estimates the location of one or more sound sources that are noise sources from among the locations of multiple sound sources estimated by the sound source location estimation unit (132), based on the distribution of noise magnitude in the space (SP1).

[0086] According to the sound environment analysis system (1) described above, the accuracy of sound source location estimation is improved.

[0087] The sixth embodiment of the sound environment analysis system (1) further comprises an image generation unit (15) that generates an image (HM1) indicating the position and size of sound sources in a space (SP1) in any of the first to fifth embodiments.

[0088] According to the sound environment analysis system (1) described above, it becomes easier for the manager or user of a space (SP1) to check the sound environment.

[0089] In the sound environment analysis system (1) according to the seventh embodiment, in the sixth embodiment, the image (HM1) is a heat map showing the sound state in the space (SP1).

[0090] According to the sound environment analysis system (1) described above, it becomes possible to easily compare the layout of the space (SP1) with the sound environment, making it easier to check and improve the sound environment.

[0091] The sound environment analysis system (1) according to the eighth embodiment further comprises a display control unit (16) according to the sixth or seventh embodiment. The display control unit (16) causes an image (HM1) to be displayed.

[0092] According to the sound environment analysis system (1) described above, visualizing the sound environment of the space (SP1) makes it even easier for the administrator or user of the space (SP1) to check the sound environment.

[0093] The sound environment analysis system (1) according to the ninth embodiment further comprises a suggestion unit (14) in any of the first to eighth embodiments. The suggestion unit (14) makes suggestions for improving the sound environment of the space (SP1).

[0094] According to the sound environment analysis system (1) described above, it becomes easy to improve the sound environment based on the analysis results of the space (SP1).

[0095] The sound environment analysis method according to the tenth embodiment includes estimation steps (S2, S4). In the estimation steps (S2, S4), the position and magnitude of sound sources in space (SP1) are estimated based on sound data acquired by a sensor (SN1) that acquires sound data in space (SP1). The sensor (SN1) includes a plurality of sound sensor arrays (SA1). Each of the plurality of sound sensor arrays (SA1) includes a plurality of sound sensors (SE1). The estimation steps (S2, S4) include a sound source localization processing step (S2) and a sound source position estimation step (S4). In the sound source localization processing step (S2), the direction of arrival of sound at each of the plurality of sound sensor arrays (SA1) is estimated based on the sound data and the position information of each of the plurality of sound sensor arrays (SA1). In the sound source location estimation step (S4), the location of the sound source is estimated based on the direction of arrival of the sound at each of the multiple sound sensor arrays (SA1) and the positional information of each of the multiple sound sensor arrays (SA1).

[0096] According to the sound environment analysis method described above, it is possible to accurately estimate the location and size of the sound source.

[0097] The program according to the eleventh embodiment causes one or more processors to execute the sound environment analysis method according to the tenth embodiment.

[0098] According to the program described above, it is possible to accurately estimate the position and size of a sound source.

[0099] 1 Sound Environment Analysis System 12 Memory Unit 13 Estimation Unit 131 Sound Source Localization Processing Unit 132 Sound Source Location Estimation Unit 135 Noise Calculation Unit 136 Noise Estimation Unit 14 Proposal Unit 15 Image Generation Unit 16 Display Control Unit S2 Sound Source Localization Processing Step (Estimation Step) S4 Sound Source Location Estimation Step (Estimation Step) SN1 Sensor SA1 Sound Sensor Array SE1 Sound Sensor SP1 Space HM1 Heat Map (Image)

Claims

1. A sound environment analysis system comprising: a sensor that acquires sound data in a space; and an estimation unit that estimates the position and magnitude of a sound source in the space based on the sound data, wherein the sensor includes a plurality of sound sensor arrays, each of the plurality of sound sensor arrays includes a plurality of sound sensors, and the estimation unit includes: a sound source localization processing unit that estimates the direction of arrival of sound in each of the plurality of sound sensor arrays based on the sound data and the position information of each of the plurality of sound sensor arrays; and a sound source position estimation unit that estimates the position of the sound source based on the direction of arrival of sound in each of the plurality of sound sensor arrays.

2. The sound environment analysis system according to claim 1, further comprising a memory unit, the memory unit storing positional information of each of the plurality of sound sensor arrays.

3. The sound environment analysis system according to claim 2, wherein the storage unit stores the positional information of each of the plurality of sound sensor arrays as three-dimensional information, and the sound source position estimation unit estimates the position of the sound source as three-dimensional information.

4. The sound environment analysis system according to any one of claims 1 to 3, further comprising: a noise calculation unit that calculates the noise level in each of the plurality of sound sensor arrays based on the sound data; and a noise estimation unit that estimates the distribution of noise magnitude in the space based on the noise level in each of the plurality of sound sensor arrays and the position information of each of the plurality of sound sensor arrays.

5. The sound environment analysis system according to claim 4, wherein the sound source location estimation unit estimates the locations of a plurality of sound sources, and the noise estimation unit estimates the location of one or more sound sources that are noise sources from among the locations of the plurality of sound sources estimated by the sound source location estimation unit, based on the distribution of the magnitude of the noise in the space.

6. The sound environment analysis system according to any one of claims 1 to 5, further comprising an image generation unit that generates an image indicating the position and size of the sound source in the space.

7. The sound environment analysis system according to claim 6, wherein the image is a heat map showing the sound state in the space.

8. The sound environment analysis system according to claim 6 or 7, further comprising a display control unit for displaying the aforementioned image.

9. The sound environment analysis system according to any one of claims 1 to 8, further comprising a proposal unit for proposing improvements to the sound environment within the space.

10. A sound environment analysis method comprising: an estimation step of estimating the position and magnitude of a sound source in a space based on sound data acquired by a sensor that acquires sound data in the space, wherein the sensor includes a plurality of sound sensor arrays, each of the plurality of sound sensor arrays includes a plurality of sound sensors, and the estimation step includes: a sound source localization processing step of estimating the direction of arrival of sound at each of the plurality of sound sensor arrays based on the sound data and the position information of each of the plurality of sound sensor arrays; and a sound source position estimation step of estimating the position of the sound source based on the direction of arrival of sound at each of the plurality of sound sensor arrays and the position information of each of the plurality of sound sensor arrays.

11. A program that causes one or more processors to execute the sound environment analysis method described in claim 10.

Images