Acoustic measurement device, acoustic measurement method and acoustic measurement program

Abstract

To provide an acoustic measurement device, acoustic measurement method and acoustic measurement program capable of accurately measuring acoustic characteristics regardless of installation environment.SOLUTION: An acoustic measurement device 10 includes an image acquisition unit 12, a sound acquisition unit 13, a determination unit 15 and a measurement unit 16. The image acquisition unit 12 acquires image data indicating images from an imaging device 180. The sound acquisition unit 13 acquires sound signals indicating sound from a sound collecting device 190. The determination unit 15 determines whether it is appropriate to perform measurement based on the image data acquired by the image acquisition unit 12 and the sound signals acquired by the sound acquisition unit 13. The measurement unit 16 measures acoustic characteristics based on the determination result from the determination unit 15.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an acoustic measurement device, an acoustic measurement method, and an acoustic measurement program for measuring acoustic characteristics.

Background Art

[0002] In a communication device, in order to enable good voice transmission and reception, the acoustic characteristics of the installation environment of the device are measured in advance. Based on the measured acoustic characteristics, appropriate parameters are set according to the installation environment. Here, since a loud sound is generated during the measurement of the acoustic characteristics, it is troublesome if there are people around. Also, if there are people around, noise is mixed in, resulting in a decrease in the accuracy of the measurement of the acoustic characteristics.

[0003] Patent Document 1 describes a voice communication device for an elevator. In this voice communication device, it is determined by a learning opportunity determination unit whether it is possible to perform parameter learning prior to a voice call according to the environment inside the elevator where the voice communication device is installed. When the elevator is stopped, the elevator door is closed, and the image of the camera installed inside the elevator is empty, it is determined that the environment inside the elevator allows parameter learning, and a learning signal for performing parameter learning is generated by a learning signal generation unit.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] According to the voice call device of Patent Document 1, in an elevator, acoustic characteristics can be appropriately measured. However, the call device is not necessarily installed in a relatively narrow and closed environment such as inside an elevator. Also, the installation environment of the call device may change dynamically. Therefore, an acoustic measurement device capable of accurately measuring acoustic characteristics regardless of the installation environment is desired.

[0006] An object of the present invention is to provide an acoustic measurement device, an acoustic measurement method, and an acoustic measurement program capable of accurately measuring acoustic characteristics regardless of the installation environment.

Means for Solving the Problems

[0007] An acoustic measurement device according to an aspect of the present invention includes an image acquisition unit that acquires image data indicating an image from an imaging device, an audio acquisition unit that acquires an audio signal indicating audio from a sound collection device, a determination unit that determines whether it is appropriate to perform measurement based on the image data acquired by the image acquisition unit and the audio signal acquired by the audio acquisition unit, and a measurement unit that measures acoustic characteristics based on a determination result by the determination unit.

[0008] An acoustic measurement method according to another aspect of the present invention includes acquiring image data indicating an image from an imaging device, acquiring an audio signal indicating audio from a sound collection device, determining whether it is appropriate to perform measurement based on the acquired image data and the acquired audio signal, and measuring acoustic characteristics based on the determination result, and is executed by a computer.

[0009] An acoustic measurement program according to still another aspect of the present invention causes a computer to execute a process of acquiring image data indicating an image from an imaging device, a process of acquiring an audio signal indicating audio from a sound collection device, a process of determining whether it is appropriate to perform measurement based on the acquired image data and the acquired audio signal, and a process of measuring acoustic characteristics based on the determination result.

Effects of the Invention

[0010] According to the present invention, the acoustic characteristics can be accurately measured regardless of the installation environment.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Embodiments for Carrying Out the Invention

[0012] 1. Configuration of the Acoustic Measurement Device Hereinafter, an acoustic measurement device, an acoustic measurement method, and an acoustic measurement program according to an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 is a block diagram showing the configuration of an acoustic measurement system including an acoustic measurement device according to an embodiment of the present invention. As shown in FIG. 1, the acoustic measurement system 100 includes a storage device 110, a CPU (Central Processing Unit) 120, a RAM (Random Access Memory) 130, a ROM (Read Only Memory) 140, a communication I / F (Interface) 150, a display device 160, an operation unit 170, an imaging device 180, a sound collection device 190, a speaker 200, and a bus 210.

[0013] The acoustic measurement system 100 is installed in a space for measuring the acoustic characteristics such as a conference room. The storage device 110, the CPU 120, the RAM 130, the ROM 140, the communication I / F 150, the operation unit 170, the imaging device 180, the sound collection device 190, and the speaker 200 are connected to the bus 210. The storage device 110, the CPU 120, the RAM 130, the ROM 140, the communication I / F 150, and the bus 210 constitute the acoustic measurement device 10. The acoustic measurement device 10 may be realized by an information processing device such as a personal computer (PC).

[0014] The storage device 110 includes a storage medium such as a hard disk, an optical disk, a magnetic disk, or a memory card, and stores an acoustic measurement program in advance. Further, the storage device 110 stores a list of predetermined sounds. The predetermined sounds include sounds that are constantly generated, such as the operating sound of a clock or the operating sound of an air conditioner. The list of sounds may have the form of sound data indicating the sounds. Further, the list of sounds may include the type of object that generates the above sounds, such as a clock or an air conditioner.

[0015] The CPU 120 executes an acoustic measurement process by executing the acoustic measurement program stored in the storage device 110. Details of the acoustic measurement process will be described later. The RAM 130 is composed of, for example, a volatile memory, and is used as a work area for the CPU 120 and temporarily stores various data. The ROM 140 is composed of, for example, a non-volatile memory and stores computer programs such as system programs.

[0016] Instead of the storage device 110, the ROM 140 may store the acoustic measurement program. The acoustic measurement program may be provided in a form stored in a storage medium 220 such as a computer-readable CD (compact disc)-ROM, and may be installed in the storage device 110 or the ROM 140 by being read through the communication I / F 150 or the like. Further, when the communication I / F 150 is connected to a communication network, the acoustic measurement program distributed from a server connected to the communication network may be installed in the storage device 110 or the ROM 140.

[0017] The display device 160 includes, for example, a liquid crystal display. An image by the imaging device 180 is displayed on the display device 160. Further, it is also possible to display the processing result by the acoustic measurement device 10 on the display device 160. The operation unit 170 includes a keyboard or a pointing device. The pointing device includes a mouse, a joystick, or the like. The operation unit 170 is operated when the user makes a predetermined designation or the like to the acoustic measurement device 10.

[0018] The imaging device 180 includes a camera and generates image data indicating an image of an object by imaging surrounding objects. The object is various subjects such as a person or an object. The camera may be a security camera such as a conference camera or a sensor camera. The image data generated by the imaging device 180 is provided to the acoustic measurement device 10.

[0019] The sound collection device 190 includes a microphone 191 and generates a sound signal indicating sound by collecting surrounding sound. In this example, the sound collection device 190 includes a plurality of microphones 191 each of which generates a sound signal by collecting surrounding sound. The sound signal generated by the sound collection device 190 is provided to the acoustic measurement device 10. The speaker 200 outputs (plays) sound. At the time of measuring acoustic characteristics, the sound collected by the sound collection device 190 includes the sound output from the speaker 200.

[0020] 2. Configuration of Acoustic Measurement Device FIG. 2 is a block diagram for explaining the configuration of the acoustic measurement device 10. As shown in FIG. 2, the acoustic measurement device 10 includes, as functional units, a list acquisition unit 11, an image acquisition unit 12, a sound acquisition unit 13, an estimation unit 14, a determination unit 15, a measurement unit 16, and a signal processing unit 17. By the CPU 120 in FIG. 1 executing an acoustic measurement program stored in the storage device 110 or the like, the functional units of the acoustic measurement device 10 are realized. Part or all of the functional units of the acoustic measurement device 10 may be realized by hardware such as an electronic circuit.

[0021] The list acquisition unit 11 acquires a list of sounds stored in the storage device 110. The image acquisition unit 12 acquires image data (hereinafter, simply referred to as an image as appropriate) from the imaging device 180. The sound acquisition unit 13 acquires a sound signal (hereinafter, simply referred to as sound as appropriate) from the sound collection device 190. In this example, the sound acquisition unit 13 acquires sound from each of the plurality of microphones 191 (FIG. 1) of the sound collection device 190.

[0022] The estimation unit 14 estimates the type of the object included in the image data acquired by the image acquisition unit 12 by performing image recognition, and also estimates the position of the object. The position of the object estimated by the estimation unit 14 includes the direction and distance of the object. Further, the estimation unit 14 estimates the position of the sound based on the sound signal acquired by the sound collection device 190. The position of the sound estimated by the estimation unit 14 includes the arrival direction of the sound. In this example, not only the imaging device 180 that generates the image data is provided, but since the sound collection device 190 includes a plurality of microphones 191, the estimation unit 14 can accurately estimate the position of the sound based on the sound signals acquired by the plurality of microphones 191.

[0023] The determination unit 15 estimates the sound source from the position of the object and the position of the sound estimated by the estimation unit 14. Further, the determination unit 15 determines whether it is appropriate to measure the acoustic characteristics based on the image data acquired by the image acquisition unit 12 and the sound signal acquired by the sound acquisition unit 13. Specifically, the determination unit 15 determines that it is appropriate to perform the measurement when the image acquired by the image acquisition unit 12 does not include an image of an object unsuitable for measurement and the sound acquired by the sound acquisition unit 13 does not include the sound of an object unsuitable for measurement.

[0024] Here, when there is no change in the images acquired within a certain period of time (including the case where the images are always dark), it may be determined that the images do not include an image of an object unsuitable for measurement. Alternatively, when the images acquired within a certain period of time do not include a human face, it may be determined that the images do not include an image of an object unsuitable for measurement. Further, when the magnitude of the sound acquired within a certain period of time is equal to or less than a predetermined threshold value, it may be determined that the sound does not include the sound of an object unsuitable for measurement.

[0025] For the determination of whether it is appropriate to perform measurement, the sound source of the voice may be used. In this example, the determination unit 15 determines that it is appropriate to perform measurement when the position of the object estimated by the estimation unit 14 corresponds to the position of the voice and the voice at the estimated position is included in the list acquired by the list acquisition unit 11. Note that the correspondence between the position of the object and the position of the voice means that the sound source of the voice can be specified based on the position of the object estimated by the estimation unit 14 and the position of the voice. Specifically, the correspondence between the position of the object and the position of the voice means that the estimated object and the voice are at approximately the same position, that is, the distance between the position of the object and the position of the voice is smaller than a predetermined threshold. As described above, the voice included in the list includes voices that constantly occur, such as the operation sound of a clock or the operation sound of an air conditioner. Therefore, even when mechanical operation sounds or the like constantly occur from a specific position in the space where the acoustic measurement system 100 is installed, if the space is unoccupied, it is determined that it is appropriate to perform measurement.

[0026] In addition, when the determination unit 15 determines that it is appropriate to perform measurement, the determination unit 15 determines whether it is necessary to measure the acoustic characteristics. For example, it may be determined that it is necessary to measure the acoustic characteristics when the current time is the specified date and time. The user can specify the date, day of the week, or time zone when the user desires to perform the measurement of the acoustic characteristics as the date and time to the determination unit 15 by operating the operation unit 170.

[0027] Here, when the acoustic measurement system 100 is not moved to another space and the arrangement of objects such as desks or chairs around the acoustic measurement system 100 is not changed, the acoustic characteristics measured once hardly change. In such a case, repeatedly measuring the acoustic characteristics may be redundant. Therefore, in this example, the determination unit 15 determines whether it is necessary to measure the acoustic characteristics based on the change in the scenery in the image acquired by the image acquisition unit 12.

[0028] For example, when the scenery in the current image has not changed from the scenery in the image obtained at the time of the previous measurement of the acoustic characteristics, it may be determined that the measurement of the acoustic characteristics is not necessary regardless of whether the current time is the specified date and time. Note that the case where the scenery in the image changes includes one or both of the case where the acoustic measurement system 100 is moved to another space and the case where the arrangement of the objects around the acoustic measurement system 100 is changed.

[0029] The measurement unit 16 measures the acoustic characteristics based on the determination result by the determination unit 15. In this example, as described above, it is determined whether it is appropriate to perform the measurement by the determination unit 15, and when it is determined that it is appropriate to perform the measurement, it is determined whether the measurement of the acoustic characteristics is necessary. Therefore, the measurement unit 16 measures the acoustic characteristics when the determination unit 15 determines that the measurement of the acoustic characteristics is necessary.

[0030] In the measurement of the acoustic characteristics, the measurement unit 16 outputs sound from the speaker 200 by providing sound data indicating a specific pulsed sound to the speaker 200. In this case, the audio signal acquired by the audio acquisition unit 13 includes a component of the audio signal indicating the audio output from the speaker 200. The measurement unit 16 performs a predetermined operation such as convolution on the audio signal given to the speaker 200 and the audio signal acquired by the audio acquisition unit 13. Further, the measurement unit 16 acquires spatial acoustic information such as the reverberation time of the space, the frequency characteristics, or the volume of the speaker 200 based on the operation result.

[0031] The signal processing unit 17 sets parameters for the equipment based on the result of the acoustic characteristics measured by the measurement unit 16. In this example, the signal processing unit 17 sets the result of the acoustic characteristics by the measurement unit 16 as a parameter in the sound collection device 190 or the speaker 200. Further, the signal processing unit 17 performs processing on the audio signal based on the set parameters. The signal processing includes echo cancellation processing, howling cancellation processing, or reverberation suppression processing. Thereby, the sound collection characteristics by the sound collection device 190 or the sound emission characteristics by the speaker 200 are improved.

[0032] The signal processing unit 17 may set the volume of the speaker 200 and the like. Further, when the acoustic measurement system 100 includes an equalizer, the signal processing unit 17 may optimize the equalizer. Furthermore, the signal processing unit 17 may present a user with a proposal for improving the acoustic environment of the space. The proposal for improving the acoustic environment includes the position of the sound collection device 190, the position of the speaker 200, or the installation of other equipment. Other equipment includes optional equipment or a tuning panel, etc. The presentation of the proposal may be performed by displaying the content of the proposal on the display device 160.

[0033] Also, the signal processing unit 17 determines the correspondence (degree of coincidence) between the position of the object included in the image and the sound generation position. Therefore, when the acoustic measurement system 100 is used in a meeting or the like, the signal processing unit 17 may perform the following face focus beamforming (FFBF). FFBF is a technology for appropriately collecting the sound of the speaker among the meeting participants based on the direction and distance of the speaker recognized from the image and the sound arrival direction.

[0034] Specifically, when executing FFBF, the image data generated by the imaging device 180 is analyzed to recognize the face of the person included in the image, and the recognized face of the person is constantly tracked in the image. Based on the position of the person recognized in the image, among the voices collected by the sound collection device 190, the voice arriving from the direction where the person is located is mainly extracted, and the sound arriving from other directions is hardly extracted. Thereby, the voice generated by a specific person can be appropriately collected.

[0035] 3. Acoustic measurement process FIG. 3 is a flowchart showing an example of the acoustic measurement process by the acoustic measurement device 10. Hereinafter, the acoustic measurement process of FIG. 3 will be described using the acoustic measurement device 10 of FIG. 2. First, the list acquisition unit 11 acquires a list of voices stored in the storage device 110 (step S1).

[0036] Next, the image acquisition unit 12 acquires image data from the imaging device 180 (step S2). The estimation unit 14 estimates the type and position of the object based on the image data acquired in step S2 (step S3). Also, the audio acquisition unit 13 acquires an audio signal from the sound collection device 190 (step S4). The estimation unit 14 estimates the position of the audio based on the audio signal acquired in step S4 (step S5). Either of step S2, S3 and step S4, S5 may be executed first, or they may be executed simultaneously.

[0037] The determination unit 15 determines whether it is appropriate to measure the acoustic characteristics based on the list of audio acquired in step S1, the type and position of the object estimated in step S3, and the position of the audio estimated in step S5 (step S6). For example, when it can be determined that the estimated position of the object and the position of the audio match, and the audio (or the type of object) at the estimated position is included in the acquired list, it is determined that it is appropriate to perform the measurement. If it is determined that it is not appropriate to measure the acoustic characteristics, the process returns to step S2. Steps S2 to S6 are repeated until it is determined that it is appropriate to measure the acoustic characteristics.

[0038] If it is determined that it is appropriate to measure the acoustic characteristics, the determination unit 15 determines whether it is necessary to measure the acoustic characteristics (step S7). When the current time is the specified date and time, it is determined that it is necessary to measure the acoustic characteristics. Also, even when the current time is the specified date and time, if the scenery in the image in step S2 has not changed from the scenery in the image acquired at the time of the previous measurement of the acoustic characteristics, it is determined that it is not necessary to measure the acoustic characteristics. If it is determined that it is not necessary to measure the acoustic characteristics, the process returns to step S2. Steps S2 to S7 are repeated until it is determined that it is necessary to measure the acoustic characteristics.

[0039] When it is determined that measurement of acoustic characteristics is necessary, the measurement unit 16 measures the acoustic characteristics (step S8). Next, the signal processing unit 17 sets parameters for the equipment based on the result of the acoustic characteristics measured in step S8 (step S9). Subsequently, the signal processing unit 17 processes the audio signal based on the parameters set in step S9 (step S10). Thereafter, the process returns to step S2.

[0040] Thereafter, steps S2 to S10 are repeated. As a result, even when the acoustic measurement system 100 is moved from one space to another, or when the arrangement of objects such as desks or chairs around the acoustic measurement system 100 in the space is changed, the acoustic characteristics of the space can be accurately measured. Also, the parameters can be updated to parameters suitable for that space.

[0041] 4. Effects of the Embodiment As described above, the acoustic measurement device 10 according to the present embodiment includes an image acquisition unit 12 that acquires image data indicating an image from the imaging device 180, an audio acquisition unit 13 that acquires an audio signal indicating audio from the sound collection device 190, and a determination unit 15 that determines whether it is appropriate to perform measurement based on the image data acquired by the image acquisition unit 12 and the audio signal acquired by the audio acquisition unit 13, and a measurement unit 16 that measures acoustic characteristics based on the determination result by the determination unit 15.

[0042] In this acoustic measurement device 10, since the image data and the audio signal are used to determine whether it is appropriate to perform measurement, it is possible to determine that it is not appropriate to perform measurement regardless of whether an object not suitable for measurement is within or outside the field of view of the image. Therefore, it becomes possible to measure the acoustic characteristics in a state where there is no object not suitable for measurement. As a result, the acoustic characteristics can be accurately measured regardless of the installation environment of the acoustic measurement device 10.

[0043] When the determination unit 15 determines that the image acquired by the image acquisition unit 12 does not include an image of an object unsuitable for measurement and the sound acquired by the sound acquisition unit 13 does not include the sound of an object unsuitable for measurement, it may determine that it is appropriate to perform the measurement. In this case, it is possible to easily determine that it is appropriate to perform the measurement.

[0044] When the determination unit 15 determines that it is appropriate to perform the measurement, it determines whether it is necessary to measure the acoustic characteristics. When the measurement unit 16 determines that it is necessary to measure the acoustic characteristics as determined by the determination unit 15, the measurement unit 16 may measure the acoustic characteristics. In this case, the acoustic characteristics are measured only when it is necessary to measure the acoustic characteristics. Thereby, it is possible to accurately measure the acoustic characteristics while reducing the load on the measurement unit 16.

[0045] The determination unit 15 may determine whether it is necessary to measure the acoustic characteristics based on the change in the scenery in the image acquired by the image acquisition unit 12. According to this configuration, when the installation environment of the acoustic measurement device 10 changes or the like, it is possible to determine that it is necessary to measure the acoustic characteristics in an appropriate situation.

[0046] The determination unit 15 may determine that it is necessary to measure the acoustic characteristics when the current time is the specified date and time. In this case, it is possible to easily determine whether it is necessary to measure the acoustic characteristics.

[0047] The acoustic measurement device 10 may further include a signal processing unit 17 that sets the result of the acoustic characteristics by the measurement unit 16 as a parameter and performs processing on the audio signal based on the set parameter. In this case, good audio can be transmitted and received.

[0048] The acoustic measurement device 10 further includes an estimation unit 14 that estimates the position of an object based on the image data acquired by the image acquisition unit 12 and estimates the position of the sound based on the audio signal acquired by the sound collection device 190. The determination unit 15 may determine whether it is appropriate to perform the measurement based on the position of the object and the position of the sound estimated by the estimation unit 14. In this case, it is possible to more accurately determine whether it is appropriate to perform the measurement.

[0049] The sound collection device 190 may include a plurality of microphones 191 that acquire an audio signal and provide the acquired audio signal to the estimation unit 14. In this case, the position of the sound can be estimated more accurately by beamforming.

[0050] The acoustic measurement device 10 further includes a list acquisition unit 11 that acquires a predetermined list of sounds. The determination unit 15 may determine that it is appropriate to perform the measurement when the position of the object and the position of the sound estimated by the estimation unit 14 correspond and the sound at the estimated position is included in the list. According to this configuration, even when there is an object that constantly generates sound, it is possible to determine that it is appropriate to perform the measurement.

[0051] During the measurement of the acoustic characteristics, the measurement unit 16 may output sound from the speaker 200, and during the measurement of the acoustic characteristics, the sound collection device 190 may acquire an audio signal indicating the sound output from the speaker 200. In this case, the acoustic characteristics can be easily measured.

[0052] 5. Other embodiments (1) In the above-described embodiment, when the determination unit 15 determines that it is appropriate to perform the measurement, it determines whether it is necessary to measure the acoustic characteristics. The measurement unit 16 measures the acoustic characteristics when it is determined by the determination unit 15 that the measurement of the acoustic characteristics is necessary. However, the embodiment is not limited to this. The determination unit 15 may determine whether it is necessary to measure the acoustic characteristics without determining whether it is appropriate to perform the measurement. That is, step S7 of the acoustic measurement process may be omitted. Even in this case, the measurement unit 16 can accurately measure the acoustic characteristics.

[0053] (2) In the above-described embodiment, the determination unit 15 determines whether it is necessary to measure the acoustic characteristics based on the change in the scenery in the image acquired by the image acquisition unit 12. However, the embodiment is not limited to this. The determination unit 15 may not perform such determination. In this case, when the current time is the specified date and time, the determination unit 15 determines that it is necessary to measure the acoustic characteristics regardless of whether there is a change in the scenery in the image acquired by the image acquisition unit 12.

[0054] (3) In the above-described embodiment, the determination unit 15 determines that it is necessary to measure the acoustic characteristics when the current time is the specified date and time. However, the embodiment is not limited to this. The determination unit 15 may determine that it is necessary to measure the acoustic characteristics every time a certain period elapses. In this case, the user does not need to specify the date and time for measuring the acoustic characteristics.

[0055] (4) In the above-described embodiment, the acoustic measurement device 10 includes the list acquisition unit 11, the estimation unit 14, and the signal processing unit 17. However, the embodiment is not limited to this. When no sound is constantly generated around the acoustic measurement device 10, the acoustic measurement device 10 may not include the list acquisition unit 11. When the position of the object and the position of the sound are not used for determining whether it is appropriate to perform the measurement, the acoustic measurement device 10 may not include the estimation unit 14. When the user sets the result of the acoustic characteristics by the measurement unit 16 as a parameter, the acoustic measurement device 10 may not include the signal processing unit 17.

[0056] (5) In the above embodiment, the sound collection device 190 includes a plurality of microphones 191, but the embodiment is not limited thereto. When the estimation unit 14 can estimate the position of the sound sufficiently accurately, the sound collection device 190 may include one microphone 191 instead of including a plurality of microphones 191.

[0057] (6) In the above embodiment, the imaging device 180, the sound collection device 190, and the speaker 200 are provided outside the acoustic measurement device 10, but the embodiment is not limited thereto. Part or all of the imaging device 180, the sound collection device 190, and the speaker 200 may be provided inside the acoustic measurement device 10.

[0058] 6. Summary of the embodiment (Item 1) The acoustic measurement device according to Item 1 includes an image acquisition unit that acquires image data indicating an image from an imaging device, a sound acquisition unit that acquires a sound signal indicating sound from a sound collection device, a determination unit that determines whether it is appropriate to perform measurement based on the image data acquired by the image acquisition unit and the sound signal acquired by the sound acquisition unit, and a measurement unit that measures acoustic characteristics based on the determination result by the determination unit.

[0059] In this acoustic measurement device, since the image data and the sound signal are used to determine whether it is appropriate to perform measurement, it is possible to determine that it is not appropriate to perform measurement even when an object not suitable for measurement is in either the field of view or outside the field of view of the image. Therefore, it becomes possible to measure the acoustic characteristics in a state where there is no object not suitable for measurement. Thereby, the acoustic characteristics can be accurately measured regardless of the installation environment of the acoustic measurement device.

[0060] (Item 2) In the acoustic measurement device according to Item 1, When the determination unit determines that the image acquired by the image acquisition unit does not include an image of an object unsuitable for measurement and the sound acquired by the sound acquisition unit does not include the sound of an object unsuitable for measurement, it may be determined that it is appropriate to perform the measurement.

[0061] In this case, it is possible to easily determine that it is appropriate to perform the measurement.

[0062] (Item 3) In the acoustic measurement device according to Item 1 or Item 2, When it is determined by the determination unit that it is appropriate to perform the measurement, the measurement unit may measure the acoustic characteristics.

[0063] In this case, the acoustic characteristics can be measured more accurately.

[0064] (Item 4) In the acoustic measurement device according to Item 1 or Item 2, When the determination unit determines that it is appropriate to perform the measurement, it determines whether the measurement of the acoustic characteristics is necessary, When it is determined by the determination unit that the measurement of the acoustic characteristics is necessary, the measurement unit may measure the acoustic characteristics.

[0065] In this case, the acoustic characteristics are measured only when the measurement of the acoustic characteristics is necessary. Thereby, while reducing the load on the measurement unit, the acoustic characteristics can be accurately measured.

[0066] (Item 5) In the acoustic measurement device according to Item 4, The determination unit may determine whether the measurement of the acoustic characteristics is necessary based on the change in the scenery in the image acquired by the image acquisition unit.

[0067] According to this configuration, when the installation environment of the acoustic measurement device changes, etc., it is possible to determine that the measurement of the acoustic characteristics is necessary in an appropriate situation.

[0068] (Item 6) In the acoustic measurement device according to Item 4 or Item 5, the determination unit may determine that it is necessary to measure the acoustic characteristics when the current time is the specified date and time.

[0069] In this case, it is possible to easily determine whether it is necessary to measure the acoustic characteristics.

[0070] (Item 7) The acoustic measurement device according to any one of Items 1 to 6 may further include a signal processing unit that sets the result of the acoustic characteristics by the measurement unit as a parameter and performs processing on the audio signal based on the set parameter.

[0071] In this case, good audio can be transmitted and received.

[0072] (Item 8) The acoustic measurement device according to any one of Items 1 to 7 further includes an estimation unit that estimates the position of an object based on the image data acquired by the image acquisition unit and estimates the position of the sound based on the audio signal acquired by the sound collection device, and the determination unit may determine whether it is appropriate to perform the measurement based on the position of the object estimated by the estimation unit and the position of the sound.

[0073] In this case, it is possible to more accurately determine whether it is appropriate to perform the measurement.

[0074] (Item 9) In the acoustic measurement device according to Item 8, the sound collection device may include a plurality of microphones that acquire an audio signal and give the acquired audio signal to the estimation unit.

[0075] In this case, the position of the sound can be estimated more accurately.

[0076] (Item 10) The acoustic measurement device according to Item 8 or Item 9 further includes a list acquisition unit that acquires a predetermined list of sounds, The determination unit may determine that it is appropriate to perform measurement when the position of the object estimated by the estimation unit corresponds to the position of the sound and the sound at the estimated position is included in the list.

[0077] According to this configuration, even when there is an object that constantly generates sound, it can be determined that it is appropriate to perform measurement.

[0078] (Item 11) In the acoustic measurement device according to any one of Items 1 to 10, When measuring the acoustic characteristics, the measurement unit outputs sound from the speaker, When measuring the acoustic characteristics, the sound collection device may acquire a sound signal indicating the sound output from the speaker.

[0079] In this case, the acoustic characteristics can be easily measured.

[0080] (Item 12) The acoustic measurement method according to Item 12 acquiring image data indicating an image from an imaging device, acquiring a sound signal indicating sound from a sound collection device, determining whether it is appropriate to perform measurement based on the acquired image data and the acquired sound signal, including measuring the acoustic characteristics based on the determination result, and is executed by a computer.

[0081] According to this acoustic measurement method, it becomes possible to measure the acoustic characteristics in a state where there is no object unsuitable for measurement. Thereby, the acoustic characteristics can be accurately measured regardless of the installation environment of the computer.

[0082] (Item 13) The acoustic measurement program according to Item 13 a process of acquiring image data indicating an image from an imaging device, a process of acquiring a sound signal indicating sound from a sound collection device, Based on the acquired image data and the acquired audio signal, a process for determining whether it is appropriate to perform a measurement, and a process for measuring acoustic characteristics based on the determination result are executed by a computer.

[0083] According to this acoustic measurement program, it becomes possible to measure acoustic characteristics in a state where there is no object unsuitable for measurement. As a result, the acoustic characteristics can be accurately measured regardless of the installation environment of the computer.

Explanation of Signs

[0084] 10…Acoustic measurement device, 11…List acquisition unit, 12…Image acquisition unit, 13…Audio acquisition unit, 14…Estimation unit, 15…Determination unit, 16…Measurement unit, 17…Signal processing unit, 100…Acoustic measurement system, 110…Storage device, 120…CPU, 130…RAM, 140…ROM, 150…Communication I / F, 160…Display device, 170…Operation unit, 180…Imaging device, 190…Sound collection device, 191…Microphone, 200…Speaker, 210…Bus, 220…Storage medium

Claims

1. An image acquisition unit that acquires image data indicating an image from an imaging device, An audio acquisition unit that acquires an audio signal indicating audio from a sound collection device, A determination unit that determines whether it is appropriate to perform a measurement based on the image data acquired by the image acquisition unit and the audio signal acquired by the audio acquisition unit, An acoustic measurement device comprising a measurement unit that measures acoustic characteristics based on the determination result by the determination unit.

2. The determination unit according to claim 1, wherein when the image acquired by the image acquisition unit does not include an image of an object unsuitable for measurement, and the audio acquired by the audio acquisition unit does not include an audio of an object unsuitable for measurement, it is determined that it is appropriate to perform a measurement.

3. The measurement unit according to claim 1 or 2, wherein when it is determined by the determination unit that it is appropriate to perform a measurement, the measurement unit measures acoustic characteristics.

4. The determination unit determines whether it is necessary to measure acoustic characteristics when it is determined that it is appropriate to perform a measurement, The measurement unit according to claim 1 or 2, wherein when it is determined by the determination unit that it is necessary to measure acoustic characteristics, the measurement unit measures acoustic characteristics.

5. The determination unit according to claim 4, wherein the determination unit determines whether it is necessary to measure acoustic characteristics based on a change in scenery in the image acquired by the image acquisition unit.

6. The determination unit according to claim 4, wherein when the current time is the specified date and time, it is determined that it is necessary to measure acoustic characteristics.

7. The acoustic measurement device according to claim 1 or 2, further comprising a signal processing unit that sets the result of the acoustic characteristics by the measurement unit as a parameter and performs processing on the audio signal based on the set parameter.

8. Further comprising an estimation unit that estimates the position of an object based on the image data acquired by the image acquisition unit and estimates the position of audio based on the audio signal acquired by the sound collection device, The determination unit according to claim 1 or 2, wherein the determination unit determines whether it is appropriate to perform a measurement based on the position of the object estimated by the estimation unit and the position of the audio.

9. The sound collection device according to claim 8, comprising a plurality of microphones that acquire an audio signal and provide the acquired audio signal to the estimation unit.

10. further comprising a list acquisition unit that acquires a predetermined list of voices; The acoustic measurement device according to claim 8, wherein the determination unit determines that it is appropriate to perform measurement when the position of the object estimated by the estimation unit corresponds to the position of the voice and the voice at the estimated position is included in the list.

11. During measurement of acoustic characteristics, the measurement unit outputs a voice from a speaker; The acoustic measurement device according to claim 1 or 2, wherein during measurement of acoustic characteristics, the sound collection device acquires a voice signal indicating the voice output from the speaker.

12. acquiring image data indicating an image from an imaging device; acquiring a voice signal indicating a voice from a sound collection device; determining whether it is appropriate to perform measurement based on the acquired image data and the acquired voice signal; including measuring acoustic characteristics based on the determination result; An acoustic measurement method executed by a computer.

13. a process of acquiring image data indicating an image from an imaging device; a process of acquiring a voice signal indicating a voice from a sound collection device; a process of determining whether it is appropriate to perform measurement based on the acquired image data and the acquired voice signal; a process of measuring acoustic characteristics based on the determination result; An acoustic measurement program executed by a computer.

Images