Noise suppression system, noise suppression method, and program

Abstract

To suppress noise by giving, to utterers, consciousness for intending to suppress the noise by suppressing the loudness of the uttered voice correspondingly to an environment where the uttered voice is a source of the noise.SOLUTION: A noise suppression system comprises: a sound collection data acquisition unit configured to acquire sound collection data obtained by collecting sound with a sound collecting sensor provided in an object space; a noise determination unit configured to determine whether the sound of the sound collection data acquired by the sound collection data acquisition unit corresponds to noise; and a device control unit capable of controlling a control device that is provided in the object space and is capable of controlling the operation of the device so that, in response to determination made by the noise determination unit, that the state corresponds to noise, a predetermined device provided in the object space performs a predetermined noise suppression promotion operation corresponding to making users aware of uttered voice suppression.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a noise suppression system, a noise suppression method, and a program.

Background Art

[0002] Techniques for providing sound insulation properties to wall materials are known in order to prevent noise in a room or the like from leaking outside (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] For example, when the noise source is the voice of a person speaking, such as in a conference room where a meeting is being held, it is possible to suppress the noise by the speaker being conscious of suppressing the volume of the voice they emit.

[0005] The present invention has been made in view of such circumstances, and an object thereof is to suppress noise by giving the speaker an awareness of suppressing the volume of the speaking voice to suppress the noise.

Means for Solving the Problems

[0006] One aspect of the present invention that solves the above-mentioned problems includes: a sound collection data acquisition unit that acquires sound collection data obtained by sound collection sensors installed in a target space; a noise determination unit that determines whether the sound in the sound collection data acquired by the sound collection data acquisition unit corresponds to noise; and a device control unit that can control a control device installed in the target space that can control the operation of a predetermined device, so that the device installed in the target space performs a predetermined noise suppression promotion operation corresponding to raising awareness of speech voice suppression to the user, in response to the noise determination unit determining that the device corresponds to noise; The system comprises a schedule management server that manages user schedules, and an analysis unit that identifies user-specific voices contained in past sound collection data based on past sound collection data, user voiceprint data, and user schedules managed by the schedule management server. The noise determination unit identifies users who have previously emitted voices at a level equivalent to noise based on the user-specific voices identified by the analysis unit, and the equipment control unit controls the equipment to perform the noise suppression promotion operation according to the identification result of the users to be warned, and changes the noise suppression promotion operation to be performed by the equipment according to the number of times the noise suppression promotion operation has been performed. It is a noise reduction system.

[0007] One aspect of the present invention includes a sound collection data acquisition step of acquiring sound collection data obtained by sound collection sensors installed in a target space, a noise determination step of determining whether the sound of the sound collection data acquired in the sound collection data acquisition step corresponds to noise, and a device control step of controlling a control device installed in the target space that can control the operation of a predetermined device, so that the device installed in the target space performs a predetermined noise suppression promotion operation corresponding to raising awareness of speech voice suppression to the user, in response to the determination in the noise determination step that the device is in a state corresponding to noise. An analysis step to identify the voice of each user contained in the past sound collection data, based on past sound collection data, user voiceprint data, and user schedules managed on the schedule management server. Includes The noise determination step identifies users who have previously emitted noise-level sounds based on the voices of each user identified by the analysis step, and the equipment control step controls the equipment to perform a predetermined noise suppression promotion operation according to the identification result of the users to be warned, and changes the noise suppression promotion operation to be performed by the equipment according to the number of times the noise suppression promotion operation has been performed. This is a noise suppression method.

[0008] One aspect of the present invention relates to a noise suppression system comprising: a computer, a sound collection data acquisition unit that acquires sound collection data obtained by sound collection sensors installed in a target space; a noise determination unit that determines whether the sound in the sound collection data acquired by the sound collection data acquisition unit corresponds to noise; and a device control unit that controls a control device installed in the target space and capable of controlling the operation of the device, so that the device installed in the target space performs a predetermined noise suppression promotion operation corresponding to raising awareness of speech voice suppression to the user, in response to the determination by the noise determination unit that the device is in a state corresponding to noise. Based on past sound collection data, user voiceprint data, and user schedules managed on the schedule management server, an analysis unit identifies the voice of each user contained in the past sound collection data. A program to make it function as The noise determination unit identifies users who have previously emitted noise-level sounds based on the voice of each user identified by the analysis unit, and the equipment control unit controls the equipment to perform a predetermined noise suppression promotion operation according to the identification result of the users to be warned, and changes the noise suppression promotion operation to be performed by the equipment according to the number of times the noise suppression promotion operation has been performed, and the program That is the case. [Effects of the Invention]

[0009] As described above, the present invention has the effect of suppressing noise by giving the speaker an awareness of trying to reduce the volume of their speech and thus suppress noise. [Brief explanation of the drawing]

[0010] [Figure 1] This figure shows an example of the overall configuration of the noise suppression system according to this embodiment. [Figure 2] This figure shows an example configuration of the device control system according to this embodiment. [Figure 3] This figure shows an example of device control information according to this embodiment. [Figure 4] This figure shows an example configuration of a data storage server according to this embodiment. [Figure 5] This figure shows an example of sound collection data according to this embodiment. [Figure 6] This figure shows an example of user information according to this embodiment. [Figure 7] This figure shows an example of the analysis results information according to this embodiment. [Figure 8] This figure shows an example configuration of the analysis server according to this embodiment. [Figure 9] This flowchart shows an example of a processing procedure performed by the equipment control device according to this embodiment in relation to noise suppression control during a meeting. [Figure 10] This flowchart shows an example of a processing procedure performed by the equipment control device according to this embodiment in relation to a pre-warning as noise suppression control. [Modes for carrying out the invention]

[0011] [Example of a noise reduction system configuration] Figure 1 shows an overall configuration example of the noise suppression system according to this embodiment. The noise suppression system according to this embodiment aims to suppress noise generated from the indoor RM by making the user U (the speaker) who participates in the meeting in the space as the indoor RM aware of speaking while suppressing the volume of the voice uttered for speaking. In the following description, as an example, the indoor RM is a conference room provided in a company's office building, and the case where a meeting is being held by the user U who is an employee is taken as an example.

[0012] In the indoor RM, a sound collection sensor 10, a device control device 100, a smart remote control 20, a smart power strip 30, devices 40-1, 40-2, 40-3, a monitor 40-4, and a user terminal 40-5 are provided. When there is no particular distinction between the devices 40-1, 40-2, 40-3, the monitor 40-4, and the user terminal 40-5, they are described as the device 40. The sound collection sensor 10 includes, for example, a microphone, collects sound in the indoor RM, and outputs sound data (sound collection data) obtained by the sound collection.

[0013] The smart remote control 20 controls the operation of the device 40-1 to be controlled by wirelessly outputting a control signal such as an IR signal. In the figure, an example where the device 40 controlled by the smart remote controller (hereinafter, the smart remote control) 20 is one is shown, but the device 40-1 controlled by the smart remote control 20 may be plural.

[0014] The smart remote control 20 is operable to transmit a command signal corresponding to the operation specified by the control data to the device 40-1 specified by the control data output by the device control device 100. The smart remote control 20 can be controlled to correspond to various electronic devices of various manufacturers, for example, by manufacturer settings, model settings, and the like. The smart remote control 20 and the device control device 100 may be wirelessly communicably connected by, for example, Bluetooth (registered trademark), wireless LAN, etc., or may be wired-connected by Ethernet, various data interfaces, etc.

[0015] The smart power strip 30 includes, for example, a power strip with a predetermined number of outlets, and can individually control the power supply to the devices 40 connected to the outlets. Any device 40-2 can be connected to the outlets of the smart power strip 30. In the figure, an example where there is one device 40 connected to the smart power strip 30 is shown, but the number of devices 40-2 that can be connected to the smart power strip 30 is not particularly limited as long as it is within the number of outlets provided on the power strip. The smart power strip 30 and the device control device 100 may also be wirelessly communicably connected by Bluetooth (registered trademark), wireless LAN, etc., or may be wired-connected by Ethernet, various data interfaces, etc.

[0016] The devices 40-1 and 40-2 are devices provided in the indoor RM and are controlled to perform a predetermined operation (noise suppression promotion operation) for the purpose of motivating the user U in the meeting to suppress the voice when speaking. The type of the devices as the devices 40-1 and 40-2 and specific examples of the operations according to the type of the devices will be described later. The device 40-! that the smart remote control 20 controls operates according to the control signal transmitted from the smart remote control 20. The device 40-2 connected to the smart power strip 30 operates by receiving power supply from the smart power strip 30, and stops operating when the smart power strip 30 stops the power supply.

[0017] Also, the device 40-3 is a device that can be communicably connected to the device control device 100 by wire or wirelessly, and can be controlled in operation by the device control device 100.

[0018] Furthermore, the figure shows an example in which a monitor 40-4, installed in the indoor RM for meetings, is connected to the equipment control device 100. In this way, the monitor 40-4 connected to the equipment control device 100 can also function as one of the devices 40 that the equipment control device 100 can control in response to noise reduction promotion. Furthermore, the figure shows an example in which user terminals 40-5, each brought into the room RM by user U for the meeting, are connected to the equipment control device 100 via the network hub HB, enabling communication. User terminals 40-5 connected to the equipment control device 100 in this way can also function as one of the devices 40 that the equipment control device 100 can control in response to noise reduction promotion.

[0019] The device control unit 100 acquires audio signal data (sound collection data) obtained by the sound collection sensor 10. The device control unit 100 monitors the sound level of the acquired sound collection data and, in response to the sound level exceeding a predetermined threshold, executes control (noise suppression control) to cause a predetermined device to perform a noise suppression promotion operation. In performing noise suppression control, the device control device 100 controls the smart remote control 20 to send a command signal to the device 40-1 to perform a predetermined noise suppression promotion operation when it wants the device 40-1, which is the target of the smart remote control 20, to perform a noise suppression promotion operation. Furthermore, when the device 40-2 connected to the smart outlet 30 is to perform a noise suppression promotion operation, the smart outlet 30 is controlled to start supplying power to the device 40 that is being controlled. Furthermore, if the controlled device 40 is a device 40-3, monitor 40-4, or user terminal 40-5 directly connected to the device control device 100, the device control device 100 may instruct these devices 40 to perform noise suppression promotion operations by communicating with the devices 40 (device 40-3, monitor 40-4, user terminal 40-5).

[0020] Furthermore, the equipment control device 100 is connected to the data storage server 200 via an external network outside the indoor RM. The equipment control device 100 transmits the sound collection data acquired from the sound collection sensor 10 to the data storage server 200. The data storage server 200 is a network storage device capable of storing various types of data as a database. The data storage server 200 stores the transmitted sound collection data. As a result, the data storage server 200 accumulates sound collection data collected by the indoor RM in the past. Although one indoor RM is shown in the figure, multiple indoor RMs having the configuration shown in the figure may be provided, for example, for each of the multiple conference rooms. In this case, the data storage server 200 can store the sound collection data transmitted from the equipment control device 100 in each of the multiple indoor RMs. In this case, the data storage server 200 can manage the stored sound collection data by associating it with each indoor RM.

[0021] Furthermore, the data storage server stores user information for each user U. The user information corresponding to a user may include, for example, basic information such as the user's name, department, and job title, as well as voiceprint data about that user.

[0022] The data storage server 200 is connected to the analysis server 300. The analysis server 300 analyzes past sound collection data stored in the data storage server 200. By analyzing the past sound collection data, the analysis server 300 can derive the noise generation situation for each room RM in the past. In this process, the analysis server 300 can use the voiceprint data in the user information stored in the data storage server 200 to identify which user U's voice is being recorded in the past sound collection data. Furthermore, based on this identification result, the analysis server 300 can obtain historical information (speaking user history information) about user U who spoke at a volume equivalent to noise in the past.

[0023] The device control unit 100 may perform noise suppression control based on speech user history information acquired from the analysis server 300. As noise suppression control based on speech user history information, for example, the device control unit 100 can control a predetermined device 40 to perform an action that prompts user U, who has made noise-related utterances at a certain frequency or higher in the past, to suppress the volume of their voice when uttering.

[0024] As shown in the figure, an information output terminal 400 may be connected to the analysis server 300. The information output terminal 400 can acquire speech user history information from the analysis server 300 and display the acquired speech user history information. The analysis server 300 may be an information terminal such as a personal computer provided as part of a company's equipment.

[0025] Furthermore, the equipment control device 100 is also connected to the schedule management server 500 via an external network outside the indoor RM. The schedule management server 500 is a server that manages the schedules of each user U who uses the indoor RM. User U can access the schedule management server 500 from their user terminal 40-5 and register their schedule. When user U uses a conference room that supports the indoor RM for a meeting or other event, the registered schedule will include the conference room to be used and the time slot for using the conference room.

[0026] Furthermore, the equipment control device 100 may acquire schedule data (schedule data) for each user U managed by the schedule management server 500 via communication with the schedule management server 500. The equipment control device 100 can use the acquired schedule data to control a predetermined piece of equipment 40 to perform noise suppression promotion operations in accordance with the use of the indoor RM (conference room) by a specific user U.

[0027] Alternatively, schedule data may be stored in the data storage server 200 via the equipment control device 100 from the schedule management server 500. By storing the schedule data in this way, the analysis server 300 can perform analysis using the schedule data as well.

[0028] [Example of equipment control system configuration] Figure 2 shows an example configuration of the device control unit 100. The functions of the device control unit 100 shown in the figure are realized by the execution of a program by the CPU (Central Processing Unit) that the device control unit 100 has as hardware. The device control unit 100 includes a communication unit 101, a control unit 102, and a storage unit 103.

[0029] The communication unit 101 communicates with the sound collection sensor 10, smart remote control 20, smart outlet 30, equipment 40-3, monitor 40-4, user terminal 40-5, data storage server 200, schedule management server 500, etc.

[0030] The control unit 102 performs control in the equipment control device 100. The control unit 102 includes a sound collection data acquisition unit 121, a noise determination unit 122, an equipment control unit 123, and a data registration unit 124. The sound collection data acquisition unit 121 acquires the sound collection data output by the sound collection sensor 10.

[0031] The noise determination unit 122 determines whether the sound in the acquired sound collection data is in a state equivalent to noise. Specifically, the noise determination unit 122 may determine whether the sound in the acquired sound collection data is in a state equivalent to noise based on whether the level (volume) of the sound in the acquired sound collection data is above a predetermined threshold. Furthermore, the threshold used to determine whether or not the audio data in the sound collection constitutes noise may be predetermined and fixed. Alternatively, for example, the control unit 102 in the equipment control device 100 may determine a threshold based on predetermined information (indoor environment information) indicating the environment of the corresponding indoor RM. The indoor environment information may include, for example, the volume of the space as an indoor RM, the sound insulation performance according to the materials such as wall materials, and the distance from other indoor RMs. For example, the control unit 102 may set the threshold higher the larger the volume, the higher the sound insulation performance of the materials, and the greater the distance from other indoor RMs.

[0032] The equipment control unit 123 performs noise suppression control. Noise suppression control is a control that causes a predetermined equipment 40 to perform noise suppression promotion operations.

[0033] The data registration unit 124 registers data with the data storage server 200. The data that the data registration unit 124 registers with the data storage server 200 may include sound collection data acquired from the sound collection sensor 10, schedule data acquired from the schedule management server 500, etc.

[0034] The memory unit 103 stores information related to the device control device 100. The memory unit 103 includes a device control information storage unit 131. The device control information storage unit 131 stores device control information. The device control information is information used to control the device 40.

[0035] Figure 3 shows an example of equipment control information stored in the equipment control information storage unit 131. The equipment control information indicates what the equipment control device 100 should control in order to obtain a predetermined noise suppression promotion operation that is determined in accordance with the indoor RM equipped with the corresponding equipment control device 100. The equipment control information is the information used to control the equipment 40 corresponding to the relevant location (indoor RM). The control information includes the operation details, control device ID, control device type, target equipment, and each of the respective fields.

[0036] The area containing the operation details information stores the operation details information. The operation details information describes what noise suppression promotion actions should be performed on the target equipment under what circumstances. Specifically, the operation information in the file named "0001.mvt" in the figure describes a sequence of operations that monitors the level of collected sound data in real time, and if the level of collected sound data exceeds a threshold, controls the smart outlet 30 to which the lamp is connected as a noise suppression promotion operation, so that the lamp, which is the target device, lights up in a predetermined lighting pattern. In this case, if the volume of a voice spoken by any of the users U during the meeting exceeds a threshold, a lamp installed in the room's RM (Responsive Monitor) lights up in a predetermined pattern. By seeing the lamp light up in this way, the users U during the meeting can realize that their voices are too loud and become more conscious of speaking at a lower volume. Furthermore, the operation information in the file named "0002.mvt" describes a noise suppression promotion operation that will issue a pre-warning at a timing corresponding to the start of the meeting (for example, 5 minutes before the start of the meeting). Specifically, the operation information in the file named "0002.mvt" describes that, at the timing corresponding to the start of the meeting, if there is a user U among the participants in the meeting who has, for example, spoken at a level equivalent to noise in the past within a certain period of time, a message will be output via the smart speaker instructing them to reduce the volume of their speech to a level that will not become noise during the meeting.

[0037] The Control Device ID field stores the Control Device ID that indicates the Control Device installed in the relevant location (Indoor RM). The Control Device is a device that controls the operation of Equipment 40. Specifically, the Control Devices are the Smart Remote Control 20 and the Smart Outlet 30. The Control Device Type area stores information indicating the type of control device indicated by the corresponding Control Device ID. Specifically, if the corresponding control device is a smart remote control 20, the Control Device Type area stores information indicating that it is a smart remote control; if the corresponding control device is a smart outlet 30, it stores information indicating that it is a remote outlet. However, if the device control device 100 communicates directly with the device 40 without controlling the control device to perform noise suppression promotion operations, then no valid information needs to be stored in the Control Device ID area and the Control Device Type area. The area for the target device stores information indicating the device 40 that the corresponding control device controls.

[0038] [Example of a data storage server configuration] Figure 4 shows an example configuration of the data storage server 200. The data storage server 200 comprises a communication unit 201, a control unit 202, and a storage unit 203. The functions of the data storage server 200 shown in the figure are realized by the CPU, which is provided as hardware in the data storage server 200, executing programs.

[0039] The communications unit 201 communicates with the data storage server 200 via the network.

[0040] The control unit 202 performs control of the data storage server 200. The control unit 202 manages the information stored in the storage unit 203. The control unit 202 causes the storage unit 203 to store information, reads the information stored in the storage unit 203 and transmits it to a predetermined external device.

[0041] The storage unit 203 stores information corresponding to the data storage server 200. The storage unit 203 includes a sound collection data storage unit 231, a user information storage unit 232, an analysis result information storage unit 233, and a schedule data storage unit 234.

[0042] The sound collection data storage unit 231 stores the sound collection data transmitted from the equipment control device 100. In other words, the sound collection data storage unit 231 stores sound collection data obtained by the sound collection sensor 10 in the indoor RM in the past.

[0043] Figure 5 shows an example of sound collection data stored by the sound collection data storage unit 231. The sound collection data includes the areas for the date and time of sound collection, the location, and the sound collection data file. The sound collection date and time field stores the date and time (sound collection date and time) when the sound from the corresponding sound collection data file was collected. The location area stores the location where the sound from the corresponding sound collection data file was collected. Alternatively, instead of the location, a sound collection sensor ID indicating the sound collection sensor 10 that collected the sound from the corresponding sound collection data file may be stored. In this case, the sound collection sensor ID corresponds to information indicating the location where the corresponding sound collection sensor 10 is installed. The sound collection data file area stores sound collection data files, which are sound files obtained by the sound collection sensor 10 at the corresponding location.

[0044] Let's return to the explanation in Figure 4. The user information storage unit 232 stores user information. Figure 6 shows an example of user information stored in the user information storage unit 232. User information corresponding to one user includes areas for user ID, voiceprint data, and user terminal information. The User ID field stores the User ID that identifies the corresponding user. The voiceprint data area stores the voiceprint data of the corresponding user. The voiceprint data may be generated based on the voice of the corresponding user, which has been collected in advance, and then stored in the user information. The user terminal information area stores the user terminal information of the corresponding user. The user terminal information may include the addresses of the corresponding user's user terminals 40-5.

[0045] Let's return to the explanation in Figure 4. The analysis result information storage unit 233 stores the analysis result information. The analysis result information is information that shows the analysis results of the sound collection data by the analysis unit 221. Figure 7 shows an example of analysis result information stored in the analysis result information storage unit 233. The analysis result information in this figure is structured to be associated with each user U. In other words, the analysis result information corresponding to user U has a structure in which user utterance history information is associated with the user ID. The user utterance history information is information related to utterances made by the corresponding user U in the past. Specifically, the user utterance history information may be information that shows the history of utterances made by the corresponding user U in the past at a volume equivalent to noise. User speech history information is information that reflects the results of analysis performed by the analysis server 300, for example, as described later.

[0046] Let's return to the explanation in Figure 4. The schedule data storage unit 234 stores the schedule data. The schedule data stored in the schedule data storage unit 234 may be obtained from the schedule management server 500.

[0047] [Example of analysis server configuration] Figure 8 shows an example configuration of the analysis server 300. The analysis server 300 comprises a communication unit 301 and an analysis unit 302. The communications unit 301 communicates with the data storage server 200 and the information output terminal 400 via the network. The analysis unit 321 acquires the sound collection data stored in the sound collection data storage unit 231 of the data storage server 200 and performs analysis on the acquired sound collection data. The analysis unit 321 stores analysis result information, which indicates the analysis results of the sound collection data, in the analysis result information storage unit 233 of the data storage server 200.

[0048] The analysis results information is user-specific information, as shown in Figure 7. The analysis results information corresponding to one user includes user utterance history information. The analysis unit 321 generates user utterance history information corresponding to one user by performing the analysis as follows, for example. The analysis unit 321 acquires one or more sound collection data points stored (accumulated) from the data storage server 200 for a certain period of time in the past, at a predetermined timing, as the target of analysis. The analysis unit 321 also acquires user information from the data storage server 200. The analysis unit 321 identifies the user of the voice contained in the sound of the sound data file of the acquired sound collection data. In this process, the analysis unit 321 extracts human speech from the sound of the sound data file and performs voiceprint analysis on each extracted voice. The analysis unit 321 identifies which user each voice spoken in the sound of each sound data file belongs to by comparing the voiceprint analyzed for each voice in the sound data file with the voiceprint corresponding to the user information for each user. For each identified user, the analysis unit 321 generates user speech history information that shows the time, location, and level (volume) of each voice spoken in chronological order. The analysis unit 321 sends the generated user speech history information for each user, associated with the user ID, to the data storage server 200. The data storage server 200 stores the received information as analysis result information in the analysis result information storage unit 233.

[0049] [Example of processing procedure] Referring to the flowchart in Figure 9, an example of a processing procedure related to noise suppression control performed by the equipment control device 100 of this embodiment based on sound collection data from the room RM during a meeting will be described. The processing in the figure can be viewed as following the operation description information of the equipment control information in the first line of Figure 3.

[0050] Step S100: In the equipment control device 100, the sound collection data acquisition unit 121 acquires sound collection data obtained from the sound collection sensor 10 of the room RM, which is currently holding a meeting.

[0051] Step S102: The noise determination unit 122 determines whether the sound level of the sound collected in step S100 is above a predetermined threshold. If the level of the collected sound data is determined to be below the threshold, it means that the voice level of user U participating in the meeting in the indoor RM does not correspond to noise. In this case, the process returns to step S100.

[0052] Step S104: If it is determined that the level of the collected sound data is above a threshold, it means that the level of the voice of user U participating in the meeting in the indoor RM is loud enough to be considered noise. Therefore, the equipment control unit 123 performs noise suppression control so that a predetermined noise suppression promotion operation is performed by a predetermined device 40 in the indoor RM. Specifically, in this case, the device control unit 123 refers to the device control information in the first row of Figure 3 from the device control information stored in the device control information storage unit 131. The device control unit 123, having referred to the device control information, controls the smart outlet 30, which is the control device for the target device, to perform on / off operations in a predetermined sequence. As a result, the lamp connected to the smart outlet 30 as the target device lights up in a predetermined lighting pattern as a noise suppression promotion operation.

[0053] Furthermore, in the process shown in the figure, for example, after noise suppression control is performed once by the process in step S104, if at some point in step S102 it is determined that the sound of the collected data is above a threshold, then noise suppression control will be performed again by step S104. In other words, under the process shown in the figure, if the volume of the voice of user U is not suppressed even after noise suppression control is performed, the noise suppression control by step S104 will be repeated. Therefore, the device control unit 123 may change the noise suppression promotion operation that device 40 performs depending on how many times the noise suppression control by step S104 has been executed. Specifically, when causing device 40, which acts as a lamp, to perform the noise suppression promotion operation as described above, the device control unit 123 may change the lamp lighting pattern so that the degree of warning increases as the number of times the process in step S104 progresses. Specifically, the device control unit 123 may control the lamp to blink more often as the number of times the process in step S104 progresses. Furthermore, the device control unit 123 may control the lamp's illumination color to change, for example, from green to yellow to red, each time the process in step S104 progresses.

[0054] Furthermore, the equipment control unit 123 may change the equipment 40 that performs the noise suppression promotion operation each time the process of step S104 progresses. In this case, the number of equipment 40 that performs the noise suppression promotion operation may be changed, or the combination of multiple equipment 40 may be changed, each time the process of step S104 progresses.

[0055] Referring to the flowchart in Figure 10, an example of the processing procedure when the equipment control device 100 of this embodiment issues a pre-warning to the user U as noise suppression control will be described. The processing in the figure can be seen as following the operation description information of the equipment control information in the second line of Figure 3.

[0056] Step S200: In the equipment control device 100, the equipment control unit 123 recognizes the schedule of a meeting to be held in the corresponding indoor RM based on the user-specific schedule data stored in the schedule management server 500. Then, the equipment control unit 123 waits until a predetermined time before the start of the meeting to be held in the indoor RM.

[0057] Step S202: When a predetermined time has passed since the start of the meeting, the equipment control unit 123 refers to the schedule data to identify the user U who will be participating in the meeting.

[0058] Step S204: The noise determination unit 122 obtains analysis result information corresponding to each user U identified in step S202 from the data storage server 200. In step S204, the noise determination unit 122 may obtain, for example, past analysis result information.

[0059] Step S206: The noise determination unit 122 determines, based on the analysis result information obtained in step S204, whether there is a user U among the users U identified in step S202 who has previously spoken at a level above the threshold corresponding to noise and is subject to a warning. The threshold used in this case may be set on an individual basis for each user U. Furthermore, a user U subject to a warning may be, for example, a user who spoke at a level above the threshold corresponding to noise in a meeting they previously attended, or a user who has spoken at a level above the threshold corresponding to noise over a certain period in the past. If it is determined in step S206 that there is no user U to whom a warning should be issued, the process in step S208, which will be described next, is skipped and the process shown in the figure is terminated.

[0060] Step S208: If it is determined in step S206 that a user U subject to a warning exists, the equipment control unit 123 executes noise suppression control according to the corresponding equipment control information. Specifically, the operation description information in the second line of the device control information in Figure 3 describes that the device 40, acting as a smart speaker, should output a message informing the user to lower the volume of their speech during the meeting. In this case, the device control unit 123 instructs the smart remote control 20, which is the remote control target for the device 40 acting as a smart speaker, to send a command signal to cause the smart speaker to output the above message.

[0061] When the process shown in the diagram is executed, the indoor RM (Remote Management) will output a voice message from the smart speaker to user U when it is a predetermined time before the start of the meeting. For example, "In the meeting that is about to begin, please refrain from speaking loudly to prevent noise." As a result, user U who is a meeting participant and has previously spoken loudly enough to be considered a warning user U will be more conscious of keeping their voice down when speaking during the meeting, thus achieving a noise reduction effect. Furthermore, the audio message output via the smart speaker can be heard by all users U participating in the meeting. Therefore, it is preferable that the content of the audio message be directed at all users U participating in the meeting, rather than only at the user who is being warned.

[0062] [Examples of noise reduction promotion actions for various types of equipment] Figure 9 above shows an example of a noise suppression promotion operation in which the device 40 as a lamp is illuminated in a predetermined lighting pattern. Figure 10 above shows an example of a noise suppression promotion operation in which the device 40 as a smart speaker is outputted a message voice. In this embodiment, the noise suppression promotion operation may be performed by devices 40 other than the lamp and smart speaker. Examples of noise suppression promotion operations by devices 40 other than the lamp and smart speaker will be described below.

[0063] For example, in step S104 of Figure 9 or step S208 of Figure 10, the equipment control unit 123 of the equipment control device 100 may perform a noise suppression promotion operation by displaying an operation on the monitor 40-4. In this case, the device control unit 123 may, as part of the process in step S104 of Figure 9, control the monitor 40-4 to display a message warning user U that the volume of their speech is too loud and that they should reduce the volume to prevent noise from disturbing surrounding rooms. Furthermore, the device control unit 123 may, as part of the process in step S208 of Figure 10, control the monitor 40-4 to display a message warning user U to lower the volume of their voice during the upcoming meeting to prevent noise from disturbing surrounding rooms, etc., a predetermined time before the start of the meeting. In this case, the equipment control information storage unit 131 stores equipment control information that describes the monitor 40-4 to perform noise suppression promotion operations as described above, and the equipment control unit 123 is configured to refer to the stored equipment control information.

[0064] Furthermore, the device control unit 123 may, as part of the process in step S104 of Figure 9, control the display of a warning message to each user U participating in the meeting on their user terminal 40-5, instructing them to lower the volume of their voice. Furthermore, as part of the process in step S208 of Figure 10, the equipment control unit 123 may control the system so that, a predetermined time before the start of the meeting, a message is displayed on the user terminals 40-5 of each user U participating in the meeting, warning the user U to lower the volume of their voice so as not to cause noise in surrounding rooms during the upcoming meeting. Also, since the user terminals 40-5 are used individually by each user U, as part of the process in step S208 of Figure 10, the equipment control unit 123 may control the system so that the message is displayed only on the user terminals 40-5 of the user U identified in step S206 as the target of the warning. In this case as well, the device control information storage unit 131 stores device control information that describes the user terminal 40-5 to perform noise suppression promotion operations as described above, and the device control unit 123 is configured to refer to the stored device control information.

[0065] Furthermore, for example, in step S104 of Figure 9, as a noise suppression promotion action, the lighting device of the indoor RM may be made to blink in a predetermined pattern. If the lighting device suddenly blinks while speaking in the meeting, users U etc. will realize that the voices they were speaking were loud, and this will encourage them to speak at a lower volume. In this case, the device control information storage unit 131 may store device control information in which the control device is a smart remote control 20, the target device is a lighting device, and the operation description information describes blinking the lighting device in a predetermined pattern. The device control unit 123 may refer to such device control information and control the smart remote control 20 so that the smart remote control 20 can send a command signal to blink the lighting device in a predetermined pattern.

[0066] Furthermore, the device 40 that performs the noise suppression promotion operation may be installed in the indoor RM and, when it operates, may create an unexpected situation in the indoor RM that is different from normal. For example, in response to the noise suppression control by step S104 in Figure 9, a vacuum cleaner, which is equipment provided in the indoor RM, may be operated for a predetermined time. Such control of the vacuum cleaner can be achieved by the device control unit 123 controlling the smart remote control 20 or the smart outlet 30 to which the vacuum cleaner is connected. In this case, the room's RM vacuum cleaner will activate and make a loud noise in response to User U's voice exceeding a threshold during the meeting. Because User U and others hear the vacuum cleaner activate unexpectedly during the meeting, they will realize their voices were too loud and become more conscious of speaking at a lower volume. Furthermore, the device 40 that performs the noise suppression promotion action may be a cooking appliance such as a microwave oven installed in the room RM. In this case, when the voice of user U becomes loud enough to exceed a threshold during the meeting, the microwave oven in the room RM will start heating for a certain period of time without any warning, allowing user U to become aware that their voice is loud and to become conscious of suppressing their speech. As can be understood from this explanation, in this embodiment, it is possible to make the device 40 perform noise suppression promotion operations using the smart remote control 20 or the smart outlet 30. As a result, in this embodiment, in the indoor RM, it is possible to easily use any of the devices 40 controlled by the smart remote control 20 or the devices 40 connected to the smart outlet 30 to perform noise suppression promotion operations.

[0067] Furthermore, the device control unit 100 may, based on the analysis result information stored in the data storage server 200, identify a user U who has made a number of utterances at a noise level equivalent to a certain volume in the past (for example, the past month) that is greater than or equal to a predetermined number, and send feedback generated based on the analysis result information for the past period to the identified user U's user terminal 40-5. The feedback may include information indicating, for example, when the user made a utterance at a noise level equivalent to a certain volume in a meeting they previously participated in.

[0068] Furthermore, the analysis server 300 may, as appropriate, transmit information indicating the analysis results regarding the user utterance history information to the information output terminal 400. The information output terminal 400 may output the received analysis results information by displaying it or by other means.

[0069] Furthermore, the predetermined functions provided in the device control unit 100, data storage server 200, analysis server 300, and schedule management server 500 described above may also be provided in other devices and servers. For example, the analysis server 300 may have the function of a noise determination unit 122, enabling the identification of users U who were previously subject to warnings as a result of analyzing user speech history information. In addition, the functions of any of the data storage server 200, analysis server 300, and schedule management server 500 may be divided among multiple servers. Furthermore, the functions of two or more of the data storage server 200, analysis server 300, and schedule management server 500 may be integrated into a single server.

[0070] Furthermore, the processing of each device described above may be performed by recording a program for realizing the functions of each device in the noise suppression system described above onto a computer-readable recording medium, loading the program recorded on this recording medium into a computer system, and executing it. Here, "loading the program recorded on the recording medium into a computer system and executing it" includes installing the program into the computer system. Here, "computer system" includes hardware such as the OS and peripheral devices. Also, "computer system" may include multiple computer devices connected via a network including communication lines such as the Internet, WAN, LAN, and dedicated lines. Also, "computer-readable recording medium" refers to portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, and storage devices such as hard disks built into the computer system. Thus, the recording medium storing the program may also be a non-transient recording medium such as a CD-ROM. Also, the recording medium includes internal or external recording media that can be accessed from the distribution server for the purpose of distributing the program. The program code stored on the distribution server's recording medium may be different from the program code in a format executable on the terminal device. In other words, the format in which it is stored on the distribution server is irrelevant as long as it can be downloaded from the distribution server and installed in a format executable on the terminal device. Furthermore, the program may be divided into multiple parts, each downloaded at a different time and then combined on the terminal device, and each divided program may be distributed by a different distribution server. In addition, "computer-readable recording medium" includes volatile memory (RAM) within computer systems that act as servers or clients when a program is transmitted over a network, which retains the program for a certain period of time. Moreover, the above program may be intended to implement only a part of the functions described above. Furthermore, it may be a so-called differential file (differential program) that can implement the above functions in combination with a program already recorded in the computer system. [Explanation of Symbols]

[0071] 10 Sound collection sensor, 20 Smart remote control, 30 Smart outlet, 40 (40-1, 40-2, 40-3) Equipment, 40-4 Monitor, 40-5 User terminal, 100 Equipment control device, 101 Communication unit, 102 Control unit, 103 Storage unit, 121 Sound collection data acquisition unit, 122 Noise determination unit, 123 Equipment control unit, 124 Data registration unit, 131 Equipment control information storage unit, 200 Data storage server, 201 Communication unit, 202 Control unit, 203 Storage unit, 221 Analysis unit, 231 Sound collection data storage unit, 232 User information storage unit, 233 Analysis result information storage unit, 234 Schedule data storage unit, 300 Analysis server, 301 Communication unit, 302 Analysis unit, 321 Analysis unit, 400 Information output terminal, 500 Schedule management server

Claims

1. A sound collection data acquisition unit acquires sound collection data obtained by sound collection sensors installed in the target space, A noise determination unit that determines whether the sound in the sound data acquired by the sound data acquisition unit corresponds to noise, In response to the noise determination unit determining that a state equivalent to noise has been determined, a control unit capable of controlling a control device provided in the target space, which is capable of controlling the operation of the equipment, controls the equipment so that a predetermined piece of equipment provided in the target space performs a predetermined noise suppression promotion operation corresponding to raising awareness of speech voice suppression in the user. A schedule management server that manages users' schedules, An analysis unit identifies the voice of each user contained in the sound of past sound collection data based on past sound collection data, user voiceprint data, and the user's schedule managed by the schedule management server. Equipped with, The noise determination unit identifies users who have previously emitted noise-level sounds based on the voice of each user identified by the analysis unit, and is subject to a warning. The device control unit controls the device to perform the noise suppression promotion operation according to the result of identifying the user to be warned, and changes the noise suppression promotion operation to be performed by the device according to the number of times the noise suppression promotion operation has been performed. Noise reduction system.

2. The control device is a remote controller that controls the operation of the equipment by wirelessly transmitting operation instruction signals. The noise suppression system according to claim 1.

3. The control device is a power supply device capable of switching between supplying and stopping power to the equipment. The noise suppression system according to claim 1 or 2.

4. The equipment control unit is capable of controlling the equipment to perform a predetermined noise suppression promotion operation through communication with the equipment, without the need for control by the control device. A noise suppression system according to any one of claims 1 to 3.

5. A sound collection data acquisition step involves acquiring sound collection data obtained by sound collection sensors installed in the target space, A noise determination step is to determine whether the sound in the sound data acquired by the sound data acquisition step corresponds to noise, In response to the noise determination step determining that a state equivalent to noise is present, a control device control step is provided in the target space that can control the operation of the equipment, so that a predetermined piece of equipment provided in the target space performs a predetermined noise suppression promotion operation corresponding to raising awareness of speech voice suppression in the user. An analysis step to identify the voice of each user contained in the sound of past sound collection data, based on past sound collection data, user voiceprint data, and user schedules managed on a schedule management server. Includes, The noise determination step identifies users who have previously emitted noise-level sounds based on the voices of each user identified by the analysis step, and who are subject to a warning. The device control step controls the device to perform a predetermined noise suppression promotion action in accordance with the result of identifying the user to be warned, and changes the noise suppression promotion action to be performed by the device in accordance with the number of times the noise suppression promotion action has been performed. Noise reduction methods.

6. The computer provided in the noise suppression system A sound collection data acquisition unit that acquires sound collection data obtained by sound collection sensors installed in the target space. A noise determination unit determines whether the sound in the sound collection data acquired by the sound collection data acquisition unit corresponds to noise. In response to the noise determination unit determining that a state equivalent to noise has been determined, a control unit capable of controlling a control device provided in the target space, which is capable of controlling the operation of the equipment, controls the control device provided in the target space, so that a predetermined piece of equipment provided in the target space performs a predetermined noise suppression promotion operation corresponding to raising awareness of the user's speech suppression. An analysis unit identifies the voice of each user contained in the past sound collection data, based on past sound collection data, user voiceprint data, and the user's schedule managed on the schedule management server. It is a program designed to function as such. The noise determination unit identifies users who have previously emitted noise-level sounds based on the voice of each user identified by the analysis unit, and is subject to a warning. The device control unit controls the device to perform a predetermined noise suppression promotion action in accordance with the identification result of the user to be warned, and changes the noise suppression promotion action to be performed by the device in accordance with the number of times the noise suppression promotion action has been performed. program.

Images