Loudspeaker system for improving the loudspeaker experience

Abstract

To provide an acoustic test system that can provide a more desirable experience of voice amplification to a viewer in a loudspeaker space.SOLUTION: In a loudspeaker system 1, a voice amplification device 11 includes an input system, a processing system, and an output system, and detects a current value on a transmission route from the input system to the output system via the processing system at the time of a loudspeaker broadcast. The voice amplification device 11 is connected to a data management server 20 via the Internet, and the data management server restores the detected current value as a voice signal, and sends the restored voice signal to an external client connected to the data management server 20 via the Internet.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a voice amplification system for improving the voice amplification experience in a voice amplification space.

Background Art

[0002] Conventionally, there is a voice amplification system for delivering voice information to people staying or passing through a predetermined space. The voice amplification system includes one or more voice amplification devices such as an audio amplifier and a speaker, and outputs and amplifies voice in a space (voice amplification space) where the voice amplification device is installed. The voice amplification system is provided in various spaces visited by an unspecified or specified number of people, such as in the street, at a station of public transportation, in public facilities such as parks, stores, office buildings, factories, etc., and is also called a public address system.

[0003] Generally, the voice amplification system holds voice data related to a predetermined sound source such as BGM and plays back the voice data according to a schedule (scheduled broadcast), or plays back and broadcasts voice data related to the voice of a speaker input from a microphone. Examples of the voice amplification system are disclosed in Patent Documents 1 to 3. In such a voice amplification system, it is common to transmit an analog voice signal via a speaker line also called a 100V line, but it is also becoming popular to transmit a digitized voice signal via an Ethernet cable (LAN cable) compliant with the IEEE802 standard. In a voice amplification system using an Ethernet cable, more detailed voice amplification broadcast can be performed using an IP speaker that can be individually identified by an IP address.

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0004] An object of the present invention is to provide a voice amplification system that can provide a preferable voice amplification experience to listeners in a voice amplification space.

Means for Solving the Problem

[0005] In a voice amplification device having an input system, a processing system, and an output system, an acoustic test system detects a current value on a transmission path from the input system through the processing system to the output system during voice amplification broadcast, restores the detected current value as a voice signal on a server connected to the voice amplification device via the Internet, and provides the restored voice signal to an external client connected to the server via the Internet.

Effect of the Invention

[0006] According to the present invention,

Brief Description of the Drawings

[0007]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Best Mode for Carrying Out the Invention

[0008] Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 shows a voice amplification system 1 according to the embodiment. The voice amplification system 1 includes one or more voice devices 11 provided in a voice amplification space 10. Each voice device 11 includes an audio amplifier and a speaker, amplifies the voice obtained by reproducing audio data, and outputs it from the speaker. As an example, the voice device 11 uses the audio data held in a recording medium such as a CD (Compact Disc), SD card, HDD (Hard Disk Drive), SSD (Solid State Drive) as a sound source and reproduces the audio data. As an example, the voice device 11 has a microphone, generates and reproduces voice data from the voice of a speaker input from the microphone as a sound source. The voice amplification space 10 is an area having a certain size where the voice device 11 is installed and amplified by the voice device 11. An example of the voice amplification space 10 is an outdoor predetermined area in the middle of the street (for example, a park, a square, an intersection, etc.), a predetermined indoor and outdoor area managed by a predetermined administrator (a stadium, each floor of a shopping mall, each floor of an office building, a school, a research institution, a government office building, a factory, etc.), and the like.

[0009] The sound reinforcement space 10 includes one or more cameras 12 for acquiring the situation of the sound reinforcement space 10 as video data. An example of the camera 12 is a surveillance camera installed in the sound reinforcement space 10 together with the sound reinforcement device 11. An example of the camera 12 is a camera mounted on an unmanned flying object such as a UAV (Unmanned Aerial Vehicle) or a drone programmed to fly within the sound reinforcement space 10. For example, when the sound reinforcement space 10 is an intersection, the camera 12 may be a surveillance camera installed on a pole or the like on the road to monitor the intersection. For example, when the sound reinforcement space 10 is inside a building such as a shopping mall, the camera 12 may be a surveillance camera installed on the ceiling or the like of the building. The camera 12 can individually perform driving for shooting such as panning, tilting, and zooming one by one, shoot a subject within the sound reinforcement space 10 to generate video data, and hold it in an internal recording medium or transmit it externally. The camera 12 can perform driving for shooting such as panning, tilting, and zooming in conjunction with the sound reinforcement broadcast operation of the sound reinforcement device 11, shoot a subject to generate video data, and hold it in an internal recording medium or transmit it externally.

[0010] The sound reinforcement space 10 includes one or more microphones 13 for acquiring the situation of the sound reinforcement space 10 as audio data. An example of the microphone 13 is a microphone installed in the sound reinforcement space 10 together with the sound reinforcement device 11. For example, when the sound reinforcement space 10 is outdoors such as a park or an intersection, the microphone 13 may be a microphone installed on a support such as a utility pole. For example, when the sound reinforcement space 10 is inside a building such as a shopping mall, the microphone 13 may be a microphone installed on a structure such as a wall surface, a pillar, or a ceiling of the building. The microphone 13 has a sound collection direction directed into the sound reinforcement space 10, can collect the sound within the sound reinforcement space 10 to generate audio data, and hold it in an internal storage medium or transmit it externally. The microphone 13 can collect sound to generate audio data in conjunction with the sound reinforcement broadcast operation of the sound reinforcement device 11, and hold it in an internal storage medium or transmit it externally.

[0011] The voice amplification space 10 includes a mobile communication terminal 15 possessed by a person 14 (user 14) who is a listener within the voice amplification space 10 and listens to the voice amplification broadcast from the voice amplification device 11. An example of the mobile communication terminal 15 is a terminal such as a mobile phone or a smartphone that can be connected to the Internet through cellular communication such as LTE (Long Term Evolution) or 5G, or LAN (Local Area Network) communication such as Wi-Fi.

[0012] The voice amplification system 1 includes a data management server 20 that can be accessed from a client via the Internet. The voice amplification device 11, the camera 12, the microphone 13, and the mobile communication terminal 15 can each access the data management server 20 via the Internet. As shown in FIG. 1, in the voice amplification system 1, there are a plurality of voice amplification spaces 10, and the data management server 20 is interconnected with the voice amplification device 11, the camera 12, the microphone 13, and the mobile communication terminal 15 within each voice amplification space 10 via the Internet.

[0013] FIG. 2 shows an example of the configuration of the voice amplification device 11. The voice amplification device 11 includes an input system 110, a processing system 111, an output system 112, and a communication system 113. The processing system 111 is interconnected with each of the input system 110, the output system 112, and the communication system 113 using a priority interface such as a cable or a wireless interface. The input system 110 is a subsystem that receives the input of the voice to be amplified and broadcast from the voice amplification device 11. The input system 110 includes, for example, a microphone 110a and a BGM device 110b. The microphone 110a is equipped with a microphone element such as a dynamic microphone or a condenser microphone, and outputs the voice of the speaker as a voice signal. The BGM device 110b plays back a sound source (voice data) recorded on a recording medium such as a CD, SD card, HDD, or SSD, and outputs it as a voice signal.

[0014] The processing system 111 is a subsystem that receives an audio signal from the input system 110, performs processing such as changing the frequency characteristics and amplifying the audio signal to generate a broadcast signal for public address broadcasting, and outputs it to the output system 111. The processing system 111 includes an equalizer 111a that changes the frequency identification of the audio signal according to the setting for each frequency band, and an audio power amplifier 111b that amplifies the audio signal according to the volume setting.

[0015] The output system 112 is a subsystem that receives a broadcast signal (audio signal) from the processing system 111 and outputs the broadcast signal. The output system 112 includes one or more speakers 112a located at various places within the public address space 10, and each speaker 112a outputs the broadcast signal.

[0016] When the output system 112 includes a plurality of speakers 112a, the processing system 111 can perform routing setting of the broadcast signal as to which speaker 112a the broadcast signal is to be output from. The processing system 111 performs the routing setting and outputs the broadcast signal to the specified one or more speakers 112a with respect to the broadcast signal 112a. For example, each speaker 112a is assigned identification information (e.g., IP address) that uniquely identifies itself, and the processing system 111 specifies the identification information of the one or more speakers 112a to be broadcast in the routing setting.

[0017] The communication system 113 transmits and receives data to and from the data management server 20 via the Internet network. The communication system 113 is connected to the processing system 111, receives information regarding the processing performed by the processing system 111, transmits it to the data management server 20 via the Internet network, and on the other hand, receives information regarding the processing of the processing system 111 from the data management server 20 and passes the information to the processing system 111. The amplification device 11 has identification information (amplification device identification information) that uniquely identifies itself, and the communication system 113 transmits data to the data management server 20 with the identification information attached. For example, the amplification device identification information is an IP address assigned to the amplification device 11. For example, the amplification device 11 is equipped with a positioning system using GNSS (Global Navigation Satellite System) such as GPS (Global Positioning System), and the amplification device identification information is position information such as longitude and latitude obtained by the positioning system. For example, the amplification device 11 is equipped with an indoor positioning system using a beacon signal using Bluetooth or the like, RFID (Radio Frequency IDentification), ultrasonic waves, geomagnetism, UWB (Ultra Wide Band) signal, etc., and the amplification device identification information is indoor position information obtained by the indoor positioning system. For example, the amplification device 11 has a SIM (Subsriber Identity Module) and performs cellular communication using LTE or the like, and the amplification device identification information is identification information such as ICCID (Integrated Circuit Card ID) that identifies the SIM, IMSI (International Mobile Subscriber Identity) registered in the SIM, or IMEI (International Mobile Equipment Identity) registered in the SIM. The communication system 113 transmits data to the data management server 20 with the amplification device identification information attached.

[0018] When a plurality of voice amplifying devices 11 are installed within the same voice amplification space 10, the communication system 113 may be disconnected from the voice amplifying devices 11 and configured such that all the voice amplifying devices 111 are connected to a common communication system 113. In this case, as shown in FIG. 3, within the voice amplification space 10, the plurality of voice amplifying devices 11 are connected to a common communication system 113. The communication system 113 exists as a communication device having an independent housing as hardware separate from the voice amplifying devices 11. The communication system 113 is connected to each voice amplifying device 11 via a communication interface such as a LAN cable. The communication system 113 communicates with the processing system 111 of each voice amplifying device 11, transmits the data received from the processing system 111 to the data management server 20, and on the other hand, delivers the data received from the data management server 20 to the processing system 111. The communication system 113 receives voice amplifying device identification information from each voice amplifying device 11, attaches the voice amplifying device identification information, and transmits the data to the data management server 20, thereby identifying which voice amplifying device 11 within the voice amplification space 10 the data is from and transmitting the data to the data management server 20. Also, as shown in FIG. 3, since all the voice amplifying devices 11 are aggregated and connected to a common communication system 113, the communication system 113 has a one-to-one relationship with the voice amplification space 10, and identifying the communication system 113 means identifying the voice amplification space 10. For this reason, the communication system 113 has identification information (communication system identification information) for uniquely identifying itself, and when transmitting data to the data management server 20 with the communication system identification information attached, it identifies which voice amplification space 10 the data is from and transmits the data to the data management server 20. For example, the communication system identification information is an IP address assigned to the communication system 113. For example, the communication system 113 is equipped with a positioning system using GNSS such as GPS, and the communication system identification information is position information such as longitude and latitude obtained by the positioning system. For example, the communication system 113 is equipped with an indoor positioning system using a beacon signal using Bluetooth or the like, RFID, ultrasonic waves, geomagnetism, UWB signal, etc., and the communication system identification information is indoor position information obtained by the indoor positioning system.For example, the communication system 113 is a cellular router that has a SIM and performs cellular communication using LTE or the like, and the communication system identification information is identification information such as an ICCID that identifies the SIM, an IMSI registered in the SIM, or an IMEI registered in the SIM.

[0019] The camera 12 is an imaging device including an imaging element such as a CCD image sensor or a CMOS image sensor, and the imaging direction is directed in a direction where a part or all of the outside of the housing of the camera 12 and within the sound amplification space 10 where the camera 12 is installed is reflected. The camera 12 is connected to the Internet through a LAN such as Wi-Fi or through cellular communication, and performs data communication with the data management server 20. The camera 12 transmits the video data of the captured video to the data management server 20, and on the other hand, performs control based on the data received from the data management server 20.

[0020] The microphone 13 is provided with a microphone element such as a dynamic microphone or a condenser microphone, and is directed in a direction where sound within the sound amplification space 10 outside the housing of the microphone 13 and where the microphone 13 is installed can be picked up. The microphone 13 is connected to the Internet through a LAN such as Wi-Fi or through cellular communication, and performs data communication with the data management server 20. The microphone 13 transmits the audio data of the picked-up sound to the data management server 20, and on the other hand, performs control based on the data received from the data management server 20.

[0021] The mobile communication terminal 15 has an OS (Operating System) and applications installed. The applications include, for example, a web browser. The mobile communication terminal 15 includes a display unit including an LCD (Liquid Crystal Display), an organic EL display, etc. The mobile communication terminal 15 includes an input unit including a keypad, a keyboard, a mouse, etc. The mobile communication terminal 15 may include a touch screen in which the display unit and the input unit are integrated to display information and receive touch input operations. The mobile communication terminal 15 connects to the Internet through a LAN such as Wi-Fi or through cellular communication, and performs data communication with the data management server 20. The mobile communication terminal 15 transmits information regarding a user operation received from the input unit to the data management server 20 through an application, and on the other hand, performs control based on the data received from the data management server 20.

[0022] The data management server 20 is a web server that performs data communication with a client via the Internet and provides web services to the client. The clients include the voice amplifier 11, the camera 12, the microphone 13, and the mobile communication terminal 15.

[0023] (Web Service: Monitoring Service for Voice Amplifier 11) An example of a web service is the monitoring service of the public address device 11. FIG. 4 is a flowchart showing an example of the monitoring service. The public address device 11 always transmits information regarding the public address broadcast status (public address status information) to the data management server 20 via the communication system 113 at predetermined time intervals (S10). The data management server 20 receives the public address status information from the public address device 11 at any time (S11), stores it (S12), and provides it to an external client (S13). Thereby, the visualization of the public address status of the public address device 11 can be realized. The public address status information transmitted by the public address device 11 in S11 is, as an example, setting information set by the processing system 111. For example, the public address status information is setting information for the equalizer 111a to change the frequency characteristics of the audio signal, or volume setting information for the audio power amplifier 111b to amplify the audio signal. Further, as shown in FIG. 5, the public address device 11 includes monitoring means (sensors) for monitoring the operating status of the public address device 11 and the internal status of the public address device 11, and the public address status information may include measurement values obtained by the sensors. As shown in FIG. 5, as an example, the public address device 11 includes a temperature sensor 120 that always measures the temperature inside the public address device 11, particularly the temperature of the processing system 111, at predetermined time intervals. As an example, the public address device 11 includes an ammeter 121 that detects a broadcast signal (audio signal) as a current value. The ammeter 121 is provided on the transmission path that transmits the broadcast signal from the input system 110 through the processing system 111 to the output system 112, and measures the current value of the broadcast signal flowing through this transmission path. An example of the ammeter 121 is a current clamp provided outside the cable that transmits the broadcast signal from the input system 110 through the processing system 111 to the output system 112. In the example illustrated in FIG. 5, the ammeter 121 is provided on the transmission path connecting the amplifier 111b of the processing system 111 and the speaker 112a of the output system 112. The ammeter 121 continuously measures the current value at predetermined time intervals, and the continuous current values obtained thereby correspond to the waveform of the broadcast signal. Further, the public address status information may include sound source information indicating the sound source when the public address broadcast is performed.For example, the sound source information indicates which sound source (e.g., microphone 110a or BGM device 110b) within the input system 110 has broadcast, that is, which sound source's audio output has been processed by the processing system 111 and output to the output system 112. For example, as shown in FIG. 5, the public address device 11 includes a character conversion (Speech to Text) unit 122 that converts the input audio of the microphone 110a into text using speech recognition technology, and it is the character information generated by the character conversion unit 122. The character conversion unit 122 converts the audio signal input from the microphone 110a into audio data and generates a character string corresponding to the audio by performing speech recognition.

[0024] The data management server 20 includes a recording medium such as an HDD or an SSD, and in S12, it accumulates the received public address status information in the recording medium. As an example, the data management server 20 accumulates the sequentially received public address status information in the form of a log with its own history. FIG. 6 shows an example of a log 21 held by the data management server 20. As shown in FIG. 6(a), the log 21 includes a temperature log 21a, a setting log 21b, and a broadcast log 21c. The temperature log 21a is a log of measured values (temperatures) continuously received from the temperature sensor 120 at predetermined time intervals. The setting log 21b is a log of setting information for the equalizer 111a and the audio power amplifier 111b. The broadcast log 21c is a log during the period when the public address device 11 is performing a public address broadcast, and it includes measured values output by the ammeter 121 based on the input audio of the input system 111 and character information generated by the character conversion unit 122. As shown in FIG. 6(b), the temperature log 21a and the setting log 21b may be continuously generated and accumulated regardless of whether the public address device 11 is performing a public address broadcast, and the broadcast log 21c may be generated and accumulated during the public address broadcast.

[0025] Figs. 7(a) and 7(b) show an example of the broadcast log 21c. When the voice amplifier 11 amplifies and broadcasts the voice input from the microphone 110a, for example, it transmits the time information indicating the time from the start to the end of the broadcast, the sound source type information indicating that the broadcast sound source is a microphone, the character information generated by the character conversion unit 122 based on the voice input to the microphone 110a from the start to the end of the broadcast, and the information of the continuous current values output by the ammeter 121 from the start to the end of the broadcast to the data management server 20 as the voice amplification status information. In this case, as shown in Fig. 7(a), the log 21c includes the broadcast time indicated by the time information, the sound source type indicated by the sound source type information, the broadcast content indicated by the character information, and the voice waveform indicated by the continuous current values. When the voice amplifier 11 amplifies and broadcasts the voice reproduced by the BGM device 110b, for example, it transmits the time information indicating the time from the start to the end of the broadcast, the sound source type information indicating that the broadcast sound source is a BGM device, the name information indicating the name of the sound source reproduced by the BGM device 110b from the start to the end of the broadcast (for example, the file name of the reproduced voice file), and the information of the continuous current values output by the ammeter 121 from the start to the end of the broadcast to the data management server 20 as the voice amplification status information. In this case, as shown in Fig. 7(b), the log 21c includes the broadcast time indicated by the time information, the sound source type indicated by the sound source type information, the sound source name indicated by the name information, and the voice waveform indicated by the continuous current values.

[0026] In S13, the data management server 20 receives access from the client via the Internet network and provides the log 21 to the client so that it can be reproduced on the client side. For example, the data management server 20 generates an HTML (HyperText Markup Language) file for displaying the log 21, transmits the HTML file to the client, and enables the client to open the HTML file with a browser and display the log 21c.

[0027] The voice amplification device 11 holds position information indicating the location and position where the device itself is installed, and transmits the position information together with the voice amplification status information to the data management server 20. The position information may be added to the voice amplification status information and transmitted simultaneously, or may be transmitted separately from the voice amplification status information. The data management server 20 receives the voice amplification status information and the position information from a plurality of voice amplification devices 11 (S11), and generates and stores a log 21 in association with the position information for each voice amplification device 11 (S12). The data management server 20 generates an HTML file that displays the position of the voice amplification device 11 as a GUI according to the position information of each voice amplification device 11, and transmits the HTML file to the client (S13). An example of the GUI is, as shown in FIG. 8, a GUI in which icons 22 of each voice amplification device 11 are arranged at corresponding positions on the map based on the position information of each voice amplification device 11 on a map of the area including the position of the voice amplification device 11. The data management server 20 receives a selection operation of an arbitrary icon 22 from the client, and transmits an HTML file for displaying the log 21 of the voice amplification device 11 corresponding to the selected icon 22 to the client (S13).

[0028] Also, in S13, the data management server 20 may provide the voice waveform included in the log 21c as a voice stream to the client so that the client can listen to the voice. In this case, the data management server 20 encodes the voice waveform, which is a continuous current value, to generate voice data, and uses a streaming protocol such as HLS (HTTP Live Streaming), DASH (Dynamic Adaptive Streaming over HTTP), or RTSP (Real Time Streaming Protocol) to generate a voice stream and transmit it to the client (S13). The client plays and outputs the voice stream on an application such as a browser corresponding to the streaming protocol. When the data management server 20 receives the selection of the voice amplification device 11 on the GUI as shown in FIG. 8, it may transmit to the client a voice stream related to the voice waveform included in the log 21c of the voice amplification device 11 corresponding to the selected icon 22. Since the voice waveform included in the log 21c is the waveform of the voice broadcast by the voice amplification device 11 and is the waveform of the voice signal that actually flowed through the transmission path from the input system 110 to the output system 112, by playing the voice related to this voice waveform, the user can listen to and confirm on the client side the voice that would have been broadcast from the voice amplification device 11 to the voice amplification space 10.

[0029] As described above, by accumulating the status of the voice amplification device 11 as a log in the data management server 20, the status of the voice amplification device 11 can be monitored through a client accessible to the data management server 20. In this way, by being able to monitor the status of the voice amplification device 11, the user (the operation administrator of the voice amplification device 11) can review various settings and operation methods of the voice amplification device 11 while observing the status, and can provide a more preferable voice amplification experience for the listeners in the voice amplification space.

[0030] (Web Service: Measurement of the Effect of Voice Amplification Broadcast) As an example of a web service, in addition to monitoring the status of the public address device 11, the data management server 20 provides a visualization of the public address broadcast effect, which shows what effects have occurred as a result of the public address broadcast performed by the public address device 11 within the public address area 10. FIG. 9 is a flowchart showing an example of a service for visualizing the public address broadcast effect. The camera 12 transmits video data of the captured video to the data management server 20 during a period (reaction expectation period) when it is expected that listeners within the public address space 10 will react to the public address broadcast performed by at least the public address device 11 (S20). The microphone 13 transmits video data of the input audio to the data management server 20 during a period (reaction expectation period) when it is expected that listeners within the public address space 10 will react to the public address broadcast performed by at least the public address device 11 (S21). The mobile communication terminal 15 transmits predetermined data input by the user from the input unit of the mobile communication terminal 15 to the data management server 20 during a period (reaction expectation period) when it is expected that listeners within the public address space 10 will react to the public address broadcast performed by at least the public address device 11 (S22). The data management server 20 receives video data, audio data, and predetermined data from the camera 12, the microphone 13, and the mobile communication terminal 15, respectively (S23), and accumulates these data as public address reaction information (S24). The data management server 20 provides the accumulated data to an external client (S25).

[0031] The reaction expected period in S20 to S22 is a period during which it can be expected that when a listener in the voice amplification space 10 hears the voice amplification broadcast from the voice amplification device 11 and reacts, the reaction will appear. In other words, it is a period during which the presence or absence of a listener with respect to the voice amplification broadcast can be determined. An example of the reaction expected period is, as shown in Fig. 10(a), a period that includes the voice amplification broadcast period during which the voice amplification device 11 is performing a voice amplification broadcast, and up to a certain time T1 after the voice amplification broadcast ends. This is based on the idea that after the voice amplification broadcast starts, the listener's reaction will start after a while, and the listener will continue to perform reaction actions for a certain time after the voice amplification broadcast ends. An example of the reaction expected period is, as shown in Fig. 10(b), a period that does not include the voice amplification broadcast period during which the voice amplification device 11 is performing a voice amplification broadcast, and is a certain time T1 after the voice amplification broadcast ends. This is based on the idea that after a series of voice amplification broadcasts have finished playing, the listener's reaction will start and the listener will continue to perform reaction actions for a certain time.

[0032] In S20, the camera 12 may always transmit the video data of the video being shot to the data management server 20 at predetermined time intervals. The data management server 20 may accumulate, as voice amplification reaction information, the video data received during the reaction expected time among the video data received constantly (S24). Alternatively, the camera 12 may be configured to transmit video data to the data management server 20 in response to a request from the data management server 20. In this case, the data management server 20 transmits a request message for requesting a video to the camera 12 when the reaction expected time arrives, and transmits a message for stopping the transmission of the video to the camera 12 when the reaction expected time ends. The camera 12 transmits, in response to the request message, the video data of the video being shot during the reaction expected time to the data management server 20 (S20), and the data management server 20 may accumulate the received video data as voice amplification reaction information (S24).

[0033] In S21, the microphone 13 may always transmit the voice data of the input voice to the data management server 20 at a predetermined time interval. The data management server 20 may accumulate, as voice amplification reaction information, the voice data received during the reaction expectation time among the voice data received constantly (S24). Alternatively, the microphone 13 may be configured to transmit voice data to the data management server 20 in response to a request from the data management server 20. In this case, when the reaction expectation time arrives, the data management server 20 transmits a request message for requesting voice to the microphone 13, and when the reaction expectation time ends, transmits a message for stopping the transmission of voice to the microphone 13. The microphone 13 transmits, in response to the request message, the voice data of the voice input during the reaction expectation time to the data management server 20 (S21), and the data management server 20 may accumulate the received voice data as voice amplification reaction information (S24).

[0034] In S22, the mobile communication terminal 15 may always transmit, in response to the input, the predetermined data input by the user from the input unit to the data management server 20. The data management server 20 may accumulate, as voice amplification reaction information, the data received during the reaction expectation time among the data received constantly (S24). Alternatively, the mobile communication terminal 15 may be configured to transmit the predetermined data to the data management server 20 in response to a request from the data management server 20. In this case, when the reaction expectation time arrives, the data management server 20 transmits a request message for requesting the predetermined data to the mobile communication terminal 15, and when the reaction expectation time ends, transmits a message for stopping the transmission of data to the mobile communication terminal 15. The mobile communication terminal 15 transmits, in response to the request message, the predetermined data input by the user from the input unit within the reaction expectation time to the data management server 20 (S22), and the data management server 20 may accumulate the received data as voice amplification reaction information (S24).

[0035] In S22, an example of the predetermined data transmitted by the mobile communication terminal 15 is character data input through an application of the mobile communication terminal 15. For example, the mobile communication terminal 15 may have a browser as an application for performing a Web search and displaying a desired Web page, and the character data may be character data of characters input from an input unit for the Web search through the browser. For example, the mobile communication terminal 15 may have an application for SNS (Social Networking Service), and the character data may be character data of characters input from an input unit for SNS posting through the application.

[0036] In S24, the data management server 20 may store the voice amplification reaction information for each voice amplification device 11 in association with the log 21 stored for each voice amplification device 11 (S24). In particular, among the logs 21, since the voice amplification reaction information is information regarding the reaction to the voice amplification broadcast, it may be stored in association with the log 21c related to the voice amplification broadcast (S24). In this case, the data management server 20 stores in association the log 21c generated during the voice amplification broadcast period of a certain voice amplification device 11 and the voice amplification reaction information of the same voice amplification device 11 within the reaction expected time corresponding to the voice amplification broadcast period (S24). For example, in the case of the example shown in FIG. 10(a), when a certain voice amplification device 11 starts a voice amplification broadcast and enters the voice amplification broadcast period, the data management server 20 sets the time point after a predetermined time has elapsed from the start time of the voice amplification broadcast as the start period of the reaction expected time, and sets the time point when a time T1 has elapsed after the voice amplification device 11 finishes the voice amplification broadcast and the voice amplification broadcast period ends as the end period of the reaction expected time. The data management server 20 receives time information, sound source type information, character information, sound source name information, voice waveform information, etc. from the voice amplification device 11 during the voice amplification broadcast period (S11) to generate the log 21c (S12), and at the same time, receives various data from the camera 12, microphone 13, and mobile communication terminal 15 within the voice amplification space 10 where the voice amplification device 11 exists during the reaction expected time (S23) to generate the voice amplification reaction information and associate it with the log 21c (S24). For example, in the case of the example shown in FIG. 10(b), when a certain voice amplification device 11 performs a voice amplification broadcast and the voice amplification broadcast period ends, the data management server 20 sets the reaction expected time T1 starting from the time point when a time T1 has elapsed from the end time of this voice amplification broadcast. The data management server 20 receives time information, sound source type information, character information, sound source name information, voice waveform information, etc. from the voice amplification device 11 during the voice amplification broadcast period (S11) to generate the log 21c (S12), and at the same time, receives various data from the camera 12, microphone 13, and mobile communication terminal 15 within the voice amplification space 10 where the voice amplification device 11 exists during the reaction expected time T1 (S23) to generate the voice amplification reaction information and associate it with the log 21c (S24).

[0037] The data management server 20 manages the voice amplifying devices 11, cameras 12, microphones 13, and mobile communication terminals 15 existing within the same voice amplifying space 10. For example, as shown in FIG. 11, for each voice amplifying space 10, a database 23 that manages the voice amplifying devices 11, cameras 12, microphones 13, and mobile communication terminals 15 existing within the space is held. In the example of FIG. 11, the database 23 shows that in the voice amplifying space 10-1, there is 1 voice amplifying device 11 (11-1), 2 cameras 12 (12-1, 12-2), 1 microphone 13 (13-1), and 3 mobile communication terminals 15 (15-1, 15-2, 15-3), and in the voice amplifying space 10-2, there are 2 voice amplifying devices 11 (11-3, 11-4), 1 camera 12 (12-3), 2 microphones 13 (13-3, 13-4), and 2 mobile communication terminals 15 (15-4, 15-5). The data management server 20 may generate the database 23 according to the position information of each voice amplifying device 11, the position information of each camera 12, the position information of each microphone 13, and the position information of each mobile communication terminal 15. For example, when forming the voice amplifying space 10 by a LAN, in other words, when the area where one or more voice amplifying devices 11 connected to one LAN perform voice amplification broadcast is regarded as one voice amplifying space 10, the voice amplifying devices 11, cameras 12, microphones 13, and mobile communication terminals 15 connected to the same LAN are registered in the database 23 as existing in the same voice amplifying space 10. For example, for each identifier (e.g., IP address) of the LAN router, the voice amplifying devices 11, cameras 12, microphones 13, and mobile communication terminals 15 connected to the LAN router having the same identifier are registered in the database 23 as existing in the same voice amplifying space 10. Also, for example, as described with reference to FIG. 3, when the output system 113 of the voice amplifying device 11 is independent, as shown in FIG. 11, cameras 12, microphones 13, and mobile communication terminals 15 are also connected to the output system 113, and all of the voice amplifying device 11, cameras 12, microphones 13, and mobile communication terminals 15 may communicate with the data management server 20 via the output system 113.In this case, for each communication system identification information (e.g., ICCID, IMSI, IMEI, etc.) of the output system 113, the data management server 20 registers in the database 23 the loudspeaker 11, the camera 12, the microphone 13, and the mobile communication terminal 15 connected to the output system 113 having the same identification information as being present in the same amplification space 10. Further, for example, the loudspeaker 11, the camera 12, the microphone 13, and the mobile communication terminal 15 are configured to acquire their own position information using GNSS, an indoor positioning system, etc. and transmit it to the data management server 20. The data management server 20 refers to the received position information and registers in the database 23 the loudspeaker 11, the camera 12, the microphone 13, and the mobile communication terminal 15 having position information that is the same as or approximately within a predetermined range of each other as being present in the same amplification space 10.

[0038] In S24 described above, the data management server 20 refers to the database 23, identifies the camera 12, the microphone 13, and the mobile communication terminal 15 present in the same amplification space 10 as the loudspeaker 11 which is the transmission source of time information, sound source type information, character information, sound source name information, voice waveform information, etc., receives various data from the camera 12, the microphone 13, and the mobile communication terminal 15, and generates voice response information corresponding to the log 21c.

[0039] In S25, the data management server 20 receives access from a client via the Internet network and provides the client with voice amplification response information that can be reproduced on the client side (S25). For example, the data management server 20 generates an HTML file for displaying the voice amplification response information, transmits the HTML file to the client, and enables the client to open the HTML file with a browser to display the voice amplification response information (S25). In S25, the data management server 20 may generate an HTML file for displaying the log 21c and the voice amplification response information corresponding to this log 21c and transmit it to the client, so that the client can confirm the situation of the voice amplification broadcast and the response of the listener to the voice amplification broadcast. When the data management server 20 receives the selection of the voice amplification device 11 on the GUI as shown in FIG. 8, it may generate an HTML file for displaying the log 21c of the voice amplification device 11 corresponding to the selected icon 22 and the voice amplification response information corresponding to this log 21c and transmit it to the client.

[0040] As described above, by measuring the effect of the voice amplification broadcast performed by the voice amplification device 11, the data management server 20 can confirm the effect of the voice amplification broadcast of the voice amplification device 11 through a client accessible to the data management server 20. In this way, by measuring the effect of the voice amplification broadcast, the user (the operation administrator of the voice amplification device 11) can evaluate the effect and improve various settings and operation methods of the voice amplification device 11, and provide a more preferable voice amplification experience for the listeners in the voice amplification space.

[0041] (Web Service: Proposal for Improving Voice Amplification Broadcast) As an example of a web service, the data management server 20 provides improvement proposals for voice amplification broadcasts for each voice amplification device 11 (for each voice amplification space 10) based on the log 21 and voice amplification response information. FIG. 12 is a flowchart showing an example of a service that provides improvement proposals for the voice amplification device 11 (voice amplification space 10). The data management server 20 statistically processes (S12, S24) the accumulated log 21 and voice amplification response information, and creates an improvement proposal leading to the improvement of voice amplification broadcasts (S31). The data management server 20 provides the created improvement proposal to the client (S32).

[0042] As an example of the statistical processing in S30, the data management server 20 statistically processes the log 21 accumulated in time series and creates a proposal to improve the operation of the voice amplification device 11. For example, the temperature log 21a is statistically processed to identify a time period during which the temperature has been continuously high for a predetermined time or more, and an improvement proposal such as strengthening the air conditioning in the voice amplification space 10 is created for this time period. For example, when it is found through statistical processing of the setting information log 21b that the frequency setting of the equalizer 111a and the volume setting of the audio power amplifier 111b are inappropriate, an improvement proposal is created to prompt appropriate frequency and volume settings.

[0043] As an example of the statistical processing in S30, the data management server 20 statistically processes the relationship between at least two of the temperature log 21a, the setting information log 21b, and the broadcast log 21c, and creates a proposal to improve the operation of the voice amplification device 11 based on the relationship between multiple elements. For example, from the temperature log 21a and the setting information log 21b, a time period when the volume setting should be lowered is identified based on the relationship between the temperature and the volume setting of the audio power amplifier 111b, and an improvement proposal to prompt adjustment of the volume setting is created.

[0044] In S30, the data management server 20 processes the voice amplification response information, determines the presence or degree of the effect of the corresponding voice amplification broadcast, and creates a proposal to improve the operation of the voice amplification device 11 based on the voice amplification broadcast effect. For example, the captured video data of the camera 12 included in the voice amplification response information is statistically processed to identify the actions taken by the listeners in the voice amplification space 10 after the voice amplification broadcast, and the effect of the voice amplification broadcast is determined. For example, when the corresponding voice amplification broadcast is a broadcast that prompts the listeners to move (for example, an evacuation guidance broadcast during a disaster), if it is identified from the statistical processing of the captured video data that a plurality of listeners started moving in one direction after the voice amplification broadcast, it can be determined that the voice amplification broadcast was effective (the degree of the effect is high). For example, when the corresponding voice amplification broadcast is an advertisement broadcast for promoting a specific product in the voice amplification space 10 such as a store like a supermarket, if it is identified from the statistical processing of the captured video data that the listeners started moving to the sales floor of the product after the voice amplification broadcast, it can be determined that the voice amplification broadcast was effective (the degree of the effect is high). Also, for example, the sound collection audio data of the microphone 13 included in the voice amplification response information is statistically processed to identify the conversations made by the listeners in the voice amplification space 10 after the voice amplification broadcast, and the effect of the voice amplification broadcast is determined. For example, when the corresponding voice amplification broadcast is an advertisement broadcast for promoting a specific product or the like, if it is identified from the statistical processing of the sound collection audio data that the listeners are having a conversation about the product or the like after the voice amplification broadcast, it can be determined that the voice amplification method was effective (the degree of the effect is high). Further, for example, the character data (data of characters input through the application of the mobile communication terminal 15) included in the voice amplification response information is statistically processed to identify the content of web searches and SNS posts made by the listeners in the voice amplification space 10 after the voice amplification broadcast, and the effect of the voice amplification broadcast is determined. For example, when the corresponding voice amplification broadcast is an advertisement broadcast for promoting a specific product or the like, if it is identified from the statistical processing of the sound collection audio data that the listeners are making web searches and SNS posts about the product or the like after the voice amplification broadcast, it can be determined that the voice amplification method was effective (the degree of the effect is high). In S31, when the voice amplification broadcast effect determined in S30 is low, the data management server 20 creates an improvement proposal to review the sound source to be amplified, the volume setting, and the frequency setting of the equalizer 111b.

[0045] As an example of the statistical processing in S30, the data management server 20 processes the voice amplification response information as described above to determine the presence or absence and degree of the effect of the voice amplification broadcast, and creates a proposal to improve the operation of the voice amplification device 11 based on the relationship between the voice amplification broadcast effect and the log 21 by referring to the log 21 corresponding to the voice amplification broadcast. For example, by referring to the setting information log 21b, the relationship between the volume setting of the audio power amplifier 111b and the frequency setting of the equalizer 111a and the voice amplification broadcast effect (for example, the volume setting and frequency setting when the voice amplification broadcast effect is high) is specified, and a improvement proposal is created to recommend the volume setting and frequency setting when the voice amplification broadcast effect is high (S31).

[0046] In S30, the data management server 20 processes the voice amplification response information and the corresponding log 21, determines the voice amplification broadcast effect based on the relationship between a plurality of elements included in both (S30), and creates a proposal to improve the operation of the voice amplification device 11 based on the voice amplification broadcast effect. For example, the broadcast log 21c and the captured video data of the camera 12 included in the voice amplification response information are processed, the broadcast content included in the broadcast log 21c and the actions taken by the listeners in the voice amplification space 10 after the voice amplification broadcast are specified, and the voice amplification broadcast effect is determined based on the relationship between the two (S30). In this case, for example, first, the broadcast content (character data) of the broadcast log 21c is analyzed to estimate the intention of the voice amplification broadcast (the action that the listener is intended to be prompted to take by the voice amplification broadcast), and then, the captured video data is analyzed to determine whether a plurality of listeners have acted as intended by the voice amplification broadcast after the voice amplification broadcast (whether they have taken the action that the listener is intended to be prompted to take by the voice amplification broadcast), thereby determining the voice amplification broadcast effect. That is, when a plurality of listeners act as intended by the voice amplification broadcast after the voice amplification broadcast, it can be determined that the voice amplification broadcast is highly effective. As an example, as a result of analyzing the broadcast content of the broadcast log 21c, if characters indicating a location (for example, the exit of a building, etc.) can be recognized and it is estimated that the broadcast is to prompt movement to the said location (for example, an evacuation guidance broadcast), then, the captured video data is analyzed to determine whether the listeners have moved towards the said location (S30). As an example, as a result of analyzing the broadcast content of the broadcast log 21c, if characters indicating staying in that place (for example, "Please wait", "Do not move", etc.) can be recognized and it is estimated that the broadcast is to prompt not to move, then, the captured video data is analyzed to determine whether the listeners are staying in that place (S30). As an example, when the voice amplification broadcast is an advertisement broadcast for promoting a specific product broadcast in the voice amplification space 10 such as a store like a supermarket, as a result of analyzing the broadcast content of the broadcast log 21c, the product name being promoted is estimated, and then, the captured video data is analyzed to determine whether the listeners have started to move to the sales floor of the said product (S30). In S31, when the voice amplification broadcast effect determined in S30 is low, the data management server 20 creates an improvement proposal to review the content to be voice amplified (the content that the speaker speaks towards the microphone 110).

[0047] In S30, the data management server 20 processes the voice amplification response information and the corresponding log 21, determines the voice amplification broadcast effect based on the relationship of a plurality of elements included in both (S30), and creates a proposal to improve the operation of the voice amplification device 11 based on the voice amplification broadcast effect. For example, the broadcast log 21c and the sound collection voice data of the microphone 13 included in the voice amplification response information are processed, the broadcast content included in the broadcast log 21c and the conversation content of the listeners in the voice amplification space 10 after the voice amplification broadcast are specified, and the voice amplification broadcast effect is determined based on the relationship between the two (S30). In this case, for example, first, the broadcast content (character data) of the broadcast log 21c is analyzed to estimate the intention of the voice amplification broadcast (the message to be conveyed by the voice amplification broadcast), and then, the sound collection voice data is analyzed to determine the conversation content of the listeners after the voice amplification broadcast, thereby determining the voice amplification broadcast effect. That is, when multiple listeners are conversing as intended by the voice amplification broadcast after the voice amplification broadcast, it can be determined that the voice amplification broadcast is highly effective. As an example, when the voice amplification broadcast is an advertisement broadcast for promoting a specific product broadcast in the voice amplification space 10 such as a store like a supermarket, as a result of analyzing the broadcast content of the broadcast log 21c, the name of the product being promoted is estimated, and then, the sound collection voice data included in the voice amplification response information is analyzed to determine whether the listeners conversed using the name of the product (S30). In S31, when the voice amplification broadcast effect determined in S30 is low, the data management server 20 creates an improvement proposal to review the content to be voice amplified (the content spoken by the speaker towards the microphone 110).

[0048] In S30, the data management server 20 processes the voice amplification response information and the corresponding log 21, determines the voice amplification broadcast effect based on the relationship between a plurality of elements included in both (S30), and creates a proposal to improve the operation of the voice amplification device 11 based on the voice amplification broadcast effect. For example, the broadcast log 21c and the character data included in the voice amplification response information (characters searched on the web or posted on SNS by the mobile communication terminal 15, etc.) are processed, the broadcast content included in the broadcast log 21c and the actions taken by the listeners in the voice amplification space 10 after the voice amplification broadcast are identified, and the voice amplification broadcast effect is determined based on the relationship between the two (S30). In this case, for example, first, the broadcast content (character data) of the broadcast log 21c is analyzed to estimate the intention of the voice amplification broadcast (the message to be conveyed by the voice amplification broadcast), and then, the character data is analyzed to determine the web search content and SNS posting content that the listeners performed through the mobile communication terminal 15 after the voice amplification broadcast, thereby determining the voice amplification broadcast effect. That is, when a plurality of listeners perform web searches, SNS postings, etc. as intended by the voice amplification broadcast after the voice amplification broadcast, it can be determined that the voice amplification broadcast is highly effective. As an example, when the voice amplification broadcast is an advertisement broadcast for promoting a specific product broadcast in the voice amplification space 10 such as a store like a supermarket, as a result of analyzing the broadcast content of the broadcast log 21c, the product name being promoted is estimated, and then, the character data included in the voice amplification response information is analyzed to determine whether the listeners used the product name for web searches, SNS postings, etc. (S30). In S31, when the voice amplification broadcast effect determined in S30 is low, the data management server 20 creates an improvement proposal to review the content to be voice amplified (the content that the speaker speaks toward the microphone 110).

[0049] The improvement proposal includes characters, images, etc. that describe the improvement content. In S32, the data management server 20 receives access from a client via the Internet and provides the improvement proposal to the client so that it can be reproduced on the client side. For example, the data management server 20 generates an HTML file for displaying the improvement proposal, sends the HTML file to the client, and enables the client to open the HTML file with a browser to display the improvement proposal. When the data management server 20 receives a selection of the voice amplifier 11 on a GUI as shown in FIG. 8, it may generate an HTML file for displaying the improvement proposal for the voice amplifier 11 corresponding to the selected icon 22 and send it to the client.

[0050] As described above, the data management server 20 creates improvement proposals regarding the settings and operation of the voice amplifier 11, and the improvement proposals can be confirmed through a client accessible to the data management server 20. In this way, by making improvement proposals for voice broadcasting, the user (the operation administrator of the voice amplifier 11) can improve various settings and operation methods of the voice amplifier 11 based on the improvement proposals, and provide a more preferable voice experience for the listeners in the voice space.

[0051] (Web Service: Abnormality Detection of Voice Broadcasting) An example of the web service is an abnormality detection service for the voice amplifier 11. FIG. 14 is a flowchart showing an example of the abnormality detection service. The voice amplifier 11 constantly determines whether the input system 110, the processing system 111, and the output system 112 are operating normally at a predetermined time interval (S40), and transmits the determination result to the data management server 20 via the communication system 113 (S41). The data management server 20 receives the determination result from the voice amplifier 11 (S42), accumulates the determination result (S43), and provides it to an external client (S44). Thereby, it is possible to visualize whether the voice amplifier 11 is operating normally or an abnormality has occurred.

[0052] As shown in FIG. 15, the voice amplifier 11 includes a determination unit 114. The determination unit 114 is connected to the input system 110, the processing system 111, and the output system 112, monitors the operating status of each of the systems 110 to 112 at predetermined time intervals, and determines whether they are operating normally (S40). As an example, the determination unit 114 includes a temperature sensor that measures temperature at predetermined time intervals, measures the temperature of each of the input system 110, the processing system 111, and the output system 112, and determines whether the temperature of each system is normal (S40). For example, if the measured temperature value is within a predetermined temperature range set in advance, it may be determined as normal, and if it is outside the predetermined temperature range, it may be determined as abnormal. As an example, the determination unit 114 includes a current sensor that measures current, measures the current flowing on each of the electric circuit boards (electronic circuit boards) of the input system 110, the processing system 111, and the output system 112, and determines whether each system is operating normally (S40). For example, if the measured current value is within a predetermined range set in advance, it may be determined as normal, and if it is outside the predetermined range, it may be determined as abnormal.

[0053] In S41, the voice amplifier 11 transmits the determination result for each system determined by the determination unit 114 to the data management server 20. The determination result includes information indicating whether each system is normal or abnormal.

[0054] In S44, the data management server 20 accepts access from a client via the Internet and provides the received determination result to the client so that it can be reproduced on the client side. For example, the data management server 20 generates an HTML file for displaying the determination result, transmits the HTML file to the client, and enables the client to open the HTML file with a browser and display the determination result.

[0055] As described above, the data management server 20 collects a determination result indicating whether the operation of the voice amplifier 11 is normal, and the determination result can be confirmed through a client accessible to the data management server 20. The user (the operator of the voice amplifier 11) can perform repairs, replacements, etc. of the voice amplifier 11 based on the determination result, improving the maintainability and providing a more preferable voice amplification experience from the voice amplifier 11.

[0056] (Web Service: Personalized Broadcast) An example of the web service is a service that causes the voice amplifier 11 to provide a personalized broadcast optimized for the user 14 in the voice amplification space 10. In this example, the user 14 can select a sound source for voice amplification broadcast from the voice amplifier 11 or perform settings (such as volume) for voice amplification broadcast using the mobile communication terminal 15, and according to these selections and settings, the data management server 20 gives a voice amplification broadcast instruction to the voice amplifier 11. As shown in FIG. 16, in this example, the data management server 20 holds a plurality of sound sources 25 and history information 26. Each of the plurality of sound sources 25 is a sound source that can be played and voice-amplified by the voice amplifier 11. Each sound source 25 is, for example, voice data related to a certain piece of music or BGM, and is, for example, voice data generated in a file format such as MP3 (MPEG Audio Layer 3) or AAC (Advanced Audio Coding). The history 26 is information including the history of settings (such as volume settings) for voice amplification broadcast from the voice amplifier 11 and the selection of sound sources, and is information including the history for each user 14 who made the settings and selections.

[0057] FIG. 17 shows an example of the history 26. The history 26 includes the past history of the user 14 accessing the data management server 20 using the mobile communication terminal 15 and selecting the sound source 25 from the mobile communication terminal 15, and the past history of performing the voice amplification setting such as the volume from the mobile terminal 15. The history 26 records the history of the selection of the sound source 25 and the voice amplification setting such as the volume performed from the mobile communication terminal 15 for each identification information of the mobile communication terminal 15 (user 14) that has accessed the data management server 20 and performed the selection of the sound source 25 and the setting such as the volume (for example, IP address, ICCID, IMSI, IMEI when the mobile communication terminal 15 has a SIM, ID for logging in to the data management server 20, etc.). In the history 26, each time the selection of the sound source 25 and the voice amplification setting such as the volume are performed, the history of the selection and the setting is recorded in association with the date and time when it was performed. In the example shown in FIG. 17, the history 26 includes the selection history of the sound source 25 and the volume setting history. For example, the history 26 has a history that music 001 (sound source 25) was selected at 9:10 on March 1, and 31 dB was set as the volume for voice amplification broadcasting of music 001.

[0058] FIG. 18 is a flowchart showing an example of an operation flow for performing personalized broadcasting in this example. The database server 20 receives access from a client via the Internet network (S50, S51). In S50, the client transmits identification information for identifying the mobile communication terminal 15 (user 14), such as an IP address, ICCID, IMSI, IMEI, login ID, etc. (S50), and the data management server 20 authenticates the received identification information and accepts the access (S51). The data management server 20 refers to the history 26 and determines whether there is a history associated with the identification information of the mobile communication terminal 15 (user 14) authenticated in S51 (S52). If there is a history (S52: Yes), based on the history, a sound source 25 and an amplification setting such as volume are selected, and the sound source 25 selected with the selected amplification setting is instructed to the amplification device 11 to be reproduced (S53). In S53, the data management server 20 transmits the selected sound source 25 (audio data) to the amplification device 11 and also transmits a setting message indicating the selected amplification setting. In S53, the data management server 20 estimates the sound source 25 that the user 14 is most likely to want to reproduce from the amplification device 11 and the amplification setting that the user 14 is most likely to want to set at the time when the mobile communication terminal 15 accessed the data management server 20 in S50 based on one or more histories, and selects these. Specifically, for example, the data management server 20 may refer to one or more histories, select the sound source 25 that has been reproduced most frequently in the past, and select the amplification setting that has been set most frequently. Also, for example, the data management server 20 may select the sound source 25 that was reproduced in the past at the time closest to the time when the access was accepted in S51 or the amplification setting that was set, or select the sound source 25 that was reproduced most frequently in the past or the amplification setting that was set during the time period when the access was accepted in S51. Thereby, an optimal sound source 25 and an amplification setting are automatically selected, and the sound source 25 is reproduced from the amplification device 11 with the amplification setting and broadcast with amplification.

[0059] If there is no history in history 26 (S52: No), the data management server 20 receives the selection of the sound source 25 input from the client (S54) and the designation of the amplification setting (S55). The data management server 20 provides, for example, a UI for inputting the selection of the sound source 25 and the designation of the amplification setting to the client, and receives the selection of the sound source 25 and the designation of the amplification setting input through the UI (S55). For example, the data management server 20 generates an HTML file for displaying the UI, transmits the HTML file to the client, and enables the client to open the HTML file with a browser and display the UI.

[0060] The data management server 20 reads out the sound source 25 selected in S55 (S56), and instructs the amplification device 11 to reproduce the sound source 25 with the amplification setting selected in S56 (S57). In S57, the data management server 20 transmits the sound source 25 read out in S56 to the amplification device 11 and transmits a setting message indicating the amplification setting selected in S55. The data management server 20 records the selection of the sound source 25 and the selection of the amplification setting received in S55 as a new history, in association with time information indicating the time when it was received in S55, in the history 26 (S61).

[0061] The amplification device 11 receives the sound source 25 and the setting message transmitted from the data management server 20 in S53 or S57 (S58). The amplification device 11 holds the received sound source 25 and performs the setting of the input system 110, the processing system 111, or the output system 112 according to the received setting message (S59). For example, when the setting message is a message indicating a volume setting, the amplification device 11 adjusts the volume of the audio power amplifier 111b of the processing system 111 according to the volume setting indicated by the setting message (S59). The amplification device 11 reproduces the sound source 25 received and held in S58 and performs amplified broadcast (S60).

[0062] As described above, the data management server 20 records the history of the voice amplification experiences that the user 14 has obtained on their own in the past, and can utilize this history to automatically provide an optimal voice amplification experience for each user 14.

[0063] (Web Service: Audibility Device 11 Ringing Point Inspection) An example of the web service is an inspection service that checks whether the voice amplification device 11 is operating normally. That is, when a malfunction occurs in the input system 110, the processing system 111, or the output system 112 of the voice amplification device 11, it may not be possible to perform voice amplification properly when attempting to do so (or even when intending to perform voice amplification), which poses a problem in the operation of the voice amplification device 11. In particular, it is dangerous in terms of human lives if a highly public voice amplification broadcast such as an evacuation guidance broadcast during a disaster cannot be performed properly. Therefore, the data management server 20 periodically or irregularly checks whether the voice amplification device 11 is operating normally. In this example, as shown in FIG. 19, the data management server 20 holds a test sound source 27. The test sound source 27 is voice data prepared for inspecting the voice amplification device 11, and is, for example, voice data related to voice that continues for several seconds.

[0064] FIG. 20 is a flowchart showing an example of an operation flow related to the inspection service of the voice amplification device 11. The data management server 20 instructs the voice amplification device 11 to perform a test voice amplification in order to inspect the voice amplification device 11 (S70). As an example, the data management server 20 may hold a schedule for performing the inspection in advance and execute S70 according to the schedule. As an example, the data management server 20 may execute S70 periodically (for example, once a month, on the first day of each month, etc.). As an example, the data management server 20 may execute S70 irregularly during a time period when no voice amplification is being performed from the voice amplification broadcast 11. In S70, the data management server 20 transmits a message instructing a test voice amplification while transmitting the test sound source 27 to the voice amplification device 11.

[0065] When the voice amplifier 11 receives the inspection sound source 27 and a message (S71), it performs a test voice broadcast in response (S72). In S72, the voice amplifier 11 holds the received inspection sound source 27, plays back the inspection sound source 27, and performs a voice broadcast.

[0066] In parallel with instructing the voice amplifier 11 to perform a test voice broadcast in S70, the data management server 20 instructs the microphone 30 existing in the same voice amplification space 10 as the voice amplifier 11 to perform sound collection (S73). In S73, the data management server 20 refers to the database 23, identifies the microphone 30 existing in the same voice amplification space 10 as the voice amplifier 11 instructed in S70, and sends a sound collection instruction to the microphone 30. In S73, the data management server 20 transmits a message instructing sound collection to the microphone 30. As an example, the data management server 20 may execute S73 simultaneously while executing S70. As an example, the data management server 20 may execute S73 after a predetermined time (for example, several seconds) considering the time lag from when S70 is executed until the voice amplifier 11 starts a voice broadcast.

[0067] When the microphone 30 receives a message for sound collection instruction (S74), it starts sound collection, generates voice data of the collected voice, and transmits it to the data management server 20 (S75). In S75, the microphone 30 may continue sound collection for a predetermined time after receiving the message in S74, generate voice data of the voice collected during this period, transmit it to the data management server 20, and then automatically end sound collection.

[0068] After executing S73, the data management server 20 waits to receive the voice data of the recorded voice from the microphone 30. When the data management server 20 receives the voice data of the recorded voice from the microphone 30, it checks the voice amplifier 11 based on the voice data (S76). As an example, in S76, when the data management server 20 can receive the voice data in S76, it determines that the voice amplifier 11 is normal, and if it cannot receive the voice data even after waiting for a predetermined time, it determines that the voice amplifier 11 is abnormal. As an example, in S76, the data management server 20 compares the received voice data with the inspection sound source 27 and determines whether the voice amplifier 11 is normal or abnormal according to the degree of coincidence. For example, if the received voice data and the inspection sound source 27 match within a predetermined range, it may be determined to be normal, and if they do not match within the predetermined range, it may be determined to be abnormal. For example, the received voice data is played back to obtain a voice signal (voice waveform), which is compared with the voice signal related to the voice data of the inspection sound source 27, and if they match within a predetermined range, it may be determined to be normal, and if they do not match within the predetermined range, it may be determined to be abnormal.

[0069] The data management server 20 accumulates the determination result (inspection result) in S76 (S77) and provides it to the client (S78). In S78, the data management server 20 accepts access from the client via the Internet network and provides the inspection result to the client so that it can be played back on the client side. For example, the data management server 20 generates an HTML file for displaying the inspection result, transmits the HTML file to the client, and enables the client to open the HTML file with a browser and display the inspection result.

[0070] As described above, the data management server 20 inspects the voice amplifier 11, and the result of the inspection can be confirmed through a client accessible to the data management server 20. A user (the operator of the voice amplifier 11) can perform repairs, replacements, etc. on the voice amplifier 11 based on the inspection result, improving the maintainability and providing a more favorable voice amplification experience from the voice amplifier 11.

[0071] (Supplementary) The voice amplifier 11 includes a processing unit including a CPU (Central Processing Unit), an MPU (Micro Processing Unit), etc., and a memory that holds a computer program executable by the processing unit. By the processing unit executing the computer program held in the memory, various functions of the voice amplifier 11 are realized. The computer program held in the memory includes program instructions for executing various processes executed by the voice amplifier 11 described above, such as S10, S40 - S41, S58 - S60, S71 - S72.

[0072] The data management server 20 includes a processing unit including a CPU, an MPU, etc., and a memory that holds a computer program executable by the processing unit. By the processing unit executing the computer program held in the memory, various functions of the data management server 20 are realized. The computer program held in the memory includes program instructions for executing various processes executed by the data management server 20 described above, such as S11 - S13, S23 - S25, S30 - S32, S42 - S44, S51 - S61, S70 - S78.

[0073] The camera 12 includes a processing unit including a CPU, an MPU, etc., and a memory that holds a computer program executable by the processing unit. By the processing unit executing the computer program held in the memory, various functions of the camera 12 are realized. The computer program held in the memory includes program instructions for executing various processes executed by the camera 12 described above, such as S20.

[0074] The microphone 13 includes a processing unit including a CPU, an MPU, etc., and a memory that holds a computer program executable by the processing unit. By the processing unit executing the computer program held in the memory, various functions of the microphone 13 are realized. The computer program held in the memory includes program instructions for executing various processes executed by the above-described camera 12, such as S21, S74 to S75.

[0075] The mobile communication terminal 15 includes a processing unit including a CPU, an MPU, etc., and a memory that holds a computer program executable by the processing unit. By the processing unit executing the computer program held in the memory, various functions of the mobile communication terminal 15 are realized. The computer program held in the memory includes program instructions for executing various processes executed by the above-described mobile communication terminal 15, such as S22, S50, S54. When the mobile communication terminal 15 is a client that receives the services provided by the data management server 20 at S13, S25, S32, S43, S77, the computer program held in the memory includes program instructions for executing processes for those.

[0076] FIG. 21 shows an example of an embodiment of the voice amplification system 1. In the voice amplification system 1, the data management server 20 includes a plurality of server elements 20a to 20g according to the functions of the services provided. The content server 20a is a server that provides content to the voice amplification device 11. For example, it holds the above-described sound source 25 and inspection sound source 27, and has a function of transmitting them to the voice amplification device 11 (S53, S57, S70). The device management server 20b is a server that manages devices such as the voice amplification device 11 in the voice amplification space 10. For example, it has functions of accumulating voice amplification information (S12), accumulating various information (S24), accumulating determination information (S43), and accumulating inspection results (S77), and also has a function of accumulating logs 21, databases 23, histories 26, etc. The portal server 20c is a server that serves as a contact point with the client. For example, it has functions of executing S13, S25, S32, S43, and S77. The analysis server 20d is a server that performs data analysis, statistical processing, etc. For example, it has functions of executing S30, S31, and S76. The end-user server 20e is a server that serves as a contact point with the mobile communication terminal 15 possessed by the user 14. For example, it has functions of executing S51 and S53. The space grasping server 20f is a server that grasps the situation of the voice amplification space 10 and serves as a contact point with the camera 12 and the microphone 13. For example, it has functions of executing S23 and S76. The diagnosis server 20g is a server that serves as a contact point with the client for diagnosing the voice amplification device 11. For example, it has functions of executing S13, S25, S32, S43, and S77.

Description of Reference Numerals

[0077] 1 Voice amplification system 10 Voice amplification space 11 Voice amplification device 12 Camera 13 Microphone 20 Data management server

Claims

1. In a public address system having an input system, a processing system, and an output system, during a public address broadcast, a current value on a transmission path from the input system through the processing system to the output system is detected, An acoustic test system that restores the detected current value as an audio signal on a server connected to the public address system via the Internet and provides the restored audio signal to an external client connected to the server via the Internet.

2. The acoustic test system according to claim 1, wherein The server is connected to a plurality of the public address systems, The server receives position information indicating the position of the public address system together with the current value from each of the public address systems, The server provides a GUI indicating the positions of the respective public address systems to the external client based on the position information, and provides an audio signal restored from the current value received from the public address system corresponding to the position designated by the external client through the GUI. An acoustic test system.

Images