Ambient sound visualization system, method for operating the ambient sound visualization system, and program therefor

Abstract

To provide an ambient sound visualization system which contributes to creation of a sound volume drawing map without requiring many measurement instruments such as noise meters.SOLUTION: In an ambient sound visualization system including an information terminal having a microphone input function unit and a server, the information terminal transmits data of a sound volume value input by the microphone input function unit to the server in each constant time cycle, and the server comprises: a database function unit which receives the data of the sound volume value input by the microphone input function unit from each information terminal and stores the data; a data calculation processing unit which maps the data on a map and creates map data of a sound volume drawing map of the ambient sound; a screen display function unit which creates an image of the sound volume drawing map displayed on the information terminal side from the map data; a database function unit; a control function unit which controls the data calculation processing unit and the screen display function unit; and a communication function unit which is connected to the control function unit and transmits the image of the sound volume drawing map to the information terminal through the Internet.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an ambient sound visualization system, a method for operating an ambient sound visualization system, and a program therefor. [Background technology]

[0002] The person himself does not know how far the sound he makes can be heard. Also, even if the sound he makes is loud enough to disturb others in a quiet environment, he is often unaware of it, and even in such cases it is difficult for those around him to point it out.

[0003] To find out the volume level in the environment around you, you use a sound level meter or other measuring device that can measure sound pressure level, but this can only be measured in the location where the sound meter is located.To determine the location at which the sound you produce can be heard, you need to place multiple sound level meters or other measuring devices that can measure sound pressure level in the space, measure the sound pressure level at each location with each sound meter while the sound is being produced, and use this data to create a graph to clarify the spatial distribution of sound pressure levels.

[0004] Various devices and systems have been proposed that can measure the distribution of such sound pressure levels, display them on a monitor screen, and create noise evaluation maps and noise maps.

[0005] For example, Patent Document 1 discloses an environmental information management system that can acquire, monitor, view, and manage environmental information, and can also issue warnings and the like based on the environmental information. In this system, environmental information is information related to noise, vibration, wind direction, wind speed, dust, temperature, and humidity, and measurement units containing measuring instruments (vibration meters, sound level meters, dust meters, wind vanes, anemometers, thermometers, hygrometers, etc.) are placed at multiple measurement points, environmental information at each measurement point is acquired, and the environmental information can be displayed in a list on a management monitor screen using graphs, tables, etc.

[0006] Patent Document 2 also discloses a noise evaluation support system that outputs noise evaluation results based on estimated noise levels for each building (creates and displays a noise evaluation map). This system creates three-dimensional map data for the area including the evaluation target range, creates a database of actual measurements including noise levels measured at specified points, and creates an estimated value database by estimating the noise levels of each building based on the estimated height of each building. It determines whether the estimated values ​​exceed environmental standards, and by coloring buildings with noise levels that exceed the environmental standards in black or other colors, it is possible to create a noise evaluation map that shows the compliance status of each building with the environmental standards.

[0007] Furthermore, Patent Document 3 discloses a noise map creation method and device that creates a noise map by distinguishing between indoor and outdoor environmental noise. This device acquires environmental noise including noise values, time information, and location information uploaded from a terminal, and when the terminal further uploads a photo, it determines that the photo is a valid photo and that the photo was taken indoors, and can recognize the environmental noise as indoor environmental noise. Alternatively, if there is no photo or the photo is invalid, but the photo is valid and the photo was taken outdoors, it can recognize the environmental noise as outdoor environmental noise. It is possible to distinguish between indoor and outdoor environmental noise and create a noise map based on an environmental noise mining model including at least one of an environmental noise clustering model, a noise decibel average model, and a noise weighting value model.

[0008] Patent Document 4 relates to an autonomous mobile body, and describes that an autonomous mobile robot 2 creates an environmental map representing the entire desired target area based on distance and angle information to the target object obtained from a laser range sensor 15 and a 3D distance image sensor 17.

[0009] Patent Document 5 relates to an indoor environment management device that allows a user to easily check the indoor condition when they want to adjust the indoor environment. A measurement device 3 has at least one sensor, such as a temperature sensor, humidity sensor, or carbon dioxide sensor, and a management device 21 receives data (measurement data) related to the indoor environment measured by the measurement device 3 via a gateway 22. The management device 21 generates display data for an indoor environment map from the measurement data received from the measurement device 3 and a floor plan (indoor map) of the room that it manages.

[0010] Patent document 6 relates to an environmental map generating device, and discloses that a tag presentation and voting unit 112 receives tag voting data regarding tags voted from a mobile information terminal 31, and a counting and statistics unit 114 performs counting and statistical processing of the tag voting data based on the tag voting data stored in a tag voting data storage unit 121 to generate an environmental map (or an event likelihood map). [Prior art documents] [Patent documents]

[0011] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-245302 [Patent Document 2] Japanese Patent Application Laid-Open No. 2005-30918 [Patent Document 3] Special Publication No. 2017-508130 [Patent Document 4] Republished Patent No. 2017 / 030188 [Patent Document 5] Japanese Patent Application Laid-Open No. 2017-10892 [Patent Document 6] Japanese Patent Application Laid-Open No. 2012-216167 Summary of the Invention [Problem to be solved by the invention]

[0012] The following analysis is provided by the present invention.

[0013] However, the technologies described in Patent Document 1 and Patent Document 2 have the problem that, in the case of Patent Document 1, data is collected by placing measuring instruments, including sound level meters, at multiple measurement locations, while in Patent Document 2, actual measurement data, including noise levels, measured at each location is used. In order to collect data from many measurement locations, many measuring instruments, such as sound level meters, are required.

[0014] The technology described in Patent Document 3 solves the problem of the need for many measuring instruments, such as sound level meters, by using environmental noise, including noise levels, time information, and location information uploaded from devices. However, it does not describe in detail the noise levels uploaded from each device, making it unclear how each device obtains the noise levels. If software capable of measuring noise levels were installed on each device and used instead of a sound level meter, there would be a problem of requiring many devices (devices with the function to measure noise levels) with such specialized software installed. Furthermore, when measuring noise levels on various devices, for example, methods that convert microphone input level values ​​into noise levels do not take into account the variability in microphone input sensitivity as a noise level sensor. This means that the noise levels acquired by each device cannot be treated as noise level data on the same scale. Therefore, when creating a noise map from noise level data from multiple devices, it is not possible to show a unified noise level distribution on the correct scale.

[0015] An object of the present invention is to provide an ambient sound visualization system, a method for operating an ambient sound visualization system, and a program therefor that contribute to creating a volume drawing map without the need for many measuring instruments such as sound level meters. [Means for solving the problem]

[0016] According to a first aspect of the present invention, there is provided an information terminal that includes a microphone input function unit and is capable of data communication; a server located on the Internet that can transmit and receive data to and from each of the information terminals; An ambient sound visualization system comprising: the information terminal transmits data of the volume value input by the microphone input function unit to the server at regular time intervals; The server a database function unit that receives data of volume values ​​inputted by the microphone input function unit from each of the information terminals and stores the data; a data calculation processing unit that maps the data on a map and creates map data of a volume drawing map of the ambient sound; a screen display function unit that generates an image of a volume drawing map to be displayed on the information terminal side from the map data; a control function unit that controls the database function unit, the data calculation processing unit, and the screen display function unit; a communication function unit connected to the control function unit and configured to transmit an image of the volume drawing map to the information terminal via the Internet; It is possible to provide an ambient sound visualization system comprising:

[0017] According to a second aspect of the present invention, the control function unit of the server comprises: The system further includes means for registering the difference between the volume value of each information terminal and the sound pressure level (dB value) input value at that time in the database function unit as calibration information, The data processing unit of the server Using the calibration information, convert the volume value into a sound pressure level (dB value) and correct for differences in microphone sensitivity of the volume value of each of the information terminals; creating map data for a volume drawing map using the sound pressure level corrected for the difference in microphone sensitivity; An ambient sound visualization system according to a first aspect of the present invention can be provided, which is characterized by the above.

[0018] According to a third aspect of the present invention, there is provided an information terminal including a microphone input function unit and capable of data communication, a server located on the Internet that can transmit and receive data to and from each of the information terminals; A method of operating an ambient sound visualization system, comprising: a step in which the information terminal transmits data of the volume value inputted by the microphone input function unit to the server at regular time intervals; The server: receiving data of volume values ​​inputted by the microphone input function unit from each of the information terminals, and storing the data in a database function unit; Mapping the data on a map to create map data of a volume drawing map of ambient sound; generating an image of a volume drawing map to be displayed on the information terminal side from the map data; communicating an image of the volume drawing map to the information terminal via the Internet; A method can be provided which includes:

[0019] According to a fourth aspect of the present invention, there is provided an information terminal including a microphone input function unit and capable of data communication, a server located on the Internet that can transmit and receive data to and from each of the information terminals; of ambient sound visualization systems, including causing a computer provided in the information terminal to execute a process of transmitting data of the volume value input by the microphone input function unit to the server at regular time intervals; The server, a process of receiving data of volume values ​​inputted by the microphone input function unit from each of the information terminals and storing the data in a database function unit; A process of mapping the data on a map to create map data of a volume drawing map of ambient sound; A process of generating an image of a volume drawing map to be displayed on the information terminal side from the map data; a process of communicating an image of the volume drawing map to the information terminal via the Internet; It is possible to provide a program for executing the above. This program can be recorded on a computer-readable storage medium. The storage medium can be a non-transient medium such as a semiconductor memory, a hard disk, a magnetic recording medium, or an optical recording medium. The present invention can also be embodied as a computer program product. [Effects of the Invention]

[0020] According to the present invention, it is possible to provide an ambient sound visualization system, a method for operating an ambient sound visualization system, and a program therefor, which contribute to creating a volume drawing map without the need for many measuring instruments such as sound level meters. [Brief explanation of the drawings]

[0021] [Figure 1] 1 is a schematic diagram showing the overall configuration of an ambient sound visualization system according to an embodiment of the present invention; [Figure 2] FIG. 10 is a diagram showing an example of a volume drawing map display screen (an example of a contour line color-coded type). [Figure 3] FIG. 1 is a block diagram showing the configuration of an ambient sound visualization system according to an embodiment of the present invention. [Figure 4] 1 is a block diagram showing a configuration of an information terminal 110 according to a first embodiment of the present invention. [Figure 5] FIG. 9 is a block diagram showing the configuration of a server 910 as an example of the server according to the first embodiment of the present invention. [Figure 6] FIG. 2 is a diagram showing an example of an initial menu display screen according to the first embodiment of the present invention. [Figure 7] FIG. 2 is a diagram showing an example of a volume drawing map screen display (an example of an area display type on map information) according to the first embodiment of the present invention. [Figure 8] FIG. 2 is a diagram showing an example of a volume drawing map screen display (an example of a volume display type) according to the first embodiment of the present invention. [Figure 9] FIG. 2 is a diagram showing an example of a volume drawing map screen display (an example of an area display type) according to the first embodiment of the present invention. [Figure 10] FIG. 3 is a diagram illustrating an example of a terminal registration screen according to the first embodiment of the present invention. [Figure 11] FIG. 3 is a diagram illustrating an example of a calibration setting screen according to the first embodiment of the present invention. [Figure 12] FIG. 3 is a diagram illustrating an example of a data management setting screen according to the first embodiment of the present invention. [Figure 13] FIG. 2 is a diagram illustrating an example of an outline of a processing flow and a data flow according to the first embodiment of the present invention. [Figure 14] FIG. 3 is a diagram showing an example of a volume drawing map generation input information screen according to the first embodiment of the present invention. [Figure 15] FIG. 3 is a diagram illustrating an example of a volume drawing screen editing screen according to the first embodiment of the present invention. [Figure 16] FIG. 10 is a diagram illustrating an example of a monitoring notification setting screen according to the second embodiment of the present invention. [Figure 17] FIG. 11 is a diagram showing an example of an analysis screen according to the third embodiment of the present invention. [Figure 18] FIG. 13 is a diagram illustrating an example of an extracted information terminal list screen according to the third embodiment of the present invention. [Figure 19] FIG. 11 is a diagram showing an example of a contact screen according to the third embodiment of the present invention. [Figure 20] FIG. 13 is a diagram illustrating an example of a detailed data analysis setting screen according to the third embodiment of the present invention. [Figure 21] FIG. 1 is a diagram showing the configuration of a computer that constitutes the ambient sound visualization system of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0022] First, an overview of one embodiment of the present invention will be described with reference to the drawings. Note that the reference numerals in the drawings attached to this overview are attached to each element for convenience as an example to facilitate understanding, and are not intended to limit the present invention to the illustrated form. Furthermore, connecting lines between blocks in the drawings and the like referred to in the following description include both bidirectional and unidirectional lines. Unidirectional arrows are used to schematically indicate the flow of the main signal (data) and do not exclude bidirectionality.

[0023] FIG. 1 shows an example of the overall configuration of an ambient sound visualization system according to one embodiment of the present invention. The ambient sound visualization system is composed of a monitored room 100 and a server room 900, with each room shown as viewed from above. As shown in FIG. 1, in the monitored room 100, information terminals 110-190 (e.g., PCs, smartphones, tablets, smart speakers, etc.) used by each user are placed at the seats of users A-I. Each of the information terminals 110-190 in the monitored room 100 and a server 910 in the server room 900 are connected via a wired or wireless communication network and perform data communication. Each of the information terminals 110-190 transmits data, including time information TD1101, position information LD1101, and volume value SD1101, to the server 910 at regular time intervals.

[0024] Next, an example of a volume drawing map screen display (an example of a contour color-coded type) displayed on the information terminals 110 to 190 of the ambient sound visualization system of Fig. 1 will be described. Fig. 2 shows an example of a display screen of a volume drawing map 2000 generated from the position information and volume values ​​at a certain time of the information terminals 110 to 190 present in the monitored room 100. The volume drawing map 2000 displays time information designated by the user and the position of each information terminal at that time on a map, and also draws contour lines according to the magnitude of the sound pressure level obtained by calculating the volume value at each position, and colors the contour lines according to their levels, thereby drawing the magnitude of the volume level at a certain time on the volume drawing map 2000.

[0025] Fig. 3 is a block diagram showing the configuration of an ambient sound visualization system 1000 according to one embodiment of the present invention. The ambient sound visualization system in Fig. 3 includes an information terminal 110, a network 10, and a server 910. The information terminal 110 includes a microphone input function unit 114. The network 10 is, for example, the Internet. The server 910 includes a control function unit 911, a communication function unit 912, a database function unit 913, a data calculation processing unit 914, and a screen display function unit 915.

[0026] The information terminal 110 transmits data of the volume value input via the microphone input function unit 114 to the server 910 at regular intervals.

[0027] The server 910 receives volume value data input from each of the information terminals 110 to 190 via each of the microphone input function units 114, and stores the received data in the database function unit 913. The data calculation processing unit 914 maps the stored data on a map and creates map data for a volume drawing map of ambient sound. The screen display function unit 915 generates an image of the volume drawing map to be displayed on the information terminals 110 to 190 from the created map data. The control function unit 911 controls the database function unit 913, the data calculation processing unit 914, and the screen display function unit 915. The communication function unit 912 connected to the control function unit 911 communicates the image of the volume drawing map to the information terminals 110 to 190 via the network (for example, the Internet) 10.

[0028] According to one embodiment of the present invention, it is possible to provide an ambient sound visualization system that contributes to creating a volume rendering map without requiring many measuring instruments such as sound level meters.

[0029] In one embodiment of the ambient sound visualization system 1000, the control function unit 911 of the server further includes means for registering, as calibration information in the database function unit 913, a difference between the volume value of each information terminal and the input value of the sound pressure level (dB value) at that time, The data calculation processing unit of the server uses the calibration information to convert the volume value into a sound pressure level (dB value), corrects for differences in microphone sensitivity of the volume value of each information terminal, and creates map data for a volume drawing map using the sound pressure level corrected for the differences in microphone sensitivity.

[0030] According to one embodiment of the present invention, an ambient sound visualization system can be provided that contributes to creating a volume drawing map by mapping the volume values ​​on a map after standardizing the variations in microphone sensitivity of each information terminal.

[0031] [First embodiment] Next, an ambient sound visualization system according to a first embodiment of the present invention will be described with reference to the drawings. Fig. 4 is a block diagram showing the configuration of an information terminal 110 according to the first embodiment of the present invention. Fig. 5 is a block diagram showing the configuration of a server 910 according to the first embodiment of the present invention. In Figs. 4 and 5, components with the same reference numerals as those in Figs. 1 and 3 indicate the same components.

[0032] 4, the information terminal 110 includes a control function unit 111, a clock function unit 112, a positioning function unit 113, a microphone input function unit 114, and a communication function unit 115. The control function unit 111 of the information terminal 110 transmits, at regular intervals, position information acquired from the positioning function unit 113 and a volume value acquired from the microphone input function unit 114, together with time information acquired from the clock function unit 112, to the server 910 via the communication function unit 115. The transmission data is made up of time information TD1101, position information LD1101, and volume value SD1101.

[0033] The configuration, functions, and data collection and transmission contents of information terminal 110 have been explained as an example, but each of information terminals 120 to 190 has the same configuration and functions as information terminal 110, and data such as time information TD1101, position information LD1101, and volume value SD1101 is transmitted from each information terminal to server 910 at regular time intervals.

[0034] The positioning function unit 113 of the information terminal utilizes a positioning function implemented in the information terminal that can acquire location information using positioning technologies such as a satellite positioning system, mobile phone base station information, Wi-Fi positioning, Bluetooth (registered trademark) positioning, beacon positioning, pedestrian autonomous navigation positioning, etc. In a room such as the monitored room 100 shown in Fig. 1, a positioning accuracy of about 1 meter is required. However, for indoor positioning, positioning accuracy can be improved to about 1 meter by using positioning technologies such as Wi-Fi positioning, Bluetooth positioning, beacon positioning, pedestrian autonomous navigation positioning, RFID positioning, acoustic positioning, geomagnetic positioning, UWB (Ultra Wide Band) positioning, visible light positioning, and IMES (Indoor Messaging System) positioning, or a combination of these positioning methods. As an example of a positioning method using an information terminal indoors, a beacon function such as iBeacon (registered trademark) can be used to calculate the distance between multiple beacons and the information terminal based on the radio wave intensity from each beacon, and the location of the information terminal can be estimated by performing triangulation using the location information of the multiple beacons and the distance information from the information terminal. Information terminals located indoors can use this type of positioning method to obtain highly accurate location information.

[0035] This system can also be used with information terminals that do not have a positioning function. In the case of an information terminal that does not have a positioning function, the location information of the terminal can be registered in advance when the information terminal is registered with the ambient sound visualization system 1000, and the information terminals 110 to 190 whose location information has been registered transmit data of time information TD1101 and volume value SD1101 excluding the location information to the server 910 at regular time intervals.

[0036] Furthermore, even for devices with positioning capabilities, if there are problems with accuracy in a location where positioning accuracy is required, the device can be used without using the positioning function by registering the location information of the information terminal in advance. For example, we have described a method of using positioning functions such as beacons to improve positioning accuracy indoors, but this requires environmental preparation such as installing multiple beacons in each room, and accuracy will be poor in locations where such equipment is not available. In such cases, in environments with fixed seats such as offices or schools, the location of the information terminal can be registered in advance along with a diagram of the room layout, allowing for a method without using the positioning function.

[0037] Furthermore, when using each positioning function, problems such as increased communication and calculation volume of the information terminal and increased power consumption may occur. To avoid these problems, positioning can be omitted by registering the location of the information terminal in advance, thereby reducing communication volume, calculation volume, and power consumption.

[0038] Furthermore, time information TD1101 transmitted from the information terminal is not required to be transmitted. If time information TD1101 is not transmitted from the information terminal, when the server 910 receives the volume value SD1101 data, the data reception time is added as time information for the volume value SD1101 and is saved in the database of the server 910.

[0039] Next, an example of the configuration and functions of the server 910 in the ambient sound visualization system 1000 will be described. Fig. 5 is a block diagram showing the configuration of the server 910 as an example of a server. As shown in Fig. 5, the server 910 includes a control function unit 911, a communication function unit 912, a database function unit 913, a data calculation processing unit 914, and a screen display function unit 915. The control function unit 911 of the server 910 stores each piece of information received via the communication function unit 912 in the database function unit 913. The control function unit 911 of the server controls the display of screens to be displayed on the information terminal (the initial menu display in FIG. 6, the terminal registration screen in FIG. 10, the calibration setting screen in FIG. 11, the data management setting screen in FIG. 12, the volume drawing map generation input screen in FIG. 14, the volume drawing screen editing screen in FIG. 15, the monitoring notification setting screen in FIG. 16, the analysis screen in FIG. 17, the extracted information terminal list screen in FIG. 18, the contact screen in FIG. 19, and the data detail analysis setting screen in FIG. 20), as well as the input / output of these screens, and executes the "editing function" related to the volume drawing screen editing screen in FIG. 15. The setting values ​​set via the screens can be saved in the database function unit 913.

[0040] [Register pre-settings] Next, an example of the contents to be set in advance when implementing the ambient sound visualization system 1000 and the program will be described.

[0041] First, with reference to the drawings, we will explain an example of a method by which a user can register in advance map images, layout images of the interior of a building or room, etc., to be displayed on a volume drawing map that can be generated and displayed by the ambient sound visualization system 1000 and program.

[0042] When a user accesses the server 910 using an information terminal 110-190 (such as a PC, smartphone, or tablet) and displays the screen, an initial menu display screen 2001 like the example in Figure 6 is displayed, and various processes can be selected on that screen.

[0043] Pressing the Map / Place Registration button B013 on the initial menu display screen 2001 in Figure 6 displays the map / place registration menu, and pressing the Map Registration button displays a map image, allowing you to select an area on the map with a mouse or other device and register the area. When creating a volume drawing map, selecting a registered area also allows you to determine the drawing area of ​​the volume drawing map based on that area on the map. Figure 7 shows an example screen 2002 in which a volume drawing map is displayed on a specified map.

[0044] By displaying the map and location registration menu and pressing the location registration button, the user can send and register building layout plans, room layout plans, and other plans to the server. By entering the location information and altitude of three locations on the registered layout plan, the layout plan and location information can be linked and registered. The volume drawing map display screen 2003 shown in Figures 2 and 8, and the volume drawing map display screen 2004 shown in Figure 9, are example screens in which a layout plan and location information have been registered and a volume drawing map is displayed on the registered layout plan.

[0045] [How to register an information device] Next, a method for registering an information terminal required for configuring the ambient sound visualization system 1000 will be described.

[0046] The information terminals 110 to 190 that collect and transmit each piece of data used to generate the volume drawing map need to be registered in advance in the server 910 of the ambient sound visualization system 1000. From here, we will explain how to register each of the information terminals 110 to 190 in the ambient sound visualization system 1000 and how to correct differences in sensitivity of each microphone (a method for setting calibration of microphone input values).

[0047] A plurality of information terminals 110 to 190 are used to create the volume drawing map, but since the types of microphones in the information terminals 110 to 190 are different, the microphone sensitivities are different, and volume value data measured at different microphone sensitivities cannot be used as is. Therefore, it is necessary to register the differences in microphone sensitivities of the information terminals 110 to 190 in advance in the ambient sound visualization system 1000, and to set up the system so that when sounds of the same volume are input to each information terminal 110 to 190, they can be treated as the same volume level. This setting is called calibration setting here.

[0048] When the terminal registration button B014 is pressed on the initial menu display screen 2001 of FIG. 6, a terminal registration screen 2005 is displayed. FIG. 10 shows an example of the terminal registration screen 2005. When the device information registration button B041 is pressed, it is possible to register device information (information terminal name, user name, location of use, contact information, etc.). When the communication setting registration button B042 is pressed, it is possible to register communication settings (wired or wireless communication information settings, etc.). The registered device information and communication setting information are saved in the database function unit 913 of the server 910 of FIG. 5, and communication can be initiated between the registered information terminals 110 to 190 and the server 910, and the server side 910 can receive data (time, position, volume value) from the information terminals 110 to 190. When registering the location of use, you can choose to use information from the positioning function of the information terminals 110 to 190 or to fix the location information.If you choose to fix the location information, you can register the latitude, longitude, and altitude of the location information where the information terminal 110 to 190 is being used.

[0049] Pressing the calibration setting button B043 on the terminal registration screen 2005 displays the calibration setting screen. FIG. 11 shows an example of the calibration setting screen. On the calibration setting screen of FIG. 11, it is possible to register the sound pressure level (dB value) and the volume value of the information terminal at that time. The sound pressure level (dB value) is determined by placing a sound level meter or the like capable of measuring sound pressure level and the information terminal 110 to 190 to be registered in close proximity (both in an environment with the same volume level), and inputting the sound pressure level (dB value) indicated by the sound level meter or the like at that time into the sound pressure level item B051 in the sound pressure level designation setting on the calibration setting screen of FIG. 11, and then pressing the calibration setting button B052. The difference between the volume value data of the microphone input of the information terminal at the time the button was pressed and the input value in the sound pressure level item B051 can be registered as calibration information in the database function unit 913. When the data calculation processing unit 914 performs calculation processing for the volume drawing map, the registered calibration information is used to convert all volume values ​​of each information terminal (convert volume values ​​to sound pressure levels (dB values)) using the registered calibration information of each information terminal (the difference between volume values ​​and sound pressure levels), and then the calculation processing for drawing is performed.

[0050] In addition to the method of measuring and registering the sound pressure level (dB value) using a sound level meter or the like capable of measuring sound pressure level, if there is an information terminal 110-190 nearby in which the sound pressure level has already been registered, it is also possible to register the sound pressure level using the sound pressure level registration information of that information terminal 110-190.

[0051] Pressing the pull-down button B053 for the terminal selection item in the other terminal usage settings on the calibration setting screen 2006 in Fig. 11 displays a list of registered information terminals. (It is possible to prevent the display of information terminals that were set to private beforehand when the terminals were registered from this information terminal list.) From the list of registered information terminals displayed in the pull-down selection, select a registered information terminal near the information terminal 110-190 for which new calibration settings are to be made, and then press the registration button B054 using another terminal on the calibration setting screen 2006. This allows the difference between the volume value data of the microphone input of the information terminal for which new calibration settings are to be made at the time the button is pressed and the data-converted sound pressure level at that time of the selected and set information terminal to be registered as calibration information.

[0052] [Management settings for saved data] Next, an example of management settings for saved data will be described.

[0053] When the data management setting button B016 is pressed on the initial menu display screen 2001 in Fig. 6, a data management setting screen 2007 like the example screen shown in Fig. 12 is displayed. When the information terminal storage target setting button B061 is pressed, it is possible to set the information terminal on which data is to be stored, when the data storage period setting button B062 is pressed it is possible to set the data storage period, when the data storage amount limit setting button B063 is pressed it is possible to set the data to be deleted with priority when the storage amount limit is reached by pressing the data deletion target priority setting button B064, and when the log storage target process setting button B065 is pressed it is possible to set the target process content to be saved in the log.

[0054] [Details of data reception and storage on the server side] Next, a detailed example of the data reception and storage process on the server side will be explained.

[0055] 13 is a diagram showing an example of an outline of the processing flow and data flow in the information terminal 110 and the server 910. The top row shows the processing of the information terminal 110 and the processing of the server 910, and for the server 910, the processing of each of the communication function unit 912, control function unit 911, screen display function unit 915, data calculation processing unit 914, and database function unit 913 is further shown.

[0056] 13, data collection and transmission processing S1001 is executed in the information terminal 110, and data consisting of time information TD1101, position information LD1101, and volume value SD1101 acquired by the information terminal 110 is transmitted to the server 910 via the network, and data reception processing S1201 is executed in the communication function unit 912 of the server 910 to receive the data. The data is sent to the database function unit 913 by data storage request processing S1101 by the control function unit 911, and data storage processing D1301 is executed by the database function unit 913.

[0057] In this way, each information terminal to be monitored constantly transmits information to the server 910 at regular intervals, and the server 910 continuously receives and stores information from each information terminal 110 to 190.

[0058] [Example of user operation and operation screen for displaying the volume drawing map] Next, an example of a user's operation when wanting to display a volume drawing map and an example of an operation screen display at that time will be described.

[0059] When the user presses the volume drawing map creation button B011 on the initial menu display screen 2001 as shown in the example of Fig. 6, a volume drawing map generation input information screen 2008 as shown in the example of Fig. 14 is displayed. The volume drawing map generation input information screen 2008 is a screen on which the user can select and input the location B021, time B022, map type B023, etc. After inputting each item, when the map drawing button B024 is pressed, the information specified by the user (specified location information BD021, specified time information BD022, specified map type BD023) is sent to the server 910, and the server 910 performs processing for drawing the volume drawing map, and the volume drawing map 2000 as shown in Fig. 2 is displayed on the screen of the information terminal.

[0060] [Volume drawing map display processing] Next, an example of the display process of the volume drawing map will be described in detail.

[0061] Pressing the Volume Map Type Selection button B012 on the initial menu display screen in Figure 6 displays a screen where you can select the type of graph to use to display volume levels when generating a volume map. Examples of selectable graphs include a contour type (displaying only contour lines without color coding), a type that displays each contour line in a different color as shown in Figure 2, a volume display type (showing sound pressure levels at locations on the map as numerical values ​​as shown in Figure 8), and an area display type (showing sound pressure levels at locations on the map as numerical values ​​as shown in Figure 9), which divides the map into rectangular areas, calculates the average value for each rectangular area, and fills the rectangular area with a specific color based on the average value to indicate the volume level. Also, by selecting the animation display and selecting the display time range and cycle, for example, selecting the last 1 minute and 5-second cycle, the volume map will switch every second to display each volume map for every 5 seconds of the last minute. This display allows you to view the changes in volume levels and volume measurement locations as an animation. Alternatively, by selecting the data list display instead of a graph display, you can display a list of time and location information along with the numerical sound pressure level data at that time.

[0062] When the edit button B001 is pressed on a volume drawing map display screen such as that shown in Figures 2, 8, and 9, a volume drawing screen edit screen is displayed. Figure 15 shows an example of the volume drawing screen edit screen 2009. Buttons such as a graph type change button B031, a display target time change button B032, a volume drawing map screen print button B033, and a volume drawing map screen save button B034 are displayed. By pressing each button, it is possible to change various settings and perform various operations on this screen.

[0063] Next, an example of the processing contents and data flow of the information terminal and server when generating and displaying a volume drawing map will be explained using "(b) Flow from start of volume drawing map generation to display" in Figure 13.

[0064] When a user of the information terminal 110 accesses the server 910 and starts a volume drawing map generation request process S1002 by operating the information terminal screen (for example, by pressing the map drawing button B024 on the volume drawing map generation input information screen 2008 shown in FIG. 14 ), the server 910 receives a volume drawing map generation start request R1002 and request content data R1003 from the user through a data reception process S1202 of the communication function unit 912. The request content data R1003 is composed of designated location information BD021, designated time information BD022, and designated map type BD023, which the user designated on the volume drawing map generation input information screen 2008 of FIG. 14 . After receiving the volume drawing map generation start request R1002, the control function unit 911 executes a volume drawing map generation start process S1102, which causes the screen display function unit 915 to execute a volume drawing map generation process S1502.

[0065] The volume drawing map generation process S1502 passes the requested content data R1003 (designated location information BD021, designated time information BD022, designated map type BD023) from the user to the data calculation processing unit 914. The data calculation processing unit 914 starts the data extraction request process S1402 in accordance with the requested content data R1003, and the database function unit 913 executes the data extraction process D1302. The data extraction process D1302 searches for data within the specified time and position information range using the requested content data R1003 (designated location information BD021, designated time information BD022, designated map type BD023), which is user input information received from the data calculation processing unit 914, and extracts extracted data D1303 (data consisting of time information, position information, and volume value). The extracted data D1303 is returned from the data extraction process D1302 to the data calculation processing unit 914. In this way, data necessary to generate a volume drawing map in accordance with the user request is extracted from the saved data.

[0066] Next, the extracted data D1303 is converted into converted data D1304 by data calculation processing S1403 by the data calculation processing unit 914, and then processed into map data D1305 by map data processing S1404.

[0067] First, the data calculation process S1403 will be described. In the data calculation processing unit 914, the data calculation process S1403 converts all volume value data in the extracted data D1303 into sound pressure level values ​​using registered calibration information. The calibration information is information that has been registered in advance in the system using a calibration setting screen 2006 such as the example in FIG. 11. The difference between the volume value data of the microphone input of the information terminal and the sound pressure level data in the same environment is stored in a database as calibration information, and the data calculation process S1403 converts each volume value into each sound pressure level value using the value of that calibration information. In this way, the extracted data D1303 is converted into converted data D1304 (data composed of time information, position information, and sound pressure level values) that includes sound pressure level values.

[0068] Next, the map data processing S1404 will be described. The data calculation processing unit 914 processes the converted data D1304 into map data D1305 through the map data processing S1404. The map data processing S1404 groups each piece of converted data D1304 (data consisting of time information, position information, and sound pressure level values) by time based on the time information within the data, creating a data group with the same time information. The position information and sound pressure level values ​​of each piece of data in the data group are mapped onto a specified map range, with the position information of each piece of data serving as a coordinate point. The specified map range is the map range specified by the specified location information BD021 in the request content data R1003. As a result, sound pressure level distribution data is created in which the sound pressure level values ​​are plotted on a map. Furthermore, the map data processing S1404 performs different calculation processes depending on the type of graph specified by the specified map type BD023 data in the request content data R1003. In the case of a contour-type graph display, for example, calculation processing is performed to draw contour lines of sound pressure levels using distribution data of sound pressure level values ​​spread over a map. For example, in the case of processing to draw contour lines in 5 dB increments, the range of sound pressure level values ​​included in each 5 dB increment is calculated, and mapping information for drawing the range of that range (a list of coordinate points that make up the outer ring of the range) is created as generated data for graph drawing. Map data D1305 is generated in this way, consisting of sound pressure level distribution data in which sound pressure level values ​​are spread over a map, and the generated data for graph drawing required for graph display.

[0069] In this way, the data calculation processing unit 914 performs the data calculation process S1403 and the map data processing S1404, and generates the map data D1305 for the volume drawing map.

[0070] The data calculation processing unit 914 passes the map data D1305 to the screen display function unit 915, and the screen display function unit 915 starts map data display processing S1504 and generates an image D1306 for volume drawing map display from the map data D1305. The control function unit 911 starts map data transmission processing S1104, and the communication function unit 912 executes data transmission processing S1204 of the image D1306 for volume drawing map display. After the image D1306 is transmitted to the information terminal 110 in this manner and received by the information terminal 110, the information terminal 110 displays the volume drawing map on the screen using the received image D1306 by volume drawing map display processing S1004.

[0071] At this time, the information received on the information terminal 110 side may be an image D1306, URL information for displaying an image, or map data D1305 consisting of various information for mapping display, and the volume drawing map display process S1004 on the information terminal side has a function of displaying on the screen of the information terminal side according to the type of data received.

[0072] In this way, the screen display function unit 915 sends an image for displaying the volume drawing map to the user's information terminal, or sends the storage location of the image, such as a URL, to cause the information terminal to acquire the image, or sends map data composed of various information for mapping display, and the image is displayed on the information terminal side. As a result, the volume drawing map as shown in Figure 2 is displayed on the screen of the user's information terminal.

[0073] As described above, according to the first embodiment, it is possible to display a volume map on a map of a location within a range designated by a user or on a building plan using the volume values ​​of the microphone inputs of multiple information terminals and the location information of the information terminals, and it is possible to visually see the volume level at each location. It is possible to visually grasp the volume level at each location on the map or building plan.

[0074] In addition, by displaying and checking the volume drawing map, when broadcasting in a region or building, or when making a presentation on a stage, it is possible to visually grasp how far the sound is reaching using the volume drawing map.

[0075] If there is a noise problem, the source of the noise can be visually identified by displaying a volume plot map and identifying the locations with the highest volume levels.

[0076] [Second embodiment] Next, a second embodiment of the present invention will be described with reference to the drawings. The second embodiment of the present invention is an embodiment in which an ambient sound visualization system is used to automatically send a warning notification to an information terminal with a high volume value and its user.

[0077] It is possible to set up monitoring notifications in advance so that users of information terminals can be notified when the volume is too high. Notifications can be set to only specific information terminals, or to all registered information terminals in a specified room. The monitoring notification setting information is saved on the server side.

[0078] Pressing the monitor notification setting button B015 on the initial menu display screen 2001 in FIG. 6 displays a monitor notification setting screen 2010 like the example shown in FIG. 16, which allows the user to set the target terminal for notification, the type of trigger for notification, and the notification method. As shown in FIG. 16, the target terminal can be selected from a list of registered information terminals or a list of locations by pressing the target terminal selection pull-down button B071. If the location list is selected, a list of information terminals located in a specific location can be selected, or all information terminals located in that specific location can be selected. The type of trigger for notification can be set by pressing the trigger type selection pull-down button B072 shown in FIG. 16 to select "exceed threshold," and then entering the sound pressure level desired as the threshold in the threshold (sound pressure level) item B073 below. It is possible to set the notification to occur when the set sound pressure level is exceeded. In addition to the type of trigger being when the sound pressure level exceeds the threshold, it is also possible to set a trigger when a sound that is not too loud exceeds the threshold for several seconds consecutively. In this case, it is also possible to enter settings in the Threshold (Sound Pressure Level) item B073 and the Threshold Exceeded Continuous Time item B074. The method of notification for warning can be selected using the notification method selection pull-down button B075, and various methods can be set, such as email address, chat, or telephone call. By entering these settings and pressing the monitor notification setting registration button B076, the monitor notification settings are registered on the server, and the server will monitor the sound pressure level of the target information terminal according to the monitor notification settings, and if the sound pressure level exceeds the threshold, it will send a warning notification to the specified destination.

[0079] The notification information for alerting users may include information such as a URL or QR code (registered trademark) that can display a volume map for that time. For example, when a sound pressure level exceedance information email is sent to a user-specified email address, the email contains data such as the date and time when the sound pressure level exceeded, the location, device information, and the sound pressure level, as well as the URL information for the volume map for that date and time. By clicking the URL, the user can display and check the volume map for that date and time on a web screen. By checking the volume map, for example, if the information device they are using has the highest volume in the location, they can determine that the sound they generated (such as voice or mechanical noise) was loud. Alternatively, if an information device other than their own has a higher sound pressure level, they can confirm that the source of the loud sound is someone other than themselves. From the displayed volume map, users can use the edit and analysis buttons to view more detailed information, change the displayed data time, or view volume changes over time using an animation display.

[0080] As described above, according to this embodiment, a warning notification can be automatically sent to the person generating the noise or to people nearby. By checking the volume drawing map, a user who receives the warning notification can visually grasp the volume level in the area or room at that time and can investigate the source of the volume level.

[0081] [Third embodiment] Next, a third embodiment of the present invention will be described with reference to the drawings. The third embodiment of the present invention is an embodiment in which an ambient sound visualization system is used to perform data analysis and to manually send an alert notification.

[0082] When the analysis button B035 is pressed on the volume drawing screen editing screen 2009 such as the example shown in FIG. 15, an analysis screen is displayed. FIG. 17 shows an example of the analysis screen 2011. On the analysis screen 2011 of FIG. 17, it is possible to specify the conditions for the information terminals to be displayed (for example, the range of sound pressure levels for which a list of information terminals is to be displayed). For example, to set the target condition as data with a sound pressure level of 70 dB or higher, select "Specified sound pressure level extraction" using the target selection pull-down button B081, select "Specified sound pressure level or higher" using the range selection pull-down button B082, enter 70 (dB) in the sound pressure level specification item B083, and press the information terminal list display button B085. This searches for information terminals that have data with a sound pressure level of 70 dB or higher from among the information terminals present within the area of ​​the volume drawing map, and displays them as a list of extracted information terminals. In addition, the display order (ascending or descending) can be selected using the display order pull-down button B084 on the analysis screen 2011 in Figure 17. If descending order is selected and the information terminal list display button B085 is pressed, the extracted information terminal list screen will be displayed in descending order, starting with the information terminal with the highest sound pressure level.

[0083] An example of the extracted information terminal list screen 2012 displayed in this manner is shown in Figure 18. Pressing the contact button B091 for a specific information terminal on the extracted information terminal list screen 2012, as shown in the example of Figure 18, displays a contact screen for sending a warning notice, email, or the like to the user of that information terminal. Figure 19 shows an example of the contact screen 2013. As shown in this screen example, the target field B101 displays the information terminal for the row where the contact button B091 was pressed on the extracted information terminal list screen 2012. It is also possible to change the target information terminal by using the pull-down menu in the target field B101. If "Email" is selected using the pull-down button B102 in the contact method field, the destination details field B103 and destination name field B104 display the user's email address and user name, which were previously registered on the server when the information terminal specified in the target field B101 was registered. It is also possible to edit the email address and the destination name to be included in the email by directly entering the details in the destination details field B103 and destination name field B104.

[0084] Pressing the data detail analysis button B092 on the extracted information terminal list screen 2012 shown in Figure 18 displays a data detail analysis setting screen that allows for more advanced analysis. Figure 20 shows an example of the data detail analysis setting screen 2014. For example, on the data detail analysis setting screen 2014 in Figure 20, if you select "Voiceprint Data Comparison" using the determination method selection pull-down button B111, select "Maximum Sound Pressure Level" using the target terminal selection pull-down button B112, enter 10 seconds in the confirmation target time field B113, enter "2" in the maximum number of people to be confirmed field B114, select "User Name Display" using the display method selection pull-down button B115, and press the data detail analysis start button B116, it is possible to create voiceprint data from the volume value data of the information terminal with the highest sound pressure level, compare that voiceprint data with the voiceprint data of each user stored in the database function unit, and search for matches to identify the speaker of the loud voice. Here, voiceprint data is created from the volume data for the number of seconds entered in the verification time item B113. Furthermore, when comparing the voiceprint data with the voiceprint data of each user stored in the database function unit to search for a match, if the volume data contains the voices of multiple users, the upper limit of the number of identified users is set in the verification limit item B114. For example, if the verification limit is set to two, when searching for data with matching voiceprint data, the search process can be terminated once two users have been identified, thereby avoiding long analysis times. Furthermore, for identified speakers, the user's name is displayed as the analysis result, and a contact button is displayed for sending a warning notice or email to that user. Pressing this button displays the contact screen 2013 shown in Figure 19, allowing the user to send a notification. The voiceprint data can be registered in advance when registering an information terminal, or it can be automatically registered while the user is speaking (e.g., with the microphone turned on during an audio conference) while using the ambient sound visualization system.

[0085] As described above, according to this embodiment, the analysis function of the volume drawing map makes it possible to search for and display a list of information terminals and users closest to the noise source, and to identify the speaker by investigating the voiceprint contained in the noise. It is also possible to send a warning notice to the identified speaker. By checking the volume drawing map, a user who receives a warning notice can visually grasp the locations in the area or room where the volume level is high at that time, and can confirm where the source of the noise is located and whether the source is likely to be themselves or someone else.

[0086] Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and further modifications, substitutions, and adjustments can be made without departing from the basic technical concept of the present invention. For example, the network configurations, element configurations, and message expression formats shown in the drawings are examples to aid in understanding the present invention, and the present invention is not limited to the configurations shown in these drawings. Furthermore, in the following description, "A and / or B" means at least either A or B.

[0087] Furthermore, the procedure shown in the first embodiment can be realized by a program that causes a computer (9000 in FIG. 21) that functions as the ambient sound visualization system to realize the functions of the ambient sound visualization system. Such a computer is exemplified by a configuration that includes a CPU (Central Processing Unit) 9010, a communication interface 9020, a memory 9030, and an auxiliary storage device 9040 in FIG. 21. That is, the CPU 9010 in FIG. 21 executes a program that operates the ambient sound visualization system, and performs processing to update each calculation parameter stored in the auxiliary storage device 9040 or the like.

[0088] The memory 9030 is a RAM (Random Access Memory), a ROM (Read Only Memory), or the like.

[0089] That is, each unit (processing means, function) of the ambient sound visualization system shown in the first embodiment can be realized by a computer program that causes the processor of the computer to execute each of the above-mentioned processes using its hardware.

[0090] Finally, preferred embodiments of the present invention will be summarized. [First form] (See the first perspective ambient sound visualization system above) [Second form] In the ambient sound visualization system according to the first aspect, Each of the information terminals A request to start generating a volume drawing map and requested content data such as designated location information, designated time information, designated map type, etc. are transmitted to the server side; The server receiving a volume drawing map generation start request and the request content data, and extracting volume value data from a database function unit according to the request content data; The data processing unit of the server Converts the volume value to a sound pressure level value, Mapping the converted sound pressure level value onto a designated map range using the location information of the information terminal that transmitted the received data as a coordinate point; Performs calculations to display the type of graph specified by the requested data, creates different map data depending on the type of graph, The screen display function unit of the server generating an image for displaying a volume drawing map from the map data; the communication function unit of the server transmits the image, URL (Uniform Resource Locator) information for displaying the image, or the map data to the information terminal; The information terminal receiving the image, URL information for displaying the image, or the map data; displaying an image of the volume drawing map on a screen of the information terminal; It is preferable. [Third Form] In the ambient sound visualization system according to the first or second aspect, The server a layout plan registration unit for registering a map, a building layout plan, or a room layout plan in advance; a linking registration means for linking and registering location information and altitude information on the map, building interior layout plan, or room interior layout plan registered by the layout plan registration unit; and a location information registration means for registering the location information of the information terminal in advance when the information terminal is registered in the ambient sound visualization system, the database function unit receives and stores the location information of the information terminal when receiving the volume value from the information terminal; the data calculation processing unit uses the registered position information and altitude information registered by the linked registration means of the map, building interior layout plan, or room interior layout plan registered in advance by the layout plan registration unit, and maps the position information of the information terminal stored in the database function unit and sound pressure level data calculated from the volume value onto the map, building interior layout plan, or room interior layout plan, to create a graphic display of the sound pressure level of a volume drawing map. It is preferable. [Fourth Form] (See the second perspective ambient sound visualization system above) [Fifth Form] In the ambient sound visualization system according to the first to fourth aspects, the database function unit of the server continuously stores received data of volume values ​​input from the plurality of information terminals via the microphone input function unit; It is preferable that the server further includes a setting means for setting, by operations on a screen that allows data management settings, the target terminal for saving data, the data saving period, the upper limit of the amount of data that can be saved, the data to be preferentially deleted when the upper limit of the amount of data that can be saved, the target processing contents to be saved in the log, etc. [Sixth Form] In the ambient sound visualization system according to the first to fifth aspects, The server Specify threshold exceedance as the type of trigger to be notified, specify a sound pressure level threshold, and set it to notify when the specified sound pressure level is exceeded, or The device further includes means for specifying a sound pressure level threshold and a continuous time period during which the threshold is exceeded, and for setting a notification to be issued when the specified sound pressure level and the specified continuous time period exceed the threshold, The server registering the setting contents set by the setting means in the server; It is preferable. [7th form] In the ambient sound visualization system according to the second aspect, By accessing the server from the information terminal and operating the screen displayed on the information terminal, It is preferable that the control function unit of the server executes editing functions for the volume drawing map displayed on the screen of the information terminal, such as changing the graph type of the volume drawing map, changing the display time, and changing the settings for printing the volume drawing map screen and saving the volume drawing map screen. [8th form] (See above for how to operate the ambient sound visualization system from the third perspective) [9th Form] (See the fourth perspective program above) [10th Form] In the ambient sound visualization system according to the fourth aspect, the server further A means for registering device information of the information terminal (information terminal name, user name, location of use, contact information, etc.) and communication settings (wired or wireless communication information settings, etc.); Regarding location information, you can choose to use the information from the positioning function of the information terminal or to use fixed location information. If you choose to use fixed location information, you will need a means to register the latitude, longitude, and altitude of the location information using the information terminal. a means for registering calibration information of another information terminal by using volume value data of an information terminal in which the calibration information has already been registered; It is preferred that the compound contains: [11th Form] In the ambient sound visualization system according to the sixth aspect, The server further comprises: On-screen operations allow you to set up monitoring notifications. a means for selecting a target terminal for which monitoring notification setting is to be performed from a list of registered information terminals or a list of locations and setting the target terminal; When a list of locations is selected, a means for selecting from a list display of information terminals present in a specific location and setting them as targets, and a means for selecting all information terminals present in the specific location and setting them as targets; and a means for setting an email address, chat, or telephone call method as a notification method for alerting; The function to register these settings on the server, According to these settings, the function to automatically send a warning notification when the target information device exceeds the sound pressure level threshold, The notification information for warning includes data such as the date and time when the sound pressure level was exceeded, the location, device information, and sound pressure level, as well as a function to include URL information and QR code information for the volume map of that date and time. By accessing the server using the URL or QR code, you can display a volume map of that date and time on the web screen. From the displayed volume map, you can use the edit and analysis buttons to check more detailed information, change the time period of the data to be displayed, check the volume changes over time by displaying the animation, and save each data. It is preferred that the compound contains: [12th Form] In the ambient sound visualization system according to the seventh aspect, The server further a function of transmitting URL information or map data for displaying an image or image data of a volume drawing map to the information terminal and displaying the volume drawing map on the screen of the information terminal; The server further comprises: By accessing the server from an information terminal and operating the screen displayed, An editing function that allows you to change the graph type of the volume drawing map displayed on the information terminal screen, change the display time, change settings such as printing the volume drawing map screen, saving the volume drawing map screen, and perform various operations. an analysis function that, when specifying an information terminal having a sound pressure level equal to or higher than a specified level as a condition for displaying a list of information terminals and performing an operation for displaying the list of information terminals, searches for information terminals that have data with a sound pressure level equal to or higher than the specified level among the information terminals present in the area of ​​the volume drawing map, and displays the extracted information terminals as a list; When displaying a list of extracted information terminals, the display order (ascending or descending) can be selected, and the extracted information terminal list screen can be displayed in the specified order. As a more advanced analysis method, the voiceprint data for the number of seconds specified by an on-screen operation can be created from the volume value data of the information terminal with the highest sound pressure level, and this voiceprint data can be compared with the voiceprint data of each user stored in the database to search for matches, thereby making it possible to identify the speaker of the loud voice. When comparing voiceprint data with the voiceprint data of each user stored in the database to search for a match, if the volume data contains the voices of multiple users, a function to specify an upper limit for the number of specific users and terminate the search process when the specified number of users has been identified, thereby avoiding long analysis times; Regarding voiceprint data, the voiceprint of the terminal user can be registered in advance when registering the information terminal, or the voiceprint can be automatically registered while the user is using the system and speaking (for example, when the microphone is turned on and the user is speaking during an audio conference). The speaker identified in this way will have the function to display the user's name as an analysis result, and A function of displaying a contact screen for sending the warning notice, e-mail, etc. to the user of the information terminal by designating the specific information terminal and pressing a contact button from the extracted information terminal list screen or user name list screen as the analysis result from the voiceprint data displayed in this way, and sending the warning notice, e-mail, etc. to the user of that information terminal by editing the user's contact information registered in advance on the server when the information terminal was registered or by editing the contact information directly on the screen; It is preferred that the compound contains:

[0091] The disclosures of the above-mentioned patent documents are incorporated herein by reference. Modifications and adjustments of the embodiments and examples are possible within the scope of the entire disclosure of the present invention (including the scope of the claims), and further based on the basic technical concept thereof. Furthermore, various combinations and selections of the various disclosed elements (including each element of each claim, each element of each embodiment or example, each element of each drawing, etc.) are possible within the scope of the disclosure of the present invention. In other words, the present invention naturally includes various modifications and alterations that would be possible by a person skilled in the art in accordance with the entire disclosure and technical concept, including the scope of the claims. In particular, with regard to the numerical ranges described herein, any numerical value or subrange included within the range should be construed as being specifically described, even if not otherwise specified. [Explanation of symbols]

[0092] 10 Network 100 Surveillance Room 110~190 Information terminal 111 Control Function Unit 112 Clock function unit 113 Positioning function unit 114 Microphone input function unit 115 Communication function unit 900 Server Room 910 Server 911 Control Function Unit 912 Communication function unit 913 Database Function Department 914 Data Processing Unit 915 Screen display function section 1000 Ambient Sound Visualization System 2000 Volume Drawing Map 9000 computers 9010 CPU 9020 Communication Interface 9030 Memory 9040 Auxiliary storage device

Claims

1. an information terminal including a microphone input function unit and capable of data communication; a server located on the Internet that can transmit and receive data to and from each of the information terminals; An ambient sound visualization system comprising: the information terminal transmits data of the volume value input by the microphone input function unit to the server at regular time intervals; The server a database function unit that receives data of volume values ​​inputted by the microphone input function unit from each of the information terminals and stores the data; a data calculation processing unit that maps the data on a map and creates map data of a volume drawing map of the ambient sound; a screen display function unit that generates an image of a volume drawing map to be displayed on the information terminal side from the map data; a control function unit that controls the database function unit, the data calculation processing unit, and the screen display function unit; a communication function unit connected to the control function unit and configured to transmit an image of the volume drawing map to the information terminal via the Internet; An ambient sound visualization system comprising: The control function unit of the server The system further includes means for registering the difference between the volume value of each information terminal and the input sound pressure level (dB value) at that time in the database function unit as calibration information, The data processing unit of the server Using the calibration information, convert the volume value into a sound pressure level (dB value) to correct for differences in microphone sensitivity of the volume value of each of the information terminals; Creating map data for a volume drawing map using the sound pressure level corrected for the difference in microphone sensitivity, The registering means registers as calibration information the difference between the volume value of the information terminal for which new calibration settings are to be made and the converted sound pressure level of another selected information terminal that has already registered the calibration information.

2. Each of the information terminals A request to start generating a volume drawing map, and request content data including designated location information, designated time information, and designated map type are transmitted to the server side; The server receiving a volume drawing map generation start request and the request content data, and extracting volume value data from a database function unit according to the request content data; The data processing unit of the server Converts the volume value to a sound pressure level value, Mapping the converted sound pressure level value onto a designated map range using the location information of the information terminal that transmitted the received data as a coordinate point; Performs calculations to display the type of graph specified by the requested data, creates different map data depending on the type of graph, The screen display function unit of the server generating an image for displaying a volume drawing map from the map data; the communication function unit of the server transmits the image, or URL (Uniform Resource Locator) information for displaying the image, or the map data to the information terminal; The information terminal receiving the image, URL information for displaying the image, or the map data; displaying an image of the volume drawing map on a screen of the information terminal; 2. The ambient sound visualization system according to claim 1 .

3. The server a layout plan registration unit for registering a map, a building layout plan, or a room layout plan in advance; a linking registration means for linking and registering location information and altitude information on the map, building interior layout plan, or room interior layout plan registered by the layout plan registration unit; and a location information registration means for registering the location information of the information terminal in advance when the information terminal is registered in the ambient sound visualization system, the database function unit receives and stores the location information of the information terminal when receiving the volume value from the information terminal; the data calculation processing unit uses the registered position information and altitude information registered by the linked registration means of the map, building interior layout plan, or room interior layout plan registered in advance by the layout plan registration unit, and maps the position information of the information terminal stored in the database function unit and sound pressure level data calculated from the volume value onto the map, building interior layout plan, or room interior layout plan, to create a graphic display of the sound pressure level of a volume drawing map.

3. The ambient sound visualization system according to claim 1 or 2.

4. the database function unit of the server continuously stores received data of volume values ​​input from the plurality of information terminals via the microphone input function unit; 4. The ambient sound visualization system according to claim 1, wherein the server further includes setting means for setting, by operations on a screen that allows data management settings, the target terminal for saving data, the period for saving data, the upper limit for the amount of data that can be saved, the data to be preferentially deleted when the upper limit for the amount of data that can be saved is reached, and the target processing content to be saved in a log.

5. The server Specify threshold exceedance as the type of trigger to be notified, specify a sound pressure level threshold, and set it to notify when the specified sound pressure level is exceeded, or The device further includes means for specifying a sound pressure level threshold and a continuous time period during which the threshold is exceeded, and for setting a notification to be issued when the specified sound pressure level and the specified continuous time period exceed the threshold, The server registering the setting contents set by the setting means in the server; 5. The ambient sound visualization system according to claim 1, wherein the ambient sound visualization system is a system for visualizing ambient sounds.

6. By accessing the server from the information terminal and operating the screen displayed on the information terminal, 3. The ambient sound visualization system according to claim 2, wherein the control function unit of the server executes editing functions for the volume drawing map displayed on the screen of the information terminal, such as changing the graph type of the volume drawing map, changing the display target time, and changing settings for printing the volume drawing map screen and saving the volume drawing map screen.

7. an information terminal including a microphone input function unit and capable of data communication; a server located on the Internet that can transmit and receive data to and from each of the information terminals; A method of operating an ambient sound visualization system, comprising: a step in which the information terminal transmits data of the volume value inputted by the microphone input function unit to the server at regular time intervals; The server: receiving data of volume values ​​inputted by the microphone input function unit from each of the information terminals, and storing the data in a database function unit; Mapping the data on a map to create map data of a volume drawing map of ambient sound; generating an image of a volume drawing map to be displayed on the information terminal side from the map data; communicating an image of the volume drawing map to the information terminal via the Internet; 1. A method comprising: The server: The method further includes a step of registering a difference between the volume value of each information terminal and the sound pressure level (dB value) input value at that time in the database function unit as calibration information, The server: a step of converting the volume value into a sound pressure level (dB value) using the calibration information and correcting a difference in microphone sensitivity of the volume value of each of the information terminals; creating map data for a volume drawing map using the sound pressure level corrected for the difference in microphone sensitivity; The method includes a step of registering as calibration information the difference between the volume value of the information terminal for which new calibration settings are to be made and the converted sound pressure level of another selected information terminal for which the calibration information has already been registered.

8. an information terminal including a microphone input function unit and capable of data communication; a server that is located on the Internet and is capable of transmitting and receiving data to and from each of the information terminals; a process of receiving data of volume values ​​inputted by the microphone input function unit and transmitted at regular time intervals from each of the information terminals, and storing the data in a database function unit; A process of mapping the data on a map to create map data of a volume drawing map of ambient sound; A process of generating an image of a volume drawing map to be displayed on the information terminal side from the map data; a process of communicating an image of the volume drawing map to the information terminal via the Internet; A program for executing The server, further executing a process of registering the difference between the volume value of each information terminal and the input sound pressure level (dB value) at that time in the database function unit as calibration information; The server, A process of converting the volume value into a sound pressure level (dB value) using the calibration information and correcting the difference in microphone sensitivity of the volume value of each of the information terminals; A process of creating map data of a volume drawing map using the sound pressure level corrected for the difference in microphone sensitivity; A program that executes a process of registering as calibration information the difference between the volume value of an information terminal for which new calibration settings are to be made and the converted sound pressure level of another selected information terminal that has already registered the calibration information.

Images