Server, processing method and program

Abstract

To provide a technique that allows for further improving convenience of users trying to recognize a detection target.SOLUTION: A server is provided, comprising a control unit configured to provide control to analyze intensity of sensor data for each sensor data frequency and sensor data acquisition time using the sensor data received from the sensor, obtain an analysis result, and provide a terminal with the analysis result.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a server, a processing method, and a program. [Background technology]

[0002] In recent years, technologies for detecting a detection target using a sensor have become known. For example, a technology is known in which frequency components belonging to each of a plurality of frequency ranges are extracted from frequency components constituting an acoustic signal detected by a plurality of microphones (see, for example, Patent Document 1). In this technology, the extracted frequency components are displayed in different colors for each frequency range. This technology allows a user to intuitively recognize that a specific detection target has been detected. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-85386 Summary of the Invention [Problem to be solved by the invention]

[0004] However, it is desirable to provide a technology that can further improve the convenience of users who are trying to recognize a detection target. [Means for solving the problem]

[0005] In order to solve the above problem, according to one aspect of the present invention, a control unit is provided that analyzes the intensity of sensor data received from a sensor for each frequency of the sensor data and for each time the sensor data was obtained, obtains an analysis result, and controls to provide the analysis result to a terminal. The control unit determines a time width from the start to the end of the analysis result to be displayed depending on the type of detection object detected based on the sensor data, the sensor is an acoustic sensor, and the sensor data is sound obtained by the acoustic sensor. A server is provided.

[0006] The control unit may determine, based on the sensor data, whether or not the intensity of the sensor data is greater than a first threshold value for each frequency and each time, and obtain the result of the determination as the analysis result.

[0007] The control unit may detect, based on the sensor data, a first frequency band in which the intensity of the sensor data is greater than the first threshold, and detect a first object to be detected based on the fact that the first frequency band is wider than the first band.

[0008] The control unit may detect, based on the sensor data, a first time at which there is a frequency at which the intensity of the sensor data is greater than the first threshold, and detect, as the first frequency band, a frequency band at which the intensity of the sensor data at a second time that is a predetermined time after the first time is greater than the first threshold.

[0009] The control unit may perform control such that, based on the detection of the first object to be detected, identification information corresponding to information related to the detection is given to the terminal.

[0010] The first detection object may be a ship.

[0011] The control unit may detect a second detection target based on a model generated in advance by machine learning and the analysis result.

[0012] The control unit may detect the second object to be detected based on the fact that a detection probability of the second object to be detected output based on the model and the analysis result is greater than a predetermined probability.

[0013] The control unit may perform control such that, based on the detection of the second object to be detected, identification information corresponding to information related to the detection is given to the terminal.

[0014] The second object to be detected may be a diver.

[0015] The control unit may detect, based on the sensor data, a second frequency band in which the intensity of the sensor data is greater than a second threshold, and cancel the detection of the second object to be detected based on the second frequency band being wider than the second band.

[0016] The control unit may detect, based on the sensor data, a time during which the intensity of the sensor data is greater than a second threshold, and cancel detection of the second object to be detected based on the time being shorter than a predetermined time.

[0017] The control unit may perform control such that information related to the detection is provided to the terminal based on a transmission request based on the identification information received from the terminal that has received the identification information.

[0018] The information relating to the detection may include a map according to the position of the sensor.

[0019] The control unit may perform control such that the analysis result is provided to the terminal based on a request to transmit the analysis result from the terminal.

[0020] The control unit may, upon receiving a request from the terminal to send the analysis results, control the terminal to provide the analysis results and at least one of air pressure, water temperature, and wind force according to the position of the sensor.

[0022] The sensor data may be detected by a sensor unit included in the sensor, and the sensor unit may be present in water. The control unit may receive a request to play the sound from the terminal. The control unit may receive a download request for the voltage of the power supply unit of the sensor from the terminal. The control unit may receive a request to download the position of the sensor from the terminal.

[0023] According to another aspect of the present invention, based on sensor data received from a sensor, the strength of the sensor data is analyzed for each frequency of the sensor data and for each time the sensor data was obtained, and an analysis result is obtained, and the analysis result is provided to a terminal. determining a time width from the start to the end of the analysis result to be displayed according to the type of the detection target detected based on the sensor data; Including fruit , the sensor is an acoustic sensor, and the sensor data is sound obtained by the acoustic sensor. A processing method is provided.

[0024] According to another aspect of the present invention, a computer is controlled to analyze the intensity of the sensor data received from a sensor for each frequency of the sensor data and each time the sensor data was obtained, to obtain an analysis result, and to provide the analysis result to a terminal. determining a time width from the start to the end of the analysis result to be displayed according to the type of the detection target detected based on the sensor data; A program to run the sensor is an acoustic sensor, and the sensor data is a sound obtained by the acoustic sensor. is provided. [Effects of the Invention]

[0025] As described above, according to the present invention, it is possible to further improve convenience for users who are trying to recognize a detection target. [Brief explanation of the drawings]

[0026] [Figure 1] 1 is a diagram illustrating an example of the configuration of an IoT system for preventing poaching according to an embodiment of the present invention. [Figure 2] FIG. 1 is a diagram illustrating an example of the configuration of an underwater acoustic sensor. [Figure 3] FIG. 2 is a diagram illustrating an example of a functional configuration of a server according to an embodiment of the present invention. [Figure 4] FIG. 10 is a diagram illustrating an example of sensor information. [Figure 5] FIG. 10 is a diagram illustrating an example of notification destination information. [Figure 6] FIG. 2 is a diagram illustrating an example of a functional configuration of a supervisor terminal according to an embodiment of the present invention. [Figure 7] FIG. 2 is a diagram showing a first example of a spectrogram obtained by analysis by the analysis unit. [Figure 8] FIG. 10 is a diagram showing a second example of a spectrogram obtained by analysis by the analysis unit. [Figure 9] 10A and 10B are diagrams illustrating examples of sound patterns obtained by analysis by an analysis unit. [Figure 10] FIG. 10 is a diagram illustrating an example of a detection email. [Figure 11] FIG. 10 is a diagram showing an example of a detection screen when a detection target is detected by one underwater acoustic sensor. [Figure 12] FIG. 10 is a diagram illustrating an example of a spectrogram displayed by the monitor terminal. [Figure 13] 10A and 10B are diagrams illustrating examples of sound patterns displayed by the monitor terminal. [Figure 14] FIG. 10 is a diagram illustrating an example in which a selection operation of a display switching object is input. [Figure 15] FIG. 10 is a diagram showing an example in which the additional information display area is scrolled. [Figure 16] 10A and 10B are diagrams illustrating an example in which a selection operation of an additional information display switching button is input. [Figure 17] 1 is a flowchart illustrating an example of the operation of the anti-poaching IoT system according to the embodiment of the present invention. [Figure 18] FIG. 1 is a diagram illustrating a hardware configuration of an information processing apparatus as an example of a server according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0027] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant explanations will be omitted.

[0028] Furthermore, in this specification and drawings, multiple components having substantially the same functional configuration may be distinguished by adding different numbers after the same reference numeral. However, if there is no particular need to distinguish between multiple components having substantially the same functional configuration, only the same reference numeral will be used. Furthermore, similar components in different embodiments may be distinguished by adding different letters after the same reference numeral. However, if there is no particular need to distinguish between similar components in different embodiments, only the same reference numeral will be used.

[0029] [0. Overview] First, an outline of the embodiment of the present invention will be described.

[0030] In recent years, technologies for detecting a detection target using a sensor have become known. For example, a technology is known in which frequency components belonging to each of a plurality of frequency ranges are extracted from frequency components constituting an acoustic signal detected by a plurality of microphones (see, for example, Patent Document 1). In this technology, the extracted frequency components are displayed in different colors for each frequency range. This technology allows a user to intuitively recognize that a specific detection target has been detected.

[0031] In the embodiment of the present invention, a technique that can further improve the convenience of a user who is trying to recognize a detection target is mainly proposed. More specifically, the embodiment of the present invention focuses on the fact that the temporal change in the intensity of sensor data for each frequency differs depending on the detection target.

[0032] In more detail, in an embodiment of the present invention, the strength of the sensor data is analyzed for each frequency of the sensor data and each time the sensor data was obtained, and an analysis result is obtained. The analysis result is then transmitted to the terminal. This allows the user to check the analysis result, in which the strength of the sensor data is analyzed for each frequency and each time, using the terminal, and is expected to further improve user convenience.

[0033] In the embodiments of the present invention, it is mainly assumed that an acoustic sensor is used as the sensor. That is, in the embodiments of the present invention, it is mainly assumed that a detection target is detected by detecting a sound emitted by the detection target from sensor data (sound data) obtained by the acoustic sensor. However, the sensor is not limited to an acoustic sensor, and may be a sensor other than an acoustic sensor (for example, an image sensor, radar, laser sensor, ultrasonic sensor, etc.). Even when a sensor other than an acoustic sensor is used as the sensor, the detection target can be detected by detecting the characteristics of the detection target from the sensor data, just as in the case where an acoustic sensor is used as the sensor.

[0034] Various objects are conceivable as detection targets. For example, it is conceivable that the detection targets may be various objects used in poaching. Examples of various objects used in poaching include poaching boats and poachers. This allows the user to monitor poaching. The importance of monitoring poaching is clear in light of the scale of damage caused by poaching in recent years and the difficulty of detecting poaching. For example, the Japan Coast Guard's annual report, "Maritime Safety Report 2018" (http: / / www.kaiho.mlit.go.jp / info / books / report2018 / html / honpen / 2_04_chap3.html), states, "The rich marine resources in the waters surrounding Japan are by no means inexhaustible. In order to maintain the balance of the ecosystem and prevent the depletion of marine resources, rules have been established, such as restrictions on catch amounts, fishing methods, areas, and periods. However, illegal fishing by some fishermen who do not follow the rules, and overfishing of marine resources by organized crime groups seeking to secure funds, continue to occur. ...The Japan Coast Guard will further improve its surveillance capabilities and enhance its document collection equipment, etc., in an effort to strictly monitor and crack down on increasingly malicious and sophisticated poaching crimes. Furthermore, by continuing to work closely with related agencies and fishing-related organizations, we will promote comprehensive anti-poaching measures, such as preventive measures tailored to the characteristics of each region, and strive to maintain order in the fishing industry." Therefore, by detecting poaching vessels or poachers, the embodiment of the present invention aims to solve a social problem, and the embodiment of the present invention can be implemented more suitably.

[0035] Here, poaching is generally understood as "fishing secretly in violation of the law" (Daijirin), and can be interpreted as fishing without a license or permit, violating various laws and regulations that stipulate fishing bans or prohibited fishing methods, or violating fishing rights. For example, the Kyoto Prefectural Fisheries Office, a branch of the Kyoto Prefectural Agriculture, Forestry and Fisheries Department that handles business related to the fisheries industry, states that "poaching is the taking of organisms that are subject to fishing rights without permission" (https: / / www.pref.kyoto.jp / suiji / documents / mitsuryou.pdf).

[0036] For example, the difficulty of detecting poaching lies in the following reasons: Poaching often occurs at night in dark environments. This makes it difficult for security guards to detect poaching vessels and poachers visually or with cameras. Furthermore, poor visibility during bad weather conditions (e.g., snowfall, typhoons, sea fog, swells, high waves, etc.) makes it difficult for security guards to detect poaching vessels and poachers visually or with cameras, even during the day. Furthermore, poaching of marine resources found on the seabed (e.g., sea cucumbers, sea urchins, turban shells, abalone, oysters, pearls, etc.) is often carried out by poachers diving, making it difficult for security guards to monitor the poaching of resources found on the seabed visually or with cameras.

[0037] Considering the difficulty of detecting such poaching, it is desirable to use an acoustic sensor when poaching vessels or poachers are the target of detection. The reason for this is that the accuracy of sensing by an acoustic sensor is hardly affected by the brightness of the environment (time of day) or the visibility (weather conditions). Furthermore, if the sensing unit of the acoustic sensor is located underwater, the acoustic sensor can easily detect poachers attempting to harvest resources present in the sea. Hereinafter, an acoustic sensor with a sensing unit located underwater will also be referred to as an "underwater acoustic sensor."

[0038] In the following, it is mainly assumed that the user is an "observer" who monitors poaching, and the user's terminal is an "observer terminal" used by the observer.

[0039] The outline of the embodiment of the present invention has been described above.

[0040] [1. Details of the embodiment] Next, details of the embodiment of the present invention will be described.

[0041] [1-1. System Configuration] First, an example of the configuration of a system according to an embodiment of the present invention will be described. In the following, it is assumed that the system according to an embodiment of the present invention is used to combat poaching, and the system according to an embodiment of the present invention will also be referred to as an "anti-poaching IoT (Internet of Things) system." However, the system according to an embodiment of the present invention may also be used for purposes other than combating poaching (i.e., the system according to an embodiment of the present invention is not limited to an IoT system).

[0042] FIG. 1 is a diagram showing an example of the configuration of an IoT system for preventing poaching according to an embodiment of the present invention. As shown in FIG. 1, the IoT system 1 for preventing poaching includes underwater acoustic sensors 10-1 to 10-N (N is an integer equal to or greater than 1), a server 20, and monitor terminals 30-1 to 30-M (M is an integer equal to or greater than 1). In the following, when there is no need to distinguish between the underwater acoustic sensors 10-1 to 10-N, each of the underwater acoustic sensors 10-1 to 10-N will also be referred to as an "underwater acoustic sensor 10." Similarly, when there is no need to distinguish between the monitor terminals 30-1 to 30-M, each of the monitor terminals 30-1 to 30-M will also be referred to as an "monitor terminal 30."

[0043] In the embodiment of the present invention, it is mainly assumed that each of the supervisor terminals 30-1 to 30-M is used by a different supervisor. However, there may be cases where multiple supervisor terminals 30 are used by a single supervisor, or where a single supervisor terminal 30 is used by multiple supervisors.

[0044] In the embodiment of the present invention, it is assumed that the underwater acoustic sensor 10 communicates with a server 20 located on the Internet via a mobile network such as an LTE (Long Term Evolution) network. However, the underwater acoustic sensor 10 may also be capable of communicating with the server 20 via other communication means such as multi-hop wireless communication means.

[0045] On the other hand, the server 20 can be realized by a computer having server functions.

[0046] In addition, in the embodiments of the present invention, it is mainly assumed that the monitor terminal 30 is configured as a smartphone. However, the monitor terminal 30 may also be realized by other devices such as a tablet terminal, a mobile phone, a business phone (key telephone), a PDA (Personal Digital Assistant), an audio player, a printer, a facsimile, a scanner, a copier, a digital camera, an automated device (such as an ATM (cash matine) that is used by an unspecified number of people and automatically handles items, a vending machine, an automatic ticket vending machine, or a kiosk terminal), a cash processing machine (a terminal that manages cash deposits and withdrawals), a wearable computer, or a car navigation system. The monitor terminal 30 may communicate with the server 20 via wireless communication via a mobile network such as an LTE network or via wired communication via a wired network such as a LAN (Local Area Network).

[0047] [Underwater Acoustic Sensor 10] The underwater acoustic sensor 10 obtains sensor data (acoustic data) by sensing the environment. The underwater acoustic sensor 10 also obtains information (sensor status information) indicating its own status (for example, normal, faulty, or unknown status). After obtaining the sensor data and sensor status information, the underwater acoustic sensor 10 transmits the sensor data and sensor status information to the server 20. The data format of the sensing data and sensor status information transmitted to the server 20 is not limited, and may be, for example, CSV (Comma-Separated Values), TSV (Tab-Separated Values) file, SSV (Space-Separated Values), SSV (Semicolon-Separated Values), HTML (HyperText Markup Language), XML (Extensible Markup Language), XHTML (Extensible HyperText Markup Language), or a database format such as dBASE or SQL (Structured Query Language).

[0048] Here, "sensing" is used to refer to the detection of estimated quantities such as sound, vibration (vibration), temperature, humidity, and tilt (detection of increase / decrease, amount of change, or occurrence), as well as the detection of occurrences such as smoke, chemical substances, and static electricity (detection of increase / decrease, amount of change, or estimated quantity). Furthermore, "sensing" is used to refer not only to detection, but also to the process of converting the detected content into a signal. Furthermore, "sensing" is used to refer not only to detection, but also to measuring and determining the detected content.

[0049] In an embodiment of the present invention, it is assumed that the underwater acoustic sensor 10 includes multiple acoustic sensors (microphones). This makes it possible to identify the direction of a sound source relative to the installation position of the underwater acoustic sensor 10 based on the sound detection results of each of the multiple acoustic sensors. Here, the specific configuration of the underwater acoustic sensor 10 is not limited. An example configuration of the underwater acoustic sensor 10 will be described below.

[0050] Fig. 2 is a diagram showing an example configuration of the underwater acoustic sensor 10. Referring to Fig. 2, the underwater acoustic sensor 12, which is an example of the underwater acoustic sensor 10, includes, from top to bottom, a transmitting buoy unit 170, a sinker 181, a float 182, a sensing unit 130, a mooring unit 150, a power supply unit 140, and a sinker unit 160. However, the arrangement order of these components is not limited to the example shown in Fig. 2. Furthermore, an antenna unit 110, a searchlight unit 121, an anchoring light unit 122, and a solar cell 123 are provided above the sea surface in the transmitting buoy unit 170.

[0051] The sensing unit 130 is an acoustic sensor located underwater and senses the water. The sensing unit 130 obtains sensor data (acoustic data) through this sensing. The transmitting buoy unit 170 is subject to buoyancy to the extent that the antenna unit 110 is positioned above the sea surface. The antenna unit 110 transmits the sensor data transmitted from the sensing unit 130 via a cable and sensor status information of the underwater acoustic sensor 12 to the server 20 via wireless communication.

[0052] The sinker 181 and the float 182 allow the transmitting buoy unit 170 to move within a certain range near the sea surface by flexing and stretching the rope (including the cable) connecting the sensing unit 130 and the transmitting buoy unit 170. The mooring unit 150 tethers the underwater acoustic sensor 12 (excluding the power supply unit 140 and the sinker unit 160) to the power supply unit 140. This allows the underwater acoustic sensor 12 to sink to the seabed. The power supply unit 140 supplies power to the antenna unit 110, the sensing unit 130, the searchlight unit 121, and the mooring light unit 122.

[0053] For example, the power supply unit 140 may have a timer function that automatically stops supplying power during operating hours (for example, between 9:00:00 and 15:00:00 when fishing is taking place) and automatically starts supplying power outside of operating hours (for example, between 15:00:01 and 8:59:59 when fishing is not taking place). This can prevent legitimate boats and legitimate divers from being mistakenly detected as detection targets.

[0054] As will be explained later, if the underwater acoustic sensor 12 has a position detection function (for example, a position detection function using a GPS (Global Positioning System)), the position of the underwater acoustic sensor 12 obtained by this position detection function can be transmitted from the underwater acoustic sensor 12 to the server 20. For example, the position of the underwater acoustic sensor 12 may be transmitted from the underwater acoustic sensor 12 to the server 20 at predetermined time intervals (for example, every second). Furthermore, the position of the underwater acoustic sensor 12 may be transmitted from the underwater acoustic sensor 12 to the server 20 periodically (for example, every hour) even during operation hours. In this case, the GPS antenna may be provided below the antenna unit 110, for example, but the location where the GPS antenna is provided is not limited.

[0055] The mooring unit 150 tethers the underwater acoustic sensor 12 (excluding the weight unit 160) to the weight unit 160. This causes the underwater acoustic sensor 12 to sink to the seabed. The weight unit 160 is an object heavy enough to be positioned on the seabed, and may be any object that sinks to the seabed and keeps the underwater acoustic sensor 12 (excluding the power supply unit 140 and weight unit 160) in a position within a predetermined range via the mooring unit 150.

[0056] The searchlight unit 121 illuminates the surroundings by emitting light to them. Since poaching is likely to occur in dark environments, it is expected that poaching will be curbed by illuminating the surroundings using the searchlight unit 121. Here, the searchlight unit 121 may emit light at a predetermined time, may emit light periodically, may emit light randomly at any timing, may emit light when the sensing unit 130 obtains sensor data (acoustic data), or may emit light based on instructions from the server 20.

[0057] The mooring light unit 122 issues a collision prevention warning by turning on or flashing a warning light. The collision prevention warning issued by the mooring light unit is expected to reduce collisions between legitimate ships and illegal fishing vessels and the underwater acoustic sensor 10. The mooring light unit 122 may be supplied with power from the power supply unit 140, or from a solar cell 123 or the like. The underwater acoustic sensor 12 shown in FIG. 2 is configured to be tethered to the seabed by a mooring unit 150, but the sensing unit 130 may also be attached to a mobile object such as a drone, a small unmanned vessel, or a manned vessel, and sensing may be performed at different positions by moving the mobile object.

[0058] [Server 20] The explanation will be continued by returning to FIG. 1. Next, an example of the functional configuration of the server 20 according to an embodiment of the present invention will be described. FIG. 3 is a diagram showing an example of the functional configuration of the server 20 according to an embodiment of the present invention. As shown in FIG. 3, the server 20 according to an embodiment of the present invention includes a control unit 220, a storage unit 230, and a communication unit 240. The control unit 220 includes an analysis unit 221, an object detection unit 222, a detection notification unit 223, a request acquisition unit 224, a data acquisition unit 225, and a data provision unit 226.

[0059] [Communications Department 240] The communication unit 240 is configured by a communication interface and communicates with the underwater acoustic sensor 10. For example, the communication unit 240 communicates with the underwater acoustic sensor 10 via a mobile network such as an LTE network. The communication unit 240 may also communicate with the underwater acoustic sensor 10 via other communication means such as multi-hop wireless communication means. Furthermore, the communication unit 240 communicates with the monitor terminal 30. For example, the communication unit 240 communicates with the monitor terminal 30 via a mobile network such as an LTE network. Alternatively, the communication unit 240 may communicate with the monitor terminal 30 via a wired connection.

[0060] [Storage section 230] The storage unit 230 is a storage device capable of storing programs and data for operating the control unit 220. The storage unit 230 can also temporarily store various data required in the course of operation of the control unit 220. For example, the storage device may be a non-volatile storage device. For example, the storage unit 230 may store sensor information 231 and notification destination information 232 as examples of various data. Hereinafter, the sensor information 231 will be described with reference to FIG. 4, and the notification destination information 232 will be described with reference to FIG. 5.

[0061] [Sensor information 231] Fig. 4 is a diagram showing an example of the sensor information 231. As shown in Fig. 4, the sensor information 231 is configured by associating a "sensor ID," "installation location information," "sensor status information," "sensor data," "weather information," and "contact name."

[0062] The “sensor ID” is information for uniquely identifying the underwater acoustic sensor 10 .

[0063] "Installation location information" is information indicating the location where the underwater acoustic sensor 10 is installed. In the embodiment of the present invention, it is mainly assumed that the installation location information is expressed using latitude and longitude. However, the expression format of the installation location information is not limited. For example, the installation location information may be expressed in polar coordinate format. For example, the installation location information may be manually input. However, if the underwater acoustic sensor 10 has a position detection function for detecting its own position, the installation location information may be set based on the installation location detected by the underwater acoustic sensor 10. Furthermore, as described above, if the position of the underwater acoustic sensor 10 is transmitted from the underwater acoustic sensor 10 to the server 20 at predetermined time intervals, the server 20 may update the installation location information at predetermined time intervals based on the position of the underwater acoustic sensor 10 received from the underwater acoustic sensor 10.

[0064] When the "sensor status information" and "sensor data" are received from the underwater acoustic sensor 10, they are registered in the sensor information 231. If a "sensor ID" is attached to the "sensor status information" and "sensor data" received from the underwater acoustic sensor 10, the "sensor status information" and "sensor data" associated with the same "sensor ID" as the "sensor ID" received from the underwater acoustic sensor 10 are registered in the sensor information 231.

[0065] The "weather information" is information about the weather corresponding to the installation location of the underwater acoustic sensor 10. The weather information may be acquired in any manner. For example, weather information corresponding to the installation location of the underwater acoustic sensor 10 may be periodically acquired from a predetermined web page and registered in the sensor information 231. The weather corresponding to the installation location of the underwater acoustic sensor 10 may be the weather at the installation location of the underwater acoustic sensor 10 itself, or may be the weather at a location distant from the installation location of the underwater acoustic sensor 10 (for example, the jurisdiction of the sea area where the underwater acoustic sensor 10 is installed). In the embodiment of the present invention, it is assumed that the weather information includes the weather (for example, wind strength, weather, etc.), temperature, humidity, precipitation, wind speed, etc. Possible weather conditions include sunny, cloudy, rain, snow, and an approaching typhoon. For example, if a notification of the detection of a poacher or a poaching vessel is received despite the weather indicating an approaching typhoon, the notification of the detection of a poacher or a poaching vessel may be determined to be a false alarm (because it is considered difficult to poach during an approaching typhoon). However, there are no particular limitations on the specific information included in the weather information.

[0066] The "contact name" corresponds to the name of the contact (the monitor who should be contacted) corresponding to the underwater acoustic sensor 10. For example, the monitor can use the monitor terminal 30 to select in advance the underwater acoustic sensor 10 that is installed in the area (zone) that the monitor wishes to monitor. This allows the name of the monitor to be associated as the "contact name" with the "sensor ID" of the underwater acoustic sensor 10 selected by the monitor.

[0067] In the example shown in Fig. 4, it is assumed that sensors 1 and 2 are installed in the same area, and sensor 3 is installed in an area different from the areas where sensors 1 and 2 are installed. In this case, "Mr. A" and "Mr. B" correspond to persons who intend to monitor only a specific area (for example, a specific fisheries cooperative association). "Mr. C" corresponds to a person who intends to monitor multiple areas (for example, the National Federation of Fisheries Cooperative Associations).

[0068] [Notification Information 232] 5 is a diagram showing an example of the notification destination information 232. As shown in Fig. 5, the notification destination information 232 is configured by associating a "contact name," a "contact address," and a "contact phone number." For example, the notification destination information 232 may be set in advance by the monitor using the monitor terminal 30.

[0069] Like the "contact name" in the sensor information 231, the "contact name" corresponds to the name of the contact person (the monitor who should be contacted) corresponding to the underwater acoustic sensor 10.

[0070] The "notification destination address" is an address that indicates the destination of a detection notification when a detection target is detected by the underwater acoustic sensor 10. In the embodiment of the present invention, it is assumed that the means of notifying detection is email (detection email). That is, it is mainly assumed that an email address is used as the "notification destination address." However, the "notification destination address" is not limited to an email address.

[0071] For example, as will be explained later, since the detection notification needs to include a character string, the detection notification means may be any means capable of sending a character string. For example, the detection notification means may be a predetermined application capable of sending a character string. For example, if the detection notification means is a social networking service (SNS) application, the notification destination address may be an SNS account. Alternatively, for example, if the detection notification means is a short message, the notification destination address may be a telephone number.

[0072] The "contact telephone number" corresponds to the telephone number of the contact person (the monitor who should be contacted) corresponding to the underwater acoustic sensor 10.

[0073] [Control unit 220] The control unit 220 includes a calculation device such as a CPU (Central Processing Unit), and its functions can be realized by the calculation device expanding a program stored in a ROM (Read Only Memory) into a RAM and executing it. In this case, a computer-readable recording medium on which the program is recorded can also be provided. Alternatively, these blocks can be configured with dedicated hardware or a combination of multiple hardware components. Data required for calculations by the calculation device is stored appropriately in the storage unit 230.

[0074] The analysis unit 221, object detection unit 222, detection notification unit 223, request acquisition unit 224, data acquisition unit 225, and data provision unit 226 will be described in detail later.

[0075] [Observer Terminal 30] Returning to FIG. 1, the explanation will continue. Next, an example of the functional configuration of the supervisor terminal 30 according to an embodiment of the present invention will be described. FIG. 6 is a diagram showing an example of the functional configuration of the supervisor terminal 30 according to an embodiment of the present invention. As shown in FIG. 6, the supervisor terminal 30 according to an embodiment of the present invention includes an input unit 310, a control unit 320, a storage unit 330, a communication unit 340, and a display unit 350.

[0076] [Input section 310] The input unit 310 accepts operations by the monitor. In the embodiment of the present invention, it is mainly assumed that the input unit 310 is a touch panel. However, the type of the input unit 310 is not limited. For example, the input unit 310 may include a keyboard, a mouse, an electronic pen, or other input devices.

[0077] [Control unit 320] The control unit 320 includes a CPU and the like, and its functions can be realized by the CPU expanding a program stored in the storage unit 330 into RAM and executing it. In this case, a computer-readable recording medium on which the program is recorded can also be provided. Alternatively, the control unit 320 can be configured with dedicated hardware or a combination of multiple pieces of hardware. Data necessary for calculations by the calculation device is stored appropriately in the storage unit 330.

[0078] [Storage section 330] The storage unit 330 is a storage device capable of storing programs and data for operating the control unit 320. The storage unit 330 can also temporarily store various data required in the course of operation of the control unit 320. For example, the storage device may be a non-volatile storage device.

[0079] [Communications Department 340] The communication unit 340 is configured by a communication interface and communicates with the server 20. The communication unit 340 communicates with the server 20 via a mobile network such as an LTE network. Alternatively, the communication unit 340 may communicate with the server 20 via a wired connection.

[0080] [Display section 350] Display unit 350 has a function of performing display under the control of control unit 320. Here, the form of display unit 350 is not particularly limited. For example, display unit 350 may be a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, or a display device such as a lamp.

[0081] [Analysis Department 221] The explanation will continue by returning to Fig. 3. The analysis unit 221 analyzes the sound intensity for each sound frequency and each time the sound was detected based on the sensor data (acoustic data) obtained by the underwater acoustic sensor 10, and obtains an analysis result (hereinafter also referred to as a "spectrogram"). An example of a spectrogram obtained by analysis by the analysis unit 221 will be described with reference to Fig. 7.

[0082] FIG. 7 is a diagram showing a first example of a spectrogram obtained by analysis by analysis unit 221. In the spectrogram shown in FIG. 7, the vertical axis indicates the frequency of the sound, the horizontal axis indicates the time when the sound was detected, and the sound intensity is shown at a position corresponding to the frequency and time. Note that the greater the sound intensity, the darker the black color is. In the example shown in FIG. 7, it can be seen that sound has been detected in each of areas D11 to D13, which are each a combination of frequency and time. More specifically, the sounds corresponding to areas D11 to D13 are sounds made by divers.

[0083] Fig. 8 is a diagram showing a second example of a spectrogram obtained by analysis by analysis unit 221. In the spectrogram shown in Fig. 8, similar to the spectrogram shown in Fig. 7, the vertical axis indicates the frequency of the sound, the horizontal axis indicates the time at which the sound was detected, and the sound intensity is shown at a position corresponding to the frequency and time. Note that the greater the sound intensity, the darker the black color. In the example shown in Fig. 8, it can be seen that sound has been detected in each of areas D21 to D22, which are each a combination of frequency and time. More specifically, the sounds corresponding to areas D21 to D22 are sounds made by marine organisms.

[0084] Returning to Fig. 3, the explanation will continue. The analysis unit 221 may determine whether the sound intensity is greater than a predetermined first threshold for each frequency and time based on the sensor data (acoustic data) obtained by the underwater acoustic sensor 10, and obtain the result of the determination as an analysis result (hereinafter also referred to as a "sound pattern"). An example of a sound pattern obtained by analysis by the analysis unit 221 will be described with reference to Fig. 9.

[0085] Fig. 9 is a diagram showing an example of a sound pattern obtained by analysis by analysis unit 221. In the sound pattern shown in Fig. 9, the vertical axis indicates the frequency of the sound, the horizontal axis indicates the time at which the sound was detected, and whether the sound intensity is greater than the first threshold is indicated at the position corresponding to the frequency and time. Note that a sound intensity greater than the first threshold is indicated by "1", and a sound intensity equal to or less than the first threshold is indicated by "0".

[0086] In the example shown in FIG. 9, it can be seen that the frequency band in which sounds with an intensity greater than the first threshold are detected (i.e., the frequency band in which "1" appears in the sound pattern) is widening over time. This is because the ship is approaching the acoustic sensor 10, and sounds emitted by the ship are being detected in a gradually wider frequency band. Note that the beam number is a number assigned to each of the multiple detection directions.

[0087] [Object detection unit 222] Continuing the explanation, returning to Fig. 3, the object detection unit 222 detects an object to be detected based on the sensor data (acoustic data) obtained by the underwater acoustic sensor 10.

[0088] For example, there is a first detection object that emits a sound characterized by a frequency band in which the intensity of the sound is greater than a first threshold and is wider than a predetermined first band, and the object detection unit 222 can detect the first detection object based on the fact that the first frequency band is wider than the predetermined first band.

[0089] More specifically, the first detection object emits sound characterized in that a first frequency band in which the sound intensity is greater than the first threshold at a time (second time) a predetermined time after a time (first time) when there is a frequency whose sound intensity is greater than the first threshold is wider than the first band. Therefore, the object detection unit 222 may detect the first time when there is a frequency whose sound intensity is greater than the first threshold, and detect the frequency band in which the sound intensity is greater than the first threshold at a second time a predetermined time after the first time as the first frequency band.

[0090] For example, in the example shown in FIG. 9, if the time at which there is a frequency at which the sound intensity is greater than the first threshold is "1 second" and the predetermined time is "5 seconds," the object detection unit 222 detects the frequency band at "6 seconds" where the sound intensity is greater than the first threshold as the first frequency band, and can detect the first detection object based on the fact that the first frequency band is wider than the predetermined first band.

[0091] Although the first detection object is not particularly limited, in the embodiment of the present invention, it is assumed that the object detection unit 222 detects a boat as the first detection object. In this case, sounds emitted by the boat may include mechanical sounds caused by the boat's engine rotation and the sound of the boat's propeller rotating. It is assumed that the boat detected by the object detection unit 222 is a poaching boat, and hereinafter, the boat detected by the object detection unit 222 is also referred to as a "poaching boat." Furthermore, the term "boat" is a concept that broadly encompasses any mobile object having a power source that floats on the water surface, and may also include jet skis.

[0092] There may also be second detection targets that are difficult to detect based on predetermined rules. For example, in the example shown in Fig. 7, it is possible that the sounds emitted by the divers corresponding to areas D11 to D13 are so small that they are difficult to detect. In such cases, the object detection unit 222 can detect the second detection target based on a model generated in advance by machine learning and a spectrogram.

[0093] More specifically, it is assumed that the model takes a spectrogram as input and outputs a detection probability of the second detection object. In such a case, the object detection unit 222 may detect the second detection object based on the detection probability of the second detection object output based on the model generated in advance by machine learning and the spectrogram being greater than a predetermined probability.

[0094] The type of machine learning algorithm is not limited. For example, the machine learning algorithm may be a neural network or another machine learning algorithm. In addition, in the learning stage, a model may be generated using a training spectrogram as input data, and using a value "1" indicating that the training spectrogram contains a sound emitted by the second detection object or a value "0" indicating that the training spectrogram does not contain a sound emitted by the second detection object as correct answer data.

[0095] Although the second detection object is not particularly limited, in the embodiment of the present invention, it is assumed that the object detection unit 222 detects a diver (i.e., a person) as the second detection object. In this case, the sound emitted by the diver may include the sound of air passing through a regulator when the diver draws air from a cylinder. Note that it is assumed that the diver detected by the object detection unit 222 is a poacher, and hereinafter, the diver detected by the object detection unit 222 is also referred to as a "poacher."

[0096] Furthermore, there may be marine organisms that emit sounds similar to those emitted by divers. Therefore, detecting sounds emitted by marine organisms may lead to false positives that sounds emitted by divers have been detected. Therefore, it is desirable that when sounds emitted by marine organisms are detected, the detection of sounds emitted by divers be canceled.

[0097] For example, sounds emitted by marine organisms corresponding to areas D21 to D22 shown in Fig. 8 have a characteristic that a frequency band in which the intensity is greater than a predetermined second threshold is wider than the predetermined second band. Therefore, the object detection unit 222 may detect the second frequency band in which the intensity of the sound is greater than the second threshold, and cancel the detection of the diver based on the fact that the second frequency band is wider than the second band.

[0098] Furthermore, the sounds emitted by marine organisms corresponding to each of areas D21 to D22 shown in Fig. 8 have the characteristic that the time during which the intensity is greater than a predetermined second threshold is shorter than a predetermined time. Therefore, the object detection unit 222 may detect the time during which the intensity of the sound is greater than the second threshold, and cancel the detection of the diver based on the fact that the time is shorter than the predetermined time.

[0099] The object detection unit 222 may cancel the detection of a diver based on the fact that the second frequency band in which the sound intensity is greater than the second threshold is wider than the second band and the time during which the sound intensity is greater than the second threshold is shorter than a predetermined time. This increases the accuracy of detecting sounds emitted by marine organisms and reduces the possibility that the detection of sounds emitted by marine organisms will lead to a false positive that sounds emitted by a diver have been detected.

[0100] As described above, the object detection unit 222 can identify the direction of the sound source (i.e., the object to be detected) based on the sensor data and relative to the installation positions of the underwater acoustic sensors 10. It is also possible that the same object to be detected is simultaneously detected by multiple underwater acoustic sensors 10. In such a case, the object detection unit 222 can identify the direction of the object to be detected based on each of the installation positions of the multiple underwater acoustic sensors 10. In this case, the object detection unit 222 can identify the position (latitude and longitude) of the object to be detected based on the direction of the object to be detected based on each of the installation positions of the multiple underwater acoustic sensors 10 and the installation positions of the multiple underwater acoustic sensors 10.

[0101] In the embodiment of the present invention, it is mainly assumed that the object detection unit 222 is present in the server 20. However, if an analysis device (not shown) is present between the underwater acoustic sensor 10 and the server 20, the object detection unit 222 may be incorporated in the analysis device. In such a case, the analysis device receives sensor data obtained by the underwater acoustic sensor 10. Then, when the analysis device detects a detection object based on the acquired sensor data, it only needs to transmit to the server 20 the direction or position information of the detection object, the type of the detection object, and the sensor ID of the underwater acoustic sensor 10 that detected the detection object.

[0102] [Detection notification unit 223] The detection notification unit 223 outputs an alarm (issues a warning) based on the detection of a detection object by the object detection unit 222 (i.e., based on the detection of a boat or a diver by the object detection unit 222). More specifically, the detection notification unit 223 controls the communication unit 240 so that identification information corresponding to the information about the detection and the type of the detection object are transmitted to the monitor terminal 30 associated in advance with the underwater acoustic sensor 10 (more specifically, to the monitor terminal 30 indicated by the "notification destination address" associated with the "sensor ID" of the underwater acoustic sensor 10 in the sensor information 231) before the information about the detection itself is transmitted. This notifies the monitor terminal 30 of the detection of the detection object. The identification information may be an example of an alarm.

[0103] In the following, it is assumed that the identification information is a URL (Uniform Resource Locator) that indicates the location of information related to detection. The URL that indicates the location of information related to detection may be formed based on a document, RFC (Request For Comment) (e.g., RFC2396 or RFC3986), issued by the Internet Engineering Task Force (IETF), an organization that defines standards for Internet-related technologies. For example, RFC3986 specifies that a general Uniform Resource Identifier (URI) syntax consists of a hierarchical sequence of components called scheme, authority, path, query, and fragment, and is expressed as "URI=scheme":"hier-part["?"query]["#"fragment]". An example of a URL that indicates the location of information related to detection is "https: / / sensor.server.jp / poaching / 999". The URL "https: / / sensor.server.jp / poaching / 999" indicating the location of the information related to the detection is composed of identification information (scheme name) "https" indicating the scheme, identification information (host name) "sensor.server.jp" indicating the address of the HTTP (HyperText Transfer Protocol) server (server 20), and identification information " / poaching / 999" indicating the path ("999" is identification information indicating a program or web page that provides information related to the detection). However, the identification information is not limited to a URL as long as it is information that can identify the information related to the detection. For example, the identification information may be characters or images corresponding to the URL indicating the location of the information related to the detection. In this case, the characters or images corresponding to the URL indicating the location of the information related to the detection may be characters or images different from those of the URL indicating the location of the information related to the detection.

[0104] As described above, the means for notifying detection is not limited, but when detection is notified by a detection mail (email), the detection notification unit 223 may perform control so that a detection mail containing, in the body thereof, a character string of a URL indicating the location of information related to the detection is sent to the monitor terminal 30. When detection is notified by a detection mail (HTML e-mail), the detection notification unit 223 may perform control so that a detection mail containing, in the body thereof, characters, images, etc. corresponding to a URL indicating the location of information related to the detection is sent to the monitor terminal 30. Specific examples of information related to the detection will be described later.

[0105] [Detection email] FIG. 10 is a diagram illustrating an example of a detection email. As shown in FIG. 10, the detection email G10 includes a sender, a subject, a sending date and time (of the detection email), a destination (of the detection email), and a main text. The main text describes examples of the type of object to be detected, such as "poaching boat" and "poacher." It also describes a URL (B10) (https: / / sensor.server.jp / poaching / 999) indicating the location of information related to the detection. In the monitor terminal 30, when the communication unit 340 receives the detection email G10, the control unit 320 controls the display unit 350 to display the detection email G10 on the display unit 350. Note that the monitor terminal 30 (control unit 320) may automatically display the detection email G10 upon receiving the detection email G10, or may control the display of the detection email G10 in response to a monitor's operation.

[0106] When the monitor wishes to check the information related to the detection, the monitor performs a selection operation of the URL (B10) on the input unit 310. For example, if the input unit 310 includes a touch panel, the selection operation may be a tap operation on the touch panel. Alternatively, if the input unit 310 includes a mouse, the selection operation may be a click operation using the mouse. The selection operation may also be changed as appropriate depending on the type of the input unit 310. Note that if the URL (B10) indicating the location of the information related to the detection is text, an image, or the like corresponding to the URL indicating the location of the information related to the detection, the monitor performs a selection operation of the text, an image, or the like corresponding to the URL indicating the location of the information related to the detection on the input unit 310 when the monitor wishes to check the information related to the detection.

[0107] When input unit 310 accepts a URL selection operation (an operation for selecting characters, an image, or the like corresponding to the URL), control unit 320 controls communication unit 340 so that a data transmission request corresponding to the URL (characters, an image, or the like corresponding to the URL) is sent to server 20. For example, control unit 320 controls communication unit 340 so that an HTTP GET request containing a GET method (characters "GET") and a request target "https: / / sensor.server.jp / poaching / 999" (characters) in the request as a data transmission request (HTTP message) is sent to server 20. Here, the request target "https: / / sensor.server.jp / poaching / 999" in the data transmission request is a URL (B10) indicating the location of information related to the detection included in detection email G10.

[0108] If the monitor contacts another person using some contact function (e.g., telephone function, email function, etc.) on the monitor terminal 30 within a predetermined time after the monitor performed the selection operation, the monitor terminal 30 may notify the server 20 of the name (contact name) of the other person who received the contact from the monitor and the contact information of the other person (notification destination address and / or contact telephone number). At this time, the server 20 may newly register the name of the other person notified by the monitor terminal 30 as a "contact name" in the sensor information 231 (FIG. 4), and may newly register the name of the other person and the contact information of the other person notified by the monitor terminal 30 as a "contact name" and a "notification destination address (and / or contact telephone number)" in the notification destination information 232 (FIG. 5). Then, the server 20 may send a detection email G10 to the other person, in addition to the monitor, based on the newly registered contact information of the other person. By newly registering the notification address in the notification destination information 232 (Figure 5), the server 20 can resend the detection email G10 that has already been sent to the monitor terminal 30 to the notification destination address of the other person, and can include the notification destination address of the other person when sending a new detection email G10 to the monitor terminal 30.

[0109] [Request acquisition unit 224] Continuing the explanation, returning to Fig. 3, in server 20, when communication unit 240 receives a data transmission request corresponding to a URL from supervisor terminal 30, request acquisition unit 224 acquires from communication unit 240 the data transmission request corresponding to the URL.

[0110] [Data Acquisition Section 225] The data acquisition unit 225 acquires information about the detection corresponding to the URL when the request acquisition unit 224 acquires a data transmission request corresponding to the URL. In the embodiment of the present invention, it is assumed that the information about the detection includes a map according to the installation position of the underwater acoustic sensor 10 where the detection target object was detected.

[0111] Note that the embodiment of the present invention mainly assumes a case where the data acquisition unit 225 acquires a map from a predetermined map providing API (Application Programming Interface). In such a case, if the data acquisition unit 225 notifies the map providing API of a reference point of the map to be acquired and the range of the map centered on the reference point (for example, zoom), the data acquisition unit 225 can acquire a map of the range centered on the reference point from the map providing API.

[0112] Therefore, the map providing API is an interface specification for communication between the map providing program that manages and provides map information and the data acquisition unit 225, and is a program that exists between the map providing program that provides map information and the data acquisition unit 225. The map providing API may be contained within the map providing program, or may exist as a program separate from the map providing program.

[0113] Furthermore, the map providing program and the map providing API may be arranged in the server 20, or in an external server other than the server 20. When the map providing program and the map providing API are arranged in the server 20, map information is stored in the storage unit 230, and the data acquiring unit 225 can acquire the map from the storage unit 230 via the map providing API. When the map providing program and the map providing API are arranged in an external server other than the server 20, map information is stored in the external server, and the data acquiring unit 225 can acquire the map from the external server via the network and the map providing API.

[0114] For example, HTTP can be used when the map providing program and map providing API are stored in an external HTTP server other than the server 20, and the data acquisition unit 225 acquires a map from a predetermined map providing API. In this case, the external HTTP server is a map providing server that manages map information and provides maps over a network based on the HTTP communication protocol, so the map providing API may be referred to as a map providing Web API (map providing Web service).

[0115] Here, the reference point may be the installation position of the underwater acoustic sensor 10 that is pre-associated with the monitor terminal 30. In this case, it is desirable that the range of the map be determined so as to include the detectable range of the underwater acoustic sensor 10 that is pre-associated with the monitor terminal 30.

[0116] Alternatively, when there are multiple underwater acoustic sensors 10 associated in advance with the monitor terminal 30, the reference point may be a position (for example, a center of gravity position) according to the installation positions of the multiple underwater acoustic sensors 10. In this case, it is desirable that the range of the map be determined so that the detectable ranges of all of the multiple underwater acoustic sensors 10 associated in advance with the monitor terminal 30 are included.

[0117] Alternatively, the reference point may be the installation position of the underwater acoustic sensor 10 that detected the detection target, among one or more underwater acoustic sensors 10 that are associated in advance with the monitor terminal 30. In this case, it is desirable that the range of the map be determined so as to include the detectable range of the underwater acoustic sensor 10 that detected the detection target.

[0118] Furthermore, in the embodiment of the present invention, it is assumed that the information regarding the detection includes additional information other than a map, but it is sufficient that the information regarding the detection includes at least one of a map and the additional information.

[0119] In an embodiment of the present invention, it is assumed that the additional information includes a contact name and contact phone number (FIG. 5) that are associated in advance with the underwater acoustic sensor 10 that detected the detection target. Note that the contact name and contact phone number are examples of information related to the notification destination, and therefore, instead of the notification destination name and contact phone number, information related to another notification destination (for example, a notification destination address) may be included in the additional information.

[0120] Furthermore, in the embodiment of the present invention, it is assumed that the additional information includes sensor status information (FIG. 4) of the underwater acoustic sensor 10 that detected the detection target. Also, in the embodiment of the present invention, it is assumed that the additional information includes weather information according to the installation position of the underwater acoustic sensor 10 that detected the detection target.

[0121] Furthermore, in the embodiment of the present invention, it is assumed that the additional information includes the date and time of the detection email transmission to the monitor terminal 30 (the date and time of the detection email transmission). However, the additional information may include the date and time of the detection of the detection object (the date and time of the detection of the detection object) instead of the date and time of the detection email transmission to the monitor terminal 30, or in addition to the date and time of the detection email transmission to the monitor terminal 30.

[0122] [Data Provider 226] The data providing unit 226 controls the communication unit 240 so that information related to the detection is sent to the monitor terminal 30. For example, the data providing unit 226 controls the communication unit 240 so that an HTTP response including information related to the detection is returned to the monitor terminal 30 in response to an HTTP GET request.

[0123] [Detection screen] In the monitor terminal 30, when the communication unit 340 receives information related to the detection, the control unit 320 acquires the information related to the detection. The control unit 320 controls the display unit 350 so that a detection screen is displayed on the display unit 350 based on the information related to the detection. The monitor can grasp the information related to the detection by looking at the detection screen displayed on the display unit 350. Examples of the detection screen will be described below with reference to FIGS. 11 to 16.

[0124] Fig. 11 is a diagram showing an example of a detection screen G20 in the case where a detection target is detected by one underwater acoustic sensor 10. Referring to Fig. 11, the detection screen G20 includes an area where a map is displayed (map display area W21) and an area where additional information is displayed (additional information display area W22). Referring to the map display area W21, the data acquisition unit 225 has added an object representing the sensor (sensor object B211) to a position on the map corresponding to the installation position of the underwater acoustic sensor 10 where the detection target was detected (sensor position on the map).

[0125] Referring to the map display area W21, an object (poacher detection direction object D211) based on the sensor position on the map is added to the direction on the map corresponding to the poacher's heading by the data acquisition unit 225. Furthermore, referring to the map display area W21, an object (poacher boat detection direction object D212) based on the sensor position on the map is added to the direction on the map corresponding to the poacher's heading by the data acquisition unit 225.

[0126] 11, the poacher detection direction object D211 and the poaching boat detection direction object D212 are distinguished by differences in color and size, but the poacher detection direction object D211 and the poaching boat detection direction object D212 may be distinguished in other ways. For example, the poacher detection direction object D211 and the poaching boat detection direction object D212 may be distinguished by differences in shape.

[0127] 11, the shape of each of the poacher detection direction object D211 and the poaching boat detection direction object D212 is a sector, but there are no limitations on the shape of each of the poacher detection direction object D211 and the poaching boat detection direction object D212. For example, the shape of each of the poacher detection direction object D211 and the poaching boat detection direction object D212 may be a triangle whose vertex is located at the sensor position on the map.

[0128] Furthermore, referring to the map display area W21, the map includes an object (display size adjustment object D272) for adjusting the display size of the map. As a result, the observer can use the display size adjustment object D272 to input an enlargement or reduction operation to the input unit 310, whereby the enlarged or reduced map is provided from the server 20 to the observer terminal 30, and the enlarged or reduced map is newly displayed on the display unit 350.

[0129] Furthermore, referring to the map display area W21, the map includes a scale bar indicating the width on the map that corresponds to the width in real space. "100 m" is displayed as an example of the width in real space. By checking the scale bar, the observer can understand the correspondence between the width on the map and the width in real space. Additionally, referring to the map display area W21, the data acquisition unit 225 has added a display switching object B210 to the map. The display switching object B210 will be described later.

[0130] The additional information display area W22 includes a "last updated date and time" that indicates the date and time the map was last updated. The additional information display area W22 also includes a "status: poaching detected" that indicates the status of the system. The additional information display area W22 also includes an additional information display switch button B221. The additional information display switch button B221 will be explained later. The additional information display area W22 also includes a "detection email sent date and time," but as described above, the detection date and time of the detection object may be included instead of or in addition to the "detection email sent date and time."

[0131] Furthermore, the additional information display area W22 includes a clear button B222. By selecting the clear button B222 and inputting it into the input unit 310, the monitor can have the server 20 clear the detection email transmission date and time. Once a detection email has been sent to the monitor terminal 30, it is common for a certain period of time not to be sent to the monitor terminal 30 even if the detection target is detected again. However, after the clear button B222 is selected, a detection email is sent to the monitor terminal 30 the moment the detection target is detected again, even if the certain period of time has not yet elapsed.

[0132] Additionally, the additional information display area W22 includes a "contact list." The "contact list" is a list of contact names and contact phone numbers (FIG. 5) that are pre-associated with the underwater acoustic sensor 10 that detected the detection target. However, as described above, the contact name and contact phone number are examples of information related to the notification destination, and therefore, instead of the notification destination name and contact phone number, information related to other notification destinations (e.g., security companies, police, etc.) (e.g., notification destination addresses, etc.) may be included in the additional information display area W22.

[0133] The additional information display area W22 also includes an audio playback button B224. When the monitor selects the audio playback button B224 via the input unit 310, the monitor terminal 30 transmits a playback request to the server 20. Based on the playback request received from the monitor terminal 30 via the communication unit 240, the data providing unit 226 plays back the audio recording made when the object detection unit 222 detected the detection object, and controls the communication unit 240 to provide the played back sound to the monitor terminal 30. In the monitor terminal 30, the display unit 350 outputs the played back sound.

[0134] This allows the observer to determine by his or her own hearing whether the sound of a boat or diver or some other sound has been detected.

[0135] The additional information display area W22 also includes a spectrogram reference button B225. When the monitor selects the spectrogram reference button B225 via the input unit 310, the monitor terminal 30 transmits a spectrogram transmission request to the server 20. Based on receiving the spectrogram transmission request from the monitor terminal 30 via the communication unit 240, the data providing unit 226 controls the communication unit 240 to provide a spectrogram to the monitor terminal 30. In the monitor terminal 30, the display unit 350 displays the spectrogram.

[0136] Fig. 12 is a diagram showing an example of a spectrogram displayed by the monitor terminal 30. Referring to Fig. 12, in addition to the spectrogram being displayed, a start date selection field B231, a start time selection field B232, an end date selection field B233, an end time selection field B234, an acoustic sensor selection field B235, and a display button B236 are also provided.

[0137] The start date selection field B231 is a selection field for selecting the start date of the spectrogram to be displayed. The start time selection field B232 is a selection field for selecting the start time of the spectrogram to be displayed. The end date selection field B233 is a selection field for selecting the end date of the spectrogram to be displayed. The end time selection field B234 is a selection field for selecting the end time of the spectrogram to be displayed.

[0138] The acoustic sensor selection field B235 is a selection field for selecting which acoustic sensor's spectrogram to display. The display button B236 is a button for starting the display of the spectrogram. It is assumed here that the observer specifies the time width from the start to the end of the spectrogram to be displayed. However, it is assumed that the time width in which sound characteristics appear varies depending on the type of detection object. Therefore, the data providing unit 226 may determine the time width from the start to the end of the spectrogram to be displayed depending on the type of detection object. As an example, it is assumed that the time width in which sound characteristics appear is narrower for sounds emitted by a diver than for sounds emitted by a boat. Therefore, the data providing unit 226 may narrow the time width from the start to the end of the spectrogram to be displayed when the detection object is a diver than when the detection object is a boat.

[0139] 12, the air pressure, water temperature, and wind force are also displayed. That is, based on receiving a spectrogram transmission request from the monitor terminal 30 via the communication unit 240, the data providing unit 226 may control the communication unit 240 to provide the monitor terminal 30 with at least one of the air pressure, water temperature, and wind force according to the position of the acoustic sensor 10, in addition to the spectrogram. Since it is expected that the conditions for sound detection by the acoustic sensor 10 may change depending on the air pressure, water temperature, wind force, etc., information such as the air pressure, water temperature, and wind force may also be useful to the monitor.

[0140] The air pressure, water temperature, and wind force may be the air pressure, water temperature, and wind force at the installation location of the underwater acoustic sensor 10 itself, or may be the air pressure, water temperature, and wind force at a location distant from the installation location of the underwater acoustic sensor 10 (for example, the jurisdiction of the sea area where the underwater acoustic sensor 10 is installed). The air pressure, water temperature, and wind force may be acquired in any manner. For example, the air pressure, water temperature, and wind force corresponding to the location of the underwater acoustic sensor 10 may be acquired from a specified web page.

[0141] Returning to FIG. 11, the explanation will continue. The additional information display area W22 also includes a sound pattern reference button B226. When the monitor selects the sound pattern reference button B226 using the input unit 310, the monitor terminal 30 transmits a sound pattern transmission request to the server 20. Based on receiving the sound pattern transmission request from the monitor terminal 30 via the communication unit 240, the data providing unit 226 controls the communication unit 240 to provide the sound pattern to the monitor terminal 30. In the monitor terminal 30, the display unit 350 displays the sound pattern.

[0142] Fig. 13 is a diagram showing an example of a sound pattern displayed by the monitor terminal 30. Referring to Fig. 13, in addition to the sound pattern being displayed, a start date selection field B231, a start time selection field B232, an end date selection field B233, an end time selection field B234, an acoustic sensor selection field B235, and a display button B236 are provided, similar to the example shown in Fig. 12. Also, in the example shown in Fig. 13, a scroll bar B234 is provided.

[0143] The start date selection field B231 is a selection field for selecting the start date of the sound pattern to be displayed. The start time selection field B232 is a selection field for selecting the start time of the sound pattern to be displayed. The end date selection field B233 is a selection field for selecting the end date of the sound pattern to be displayed. The end time selection field B234 is a selection field for selecting the end time of the sound pattern to be displayed.

[0144] The acoustic sensor selection field B235 is a selection field for selecting which acoustic sensor detects a sound pattern to display. The display button B236 is a button for starting the display of the sound pattern. The scroll bar B234 is a scroll bar for scrolling the time displayed within the sound pattern. Note that, here, it is assumed that the observer specifies the time width from the start to the end of the displayed sound pattern. However, it is assumed that the time width in which sound characteristics appear varies depending on the type of detected object. Therefore, the data providing unit 226 may determine the time width from the start to the end of the displayed sound pattern depending on the type of detected object. As an example, it is assumed that the time width in which sound characteristics appear is narrower in sounds emitted by divers than in sounds emitted by boats. Therefore, the data providing unit 226 may narrow the time width from the start to the end of the displayed sound pattern when the detected object is a diver than when the detected object is a boat. Also, referring to FIG. 13, as in FIG. 12, air pressure, water temperature, and wind force are also displayed.

[0145] 13, positions corresponding to frequencies and times where the sound intensity is greater than the first threshold are colored, and positions corresponding to frequencies and times where the sound intensity is equal to or less than the first threshold are not colored. As in this example, the display mode of positions corresponding to frequencies and times where the sound intensity is greater than the first threshold is different from the display mode of positions corresponding to frequencies and times where the sound intensity is equal to or less than the first threshold, allowing the observer to intuitively grasp the correspondence between sound intensity, frequency, and time.

[0146] Furthermore, the additional information display area W22 also includes a detection email history button B227. When the monitor selects the detection email history button B227 using the input unit 310, the monitor terminal 30 sends a detection email history transmission request to the server 20. Based on receiving the detection email history transmission request from the monitor terminal 30 via the communication unit 240, the data providing unit 226 controls the communication unit 240 to provide the monitor terminal 30 with a history of detection email transmission times. In the monitor terminal 30, the display unit 350 displays the history of detection email transmission times. This allows the monitor to understand the history of detection email transmission times.

[0147] Furthermore, the additional information display area W22 also includes a download button B228. When the monitor selects the download button B228 using the input unit 310, the monitor terminal 30 transmits a download request to the server 20. Based on receiving the download request from the monitor terminal 30 via the communication unit 240, the data providing unit 226 controls the communication unit 240 to provide the monitor terminal 30 with the voltage of the power supply unit 140 of the acoustic sensor 10 and the position of the acoustic sensor 10. In the monitor terminal 30, the display unit 350 displays the voltage of the power supply unit 140 and the position of the acoustic sensor 10. This allows the monitor to grasp the remaining charge of the power supply unit 140 and the location of the acoustic sensor 10.

[0148] 14 is a diagram showing an example in which a selection operation for a display switching object B210 is input. The display switching object B210 is an object for switching between displaying and hiding information about the underwater acoustic sensor 10. The display switching object B210 is added to the map by the data acquisition unit 225.

[0149] 14, the sensor name D217 of the underwater acoustic sensor 10 is added to the map as an example of information relating to the underwater acoustic sensor 10. Other examples of information relating to the underwater acoustic sensor 10 include information D215 relating to the acoustic sensor that detected the poacher (the "detection time" of the poacher, the "direction" of the poacher relative to the sensor, and the "radius" of the poacher detection range), and information D216 relating to the acoustic sensor that detected the poaching vessel (the "detection time" of the poaching vessel, the "direction" of the poaching vessel relative to the sensor, and the "radius" of the poaching vessel detection range).

[0150] In addition, when the display switching object B210 is deselected, the sensor name D217, information D215 regarding the acoustic sensor that detected the poacher, and information D216 regarding the acoustic sensor that detected the poaching vessel may be hidden.

[0151] 15 is a diagram showing an example in which the additional information display area W22 is scrolled. Here, it is assumed that the observer inputs a scroll operation to scroll the additional information display area W22 downwards to the input unit 310. At this time, the additional information display area W22 includes "weather information" and "map legend."

[0152] The "map legend" describes a change in the state of the sensor object B211 according to the sensor state information. Here, a case is shown in which the shape of the sensor object B211 changes according to the sensor state information. However, the way in which the data acquisition unit 225 changes the state of the sensor object B211 according to the sensor state information is not limited to this example. For example, the color of the sensor object B211 may change according to the sensor state information. Alternatively, text data indicating the sensor state information may be added to the sensor object B211 (for example, as a speech bubble).

[0153] Here, it is assumed that the observer inputs a selection operation of the additional information display switching button B221 (FIG. 14) to the input unit 310. At this time, the data acquisition unit 225 hides the additional information display area W22. This allows a wider area of ​​the map to be displayed (the map display area W21 becomes wider). When the observer inputs a selection operation of the additional information display switching button (not shown) to the input unit 310, the data acquisition unit 225 may display the additional information display area W22 again.

[0154] FIG. 16 is a diagram showing an example where a selection operation of the additional information display switching button B221 is input. Here, it is assumed that a selection operation of the additional information display switching button B221 is input by the monitor to the input unit 310. At this time, the data acquisition unit 224 hides the additional information display area W22. This allows a wider area of ​​the map to be displayed (the map display area W21 becomes wider). Note that with reference to FIG. 16, the detection screen G20 includes the additional information display switching button B223. When a selection operation of the additional information display switching button B223 is input by the monitor to the input unit 310, the data acquisition unit 224 may display the additional information display area W22 again.

[0155] Various display modes according to the embodiments of the present invention have been described above. While the display modes according to the embodiments of the present invention contribute to the understanding of detection-related information, the display content may be saved to preserve the detection-related information. Specifically, when the detection screen (FIGS. 11 to 16) is displayed on the monitor terminal 30, some or all of the contents of the detection screen may be saved as an image or a portable document format (PDF). In this case, the data providing unit 22 provides the monitor terminal 30 with detection-related information, including a display content saving button for saving the detection screen. Operating the display content saving button while the detection screen is displayed on the monitor terminal 30 saves some or all of the contents of the detection screen as an image or a PDF. In this way, the display content saving button can be provided for all or any of the detection screens (FIGS. 11 to 16) based on the monitor's preservation needs, thereby preserving detection-related information according to the monitor's needs.

[0156] [1-2. System Operation] Next, an example of the operation of the IoT system for preventing poaching according to an embodiment of the present invention will be described. Fig. 17 is a flowchart showing an example of the operation of the IoT system for preventing poaching according to an embodiment of the present invention. First, as shown in Fig. 17, the underwater acoustic sensor 10 obtains sensor data by performing underwater sensing. The underwater acoustic sensor 10 transmits the sensor data to the server 20 (S11).

[0157] In the server 20, the communication unit 240 receives the sensor data (S21). The object detection unit 222 attempts to detect the detection object based on the sensor data. If the object detection unit 222 does not detect the detection object ("NO" in S22), the operation proceeds to S11. On the other hand, if the object detection unit 222 detects the detection object ("YES" in S22) and the determination unit 222 determines that the detection object is a poaching boat or a poaching diver, the detection notification unit 223 acquires a URL for displaying a map (S23) and controls the communication unit 240 so that a detection email including the URL is sent to the monitor terminal 30 (S24).

[0158] In the monitor terminal 30, when the communication unit 340 receives the detection email (S31), the detection email is displayed on the display unit 350. If the monitor does not input a click operation on the URL included in the detection email into the input unit 310 ("NO" in S32), the operation proceeds to S11. On the other hand, if the monitor inputs a click operation on the URL included in the detection email into the input unit 310 ("YES" in S32), the control unit 320 controls the communication unit 340 so that a map display request is sent to the server 20 as an example of a data transmission request (S33).

[0159] In the server 20, when the communication unit 240 receives a map display request (S25), the request acquisition unit 224 acquires the map display request. When the data acquisition unit 225 acquires the map (and additional information) corresponding to the URL, it controls the communication unit 240 so that the acquired map (and additional information) is transmitted to the monitor terminal 30 (S26). In the monitor terminal 30, when the communication unit 340 receives the map (and additional information) (S34), the map (and additional information) is displayed on the display unit 350 (S35). S34 and S35 may be repeatedly executed at predetermined time intervals. As a result, the map (and additional information) displayed on the display unit 350 is updated at predetermined time intervals.

[0160] An example of the operation of the IoT system for preventing poaching according to the embodiment of the present invention has been described above.

[0161] [2. Hardware configuration example] Next, an example of the hardware configuration of the server 20 according to the embodiment of the present invention will be described. However, the example of the hardware configuration of the supervisor terminal 30 according to the embodiment of the present invention can also be realized in the same way.

[0162] An example of the hardware configuration of the information processing device 900 will be described below as an example of the hardware configuration of the server 20 according to an embodiment of the present invention. Note that the example of the hardware configuration of the information processing device 900 described below is merely one example of the hardware configuration of the server 20. Therefore, the hardware configuration of the server 20 may be such that unnecessary components are deleted from the hardware configuration of the information processing device 900 described below, or new components are added.

[0163] 18 is a diagram showing a hardware configuration of an information processing device 900 as an example of the server 20 according to an embodiment of the present invention. The information processing device 900 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, a RAM (Random Access Memory) 903, a host bus 904, a bridge 905, an external bus 906, an interface 907, an input device 908, an output device 909, a storage device 910, and a communication device 911.

[0164] The CPU 901 functions as an arithmetic processing unit and control unit, and controls the overall operation of the information processing device 900 in accordance with various programs. The CPU 901 may also be a microprocessor. The ROM 902 stores programs and calculation parameters used by the CPU 901. The RAM 903 temporarily stores programs used in the execution of the CPU 901 and parameters that change as appropriate during the execution. These components are interconnected by a host bus 904 that includes a CPU bus and the like.

[0165] The host bus 904 is connected to an external bus 906, such as a PCI (Peripheral Component Interconnect / Interface) bus, via a bridge 905. It is not necessary to configure the host bus 904, bridge 905, and external bus 906 separately, and these functions may be implemented on a single bus.

[0166] The input device 908 is composed of input means such as a mouse, keyboard, touch panel, buttons, microphone, switches, and levers that allow the user to input information, and an input control circuit that generates an input signal based on the user's input and outputs it to the CPU 901. By operating this input device 908, the user operating the information processing device 900 can input various data to the information processing device 900 and instruct the information processing device 900 to perform processing operations.

[0167] The output device 909 includes, for example, a display device such as a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, or a lamp, and an audio output device such as a speaker.

[0168] The storage device 910 is a device for storing data. The storage device 910 may include a storage medium, a recording device for recording data on the storage medium, a reading device for reading data from the storage medium, and a deletion device for deleting data recorded on the storage medium. The storage device 910 is configured, for example, with an HDD (Hard Disk Drive). This storage device 910 drives a hard disk and stores programs executed by the CPU 901 and various data.

[0169] The communication device 911 is, for example, a communication interface configured with a communication device for connecting to a network, etc. Furthermore, the communication device 911 may be compatible with either wireless communication or wired communication.

[0170] An example of the hardware configuration of the server 20 according to the embodiment of the present invention has been described above.

[0171] [3. Summary] As described above, according to an embodiment of the present invention, there is provided a server including a control unit that analyzes the intensity of sensor data received from a sensor for each frequency of the sensor data and the time at which the sensor data was obtained, obtains analysis results, and controls the server to provide the analysis results to a terminal. With this configuration, it is possible to further improve convenience for users who are trying to recognize detected objects.

[0172] Although the preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, the present invention is not limited to these examples. It is clear that a person skilled in the art to which the present invention pertains can conceive of various modifications and alterations within the scope of the technical ideas set forth in the claims, and it is understood that these also naturally fall within the technical scope of the present invention.

[0173] In the above, the term "poaching" is used to mean "secret fishing in violation of the law." Here, the term "poaching" should not be interpreted narrowly as meaning only the collection of seafood, but should be interpreted broadly as meaning organisms other than seafood as well. For example, "poaching" may also include the collection of mammals that live in water (e.g., dolphins, seals, etc.). In other words, although the term "poaching" is commonly used to mean the collection of mammals that live in water, the term "poaching" used in the embodiments of the present invention does not exclude "poaching" that means the collection of mammals that live in water.

[0174] 4. Other Embodiments The embodiment of the present invention may also be applied to the detection of smuggling, stowaways, illegal dumping (e.g., dumping of oil and waste), illegal acquisition of seabed resources (e.g., illegal acquisition of crude oil, natural gas, methane hydrate, etc.), and piracy. Furthermore, the embodiment of the present invention may also detect illegal fishing based on the sensing results of a sensor other than the underwater acoustic sensor 12, which is sensed by the server 20.

[0175] [4.1. Application to anti-smuggling measures] For example, when an embodiment of the present invention is applied to anti-smuggling measures, the system according to the embodiment of the present invention becomes an "anti-smuggling IoT system." In this case, the detection targets are various objects used in smuggling, such as smuggling ships and smugglers, and smuggling can be monitored by a user. By detecting smuggling ships and smugglers as the detection targets, the "anti-smuggling IoT system" aims to solve social issues and can be implemented more effectively.

[0176] When the embodiment of the present invention is applied to anti-smuggling measures, it is possible to provide a server including a control unit that analyzes the strength of sensor data received from sensors placed in areas where smuggling ships and smugglers may be operating, based on the sensor data, for each frequency of the sensor data and the time the sensor data was obtained, to obtain analysis results, and controls the server to provide the analysis results to a terminal. With this configuration, it is possible to further improve convenience for users.

[0177] [4.2. Forms applied to stowaway countermeasures] For example, when an embodiment of the present invention is applied to countermeasures against stowaways, the system according to the embodiment of the present invention becomes an "anti-stowaway IoT system." In this case, the detection target becomes various objects used for stowaways, such as stowaway boats and stowaways, and stowaways can be monitored by a user. By detecting stowaway boats and stowaways as the detection targets, the "anti-stowaway IoT system" becomes one that attempts to solve a social problem and can be implemented more suitably.

[0178] When an embodiment of the present invention is applied to anti-stowaway measures, it is possible to provide a server that includes a control unit that analyzes the strength of sensor data received from sensors placed in areas where stowaway ships and stowaways may be active, based on the sensor data, for each frequency of the sensor data and the time the sensor data was obtained, to obtain analysis results, and provides the analysis results to a terminal. With this configuration, it is possible to further improve convenience for users.

[0179] [4.3. Forms applied to illegal dumping countermeasures] For example, when an embodiment of the present invention is applied to measures against illegal dumping, the system according to the embodiment of the present invention becomes an "IoT system for countering illegal dumping." In this case, the detection targets are various objects used in illegal dumping, such as illegal dumping vessels and illegal dumpers, and illegal dumping can be monitored by users. By detecting illegal dumping vessels and illegal dumpers as the detection targets, the "IoT system for countering illegal dumping" aims to solve social issues and can be implemented more effectively.

[0180] When the embodiment of the present invention is applied to measures against illegal dumping, it is possible to provide a server that includes a control unit that analyzes the strength of sensor data received from sensors placed in areas where illegal dumping vessels and illegal dumpers may be active, based on the sensor data, for each frequency of the sensor data and the time when the sensor data was obtained, to obtain analysis results, and controls the server to provide the analysis results to a terminal. With this configuration, it is possible to further improve convenience for users.

[0181] [4.4. Forms applied to measures against illegal acquisition of seabed resources] For example, when an embodiment of the present invention is applied to measures to combat the illegal acquisition of seabed resources, the system according to the embodiment of the present invention becomes an "IoT system for combating the illegal acquisition of seabed resources." In this case, the detection targets are various objects used in the illegal acquisition of seabed resources, such as vessels illegally acquiring seabed resources (e.g., drillships) and illegal acquirers of seabed resources, and the illegal acquisition of seabed resources can be monitored by users. By detecting vessels illegally acquiring seabed resources and illegal acquirers of seabed resources as the detection targets, the "IoT system for combating the illegal acquisition of seabed resources" aims to solve social issues and can be more effectively implemented.

[0182] When the embodiment of the present invention is applied to measures against illegal acquisition of seabed resources, it is possible to provide a server including a control unit that analyzes the strength of sensor data received from sensors placed in areas where vessels and persons illegally acquiring seabed resources may be active, analyzes the strength of the sensor data for each frequency of the sensor data and the time when the sensor data was obtained, obtains analysis results, and controls the server to provide the analysis results to a terminal. With this configuration, it is possible to further improve convenience for users.

[0183] [4.5. Forms of application to anti-piracy measures] For example, when an embodiment of the present invention is applied to anti-piracy measures, the system according to the embodiment of the present invention becomes an "anti-piracy IoT system." In this case, the detection targets are pirate ships and various objects used in acts of piracy, such as piracy, and piracy can be monitored by users. By detecting pirate ships and pirates as the detection targets, the "anti-piracy IoT system" aims to solve social issues and can be implemented more effectively.

[0184] When the embodiment of the present invention is applied to anti-piracy measures, it becomes possible to provide a server that includes a control unit that analyzes the strength of sensor data received from sensors placed on pirate ships and in areas where pirates may be active, for each frequency of the sensor data and the time the sensor data was obtained, obtains analysis results, and provides the analysis results to a terminal. With this configuration, it becomes possible to further improve convenience for users.

[0185] [4.6. Forms of application to anti-terrorism measures] For example, when an embodiment of the present invention is applied to anti-terrorism measures (e.g., anti-terrorism measures against important coastal facilities (such as nuclear power plants)), the system according to the embodiment of the present invention becomes a "terrorism prevention IoT system." In this case, the managed object is a pre-registered official ship patrolling the coast, and it can be determined whether the detected object is a suspicious ship or a suspicious diver based on the location information of the onboard terminal installed on the official ship and the location information of the detected object.

[0186] [4.7. Application of other sensors] In the embodiment of the present invention, the server 20 detects poaching based on the sensing results of the underwater acoustic sensor 12. However, in an embodiment of the present invention, the server 20 may detect poaching based on the sensing results of a sensor other than the underwater acoustic sensor 12. In other words, the detection target may be detected based on information other than sound. In this case, the detection target can be detected by detecting the characteristics of the detection target from sensor data, just as in the case where the underwater acoustic sensor 12 is used as the sensor.

[0187] For example, the server 20 may detect illegal fishing based on the results of sensing using an active sonar, radar, laser sensor, image sensor, or the like.

[0188] [4.7.1. Active sonar application] When the server 20 detects poaching based on the sensing results of an active sonar, the anti-poaching IoT system 1 includes an active sonar (not shown) and detects poaching based on the detection results of the active sonar. In this case, the active sonar has an acoustic wave transmitter that emits acoustic waves into the water and an acoustic reflection receiver that receives reflected sound from the detection target using multiple microphones. The sensor data (acoustic data, acoustic wave transmission time, acoustic reflection reception time) and sensor status information obtained through this sensing are transmitted to the server 20 via wireless communication. The server 20 detects the position and distance of the detection target from the time difference between the received emitted sound and the reflected sound and the detection direction of the reflected sound obtained from the acoustic data. The server 20 then uses the detection results to detect the detection target in the same manner as in the present embodiment. Note that, unlike an active sonar that emits acoustic waves into the water and captures reflected sound from the detection target, the present embodiment uses a passive sonar that captures acoustic waves generated by detection targets (e.g., ships, divers, etc.) present underwater (including the water surface).

[0189] [4.7.2. Radar application] When the server 20 detects poaching based on radar sensing results, the anti-poaching IoT system 1 includes a radar (not shown) and detects poaching based on the radar detection results. In this case, the radar is installed in a location where sensing is possible (e.g., on land, such as the coast of the monitoring area). It has a radio wave transmitter that transmits radio waves, such as millimeter waves or microwaves, as search waves within the detection range via a radar antenna, and a radio wave reflected wave receiver that receives reflected waves from the detection target. The detection data (radar data, radio wave transmission time, radio wave reflected wave reception time) and sensor status information obtained through such sensing are transmitted to the server 20 via wireless or wired communication. The server 20 detects the position and distance of the detection target based on the time difference between the received search wave and the reflected wave and the detection direction of the reflected wave obtained from the radar data. The server 20 then uses the detection results to detect the detection target in the same manner as in the above-described embodiment.

[0190] [4.7.3. Laser sensor application] When the server 20 detects poaching based on the sensing results of a laser sensor (such as a laser rangefinder (LRF) or light detection and ranging (LIDAR)), the anti-poaching IoT system 1 includes a laser sensor (not shown) and detects poaching based on the detection results of the laser sensor. In this case, the laser sensor is installed in a location where sensing is possible (for example, on land, such as the coast of the monitored area). It has a laser light transmitter that transmits laser light, such as visible light, ultraviolet light, X-rays, or infrared light, and a laser reflection receiver that receives reflected light from the object to be detected. The detection data (laser data, laser light transmission time, and laser reflection reception time) and sensor status information obtained through such sensing are transmitted to the server 20 via wireless or wired communication. The server 20 detects the position and distance of the object to be detected based on the time difference between the received laser light and the reflected laser light and the moving direction of the reflected laser wave obtained from the laser data. The server 20 then uses the detection results to detect the object to be detected in the same manner as in the present embodiment.

[0191] [4.7.4. Image sensor application] When the server 20 detects poaching based on the sensing results of an image sensor (hereinafter referred to as a camera), the anti-poaching IoT system 1 includes a camera (not shown) and detects poaching based on the camera's detection results. In this case, the camera is installed in a position where sensing is possible (for example, installed on land, such as the coast of the monitored area), and the imaging data (captured image) obtained by such sensing and sensor status information are transmitted to the server 20 via wireless or wired communication. The server 20 detects the detection target by pattern matching with image information of the detection target stored in advance. If the server 20 detects the detection target from the imaging data received from the camera outside of operating hours, it may determine that the detection target is a poaching vessel or a poacher. The imaging data may be moving or still images.

[0192] When a single camera is used, the server 20 stores a plurality of pieces of image information and distance information of boats or divers, which are objects to be detected, associated in advance at predetermined distances (for example, every 1 m) from the camera installation position. The server 20 detects the distance and position of the object to be detected by pattern matching or the like for the captured image acquired from the camera. The information stored in advance in the server 20 may also include a plurality of pieces of image information of distance markers captured together with the boats or divers, which are objects to be detected.

[0193] In the case of multiple cameras, server 20 may perform image processing of the object to be detected by aligning the optical axes of the multiple cameras (for example, the optical axes of two cameras), and may specify the position by superimposing each image and measuring the coordinates of the object to be detected based on the shift amount using the principle of triangulation. Alternatively, server 20 may detect the object to be detected by pattern matching the image data obtained from each of the multiple cameras, obtain the center coordinates, and detect the coordinate position of the object to be detected based on the direction angle of each camera using triangulation to specify the position.

[0194] Furthermore, when capturing moving or still images, the camera may capture images in a first mode, a second mode, or a third mode. Here, the first mode may be general color photography. The second mode may be infrared photography with sensitivity to infrared light. The third mode may be thermography photography that visualizes temperature distribution based on infrared light. In this case, the camera has a first imaging means corresponding to the first mode, a second imaging means corresponding to the second mode, a third imaging means corresponding to the third mode, and an imaging means switching means for determining which imaging means to apply.

[0195] Specifically, if the first imaging means is applied when the camera is started up, the imaging means switching means may switch the imaging means to be applied from the first imaging means to the second imaging means. The imaging means switching means may also control switching from a state in which the first imaging means is applied alone to a state in which the second imaging means and the third imaging means are applied simultaneously. The imaging means switching means may control the imaging means switching at predetermined intervals (e.g., 10 seconds or 8 hours) or may control the imaging means switching based on an instruction from an external device such as the server 20. The instruction from the server 20 may be, for example, an instruction command to switch the imaging means to be applied from the first imaging means to the second imaging means at 6:00 p.m. on March 31, 2020. Alternatively, for example, a day / night detector (light blocking sensor) provided in an external device other than the server 20 may detect whether it is day or night based on the intensity of ambient light and notify the server 20 of the detection information. In this case, the imaging means switching means of the camera may switch the imaging means to be applied from the first imaging means to the second imaging means based on the received detection information. Furthermore, the imaging means switching means may control the switching of the imaging means to be applied based on the analysis results of the image information of the detected object captured by the camera. That is, the imaging means switching means may control the switching of the imaging means to be applied based on whether the object is a poaching vessel or a poacher determined by image analysis. The configuration of the camera may be changed as appropriate depending on the surrounding environment. The camera may be switched to other modes, not limited to the first, second, and third modes described above.

[0196] [4.7.5. Sensor switching configuration] Furthermore, the anti-poaching IoT system 1 may include the active sonar, radar, laser sensor, and image sensor exemplified above in addition to the underwater acoustic sensor 12 according to this embodiment. Each sensor or the server 20 may have a sensor switching means for determining which sensor to apply, and the sensor switching means may switch the sensor to be applied between the underwater acoustic sensor 12, the active sonar, radar, laser sensor, image sensor, etc. Specifically, if the underwater acoustic sensor 12 is applied at the time of sensor activation, the sensor switching means may switch the applied sensor from the underwater acoustic sensor 12 to an image sensor. The sensor switching means may also control switching from a mode in which the underwater acoustic sensor 12 is applied alone to a mode in which the underwater acoustic sensor 12 and the image sensor are applied simultaneously. Here, the sensor switching means may control sensor switching at predetermined intervals (e.g., 10 seconds or 8 hours) or may control sensor switching based on an instruction from the server 20. The instruction from the server 20 may be, for example, an instruction command to switch the applied sensor from the underwater acoustic sensor 12 to an image sensor at 9:00 a.m. on March 31, 2020.

[0197] As described above, according to the embodiment in which the other sensor is applied, it is possible to further improve the convenience for the user and to suppress erroneous detection of the object to be detected. [Explanation of symbols]

[0198] 1. IoT system to combat illegal fishing 10, 12 Underwater acoustic sensor 110 Antenna section 121 Searchlight 122 Berthing light section 123 Solar Cells 130 Sensing unit 140 Power supply section 150 Mooring section 160 Weight 170 Transmitting Buoy Unit 181 Weight 182 Float 20 servers 220 Control Unit 221 Analysis Department 222 Object detection unit 223 Detection notification unit 224 Request acquisition part 225 Data Acquisition Department 226 Data Provision Department 230 Storage section 231 Sensor Information 232 Notification Information 240 Communications Department 30 Monitor terminal 310 Input section 320 Control Unit 330 Storage section 340 Communications Department 350 Display section

Claims

1. a control unit that analyzes the intensity of the sensor data received from a sensor for each frequency of the sensor data and for each time the sensor data was obtained, to obtain an analysis result, and controls to provide the analysis result to a terminal; The control unit determining a time width from the start to the end of the analysis result to be displayed according to the type of detection target detected based on the sensor data; the sensor is an acoustic sensor; The sensor data is sound obtained by the acoustic sensor. server.

2. the control unit determines whether or not the intensity of the sensor data is greater than a first threshold for each frequency and each time based on the sensor data, and obtains the result of the determination as the analysis result. The server of claim 1 .

3. the control unit detects, based on the sensor data, a first frequency band in which the intensity of the sensor data is greater than the first threshold, and detects a first detection object based on the first frequency band being wider than a first band; The server of claim 2.

4. the control unit detects, based on the sensor data, a first time at which a frequency exists at which the intensity of the sensor data is greater than the first threshold, and detects, as the first frequency band, a frequency band at which the intensity of the sensor data is greater than the first threshold at a second time that is a predetermined time after the first time. The server of claim 3.

5. the control unit controls the terminal to provide identification information corresponding to information related to the detection based on the detection of the first detection target object.

5. The server according to claim 3 or 4.

6. The first detection object is a ship. The server according to any one of claims 3 to 5.

7. the control unit detects a second detection target based on a model generated in advance by machine learning and the analysis result. The server of claim 1 .

8. the control unit detects the second detection object based on the fact that a detection probability of the second detection object output based on the model and the analysis result is greater than a predetermined probability. The server of claim 7.

9. the control unit controls the terminal to provide identification information corresponding to information related to the detection based on the detection of the second detection target object.

9. The server according to claim 7 or 8.

10. the second detection object is a diver; The server according to any one of claims 7 to 9.

11. the control unit detects, based on the sensor data, a second frequency band in which the intensity of the sensor data is greater than a second threshold, and cancels the detection of the second detection object based on the second frequency band being wider than the second band; The server according to any one of claims 7 to 10.

12. the control unit detects a time period during which the intensity of the sensor data is greater than a second threshold based on the sensor data, and cancels the detection of the second detection object based on the time period being shorter than a predetermined time period; The server according to any one of claims 7 to 10.

13. the control unit controls the terminal to provide information related to the detection based on a transmission request received from the terminal that has received the identification information. The server according to claim 5 or 9.

14. The information related to the detection includes a map according to the position of the sensor. The server of claim 13.

15. the control unit controls the analysis result to be provided to the terminal based on a request to transmit the analysis result from the terminal. The server according to any one of claims 1 to 14.

16. the control unit, upon receiving a request to transmit the analysis result from the terminal, controls the terminal to provide the analysis result and at least one of air pressure, water temperature, and wind force according to the position of the sensor; The server of claim 15.

17. the sensor data is detected by a sensor unit included in the sensor; The sensor unit is present in water. The server according to any one of claims 1 to 16.

18. The control unit receives a request to play the sound from the terminal. The server according to any one of claims 1 to 17.

19. The control unit receives a request from the terminal to download the voltage of the power supply unit of the sensor. The server according to any one of claims 1 to 18.

20. The control unit receives a request to download the position of the sensor from the terminal. The server according to any one of claims 1 to 19.

21. Based on the sensor data received from the sensor, analyze the intensity of the sensor data for each frequency of the sensor data and each time when the sensor data was obtained to obtain an analysis result, and control the terminal to provide the analysis result; determining a time width from the start to the end of the analysis result to be displayed according to the type of detection target detected based on the sensor data; Including, the sensor is an acoustic sensor; The sensor data is sound obtained by the acoustic sensor. Processing method.

22. On the computer, Based on the sensor data received from the sensor, analyze the intensity of the sensor data for each frequency of the sensor data and each time when the sensor data was obtained to obtain an analysis result, and control the terminal to provide the analysis result; determining a time width from the start to the end of the analysis result to be displayed according to the type of detection target detected based on the sensor data; A program for executing the sensor is an acoustic sensor; The sensor data is sound obtained by the acoustic sensor. program.

Images