Information processing system, program, and system

Abstract

To improve detection accuracy of detecting the occurrence of an event.SOLUTION: An information processing system includes: an acquisition unit that acquires respective position information detected by a first sensor device, a second sensor device, and a third sensor device located within a predetermined area; a first calculation unit that calculates a first relative distance between the first sensor device and the second sensor device, a second relative distance between the first sensor device and the third sensor device, and a third relative distance between the second sensor device and the third sensor device on the basis of the acquired position information; a second calculation unit that calculates a value corresponding to the first relative distance, a value corresponding to the second relative distance and a value corresponding to the third relative distance; and a determination unit that determines whether or not any of the value corresponding to the first relative distance, the value corresponding to the second relative distance and the value corresponding to the third relative distance exceeds a predetermined threshold.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to an information processing system, a program, and a system.

Background Art

[0002] In recent years, technologies for monitoring the occurrence of natural disasters have been proposed.

[0003] For example, Patent Document 1 discloses a system for monitoring the displacement of a slope based on GPS (Global Positioning System) data output by a reference station installed at a position outside the slope and GPS data output by a GPS station installed at a position inside the slope.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] Improvement in detection accuracy for detecting the occurrence of an event is required.

Means for Solving the Problems

[0006] An information processing system according to an aspect of the present invention includes an acquisition unit that acquires respective position information detected by a first sensor device, a second sensor device, and a third sensor device existing in a predetermined area, and based on the acquired position information, a first calculation unit that calculates a first relative distance between the first sensor device and the second sensor device, a second relative distance between the first sensor device and the third sensor device, and a third relative distance between the second sensor device and the third sensor device, respectively, a second calculation unit that calculates a value related to the first relative distance, a value related to the second relative distance, and a value related to the third relative distance, respectively, and a determination unit that determines whether any of the value related to the first relative distance, the value related to the second relative distance, and the value related to the third relative distance exceeds a predetermined threshold value.

Brief Description of the Drawings

[0007]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the present specification and the drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted.

[0009] One or more of the embodiments (including examples, modified examples, and application examples) described below can each be implemented independently. On the other hand, at least a part of the plurality of embodiments described below may be implemented in appropriate combination with at least a part of other embodiments. These plurality of embodiments may include different novel features. Therefore, these plurality of embodiments can contribute to solving different objects or problems and can exhibit different effects.

[0010] Further, in the following embodiments, the event targeted by the proposed technology of the present invention will be described as a natural disaster, particularly a landslide disaster (landslide), in which the terrain changes. However, the proposed technology of the present invention can be applied to various events regardless of natural disasters.

[0011] <EMBODIMENT> 〔1. Introduction〕 It is required to detect landslides in real time, rescue the affected residents, and promptly conduct evacuation guidance for the residents in the risk area based on the landslide warning. In addition, regarding the early initiation of actions for restoring the site where a landslide has occurred, although there are means of immediate notification such as SNS (Social Networking Service), it is also regarded as a problem that there is no means of actively, promptly, and accurately acquiring disaster site information.

[0012] Therefore, the inventors of the present invention considered that by installing a plurality of sensor devices on the land where a landslide may occur (for example, the slope of a mountain, etc.) and calculating the straight-line distance between the sensor devices in a three-dimensional space, the occurrence of a landslide can be detected quickly and with high accuracy.

[0013] That is, the information processing according to the proposed technology of the present invention (hereinafter referred to as "the information processing according to the embodiment") is a method of calculating the straight-line distance between two points in a three-dimensional space between sensor devices before and after a landslide occurs in a state where a plurality of sensor devices are installed on the slope of a "special landslide warning area", calculating the standard deviation value of the difference calculation result by brute force, and detecting that a landslide has occurred when the standard deviation value changes to be equal to or greater than a threshold value.

[0014] 〔2. System Configuration〕 A system for realizing the information processing according to the embodiment will be described with reference to FIG. 1. FIG. 1 is a diagram showing an example of the system according to the embodiment. As shown in FIG. 1, the system according to the embodiment may be composed of a plurality of different systems. For example, the system according to the embodiment may include a first system Sy1 on the back-end side, a second system Sy2 on the front-end side, an instruction device 400, a flight control device 500, and a flying object FO.

[0015] In addition, FIG. 1 shows an overall system Sy including a first system Sy1 on the back-end side, a second system Sy2 on the front-end side, an instruction device 400, a flight control device 500, and a flying object FO.

[0016] First, the first system Sy1 will be described. The first system Sy1 corresponds to the system according to the embodiment. The first system Sy1 may include a sensor device 10, a reference station 20, a distribution device 30, a management device 40, and a backend system 100.

[0017] The sensor device 10 may be a portable information processing terminal that can be installed at any location according to the user's purpose. For example, the sensor device 10 may be pre-installed on land including the risk of landslides, specifically, land designated as a special landslide warning area (for example, a mountain slope). For this reason, the sensor device 10 may be a stationary information processing terminal fixedly installed at any location according to the user's purpose.

[0018] Also, the sensor device 10 may receive satellite signals. Specifically, the sensor device 10 may receive GNSS signals from GNSS (Global Navigation Satellite System) satellites (not shown). That is, the sensor device 10 may be equipped with a GNSS module (positioning module) including a GNSS receiver corresponding to, for example, RTK (Real Time Kinematic) and an antenna. Further, the sensor device 10 may be equipped with a communication module for communicating with the distribution device 30 and the management device 40.

[0019] The sensor device 10 may perform positioning based on correction information. Specifically, first, the sensor device 10 may acquire its own position information based on GNSS signals. Then, the sensor device 10 may receive correction information distributed from the distribution device 30 described later. The sensor device 10 may correct its own position information based on the correction information. More specifically, the sensor device 10 may correct its own position information by RTK calculation using the correction information. That is, the sensor device 10 may acquire corrected position information by RTK calculation using the correction information. For this reason, the sensor device 10 may be equipped with a program capable of executing RTK calculation. Note that the RTK calculation may be executed by a conventionally well-known method.

[0020] Also, in order to realize the information processing according to the embodiment, a plurality of sensor devices 10 may be installed. For this reason, in the first system Sy1, as an example of a plurality of sensor devices 10, an example including a first sensor device 10-1, a second sensor device 10-2, a third sensor device 10-3,..., an nth sensor device 10-n is shown. When there is no need to distinguish the first sensor device 10-1, the second sensor device 10-2, the third sensor device 10-3,..., the nth sensor device 10-n, the description of the sensor device 10 may be used. Note that time synchronization for aligning the time among the plurality of sensor devices 10 may be performed.

[0021] The reference station 20 may function as a reference station in RTK calculation. That is, the reference station 20 may have a known coordinate (known coordinate) indicating its own position defined. Also, when there are a plurality of reference stations 20, each of the plurality of reference stations 20 may have a known coordinate defined.

[0022] The reference station 20 may receive satellite signals. Specifically, the reference station 20 may receive GNSS signals from GNSS satellites. For example, the reference station 20 may transmit information based on the known coordinate information and the GNSS signal to the distribution device 30. The information based on the GNSS signal may include information indicating the satellite that received the GNSS signal, information indicating the phase of the carrier wave, and the like.

[0023] Specifically, the reference station 20 may transmit various information to the distribution device 30 based on, for example, the standards of RTCM (Radio Technical Commission For Maritime Services). Also, the reference station 20 may transmit, for example, ephemeris to the distribution device 30. Note that the reference station 20 may be appropriately installed at an arbitrary location (for example, a location within the area where the sensor device 10 is installed) by an arbitrary operator or the like.

[0024] The distribution device 30 may be, for example, a server device. The distribution device 30 may receive from the reference station 20 information on the known coordinates of the reference station 20 and information on the GNSS signals received by the reference station 20. Based on the information on the known coordinates of the reference station 20 and the GNSS signals of the reference station 20 to be processed among the reference stations 20, the distribution device 30 may generate correction information for correcting the positioning error by the sensor device 10. The correction information may include, for example, information on the known coordinates of the reference station 20 and information on the phase of the carrier wave from the GNSS satellite.

[0025] The distribution device 30 may transmit the generated correction information to the sensor device 10. Note that the information included in the correction information is not limited to the above example. The correction information may optionally include information necessary for RTK calculation by the sensor device 10.

[0026] Here, the positioning by RTK calculation using the correction information will be described. First, the sensor device 10 may acquire rough position information (approximate position information) of its own device by positioning based on GNSS signals. Also, the distribution device 30 may generate correction information including information on the known coordinates of the reference station 20 and information based on GNSS signals. The distribution device 30 may transmit the correction information to the sensor device 10. The sensor device 10 may correct the approximate position information by RTK calculation using the correction information. That is, the sensor device 10 may calculate, by RTK calculation, information (corrected position information) obtained by correcting the approximate position information with the correction information.

[0027] The sensor device 10 may transmit the corrected position information to the management device 40. Also, the management device 40 may transmit the corrected position information to the backend system 100.

[0028] The management device 40 may mediate the transmission and reception of information between the sensor device 10 and the backend system 100. For example, the management device 40 may acquire the corrected position information transmitted by the sensor device 10 and transmit the acquired corrected position information to the backend system 100. The management device 40 may be a server operating on a data center configured on a public cloud such as AWS (Amazon Web Service).

[0029] Note that the first system Sy1 may not have the management device 40, and the corrected position information may be directly transmitted from the sensor device 10 to the backend system 100. Also, a configuration may be adopted in which the sensor device 10 transmits the corrected position information to the distribution device 30, and the distribution device 30 transmits the corrected position information to the backend system 100.

[0030] The backend system 100 corresponds to the information processing system according to the embodiment. The backend system 100 may be configured by, for example, one or more server devices, but in this embodiment, it will be described as one server device. Therefore, hereinafter, the backend system 100 will be rephrased as the information processing device 100.

[0031] The information processing device 100 executes the backend processing among the information processing according to the embodiment. The main backend processing may be, for example, a landslide detection process for detecting the occurrence of a landslide in real time based on the position information acquired from the sensor device 10, a process for generating a three-dimensional map from the three-dimensional point cloud data generated by the flying object FO, and the like. The information processing device 100 can acquire the three-dimensional point cloud data via the flight control device 500.

[0032] Also, when the information processing device 100 detects the occurrence of a landslide, it may notify the front-end system 200 or the instruction device 400 of alert information indicating the occurrence of the landslide. The alert information may at least include information indicating the occurrence of the landslide and information on the area where the landslide occurred.

[0033] Next, the second system Sy2 will be described. The second system Sy2 may include weather information DA1, landslide special area information DA2, a wearable terminal WT, and a front-end system 200.

[0034] The weather information DA1 may include the weather information of each region provided by the Japan Meteorological Agency. Also, the weather information may include rainfall data measured by a rainfall sensor, etc. The weather information DA1 may be provided to the front-end system 200 from an external device belonging to the Japan Meteorological Agency through API cooperation via the Internet.

[0035] The landslide special area information DA2 is information indicating an area of land where there is a risk of harm to the lives or bodies of residents when a landslide occurs, and may be provided by local governments. The landslide special area information DA2 may be provided to the front-end system 200 from an external device belonging to each local government through API cooperation via the Internet.

[0036] Also, although not shown in FIG. 1, information on restricted access areas existing in each region (for example, information on restricted access areas in landslide special areas) may also be uploaded to the front-end system 200.

[0037] The wearable terminal WT is an information processing terminal worn by workers at the work site, and may be equipped with sensors capable of detecting the vital information of the workers. Also, the wearable terminal WT may provide the vital information of the workers to the front-end system 200 through API cooperation via a wireless communication network such as LTE (Long Term Evolution), 4G (4th Generation), 5G (5th Generation: the 5th generation mobile communication system).

[0038] The front-end system 200 may be composed of, for example, one or more server devices. However, in this embodiment, it will be described as one server device. Therefore, hereinafter, the front-end system 200 will be referred to as the display control device 200.

[0039] The display control device 200 executes the front-end processing among the information processing according to the embodiment. The main processing of the front-end may be providing information to the user using a predetermined screen. For example, the display control device 200 may display information such as the information of the area where the sensor device 10 is installed, the information indicating the occurrence of a landslide, the information of the area where the landslide has occurred, and vital information with high urgency / importance when there are workers in or near the area where the landslide has occurred on the user's instruction device 400.

[0040] Note that the user in the embodiment may be an organization U (specifically, the personnel of the organization) that monitors the occurrence of a landslide or is requested to dispatch when a landslide occurs, such as the police, the fire department, and administrative agencies (local governments). Also, the user may include a management operator M who is responsible for constructing and managing the entire system Sy.

[0041] Subsequently, as other devices included in the entire system Sy, the aircraft FO, the instruction device 400, and the flight control device 500 will be described.

[0042] The aircraft FO may be, for example, a drone. The aircraft FO may be used by the user. Also, the aircraft FO may be equipped with a positioning module that performs positioning of its own aircraft. The aircraft FO may be equipped with, for example, the sensor device 10 as a device including a positioning module. That is, the aircraft FO may acquire corrected position information indicating the position of its own aircraft by RTK calculation using correction information. Note that the RTK calculation may be executed by a conventionally well-known method.

[0043] Also, the aircraft FO and the sensor device 10 may be separate devices. That is, the user may attach the sensor device 10 to the body of an off-the-shelf aircraft FO to cause the aircraft FO to perform positioning of its own aircraft. On the other hand, the aircraft FO and the sensor device 10 may be an integrated device. That is, the user may cause an aircraft FO having the same function as the sensor device 10 as one function to perform positioning of its own aircraft.

[0044] Furthermore, the aircraft FO may be equipped with a point cloud data generation module having a LiDAR (Light Detection and Ranging) function. That is, when identifying its own position when generating point cloud data (three-dimensional point cloud data), the aircraft FO may use the positioning data obtained by the above RTK positioning function (positioning module).

[0045] Also, the aircraft FO and the point cloud data generation module may be separate devices. That is, the user may attach the point cloud data generation module to the airframe of an off-the-shelf aircraft FO to cause the aircraft FO to generate point cloud data. On the other hand, the aircraft FO and the point cloud data generation module may be an integrated device. That is, the user may cause an aircraft FO having a function similar to that of the point cloud data generation module as one function to generate point cloud data.

[0046] The instruction device 400 is an information processing terminal used to give a flight instruction to the aircraft FO according to weather information or the like, or to instruct the position of the object for which point cloud data should be acquired for the aircraft FO before or during flight. The instruction device 400 may be, for example, a smartphone, a tablet terminal, a notebook PC (Personal Computer), a desktop PC, a mobile phone, a PDA (Personal Digital Assistant), or the like.

[0047] The instruction device 400 inputs the instruction information received from the user to the flight control device 500. Here, the user who gives a flight instruction to the aircraft FO or instructs the position of the object for which point cloud data should be acquired may be the above-described organization U or the management operator M. In FIG. 1, an instruction device 400-1 is shown as an example of the instruction device 400 used by the organization U, and an instruction device 400-2 is shown as an example of the instruction device 400 used by the management operator M.

[0048] The flight control device 500 may be, for example, a server device. The flight control device 500 controls the flight of the flying object FO according to the input instruction device. For example, the flight control device 500 may control the flying object FO to fly along the flight path defined by the instruction information. Since the flying object FO is equipped with a positioning module, it may fly while comparing its own position obtained by RTK calculation with the information of the flight path.

[0049] In addition, the flight control device 500 controls the flying object FO to generate point cloud data at the position of the target defined by the instruction information. Since the flying object FO is equipped with a point cloud data generation module (for example, a LiDAR function), it generates three-dimensional point cloud data at the position of the target defined by the instruction information based on its own position obtained by RTK calculation. For example, the flying object FO can generate the first three-dimensional point cloud data in the first period (for example, before the landslide disaster) and the second three-dimensional point cloud data in the second period (for example, after the landslide disaster).

[0050] In addition, the flight control device 500 may acquire three-dimensional point cloud data from the flying object FO and transmit the acquired three-dimensional point cloud data to the information processing device 100.

[0051] [3. Acquisition of Position Information] When detecting the occurrence of a landslide disaster, the information processing device 100 acquires the position information of each of the sensor devices 10. Specifically, the information processing device 100 acquires the corrected position information corrected by RTK calculation from the sensor device 10. Therefore, with reference to FIG. 2, the acquisition of the corrected position information will be described. FIG. 2 is a diagram showing an example of the position information acquisition process.

[0052] In FIG. 2, when a plurality of sensor devices 10 are installed on the mountain slope within the area AR included in the landslide disaster special warning area, a scene where the corrected position information is acquired from each sensor device 10 is shown. In addition, a reference station 20 is also installed within the area AR. Note that the number of the sensor devices 10 and the reference station 20 in the area AR is not limited to the example of FIG. 2.

[0053] The sensor device 10 may calculate position information indicating the position (installed position) of the own terminal by GNSS positioning based on GNSS signals. Such position information may be approximate position information (rough position information) that can indicate a position within a range of several meters around the actual position of the own device. The sensor device 10 may transmit the rough position information to the distribution device 30 together with the information of the received GNSS signals (step S21).

[0054] Based on the rough position information received from the sensor device 10, the distribution device 30 may select a reference station 20 to be processed among the reference stations 20. For example, the distribution device 30 may select, as the reference station 20 to be processed, a reference station 20 existing in the area corresponding to the position indicated by the rough position information.

[0055] Note that in the above example, the sensor device 10 calculates rough position information by GNSS positioning, but the distribution device 30 may also calculate the rough position information of the sensor device 10. In this case, in step S21, the sensor device 10 only needs to transmit GNSS signals, and the distribution device 30 may calculate the rough position information of the sensor device 10 by GNSS positioning based on the GNSS signals received from the sensor device 10.

[0056] Next, the distribution device 30 may transmit a distribution request for requesting distribution of GNSS signals to the selected reference station 20 (step S22). The reference station 20 may always receive GNSS signals. That is, the reference station 20 to be processed may transmit information based on the GNSS signals received at the time of receiving the distribution request to the distribution device 30 (step S23).

[0057] Note that the reference station 20 to be processed may continue to transmit GNSS signals to the distribution device 30 after receiving the distribution request. Also, the reference station 20 may always push GNSS signals to the distribution device 30. That is, the reference station 20 may transmit GNSS signals to the distribution device 30 even without receiving the distribution request from the distribution device 30. In this case, the distribution device 30 may accumulate the received GNSS signals.

[0058] The distribution device 30 may generate correction information based on the GNSS signal received from the reference station 20 to be processed (step S24). For example, the distribution device 30 may calculate the position coordinates of the reference station 20 by GNSS positioning based on the GNSS signal received from the reference station 20 to be processed, and generate correction information by obtaining the difference between the calculated position coordinates and the known coordinates of the reference station 20 (for example, stored in the distribution device 30 in advance). The correction information will be used to perform real-time correction on the approximate position information of the sensor device 10.

[0059] Note that in the above example, the distribution device 30 calculates the position coordinates by GNSS positioning, but the reference station 20 to be processed may also calculate its own position coordinates. In this case, in step S23, the reference station 20 to be processed may transmit information indicating its own position coordinates to the distribution device 30 together with the information based on the GNSS signal.

[0060] The distribution device 30 may transmit the generated correction information to the sensor device 10 that is the source of the approximate position information (step S25).

[0061] The sensor device 10 may execute a correction calculation for correcting the approximate position information based on the correction information received from the distribution device 30 (step S26). Specifically, the sensor device 10 may calculate the corrected position information by correcting the approximate position information by RTK calculation using the correction information.

[0062] The sensor device 10 may transmit the corrected position information to the management device 40 (step S27). When the management device 40 receives the corrected position information from the sensor device 10, it may transmit the received corrected position information to the information processing device 100 (step S28). As a result, the information processing device 100 can obtain the position information of the sensor device (specifically, the corrected position information) via the management device 40.

[0063] 〔4. Configuration of Sensor Device〕 With reference to FIG. 3, the sensor device 10 according to the embodiment will be described. FIG. 3 is a diagram showing a configuration example of the sensor device 10 according to the embodiment. As shown in FIG. 3, the sensor device 10 may include a communication unit 11, a GNSS module M, a storage unit 12, and a control unit 13.

[0064] (Regarding the communication unit 11 and the GNSS module M) The communication unit 11 may be realized by, for example, a NIC (Network Interface Card) or the like. The communication unit 11 may be connected to a network by wire or wirelessly. The communication unit 11 may transmit and receive information to and from, for example, a distribution device 30, a management device 40, and an information processing device 100 via the network. The GNSS module M can receive GNSS signals. That is, the GNSS module M may be composed of any component for receiving GNSS signals.

[0065] (Regarding the storage unit 12) The storage unit 12 may be realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 12 may store, for example, the approximate position information calculated by the approximate position calculation unit 13b, the correction information received from the distribution device 30, and the corrected position information obtained by RTK calculation using such correction information.

[0066] (Regarding the control unit 13) The control unit 13 may be realized by, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an MPU (Micro Processing Unit), etc., when various programs stored in the storage device inside the sensor device 10 are executed with the RAM as a working area. Also, the control unit 13 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0067] The control unit 13 may include a first receiving unit 13a, a rough position calculation unit 13b, a first transmitting unit 13c, a second receiving unit 13d, a correction unit 13e, and a second transmitting unit 13f. Note that the internal configuration of the control unit 13 is not limited to the configuration shown in FIG. 3, and may be any other configuration as long as it can perform the information processing described later. Also, the connection relationship between the respective processing units included in the control unit 13 is not limited to the connection relationship shown in FIG. 3, and may be any other connection relationship.

[0068] (Regarding the first receiving unit 13a) The first receiving unit 13a may correspond to a GNSS receiver compatible with RTK and an antenna, and receive GNSS signals. Also, the first receiving unit 13a may output the received GNSS signals to the rough position calculation unit 13b.

[0069] (Regarding the rough position calculation unit 13b) The rough position calculation unit 13b may calculate position information indicating the position of the own device by GNSS positioning based on the GNSS signals received by the first receiving unit 13a. That is, the rough position calculation unit 13b may calculate rough position information by GNSS positioning based on the GNSS signals. Also, the rough position calculation unit 13b may store the rough position information in the storage unit 12.

[0070] (Regarding the first transmitting unit 13c) The first transmitting unit 13c may transmit the rough position information calculated by the rough position calculation unit 13b to the distribution device 30.

[0071] (Regarding the second receiving unit 13d) The second receiving unit 13d may receive correction information transmitted from the distribution device 30. Also, the second receiving unit 13d may store the correction information in the storage unit 12.

[0072] (Regarding the correction unit 13e) The correction unit 13e may perform a correction calculation for correcting the approximate position information calculated by the approximate position calculation unit 13b based on the correction information received by the second reception unit 13d. That is, the correction unit 13e may correct the approximate position information by RTK calculation using the correction information. Further, the correction unit 13e may cause the storage unit 12 to store the corrected position information (corrected position information) obtained by such a correction calculation.

[0073] (Regarding the second transmission unit 13f) The second transmission unit 13f may transmit the corrected position information obtained by the RTK calculation by the correction unit 13e. For example, the second transmission unit 13f may transmit the corrected position information to the management device 40. Note that the second transmission unit 13f may directly transmit the corrected position information to the information processing device 100.

[0074] [5. Configuration of the information processing device] The information processing device 100 according to the embodiment will be described with reference to FIG. 4. FIG. 4 is a diagram showing a configuration example of the information processing device 100 according to the embodiment. As shown in FIG. 4, the information processing device 100 may include a communication unit 110, a storage unit 120, and a control unit 130.

[0075] (Regarding the communication unit 110) The communication unit 110 is realized by, for example, a NIC or the like. For example, the communication unit 110 is connected to a network by wire or wirelessly, and transmits and receives information to and from the sensor device 10, the management device 40, the display control device 200, the instruction device 400, and the flight control device 500.

[0076] (Regarding the storage unit 120) The storage unit 120 may be realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 120 may store, for example, information necessary for the earth and sand disaster detection process, information necessary for generating alert information indicating the occurrence of an earth and sand disaster, etc. Further, the storage unit 120 may store a program for causing the information processing device 100 to execute the information processing according to the embodiment.

[0077] (Regarding the control unit 130) The control unit 130 may be realized by various programs stored in the storage device inside the information processing apparatus 100 being executed with the RAM as a work area by a CPU, GPU, MPU, etc. Also, the control unit 130 may be realized by an integrated circuit such as an ASIC or FPGA, for example.

[0078] The control unit 130 may include an acquisition unit 131, a first calculation unit 132, a second calculation unit 133, a determination unit 134, an estimation unit 135, and a notification unit 136. Note that the internal configuration of the control unit 130 is not limited to the configuration shown in FIG. 4, and may be other configurations as long as they perform the information processing described later. Also, the connection relationship of each processing unit included in the control unit 130 is not limited to the connection relationship shown in FIG. 4, and may be other connection relationships.

[0079] (Regarding the acquisition unit 131) The acquisition unit 131 may acquire each position information detected by each of the sensor devices 10 existing in a predetermined area. Specifically, the acquisition unit 131 may acquire corrected position information obtained by correcting the approximate position information by RTK calculation by the sensor device 10 existing in a predetermined area. For example, the acquisition unit 131 may acquire the corrected position information obtained by RTK calculation by each of the first sensor device 10-1, the second sensor device 10-2, the third sensor device 10-3,..., the nth sensor device 10-n.

[0080] For example, the first sensor device 10-1, the second sensor device 10-2, the third sensor device 10-3,..., the nth sensor device 10-n calculate RTK at a predetermined period to calculate the corrected position information at a predetermined period. Therefore, the acquisition unit 131 may sequentially acquire the corrected position information of each sensor device 10 in response to the corrected position information being calculated at a predetermined period.

[0081] Also, the acquisition unit 131 may acquire other information. For example, the acquisition unit 131 may acquire three-dimensional point cloud data. For example, the acquisition unit 131 may acquire three-dimensional point cloud data generated by the flying object FO using the LiDAR function.

[0082] Note that the corrected position information acquired by the acquisition unit 131 may be three-dimensional position information including longitude, latitude, and altitude information. Further, the predetermined area may be, for example, an area AR included in a special warning area for landslide disasters.

[0083] (Regarding the first calculation unit 132) The first calculation unit 132 may calculate the relative distance between two different sensor devices 10 based on the corrected position information. For example, the first calculation unit 132 may calculate the relative distance between two different sensor devices 10 for all combination patterns that are established as combinations of two different sensor devices 10 (that is, by brute force), based on the corrected position information of each of the two different sensor devices 10.

[0084] Specifically, the first calculation unit 132 may calculate a first relative distance between the first sensor device 10-1 and the second sensor device 10-2, a second relative distance between the first sensor device 10-1 and the third sensor device 10-3, and a third relative distance between the second sensor device 10-2 and the third sensor device 10-3, respectively.

[0085] More specifically, the first calculation unit 132 may calculate the first relative distance between the first sensor device 10-1 and the second sensor device 10-2 based on the corrected position information (initial value of the position information) at the time when the first sensor device 10-1 was installed and the current corrected position information (current value of the position information) of the second sensor device 10-2. Further, the first calculation unit 132 may calculate the second relative distance between the first sensor device 10-1 and the third sensor device 10-3 based on the corrected position information (initial value of the position information) at the time when the first sensor device 10-1 was installed and the current corrected position information (current value of the position information) of the third sensor device 10-3. Further, the first calculation unit 132 may calculate the third relative distance between the second sensor device 10-2 and the third sensor device 10-3 based on the corrected position information (initial value of the position information) at the time when the second sensor device 10-2 was installed and the current corrected position information (current value of the position information) of the third sensor device 10-3.

[0086] In response to the acquisition unit 131 sequentially acquiring the corrected position information, the first calculation unit 132 may sequentially calculate the relative distance between two different sensor devices 10. Further, the first calculation unit 132 may calculate the relative distance as a straight-line distance based on three-dimensional position information.

[0087] (Regarding the second calculation unit 133) The second calculation unit 133 may calculate a value related to the relative distance. For example, the second calculation unit 133 may calculate a value related to the first relative distance, a value related to the second relative distance, and a value related to the third relative distance, respectively.

[0088] For example, the second calculation unit 133 may calculate a standard deviation value as the value related to the relative distance. Note that the second calculation unit 133 may calculate another value different from the standard deviation value as the value related to the relative distance. For example, the second calculation unit 133 may calculate the difference between the first relative distance calculated at a certain time point and the first relative distance calculated at a subsequent time point as the value related to the first relative distance, or may calculate the ratio of the difference. Also, the second calculation unit 133 may calculate the difference between the second relative distance calculated at a certain time point and the second relative distance calculated at a subsequent time point as the value related to the second relative distance, or may calculate the ratio of the difference. Further, the second calculation unit 133 may calculate the difference between the third relative distance calculated at a certain time point and the third relative distance calculated at a subsequent time point as the value related to the third relative distance, or may calculate the ratio of the difference.

[0089] In response to the acquisition unit 131 sequentially acquiring the corrected position information, the second calculation unit 133 may sequentially calculate a value related to the relative distance.

[0090] (Regarding the determination unit 134) The determination unit 134 may detect the occurrence of an event. For example, the determination unit 134 may detect the occurrence of a landslide. For example, the determination unit 134 may determine whether a value related to the relative distance exceeds a predetermined threshold value, and when the value related to the relative distance exceeds the predetermined threshold value, it may be determined that a landslide has occurred in a predetermined area. For example, the determination unit 134 may determine whether any one of a value related to the first relative distance, a value related to the second relative distance, and a value related to the third relative distance exceeds a threshold value.

[0091] (Regarding the estimation unit 135) The estimation unit 135 may estimate the occurrence area where the event has occurred. For example, the estimation unit 135 may estimate the occurrence area where a landslide has occurred. For example, the estimation unit 135 may estimate the occurrence area where a landslide has occurred based on the difference between the corrected position information of each sensor device 10 after it is determined by the determination unit 134 that a landslide has occurred and the position information of each sensor device 10 before it is determined that a landslide has occurred.

[0092] Also, according to the information processing device 100, the volume of the earth and sand may be calculated from the matching of the relative positional relationship of the point cloud data based on the first three-dimensional point cloud data in the first period (for example, before the landslide) and the second three-dimensional point cloud data in the second period (for example, after the landslide). In this case, the estimation unit 135 may also estimate the types and quantities of the equipment required for earth and sand removal in the area affected by the volume of the earth and sand (the geographical range newly covered with earth and sand due to the landslide).

[0093] (Regarding the notification unit 136) When it is determined that an event has occurred, the notification unit 136 may notify information regarding the occurred event. For example, when it is determined that a landslide has occurred, the notification unit 136 may notify alert information including at least information indicating the occurrence of the landslide and information on the occurrence area where the landslide has occurred to one or more devices not included in the backend system 100. For example, the notification unit 136 may output the alert information to the display control device 200 so that the alert information is notified to the user. Further, the notification unit 136 may notify the alert information to the instruction device 400.

[0094] In addition, the notification unit 137 may output to the display control device 200 so that information on the geographical range (landslide area) newly covered with sediment due to the landslide is notified to the user.

[0095] 〔6. Outline of Landslide Detection Logic〕 Next, the logic of the landslide detection process executed by the information processing device 100 will be described. FIG. 5 is a diagram showing the outline of the landslide detection logic. In FIG. 5, a scenario is shown in which, when ten sensor devices 10 are installed on the slope of a mountain within an area AR included in the landslide special warning area, the occurrence of a landslide is detected based on the position information (corrected position information) acquired from each sensor device 10.

[0096] In FIG. 5, the ten sensor devices 10 are specifically the first sensor device 10-1, the second sensor device 10-2, the third sensor device 10-3, the fourth sensor device 10-4, the fifth sensor device 10-5, the sixth sensor device 10-6, the seventh sensor device 10-7, the eighth sensor device 10-8, the ninth sensor device 10-9, and the tenth sensor device 10-10.

[0097] As shown in FIG. 5, the corrected position information (longitude, latitude, altitude) at time point t0 when these 10 sensor devices 10 are installed is used as the initial value of the position information, and thereafter, the corrected position information (longitude, latitude, altitude) at the current time point tx sequentially acquired in time series is used as the current value of the position information. In such a case, the first calculation unit 132 may calculate the relative distance based on the initial value of the position information and the current value of the position information for every combination of two different sensor devices 10. More specifically, the first calculation unit 132 may calculate the relative distance between two different sensor devices 10 based on the initial value of the position information of one sensor device 10 and the current value of the position information of the other sensor device for all combination patterns that are established as combinations of two different sensor devices 10.

[0098] Further, since the second calculation unit 133 calculates the relative distance by the first calculation unit 132 for each current time point tx according to the time series, the standard deviation value at the current time point tx may be calculated from the relative distance for each current time point tx according to the time series.

[0099] 〔7. Specific Example of Landslide Disaster Detection Logic〕 Subsequently, with reference to FIGS. 6 and 7, the details of the logic of the landslide disaster detection process will be described. FIGS. 6 and 7 illustrate an example of calculating the standard deviation value in the logic of the landslide disaster detection process. FIG. 6 is a diagram (1) showing a specific example of the landslide disaster detection logic.

[0100] According to the example of FIG. 6, the current values of the position information of each of the sensor devices 10 at time point t1 (an example of the current time point tx) are acquired by the acquisition unit 131. In such a case, as shown in FIG. 6, the first calculation unit 132 may calculate the relative distance by brute force for every combination (partially omitted) of two different sensor devices 10 based on the initial value of the position information at time point t0 and the current value of the position information at time point t1.

[0101] In FIG. 6, focusing on one example, the first calculation unit 132 may calculate the relative distance D1-2 at the current time t1 between the first sensor device 10-1 and the second sensor device 10-2 based on the initial value PT1 of the position information of the first sensor device 10-1 and the current value PT2 of the position information of the second sensor device 10-2. Also, focusing on another example, the first calculation unit 132 may calculate the relative distance D2-3 at the current time t1 between the second sensor device 10-2 and the third sensor device 10-3 based on the initial value PT2 of the position information of the second sensor device 10-2 and the current value PT3 of the position information of the third sensor device 10-3.

[0102] When the relative distance is calculated in this way, the second calculation unit 133 may calculate the standard deviation value of the relative distance from each relative distance. In the example of FIG. 6, the second calculation unit 133 may calculate the standard deviation value SD1 of the relative distance from each relative distance calculated at the current time t1 for every combination of two different sensor devices 10.

[0103] Similar processing may be performed for time points t2 (an example of the current time tx), time point t3 (an example of the current time tx), etc. FIG. 6 shows an example in which the second calculation unit 133 calculates the standard deviation value SD2 at time point t2, the standard deviation value SD3 at time point t3, etc.

[0104] In FIG. 6, the position information was conceptually shown such as the initial value PT1 of the position information and the current value PT2 of the position information. However, FIG. 7 shows an example of the actual values for the initial value of the position information, the current value of the position information, and the standard deviation value. FIG. 7 is a diagram (2) showing a specific example of the earth and sand disaster detection logic. FIG. 7 shows an example that focuses on a scene in which the relative distance at time point t3 between two different sensor devices 10 is calculated based on the initial value of the position information (initial values of longitude, latitude, and altitude) at time point t0 of one sensor device 10 and the current value (current values of longitude, latitude, and altitude) of the position information of the other sensor device at time point t3 for every combination of two different sensor devices 10.

[0105] FIG. 7 shows an example in which the second calculation unit 133 calculates "16.58200952" as the standard deviation value SD3 of the relative distances from the relative distances calculated at the current time t3.

[0106] As described so far, the position information of the sensor device 10 is sequentially acquired according to the time series since the sensor device 10 was installed. As a result, the standard deviation value at the current time tx is sequentially calculated from the relative distances for each current time tx according to the time series. For this reason, while the earth and sand disaster has not occurred, since almost no change occurs in the position information, it is considered that almost no difference occurs between the relative distances at each time tx. On the other hand, when an earth and sand disaster occurs at a certain timing, a large change can occur in the position information of the sensor device 10 installed near the place where the earth and sand disaster occurred. As a result, a large change can also occur in the relative distances in the set including this sensor device 10. As a result, the standard deviation value at the time tx when the earth and sand disaster occurs will change greatly compared to the standard deviation values at each time tx before the earth and sand disaster occurs. For this reason, the determination unit 134 determines whether or not the standard deviation value exceeds a predetermined threshold value, and when the standard deviation value exceeds the predetermined threshold value, it can be determined that an earth and sand disaster has occurred. That is, the determination unit 134 can detect that an earth and sand disaster has occurred. This point will be described with reference to FIG. 8.

[0107] FIG. 8 illustrates an example of detecting the occurrence of an earth and sand disaster in the logic of the earth and sand disaster detection process. FIG. 8 is a diagram (3) showing a specific example of the earth and sand disaster detection logic. FIG. 8 focuses on a scene in which the relative distance at time t4 between two different sensor devices 10 is calculated based on the initial value of the position information (initial values of longitude, latitude, and altitude) at time t0 of one sensor device 10 and the current value (current values of longitude, latitude, and altitude) at time t4 of the position information of the other sensor device for every combination of two different sensor devices 10.

[0108] Also, in the example of FIG. 7, the second calculation unit 133 calculates "30.35902763" as the standard deviation value SD4 of the relative distances from the relative distances calculated at the current time t4.

[0109] Here, for example, it is assumed that a predetermined threshold value of "20" is set. In such a case, the determination unit 134 may determine that the standard deviation value SD4 exceeds the predetermined threshold value, and may determine that a landslide has occurred in the area AR where the ten sensor devices 10 are installed. Further, the determination unit 134 may determine that a landslide has occurred at the timing of time point t4.

[0110] Further, the estimation unit 135 may compare, as the position information before the occurrence of the landslide, for example, the current value of the position information at time point t3, and as the position information after the occurrence of the landslide, for example, the current value of the position information at time point t4, and calculate the difference in the position information between the same sensor devices 10 before and after the occurrence. Then, the estimation unit 135 may estimate the vicinity of the location where the sensor device 10 for which a difference exceeding the predetermined threshold value is calculated is installed as the occurrence area where the landslide has occurred.

[0111] For example, when comparing the example of FIG. 7 (example before the occurrence of the landslide) and the example of FIG. 8 (example after the occurrence of the landslide), it is assumed that the position information of the sixth sensor device 10-6 has changed and the difference in the position information exceeds the predetermined threshold value. In such a case, the estimation unit 135 may estimate the vicinity of the location where the sixth sensor device 10-6 is installed in the area AR as the occurrence area where the landslide has occurred.

[0112] [8. Configuration of the Display Control Device] The display control device 200 according to the embodiment will be described with reference to FIG. 9. FIG. 9 is a diagram showing a configuration example of the display control device 200 according to the embodiment. As shown in FIG. 9, the display control device 200 may include a communication unit 210, a storage unit 220, and a control unit 230.

[0113] (Regarding the communication unit 210) The communication unit 210 is realized by, for example, a NIC or the like. For example, the communication unit 210 is connected to the network by wire or wirelessly, and transmits and receives information between the information processing device 100, the instruction device 400, and the wearable terminal WT.

[0114] (Regarding the storage unit 220) The storage unit 220 may be implemented by a semiconductor memory device such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 220 may store, for example, information necessary for generating alert information indicating the occurrence of a landslide disaster, information on the geographical range (landslide disaster area) newly covered with sediment due to the landslide disaster, and the like. Further, the storage unit 120 may store a program for causing the information processing apparatus 100 to execute the information processing according to the embodiment.

[0115] (Regarding the control unit 230) The control unit 230 may be implemented by a CPU, a GPU, an MPU, etc., by executing various programs stored in the storage device inside the display control device 200 using the RAM as a work area. Further, the control unit 230 may be implemented by an integrated circuit such as an ASIC or an FPGA.

[0116] The control unit 230 may include a first reception unit 231, a second reception unit 232, and a display control unit 233. Note that the internal configuration of the control unit 230 is not limited to the configuration shown in FIG. 9, and may be any other configuration as long as it performs the information processing described later. Also, the connection relationship between the processing units included in the control unit 230 is not limited to the connection relationship shown in FIG. 9, and may be any other connection relationship.

[0117] (Regarding the first reception unit 231) The first reception unit 231 may receive information on an event and information on the occurrence area where the event occurred from the information processing apparatus 100. For example, the first reception unit 231 may receive information indicating the occurrence of a landslide disaster and information on the occurrence area where the landslide disaster occurred from the information processing apparatus 100.

[0118] Further, the first reception unit 231 may also receive information on the landslide disaster area and a three-dimensional map generated based on the three-dimensional point cloud data from the information processing apparatus 100. Furthermore, the first reception unit 231 may receive vital information of the worker from the wearable terminal WT.

[0119] (Regarding the second reception unit 232) The second receiving unit 232 may receive the information that has been made open data. For example, the second receiving unit 232 may receive weather information DA1 including rainfall data measured by a rainfall sensor, etc., and landslide special area information DA2 from an external device. Further, the second receiving unit 232 may also receive information on restricted access areas existing in various locations.

[0120] (Regarding the display control unit 233) The display control unit 233 may notify (provide / transmit) the information received by the first receiving unit 231 and the second receiving unit 232 to the user. Specifically, the display control unit 233 may perform display control so that the information received by the first receiving unit 231 and the second receiving unit 232 is displayed on the user's instruction device 400. For example, the display control unit 233 may display the information received by the first receiving unit 231 and the second receiving unit 232 together with map data.

[0121] Note that the map data may be an aerial image taken by an aircraft FO or the like, or may be a three-dimensional map obtained based on the three-dimensional point cloud data generated by the aircraft FO.

[0122] 〔9. Display control screen〕 The display control unit 233 may cause the information received by the first receiving unit 231 and the second receiving unit 232 to be displayed on the instruction device 400 via the screen G1 shown in FIG. 10. The display control unit 233 may display the screen G1 in a state where the information received by the first receiving unit 231 and the second receiving unit 232 is embedded in the display frame included in the screen G1 via the screen G1 shown in FIG. 10.

[0123] FIG. 10 is a diagram showing an example of a display control screen. According to the example of FIG. 10, a plurality of display frames may be provided on the screen G1. As an example, six display frames, namely, display frames G11 to G16, may be provided on the screen G1.

[0124] According to the example of FIG. 10, the name of the area designated by the user may be displayed in the display frame G11. The weather information of the area designated by the user may be displayed in the display frame G12. The map data of the area designated by the user may be displayed in the display frame G13. Here, the area mentioned may be, for example, a designated area designated by the user from among the areas AR included in the special warning area for landslides.

[0125] If there is a worker in the area designated by the user, the vital information of the worker may be displayed in the display frame G14. If there is a worker in the area designated by the user, the position information of the worker (the position information of the wearable terminal WT worn by the worker) may be displayed in the display frame G15. Various information associated with the occurrence of, for example, a landslide may be displayed in the display frame 16 as event information.

[0126] Here, information corresponding to before and after the occurrence of an event may be displayed on the screen G1. For example, on the screen G1, information corresponding to before the occurrence of a landslide may be displayed in a situation where no landslide has occurred, and information corresponding to after the occurrence of a landslide may be displayed when a landslide has occurred. Below, an example of the display content corresponding to each situation will be described.

[0127] First, an example of the display content before the occurrence of a landslide will be described. FIG. 11 is a diagram showing an example of the display content before the occurrence of a landslide. FIG. 11 shows an example of the display content before the occurrence of a landslide when the user designates an area "Takao Mountain Area #1" among the areas AR that can be assigned on the map data.

[0128] In this case, "Takao Mountain Area #1" may be displayed as the area name in the display frame G11. Also, the current (before the occurrence of a landslide) weather information of "Takao Mountain Area #1" may be displayed in the display frame G12, and an example where "Sunny" is displayed is shown in FIG. 11. Note that the current rainfall data of "Takao Mountain Area #1" may also be displayed in the display frame G12.

[0129] On the display frame G13, the map data of the current state (before the landslide disaster) of "Takao Mountain Area #1" may be displayed. For example, when the aircraft FO is currently flying over the "Takao Mountain Area #1", the aerial video captured by the aircraft FO may be displayed as the map data. On the other hand, for example, when the aircraft FO is currently flying over the "Takao Mountain Area #1", a three-dimensional map obtained from the three-dimensional point cloud data generated by the aircraft FO may also be displayed as the map data. In addition, some external organizations (such as local governments) may be working on making three-dimensional point cloud data open data. Therefore, a three-dimensional map generated from the three-dimensional point cloud data provided by an external organization may also be displayed as the map data.

[0130] Also, as shown in FIG. 11, for the map data in the display frame G13, it may be displayed in association with the fact that there is no abnormality and it is normal for the position change of the sensor device 10 with respect to the position where the sensor device 10 is installed (that is, no landslide disaster has occurred).

[0131] On the display frame G14, the current vital information of the worker in the "Takao Mountain Area #1" may be displayed, and an example where "No vital check abnormality" is displayed is shown in FIG. 11. On the display frame G15, the current position information of the worker in the "Takao Mountain Area #1" (the position information of the wearable terminal WT worn by the worker) may be displayed. Also, when there is a no-entry area near the current position of the worker, as shown in FIG. 11, the information of the no-entry area may also be displayed on the display frame G15.

[0132] On the display frame 16, alert information indicating the occurrence of a landslide disaster and the like may be displayed, but it may be not displayed in the example of FIG. 11 before the landslide disaster.

[0133] Next, an example of the display content after a landslide disaster will be described. FIG. 12 is a diagram showing an example of the display content after a landslide disaster. FIG. 12 shows an example of the display content after a landslide disaster when an area called "Takao Mountain Area #1" is specified among the areas AR assigned to the user on the map data.

[0134] In this case, "Takao Mountain Area #1" may be displayed as the area name in the display frame G11. Also, the current (after the landslide disaster) weather information of "Takao Mountain Area #1" may be displayed in the display frame G12, and an example where "rain" is displayed is shown in FIG. 12. Note that the current rainfall data of "Takao Mountain Area #1" may also be displayed in the display frame G12.

[0135] The current (after the landslide disaster) map data of "Takao Mountain Area #1" may be displayed in the display frame G13. For example, when the aircraft FO is currently flying over the "Takao Mountain Area #1", the aerial video taken by the aircraft FO may be displayed as the map data. On the other hand, for example, when the aircraft FO is currently flying over the "Takao Mountain Area #1", the three-dimensional map obtained from the three-dimensional point cloud data generated by the aircraft FO may also be displayed as the map data.

[0136] Also, as shown in FIG. 12, in the map data in the display frame G13, information indicating that there is an abnormality in the position change of the sensor device 10 (that is, there may be a landslide disaster) may be displayed in association with the position where the sensor device 10 is installed. Here, in FIG. 7, an example is shown in which the estimation unit 135 estimates the vicinity of the place where the sixth sensor device 10-6 is installed among the areas AR as the occurrence area where a landslide disaster has occurred. Following such an example, information indicating that there is an abnormality may be displayed for the installation position of the sensor device 10 corresponding to the occurrence area.

[0137] The display frame G14 may display the current vital information of the worker in the "Takao Mountain Area #1", and an example where "No Vital Check Abnormality" is displayed in FIG. 12 is shown. Note that, for example, if the worker is involved in a landslide disaster and some abnormality occurs to the body (for example, when the blood pressure drops due to bleeding), "Vital Check Abnormality Present" will be displayed in the display frame G14. In this case, the user can use the instruction device 400 to request, for example, the dispatch of a rescue team or an ambulance.

[0138] The display frame G15 may display the current position information of the worker in the "Takao Mountain Area #1" (the position information of the wearable terminal WT worn by the worker). Further, when there is a restricted access area near the current position of the worker, as shown in FIG. 12, the display frame G15 may also display the information of the restricted access area.

[0139] The display frame 16 may display alert information indicating the occurrence of a landslide disaster. For example, the display frame 16 may display alert information including information indicating the occurrence of a landslide disaster and information on the occurrence area where the landslide disaster occurred.

[0140] Also, assume that the information processing device 100 calculates the volume of the landslide body of the landslide disaster that occurred in the "Takao Mountain Area #1", and estimates the types and quantities of the equipment required for landslide removal in the landslide disaster area newly covered by the landslide due to the landslide disaster. In such a case, the display frame 16 may further display the information on the volume of the landslide body, the information on the landslide disaster area, and the types and quantities of the equipment required for landslide removal.

[0141] 〔10. Operating Procedure of Information Processing Device〕 From here, the operating procedure of the information processing device 100 in the landslide disaster detection process will be described. FIG. 13 is a flowchart showing the operating procedure of the information processing device 100. In the example of FIG. 13, it is assumed that the position information of the sensor device 10 is the corrected position information based on RTK positioning.

[0142] The control unit 130 may determine whether or not an arbitrary area has been designated within the area AR where the sensor device 10 is installed (for example, the area AR included in the special warning area for landslide disasters) (step S1301). While no area has been designated (step S1301; No), the control unit 130 may wait until an area is designated.

[0143] When an arbitrary area has been designated (step S1301; Yes), the acquisition unit 131 may acquire the position information (initial value of the position information) at the installation time t0 when the sensor device 10 is installed in that area (step S1302).

[0144] Further, the acquisition unit 131 may determine whether or not the position information at the current time tx has been acquired from all the sensor devices 10 installed in the area designated by the user (step S1303). While the position information at the current time tx has not been acquired from all the sensor devices 10 (step S1303; No), the acquisition unit 131 may wait until the position information at the current time tx has been acquired from all the sensor devices 10.

[0145] Note that when the state in which the position information (current location of the position information) at the current time tx cannot be acquired from all the sensor devices 10 continues for a certain period, for example, when the state in which the position information cannot be acquired from some of the sensor devices 10 installed in the area designated by the user continues for a certain period, a predetermined determination process may be performed. For example, the determination unit 134 may determine that some of these sensor devices 10 are malfunctioning, or may determine that there is a possibility of a landslide disaster occurring near some of these sensor devices 10. Further, the notification unit 136 may notify the user of this determination result.

[0146] Returning to the description of FIG. 13, when the position information at the current time tx has been acquired from all the sensor devices 10 (step S1303; Yes), the first calculation unit 132 may calculate the relative distance based on the initial value and the current value for all of the combination patterns that are established as combinations of two different sensor devices 10 (step S1304).

[0147] The second calculation unit 133 may calculate a standard deviation value at the current time point tx based on the relative distance at the current time point tx calculated in step S1304 (step S1305).

[0148] The determination unit 134 may determine whether the standard deviation value at the current time point tx exceeds a threshold value (step S1306). When the determination unit 134 determines that the standard deviation value at the current time point tx does not exceed the threshold value (step S1306; No), the process may return to step S1303.

[0149] When the determination unit 134 determines that the standard deviation value at the current time point tx exceeds the threshold value (step S1306; Yes), it may detect that a landslide disaster has occurred.

[0150] [[11. Processing procedure in the system]] Next, the operation procedure of the entire system Sy will be described. FIG. 14 is a sequence diagram showing an example of the flow in which landslide disaster information is provided to the user in the entire system Sy.

[0151] The sensor device 10 may transmit position information (corrected position information) to the information processing device 100 (step S1401). The information processing device 100 may receive the position information (step S1402).

[0152] The information processing device 100 may execute a landslide disaster detection process based on the received position information (step S1403). Since specific examples of the landslide disaster detection process have been described with reference to FIG. 13 and the like, they are omitted here.

[0153] When the information processing device 100 detects the occurrence of a landslide disaster, it may transmit alert information indicating the occurrence of the landslide disaster to the display control device 200 (step S1404). The display control device 200 may receive the alert information indicating the occurrence of the landslide disaster (step S1405).

[0154] The presentation control device 200 may transmit alert information to the instruction device 400 (step S1406). The instruction device 400 may receive the alert information (step S1407).

[0155] Here, the user who has confirmed the alert information from the instruction device 400 wants to check the details of the landslide disaster site. For example, the user may want to check the details of the landslide disaster site via the alert screen and operate the instruction device 400.

[0156] In this case, the instruction device 400 may transmit a browsing request for the alert screen to the presentation control device 200 (step S1408).

[0157] The presentation control device 200 may receive the browsing request for the alert screen (step S1409), and when receiving the browsing request for the alert screen, may perform a process of generating the alert screen in the following flow.

[0158] The alert screen generated when a landslide disaster occurs may be the screen G1 described in FIG. 12. Therefore, the presentation control device 200 may acquire vital information from the wearable terminal WT (step S1410). For example, when there is a worker in the occurrence area where the landslide disaster has occurred, the presentation control device 200 may acquire the current vital information from the wearable terminal WT of that worker.

[0159] Also, the presentation control device 200 may acquire weather information from the weather information DA1 (step S1411). For example, the presentation control device 200 may acquire the current weather information in the occurrence area where the landslide disaster has occurred.

[0160] The display control device 200 may generate an alert screen on which the alert information acquired in step S1405, the vital information acquired in step S1410, the weather information acquired in step S1411, etc. are displayed, and transmit the generated alert screen to the instruction device 400 (step S1412). Note that when the display control device 200 can further receive the earth volume information, the earth disaster area (prohibited entry area) information, and the type and number of devices necessary for earth removal from the information processing device 100, it may generate an alert screen on which these pieces of information are further displayed.

[0161] The instruction device 400 may receive the alert screen and display the received alert screen on the display screen of its own device (step S1413).

[0162] FIG. 15 is a sequence diagram showing an example of the flow in which a three-dimensional map, which is map data, is provided to the user in the overall system Sy. FIG. 15 shows a scene in which a three-dimensional map based on three-dimensional point cloud data of a location according to the user's instruction is provided. For example, when the user receives the provision of earth disaster information in the flow shown in FIG. 14, the user may want to know the on-site situation of the earth disaster in more detail in order to issue a dispatch request for earth removal. In such a case, the user issues a dispatch request to direct the flying object FO to the site of the earth disaster in order to know the on-site situation.

[0163] Therefore, the instruction device 400 may transmit a dispatch request for the flying object FO according to the instruction content input by the user to the flight control device 500 (step S1501). The instruction content may include, for example, a flight instruction indicating the flight path of the flying object FO and an acquisition instruction indicating the scan target location for acquiring the three-dimensional point cloud data.

[0164] When receiving the dispatch request (step S1502), the flight control device 500 may control the flying object FO to operate according to the instruction content input by the user (step S1503).

[0165] In this case, the flying object FO may fly along a flight path according to the control of the flight control device 500, and perform scanning of the target location from above the target location. Then, the flying object FO may generate three-dimensional point cloud data of the target location and transmit the generated three-dimensional point cloud data to the flight control device 500 (step S1504).

[0166] When the flight control device 500 receives the three-dimensional point cloud data, it may transmit the received three-dimensional point cloud data to the information processing device 100 (step S1505).

[0167] The information processing device 100 may receive the three-dimensional point cloud data (step S1506). Then, the information processing device 100 may generate a three-dimensional map from the received three-dimensional point cloud data and transmit the generated three-dimensional map to the display control device 200 (step S1507).

[0168] The display control device 200 may receive the three-dimensional map (step S1508). Also, the display control device 200 may transmit the three-dimensional map to the indicating device 400 (step S5109). For example, the display control device 200 may transmit the screen G1 inserted into the display frame G13 to the indicating device 400.

[0169] When the indicating device 400 receives the three-dimensional map, it may display the received three-dimensional map on the display screen of its own device (step S1510).

[0170] Here, the user can cause the information processing device 100 to calculate the earth and sand volume within the measurement area by designating the measurement area with respect to the three-dimensional map displayed in step S1510. For example, the user can refer to the three-dimensional map and designate the measurement area so as to surround the location where the earth and sand disaster occurred.

[0171] In such a case, the information processing apparatus 100 may calculate the volume of earth and sand within the measurement area based on the three-dimensional point cloud data (first three-dimensional point cloud data) before the occurrence of the earth and sand disaster at the location to be scanned and the three-dimensional point cloud data (second three-dimensional point cloud data) generated by the aircraft FO at the current time (i.e., the current time after the occurrence of the earth and sand disaster) for the location to be scanned. For example, the information processing apparatus 100 may match the relative positions between the first three-dimensional point cloud data and the second three-dimensional point cloud data, and calculate the difference between the terrain before the occurrence of the earth and sand disaster and the terrain after the occurrence of the earth and sand disaster based on the matching result. Then, the information processing apparatus 100 may determine the terrain of the difference as the earth and sand portion due to the earth and sand disaster, and calculate the volume of earth and sand corresponding to the earth and sand portion based on the three-dimensional point cloud data corresponding to the earth and sand portion.

[0172] Further, the information processing apparatus 100 may specify the geographical range newly covered with earth and sand due to the earth and sand disaster based on the three-dimensional point cloud data, and may estimate the types and quantities of equipment required for earth and sand removal based on the geographical range and the volume of earth and sand.

[0173] 〔12. Hardware Configuration〕 The apparatus according to the embodiment (for example, the information processing apparatus 100, the display control apparatus, etc.) may be realized by a computer 1000 having a configuration as shown in FIG. 16, for example. FIG. 16 is a hardware configuration diagram showing an example of a computer that realizes the functions of the apparatus according to the embodiment. The computer 1000 includes a CPU 1100, a RAM 1200, a ROM 1300, an HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

[0174] The CPU 1100 operates based on a program stored in the ROM 1300 or the HDD 1400, and controls each part. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started up, a program dependent on the hardware of the computer 1000, and the like.

[0175] The HDD 1400 stores programs executed by the CPU 1100, data used by such programs, and the like. The communication interface 1500 receives data from other devices via a predetermined communication network and sends it to the CPU 1100, and transmits data generated by the CPU 1100 to other devices via the predetermined communication network.

[0176] The CPU 1100 controls output devices such as displays and input devices such as keyboards via the input / output interface 1600. The CPU 1100 acquires data from the input device via the input / output interface 1600. Also, the CPU 1100 outputs the generated data to the output device via the input / output interface 1600.

[0177] The media interface 1700 reads a program or data stored in the recording medium 1800 and provides it to the CPU 1100 via the RAM 1200. The CPU 1100 loads such a program from the recording medium 1800 onto the RAM 1200 via the media interface 1700 and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory or the like.

[0178] For example, when the computer 1000 functions as the information processing apparatus 100 according to the embodiment, the CPU 1100 of the computer 1000 realizes the functions of the control unit 130 by executing the program loaded onto the RAM 1200. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, these programs may be acquired from other devices via a predetermined communication network.

[0179] 〔13. Others〕 Also, among the processes described in each of the above embodiments, all or part of the processes described as being automatically performed can be manually performed, or all or part of the processes described as being manually performed can be automatically performed by a known method. In addition, regarding the processing procedures, specific names, and information including various data and parameters shown in the above documents and drawings, they can be arbitrarily changed unless otherwise specified. For example, the various information shown in each figure is not limited to the illustrated information.

[0180] In addition, each component of each device shown in the drawings is conceptually functional and does not necessarily have to be physically configured as shown in the drawings. That is, the specific form of the distribution and integration of each device is not limited to that shown, and all or part of it can be functionally or physically distributed and integrated in any unit according to various loads and usage situations.

[0181] Also, the above embodiments can be appropriately combined within a range that does not conflict with the processing content.

[0182] As described above, some of the embodiments of the present application have been described in detail with reference to the drawings. However, these are examples, and the present invention can be implemented in other forms with various modifications and improvements based on the knowledge of those skilled in the art, including the aspects described in the column of the present invention.

Explanation of Reference Numerals

[0183] 10 Sensor device 20 Reference station 30 Distribution device 40 Management device 100 Information processing device 131 Acquisition unit 132 First calculation unit 133 Second calculation unit 134 Determination unit 135 Estimation unit 136 Notification unit 200 Display control device 231 First reception unit 232 Second reception unit 233 represents the control unit 400 indicating device 500 flight control device FO aircraft Sy overall system Sy1 first system Sy2 second system

Claims

1. An acquisition unit that acquires respective position information detected by a first sensor device, a second sensor device, and a third sensor device existing in a predetermined area; A first calculation unit that calculates, based on the acquired position information, a first relative distance between the first sensor device and the second sensor device, a second relative distance between the first sensor device and the third sensor device, and a third relative distance between the second sensor device and the third sensor device; A second calculation unit that calculates a value related to the first relative distance, a value related to the second relative distance, and a value related to the third relative distance; A determination unit that determines whether any of the value related to the first relative distance, the value related to the second relative distance, and the value related to the third relative distance exceeds a predetermined threshold; An information processing system comprising the above.

2. The acquisition unit, as a plurality of sensor devices, sequentially acquires the position information of each of the plurality of sensor devices in response to the position information detected by the first sensor device, the second sensor device, and the third sensor device being detected at a predetermined period, The first calculation unit calculates a relative distance between two different sensor devices among the plurality of sensor devices in response to the acquisition unit acquiring the position information, The second calculation unit calculates a value related to the relative distance in response to the first calculation unit calculating the relative distance, The determination unit determines whether the value related to the relative distance exceeds the predetermined threshold in response to the second calculation unit calculating the value related to the relative distance. The information processing system according to Claim 1.

3. Further comprising an event determination unit that determines whether an event has occurred, The acquisition unit acquires the position information of each of the plurality of sensor devices as three-dimensional position information, The first calculation unit calculates the relative distance as a straight-line distance based on the three-dimensional position information, The event determination unit determines that an event has occurred in the predetermined area when the determination unit determines that the value related to the relative distance exceeds the predetermined threshold. The information processing system according to Claim 2.

4. The value related to the relative distance is a standard deviation value. The information processing system according to any one of Claims 1 to 3.

5. An estimation unit that estimates the occurrence area where the event occurred based on the difference between the position information of each of the plurality of sensor devices after it is determined that an event has occurred in the event determination unit and the position information of each of the plurality of sensor devices before it is determined that the event has occurred. The information processing system according to claim 3.

6. When it is determined that the event has occurred, a notification unit that notifies one or more devices not included in the information processing system of the information on the occurred event and the information on the occurrence area. The information processing system according to claim 5.

7. The information processing system is communicably connected to a display control system that displays that the event has occurred. The display control system A first receiving unit that receives information on the occurred event and information on the occurrence area from the information processing system. A second receiving unit that receives rainfall data measured by a rainfall sensor installed in an area corresponding to the occurrence area. A display control unit that displays information on the occurred event, information on the occurrence area, and the rainfall data together with map data. Comprising The information processing system according to claim 6.

8. The acquisition unit acquires, as the position information, position information calculated by real-time kinematic positioning. The information processing system according to claim 1.

9. An acquisition procedure for acquiring the position information respectively detected by a first sensor device, a second sensor device, and a third sensor device existing in a predetermined area. A first calculation procedure for calculating a first relative distance between the first sensor device and the second sensor device, a second relative distance between the first sensor device and the third sensor device, and a third relative distance between the second sensor device and the third sensor device based on the acquired position information. A second calculation procedure for calculating a value related to the first relative distance, a value related to the second relative distance, and a value related to the third relative distance. A determination procedure for determining whether any of the value related to the first relative distance, the value related to the second relative distance, and the value related to the third relative distance exceeds a predetermined threshold. A program for causing a computer to execute.

10. A system including a reference station corresponding to a predetermined area, a sensor device, and an information processing system, The sensor device There are a plurality in the predetermined area. The information processing system an acquisition unit that acquires position information calculated based on correction information including information on the coordinates of the reference station and information based on satellite signals received by the reference station, as respective position information detected by a plurality of sensor devices existing in the predetermined area; a first calculation unit that calculates a relative distance between two different sensor devices among the plurality of sensor devices; a second calculation unit that calculates a value related to the calculated relative distance; a determination unit that determines whether or not the calculated value related to the relative distance exceeds a predetermined threshold; A system comprising the above.

Images