Command system, coordination system, and command method

Abstract

To provide a system that provides assistance so that a user who directs countermeasures after a crisis can make a decision for crisis countermeasures more accurately or more quickly.SOLUTION: A command system comprises: an integrated information acquisition unit that acquires integrated information obtained by integrating troop information relating to the status of on-site troops in a disaster area, with sensing data or processed sensing data, the sensing data including image data or point cloud data or spatial data obtained by sensing the disaster area from above by a flying vehicle; an integrated information display unit that displays the integrated information to a control device used by a user who directs the on-site troops; and a work plan command unit that issues a work command as to a work instruction or a work plan for the on-site troops. The work plan command unit causes information about the work instruction or the work plan to be displayed by at least one of a troop terminal used by the on-site troops and the control device.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a command system, a cooperation system, and a command method.

Background Art

[0002] In recent years, the threat of natural disasters such as earthquakes and heavy rains has been increasing. When such disasters occur, a crisis management headquarters is established by an administration such as a local government, and various support activities required at the disaster site, such as rescue activities, fire fighting activities, infrastructure restoration work, and evacuation shelter support activities, are carried out in parallel. Therefore, at the crisis management headquarters, in order to command the support activities by a large number of on-site teams as described above, decision-making across the on-site teams is required according to the information collected from various places.

[0003] Centered around the United States, a management method for an emergency command system called the Incident Command System (ICS) has been proposed for applications such as military and disasters. As shown in FIG. 34, in ICS, command is given considering that the real-time nature of judgments required for each application and the information granularity of the collected information are different. However, in a crisis management headquarters such as for a disaster, each operation including information collection of the on-site situation in cooperation with each on-site team, prioritization of responses, decision-making, and commands to each on-site team has been carried out manually, and it has not been easy to execute these processes accurately and quickly.

[0004] Also, as a technology related to the evacuation shelter support activity by on-site teams, Patent Document 1 discloses that, in consideration of the needs of disaster victims and the situation of evacuation shelters at the time of a disaster, limited materials can be appropriately distributed, and a material providing organization that provides materials is appropriately selected and determined.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] Although Patent Document 1 discloses a technology for evacuation shelter support activities that efficiently provide supplies to evacuation shelters, it does not consider the cooperation with support activities other than evacuation shelter support required at the scene during a crisis, and the work at the crisis management headquarters that oversees the entire support activities at the scene remains difficult.

[0007] Therefore, one object of the present invention is to provide a system that supports a user who commands countermeasures after a crisis to make a more accurate or quicker decision on crisis countermeasures.

Means for Solving the Problems

[0008] According to the present invention, integrated information obtained by integrating unit information regarding the situation of the on-site forces in the disaster area with sensing data including image data, point cloud data, or spatial data obtained by sensing the disaster area from above by an aircraft or data obtained by processing the sensing data, an integrated information acquisition unit that acquires the integrated information, an integrated information display unit that displays the integrated information on a general control device used by a user who commands the on-site forces, and a work plan command unit that commands a work instruction or a work plan for the on-site forces are provided, and the work plan command unit causes at least one of a unit terminal used by the on-site forces and the general control device to display the information of the work instruction or the work plan, thereby obtaining a command system.

Effects of the Invention

[0009] According to the present invention, it is possible to provide a system that supports a person in charge of commanding crisis countermeasures after a crisis to make a more accurate or quicker decision on crisis countermeasures.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Figure 31

Figure 32

Figure 33

Figure 34

Embodiments for Carrying Out the Invention

[0011] The content of the embodiments of the present invention will be listed and described. The present invention has the following configuration. [Item 1] An integrated information acquisition unit that acquires integrated information in which unit information regarding the situation of the on-site team in the disaster area is integrated into sensing data including image data, point cloud data, or spatial data obtained by sensing the disaster area from above by an aircraft, or data obtained by processing the sensing data, An integrated information display unit that displays the integrated information on a general control device used by a user who commands the on-site team, A work plan command unit that commands a work instruction or a work plan for the on-site team, and The work plan command unit is a command system that causes at least one of the unit terminal used by the on-site team and the general control device to display the information on the work instruction or the work plan. [Item 2] In the command system according to Item 1, A unit terminal communication unit that directly or indirectly exchanges information regarding the work instruction or the work plan between the unit terminal and the general control device is provided. [Item 3] In the command system according to Item 1 or 2, The troop terminal communication unit causes the troop terminal to display information regarding the work instruction or the work plan, obtains response information regarding at least any one of acceptance, rejection, and mediation request for the information input from the troop terminal from the troop terminal, and causes the display unit of the integrated device to display it, which is a command system. [Item 4] In the command system according to any one of Items 1 to 3, it includes a work plan mediation unit that generates a modification plan for the work instruction or the work plan according to the response information, The work plan command unit causes at least one of the troop terminal and the integrated device to display the information of the modification plan, which is a command system. [Item 5] In the command system according to any one of Items 1 to 3, When the troop terminal communication unit receives the response information of "accepted" from the troop terminal, the work plan command unit causes at least one of the troop terminal and the integrated device to display the accepted work instruction or work plan as confirmed information, which is a command system. [Item 6] In the command system according to any one of Items 1 to 5, it further includes a disaster information generation unit that acquires or generates disaster information regarding the disaster situation including the current or predicted future disaster location or disaster type, The disaster information generation unit generates the disaster information including at least any one of the disaster location or area, disaster content, and disaster scale regarding the object in the current or future based on at least any one of the sensing data acquired from the air by the flying object or the analysis information of its processed data, or the external information acquired from the external system of the command system, or the on-site information acquired from the on-site troops, The integrated information acquisition unit acquires integrated information in which the troop information and the disaster information are integrated into the sensing data or the data obtained by processing the sensing data, which is a command system. [Item 7] In the command system according to any one of Items 1 to 6, It further includes a disaster information generation unit that acquires or generates disaster information regarding a disaster situation including a disaster location or disaster type that is present or predicted in the future. Based on the analysis information of the sensing data acquired from above the sky by the aircraft or its processed data, or external information acquired from an external system, or the troop information, the disaster information generation unit generates the disaster information including at least any one of the disaster location or area, disaster content, and disaster scale regarding people at present or in the future. The integrated information acquisition unit acquires integrated information in which the troop information and the disaster information are integrated with the sensing data or data obtained by processing the sensing data. Command system. [Item 8] In the command system according to any one of Items 1 to 7, A command system comprising a work candidate generation unit that determines at least any one of the work content, work area, and work scale of a plurality or single corresponding work candidate according to the disaster information acquired or generated by the disaster information generation unit. [Item 9] In the command system according to any one of Items 1 to 8, The work candidate generation unit determines the crisis level of the disaster regarding people or things according to the disaster information, A command system that determines the priority of the corresponding work candidate according to the crisis level or displays the priority of the corresponding work candidate to the user. [Item 10] In the command system according to any one of Items 1 to 9, The work candidate generation unit determines the crisis level based on the result of evaluating at least any one of the severity degree of damage to people or things, the degree of damage scale, and the possibility of dealing with the damage. [Item 11] In the command system according to any one of Items 1 to 10, The operation candidate generation unit determines the priority of the response operation candidates according to the accuracy of the information content of the disaster information in addition to the crisis level, or displays the priority of the response operation candidates to the user, in a command system. [Item 12] In the command system according to any one of Items 1 to 11, it includes a unit information generation unit that generates unit information regarding the situation of the on-site unit in the disaster area, The unit information generation unit obtains or generates the unit information including at least any one of the current position of the on-site unit, the work content, the work progress status, the equipment in possession, the unit personnel, the work status, or the activity history information of the on-site unit in the past, or the work plan information of the on-site unit in the future, in a command system. [Item 13] In the command system according to any one of Items 1 to 12, it includes a unit information generation unit that generates unit information regarding the situation of the on-site unit in the disaster area, The unit information generation unit obtains the activity history information of the on-site unit in the past, and generates information regarding the fatigue degree or work load of the on-site unit based on the activity history information of the on-site unit in the past, in a command system. [Item 14] In the command system according to any one of Items 1 to 13, it includes a unit information generation unit that generates unit information regarding the situation of the on-site unit in the disaster area, The unit information generation unit obtains the current work status and work plan information of the on-site unit, and generates information regarding the delay or progress of the work progress with respect to the work plan based on the information, in a command system. [Item 15] In the command system according to any one of Items 1 to 14, it further includes a disaster information generation unit that obtains or generates disaster information regarding the disaster situation including the current or future predicted disaster location or disaster type, The integrated information acquisition unit generates the integrated information including the disaster information acquired or generated by the disaster information generation unit, which includes at least any one of the disaster location or area, disaster content, and disaster scale in the present or future, or the position of the current on-site team, work content, work progress delay situation, possessed equipment, team personnel, work status, work plan, fatigue degree, past activity history information, and future work plan of the on-site team, The integrated information display unit is a command system that causes the integrated information to be displayed on the general control device. [Item 16] In the command system according to any one of Items 1 to 15, The work plan command unit acquires, from the general control device, user command input information regarding at least any one of the work area of the corresponding work and the on-site team that instructs the execution of the corresponding work, as information regarding the corresponding work to be executed, and determines the on-site team that instructs the execution of the corresponding work or its candidate based on the acquired user command input information. [Item 17] In the command system according to any one of Items 1 to 16, It includes a team information generation unit that generates team information regarding the situation of the on-site team in the disaster area, The work plan command unit determines the on-site team that instructs the execution of the corresponding work to be executed or its candidate based on the team information acquired or generated by the team information generation unit. [Item 18] In the command system according to any one of Items 1 to 17, The work plan command unit determines, based on the current position of the on-site team included in the team information, the on-site team at a position close to the disaster area as the on-site team that instructs the execution of the corresponding work or its candidate. [Item 19] In the command system according to any one of Items 1 to 18, A disaster information generation unit that acquires or generates disaster information regarding the disaster situation including the disaster location or disaster type expected in the present or future, A necessary resource estimation unit that estimates necessary resources including equipment or personnel required in the disaster area based on the disaster information. The operation plan command unit is a command system that determines, as the on-site unit or its candidate for instructing the execution of the corresponding operation, the on-site unit having the necessary resources in the disaster area based on the information on the equipment possessed by the on-site unit or the unit personnel included in the unit information. [Item 20] In the command system according to any one of Items 1 to 19, A disaster information generation unit that acquires or generates disaster information regarding the disaster situation including the current or predicted future disaster location or disaster type; A necessary work amount estimation unit that estimates the necessary work amount in the disaster area based on the disaster information; The operation plan command unit determines, as the on-site unit or its candidate for instructing the execution of the corresponding operation, the on-site unit capable of performing the necessary work amount in the disaster area based on at least any one of the past activity history information, fatigue level, and work progress delay situation included in the unit information, or highlights it on the general control device. It is a command system. [Item 21] In the command system according to any one of Items 1 to 20, The operation plan command unit determines the operation instruction or the operation plan including the operation area for performing the corresponding operation to be executed, the operation content, and the information on the on-site unit instructing the execution of the corresponding operation, or candidates thereof. It is a command system. [Item 22] In the command system according to any one of Items 1 to 21, It further includes a disaster information generation unit that acquires or generates disaster information regarding the disaster situation including the current or predicted future disaster location or disaster type; After the operation plan command unit determines the operation plan, the operation plan command unit determines whether the operation plan needs to be changed based on the disaster information. It is a command system. [Item 23] In the command system according to any one of Items 1 to 22, The operation plan instruction unit is a command system that causes at least one of the unit terminal and the central control device to display the on-site unit or its candidate that is instructed to execute the corresponding operation determined by the operation plan instruction unit. [Item 24] In the command system according to any one of Items 1 to 23, The operation plan instruction unit is a command system that causes at least one of the unit terminal and the central control device to display the on-site unit or its candidate that is instructed to execute the corresponding operation determined by the operation plan instruction unit and the information on the disaster area. [Item 25] In the command system according to any one of Items 1 to 24, The operation instruction includes at least any one of information on the work position, work content, urgency, and priority regarding the corresponding operation to be executed within a predetermined time. The operation plan is a command system that includes at least any one of information on the work time, work position, work content, urgency, and priority regarding the corresponding operation to be executed after the predetermined time. [Item 26] In the command system according to any one of Items 1 to 25, It further includes a disaster information generation unit that acquires or generates disaster information regarding the disaster situation including the current or predicted future disaster location or disaster type, The operation plan instruction unit is a command system that causes at least one of the unit terminal and the central control device to display at least any one of the list information of the disaster information and the list information of the unit information. [Item 27] In the command system according to any one of Items 1 to 26, The operation plan instruction unit is a command system that notifies the user of information regarding the fatigue degree or work load of the on-site unit generated by the unit information generation unit from at least one of the unit terminal and the central control device. [Item 28] In the command system according to any one of Items 1 to 27, The operation plan instruction unit is an instruction system that notifies a user of information regarding a delay in work progress with respect to the operation plan generated by the unit information generation unit from at least one of the unit terminal and the central control device. [Item 29] A unit terminal used by a field unit in a disaster area, A central control device used by a user who commands the field unit, An information integration system communicably connected to the unit terminal and the central control device, and a cooperation system that operates in cooperation with each other, A unit information generation unit that acquires or generates unit information regarding the situation of a field unit in a disaster area, An information integration unit that generates integrated information obtained by integrating the unit information with sensing data including image data, point cloud data, or spatial data obtained by sensing a disaster area from above by an aircraft, or data obtained by processing the sensing data, An integrated information display unit that displays the integrated information on a central control device used by a user who commands the field unit, An operation plan instruction unit that commands an operation instruction or an operation plan for the field unit, The operation plan instruction unit includes an operation plan display unit that displays information on the operation instruction or the operation plan on at least one of the unit terminal used by the field unit and the central control device, A cooperation system comprising the above. [Item 30] A computer Performs steps of acquiring or generating unit information regarding the situation of a field unit in a disaster area, Performs steps of acquiring sensing data including image data, point cloud data, or spatial data obtained by sensing a disaster area from above by an aircraft, or acquiring processed data obtained by processing the sensing data, Performs a step of generating integrated information obtained by integrating the sensing data or the processed data with the unit information, Performs a step of displaying the integrated information on a display unit of a central control device used by a user who commands the field unit, A step of determining a work instruction or work plan for the on-site team, A command method that executes a step of displaying information on the work instruction or work plan determined on at least one of a team terminal used by the on-site team and the general control device.

[0012] <A. First Embodiment> Hereinafter, embodiments of the present invention will be described with reference to the drawings. In this specification and the drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted. Further, the embodiments shown below are merely examples, and other known elements and alternative means can be adopted according to the use, purpose, scale, etc.

[0013] [A-1. Configuration] (A-1-1. Overview) FIG. 1 is an overall configuration diagram of a cooperation system according to an embodiment of the present invention. As shown in FIG. 1, this system includes an aircraft or other flying object equipped with sensors including sensors such as an optical camera, an infrared camera, and a laser sensor such as LiDAR, and acquires aerial sensing data by controlling the aircraft to sense information on a target area from above. Further, it may be a base equipped with a remote control device that exchanges control information with the flying object, may be composed of movable vehicles, ships, flying objects, etc., or may be composed of immovable buildings (fixed type) that do not move.

[0014] The data acquisition system 1000 controls an aircraft or other flying object equipped with sensors including sensors such as an optical camera, an infrared camera, and a laser sensor such as LiDAR, and acquires aerial sensing data by sensing information on a target area from above. Further, it may be a base equipped with a remote control device that exchanges control information with the flying object, may be composed of movable vehicles, ships, flying objects, etc., or may be composed of immovable buildings (fixed type) that do not move.

[0015] The spatial information data utilization system 2000 is a system that processes the aerial sensing data acquired by the data acquisition system 1000 to generate ortho-images, three-dimensional space models, or three-dimensional space data, etc., and combines them with polygon geographic information, etc. to generate map images. The external system 4000 is an external system that can provide disaster information such as the disaster situation, and may include, for example, map applications, disaster prevention applications, road corporations, meteorological agencies, power companies, communication companies, gas companies, waterworks, etc. Furthermore, it may also be SNS, hospitals, mass media, etc. posted from mobile terminals used by the general public.

[0016] The crisis countermeasure on-site command system 5000 includes a general control device 5100, an other-site general control device 5200, and a plurality of on-site unit terminal devices 5300 that can communicate with the general control device 5100. As shown in FIG. 1, the on-site unit terminal devices 5300 include, for example, terminals for the Self-Defense Forces, terminals for the police, terminals for the fire department, terminals for rescue teams, terminals for heavy machinery operators, terminals for shelter in-charges, terminals for local government in-charges, etc. The general control device 5100 gives work instructions to the on-site unit terminal devices 5300 and receives responses to the work instructions and information on the on-site units from the on-site unit terminal devices 5300. Also, the generated information generated in the other-site general control device 5200, the OCR reading information of the user's handwritten character information (writing character information on the whiteboard), etc. are shared with the general control device 5100 via the communication line.

[0017] The information integration system 3000 acquires map images and the like generated from aerial sensing data from the spatial information data utilization system 2000, acquires disaster information regarding the disaster situation from an external system, and also acquires information on the on-site responses of the on-site teams to work instructions and information on the on-site teams from the general control device 5100. Further, it generates a common situation map (integrated information) by integrating the acquired respective information, and transmits the common situation map to the general control device 5100 and each on-site team terminal device 5300. Note that the functions of the spatial information data utilization system 2000 and the information integration system 3000 can also be implemented in a common device and configured as one subsystem (disaster DX system 6000). On the other hand, the functions of the information integration system 3000 and the general control device 5100 can also be implemented in a common housing and configured as one subsystem.

[0018] (A-1-2. Stakeholder) FIG. 2 is a diagram showing an example of stakeholders related to the cooperation system according to an embodiment of the present invention. In each system constituting the cooperation system shown in FIG. 1, there are users who use a user interface unit (having a display unit, an input unit, etc.) provided in each system. In the example shown in FIG. 2, for example, the data acquisition system 1000 is used by a data acquisition responsible person, the spatial information data utilization system 2000 is used by a map image generation responsible person, the external system 4000 is used by an external system user, the general control device 5100 is used by the crisis management headquarters commander, the other site general control device 5200 is used by an other site responsible person, the Self-Defense Forces terminal is used by the Self-Defense Forces, the police terminal is used by police officers, the fire department terminal is used by the fire department, the rescue team terminal is used by the rescue team, the heavy equipment operator terminal is used by the heavy equipment operator, the evacuation shelter person-in-charge terminal is used by the evacuation shelter person-in-charge, and the local government person-in-charge terminal is used by the local government person-in-charge. Note that in the example shown in FIG. 2, the information integration system 3000 shows a system configuration without a user interface unit, but it is not limited to this, and a user interface unit may be provided.

[0019] (A-1-3. Data Acquisition System 1000) Figure 2 is a configuration diagram of the data acquisition system. The data acquisition system 1000 includes an airframe control system 1100, an airframe operation system 1200, an acquired data management system 1300, a communication infrastructure management system 1400, a rear support system 1500, a flight management system 1600, and an airspace surveillance and control system 1700.

[0020] The airframe control system 1100 is a system that is installed on an aircraft or other flying object and performs airframe control including flight control and measurement control of the flying object. The airframe control system 1100 includes, for example, a flight unit having a flight function, a sensing unit that performs sensing by sensors (such as an optical camera, an IR camera, LiDAR, and other laser sensors), a communication unit that communicates with each system via a communication infrastructure management system described later via a satellite or a mobile phone communication network, a state determination unit that determines each state of flight, sensing, and positioning, a data recording unit that records acquired data and the like, and a state determination result recording unit that records information related to flight control and measurement control and state determination results.

[0021] In this specification, the term "aircraft" refers to any flying object having a function of autonomously controlling its attitude, regardless of the power means (such as electricity and prime mover), the control method (such as wireless or wired, and fully autonomous flight type or partially manual control type), and whether it is manned or unmanned. An aircraft may also be referred to as an unmanned aerial vehicle (UAV), a multi-copter, a remote piloted aircraft system (RPAS), or an unmanned aircraft system (UAS). Further, the aircraft may be of any type, including a fixed-wing type having a fixed wing, a multi-copter type having a plurality of propellers, or a VTOL type having both a fixed wing and a plurality of propellers. In addition, the term "flying object" refers to any device that flies in the sky, such as a balloon or a satellite, in addition to the above-described aircraft.

[0022] The airframe operation control system 1200 is a system that generates a flight mission for an aircraft controlled by the airframe control system 1100 and controls the movement of the aircraft. The flight mission is a movement plan including, for example, the movement route and movement speed of the aircraft. The movement route is generated in an airspace below an altitude of 150 m, for example, to avoid interference with other aircraft such as passenger aircraft in advance. The airframe operation control system 1200 transmits a control signal to the aircraft via the communication infrastructure management system 1400 described later in order to automatically operate the aircraft.

[0023] The acquisition data management system 1300 has a data management function of acquiring and recording acquisition data (optical image data, IR image data, point cloud data acquired by a laser sensor such as LiDAR, and other spatial data, etc.) and state data of the target area sensed by the airframe control system 1100 of the aircraft via the communication infrastructure.

[0024] The communication infrastructure management system 1400 is a system that manages the communication means of data (such as sensing data acquired by sensing by the aircraft) transmitted and received between the airframe control system 1100 and other systems in the data acquisition system 1000, and control information related to the flight and measurement control of the aircraft. Further, the communication infrastructure management system 1400 manages the communication means of data (such as sensing data acquired by sensing by the aircraft) transmitted and received between the data acquisition system 1000 and the spatial information data utilization system 2000.

[0025] The rear support system 1500 is a system that supports the smooth and efficient execution of each task required for acquiring sensing data and the coordination between tasks, which is executed by the data acquisition system 1000. Specifically, based on the acquired data and status data obtained by the acquired data management system 1300, it determines whether the data is appropriate, and if it is inappropriate, issues a request for remeasurement. It may also have a function of determining whether the power and communication infrastructure at the data acquisition site can be used and providing alternative means. In addition, it may support each task (such as pre-flight equipment preparation, equipment movement, equipment inspection, equipment adjustment, sensor calibration, in-flight operation, coordination, post-flight post-processing, equipment diagnosis, tidying up, etc.) at the site where an aircraft or other flying object is operated. It also determines the equipment and facilities required for each task at the site where an aircraft or other flying object is operated, and notifies the equipment management system and reservation system described later of the information on the required equipment and facilities.

[0026] The operation management system 1600 is a system that makes decisions and gives instructions for the operation of an aircraft. The operation management system 1600 formulates a plan regarding the operations of an aircraft, including, for example, sensing and flight, and transmits it to the airframe control system 1100 that controls the aircraft via the communication infrastructure management system 1400. The operation management system 1600 may formulate plans for a plurality of aircraft and transmit the information on the plans to the airframe control systems 1100 that control the respective aircraft.

[0027] The airspace monitoring and control system 1700 is a system that monitors the airspace in which the aircraft to be controlled is flying. The airspace monitoring and control system 1700 acquires information such as the position of the flying object from the air traffic control system 9000 that controls the flying objects flying within the target airspace. The air traffic control system 9000 may be, for example, a drone operation management system (UTM), an operation management subsystem (UASSP), or an air traffic management system (ATM). That is, the airspace monitoring and control system 1700 measures or acquires information on the environment and other aircraft in the airspace where the aircraft is flying, and transmits the information to the operation management system 1600. Based on the information from the airspace monitoring and control system 1700, the operation management system 1600 changes the work plan if there is a problem with the work plan of the aircraft.

[0028] The equipment and material management system 7000 manages the status of equipment and materials at each base where each equipment and material is stored, and determines bases where the equipment and materials can be arranged based on the information on the necessary equipment and materials notified from the above-mentioned rear support system 1500.

[0029] The reservation system 8000 makes reservations for the use of equipment and materials based on the information on the necessary equipment and materials notified from the above-mentioned rear support system 1500, or the information on the bases where the equipment and materials can be arranged as determined by the equipment and material management system.

[0030] (A-1-4. Spatial Information Data Utilization System 2000) FIG. 4 is a configuration diagram of a spatial information data utilization system according to an embodiment of the present invention. The spatial information data utilization system 2000 integrates the sensing data of the target area acquired from the data acquisition system 1000 and the map data of the target area, generates a map image in which the sensing data and the map are integrated, and provides the generated map image to the information integration system 3000. The spatial information data utilization system 2000 includes a sensing data acquisition unit 2100, a map data storage unit 2200, a user input reception unit 2300, and a map image generation unit 2400.

[0031] The sensing data acquisition unit 2100 acquires sensing data from the data acquisition system 1000 and provides the acquired sensing data to the map image generation unit 2400 described later.

[0032] The map data storage unit 2200 records map data acquired in advance from an external system or input by a user, and provides the recorded map data to the map image generation unit 2400. Here, the map data is data related to geographical information, and includes, for example, polygon geographical data, map data, and the like.

[0033] The user input reception unit 2300 acquires user requests for the generation process executed by the map image generation unit 2400. For example, it receives from the user a specification of the target area for generating a map image. Or, when a defect is found in sensing data such as aerial images and three-dimensional point cloud data acquired from the sensing data acquisition unit 2100, an instruction not to use the sensing data can be input.

[0034] The map image generation unit 2400 integrates the sensing data from the sensing data acquisition unit 2100 and the map data acquired from the map data storage unit 2200 to generate a map image. The generated map image is input to the information integration system 3000.

[0035] (A-1-5. Crisis Response Site Command System 5000) FIG. 5 is a configuration diagram of a crisis response site command system according to an embodiment of the present invention. The crisis response site command system 5000 includes a general control device 5100 and a site force terminal device 5300. The site force terminal device 5300 includes terminal devices operated by various site forces, and includes, for example, a terminal for inspection workers, a terminal for the Self-Defense Forces, a terminal for the police, a terminal for the fire department, a terminal for rescue teams, a terminal for heavy machinery operators, a terminal for shelter personnel, a terminal for local government personnel, and the like.

[0036] The overall control device 5100 is a terminal device operated by the commander of the crisis management headquarters installed in the event of, for example, a disaster. The overall control device 5100 can transmit work instructions and work plans generated by the information integration system or input by the commander to any on-site team terminal device 5300 that is communicably connected. The on-site team terminal device 5300 has a function of transmitting response information (on-site response) to the received work plan and work instructions to the overall control device 5100, and further has a function of transmitting on-site team information regarding the position and work status of the on-site team to the overall control device 5100.

[0037] In addition, the overall control device 5100 transmits the on-site response and on-site team information obtained from the on-site team terminal device 5300 to the information integration system 3000. On the other hand, it obtains from the information integration system 3000 a common situation map (integrated information) in which at least one of the disaster information and the on-site team information is integrated with the map image, and information on work instructions and work plans generated by the information integration system 3000.

[0038] Here, the terms "work instruction" and "work plan" described above can be defined as follows, for example. A work instruction is an instruction including at least one of information on the work position, work content, urgency, and priority regarding the corresponding work to be executed by the on-site team within a predetermined time, and the predetermined time can be, for example, 5 minutes. On the other hand, a work plan is a plan including at least one of information on the work time, work position, work content, urgency, and priority regarding the corresponding work to be executed after the predetermined time.

[0039] (A-1-6. On-site team terminal device 5300) FIG. 6 is a functional configuration diagram of an on-site team terminal device according to an embodiment of the present invention. The on-site team terminal device 5300 includes an on-site information acquisition unit 5310, a work command acquisition unit 5320, a work command display unit 5330, a common situation map display unit 5340, and a communication unit 5350.

[0040] The on-site information acquisition unit 5310 includes a unit status acquisition unit 5311, a disaster status acquisition unit 5312, and a work instruction response input unit 5313, and acquires input information input by the on-site unit operating the on-site unit terminal device 5300 and measurement information from sensors and the like mounted on the on-site unit terminal device 5300 as information regarding the on-site unit.

[0041] The unit status acquisition unit 5311 acquires position information, speed information, and acceleration as user input or measurement information as information regarding the status of the on-site unit operating the on-site unit terminal device 5300. Furthermore, the work content being executed, work progress information (such as work delays or faster progress than the work plan relative to the work plan), resource information (the number of personnel in the unit, equipment, types and quantities of facilities), work status information (waiting, preparing, executing, on break, delayed, completed earlier than planned, completed, waiting for instructions, requesting instruction changes, waiting for mediation, etc.), past activity history information of the on-site unit, or future work plans of the on-site unit are acquired as user-entered information or the above-mentioned measurement information.

[0042] The above-mentioned "past activity history information of the on-site unit" is information regarding the activity content implemented by the on-site unit operating the on-site unit terminal device 5300 in the past, and can include, for example, the cumulative work time of the on-site unit, moving distance, rest rate, rest time, nighttime activity time, sleep time, water supply, presence or absence of meals, etc. Also, the above-mentioned "future work plan of the on-site unit" is information on the future activity plan desired by the on-site unit operating the on-site unit terminal device 5300.

[0043] Here, at least any one of the measurement information of position information, speed information, and acceleration can be measured by an inertial device (IMU) mounted on a mobile terminal or wearable terminal worn by the on-site unit, and the above-mentioned "work content being executed" can also be automatically determined by the system from at least any one of the measurement information of position information, speed information, and acceleration measured by the mobile terminal or wearable terminal.

[0044] The disaster situation acquisition unit 5312 acquires disaster information regarding the human and material disaster situations at the disaster area as information manually input by the on-site team operating the on-site team terminal device 5300. The disaster information includes information such as the location of the disaster occurrence, the type of disaster, the disaster level and scale, etc. regarding human and material disasters.

[0045] The work instruction response input unit 5313 accepts the on-site team's response input to the work instructions and work plans transmitted from the overall control device 5100 acquired by the work order acquisition unit 5320 described later and displayed by the work order display unit 5330 described later. Here, the response input is any one or a combination of at least "accepted", "rejected", "mediation request".

[0046] The work order acquisition unit 5320 acquires the work instructions and work plans transmitted from the overall control device 5100. The work order display unit 5330 displays the work instructions and work plans acquired by the work order acquisition unit 5320.

[0047] The common situation diagram display unit 5340 displays the common situation diagram transmitted from the information integration system 3000. The communication unit 5350 has a function of transmitting information via wired or wireless communication between the on-site team terminal device 5300 and the overall control device 5100 or the information integration system 3000.

[0048] As described above, the on-site team terminal device 5300 displays the information acquired from the overall control device 5100 and the information integration system 3000 to the on-site team who is the user of the on-site team terminal device 5300, and at the same time, acquires information regarding the team status and disaster situation and response input to work instructions from the on-site team and transmits it to the overall control device 5100.

[0049] (A-1-7. Overall control device 5100) FIG. 7 is a functional configuration diagram of an overall control device according to an embodiment of the present invention. The overall control device 5100 includes a team terminal communication unit 5110, a on-site acquired information display unit 5120, a superior device information acquisition unit 5130, a superior device acquired information display unit 5140, a user input reception unit 5150, and a transmission to superior device unit 5160.

[0050] (A-1-7―1. Unit Terminal Communication Section 5110) The Unit Terminal Communication Section 5110 has a function of acquiring or transmitting information exchanged between the Centralized Control Device 5100 and the On-site Unit Terminal Device 5300. The Unit Terminal Communication Section 5110 includes a Field Unit Status Information Acquisition Section 5111, a Disaster Status Information Acquisition Section 5112, a Field Mediation Information Acquisition Section 5113, and a Work Instruction / Plan Transmission Section 5114.

[0051] The Field Unit Status Information Acquisition Section 5111 acquires information regarding the status of the on-site unit, which is acquired by the Unit Status Acquisition Section 5311 and transmitted via the communication section 5350 of the on-site unit terminal device 5300.

[0052] The Disaster Status Information Acquisition Section 5112 acquires disaster information regarding the human and material disaster situation in the disaster area, which is acquired by the Disaster Status Acquisition Section 5312 and transmitted via the communication section 5350 of the on-site unit terminal device 5300.

[0053] The Field Mediation Information Acquisition Section 5113 acquires the response input information of the on-site unit to the work instruction and work plan, which is acquired by the Work Instruction Response Input Section 5313 and transmitted via the communication section 5350 of the on-site unit terminal device 5300.

[0054] The Work Instruction / Plan Transmission Section 5114 transmits, by the Work Instruction / Plan Input Section 5153 described later, the work instruction or work plan request information input by the commander or other users of the Centralized Control Device 5100, or the work instruction or work plan request information acquired by the Work Instruction / Plan Candidate Acquisition Section 5132, to the on-site unit terminal device 5300. Also, the work instruction or work plan request information may include a request for change of the work instruction or work plan (such as replacement, postponement, suspension / termination, deletion, addition, etc.). In addition, at that time, it may have a function of extracting the on-site unit to which the work instruction or work plan request information should be transmitted.

[0055] (A-1-7―2. On-site Acquired Information Display Section 5120) The on-site acquired information display unit 5120 has a function of displaying the information transmitted from the on-site unit terminal device 5300 acquired by the unit terminal communication unit 5110. The on-site acquired information display unit 5120 includes an on-site unit status information display unit 5121, a disaster status information display unit 5122, and an on-site mediation information display unit 5123.

[0056] The on-site unit status information display unit 5121 displays information regarding the status of the on-site unit acquired by the unit status acquisition unit 5311. The disaster status information display unit 5122 displays disaster information regarding the human and material disaster situation in the disaster area acquired by the disaster status acquisition unit 5312. The on-site mediation information display unit 5123 displays the response input information of the on-site unit (at least any one or a combination of "accepted", "rejected", "mediation request") to the work instruction and work plan acquired by the work instruction response input unit 5313.

[0057] (A-1-7―3. Upper device information acquisition unit 5130) The upper device information acquisition unit 5130 has a function of acquiring the information transmitted from the information integration system 3000 which is the upper device. The upper device information acquisition unit 5130 includes a common situation diagram acquisition unit 5131 and a work instruction / plan candidate acquisition unit 5132.

[0058] The common situation diagram acquisition unit 5131 has a function of acquiring the common situation diagram generated in the information integration system 3000. The work instruction / plan candidate acquisition unit 5132 has a function of acquiring the candidate information of the work instruction or work plan generated in the information integration system 3000.

[0059] (A-1-7―4. Upper device acquired information display unit 5140) The upper device acquired information display unit 5140 has a function of displaying the information acquired by the common situation diagram acquisition unit 5131. The upper device acquired information display unit 5140 includes a common situation diagram display unit 5141 and a work instruction / plan candidate display unit 5142. The common situation diagram display unit 5141 displays the common situation diagram acquired by the common situation diagram acquisition unit 5131. The work instruction / plan candidate display unit 5142 displays the work instruction or the candidate information of the work plan acquired by the work instruction / plan candidate acquisition unit 5132.

[0060] (A-1-7―5. User input reception unit 5150) The user input reception unit 5150 has a function of receiving an input from a user who operates the integrated device 5100. The user input reception unit 5150 includes a display specification input unit 5151, a disaster / unit information input unit 5152, a work instruction / plan input unit 5153, and a disclosure restriction input unit 5154.

[0061] The display specification input unit 5151 is a functional unit that designates and inputs the display method of the common situation diagram displayed on the common situation diagram display unit 5141 of the upper device acquired information display unit 5140, and the work instruction and work plan information displayed on the work instruction / plan candidate display unit 5142. Also, it is possible to designate and input the information to be displayed from the display information displayed by a plurality of display units such as the on-site acquired information display unit 5120 and the upper device acquired information display unit 5140.

[0062] The disaster / unit information input unit 5152 is a functional unit for a user who has confirmed the disaster status information displayed on the disaster status information display unit 5122, the on-site unit status information displayed on the on-site unit status information display unit 5121, and the common situation diagram displayed on the common situation diagram display unit 5141 to input disaster information and unit information in addition to these. For example, when the user, who is a commander, grasps the disaster information or unit information that is not shown in the above-mentioned disaster status information, on-site unit status information, or common situation diagram, the user can input additional disaster information and unit information.

[0063] The work instruction and plan input section 5153 has a function of receiving a selection input in which a user selects a specific candidate for the work instruction or work plan candidate information displayed on the work instruction and plan candidate display section 5142, or a function of allowing the user to newly input an original work instruction or work plan.

[0064] The public restriction input section 5154 has a function of receiving from the user a designation input of a group to which the common situation diagram generated by the information integration system 3000, the on-site unit information and the disaster information included in the common situation diagram are to be disclosed. For example, the information to be disclosed from the information integration system 3000 to the mass media is restricted to the information that has been confirmed by the on-site unit. Alternatively, it has a function of receiving from the user a designation input of the disclosure time of the common situation diagram, the on-site unit information and the disaster information included in the common situation diagram. For example, the time of disclosure from the information integration system 3000 to the mass media is specified. Thereby, effects such as preventing people from gathering at the disaster site based on interest and causing interference with the response work at the disaster site can be expected.

[0065] (A-1-7―6. Transmission section 5160 to the upper-level device) The transmission section 5160 to the upper-level device has a function of transmitting information to the information integration system 3000 which is the upper-level device. The transmission section 5160 to the upper-level device includes a field unit status information transmission section 5161, a disaster status information transmission section 5162, and a field mediation information transmission section 5163.

[0066] The field unit status information transmission section 5161 transmits the status information of the field unit acquired by the field unit status information acquisition section 5111 to the information integration system 3000. Next, the disaster status information transmission section 5162 transmits the disaster information acquired by the disaster status information acquisition section 5112, or the information obtained by adding the disaster information input by the disaster / unit information input section 5152 thereto, to the information integration system 3000. Next, the field mediation information transmission section 5163 transmits the work instruction and work plan information transmitted from the work instruction and plan transmission section 5114 to the field unit terminal device 5300 and the response input information of the field unit acquired by the field mediation information acquisition section 5113 to the information integration system 3000.

[0067] (A-1-8. Information Integration System 3000) FIG. 8 is a functional block diagram of an information integration system according to an embodiment of the present invention. The information integration system 3000 integrates disaster information and on-site team information into a map image generated from sensing data including image data, point cloud data, or spatial data obtained by sensing a disaster area from above by a flying object including an aircraft, generates a common situation map, and transmits the generated common situation map to the overall control device 5100 and the on-site team terminal device 5300. The information integration system 3000 includes an on-site team information acquisition unit 3100, a disaster situation information acquisition unit 3200, an information integration unit 3300, a countermeasure generation unit 3400, a work plan determination unit 3500, a work plan mediation unit 3600, a post-determination change plan notification unit 3700, a work plan storage unit 3800, and a transmission unit 3900.

[0068] (A-1-8-1. On-site Team Information Acquisition Unit 3100) The on-site team information acquisition unit 3100 has a function of acquiring on-site team information acquired via the overall control device 5100 and determining the state of the on-site team based on the acquired on-site team information. The on-site team information acquisition unit 3100 includes a position information acquisition unit 3110, a resource information acquisition unit 3120, an activity status information acquisition unit 3130, a fatigue degree determination unit 3140, and a work progress determination unit 3150.

[0069] The position information acquisition unit 3110 acquires information regarding the position of the on-site team. Note that the position information acquisition unit 3110 acquires not only position information but also speed information, acceleration information, etc. as information regarding the state of the on-site team operating the on-site team terminal device 5300 acquired by the above-described team state acquisition unit 5311.

[0070] The resource information acquisition unit 3120 acquires resource information regarding the number of on-site teams, equipment, and types and quantities of facilities acquired by the above-described team state acquisition unit 5311.

[0071] The activity status information acquisition unit 3130 acquires information regarding the activity status of the on-site unit acquired by the aforementioned unit status acquisition unit 5311. The activity status information acquisition unit 3130 acquires, as the activity status, for example, the activity status of the on-site unit including waiting, preparation, execution, break, delay, completed earlier than scheduled, completed, waiting for instructions, requesting instruction change, waiting for mediation, etc. Also, as the activity status, it may acquire the activity history information of the past on-site unit or the work plan of the future on-site unit.

[0072] The fatigue determination unit 3140 estimates the fatigue level (or work load) of the on-site unit based on the activity history information of the past on-site unit acquired by the activity status information acquisition unit 3130.

[0073] The work progress determination unit 3150 acquires the information on the current work status and work plan of the on-site unit acquired by the activity status information acquisition unit 3130, and estimates the delay in work progress against the work plan based on this information.

[0074] (A-1-8-2. Disaster status information acquisition unit 3200) The disaster status information acquisition unit 3200 acquires disaster information from at least any one of the analysis results of airborne sensing data acquired by an aircraft or other flying object, an external system, and a central control device, or a combination thereof. The disaster status information acquisition unit 3200 includes an airborne measurement data analysis unit 3210, an external information acquisition unit 3220, and a central control device information acquisition unit 3230.

[0075] The aerial measurement data analysis unit 3210 interprets the current disaster situation by analyzing the sensing data of the target area acquired from the data acquisition system 1000 or the map image generated by processing the sensing data. The aerial measurement data analysis unit 3210 includes a map image acquisition unit 3211 and a disaster situation interpretation unit 3212. The map image acquisition unit 3211 acquires the information of the map image from the spatial information data utilization system 2000. Note that the map image acquisition unit 3211 may acquire sensing data instead of the map image. The disaster situation interpretation unit 3212 interprets the current disaster situation of the target area by analyzing the map image (or sensing data) acquired by the map image acquisition unit 3211. Here, the disaster situation includes the human and material disaster locations, disaster areas, disaster types, and disaster scales.

[0076] Here, the disaster type means the type of disaster, including, for example, floods, landslides, fires, earthquakes, tsunamis, power outages, water supply cuts, etc. Also, the disaster scale means the degree of disaster. For example, the physical disaster scale includes the number of damaged households, seismic intensity in the case of an earthquake, tsunami height, damaged area size, predicted economic loss scale, etc. The human disaster scale includes the number of disaster victims, the number of injured people, the severity of injuries, etc.

[0077] The external information acquisition unit 3220 acquires the disaster situation from the aforementioned external system 4000. Here too, the disaster situation acquired from the external system includes the human and material disaster locations, disaster areas, disaster types, and disaster scales.

[0078] The general device information acquisition unit 3230 acquires the disaster information input by the on-site team acquired via the general device 5100 and the disaster information input to the general device 5100. Here too, the disaster situation includes the human and material disaster locations, disaster areas, disaster types, and disaster scales.

[0079] Note that the disaster status information acquisition unit 3200 may have a function of predicting not only the current disaster status but also the future disaster status (including the disaster area, disaster type, and disaster scale) based on the above-mentioned various information. For example, when the road interruption is interpreted by the aerial measurement data analysis unit 3210, the future secondary damage of the isolated area isolated by the road interruption is estimated.

[0080] (A-1-8-3. Information integration unit 3300) The information integration unit 3300 generates a common situation map integrating the on-site team information and the disaster information on the map image or the sensing data. The information integration unit 3300 includes a disaster / on-site information integration unit 3310 and a common situation map generation unit 3320.

[0081] The disaster / on-site information integration unit 3310 generates integrated information by integrating the on-site team location information acquired by the on-site team information acquisition unit 3100 and the disaster information (including the disaster location, disaster content, disaster scale, etc.) acquired by the disaster status information acquisition unit 3200. As an integration method, for example, it can be integrated based on the location and area information included in the on-site team information and the disaster information respectively. As another example, the disaster type can be associated with the on-site team related to the disaster for integration. For example, when the disaster type is a flood, the information of the rescue team is integrated.

[0082] The common situation map generation unit 3320 generates a common situation map integrating the on-site team information and the disaster information on the map image acquired from the spatial information data utilization system 2000, or the sensing data acquired by the data acquisition system 1000, or the pre-recorded map data. The information of the generated common situation map is transmitted to the general control device 5100 by the transmission unit 3900 described later and displayed.

[0083] (A-1-8-4. Countermeasure generation unit 3400) The countermeasure generation unit 3400 determines the crisis level based on the disaster information, generates countermeasures for the disaster, determines the priority of the countermeasures, or proposes them to the user. The countermeasure generation unit 3400 includes a crisis level determination unit 3410, a countermeasure candidate generation unit 3420, and a countermeasure priority determination unit 3430.

[0084] The crisis level determination unit 3410 determines the crisis levels of human and physical damages respectively based on the acquired human or physical disaster information. The information on the determined crisis levels is transmitted to and displayed on the integrated device 5100 by the transmission unit 3900 described later. As criteria for determining the crisis level, "severity", "scale of impact", and "controllability" can be used as the criteria for determining the crisis level.

[0085] As an example of determining the crisis level of human damage, for example, based on the scale of human damage (number of people, severity of injuries, etc.) obtained from the on-site team and external systems (hospitals, media, etc.), "severity" and "scale of impact" are determined, and "controllability" is determined according to the disaster content (type of disaster). Also, as an example of determining the crisis level of physical damage, based on the disaster level (number of damaged dwellings, seismic intensity (earthquake), tsunami height, affected area size, economic loss amount, etc.) obtained from the Meteorological Agency, disaster prevention apps, etc., "severity" and "scale of impact" are determined, and "controllability" is determined according to the disaster content (type of disaster).

[0086] Based on the acquired human or physical disaster information, the countermeasure candidate generation unit 3420 generates multiple or single candidates for the countermeasures of the on-site team. The information on the generated countermeasure candidates is transmitted to and displayed on the unified device 5100 by the transmission unit 3900 described later. Here, the countermeasure candidates to be generated include information on at least any one of the work content, work area, and work scale of the countermeasures, or a combination thereof. Note that the work content can be determined according to the disaster content (disaster type) included in the disaster information, and the work area can be determined according to the disaster location or area included in the disaster information.

[0087] In addition to the disaster information as described above, the work area of the countermeasure candidate may be generated according to the on-site team information and the work progress information. For example, based on the location information of the on-site team included in the on-site team information, a countermeasure candidate is generated with the disaster area where the rescue activities by the on-site team have not been carried out or the future disaster prediction area as the work area. As another example, according to the information on the work progress delay of the on-site team estimated by the work progress determination unit 3150, a countermeasure candidate is generated with the area where the work delay has occurred as the work area. Also, the work scale of the countermeasure can be determined according to the disaster scale (number of disaster victims, number of affected households, etc.) included in the disaster information.

[0088] The countermeasure priority determination unit 3430 determines the priority for multiple or single candidates of the generated countermeasures according to the crisis level of human or physical disasters (that is, performs triage of the countermeasures). The information on the determined priority is transmitted to and displayed on the unified device 5100 by the transmission unit 3900 described later. For example, the priority of the countermeasure candidate for the disaster area with a higher disaster crisis level is relatively highly evaluated. As another example, when the crisis levels are the same in different disaster areas, the human crisis levels are compared, and the priority of the countermeasure candidate for the disaster area with a higher human crisis level is relatively highly evaluated. That is, the priority of the countermeasure candidate for the disaster area with a higher human crisis level than the physical crisis level is highly evaluated.

[0089] In addition to the magnitude relationship of the disaster crisis levels as described above, the countermeasure priority determination unit 3430 evaluates the priority of countermeasure candidates for disaster areas with higher accuracy of disaster information based on the accuracy of the disaster information. For example, when the crisis levels in different disaster areas are the same, the priority of countermeasure candidates for the disaster area with higher accuracy of disaster information is evaluated higher.

[0090] All of the crisis level determination, generation of countermeasure candidates, and determination of countermeasure priorities in the above-described countermeasure generation unit 3400 may be automatically performed by the system, or a part of them may be automatically implemented by the system and the other part may be manually performed by the user. As an example, the system may automatically determine the crisis level and display it on the integrated device, and the user of the integrated device may generate countermeasure candidates and determine the countermeasure priorities.

[0091] (A-1-8-5. Work Plan Determination Unit 3500) Based on the generated countermeasure candidates and their priority information, the work plan determination unit 3500 determines the on-site team to execute the countermeasures and determines the work instructions and work plans. The work plan determination unit 3500 includes a dispatched team candidate determination unit 3510, a work instruction / planning proposal generation unit 3520, and a terminal input information acquisition unit 3530.

[0092] The dispatched team candidate determination unit 3510 determines candidates for on-site teams that can be dispatched to the disaster areas of the generated countermeasure candidates. As an example of automatically determining candidates for on-site teams that can be dispatched, for example, based on the current positions of the on-site teams included in the team information, the on-site team at a position close to the disaster area of the countermeasure candidate is determined as the on-site team or its candidate to instruct the execution of the countermeasures. As another example, it is equipped with a necessary resource estimation unit (not shown) that estimates the necessary resources including equipment or personnel required in the disaster area based on the disaster information, and based on the information on the equipment held by the on-site teams or the team personnel included in the team information, the on-site team having the necessary resources in the disaster area can also be determined as the on-site team or its candidate to instruct the execution of the countermeasures. The determined candidates for on-site teams are transmitted to and displayed on the integrated device 5100 by the transmission unit 3900 described later.

[0093] As yet another example, a necessary work amount estimation unit (not shown) that estimates the necessary work amount in the disaster area based on the disaster information is provided, and based on at least any one of the past activity history information, fatigue level, and work progress delay situation included in the unit information, a field unit capable of performing the necessary work amount in the disaster area can also be determined as the field unit or its candidate for instructing the execution of the countermeasure. In this case, the field units capable of performing the necessary work amount are displayed in a list on the display unit of the control device or highlighted in a manner that emphasizes them more than other field units.

[0094] The work instruction / planning proposal generation unit 3520 generates a work instruction or a draft of a work plan having information on the work area, work content, work scale, and the field dispatch unit that performs the work, based on the countermeasure candidates generated by the countermeasure generation unit 3400, the information on the countermeasure priorities, and the field unit information to be dispatched generated by the dispatched unit candidate determination unit 3510. The generated work instruction or draft of the work plan is transmitted to and displayed on the control device 5100 by the transmission unit 3900 described later.

[0095] When the work instruction / planning proposal generation unit 3520 has already determined a work instruction or a work plan by the work plan determination unit 3500, it determines whether it is necessary to change the already determined work instruction or work plan based on the disaster information. As an example, it determines whether it is necessary to change the work plan according to newly acquired physical damage, human damage, or the work situation (such as progress delay) of the unit. Whether it is necessary to change the determined work instruction or work plan is transmitted to and displayed on the control device 5100 by the transmission unit 3900 described later.

[0096] The terminal input information acquisition unit 3530 receives user command input information regarding at least one of the work area of the countermeasure candidate and the on-site team that instructs the execution of the countermeasure candidate from the user input reception unit 5150 of the integrated device 5100, and based on the acquired user command input information, determines the on-site team that instructs the execution of the countermeasure or its candidate. At this time, in the user input reception unit 5150, it is possible for the system to automatically generate countermeasure candidates and for the user to select and input an arbitrary countermeasure from among the countermeasure candidates, but it is also possible for the user to specify and input a countermeasure with arbitrary content.

[0097] (A-1-8-6. Work plan mediation unit 3600) The work plan mediation unit 3600 acquires response information from the on-site team terminal device 5300 regarding the work instruction or work plan, generates a modification plan for the work instruction or work plan according to the response information, and transmits the modification plan to the on-site team terminal device 5300 and the integrated device 5100 for display. The work plan mediation unit 3600 includes a response information acquisition unit 3610, a modification candidate adjustment unit 3620, a re-modification request notification unit 3630, and a modification plan determination unit 3640.

[0098] The response information acquisition unit 3610 acquires response information regarding the request information regarding the work instruction or work plan from the on-site team terminal device 5300. Here, the response information includes information regarding at least one of acceptance, rejection, and mediation request for the request information. The "mediation request" may include conditions for acceptance or reasons for non-acceptance.

[0099] When the acquired response information is "rejected" or "mediation request", the modification candidate adjustment unit 3620 modifies the content of the work instruction or work plan according to the content of the response information.

[0100] The re-change request notification unit 3630 notifies the integrated device 5100 of the work instruction or the change plan of the work plan changed by the change candidate adjustment unit 3620, and displays it on the work instruction / planning candidate display unit 5142 of the integrated device 5100. At the same time, it notifies the field force terminal device 5300 via the integrated device 5100 and displays it on the work command display unit 5330 of the field force terminal device 5300.

[0101] When the change plan determination unit 3640 obtains the response information of "accepted" for the request information regarding the work instruction or the work plan from the field force terminal device 5300, it records the accepted work instruction or work plan as the confirmed information in the work plan storage unit 3800 described later.

[0102] (A-1-8-7. Post-determination change plan notification unit 3700) The post-determination change plan notification unit 3700 transmits the confirmed information of the work instruction or the work plan confirmed by the change plan determination unit 3640 to the integrated device 5100 and the field force terminal device 5300. This confirmed information may be transmitted to the field force terminal device 5300 operated by the field force related to the work instruction or the work plan, or may be transmitted to all the field force terminals integrated by the integrated device 5100. The transmitted confirmed information is displayed on the work instruction / planning candidate display unit 5142 of the integrated device 5100 and is also displayed on the work command display unit 5330 of the field force terminal device 5300.

[0103] (A-1-8-8. Work plan storage unit 3800) The work plan storage unit 3800 records the confirmed information confirmed by the change plan determination unit 3640. Furthermore, it may record the work instruction or the work plan before confirmation and the response information during the mediation between the field force terminal device and the integrated device.

[0104] (A-1-8-9. Transmission unit 3900) The transmission unit 3900 transmits the integrated information, common situation diagram generated by the information integration unit 3300, or each piece of information such as the crisis level, countermeasure candidates, and priority of countermeasures generated by the countermeasure generation unit 3400, or the dispatched force candidates, work instructions / work plans, and change proposals for work instructions / work plans generated by the work plan determination unit 3500 to at least one of the on-site force terminal device and the control device.

[0105] Here, when communication with the on-site force terminal device or the control device via the transmission unit 3900 malfunctions, the communication means is switched to another communication means to continue the state where communication with the on-site force terminal device or the control device is possible. For example, when communicating with the on-site force terminal device or the control device using a mobile phone communication network such as LTE under normal conditions, in the event of communication failure, direct communication using a communication band such as 2.4 Gh, satellite communication via an artificial satellite, communication via a relay aircraft, etc. is switched to maintain communication with the on-site force terminal device or the control device. For example, the communication state such as communication strength and communication speed can be monitored to determine the switching of the communication means.

[0106] (A-1-9. Decision-making process) The system in the above-described embodiment supports the process from making a decision during an incident such as a disaster to executing the work decided for the on-site force in order for the person in charge of commanding crisis countermeasures after the occurrence of an accident to make a more accurate or quicker decision on crisis countermeasures. Therefore, it has functions to support each process as described above.

[0107] FIG. 9 is a diagram showing an example of a general process up to making a decision during an incident such as a disaster. As a general decision-making process, as shown in FIG. 9, there are roughly a data acquisition execution function, a planning and formulation function, and a decision-making function, and a process in which the operations of each function are executed in multiple cycles in sequence by the crisis countermeasure commander and the on-site force.

[0108] The data acquisition execution function includes the execution of data collection and the establishment of on-site command systems, and is a function that is executed immediately after a disaster occurs. Next, in the planning and formulation function to be executed, it includes the creation and update of a common situation diagram and the analysis of the damage situation, and processes and analyzes the acquired data of the disaster site to create and update the common situation diagram. Next, the decision-making function to be executed includes grasping the damage situation, triaging information, and making decisions based on the results of data processing and analysis, and issues work instructions to on-site teams such as rescue teams. The system described in this embodiment is implemented with a function that supports the work process executed by the crisis countermeasure commander when an incident such as a disaster occurs as shown in FIG. 9.

[0109] (A-1-10. Hardware Configuration) FIG. 10 is a configuration diagram showing an example of the hardware configuration of the cooperation system according to an embodiment of the present invention. Here, the data acquisition system 1000, the spatial information data utilization system 2000, the information integration system 3000, the general control device 5100, the other base general control device 5200, and the on-site team terminal device 5300 that constitute the cooperation system 1 in the present invention are information processing devices such as server devices and PCs. As shown in the figure, the data acquisition system 1000, the spatial information data utilization system 2000, the information integration system 3000, the general control device 5100, the other base general control device 5200, and the on-site team terminal device 5300 include an input device 100, an output device 200, a processing device 300, a main storage device 400, an auxiliary storage device 500, a communication device 600, and a bus 700 that electrically connects these devices.

[0110] The input device 100 is a device for a user to input information and instructions into the spatial information data utilization system 2000 and the general control device 5100. Specifically, the input device 100 is, for example, a touch panel, a keyboard, a mouse, or a voice input device such as a microphone.

[0111] The output device 200 is a device that outputs information generated by the space information data utilization system 2000 and the integrated device 5100. Specifically, the output device 200 is a display device (including an eyewear, AR, VR display device, etc.), a printer, or a speaker.

[0112] The processing device 300 is a device that performs arithmetic processing, for example. Specifically, the processing device 300 is, for example, a CPU, a microprocessor, a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), or other semiconductor devices capable of performing arithmetic operations.

[0113] The main memory device 400 is a memory device such as a RAM that temporarily stores various read information, a ROM that stores programs and application programs executed by the processing device 300, and other various information. The auxiliary storage device 500 is a non-volatile storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or a flash memory that can store digital information.

[0114] The communication device 600 is a device that performs information communication wirelessly or by wire with an external device.

[0115] Note that in FIG. 10, the hardware configurations of the data acquisition system 1000, the space information data utilization system 2000, the information integration system 3000, the integrated device 5100, the other-site integrated device 5200, and the on-site team terminal device 5300 were described. However, the external system 4000 can also be realized with the same hardware configuration as that shown in FIG. 10 described above.

[0116] (A-1-11. Flowchart of the cooperation system) Next, the control flow of the entire cooperation system 1 will be described. FIG. 11 is a flowchart showing the control flow of the cooperation system according to an embodiment of the present invention.

[0117] First, the cooperation system 1 acquires troop information (step 101). Specifically, the on-site troop terminal device 5300 acquires troop information regarding the situation of the on-site troops in the disaster area, transmits the troop information to the information integration system 3000 via the general control device 5100, and the on-site troop information acquisition unit 3100 acquires the troop information. The troop information can be acquired by manual input by the on-site troops, or by measurement using the on-site troop terminal device 5300, or by manual input by the general control device.

[0118] Next, the cooperation system 1 acquires human or material disaster information (step 102). Specifically, the information integration system 3000 acquires disaster information regarding the disaster situation including the current or predicted future disaster location or disaster type from the general control device 5100 or the external system 4000. Also, the information integration system 3000 acquires aerial sensing data from the data acquisition system and generates disaster information regarding the disaster situation including the current or predicted future disaster location or disaster type based on the aerial sensing data.

[0119] Next, the cooperation system 1 integrates and displays the on-site situation and the disaster situation on a common situation map (step 103). Specifically, the information integration unit 3300 of the information integration system 3000 integrates the on-site situation and the disaster situation on a common situation map and displays the integrated information on the general control device 5100.

[0120] Next, the information integration system 3000 generates candidate countermeasures for the disaster (step 104). Specifically, the countermeasure generation unit 3400 of the information integration system 3000 determines the crisis level, generates multiple or single candidate countermeasures, and determines the priority of each candidate countermeasure.

[0121] Next, the information integration system 3000 determines candidates for the on-site teams to be dispatched (step 105). Specifically, the dispatched team candidate determination unit 3510 of the information integration system 3000 determines the on-site teams to execute the countermeasures according to the disaster area where the countermeasures are to be implemented, the resources required for the implementation of the countermeasures, the workload, etc. Here, the on-site teams to execute the countermeasures are determined, including not only the on-site teams already active on-site but also the standby teams that have not yet started their activities.

[0122] Next, the information integration system 3000 generates a work instruction or a work plan (step 106). Specifically, the work plan determination unit 3500 generates a draft of the work instruction or the work plan based on the candidate information of the on-site teams to be dispatched and the input information from the user.

[0123] Next, the information integration system 3000 mediates the work instruction or the work plan (step 107). Specifically, the information integration system 3000 exchanges the draft of the work instruction or the work plan and the response information of the on-site teams thereto between the on-site team terminal device 5300 and the general control device 5100, or between the on-site team terminal device 5300 and the information integration system 3000 to mediate the work instruction or the work plan.

[0124] Next, the information integration system 3000 notifies the work instruction or the work plan after mediation (step 108). Specifically, the confirmed change plan notification unit 3700 transmits the work instruction or the work plan that has been mediated and confirmed to the general control device 5100 and all the on-site team terminal devices 5300 to be controlled by the general control device, and displays them on each terminal device. Note that the confirmed work instruction or work plan may be transmitted only to the on-site team terminal devices 5300 of the on-site teams related to the work instruction or work plan, rather than all the on-site team terminal devices 5300.

[0125] (A-1-12. Flowchart for Obtaining On-site Information) In step 101 of FIG. 11, a detailed operation flow for acquiring unit information will be described. FIG. 12 is a diagram showing an example of a flowchart when a cooperation system according to an embodiment of the present invention acquires on-site information.

[0126] First, information regarding work progress is acquired from each on-site unit by the on-site unit terminal device 5300 of each on-site unit (step 201). Here, the information regarding work progress means, for example, including work delays with respect to the original work plan.

[0127] Next, position information regarding the position of the on-site unit is acquired from each on-site unit by the on-site unit terminal device 5300 of each on-site unit (step 202). Here, the information to be acquired is not limited to position information and may be speed or acceleration information. Also, the position information etc. may be acquired by manual input from the operator of the on-site unit terminal device, or may be acquired as measurement information by a sensor (such as a GPS sensor) mounted on the on-site unit terminal device.

[0128] Next, resource information of the on-site unit is acquired by the on-site unit terminal device 5300 of each on-site unit (step 203). Here, the resource information to be acquired is input manually from the operator of the on-site unit terminal device. Specifically, the resource information is information regarding the number of personnel in the unit, possessed equipment, and possessed facilities.

[0129] Next, activity status information of the on-site unit is acquired by the on-site unit terminal device 5300 of each on-site unit (step 204). Here, the activity status information includes, for example, status information such as standby, preparation, execution, break, delay, completed earlier than scheduled, completed, waiting for instructions, requesting instruction change, waiting for mediation, etc.

[0130] (A-1-13. Unit information displayed on the common situation diagram) In step 103 of FIG. 11, an example of a display screen when displaying unit information on the common situation diagram will be described. FIG. 13 is a diagram showing an example of a display screen when a general control device according to an embodiment of the present invention displays unit information.

[0131] For example, in the common situation diagram display unit 5141 of the overall control device 5100, information about a plurality of on-site teams is displayed on the map screen. In the example shown in FIG. 13, in a disaster area where a river flowing on the right side of the drawing has flooded and a flood has occurred, the state of the rescue team A, rescue team B, medical team C, and heavy machinery operation team D operating in the disaster area as on-site teams is shown. As information about each team, the team name, work progress, equipment in possession, and number of personnel are displayed.

[0132] In the example shown in FIG. 13, for the rescue team A, the work progress is "Expected to complete the rescue in area AA: 4 hours later (with a delay)", the equipment is "1 boat and 2 rescue vehicles", and the number of personnel is "5". For the rescue team B, the work progress is "Expected to complete the rescue in area BB: 2 hours later", the equipment is "2 boats and 3 rescue vehicles", and the number of personnel is "10". For the medical team C, the work progress is "20 people have been received. The allowable number of new admissions is 40 people.", the equipment is "60 beds (medical institution A)", and the number of personnel is "10 (5 experienced, 3 mid-level, 2 new)". Finally, for the heavy machinery operation team D, the work progress is "Expected to complete the installation of sandbags: 8 hours later (with a delay) (high fatigue level)", the equipment is "1 excavator truck and 2 trucks", and the number of personnel is "5". Thus, as information about the number of personnel, in addition to the number of personnel, information about the proficiency level of the personnel may be included. For example, as the personnel information of the rescue team B, the number of personnel corresponding to the proficiency levels of 5 "experienced" with a high proficiency level, 3 "mid-level" with a medium proficiency level, and 2 "new" with a low proficiency level is described.

[0133] As described above, for the on-site team or activity location where a delay has occurred in the work progress, the fact that a delay has occurred is emphasized and displayed in bold or by color coding. Similarly, for the on-site team or activity location where it is determined that the fatigue level of the on-site team is high or the work load is high, the fact that the fatigue level is high (work load is high) is emphasized and displayed in bold or by color coding.

[0134] (A-1-14. Disaster information displayed on the common situation diagram) In step 103 of FIG. 11, an example of a display screen when disaster information is displayed on the common situation map will be described. FIG. 14 is a diagram showing an example of a display screen when the general control device according to an embodiment of the present invention displays disaster information.

[0135] For example, in the common situation map display unit 5141 of the general control device 5100, information regarding a plurality of on-site teams is displayed on the map screen. In the example shown in FIG. 14, in a disaster area where a river flowing on the right side of the drawing has flooded and a flood has occurred, the interpretation result of the sensing data (aerial sensing data) acquired by the data acquisition system 1000, the interpretation results of a plurality of fixed cameras acquired from the external system 4000, and the disaster information acquired from the on-site team terminal device 5300 via the general control device 5100 are displayed. Here, the interpretation of the aerial sensing data and the fixed cameras may be an interpretation process using AI.

[0136] In the example shown in FIG. 14, as the interpretation result of the aerial sensing data, the area on the left side of the river is shown as a flooded area and the location of the levee breach is displayed. Also, the interpretation result of fixed camera A is "There is flooding. Water depth is 30 cm", the interpretation result of fixed camera B is "No abnormality", and the interpretation result of fixed camera C is "No abnormality". As the disaster information acquired from the on-site team, the information of rescue team A "There is flooding. Water depth is 40 cm", rescue team B "There is flooding. Water depth is 40 cm", medical team C "No abnormality", and heavy equipment operation team D "Levee is being breached. Width is 30 m" are displayed as disaster information.

[0137] Also, in the example shown in FIG. 14, in addition to the above-described disaster information, information regarding regional residents such as the number of residential households and the number of residents in each area (AA area, BB area, CC area, DD area) is displayed. In this way, by acquiring or displaying information regarding regional residents in addition to the disaster information, it becomes possible to more accurately estimate the scale of the disaster.

[0138] (A-1-15. Team information and disaster information displayed on the common situation map) In step 103 of FIG. 11, an example of a display screen when displaying unit information and disaster information on a common situation map will be described. FIG. 15 is a diagram showing an example of a display screen when the general control device according to an embodiment of the present invention displays integrated information of unit information and disaster information.

[0139] For example, in the common situation map display unit 5141 of the general control device 5100, information on a plurality of on-site units and a plurality of disaster information are displayed on the map screen. In the example shown in FIG. 15, in a disaster area where a river flowing on the right side of the drawing has flooded and a flood has occurred, the above-described unit information and disaster information are integrally displayed.

[0140] In FIGS. 13 to 15, an example of a common situation map on which unit information and disaster information are displayed on the map screen has been described. However, the common situation map to be displayed may be, instead of this, a map image in which a map and sensing data (image, point cloud, or spatial data) are integrated. Alternatively, instead of the map format, a list of unit information and disaster information may be displayed. The above-described integrated information of unit information and disaster information is not limited to the general control device and may be displayed on the on-site unit terminal device.

[0141] (A-1-16. Control Flow for Generating Countermeasure Candidates) Next, in step 104 of FIG. 11, an example in which the countermeasure generation unit 3400 generates candidates for countermeasures will be described. FIG. 16 is a diagram showing an example of a flowchart when the countermeasure generation unit according to an embodiment of the present invention generates countermeasure candidates.

[0142] First, the crisis level determination unit 3410 determines the crisis level (step 301). In this processing step, the crisis level determination unit 3410 determines the crisis level of human damage related to people and the crisis level of physical damage related to things. The crisis level is determined in association with the disaster area or location.

[0143] Next, the countermeasure candidate generation unit 3420 generates countermeasure candidates (step 302). In this processing step, the countermeasure candidate generation unit 3420 determines the content of the countermeasures according to the human and material damage content, determines the work area of the countermeasures according to the affected area, and determines the work scale of the countermeasures according to the scale of the disaster.

[0144] Next, the countermeasure priority determination unit 3430 determines the priority for the countermeasure candidates (step 303). In this processing step, the countermeasure priority determination unit 3430 performs priority assignment (triage) for each countermeasure based on the determination result of the crisis level.

[0145] (A-1-17. Display example of countermeasure candidates) Next, the display screen of the countermeasure candidates generated by steps 301 to 303 in FIG. 16 will be described. FIG. 17 is a diagram showing an example of the display screen of the countermeasure candidates displayed on the integrated device or the on-site team terminal device according to an embodiment of the present invention.

[0146] In the example shown in FIG. 17, an example is shown in which the generated countermeasure candidates are displayed in tabular form in table T101 together with the common situation diagram. Table T101 of the countermeasure candidates includes a plurality of countermeasure candidates, and each countermeasure candidate includes information on the countermeasure content, the response area / location, the crisis level, and the priority. Here, the countermeasure content includes the activity content of countermeasures such as resident rescue, levee repair, and medical support. The response area / location includes information on the area or location where the countermeasures are implemented, such as Area AA, Area BB, Area CC, Area DD, the levee breach location, and medical institutions. The crisis level is the crisis level determined in step 301 of FIG. 16, and is information divided into a plurality of levels such as S, A, B, etc. Next, the priority is the information on the priority of the countermeasure candidates determined in step 303 of FIG. 16, and is information divided into a plurality of levels such as S, A, B, etc.

[0147] In Response Measures Nos. 001 and 002 shown in Fig. 17, since the crisis level is as high as "S", the corresponding priority is also judged to be "S" which is high. Also, in Response Measures Nos. 003, 004, and 006, a priority "A" corresponding to the crisis level "A" is set. Note that in Response Measure No. 005, although the crisis level is "A", the priority is set to "B". This is because the priorities of Response Measures Nos. 003, 004, and 006 which are related to human rescue and medical treatment are evaluated higher than that of Response Measure No. 005 which is for physical recovery.

[0148] Fig. 17 shows an example where the generated response measure candidates are displayed in a table format alongside the common situation diagram. However, the display method of the response measure candidates is not limited to this, and it may be displayed in association with the position of the common situation diagram, or it may be displayed on a screen different from the common situation diagram.

[0149] (A-1-18. Dispatch Unit Candidate Determination) Next, in step 105 of Fig. 11, an example of a candidate list of deployable on-site units generated when the dispatch unit candidate determination unit 3510 determines the on-site unit to execute the response measure will be described. Fig. 18 is a table showing an example of the determination result in which the dispatch unit candidate determination unit according to an embodiment of the present invention generates dispatch unit candidates.

[0150] The table T102 shown in Fig. 18 is list information of units that can be dispatched to the disaster site to execute response measure candidates, and for each unit, it includes information such as unit identification information, activity status, expected end of activity, and resources. As the unit identification information, information capable of identifying units such as "Rescue Team A", "Rescue Team B", "Rescue Team E", "Heavy Equipment Operation Unit F", "Medical Unit G", etc. is described. As the activity status, information indicating the current activity content and activity state of each unit such as "Rescuing residents in Area AA", "Rescuing residents in Area BB", "Standby", etc. is described. As the expected end of activity, the expected time until the currently ongoing activity ends is described. Finally, as the resources, it is information on the human or physical resources including equipment and facilities owned by each unit, and for example, "number of personnel", "boats", "rescue vehicles", etc. are described.

[0151] (A-1-19. Display of Work Instruction or Work Plan) Next, in step 106 of FIG. 11, the display method when the work instruction or work plan information generated by the work plan determination unit 3500 is displayed on the field force terminal device or the general control device will be described. FIG. 19 is a display example when the work instruction or work plan information is displayed in tabular form, and FIG. 20 is a display example when the work instruction or work plan information is displayed in a time series chart form.

[0152] Table T103 shown in FIG. 19 is the work instruction or work plan information displayed in tabular form, and for each of a plurality of countermeasures, it includes information such as countermeasure No., countermeasure content, corresponding area / position, priority, current activity status, and dispatched force candidate. The countermeasure No., countermeasure content, corresponding area / position, and priority include the same information as those shown in FIG. 17. Also, as the current activity status, information on the current activity status in the corresponding area or position is described. For example, "not implemented" which means the work has not been carried out, "in work" which means the work is being carried out by a certain field force, etc. are described. As the dispatched force candidate, the force identification information of the dispatchable force candidates shown in FIG. 18 is described.

[0153] The figure shown in FIG. 20 is a display example of the work instruction or work plan information displayed in a time series chart form, and for each of a plurality of field forces, it includes information on the corresponding area, activity content, and priority in each time frame from the past to the future. For example, Rescue Team A has already carried out the activity of rescuing residents with a priority of "A" in Area AA, and a work plan to continue the activity until after 14:00 is shown.

[0154] Also, for the field forces where a delay has occurred in the current work progress compared to the initial work plan, it is indicated that a delay has occurred, and the work progress line lags behind the planned line. For example, Rescue Team A and Heavy Machinery Work Force D indicate that the work progress line lags behind the planned line at the current time.

[0155] In addition, in the work instruction or work plan in the time-series chart format shown in FIG. 20, a line indicating the current time is shown. When the work is behind schedule with respect to the work plan, it is displayed on the time-series chart that a work delay has occurred.

[0156] In the example of displaying the information of the work instruction or work plan shown in FIGS. 19 and 20, an example is shown in which the information of the work instruction or work plan is displayed side by side with the common situation diagram. However, the display method of the work instruction or work plan is not limited to this, and it may be displayed on a screen different from the common situation diagram.

[0157] (A-1-20. Control Flow during Mediation) Next, in step 107 of FIG. 11, a method for mediating a work instruction or work plan that the work plan mediation unit 3600 performs between the field force terminal device via the integrated device will be described. FIG. 21 is a diagram showing an example of a control flowchart when mediating with the field force terminal device via the integrated device after generating a proposal for a work instruction or work plan in the information integration system 3000.

[0158] First, the integrated device that has received a proposal for a work instruction or work plan from the work plan determination unit 3500 transmits the proposal for the work instruction or work plan to the field force terminal device (step 401).

[0159] Next, the integrated device determines the control to be processed next based on whether the response received from the destination field force terminal device is "accepted" (step 402). If the response received from the field force terminal device is not "accepted", the process proceeds to step 403, while if the response received from the field force terminal device is "accepted", the process proceeds to step 408.

[0160] Next, when the response received from the field force terminal device is not "accepted", the change candidate adjustment unit 3620 of the information integration system 3000 generates another candidate for the work instruction or work plan (step 403).

[0161] Next, the re-change request notification unit 3630 transmits another candidate for the work instruction or work plan to the integrated device, and displays the other candidate on the work instruction / planning candidate display unit 5142 of the integrated device (step 404).

[0162] Next, the work instruction / planning input unit 5153 of the integrated device accepts a correction input or a selection input for another candidate for the work instruction or work plan (step 405).

[0163] Next, the work instruction / planning transmission unit 5114 extracts the on-site team related to another candidate for the work instruction or work plan (step 406).

[0164] Next, the work instruction / planning transmission unit 5114 transmits another candidate for the work instruction or work plan to the related on-site team terminal device again to the on-site team terminal device (step 407). After the processing of this step, the process transitions to the processing of step 402.

[0165] In the process of step 402, when the response received from the on-site team terminal device is "accepted", the change plan determination unit 3640 determines the content of the work instruction or work plan (step 408).

[0166] Next, the information on the determined work instruction or work plan is notified to the integrated device and the on-site team terminal device by the post-determination change plan notification unit 3700, and the information on the determined work instruction or work plan is displayed on the integrated device and the on-site team terminal device (step 409).

[0167] (A-1-20-1. Sequence diagram during mediation) Next, an example of a method for performing mediation between a plurality of on-site team terminal devices and an integrated device when changing a work plan in step 107 of FIG. 11 will be described. FIG. 22 shows a sequence diagram when performing mediation of a work instruction or work plan between rescue teams A, B, and C as a plurality of on-site team terminal devices and an integrated device.

[0168] In the example shown in FIG. 22, first, the coordinating device transmits a work plan change candidate to the terminal device of rescue team B related to the work plan. A "rejection" response is transmitted from the terminal device of rescue team B to the coordinating device.

[0169] Next, the coordinating device transmits the "rejection" response information to the response information acquisition unit 3610 of the information integration system 3000, and acquires the information of the work plan candidate re-changed by the change candidate adjustment unit 3620, and transmits it again to the terminal device of rescue team B. An "acceptance" response is transmitted from the terminal device of rescue team B to the coordinating device.

[0170] The coordinating device transmits the "acceptance" response information to the response information acquisition unit 3610 of the information integration system 3000, and acquires the information of the work plan determined by the change plan determination unit 3640, and transmits the determined work plan not only to the terminal device of rescue team B but also to the terminal devices of other rescue teams A and C, and displays it on each terminal device.

[0171] (A-1-20-2. Display of the on-site team terminal device during mediation) Next, in step 107 of FIG. 11, a method of displaying a work instruction or a work plan on the work instruction display unit 5330 of the on-site team terminal device and acquiring response information from the on-site team by the work instruction response input unit 5313 will be described. FIG. 23 is a diagram showing an example of a display screen displayed when the on-site team terminal device according to an embodiment of the present invention mediates a work instruction or a work plan.

[0172] The display screen shown in FIG. 23 particularly shows the candidate information of the work plan displayed on the display screen of the on-site team terminal device searched by rescue team B. In the display example shown in this figure, a common situation diagram is displayed on the upper side of the display screen, and candidates for work plans in a time-series chart format for a plurality of on-site teams including rescue team B are shown on the lower side of the display screen. The candidates for the work plan in the time-series chart format may be the same as the work plan shown in FIG. 20.

[0173] In addition, an input button for acquiring response information from Rescue Team B for candidates of the work plan is displayed on the display screen. In the example shown in this figure, buttons for "Acceptance", "Rejection", and "Input of Acceptable Conditions" are displayed, and a free-form input field corresponding to "Input of Acceptable Conditions" is provided.

[0174] As shown in this figure, by displaying a common situation diagram, work instructions or candidate information of the work plan, and a response input field on the display screen respectively, and enabling the acceptance of response inputs from Rescue Team B that checks the display screen, it is possible to perform the processes of information display and response acquisition necessary for mediation with each on-site team.

[0175] (A-1-21. Display of Work Instructions or Work Plan after Confirmation) Next, in step 108 of FIG. 11, a method for displaying the confirmed work instructions or work plan after mediation on the work instruction display unit 5330 of the on-site team terminal device will be described. In the overall control device and the on-site team terminal device, work instructions or work plans in a table format or a time-series chart format as shown in FIGS. 19 and 20 are displayed together with the common situation diagram.

[0176] In addition, when generating integrated information of disaster information and team information as digital twin information on a computer in the information integration unit 3300, it is also possible to display the digital twin information and the work instructions or work plan on the on-site team terminal device in an AR (Augmented Reality) method.

[0177] FIG. 24 is a diagram showing an example in which a field unit terminal device according to an embodiment of the present invention AR - displays a work instruction or a work plan. FIG. 24 shows an example of a display screen in the AR device of the field terminal device of rescue team B in particular. Here, the AR device may be a goggle - type display device or a mobile terminal with a camera. In the captured video taken by the camera of the mobile terminal or the display unit of the goggle - type display device, according to the position and orientation information of the AR device, the unit information of other field units (rescue team A, heavy machinery work unit D) and disaster information (dike breach 300 m ahead) generated in the virtual space on the computer are superimposed and displayed. Also, on the display screen, work instructions and work plans are displayed together with the unit information and disaster information.

[0178] In this way, instead of a common situation map in map form, the unit information and disaster information can also be superimposed on the captured video and displayed in an AR manner. The operators of the field units can more easily grasp the unit information, disaster information, work instructions, or work plans while performing their work.

[0179] Another example of displaying digital twin information on the AR device is shown in FIG. 25. FIG. 25 shows an example of a display screen of an AR device operated by heavy machinery work unit D working at the dike breach location. Here, as disaster information, the estimated capacity of the damaged part of the dike at the dike breach location and the information on the required number of sandbags for the repair work are superimposed and displayed on the captured video taken by the camera of the mobile terminal or the display unit of the goggle - type display device according to the position and orientation information of the AR device. Also, on the display screen, work instructions and work plans are displayed together with the disaster information.

[0180] Here, the estimated capacity of the damaged part of the dike at the dike breach location and the required number of sandbags for the repair work can be generated by the disaster - state information acquisition unit 3200. When heavy machinery work unit D determines that the number of sandbags is insufficient with respect to the information on the number of sandbags displayed on the AR device, it can communicate the required number of sandbags to the centralized device via the disaster - state acquisition unit 5312.

[0181] (A - 1 - 22. Example of a common situation map) Next, an explanation of the common situation map generated by the information integration system in the present invention and transmitted to and displayed on the general control device and the on-site team terminal device, along with specific examples thereof, will be described with reference to FIGS. 26 to 29. FIG. 26 is a diagram for explaining the concept of the common situation map. The common situation map is a map, a wide-area image, or spatial data in which the latest information is overwritten and updated. Here, the latest information to be overwritten includes optical images (ortho-images, DEM, DSM), point clouds (DSM, DEM), post-disaster road information, river information, housing information, terrain information, etc. extracted by the system based on the information of optical images and point clouds.

[0182] As shown in FIG. 26, the common situation map is displayed by integrating and overlaying the following multiple pieces of information. · Terrain information: Terrain information before and after the disaster · Housing map: Housing maps before and after the disaster (automatically extracted by the system based on the information of optical images and point clouds) · Road and railway maps (transportation network): Road and railway maps before and after the disaster (automatically extractable by the system based on the information of optical images and point clouds) · River map: River maps before and after the disaster (automatically extractable by the system based on the information of optical images and point clouds) · Damage information: Damage information collected by the information integration system (collected from on-site teams, external systems, and spatial information data utilization systems) · Team information: The working status of each on-site team operating at the disaster site

[0183] Next, FIG. 27 shows an example of using an orthoimage generated from an image acquired by a flying object and a map image integrated with map data as a common situation map. FIG. 28 shows an example of integrating a DEM (Digital Elevation Model) generated from point cloud data acquired by a flying object with map data and using it as a common situation map. FIG. 29 shows an example of integrating a perspective image acquired by a flying object and a DEM (Digital Elevation Model) generated from point cloud data acquired by a flying object and using it as a common situation map. FIG. 30 shows an example of integrating an orthoimage acquired by a flying object and a DEM (Digital Elevation Model) generated from point cloud data acquired by a flying object and using it as a common situation map. FIG. 31 shows an example of integrating a perspective image acquired by a flying object in a local area and a DEM (Digital Elevation Model) generated from point cloud data acquired by a flying object and using it as a common situation map.

[0184] Next, FIG. 32 is a common situation map generated by integrating camera video taken by an aircraft with map data and embedding information of the camera video at the shooting position of the map. FIG. 33 shows data recorded in association with the common situation map, and shows an example in which a plurality of time-series sensing data (aerial images, videos, or point clouds) in a predetermined area of the common situation map are selectively displayed. By selecting arbitrary sensing data, the user can check the sensing data at a desired time.

[0185] In each of the above-described embodiments, a form in which functions for acquiring unit information and disaster information and generating work instructions and work plans are implemented in the information integration system 3000 has been described. However, all or part of the functions of the information integration system 3000 can also be implemented in the spatial information data utilization system 2000 or the general control device 5100.

[0186] The above-described embodiments are merely examples for facilitating the understanding of the present invention and are not intended to limit the interpretation of the present invention. It goes without saying that the present invention can be changed and improved without departing from its gist, and equivalents thereof are included in the present invention.

[0187] [A-2. Effects of the Present Embodiment] According to the above-described embodiments, it is possible to assist a user who commands countermeasures after a crisis occurs in making a more accurate or rapid decision on crisis countermeasures. Specifically, in order to grasp the disaster situation by using the aviation data from the on-site team terminal device, the external system, or the data acquisition system, it is possible to grasp the physical and human damage situation in real time even in the ultra-acute phase immediately after the occurrence of a disaster where the situation changes in a short time. Also, it is possible to grasp the on-site team information from the on-site team terminal device in real time.

[0188] In addition, in the information integration system, since the priority for candidates for countermeasures is determined according to the disaster information and these judgment results are displayed, the user at the crisis management headquarters can make a more accurate decision on crisis countermeasures. Also, since it has a function of notifying the on-site team terminal device of the work instructions and work plans to the site judged by the user at the crisis management headquarters and acquiring the response information, it is possible to mediate more quickly between the crisis management headquarters and the on-site team.

Explanation of Reference Numerals

[0189] 1... Cooperative System (Command System) 100... Input Device 200... Output Device 300... Processing Device 400... Main Memory Device 500... Auxiliary Memory Device 600... Communication Device 700... Bus 1000... Data Acquisition System 1100... Airframe Control System 1200... Airframe Operation Control System 1300... Acquired Data Management System 1400... Communication Infrastructure Management System 1500... Rear Support System 1600... Operation Management System 1700…Airspace Surveillance and Control System 2000…Spatial Information Data Utilization System 2100…Sensing Data Acquisition Unit 2200…Map Data Storage Unit 2300…User Input Reception Unit 2400…Map Image Generation Unit 3000…Information Integration System 3100…Field Unit Information Acquisition Unit 3110…Position Information Acquisition Unit 3120…Resource Information Acquisition Unit 3130…Activity Status Information Acquisition Unit 3140…Fatigue Degree Judgment Unit 3150…Work Progress Judgment Unit 3200…Disaster Situation Information Acquisition Unit 3210…Aerial Measurement Data Analysis Unit 3211…Map Image Acquisition Unit 3212…Disaster Situation Interpretation Unit 3220…External Information Acquisition Unit 3230…General Device Information Acquisition Unit 3300…Information Integration Unit 3310…Disaster / Field Information Integration Unit 3320…Common Situation Map Generation Unit 3400…Countermeasure Generation Unit 3410…Crisis Level Judgment Unit 3420…Countermeasure Candidate Generation Unit 3430…Countermeasure Priority Judgment Unit 3500…Work Plan Judgment Unit 3510…Dispatch Unit Candidate Judgment Unit 3520…Work Instruction / Plan Draft Generation Unit 3530…Terminal Input Information Acquisition Unit 3600…Work Plan Mediation Unit 3610…Response Information Acquisition Unit 3620…Change Candidate Adjustment Unit 3630…Re - change Request Notification Unit 3640…Change Plan Confirmation Unit 3700…Confirmed Change Plan Notification Unit 3800…Work Plan Storage Unit 3900…Transmission Unit 4000…External System 5000…Crisis Response Field Command System 5100…General Device 5110…Field Unit Status Information Acquisition Unit 5112…Disaster Situation Information Acquisition Unit 5113…Field Mediation Information Acquisition Unit 5114…Work Instruction / Plan Transmission Unit 5120…Field Acquired Information Display Unit 5121…Field Unit Status Information Display Unit 5122…Disaster Situation Information Display Unit 5123…On-site Mediation Information Display Unit 5130…Superior Device Information Acquisition Unit 5131…Common Situation Diagram Acquisition Unit 5132…Work Instruction / Plan Candidate Acquisition Unit 5140…Superior Device Acquired Information Display Unit 5141…Common Situation Diagram Display Unit 5142…Work Instruction / Plan Candidate Display Unit 5150…User Input Reception Unit 5151…Display Specification Input Unit 5152…Disaster / Unit Information Input Unit 5153…Work Instruction / Plan Input Unit 5154…Restricted Public Input Unit 5160…Transmission Unit to Superior Device 5161…On-site Unit Status Information Transmission Unit 5162…Disaster Status Information Transmission Unit 5163…On-site Mediation Information Transmission Unit 5200…Other Base Consolidation Device 5300…On-site Unit Terminal Device 5310…On-site Information Acquisition Unit 5311…Unit Status Acquisition Unit 5312…Disaster Status Acquisition Unit 5313…Work Instruction Response Input Unit 5320…Work Command Acquisition Unit 5330…Work Command Display Unit 5340…Common Situation Diagram Display Unit 5350…Communication Unit 7000…Facility and Equipment Management System 8000…Reservation System 9000…Air Traffic Control System

Claims

1. An integrated information acquisition unit that acquires integrated information in which unit information regarding the situation of on-site teams in the disaster area is integrated into sensing data including image data, point cloud data, or spatial data obtained by sensing the disaster area from above by a flying object, or data obtained by processing the sensing data; An integrated information display unit that displays the integrated information on a general control device used by a user who commands the on-site teams; A work plan command unit that commands a work instruction or a work plan for the on-site teams, and The work plan command unit is a command system that causes at least one of a unit terminal used by the on-site teams and the general control device to display information on the work instruction or the work plan.

2. In the command system according to claim 1, A unit terminal communication unit that directly or indirectly exchanges information regarding the work instruction or the work plan between the unit terminal and the general control device is provided.

3. In the command system according to claim 2, The unit terminal communication unit causes the unit terminal to display information regarding the work instruction or the work plan, and acquires response information regarding at least one of acceptance, rejection, and mediation request for the information input from the unit terminal from the unit terminal and causes the information to be displayed on the display unit of the general control device.

4. In the command system according to claim 3, A work plan mediation unit that generates a modification plan for the work instruction or the work plan according to the response information is provided, and The work plan command unit is a command system that causes at least one of the unit terminal and the general control device to display information on the modification plan.

5. In the command system according to claim 3, When the operation plan command unit receives the response information of "accepted" from the unit terminal through the unit terminal communication unit, the operation plan command unit displays the accepted operation instruction or the operation plan as confirmed information on at least one of the unit terminal and the general control device.

6. In the command system according to claim 1, further comprising a disaster information generation unit that acquires or generates disaster information regarding a disaster situation including a current or future predicted disaster location or disaster type, the disaster information generation unit generates the disaster information including at least one of a disaster location or area, disaster content, and disaster scale regarding an object in the current or future based on at least one of sensing data acquired from the air by an aircraft or analysis information of processed data thereof, external information acquired from an external system, or on-site information acquired from the on-site unit, the integrated information acquisition unit acquires integrated information obtained by integrating the unit information and the disaster information in the sensing data or data obtained by processing the sensing data.

7. In the command system according to claim 1, further comprising a disaster information generation unit that acquires or generates disaster information regarding a disaster situation including a current or future predicted disaster location or disaster type, the disaster information generation unit generates the disaster information including at least one of a disaster location or area, disaster content, and disaster scale regarding a person in the current or future based on at least one of sensing data acquired from the air by an aircraft or analysis information of processed data thereof, external information acquired from an external system, or on the unit information, the integrated information acquisition unit acquires integrated information obtained by integrating the unit information and the disaster information in the sensing data or data obtained by processing the sensing data.

8. In the command system according to claim 6 or 7, A command system comprising a work candidate generation unit that generates at least one of the work content, work area, and work scale of a plurality or single corresponding work candidate according to the disaster information acquired or generated by the disaster information generation unit.

9. In the command system according to claim 8, The work candidate generation unit determines the crisis level of the disaster related to people or objects according to the disaster information, A command system that determines the priority of the corresponding work candidate according to the crisis level, or displays the priority of the corresponding work candidate to the user.

10. In the command system according to claim 9, The work candidate generation unit determines the crisis level based on the result of evaluating at least one of the severity degree of damage to people or objects, the degree of damage scale, and the possibility of dealing with the damage.

11. In the command system according to claim 9, In addition to the crisis level, the work candidate generation unit determines the priority of the corresponding work candidate according to the accuracy of the information content of the disaster information, or displays the priority of the corresponding work candidate to the user.

12. In the command system according to claim 1, Comprising a unit information generation unit that generates unit information regarding the situation of the on-site unit in the disaster area, The unit information generation unit acquires or generates the unit information including at least one of the current position of the on-site unit, work content, work progress status, possessed equipment, unit personnel, work status, or the activity history information of the past on-site unit, or the work plan information of the future on-site unit.

13. In the command system according to claim 1, Comprising a unit information generation unit that generates unit information regarding the situation of the on-site unit in the disaster area, The above-mentioned troop information generation unit acquires the activity history information of the on-site troops in the past, and generates information related to the fatigue degree or work load of the on-site troops based on the activity history information of the on-site troops in the past, which is a command system.

14. In the command system according to claim 1, It is provided with a troop information generation unit that generates troop information regarding the situation of on-site troops in the disaster area, The above-mentioned troop information generation unit acquires the work status and work plan information of the current on-site troops, and generates information regarding work progress delay or progress with respect to the work plan based on the information, which is a command system.

15. In the command system according to claim 1, It further includes a disaster information generation unit that acquires or generates disaster information regarding the disaster situation including the current or future predicted disaster location or disaster type, The above-mentioned integrated information acquisition unit generates the integrated information including the disaster information including at least any one of the current or future disaster location or area, disaster content, and disaster scale acquired or generated by the disaster information generation unit, or the troop information including at least any one of the location of the current on-site troops, work content, work progress delay situation, possessed equipment, troop personnel, work status, work plan, fatigue degree, past activity history information, and future work plan, The above-mentioned integrated information display unit causes the integrated information to be displayed on the general control device, which is a command system.

16. In the command system according to claim 1, The above-mentioned work plan command unit acquires, from the general control device, user command input information regarding at least any one of the work area of the corresponding work to be executed and the on-site troops instructing the execution of the corresponding work as information regarding the corresponding work to be executed, and determines the on-site troops or their candidates instructing the execution of the corresponding work based on the acquired user command input information, which is a command system.

17. In the command system according to claim 1, It is provided with a force information generation unit that generates force information regarding the situation of the on-site force in the disaster area. The operation plan command unit is a command system that determines the on-site force or its candidate that instructs the execution of the corresponding operation to be performed based on the force information acquired or generated by the force information generation unit.

18. In the command system according to claim 17, The operation plan command unit determines, as the on-site force or its candidate that instructs the execution of the corresponding operation, the on-site force at a position close to the disaster area based on the current position of the on-site force included in the force information. A command system.

19. In the command system according to claim 17, A disaster information generation unit that acquires or generates disaster information regarding the disaster situation including the current or predicted future disaster location or disaster type, It is provided with a necessary resource estimation unit that estimates the necessary resources including equipment or personnel required in the disaster area based on the disaster information. The operation plan command unit determines, as the on-site force or its candidate that instructs the execution of the corresponding operation, the on-site force having the necessary resources in the disaster area based on the information on the equipment held by the on-site force or the force personnel included in the force information. A command system.

20. In the command system according to claim 17, A disaster information generation unit that acquires or generates disaster information regarding the disaster situation including the current or predicted future disaster location or disaster type, It is provided with a necessary work amount estimation unit that estimates the necessary work amount in the disaster area based on the disaster information. The operation plan command unit determines, as the on-site force or its candidate that can perform the necessary work amount in the disaster area, based on at least any one of the past activity history information, fatigue degree, and work progress delay situation included in the force information, the on-site force that instructs the execution of the corresponding operation, or highlights it on the general control device. A command system.

21. In the command system according to claim 1, the work plan command unit determines the work instruction or the work plan including the work area for performing the corresponding work to be executed, the work content, and the information of the on-site team instructing the execution of the corresponding work, or candidates thereof, of the command system.

22. In the command system according to claim 1, further comprising a disaster information generation unit that acquires or generates disaster information regarding a disaster situation including a disaster location or disaster type that is currently or expected to occur in the future, after the work plan command unit determines the work plan, the work plan command unit determines whether the work plan needs to be changed based on the disaster information, of the command system.

23. In the command system according to any one of claims 16 to 19, the work plan command unit causes at least one of the unit terminal and the control device to display the on-site team or a candidate thereof that instructs the execution of the corresponding work determined by the work plan command unit, of the command system.

24. In the command system according to claim 18 or 19, the work plan command unit causes at least one of the unit terminal and the control device to display the on-site team or a candidate thereof that instructs the execution of the corresponding work determined by the work plan command unit and the information of the disaster area, of the command system.

25. In the command system according to claim 1, the work instruction includes at least any one of information on the work position, work content, urgency, and priority regarding the corresponding work to be executed within a predetermined time, the work plan includes at least any one of information on the work time, work position, work content, urgency, and priority regarding the corresponding work to be executed after the predetermined time, of the command system.

26. In the command system according to claim 1, further comprising a disaster information generation unit that acquires or generates disaster information regarding a disaster situation including a disaster location or disaster type that is present or expected in the future, The work plan command unit is a command system that causes at least one of the unit terminal and the central control device to display at least one of the list information of the disaster information and the list information of the unit information.

27. In the command system according to claim 13, The work plan command unit is a command system that notifies a user from at least one of the unit terminal and the central control device of information regarding the fatigue level or work load of the on-site unit generated by the unit information generation unit.

28. In the command system according to claim 14, The work plan command unit is a command system that notifies a user from at least one of the unit terminal and the central control device of information regarding a delay in work progress with respect to the work plan generated by the unit information generation unit.

29. A unit terminal used by the on-site unit in the disaster area, A central control device used by a user who commands the on-site unit, An information integration system that is communicably connected to the unit terminal and the central control device, and is a cooperation system that operates in cooperation with each other, A unit information generation unit that acquires or generates unit information regarding the situation of the on-site unit in the disaster area, An information integration unit that generates integrated information in which the unit information is integrated with sensing data including image data, point cloud data, or spatial data obtained by sensing the disaster area from above by an aircraft, or data obtained by processing the sensing data, An integrated information display unit that displays the integrated information on the central control device used by a user who commands the on-site unit, A work plan command unit that commands a work instruction or work plan for the on-site unit, The operation plan instruction unit includes an operation plan display unit that displays information on the operation instruction or the operation plan on at least one of a unit terminal used by the on-site unit and the integrated device. A cooperation system comprising the same.

30. A computer obtaining or generating unit information regarding the situation of the on-site unit in the disaster area; obtaining sensing data including image data, point cloud data, or spatial data obtained by sensing the disaster area from above by an aircraft, or obtaining processed data obtained by processing the sensing data; generating integrated information by integrating the sensing data or the processed data and the unit information; displaying the integrated information on a display unit of an integrated device used by a user who commands the on-site unit; determining an operation instruction or an operation plan for the on-site unit; A command method for executing the step of displaying information on the determined operation instruction or the operation plan on at least one of a unit terminal used by the on-site unit and the integrated device.

Images