Information control system, information control method, and program
The information control system addresses the challenge of accurately identifying suspicious ships or aircraft by analyzing data from satellites or aircraft to detect and monitor targets, while incorporating weather information for improved monitoring and response.
Patent Information
- Application Number
- JP2024060561
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-04-04
- Publication Date
- 2025-10-17
AI Technical Summary
Existing systems struggle to accurately identify suspicious ships or aircraft in sea or airspace due to disguise and lack of weather information, leading to potential misses or false positives, and do not effectively utilize valuable meteorological data for monitoring operations.
An information control system that includes a measurement data acquisition unit, operation information acquisition unit, measurement data analysis unit, and monitored object detection unit to analyze data from satellites or aircraft, generating accurate mobile object analysis information and detecting targets based on predefined conditions, while also capturing weather information.
The system enables precise detection of monitored objects and grasps weather information in sea or airspace, enhancing monitoring accuracy and response capabilities.
Smart Images

Figure 2025158222000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an information control system, an information control method, and a program. [Background technology]
[0002] Patent Document 1 discloses a technology that uses aircraft radar to detect suspicious ships, identifies potential suspicious ships based on data transmitted from the ship, and then approaches the suspected suspicious ships to acquire images. In this system, if any external characteristics of the suspicious ship are recognized from the images, this information is transmitted to an external device. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2020-101973 Summary of the Invention [Problem to be solved by the invention]
[0004] To monitor illegal activities or to help save lives, there is a need for technology to monitor designated sea areas or airspace, detect suspicious ships or aircraft, ships in distress, and take appropriate action.However, it is not easy to accurately identify targets from the many ships and aircraft operating in the sea or airspace, and there is a risk of missing or false positives.
[0005] Furthermore, suspicious ships and aircraft, particularly those engaged in illegal activities, are likely to disguise their appearance and operational information to appear as normal ships and aircraft, and it has not been easy to see through such disguise and accurately identify the target of surveillance.
[0006] Furthermore, although wind, waves, currents, and other weather information in the sea and airspace being monitored is valuable information for monitoring operations and response actions after discovering a target, this information was not being measured or utilized.
[0007] Therefore, the present invention has been made in consideration of at least one of the above problems, and one object of the present invention is to provide a system or method, etc., that can more accurately detect monitored objects in sea areas or airspace, or that can grasp weather information in sea areas or airspace. [Means for solving the problem]
[0008] According to the present invention, an information control system is obtained which includes a measurement data acquisition unit that acquires measurement data of an airspace or sea area acquired by a measurement satellite or a measurement aircraft, an operation information acquisition unit that acquires operation information regarding an aircraft in the airspace or a ship in the sea area, a measurement data analysis unit that generates mobile object analysis information regarding the aircraft or ship by performing analytical processing on the measurement data, a monitored object detection unit that detects a monitored object from the aircraft or ship based on the mobile object analysis information and the operation information, and a detection result output unit that outputs information regarding the detected monitored object. [Effects of the Invention]
[0009] According to the present invention, it is possible to provide a system or method that can more accurately detect a monitoring target in sea areas or airspace, or that can grasp meteorological information in sea areas or airspace. [Brief explanation of the drawings]
[0010] [Figure 1] 1 is an overall configuration diagram of an information control system 1 according to one embodiment of the present invention. [Figure 2] FIG. 1 is a system configuration diagram of a data acquisition system 1000. [Figure 3] FIG. 1 is a conceptual diagram showing how a data acquisition system 1000 monitors sea areas and airspace using a surveillance aircraft. [Figure 4] FIG. 2 is a functional block diagram of a geographic information providing system 2000. [Figure 5] FIG. 4 is a functional block diagram of an external system 4000. [Figure 6]FIG. 5 is a functional block diagram of a user terminal device 5000. [Figure 7] FIG. 6 is a system configuration diagram of a collaborative system 6000. [Figure 8] FIG. 3 is a functional block diagram of an airspace and sea area monitoring system 3000. [Figure 9] FIG. 3 is a hardware configuration diagram of an airspace and sea area monitoring system 3000, etc. [Figure 10] FIG. 2 is a flowchart illustrating a processing flow of the information control system 1 according to one embodiment of the present invention. [Figure 11] 10 is a diagram showing an example of measurement data acquired by a measurement data acquisition unit 3110. FIG. [Figure 12] 10 is a diagram showing an example of ship information etc. acquired by the ship operation information acquisition unit 3140. FIG. [Figure 13] 10 is a diagram showing an example of suspicious ship-related information registered by a monitoring target information registration unit 3210. FIG. [Figure 14] FIG. 10 is a diagram showing an example of evidence recording conditions registered by the evidence recording item registration unit 3220. [Figure 15] 10 is a diagram showing an example of ship analysis information and marine environment information determined by the measurement data analysis unit 3300. FIG. [Figure 16] FIG. 10 is a flowchart showing the flow of a monitoring target detection and determination process performed by a monitoring target detection unit 3400. [Figure 17] FIG. 10 is a flowchart showing the processing flow of the third monitoring target detection determination by the integrated determination unit 3430. [Figure 18] FIG. 10 is a flowchart showing the process flow of determining and executing a corresponding action by a corresponding action executing unit 3600. [Figure 19] 10 is a diagram showing an example of a display screen of a monitoring target detection result output by a monitoring target information output unit 3620. FIG. [Figure 20] FIG. 10 is a flowchart showing the processing flow of utilizing history information by a history information utilization unit 3700. [Figure 21] FIG. 13 is a diagram showing an example of a proposed display screen for a monitoring plan generated by a monitoring plan proposing unit 3730. [Figure 22] 13 is a diagram showing an example of a display screen of sea area environmental information output by an environmental information output unit 3740. FIG. DETAILED DESCRIPTION OF THE INVENTION
[0011] The present invention will be described below with reference to the following embodiments. [Item 1] a measurement data acquisition unit that acquires measurement data of an airspace or sea area acquired by a measurement satellite or a measurement aircraft; an operation information acquisition unit that acquires operation information related to an aircraft in the airspace or a ship in the sea area; a measurement data analysis unit that performs an analysis process on the measurement data to generate mobile object analysis information related to the aircraft or the ship; a monitoring target detection unit that detects a monitoring target from the aircraft or the ship based on the mobile object analysis information and the operation information; An information control system comprising a detection result output unit that outputs information relating to the detected monitoring target. [Item 2] In the information control system according to item 1, When the measurement data analysis unit generates the moving object analysis information regarding the ship in the sea area by analyzing the measurement data in the sea area, An information control system that generates at least one of the ship's position, speed, acceleration, movement trajectory, course relative to the ground, heading, rate of turn, ship identification number, call sign, ship name, maximum speed performance, ship length, ship width, position of positioning antenna, estimated destination, estimated time of arrival at the estimated destination, cargo type, draft, and presence or absence of navigation abnormalities as the moving body analysis information of the ship. [Item 3] In the information control system according to item 1 or 2, When the measurement data analysis unit generates the moving object analysis information regarding the ship in the sea area by analyzing the measurement data in the sea area, An information control system that generates at least one of the ship's position, speed, acceleration, movement trajectory, course over the ground, heading, rate of turn, estimated destination, and arrival time at the estimated destination based on the shape of the ship's wake. [Item 4] In the information control system according to any one of items 1 to 3, The operation information acquisition unit generates the operation information including at least one of the ship's position, speed, course over the ground, heading, rate of turn, ship identification number, call sign, ship name, maximum speed performance, maximum acceleration performance, maximum rate of turn performance, ship length, ship width, position of positioning antenna, destination, estimated time of arrival at the destination, cargo type, and draft. [Item 5] In the information control system according to any one of items 1 to 4, When detecting a monitoring target ship that is the monitoring target from the ship, the monitoring target detection unit: An information control system that compares the operation information regarding the ship with the mobile object analysis information regarding the ship, and detects the ship as the monitored ship if the comparison result satisfies a predetermined condition. [Item 6] In the information control system according to any one of items 1 to 5, When detecting a monitoring target ship that is the monitoring target from the ship, the monitoring target detection unit: An information control system that detects a ship as a monitored ship when the movement speed of the ship obtained as the mobile object analysis information exceeds the maximum speed performance of the ship obtained as the operation information. [Item 7] In the information control system according to any one of items 1 to 6, When detecting a monitoring target ship that is the monitoring target from the ship, the monitoring target detection unit: An information control system that detects a ship as a monitored ship when the movement acceleration of the ship obtained as the mobile object analysis information exceeds the maximum acceleration performance of the ship obtained as the operation information. [Item 8] In the information control system according to any one of items 1 to 7, When detecting a monitoring target ship that is the monitoring target from the ship, the monitoring target detection unit: An information control system that detects a ship as a monitored ship when the turning rate of the ship obtained as the mobile object analysis information exceeds the maximum turning rate performance of the ship obtained as the operation information. [Item 9] In the information control system according to any one of items 1 to 8, When detecting a monitoring target ship that is the monitoring target from the ship, the monitoring target detection unit: An information control system that detects a ship as a monitored ship when the position or movement trajectory of the ship obtained as the mobile object analysis information deviates from the planned route of the ship obtained as the operation information in at least a portion of the distance. [Item 10] In the information control system according to any one of items 1 to 9, When detecting a monitoring target ship that is the monitoring target from the ship, the monitoring target detection unit: An information control system that detects a ship as a monitored ship when the length or width of the ship obtained as the mobile object analysis information differs from the length or width of the ship obtained as the operation information. [Item 11] In the information control system according to any one of items 1 to 10, When the measurement data analysis unit generates moving object analysis information regarding the flying object in the airspace by analyzing the measurement data in the airspace, An information control system that generates at least one of the following as mobile object analysis information: the position of the flying object, movement speed, movement acceleration, movement trajectory, ground course direction, heading direction, turning radius, flying object identification number, aircraft name, maximum speed performance, aircraft length, aircraft width, estimated destination, estimated time of arrival at the estimated destination, and flying object type. [Item 12] In the information control system according to any one of items 1 to 11, The operation information acquisition unit acquires the operation information of the aircraft, including at least one of the aircraft's position, movement speed, movement acceleration, movement trajectory, ground course direction, heading direction, turning radius, aircraft identification number, aircraft name, maximum speed performance, aircraft length, aircraft width, estimated destination, estimated time of arrival at the estimated destination, and aircraft type. [Item 13] In the information control system according to any one of items 1 to 12, An information control system in which the detection result output unit displays or transmits to an external device notification information that the monitored object has been detected by the monitored object detection unit or the mobile object analysis information regarding the monitored object from a display unit. [Item 14] In the information control system according to any one of items 1 to 13, An information control system in which the detection result output unit displays and outputs notification information that the monitored object has been detected by the monitored object detection unit or the mobile object analysis information regarding the monitored object on a map including the airspace or the sea area. [Item 15] In the information control system according to any one of items 1 to 14, An information control system comprising a response action execution unit that executes a response action in accordance with a detection result by the monitoring target detection unit. [Item 16] In the information control system according to any one of items 1 to 15, When the monitoring target is detected by the monitoring target detection unit, The response action execution unit instructs the measurement aircraft to measure the monitored object at a different angle, distance, or zoom level than the measurement data, or records or displays or commands additional measurement data obtained by measuring the monitored object at a different angle, distance, or zoom level than the measurement data. [Item 17] In the information control system according to any one of items 1 to 16, When the monitoring target is detected by the monitoring target detection unit, The response action execution unit is an information control system that determines, records, displays, or commands information regarding the airspace environment or sea environment surrounding the monitored object. [Item 18] In the information control system according to any one of items 1 to 17, When the monitoring target detection unit determines that it is uncertain whether the aircraft or the ship corresponds to the monitoring target, The response action execution unit is an information control system that causes the measurement satellite or the measurement aircraft to acquire additional measurement data regarding the aircraft or the ship, or sends an acquisition command. [Item 19] In the information control system according to any one of items 1 to 18, When the monitoring target is detected by the monitoring target detection unit, The response action execution unit receives operational instructions from a user, including at least one of cooperation with other systems, handover of monitoring work to other systems, tracking of the monitored target, and intimidation or attack of the monitored target. [Item 20] In the information control system according to any one of items 1 to 19, An information control system comprising a history information utilization unit that outputs statistical information on the detection history of the monitoring target by the monitoring target detection unit. [Item 21] In the information control system according to any one of items 1 to 20, An information control system comprising a history information utilization unit that generates a monitoring plan for the airspace or sea area by the measurement satellite or the measurement aircraft based on history information of the detection results of the monitoring target by the monitoring target detection unit, and outputs the monitoring plan. [Item 22] In the information control system according to any one of items 1 to 21, An information control system comprising a marine environment information output unit that determines or outputs marine environment information including at least one of the acquired wave height, wave speed, wave direction, tidal current speed or direction, and wind speed or direction in the sea area by analyzing the measurement data. [Item 23] In the information control system according to any one of items 1 to 22, An information control system in which the measurement data acquisition unit acquires image data or video data measured by a camera mounted on the measurement satellite or the measurement aircraft, or point cloud data measured by a laser sensor mounted on the measurement satellite or the measurement aircraft. [Item 24] In the information control system according to any one of items 1 to 23, An information control system comprising a monitoring target information receiving unit that receives, from a user, registration information relating to the monitoring target detected by the monitoring target detection unit. [Item 25] The computer a measurement data acquisition step of acquiring measurement data of an airspace or a sea area acquired by a measurement satellite or a measurement aircraft; an operation information acquisition step of acquiring operation information regarding an aircraft in the airspace or a ship in the sea area; a measurement data analysis step of generating mobile object analysis information related to the aircraft or the ship by analyzing the measurement data; a monitoring target detection step of detecting a monitoring target from the aircraft or the ship based on the mobile object analysis information and the operation information; a detection result output step of outputting information about the detected monitoring target; An information control method that performs the above. [Item 26] On the computer, A measurement data acquisition command to acquire measurement data of an airspace or sea area acquired by a measurement satellite or a measurement aircraft; an operation information acquisition command to acquire operation information regarding an aircraft in the airspace or a ship in the sea area; A measurement data analysis command for generating moving object analysis information regarding the flying object or the ship by analyzing and processing the measurement data, A monitoring target detection command for detecting a monitoring target from the flying object or the ship based on the moving object analysis information and the operation information, A detection result output command for outputting information regarding the detected monitoring target, A program for causing execution thereof.
[0012] <A. First Embodiment> Hereinafter, embodiments of the present invention will be described with reference to the drawings. In this specification and the drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted. Further, the embodiments shown below are merely examples, and other known elements and alternative means can be adopted according to the use, purpose, scale, etc.
[0013] [A-1. Configuration] (A-1-1. Overview) FIG. 1 is an overall configuration diagram of an information control system 1 (hereinafter also referred to as "system 1") according to an embodiment of the present invention. As shown in FIG. 1, the information control system 1 includes a data acquisition system 1000, a geographical information providing system 2000, an airspace and sea area monitoring system 3000, an external system 4000, a user terminal device 5000, and a cooperation system 6000. Each system constitutes an information control system 1 that operates in cooperation by communicating with each other via an Internet line or the like.
[0014] The data acquisition system 1000 controls monitoring machines such as aircraft, artificial satellites, and other flying objects equipped with sensors including radar sensors such as optical cameras, infrared cameras, and SAR sensors, and laser sensors such as LiDAR, and acquires measurement data obtained by sensing information on sea areas and airspaces to be monitored. The data acquisition system 1000 transmits the acquired measurement data to the airspace and sea area monitoring system 3000.
[0015] The measurement data is not limited to image information acquired by a camera or SAR, but may also be point cloud data acquired by other sensors. The data acquisition system 1000 may also be a base equipped with a remote control device that exchanges control information with a monitoring device to perform remote control. The data acquisition system 1000 may also be configured as a mobile vehicle, ship, aircraft, or the like, or as a stationary building (fixed type). The data acquisition system 1000 may also be equipped with a user interface for users, such as a data acquisition manager.
[0016] The geographic information providing system 2000 is a system that transmits to the airspace and sea area monitoring system 3000 marine geographic information of the sea area that is the monitoring area of the monitoring aircraft, and terrestrial GIS geographic information corresponding to the airspace.
[0017] The external system 4000 is a system that transmits to the airspace and sea area monitoring system 3000 information such as ship information, navigation warning information, weather environment information, and accident information such as maritime disasters in the sea area that is the monitoring area by the surveillance aircraft, as well as information on aircraft and weather environment information in the airspace that is the monitoring area.
[0018] The airspace and sea area monitoring system 3000 is a system that acquires information about moving objects such as aircraft and ships in the airspace and sea area that are its monitoring area by analyzing and processing the measurement data acquired from the data acquisition system 1000, and further determines whether these aircraft and ships are targets of monitoring such as suspicious aircraft or ships. The airspace and sea area monitoring system 3000 also transmits information about the determination result to a user terminal device 5000, which will be described later. The airspace and sea area monitoring system 3000 also uses various information acquired from the geographic information providing system 2000, the external system 4000, the user terminal device 5000, etc., for the above-mentioned determination process, etc.
[0019] The user terminal device 5000 is a terminal device used by a user (monitoring manager) who monitors, for example, the airspace or sea area that is the monitoring area, and is a device that accepts monitoring target information regarding the monitoring target from the user and transmits it to the airspace and sea area monitoring system 3000, and also displays or notifies the user of information regarding the judgment results of the monitoring target received from the airspace and sea area monitoring system 3000.
[0020] The cooperative system 6000 is a system that monitors airspace or sea areas in cooperation with the airspace and sea area monitoring system 3000, and when it receives information such as a request for cooperation from the airspace and sea area monitoring system 3000, for example, it dispatches aircraft, ships, etc. to the site to perform monitoring work and other response actions such as tracking in cooperation with the airspace and sea area monitoring system 3000. The cooperative system 6000 may have a function to perform a predetermined operation in response to an operation command received from the user terminal device 5000.
[0021] (A-1-2. Data Acquisition System 1000) 2 and 3, a method for acquiring measurement data in sea areas and airspace using a surveillance aircraft with the data acquisition system 1000 will be described. FIG.
[0022] The data acquisition system 1000 includes an aircraft control system 1100, an aircraft flight operation system 1200, an acquired data management system 1300, a communications infrastructure management system 1400, a logistics support system 1500, an operation management system 1600, and an airspace surveillance and control system 1700.
[0023] The aircraft control system 1100 is a system implemented in a surveillance aircraft, artificial satellite, or other flying object, and performs aircraft control including flight control and measurement control of the flying object. The aircraft control system 1100 includes, for example, a flight unit having a flight function, a sensing unit that performs sensing using sensors (optical cameras, IR cameras, sensors including radar sensors such as SAR sensors, LiDAR, other laser sensors, etc.), a communication unit that communicates with each system via a communication infrastructure management system 1400 (described later) via satellites, a mobile phone communication network, etc., a state determination unit that determines each state of flight, sensing, and positioning, a data recording unit that records acquired data, etc., and a state determination result recording unit that records information related to flight control and measurement control, as well as state determination results.
[0024] In this specification, the term "aircraft" refers to any flying object capable of autonomous attitude control, regardless of the power source (electric power, prime mover, etc.), the control method (wireless or wired, fully autonomous flight or partially manual flight, etc.), and whether manned or unmanned. Aircraft may also be referred to as unmanned aerial vehicles (UAVs), multicopters, remote piloted aircraft systems (RPASs), or unmanned aircraft systems (UASs). Aircraft may be fixed-wing aircraft, multicopter aircraft with multiple propellers, or VTOL aircraft with both fixed wings and multiple propellers. The term "aircraft" also refers to any device that flies in the sky, such as balloons and artificial satellites, in addition to the aircraft mentioned above.
[0025] The aircraft flight operating system 1200 is a system that generates a flight mission for a surveillance aircraft, such as an airplane, controlled by the aircraft control system 1100, and controls the movement of the surveillance aircraft. The flight mission is, for example, a movement plan including the movement route and movement speed of the surveillance aircraft, and the movement route is generated, for example, in an airspace at an altitude of 100 m to 6000 m. The aircraft flight operating system 1200 transmits a control signal to the surveillance aircraft via the communication infrastructure management system 1400, which will be described later, in order to operate the surveillance aircraft automatically.
[0026] The acquired data management system 1300 has a data management function that acquires and records aerial measurement data (optical image data, IR image data, SAR image data, point cloud data acquired by laser sensors such as LiDAR, other spatial data, etc.) and status data of the target area sensed by the surveillance aircraft's aircraft control system 1100 via communication infrastructure management.
[0027] The communication infrastructure management system 1400 is a system that manages the communication means for data (such as measurement data acquired by sensing using a surveillance aircraft) transmitted and received between the aircraft control system 1100 and other systems within the data acquisition system 1000, as well as for control information related to the flight and measurement control of the surveillance aircraft. Furthermore, the communication infrastructure management system 1400 manages the communication means for data (such as measurement data acquired by sensing using a surveillance aircraft) transmitted and received between the data acquisition system 1000 and the airspace and sea area monitoring system 3000.
[0028] The logistic support system 1500 is a system that supports the rapid and smooth execution of each task required for acquiring measurement data executed by the data acquisition system 1000 and the coordination between each task. Specifically, based on the acquired data and status data acquired by the acquired data management system 1300, the system determines whether the data is appropriate and, if inappropriate, requests remeasurement. The system may also have a function for determining whether the power and communication infrastructure at the data acquisition site is available and providing alternative means. The system may also support each task (pre-flight equipment preparation, equipment movement, equipment inspection, equipment adjustment, sensor calibration, in-flight operation, coordination, post-flight post-processing, equipment diagnosis, cleanup, etc.) at the site where the surveillance aircraft or other flying object is operated. The system also determines the equipment and facilities required for each task at the site where the surveillance aircraft is operated and notifies the equipment management system and reservation system (described later) of the required equipment and facilities.
[0029] The flight management system 1600 is a system that makes decisions and gives instructions for the operation of surveillance aircraft. The flight management system 1600 prepares plans for surveillance aircraft operations, including sensing and flight, and transmits the plans to the aircraft control system 1100 that controls the surveillance aircraft via the communication infrastructure management system 1400. The flight management system 1600 may prepare plans for multiple surveillance aircraft and transmit information about the plans to the aircraft control systems 1100 that control each of the surveillance aircraft.
[0030] The airspace surveillance and control system 1700 is a system that monitors the airspace in which a surveillance aircraft to be operated is flying. The airspace surveillance and control system 1700 acquires information on the position of the aircraft from the air traffic control system 4400, which controls the aircraft flying in the target airspace. The air traffic control system 9000 may be, for example, a drone traffic management system (UTM), an aircraft traffic management subsystem (UASSP), or an air traffic management system (ATM). That is, the airspace surveillance and control system 1700 measures or acquires information on the environment and other aircraft in the airspace in which the surveillance aircraft is flying, and transmits the information to the flight management system 1600. If there is a problem with the surveillance aircraft's work plan based on the information from the airspace surveillance and control system 1700, the flight management system 1600 changes the work plan.
[0031] Fig. 3 is a conceptual diagram showing how a sea area and an airspace are monitored using a surveillance aircraft with a data acquisition system 1000. As shown in Fig. 3, the surveillance aircraft, which may be an aircraft, an artificial satellite, or the like, acquires images, videos, or point cloud data of ships navigating within the sea area that is the monitoring area, as well as the wakes of those ships. Furthermore, when the airspace is the monitoring area, the surveillance aircraft acquires images, videos, or point cloud data of aircraft flying within the airspace that is the monitoring area, as well as the contrails of those aircraft. The targets monitored by the surveillance aircraft include, for example, suspicious ships, ships in distress, people in distress, or drifting objects in the sea area, and suspicious aircraft in the airspace.
[0032] 3, a facility is provided on land in which some of the functions constituting the data acquisition system 1000, such as an operation management system 1600, are implemented, and the surveillance aircraft is equipped with an aircraft control system 1100. Also provided on land is an air traffic control system 4400 that communicates with the data acquisition system 1000 and the surveillance aircraft.
[0033] (A-1-3. Geographic Information System 2000) 4 is a functional block diagram of the geographic information providing system 2000. The geographic information providing system 2000 includes a marine geographic information providing system 2100 and a terrestrial GIS geographic information providing system 2200.
[0034] The marine geographic information providing system 2100 is a system that provides geographic information related to the ocean to the airspace and ocean area monitoring system 3000. The marine geographic information provided by the marine geographic information providing system 2100 includes, for example, information on marine areas including territorial waters, contiguous zones, exclusive economic zones (EEZs), and high seas, areas of activity for the Japan Maritime Self-Defense Force, areas of activity for the Japan Coast Guard, fishing areas for fishing boats, navigation areas such as regular routes for civilian ships, leisure sea areas for swimming and diving, and sea route area information for regular shipping routes.
[0035] The ground GIS geographic information providing system 2200 is a system that provides ground GIS geographic information corresponding to airspace to the airspace and sea area monitoring system 3000. The ground GIS geographic information provided by the ground GIS geographic information providing system 2200 includes, for example, base maps, polygon geographic information, elevation information, transportation network information such as roads and railway tracks, facility information, land use information (farmland, housing, commercial facilities, factories, etc.), administrative district information (prefectures, cities, towns, villages, etc.), population information, etc.
[0036] (A-1-4. External System 4000) 5 is a functional block diagram of the external system 4000. The external system 4000 includes an automatic vessel identification system 4100, a coastal area information providing system 4200, a Japan Coast Guard information providing system 4300, and an air traffic control system 4400.
[0037] The automatic identification system 4100 is an AIS (Automatic Identification System) that transmits and receives information between ship stations or between ground stations, such as ship information such as call signs, ship names, positions, courses, speeds, and destinations, warnings for ships including whether they are entering an area and evacuation advisories and calls for cautious navigation, marine accident information including the positions, areas, and scales of marine accidents and their status, and information on the surrounding environment including information on natural disasters such as tsunamis and volcanic eruptions and areas affected by damage, and includes an AIS ground station 4110 and an AIS navigation support system 4120. The automatic identification system 4100 can provide the airspace and sea area monitoring system 3000 with various information such as the above-mentioned ship information, warnings for ships, marine accident information, and surrounding environment information.
[0038] The AIS ground station 4110 has the function of receiving the above-mentioned ship information from the ship and transmitting warning information and marine disaster information to the ship. The AIS navigation support system 4120 has the function of generating warning information for other ships, marine disaster information, and surrounding environment information based on the ship information received from the ship via the AIS ground station 4110 and information acquired from outside.
[0039] The coastal area information providing system 4200 is a system that transmits information such as local weather and sea conditions, such as wind speed, wind direction, and wave height observed at lighthouses in various locations, and the status of offshore construction work, to operators of pleasure boats, recreational fishing boats, and other vessels and those involved in marine leisure activities via the Internet, etc. Furthermore, the coastal area information providing system 4200 can provide various information such as the status of weather and sea conditions and the status of offshore construction work to the airspace and sea area monitoring system 3000.
[0040] The Japan Coast Guard information provision system 4300 is a system that provides the airspace and sea area monitoring system 3000 with various information collected by the Japan Coast Guard, such as the security situation in the sea area (information on deteriorating security, fires, etc.), the status of maritime accidents, the status of navigation traffic (the density of shipping routes, congestion on shipping routes, etc.), and the status of navigation infrastructure (the status of anchorage ports, etc.).
[0041] The air traffic control system 4400 is a system that controls flying objects that fly within controlled airspace, and is a system that acquires information about flying objects, such as the position, movement speed, movement acceleration, movement trajectory, ground course direction, heading, turning radius, flying object identification number, aircraft name, maximum speed performance, aircraft length, aircraft width, estimated destination, estimated time of arrival at the estimated destination, and flying object type. The air traffic control system 4400 can provide the above-mentioned information about flying objects to the airspace and sea area monitoring system 3000.
[0042] (A-1-5. User terminal device 5000) 6 is a functional block diagram of a user terminal device 5000. The user terminal device 5000 is a terminal device used by a user (a person in charge of monitoring) who monitors the airspace or sea area that is a monitoring area, and is, for example, a terminal device used by a person related to the Japan Coast Guard, a person related to the Self-Defense Forces, or other person in charge of monitoring the airspace or sea area. As shown in FIG. 6, the user terminal device 5000 includes a display unit 5100, a user input receiving unit 5200, and a communication unit 5300.
[0043] The user terminal device 5000 communicates with the airspace and sea area monitoring system 3000 via the communication unit 5300, receives information on the determination results of the monitoring target detection unit 3400 (described later) and other units from the airspace and sea area monitoring system 3000 via the communication unit 5300, and displays the determination results on the display unit 5100. In addition, the user input receiving unit 5200 acquires user input information from the user regarding determination information on whether or not a monitoring target is present, response actions to be taken when a monitoring target is detected, criteria for determining whether a monitoring target is present, and conditions for recording evidence when a monitoring target is detected, and the like, and transmits the user input information to the airspace and sea area monitoring system 3000 via the communication unit 5300.
[0044] (A-1-6. Collaborative System 6000) The cooperative system 6000 is a system that monitors airspace or sea area in cooperation with the airspace / sea area monitoring system 3000, and includes an aircraft traffic control unit 6100 and a ship traffic control unit 6200.
[0045] The aircraft traffic control unit 6100 is a system that, when receiving information such as a cooperation request from the airspace and sea area monitoring system 3000, dispatches an aircraft to the site and performs monitoring work or other response actions such as tracking in cooperation with the airspace and sea area monitoring system 3000. Similarly, the ship traffic control unit 6200 is a system that, when receiving information such as a cooperation request from the airspace and sea area monitoring system 3000, dispatches a ship to the site and performs monitoring work or other response actions such as tracking in cooperation with the airspace and sea area monitoring system 3000. The cooperation system 6000 may have a function of executing a predetermined operation in response to an operation command received from the user terminal device 5000.
[0046] (A-1-7. Airspace and Ocean Area Monitoring System 3000) 8 is a functional block diagram of the airspace and sea area monitoring system 3000. The airspace and sea area monitoring system 3000 includes an information import unit 3100, a prior information registration unit 3200, a measurement data analysis unit 3300, a monitoring target detection unit 3400, an incidental information generation unit 3500, a response action execution unit 3600, and a history information utilization unit 3700.
[0047] (A-1-7-1. Information import unit 3100) The information import unit 3100 has the function of acquiring information used for processing in the airspace and sea area monitoring system 3000, and is equipped with a measurement data acquisition unit 3110, a marine geographic information acquisition unit 3120, a ground geographic information acquisition unit 3130, a ship operation information acquisition unit 3140, a coastal area information acquisition unit 3150, a maritime safety information acquisition unit 3160, an aircraft operation information acquisition unit 3170, and a user terminal information acquisition unit 3180.
[0048] The measurement data acquisition unit 3110 has a function of acquiring measurement data from the data acquisition system 1000. FIG. 11 is a diagram showing an example of measurement data acquired by the measurement data acquisition unit 3110. The example shown in FIG. 11 shows an example of measurement data acquired by the measurement data acquisition unit 3110 when an optical image of the sea surface in a specified sea area is acquired as measurement data by an optical camera mounted on a monitoring aircraft (artificial satellite or aircraft). In the case shown in FIG. 11, the measurement data includes images of ships sailing in the sea area of the measurement area, wake waves (also called wake waves) generated on the sea surface by the sailing of the ship, and waves on the sea surface. Note that while FIG. 11 shows an example of acquiring measurement data of a sea area, measurement data of an airspace may also be acquired.
[0049] The marine geographic information acquisition unit 3120 has a function of acquiring geographic information related to the ocean from the marine geographic information provision system 2100 of the geographic information provision system 2000. As described above, the marine geographic information provided by the marine geographic information provision system 2100 includes, for example, information on marine areas including territorial waters, contiguous zones, exclusive economic zones (EEZs), and high seas. Next, the terrestrial geographic information acquisition unit 3130 has a function of acquiring terrestrial GIS geographic information corresponding to airspace from the terrestrial GIS geographic information provision system 2200 of the geographic information provision system 2000. As described above, the terrestrial GIS geographic information provided by the terrestrial GIS geographic information provision system 2200 includes, for example, base maps, polygon geographic information, elevation information, transportation network information such as roads and railway tracks, facility information, land use information (agricultural land, housing, commercial facilities, factories, etc.), administrative district information (prefectures, cities, towns, and villages, etc.), and population information.
[0050] The ship operation information acquisition unit 3140 has a function of acquiring various types of operation information related to ships, such as ship information, ship warning information, marine disaster information, and surrounding environment information, from the automatic ship identification system 4100 of the external system 4000. Fig. 12 is a diagram showing an example of the ship information etc. acquired by the ship operation information acquisition unit 3140.
[0051] The acquired information shown in FIG. 12 includes ship information, ship warning information, surrounding environment information, and marine disaster information. The ship information includes dynamic information, static information, and navigation-related information. Dynamic ship information includes, for example, the ship's position, speed, course over ground, heading, rate of turn (ROT), navigation status, and UTC (Coordinated Universal Time). Static information includes the ship's IMO number (ship identification number), call sign (e.g., Maritime Mobile Service Identity), ship name, captain, width, type of ship, maximum speed performance, maximum acceleration performance, maximum ROT performance, and positioning antenna location. Navigation-related information includes the ship's draft, presence or absence of dangerous cargo, type of cargo, destination, planned route, estimated time of arrival at the destination, and information on navigation safety. Here, ROT (rate of turn) is an abbreviation for Rate of Turn, and refers to the angle of rotation of the ship's bow per unit time, and is measured in units of "deg / s."
[0052] Next, the warning information includes grounding warning information, dragging anchor warning information, and cargo shift warning information generated by the AIS navigation assistance system 4120. Grounding warning information is, for example, information transmitted to a vessel navigating near a grounding prevention line based on the vessel's position and previously determined information on shallow water areas where there is a risk of grounding and grounding prevention lines. Dragging anchor warning information is, for example, information that warns of the risk of running aground in shallow water due to dragging anchor, based on the vessel's position, wind direction and speed, and shallow water area information. Cargo shift warning information is, for example, information that prompts a cargo ship or the like to check the lashing status based on wind direction and speed.
[0053] Next, surrounding environment information includes weather information and natural disaster information. Weather information includes information on typhoons, rain, wind, lightning, and other weather and sea conditions, while natural disaster information includes information on natural disasters related to the sea, such as tsunamis and volcanic eruptions.
[0054] Next, the marine disaster information includes marine disaster warning information about ships that have suffered marine disasters, such as drifting ships, capsized ships, collided ships, grounded ships, ships on fire, and sunken ships, rescue work warning information about sea areas where rescue work is being carried out at sea, diving work warning information about sea areas where diving work is being carried out, and spilled oil warning information about sea areas where oil such as petroleum has spilled onto the sea. Furthermore, the marine disaster warning information may include information about the area of the sea where the marine disaster occurred, the status of the marine disaster, whether it is possible to enter the sea area where the marine disaster occurred, evacuation advice from the sea area, and calls for careful operation.
[0055] The coastal area information acquisition unit 3150 has a function of acquiring various information such as meteorological and sea conditions and the status of marine construction work from the coastal area information provision system 4200 of the external system 4000. In addition, the coast guard information acquisition unit 3160 has a function of acquiring various information such as the security situation in the marine area (information on deterioration of security, fires, etc.), the status of marine accidents, the navigation traffic situation (congestion of navigation routes, congestion of navigation routes, etc.), and the status of navigation infrastructure (status of anchoring ports, etc.) collected by the Japan Coast Guard from the Japan Coast Guard information provision system 4300 of the external system 4000. The coast guard information acquisition unit 3160 may also acquire information on avoiding collisions between ships from other systems.
[0056] The aircraft operation information acquisition unit 3170 has the function of acquiring aircraft operation information related to the aircraft, such as the position of the aircraft within the airspace, movement speed, movement acceleration, movement trajectory, ground course direction, heading direction, turning radius, aircraft identification number, aircraft name, maximum speed performance, aircraft length, aircraft width, estimated destination, estimated time of arrival at the estimated destination, and aircraft type, from the air traffic control system 4400 of the external system 4000.
[0057] The user terminal information acquisition unit 3180 has the function of acquiring user input information regarding the user's judgment of whether or not a person is a subject of monitoring, which is input into the user terminal device 5000, the response actions to be taken when a subject of monitoring is detected, the criteria for determining whether a subject of monitoring is detected, and the conditions for recording evidence when a subject of monitoring is detected.
[0058] (A-1-7-2. Advance information registration unit 3200) The advance information registration unit 3200 has a function of pre-registering information such as information on suspicious ships and aircraft that are targets of monitoring acquired from the user terminal information acquisition unit 3180, etc., and information such as conditions for acquiring and recording evidence information when a target of monitoring is detected. The advance information registration unit 3200 includes a monitoring target information registration unit 3210 and an evidence recording item registration unit 3220.
[0059] The monitoring target information registration unit 3210 has a function of registering monitoring target related information relating to suspicious ships and suspicious flying objects that are the monitoring targets. The monitoring target related information, particularly the suspicious ship related information, when a suspicious ship is the monitoring target will be described below with reference to Fig. 13. Fig. 13 is a diagram showing an example of suspicious ship related information registered by the monitoring target information registration unit 3210.
[0060] As shown in FIG. 13 , the suspicious ship-related information includes the suspicious ship's ship type, sighting area, movement speed information, movement acceleration information, ground course information, bow direction information, ROT (rate of turn) information, IMO number, call sign, ship name, maximum speed performance, bow, ship width, and positioning antenna position. The suspicious ship's ship type is information about the type of ship that the suspicious ship may disguise itself as and the type of ship the suspicious ship is. For example, types of ships that a suspicious ship may disguise themselves as include fishing boats, cargo ships, pleasure boats, drifting ships, and passenger ships. Furthermore, types of suspicious ships include patrol boats, naval vessels, rafts, and spy boats. Furthermore, the sighting area is sighting area information generated, for example, based on the sighting history information of suspicious ships detected in the past. In addition, the information on movement speed, movement acceleration, course relative to the ground, bow direction, ROT (rate of turn) information, IMO number, call sign, ship name, maximum speed performance, bow, width, and positioning antenna position can be registered for each type of suspicious ship, and can be used as criteria for determining suspicious ships by the monitored ship detection unit 3400 described below.
[0061] The evidence recording item registration unit 3220 has a function of registering information such as requests and conditions for obtaining and recording evidence information in the evidence recording operation executed by the response action execution unit 3600 when a monitoring target is detected. Evidence recording condition information when a suspicious ship is the monitoring target will be explained below using Figure 14. Figure 14 is a diagram showing an example of evidence recording conditions registered by the evidence recording item registration unit 3220.
[0062] As shown in FIG. 14, the evidence recording conditions include items such as a resolution condition, a request for zoom shooting, a measurement time length condition, a request for video shooting, a shooting angle condition, and a request for close-up shooting. For example, the resolution condition is registered as a condition that the ppi (Pixels per inch) or dpi (Dots per inch) value is equal to or greater than a predetermined value. The zoom shooting request is registered as a condition whether or not there is a request for zoom shooting. The measurement time length condition is registered as a condition that it is equal to or greater than a predetermined time (e.g., 10 minutes). The action shooting request is registered as a condition whether or not there is a request for video shooting. The shooting angle condition is registered as a condition such as a shooting angle from the left, right, or diagonally above. The close-up shooting request is registered as a condition whether or not there is a request for close-up shooting, and if there is a request for close-up shooting, as a condition (e.g., within 40 m).
[0063] (A-1-7-3. Measurement Data Analysis Unit 3300) The measurement data analysis unit 3300 has a function of generating information about ships in the sea area where the measurement data was acquired and information about the marine environment by analyzing and processing the measurement data acquired by the measurement data acquisition unit 3110. When acquiring measurement data of an airspace, it also generates information about aircraft in the airspace and the airspace environment. The measurement data analysis unit 3300 includes a moving object information determination unit 3310 and an environmental information determination unit 3320.
[0064] The mobile object information determination unit 3310 has a function of acquiring mobile object analysis information about ships in the sea area and aircraft in the airspace from which the measurement data was acquired by analyzing and processing the measurement data. The environmental information determination unit 3320 is a functional unit that determines information about the marine environment in the sea area and the airspace environment in the airspace from which the measurement data was acquired by analyzing and processing the measurement data. Below, using Figure 15, we will explain the mobile object analysis information (ship analysis information) and marine environment information about ships that are determined by analyzing and processing the measurement data in the sea area.
[0065] Fig. 15 is a diagram showing an example of ship analysis information and marine environment information determined by the measurement data analysis unit 3300. In the example shown in Fig. 15, the mobile object analysis information determined by the mobile object information determination unit 3310 includes ship determination information, dynamic information, static information, and navigation-related information of individual ships. It also includes marine environment information determined by the environmental information determination unit 3320.
[0066] The ship determination information is information relating to the result of detecting and determining whether a ship has been detected from the measurement data by the mobile object information determination unit 3310. It may also include the result of detecting and determining whether a drifting object or adrift other than a ship has been detected.
[0067] The dynamic information of an individual ship includes information on the ship's position, movement speed, movement acceleration, wake, course over the ground, heading, ROT (rate of turn), and draft detected by the moving body information determination unit 3310. Here, the moving body information determination unit 3310 can determine the ship's draft based on image data of the ship included in measurement data of optical images of the sea, for example, as shown in FIG. 11. The moving body information determination unit 3310 can also determine the ship's position based on the ship's position in the image data and the surveillance aircraft's self-position information. The moving body information determination unit 3310 can also determine the ship's movement speed and movement acceleration from time-series changes in the ship's position in the image data. The moving body information determination unit 3310 can also determine the ship's heading based on the ship's image data and the surveillance aircraft's heading information.
[0068] Furthermore, the moving body information determination unit 3310 can determine the ship's position, moving speed, moving acceleration, previous ship wake (moving trajectory), ship's course, heading, ROT (rate of turn), estimated destination, and arrival time at the estimated destination based on the shape of the wake wave generated on the sea surface when the ship passes. Here, a wake wave is a wave pattern generated on the water surface downstream of an object such as a stationary object in a current or a ship navigating on the water surface, and includes Kelvin waves and the ship's moving trajectory. The moving speed and moving acceleration of the ship can be estimated from the angle and wave height of the wake wave, particularly the Kelvin wave.
[0069] The static information of an individual ship includes the IMO number (ship identification number), call sign, ship name, maximum speed performance, ship length, ship width, and positioning antenna position of the ship detected by the moving body information determination unit 3310. Here, the moving body information determination unit 3310 can determine the IMO number (ship identification number), call sign, and ship name from text information written on the hull based on image data of the ship included in measurement data of optical images of the sea surface such as shown in Fig. 11, and can also determine the ship length, ship width, and positioning antenna position from the image data of the ship, and can further estimate the ship's maximum speed performance from time-series changes in the positions of the ship and wake waves in the image data.
[0070] The voyage-related information for each individual ship detected by the mobile object information determination unit 3310 includes whether or not the ship has dangerous cargo, the type of cargo, the ship's estimated destination, the estimated estimated time of arrival at the destination, and whether or not the ship has experienced a marine accident or abnormality and the type of such accident (capsize, drifting, stranding, grounding, cargo shift, fire, oil spill, etc.). Here, the mobile object information determination unit 3310 can estimate the ship's estimated destination and the estimated estimated time of arrival at the destination based on the ship's position, movement speed, course, and previous track determined from image data of the ship included in measurement data of optical images of the sea, such as that shown in Fig. 11. It is also possible to determine whether or not the ship has dangerous cargo, the type of cargo, and whether or not the ship has experienced a marine accident or abnormality and the type of such accident (capsize, drifting, stranding, grounding, cargo shift, fire, oil spill, etc.) based on image data of the ship included in the measurement data.
[0071] The marine environment information includes, for example, information on wave height, wave speed, wave direction, current speed and direction, and wind speed and direction determined by the environmental information determination unit 3320 for the target sea area. Here, the moving object information determination unit 3310 can determine wave height, wave speed, wave direction, current speed and direction, and wind speed and direction based on, for example, images of waves on the sea surface or images of floating objects on the sea surface included in measurement data of optical images of the sea, such as those shown in Fig. 11. Note that when analyzing not only still images of the sea but also time-series images or video data, wave height, wave speed, wave direction, current speed and direction, and wind speed and direction can be determined more accurately.
[0072] In the example shown in Figure 15, the mobile object information determination unit 3310 and the environmental information determination unit 3320 analyzed and processed measurement data in the sea area to obtain mobile object analysis information (ship analysis information) related to ships and marine environment information. However, the mobile object information determination unit 3310 and the environmental information determination unit 3320 can also analyze and process measurement data in the airspace to obtain mobile object analysis information (aircraft analysis information) related to flying objects and airspace environment information.
[0073] When the mobile object information determination unit 3310 analyzes and processes measurement data in the airspace to obtain mobile object analysis information (aircraft analysis information) regarding the aircraft, the mobile object information determination unit 3310 can obtain, for example, at least one of the following as mobile object analysis information: the aircraft's position, movement speed, movement acceleration, movement trajectory, ground course direction, heading direction, turning radius, aircraft identification number, aircraft name, maximum speed performance, aircraft length, aircraft width, estimated destination, estimated time of arrival at the estimated destination, and aircraft type.
[0074] In addition, when the environmental information determination unit 3320 analyzes and processes measurement data in the airspace to obtain airspace environmental information, the environmental information determination unit 3320 can obtain information such as the weather in the airspace (sunny, rain, snow, sleet, clouds, fog, typhoon, etc.), wind speed and direction, etc.
[0075] (A-1-7-4. Monitoring target detection unit 3400) The monitoring target detection unit 3400 has a function of detecting and determining a suspicious ship (or suspicious flying object, etc.) that is a monitoring target based on the ship information determined by the moving object information determination unit 3310 of the measurement data analysis unit 3300, the ship information acquired by the ship operation information acquisition unit 3140, the information registered in the monitoring target information registration unit 3210 of the advance information registration unit 3200, or a comparison of these. The monitoring target detection unit 3400 includes a measurement data only determination unit 3410, an operation information only determination unit 3420, and an integrated determination unit 3430.
[0076] The measurement data only judgment unit 3410 is a functional unit that detects and judges the presence of a suspicious ship (or suspicious flying object, etc.) that is the target of monitoring based on the mobile object operation information judged by the mobile object information judgment unit 3310, or based on a comparison of the mobile object operation information judged by the mobile object information judgment unit 3310 with the information registered in the monitored object information registration unit 3210.
[0077] For example, if the dynamic information of the ship determined by the moving body information determination unit 3310, such as the ship's position, movement speed, movement acceleration, wake, course relative to the ground, bow direction, ROT, and draft, meets the determination criteria for a suspicious ship (or suspicious flying object, etc.) that is a monitoring target registered in the monitoring target information registration unit 3210, the measurement data only determination unit 3410 detects and determines that the ship is a suspicious ship.
[0078] In addition, the measurement data only judgment unit 3410 can also detect and judge a ship as a suspicious ship if the static information of the ship judged by the mobile body information judgment unit 3310, such as the IMO number, call sign, ship name, maximum speed performance, ship length, ship width, and positioning antenna position, meets the judgment criteria for a suspicious ship (or suspicious flying object, etc.) that is a monitored target registered in the monitored object information registration unit 3210.
[0079] In addition, the measurement data only judgment unit 3410 can also detect and judge a ship as a suspicious ship if the ship's voyage-related information judged by the mobile body information judgment unit 3310, such as whether or not there is dangerous cargo, the type of cargo, the ship's estimated destination, the estimated time of arrival at the destination, and whether or not there is a maritime accident or abnormality with the ship and the type of such accident (capsize, drifting, stranding, grounding, cargo collapse, fire, oil spill, etc.), meets the judgment criteria for a suspicious ship (or suspicious flying object, etc.) that is a monitored object registered in the monitored object information registration unit 3210.
[0080] The operation information only determination unit 3420 is a functional unit that detects and determines whether a suspicious ship (or suspicious aircraft, etc.) is a target of monitoring, based on the operation information of a ship or aircraft acquired by the ship operation information acquisition unit 3140 or the aircraft operation information acquisition unit 3170, or based on a comparison of the ship operation information or aircraft operation information with the information registered in the monitored object information registration unit 3210.
[0081] When the operation information of a ship or an aircraft acquired by the ship operation information acquisition unit 3140 or the aircraft operation information acquisition unit 3170 meets the criteria for determining a suspicious ship (or suspicious aircraft, etc.) that is a monitoring target registered in the monitoring target information registration unit 3210, the ship can be detected and determined as a suspicious ship. For example, when the speed, acceleration, and ROT, which are dynamic information received from the ship in real time, exceed the maximum speed performance, maximum acceleration performance, maximum ROT performance, etc., which are static information of the ship, the ship can be detected and determined as a suspicious ship. As another example, the ship can also be detected and determined as a suspicious ship when real-time communication with the ship by the automatic identification system 4100 has been cut off for a predetermined period of time or more, or a predetermined number of times or more.
[0082] The integrated judgment unit 3430 is a functional unit that makes a judgment on the detection of a suspicious ship that is a target of monitoring based on a comparison of the ship operation information acquired by the mobile body information judgment unit 3310 of the measurement data analysis unit 3300 and the ship operation information acquired by the ship operation information acquisition unit 3140, or based on the ship operation information determined by the mobile body information judgment unit 3310 of the measurement data analysis unit 3300, the ship operation information acquired by the ship operation information acquisition unit 3140, and the information registered in the monitored object information registration unit 3210 of the advance information registration unit 3200.
[0083] In addition, when suspicious flying objects, etc. within the airspace are targeted for monitoring, the integrated judgment unit 3430 is a functional unit that detects and judges the suspicious flying object being monitored based on a comparison of the flying object operation information determined by the measurement data analysis unit 3300 and the flying object operation information acquired by the aircraft operation information acquisition unit 3170, or based on this information plus the information registered in the monitored object information registration unit 3210 of the advance information registration unit 3200.
[0084] When determining whether a suspicious ship that is a target of monitoring has been detected from ships detected by the measurement data analysis unit 3300, the integrated determination unit 3430 detects and determines that the ship is a suspicious ship if the comparison result satisfies predetermined conditions based on a comparison between the ship operation information determined by the moving body information determination unit 3310 and the ship operation information acquired by the ship operation information acquisition unit 3140. Below, specific examples of predetermined conditions and determination methods for detecting and determining that a ship is a suspicious ship will be described.
[0085] The integrated determination unit 3430 can detect and determine that a ship is a suspicious ship, for example, when the moving speed, moving acceleration, or ROT (rate of turning) of the ship acquired by the moving body information determination unit 3310 exceeds the maximum speed performance, maximum acceleration performance, or maximum ROT (rate of turning) performance acquired by the ship operation information acquisition unit 3140. In other words, the information on the maximum speed performance, maximum acceleration performance, or maximum ROT performance transmitted from the ship to the Automatic Identification System 4100 is disguised to be lower than the actual moving speed, moving acceleration, or ROT, and there is a high possibility that the ship is navigating for an illegal purpose (a purpose that requires agile movement) different from the intended use of the ship transmitted to the Automatic Identification System 4100, and therefore the ship can be detected and determined to be a suspicious ship.
[0086] As another example, the integrated determination unit 3430 can detect and determine a ship as a suspicious ship when the position or previous movement trajectory of the ship determined by the moving object information determination unit 3310 deviates from the planned passage route of the ship acquired by the ship operation information and ship operation information acquisition unit 3140 in at least a portion of the range. In other words, when the actual movement trajectory of the ship or the current ship position deviates from the planned passage route transmitted by the ship to the Automatic Identification System 4100, the ship can be detected and determined as a suspicious ship because there is a high possibility that the ship is sailing for an illegal purpose (a purpose that cannot be achieved on a normal ship route) that is different from the intended use of the ship transmitted to the Automatic Identification System 4100. Here, to determine whether the position or previous movement trajectory of the ship deviates from the planned passage route of the ship, it is not necessary for the actual route to deviate from the planned passage route in all sections; the ship can be detected and determined as a suspicious ship if it deviates in at least some sections.
[0087] As another example, the integrated determination unit 3430 can detect and determine that a ship is a suspicious ship when the length or width of the ship determined by the moving body information determination unit 3310 differs from the length or width of the ship acquired by the ship operation information and ship operation information acquisition unit 3140. In other words, when the length or width of the ship actually measured from the measurement data differs from the length or width transmitted by the ship to the Automatic Identification System 4100, there is a high possibility that the ship is sailing for an illegal purpose (a purpose that can only be achieved with a special length or width) that is different from the intended use of the ship transmitted to the Automatic Identification System 4100, and therefore the ship can be detected and determined as a suspicious ship.
[0088] (A-1-7-5. Additional information generation unit 3500) The incidental information generation unit 3500 has a function of generating incidental information associated with a suspicious ship or the like detected by the monitoring target detection unit 3400. The incidental information generation unit 3500 generates various types of information that are useful to record in association with the suspicious ship or the like. For example, the incidental information generation unit 3500 generates meteorological and oceanographic information (such as wave height, wave speed, wave direction, current speed and direction, and wind speed and direction) of the sea area where the suspicious ship or the like was detected as incidental information for the suspicious ship or the like. In another example, the incidental information generation unit 3500 generates the time series of events, such as the time, season, or political event, at which the suspicious ship or the like was detected as incidental information. In yet another example, the incidental information generation unit 3500 generates the number and other information of other suspicious ships detected around the same time or in the same sea area as the suspicious ship or the like. In another example, the incidental information generation unit 3500 can generate the estimated future route, past route, and external characteristics of the ship, etc., of the suspicious ship or the like determined by the moving object information determination unit 3310.
[0089] (A-1-7-6. Response action execution unit 3600) The response action execution unit 3600 has a function of executing a response action in accordance with the detection result of a monitoring target such as a suspicious ship by the monitoring target detection unit 3400. The response action execution unit 3600 includes an action determination execution unit 3610, a monitoring target information output unit 3620, and an environmental information recording unit 3630.
[0090] When a monitoring target such as a suspicious ship is detected by the monitoring target detection unit 3400, the action determination execution unit 3610 causes the measurement aircraft (aircraft) serving as the monitoring device to perform additional measurement of the monitoring target at a different angle, distance, or zoom amount from the measurement data already acquired, or issues a measurement command. Furthermore, the action determination execution unit 3610 issues a command to record or display the additional measurement data obtained by additional measurement at a different angle, distance, or zoom amount, and records or displays the data.
[0091] When the monitoring target detection unit 3400 determines that it is uncertain whether an air vehicle or a ship corresponds to a monitoring target such as a suspicious ship, the action determination execution unit 3610 causes the monitoring device, a measurement satellite or a measurement air vehicle (including an aircraft), to acquire additional measurement data regarding the air vehicle or the ship. Specifically, the action determination execution unit 3610 transmits an acquisition command for the above-mentioned additional measurement data to the data acquisition system 1000 to acquire the additional measurement data.
[0092] When a monitoring target such as a suspicious ship is detected by the monitoring target detection unit 3400, the action determination execution unit 3610 can receive an operation instruction from the user via the user terminal information acquisition unit 3180, the operation instruction including at least one of cooperation with another system, handover of monitoring work to another system, tracking of the monitoring target, and threatening or attacking the monitoring target. Note that cooperation with another system is, for example, cooperation with the cooperative system 6000, and handover of monitoring work to another system is, for example, handover of monitoring work to the cooperative system 6000.
[0093] The monitored target information output unit 3620 has a function of outputting information on the detection result regarding the monitored target detected by the monitored target detection unit 3400. The monitored target information output unit 3620 displays, for example, notification information that the monitored target has been detected by the monitored target detection unit 3400 or mobile object analysis information regarding the monitored target on a display unit of the airspace and sea area monitoring system 3000, or transmits the same from the airspace and sea area monitoring system 3000 to the user terminal device 5000 or the cooperative system 6000, and displays the same on a display unit of the user terminal device 5000 or the cooperative system 6000.
[0094] When the monitored object information output unit 3620 displays notification information that a target has been detected by the monitored object detection unit 3400, or mobile object analysis information regarding the monitored object, on the display unit of the airspace and sea area monitoring system 3000, the user terminal device 5000, or the cooperative system 6000, the monitored object information output unit 3620 can display the notification information or mobile object analysis information on a map including the airspace or sea area from which the measurement data was obtained.
[0095] When a monitoring target such as a suspicious ship is detected by the monitoring target detection unit 3400, the environmental information recording unit 3630 determines, records, or displays environmental information related to the surrounding environment of the airspace or sea area around the detected monitoring target. Specifically, the environmental information recording unit 3630 acquires the environmental information determination result by the environmental information determination unit 3320, or analyzes and processes the measurement data to determine environmental information related to the surrounding environment of the airspace or sea area around the monitoring target, and outputs a command to record or display the acquired or determined environmental information in a storage device of the airspace and sea area monitoring system 3000, thereby recording and displaying the environmental information.
[0096] (A-1-7-7. History Information Utilization Department 3700) The history information utilization unit 3700 has the functions of utilizing database information in which detection history data of monitoring targets such as suspicious ships has been accumulated to search for and output information on the detection history of the desired suspicious ships, etc., as intended by the user, the function of performing statistical analysis of the detection of suspicious ships, etc., the function of generating a monitoring plan for future monitoring of suspicious ships, etc. using monitoring aircraft, and the function of performing statistical analysis of the marine environment based on the historical accumulated data of marine environment information. The history information utilization unit 3700 includes a detection history search and output unit 3710, a monitoring target statistical analysis unit 3720, a monitoring plan proposal unit 3730, and an environmental information output unit 3740.
[0097] The detection history search output unit 3710 has the function of accepting search condition input from the user via the user terminal information acquisition unit 3180, and based on the search conditions, displaying or transmitting detection history information of monitored targets that match or are similar to the search conditions from the detection history of monitored targets such as suspicious ships.
[0098] The monitored target statistical analysis unit 3720 performs statistical analysis processing on the detection history of monitored targets previously detected by the monitored target detection unit 3400, and displays or outputs statistical information that is the result of the statistical analysis processing. Furthermore, the monitored target statistical analysis unit 3720 may statistically analyze the relationship between the detection history of monitored targets previously detected and the incidental information, for example, based on the detection history of monitored targets and information recorded as incidental information, such as the time, season, time series of various events (e.g., political events), weather, and sea conditions when the monitored targets were detected. The monitored target statistical analysis unit 3720, for example, displays or outputs the statistical information that is the result of the statistical analysis processing on the display unit of the airspace and sea area monitoring system 3000, the user terminal device 5000, or the cooperative system 6000, or transmits or outputs the statistical information from the airspace and sea area monitoring system 3000 to the user terminal device 5000 or the cooperative system 6000.
[0099] The monitoring plan proposal unit 3730 generates a monitoring plan for an airspace or sea area by a monitoring aircraft (a flying object such as a measurement satellite or an aircraft) based on the detection history of monitoring targets previously detected by the monitoring target detection unit 3400, and displays and outputs the generated monitoring plan. For example, the monitoring plan proposal unit 3730 displays and outputs the generated monitoring plan on the display unit of the airspace and sea area monitoring system 3000, the user terminal device 5000, or the cooperative system 6000, or transmits and outputs the generated monitoring plan from the airspace and sea area monitoring system 3000 to the user terminal device 5000 or the cooperative system 6000. The monitoring plan proposal unit 3730 can generate and display a monitoring plan for each area on a marine map using marine geographic information acquired from the marine geographic information providing system 2100.
[0100] The monitoring plan proposing unit 3730 can generate a monitoring plan for each airspace or sea area and for each period, based on, for example, the detection history of monitoring targets detected in the past and statistical information on the relationship between information such as the time, season, chronological relationships of various events such as political events, weather, and sea conditions when the monitoring target was detected, which is recorded as supplementary information. Note that the monitoring plan may include information on the monitoring priority, importance, and monitoring frequency for each airspace or sea area and for each period.
[0101] The environmental information output unit 3740 has a function of determining environmental information in airspace or sea area by analyzing measurement data, and displaying or transmitting the determined environmental information from a display unit. For example, when analyzing measurement data of a sea area, the environmental information output unit 3740 displays or transmits sea area environmental information including at least one of wave height, wave speed, wave direction, tidal current speed or direction, and wind speed or direction in the sea area determined by the analysis process by the environmental information determination unit 3320.
[0102] (A-1-10. Hardware configuration) 9 is a hardware configuration diagram of an airspace and sea area monitoring system 3000, etc. Here, the data acquisition system 1000, geographic information providing system 2000, airspace and sea area monitoring system 3000, external system 4000, user terminal device 5000, and collaboration system 6000, which constitute the information control system 1 of the present invention, are information processing devices such as a server device or a PC. As shown in the figure, the data acquisition system 1000, geographic information providing system 2000, airspace and sea area monitoring system 3000, external system 4000, user terminal device 5000, and collaboration system 6000 each include an input device 100, an output device 200, a processing device 300, a main memory device 400, an auxiliary memory device 500, a communication device 600, and a bus 700 that electrically connects these devices.
[0103] The input device 100 is a device that allows a user to input information and instructions to the information control system 1. Specifically, the input device 100 is, for example, a touch panel, a keyboard, a mouse, or an audio input device such as a microphone.
[0104] The output device 200 is a device that outputs information generated by the information control system 1. Specifically, the output device 200 is a display unit (including eyewear, AR, VR display devices, etc.), a printer, or a speaker.
[0105] The processing device 300 is, for example, a device that performs arithmetic processing. Specifically, the processing device 300 is, for example, a CPU, a microprocessor, a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), or other semiconductor devices capable of performing arithmetic processing.
[0106] The main storage device 400 is a memory device such as a RAM that temporarily stores various types of read information and a ROM that stores programs, application programs, and other various information executed by the processing device 300. The auxiliary storage device 500 is a non-volatile storage device such as an HDD (Hard Disk Drive), SSD (Solid State Drive), or flash memory that can store digital information.
[0107] The communication device 600 is a device that performs wireless or wired information communication with an external device.
[0108] (A-1-11. Control flow of information control system 1) Next, we will explain the overall control flow of the information control system 1. Fig. 10 is a flowchart showing the processing flow of the information control system 1 according to one embodiment of the present invention.
[0109] First, measurement data is imported by the measurement data acquisition unit 3110 of the information import unit 3100 (step 101). In this step, when an image of a predetermined sea area is acquired as measurement data, for example, image data such as that shown in Fig. 11 is acquired.
[0110] Next, the information import unit 3100 imports geographic information and external information provided by the external system 4000 (step 102). In this step, for example, geographic information is imported from the marine geographic information acquisition unit 3120 and the terrestrial geographic information acquisition unit 3130, information about ships and their navigation is imported from the ship operation information acquisition unit 3140, the coastal area information acquisition unit 3150, and the maritime safety information acquisition unit 3160, and information about aircraft and their operation is imported from the aircraft operation information acquisition unit 3170 (step 102).
[0111] Next, the advance information registration unit 3200 registers information about the monitoring target and information about the evidence record at the time of the monitoring target detection (step 103). In this step, for example, input information is accepted from the user via the user terminal information acquisition unit 3180, and the monitoring target information registration unit 3210 registers information about the monitoring target, and the evidence record item registration unit 3220 registers information about the evidence record.
[0112] Next, the measurement data analysis unit 3300 performs an analysis process of the measurement data (step 104). In this step, for example, the moving body information determination unit 3310 performs an analysis process of the measurement data to acquire moving body analysis information, and the environmental information determination unit 3320 performs an analysis process of the measurement data to acquire environmental information of the airspace or sea area.
[0113] Next, the monitoring target detection unit 3400 detects and determines whether a monitoring target such as a suspicious ship or a suspicious flying object has been detected (step 105).
[0114] Next, the additional information generating unit 3500 generates additional information of the monitoring target (step 106).
[0115] Next, the response action execution unit 3600 determines and executes a response action after the monitoring target detection determination is made (step 107).
[0116] Next, the history information utilization unit 3700 outputs statistical information utilizing the detection history of the monitoring target and the determination history information of the environmental information, and outputs a proposal for a future monitoring plan (step 108).
[0117] (A-1-12. Detection and Determination Processing of Monitored Objects) Next, the process of detecting and determining a monitoring target will be described with reference to FIGS.
[0118] (A-1-12-1. Processing flow for monitoring target detection determination) Fig. 16 is a flowchart showing the flow of the monitoring target detection and determination process by the monitoring target detection unit 3400. In the process flow shown in Fig. 16, first, the measurement data only determination unit 3410 performs a first monitoring target detection and determination based on the mobile object analysis information obtained by the mobile object information determination unit 3310 (step 201).
[0119] Next, the operation information only determination unit 3420 performs a second monitoring target detection determination based on either the ship operation information obtained by the ship operation information acquisition unit 3140 or the aircraft operation information obtained by the aircraft operation information acquisition unit 3170 (step 202).
[0120] Next, the integrated determination unit 3430 performs a third monitoring target based on the mobile object analysis information obtained by the mobile object information determination unit 3310 and the ship operation information or the aircraft operation information obtained by the ship operation information acquisition unit 3140 or the aircraft operation information acquisition unit 3170 (step 203). The detailed processing of this step will be described later in detail using FIG. 17.
[0121] Next, the next processing step to transition to is determined (step 204) depending on whether or not a monitoring target is detected in at least one of the first to third monitoring target detection determinations in steps 201 to 203. If a monitoring target is detected in at least one of the first to third monitoring target detection determinations described above, the processing transitions to step 205, whereas if a monitoring target is not detected in any of the first to third monitoring target detection determinations, the processing transitions to step 207.
[0122] Next, in step 204, if it is determined that the monitoring target is not detected in any of the first to third monitoring target detection determinations, a definitive determination that the monitoring target is not detected is made (step 205).
[0123] Next, in step 204, if it is determined that a monitoring target has been detected in at least one of the first to third monitoring target detection determinations, the next processing step to transition to is determined depending on whether a monitoring target has been detected in at least one of the first and second monitoring target detection determinations (step 206). If a monitoring target has been detected in at least one of the first and second monitoring target detection determinations, the processing transitions to step 207, whereas if a monitoring target has not been detected in either the first or second monitoring target detection determinations, the processing transitions to step 208.
[0124] Next, in step 206, if it is determined that a monitoring target has been detected in at least one of the first and second monitoring target detection determinations, a determination is made as to whether a monitoring target has been detected (step 207).
[0125] Next, in step 206, if it is determined that the monitoring target is not detected in either the first or second monitoring target detection determination, the next processing step to transition to is determined depending on whether the monitoring target is detected in the third monitoring target detection determination (step 208).If the monitoring target is detected in the third monitoring target detection determination, the processing transitions to step 207, and on the other hand, if the monitoring target is not detected in the third monitoring target detection determination, the processing transitions to step 209.
[0126] Next, in step 208, if it is determined that the monitoring target is not detected in the third monitoring target detection determination, it is determined that the monitoring target detection determination is indeterminate (step 209).
[0127] (A-1-12-1. Detailed processing flow of monitoring target detection determination by the integrated determination unit 3430) Next, the third monitoring target detection judgment in the monitoring target detection judgment process will be described with reference to Fig. 17. Fig. 17 is a flowchart showing the processing flow of the third monitoring target detection judgment by the integrated judgment unit 3430. In particular, Fig. 17 shows the processing flow when judging a suspicious ship as a monitoring target.
[0128] First, the next processing step to transition to is determined (step 301) depending on whether the movement speed of the ship acquired by the moving body information determination unit 3310 exceeds the maximum speed performance acquired by the ship operation information acquisition unit 3140. If the acquired movement speed of the ship exceeds the maximum speed performance, the processing transitions to step 306, whereas if the acquired movement speed of the ship does not exceed the maximum speed performance, the processing transitions to step 302.
[0129] Next, if it is determined in step 301 that the movement speed of the ship obtained exceeds the maximum speed performance, it is determined that a suspicious ship has been detected (step 302).
[0130] Next, if it is determined in step 301 that the acquired moving speed of the ship does not exceed the maximum speed performance, the next processing step to transition to is determined (step 303) depending on whether the moving acceleration of the ship acquired by the mobile body information determination unit 3310 exceeds the maximum acceleration performance acquired by the ship operation information acquisition unit 3140. If the acquired moving acceleration of the ship exceeds the maximum acceleration performance, the processing transitions to step 302, and on the other hand, if the acquired moving acceleration of the ship does not exceed the maximum acceleration performance, the processing transitions to step 304.
[0131] Next, if it is determined in step 303 that the acquired movement acceleration of the ship does not exceed the maximum acceleration performance, the next processing step to transition to is determined (step 304) depending on whether the ROT (rate of turning) of the ship acquired by the mobile body information determination unit 3310 exceeds the maximum ROT (rate of turning) performance acquired by the ship operation information acquisition unit 3140. If the acquired ROT (rate of turning) of the ship exceeds the maximum ROT (rate of turning) performance, the processing transitions to step 302, and on the other hand, if the acquired ROT (rate of turning) of the ship does not exceed the maximum ROT (rate of turning) performance, the processing transitions to step 305.
[0132] Next, if it is determined in step 304 that the ROT (rate of turning) of the vessel acquired does not exceed the maximum ROT (rate of turning) performance, the next processing step to transition to is determined depending on whether the position or previous movement trajectory of the vessel acquired by the mobile body information determination unit 3310 deviates from the planned passage route acquired by the vessel operation information acquisition unit 3140 (step 305). Here, the determination of whether the vessel has deviated from the planned passage route may be made on the condition that the distance between the vessel's position or previous movement trajectory and the planned passage route is greater than or equal to a predetermined distance. In this step, if the acquired position or previous movement trajectory of the vessel exceeds the planned passage route, the processing transitions to step 302. On the other hand, if the acquired position or previous movement trajectory of the vessel does not exceed the planned passage route, the processing transitions to step 306.
[0133] Next, if it is determined in step 306 that the position of the ship or the movement trajectory up to now does not exceed the planned passage route, it is determined that no suspicious ship has been detected (step 307).
[0134] According to the processing flow for suspicious ship detection as shown in Figure 17, if the ship operation information, such as the actual ship speed, acquired by the mobile information determination unit 3310 based on measurement data differs from the ship operation information acquired by the ship operation information acquisition unit 3140, it can be determined that a suspicious ship has been detected.On the other hand, if the actual ship operation information does not differ from the ship operation information acquired by the ship operation information acquisition unit 3140, it can be determined that a suspicious ship has not been detected.
[0135] (A-1-13. Processing flow for taking action after detecting a monitored object) Next, the response action execution process after the monitoring target detection determination will be described with reference to Fig. 18. Fig. 18 is a flowchart showing the process flow of response action determination and execution by the response action execution unit 3600.
[0136] First, the next processing step to transition to is determined depending on whether or not a definitive determination that a monitoring target has been detected has been made by the monitoring target detection unit 3400 shown in Fig. 16 (step 401). If a definitive determination that a monitoring target has been detected has been made, the processing transitions to step 402, whereas if a definitive determination that a monitoring target has been detected has not been made, the processing transitions to step 403.
[0137] Next, if it is determined in step 401 that a definitive determination has been made that a monitoring target has been detected, notification information that a monitoring target has been detected and information about the detected monitoring target (mobile object analysis information acquired by the mobile object information determination unit 3310) are displayed (step 402). The display screen displayed in this step will be described later.
[0138] Next, if it is determined in step 401 that a definitive determination of whether a monitoring target has been detected has not been made, the next processing step to transition to is determined (step 403) depending on whether the monitoring target detection determination has been determined to be indeterminate by the monitoring target detection unit 3400 shown in Fig. 16 (that is, whether the aircraft or ship included in the measurement data has been determined to be indeterminate as a monitoring target).If it is determined that the monitoring target detection determination is indeterminate, the process transitions to step 404, and on the other hand, if it is not determined that the monitoring target detection determination is indeterminate, the process of this flowchart ends.
[0139] Next, if the monitoring target detection determination is determined to be indefinite in step 403, additional measurement data of the aircraft or ship included in the measurement data is acquired (step 404). In this step, for example, a command is sent to a measurement satellite or measurement aircraft, which is a monitoring device of the data acquisition system 1000, to acquire additional measurement data such as optical images, IR images, and point clouds of the aircraft or ship that is a candidate for monitoring, and the additional measurement data is acquired.
[0140] Next, a report of completion of acquisition of the additionally acquired measurement data and the measurement data are displayed and output to the user (step 405). For example, the above-mentioned information is displayed and output on the display unit of the airspace and sea area monitoring system 3000, the user terminal device 5000, or the cooperative system 6000.
[0141] Next, an input of a determination result as to whether or not the device corresponds to a monitoring target is accepted from a user who has confirmed the display information of the additionally acquired measurement data (step 406). For example, a monitoring manager who uses the user terminal device 5000 accepts the determination result as to whether or not the device corresponds to a monitoring target based on the additionally acquired measurement data.
[0142] Next, the next processing step to transition to is determined depending on whether the determination content received from the user in step 406 is confirmed as detection of a monitoring target (step 407). If the user's determination result is confirmed as detection of a monitoring target (i.e., if it is determined to be a monitoring target), the processing transitions to step 408, and on the other hand, if the user's determination result is not confirmed as detection of a monitoring target (i.e., if it is determined not to be a monitoring target), the processing of this flowchart ends.
[0143] Next, if the user's judgment result in step 407 confirms the detection of the monitored object, or after the notification of the detection result in step 402 has been made, the monitoring aircraft, or measurement aircraft, measures the monitored object at a different angle, distance, or zoom amount than the previously acquired measurement data (step 408). In this step, a measurement command for evidence recording is output to the monitoring aircraft, etc. of the data acquisition system 1000, to measure the monitored object at a different angle, distance, or zoom amount than the previously acquired measurement data, in accordance with, for example, various conditions of the evidence recording conditions (resolution, zoom shooting, measurement time length, video shooting, shooting angle, close-up shooting, etc.) shown in Fig. 14 registered by the evidence recording item registration unit 3220, and evidence recording is performed.
[0144] Next, an input of a response action for the monitored target is accepted from the user (step 409). For example, a monitoring manager using the user terminal device 5000 may select an arbitrary response action from a plurality of response action options, including cooperation with another system, the collaborative system 6000, handing over the monitoring work to the collaborative system 6000, tracking the detected monitored target, and threatening or attacking the monitored target.
[0145] Next, the corresponding action accepted from the user in step 409 is executed (step 410).
[0146] Next, environmental information regarding the airspace environment or sea area environment around the monitoring target is determined, recorded, or displayed (step 411). In this step, for example, the environmental information recording unit 3630 determines, records, or displays the environmental information in the airspace or sea area around the monitoring target based on measurement data obtained by measuring the airspace or sea area around the monitoring target.
[0147] (A-1-14. Example of display of suspicious ship detection judgment result) Next, a display example of the suspicious ship detection determination result will be described with reference to Fig. 19. Fig. 19 is a diagram showing an example of a display screen of the monitoring target detection result output by the monitoring target information output unit 3620. The example shown in Fig. 19 particularly shows a display screen of the detection result when a suspicious ship is detected as a monitoring target.
[0148] In the example shown in FIG. 19, the position, course relative to the ground, and track of the suspicious ship determined by the moving object information determination unit 3310 are superimposed on a map of the sea area including the measurement area of the measurement data. In addition, when the user selects a suspicious ship, detailed information about the suspicious ship is displayed in tabular form. Detailed information about the suspicious ship includes the type of monitored vessel (suspicious vessel), position (coordinates), speed, acceleration, ROT (rate of turn), vessel length, vessel width, and AIS maximum speed. In addition, the display screen displays a message saying "Suspicious ship detected" as notification information that a suspicious ship has been detected, and further displays a message such as "Measured maximum speed exceeds AIS maximum speed performance" as information on the basis for determining that the ship is suspicious.
[0149] (A-1-15. Processing flow for utilizing history information) Next, the processing flow of the history information utilization process will be described with reference to Fig. 20. Fig. 20 is a flowchart showing the processing flow of the history information utilization process by the history information utilization unit 3700.
[0150] First, history data of the monitoring target detection determination by the monitoring target detection unit 3400 shown in FIG. 16 is accumulated (step 501).
[0151] Next, the next processing step to transition to is determined based on whether or not a search condition has been input by the user for the history data of the monitoring target detection determination (step 502). If a search condition input has been received, the processing transitions to step 503, whereas if a search condition input has not been received, the processing transitions to step 504.
[0152] Next, if search condition input is accepted in step 502, the detection history information of the monitored object that matches or is similar to the search condition is displayed and output by the detection history search and output unit 3710 (step 503).
[0153] Next, if no search condition input is received in step 502, or after the processing of step 503 is executed, statistical analysis processing is performed on the detection history data of the monitoring target to generate statistical information (step 504).
[0154] Next, based on the detection history data of the monitored object, proposed information for a monitoring plan using a monitoring aircraft in the airspace or sea area that is the monitored area is generated (step 505).
[0155] Next, the environmental information determination unit 3320 analyzes the measurement data to determine the environmental information in the airspace or sea area that is the monitoring area, and performs statistical analysis of the history data of the environmental information (step 506).
[0156] Next, the next processing step to transition to is determined (step 507) depending on whether a display request input has been received from the user for any of the following information: statistical information on the detection history data of the monitored object generated in step 504, proposed information on a monitoring plan using a monitoring aircraft in airspace or sea area generated in step 505, or environmental information on airspace or sea area generated in step 506. If an information display request input has been received, the process transitions to step 508; on the other hand, if an information display request input has not been received, the processing flow in this figure is terminated.
[0157] Next, if an information display request input is accepted in step 507, the information specified by the information display request is displayed (step 508). For example, if a request to display statistical information on detection history data of a monitoring target is accepted from the user, the monitoring target statistical analysis unit 3720 displays and outputs the statistical information on the detection history data on the display unit. Furthermore, if a request to display proposed information on a monitoring plan using a monitoring aircraft in airspace or sea area is accepted from the user, the monitoring plan proposal unit 3730 displays and outputs the proposed information on the monitoring plan on the display unit. Furthermore, if a request to display environmental information in airspace or sea area or statistical information on the historical data of the environmental information is accepted from the user, the environmental information output unit 3740 displays and outputs the environmental information or statistical information on the historical data of the environmental information on the display unit.
[0158] (A-1-16. Example of display of proposed monitoring plan information) Next, the display contents when proposing a monitoring plan will be described with reference to Fig. 21. Fig. 21 is a diagram showing an example of a monitoring plan proposal display screen generated by the monitoring plan proposal unit 3730.
[0159] The example shown in Figure 21 shows an example in which a monitoring plan for a specific period of time is output, color-coded, for each area defined by a grid mesh on a map of the ocean area including the exclusive economic zone. Darker colored ocean areas are monitored more frequently, while lighter colored ocean areas are monitored less frequently. The monitoring plan proposal unit 3730 can display the monitoring plan on the ocean map using ocean geographic information acquired from the ocean geographic information provision system 2100. Furthermore, while the example shown in Figure 21 shows an example in which a monitoring plan is overlaid on a map of the land (archipelago) and the exclusive economic zone, location information for territorial waters and contiguous waters may also be displayed as map information.
[0160] The monitoring plan proposing unit 3730 generates a monitoring plan that monitors sea areas where monitoring targets are frequently detected at a high frequency, based on historical data of past detections of monitoring targets such as suspicious ships and statistical information about the detections. If many suspicious ships have been detected in the past in a sea area near the boundary line of the exclusive economic zone, the monitoring plan proposing unit 3730 generates a monitoring plan that monitors sea areas near the boundary line of the exclusive economic zone at a relatively high frequency, as shown in Fig. 21. Furthermore, the monitoring plan proposing unit 3730 can generate a monitoring plan based on statistical information about the relationship between the detection history data of monitoring targets and accompanying information, depending on the time, period, season, political events, weather and sea forecast information for the target sea area, or the appearance status of other monitoring targets. In other words, statistical information on the relationship between the detection history data of monitored objects and additional information makes it possible to grasp statistics on the appearance trends of monitored objects according to additional information such as time, period, season, political events, or weather and sea conditions in the target sea area, or the appearance status of other monitored objects, and therefore, according to this information, it is possible to generate monitoring plans for monitored objects for each sea area and time, and to propose and output these monitoring plans.
[0161] (A-1-17. Example of displaying environmental information in marine areas) Next, the display output contents of environmental information for a sea area determined based on measurement data will be described with reference to Fig. 22. Fig. 22 is a diagram showing an example of a display screen for sea area environmental information output by the environmental information output unit 3740. In addition, while the example shown in Fig. 21 shows an example in which environmental information is superimposed on a map of land (archipelagos) and exclusive economic zones, position information for territorial waters and contiguous zones may also be displayed as map information.
[0162] The example shown in FIG. 22 shows the distribution of wave heights by area in a sea area specified by the user, with wave heights represented by different shades of color for each area. In addition to wave heights, the bottom of the screen also displays selection icons for tidal currents (speed, direction), waves (speed, direction), and wind (speed, direction). By selecting one of these icons, the user can display environmental information for each area, including tidal currents (speed, direction), waves (speed, direction), and wind (speed, direction). The environmental information output unit 3740 can also receive a time specification input from the user and display environmental information for the received specified time. When a request to display statistical information is received from the user, statistical information for each area, including wave heights, tidal currents (speed, direction), waves (speed, direction), and wind (speed, direction), can be displayed.
[0163] The above-described embodiments are merely examples for facilitating understanding of the present invention, and are not intended to limit the present invention. The present invention can be modified and improved without departing from the spirit thereof, and it goes without saying that the present invention includes equivalents thereof.
[0164] [A-2. Effects of this embodiment] The above-described embodiment enables more accurate detection of monitoring targets in sea areas or airspace, or understanding of weather information in sea areas or airspace. For example, even if a suspicious ship or a suspicious flying object disguises its operation information to appear as a normal ship or aircraft, the suspicious ship or the suspicious flying object can be more accurately detected by comparing the operation information with the analysis results based on the measurement data.
[0165] As another example, even if a suspicious ship or flying object disguises its appearance to make it look like a normal ship or aircraft, analytical processing based on measurement data can be used to detect not only its external characteristics but also its dynamic behavior, such as speed, acceleration, rate of turn, and heading relative to the ground, making it possible to more accurately detect the suspicious ship or flying object based on such dynamic behavior.
[0166] As another example, by using analytical processing based on measurement data to determine wind, waves, currents, and other weather information in the sea or airspace being monitored, future monitoring operations and response actions after a target is discovered can be carried out more effectively. [Explanation of symbols]
[0167] 1...Information control system (system) 100...input device 200...output device 300...Processing device 400...Main storage device 500...Auxiliary storage device 600...Communication device 700...bus 1000...Data Acquisition System 1100...Aircraft control system 1200...Aircraft operation system 1300...Acquisition data management system 1400...Communication Infrastructure Management System 1500...Logistics support system 1600...Flight management system 1700...Airspace Surveillance and Control System 2000...Geographical Information System 2100: Marine geographic information provision system 2200: Terrestrial GIS geographic information provision system 3000...Airspace and Ocean Surveillance System 3100: Information import unit 3110: Measurement data acquisition unit 3120...Marine geographic information acquisition section 3130...Terrestrial geographic information acquisition section 3140: Ship Operation Information Acquisition Department 3150: Coastal Area Information Acquisition Department 3160: Maritime Safety Information Acquisition Division 3170: Aircraft Operation Information Acquisition Division 3180...User terminal information acquisition unit 3200... Advance information registration unit 3210... Monitoring target information registration unit 3220...Evidence Record Item Registration Section 3300...Measurement data analysis unit 3310...Moving object information determination unit 3320…Environmental information judgment department 3400...Monitoring target detection unit 3410...Measurement data individual determination unit 3420: Flight Information Individual Judgment Unit 3430: Integrated Judgment Unit 3500...Additional information generation unit 3600: Corresponding action execution unit 3610: Action determination execution unit 3620...Monitoring target information output unit 3630...Environment information recording unit 3700... History information utilization unit 3710... Detection history search output unit 3720… Monitoring target statistical analysis department 3730… Monitoring plan proposal department 3740...Environmental information output unit 4000…External system 4100: Automatic Identification System 4110: AIS ground station 4120…AIS navigation assistance system 4200…Coastal Area Information System 4300...Japan Coast Guard Information System 4400...Air traffic control system 5000...User terminal device 5100...Display unit 5200...User input reception unit 5300...Communication unit 6000...Cooperative System 6100...Aircraft Operation Control Department 6200...Ship Operation Management Department
Claims
1. a measurement data acquisition unit that acquires measurement data of an airspace or sea area acquired by a measurement satellite or a measurement aircraft; an operation information acquisition unit that acquires operation information related to an aircraft in the airspace or a ship in the sea area; a measurement data analysis unit that performs an analysis process on the measurement data to generate mobile object analysis information related to the aircraft or the ship; a monitoring target detection unit that detects a monitoring target from the aircraft or the ship based on the mobile object analysis information and the operation information; An information control system comprising a detection result output unit that outputs information relating to the detected monitoring target.
2. 2. The information control system according to claim 1, When the measurement data analysis unit generates the moving object analysis information regarding the ship in the sea area by analyzing the measurement data in the sea area, An information control system that generates at least one of the ship's position, speed, acceleration, movement trajectory, course relative to the ground, heading, rate of turn, ship identification number, call sign, ship name, maximum speed performance, ship length, ship width, position of positioning antenna, estimated destination, estimated time of arrival at the estimated destination, cargo type, draft, and presence or absence of navigation abnormalities as the moving body analysis information of the ship.
3. 2. The information control system according to claim 1, When the measurement data analysis unit generates the moving object analysis information regarding the ship in the sea area by analyzing the measurement data in the sea area, An information control system that generates at least one of the ship's position, speed, acceleration, movement trajectory, course over the ground, heading, rate of turn, estimated destination, and arrival time at the estimated destination based on the shape of the ship's wake.
4. 2. The information control system according to claim 1, The operation information acquisition unit acquires the operation information including at least one of the ship's position, speed, course over the ground, heading, rate of turn, ship identification number, call sign, ship name, maximum speed performance, maximum acceleration performance, maximum rate of turn performance, ship length, ship width, position of positioning antenna, destination, estimated time of arrival at the destination, cargo type, and draft.
5. 5. The information control system according to claim 4, When detecting a monitoring target ship that is the monitoring target from the ship, the monitoring target detection unit: An information control system that compares the operation information regarding the ship with the mobile object analysis information regarding the ship, and detects the ship as a target of monitoring if the comparison result satisfies a predetermined condition.
6. 2. The information control system according to claim 1, When detecting a monitoring target ship that is the monitoring target from the ship, the monitoring target detection unit: An information control system that detects a ship as a monitored ship when the movement speed of the ship obtained as the mobile object analysis information exceeds the maximum speed performance of the ship obtained as the operation information.
7. 2. The information control system according to claim 1, When detecting a monitoring target ship that is the monitoring target from the ship, the monitoring target detection unit: An information control system that detects a ship as a monitored ship when the movement acceleration of the ship obtained as the mobile object analysis information exceeds the maximum acceleration performance of the ship obtained as the operation information.
8. 2. The information control system according to claim 1, When detecting a monitoring target ship that is the monitoring target from the ship, the monitoring target detection unit: An information control system that detects a ship as a monitored ship when the turning rate of the ship obtained as the mobile object analysis information exceeds the maximum turning rate performance of the ship obtained as the operation information.
9. 2. The information control system according to claim 1, When detecting a monitoring target ship that is the monitoring target from the ship, the monitoring target detection unit: An information control system that detects a ship as a monitored ship when the position or movement trajectory of the ship obtained as the mobile object analysis information deviates from the planned route of the ship obtained as the operation information in at least a portion of the distance.
10. 2. The information control system according to claim 1, When detecting a monitoring target ship that is the monitoring target from the ship, the monitoring target detection unit: An information control system that detects a ship as a monitored ship when the length or width of the ship obtained as the mobile object analysis information differs from the length or width of the ship obtained as the operation information.
11. 2. The information control system according to claim 1, When the measurement data analysis unit generates the moving object analysis information regarding the flying object in the airspace by analyzing the measurement data in the airspace, An information control system that generates at least one of the following as mobile object analysis information: the position of the flying object, movement speed, movement acceleration, movement trajectory, ground course direction, heading direction, turning radius, flying object identification number, aircraft name, maximum speed performance, aircraft length, aircraft width, estimated destination, estimated time of arrival at the estimated destination, and flying object type.
12. 2. The information control system according to claim 1, The operation information acquisition unit acquires the operation information of the aircraft, including at least one of the aircraft's position, movement speed, movement acceleration, movement trajectory, ground course direction, heading direction, turning radius, aircraft identification number, aircraft name, maximum speed performance, aircraft length, aircraft width, estimated destination, estimated time of arrival at the estimated destination, and aircraft type.
13. 2. The information control system according to claim 1, An information control system in which the detection result output unit displays or transmits to an external device notification information that the monitored object has been detected by the monitored object detection unit or the mobile object analysis information regarding the monitored object from a display unit.
14. 2. The information control system according to claim 1, An information control system in which the detection result output unit displays and outputs notification information that the monitored object has been detected by the monitored object detection unit or the mobile object analysis information regarding the monitored object on a map including the airspace or the sea area.
15. 2. The information control system according to claim 1, An information control system comprising a response action execution unit that executes a response action in accordance with a detection result by the monitoring target detection unit.
16. 16. The information control system according to claim 15, When the monitoring target is detected by the monitoring target detection unit, The response action execution unit instructs the measurement aircraft to measure the monitored object at a different angle, distance, or zoom level than the measurement data, or records or displays or commands additional measurement data obtained by measuring the monitored object at a different angle, distance, or zoom level than the measurement data.
17. 16. The information control system according to claim 15, When the monitoring target is detected by the monitoring target detection unit, The response action execution unit is an information control system that determines, records, displays, or commands information regarding the airspace environment or sea environment surrounding the monitored object.
18. 16. The information control system according to claim 15, When the monitoring target detection unit determines that it is uncertain whether the aircraft or the ship corresponds to the monitoring target, The response action execution unit is an information control system that causes the measurement satellite or the measurement aircraft to acquire additional measurement data regarding the aircraft or the ship, or sends an acquisition command.
19. 16. The information control system according to claim 15, When the monitoring target is detected by the monitoring target detection unit, The response action execution unit receives operational instructions from a user, including at least one of cooperation with other systems, handover of monitoring work to other systems, tracking of the monitored target, and intimidation or attack of the monitored target.
20. 2. The information control system according to claim 1, An information control system comprising a history information utilization unit that outputs statistical information on the detection history of the monitoring target by the monitoring target detection unit.
21. 2. The information control system according to claim 1, An information control system comprising a history information utilization unit that generates a monitoring plan for the airspace or sea area by the measurement satellite or the measurement aircraft based on history information of the detection results of the monitoring target by the monitoring target detection unit, and outputs the monitoring plan.
22. 2. The information control system according to claim 1, An information control system comprising a marine environment information output unit that determines or outputs marine environment information including at least one of wave height, wave speed, wave direction, tidal current speed or direction, and wind speed or direction in the sea area by analyzing the measurement data.
23. 2. The information control system according to claim 1, An information control system in which the measurement data acquisition unit acquires image data or video data measured by a camera mounted on the measurement satellite or the measurement aircraft, or point cloud data measured by a laser sensor mounted on the measurement satellite or the measurement aircraft.
24. 2. The information control system according to claim 1, An information control system comprising a monitoring target information receiving unit that receives, from a user, registration information relating to the monitoring target detected by the monitoring target detection unit.
25. The computer a measurement data acquisition step of acquiring measurement data of an airspace or a sea area acquired by a measurement satellite or a measurement aircraft; an operation information acquisition step of acquiring operation information regarding an aircraft in the airspace or a ship in the sea area; a measurement data analysis step of generating mobile object analysis information related to the aircraft or the ship by analyzing the measurement data; a monitoring target detection step of detecting a monitoring target from the aircraft or the ship based on the mobile object analysis information and the operation information; a detection result output step of outputting information about the detected monitoring target; An information control method that performs the above.
26. On the computer, A measurement data acquisition command to acquire measurement data of an airspace or sea area acquired by a measurement satellite or a measurement aircraft; an operation information acquisition command to acquire operation information regarding an aircraft in the airspace or a ship in the sea area; a measurement data analysis command for generating mobile object analysis information related to the aircraft or the ship by analyzing the measurement data; a monitoring target detection command for detecting a monitoring target from the aircraft or the ship based on the mobile object analysis information and the operation information; a detection result output command to output information about the detected monitoring target; A program that executes the following.
Citation Information
Patent Citations
Aircraft
JP2020101973A