SAR Image Analysis System

Abstract

SAR image analysis system with: a storage unit configured to store a SAR image data set containing multiple SAR images obtained by observing an observation area and differing in acquisition time, and a sensor observation data set obtained from a sensor facility group configured to perform an observation with respect to known coordinates within the observation area; an interferometric analysis unit configured to perform an interferometric analysis of the multiple SAR images in order to obtain interferometric analysis result data; and a repair work estimation unit configured for this purpose: to extract a correlation between an offset of each of the analysis points contained in the interferometric analysis result data and each observation data element for each set of observation coordinates contained in the sensor observation data set; to estimate a cause of the offset of each of the analysis points included in the interferometric analysis result data based on any of the following: presence or absence, breakdown, breakdown measure and breakdown type of correlation, or a combination thereof; and to extract a repair work type that is related to an estimated cause of the offset in relation to a location of an analysis point with a large offset among the respective analysis points, or to a structure or topography that features the analysis point with a large offset.

Description

[0001] The present application is based on Japanese patent application no. 2018-146694, filed on August 3, 2018, and claims priority therefrom. Reference is made to the entirety of its disclosure herein. Technical field

[0002] The present invention relates to: a SAR (Synthetic Aperture Radar) image analysis system configured to perform an image data set analysis using an image data set of the same observation point acquired by a SAR at different acquisition times, a method for this and a program for this. Background technology

[0003] In recent years, various data processing systems have been configured to perform image analysis of the ground using satellite imagery. Some of these systems analyze the ground using a SAR image dataset acquired by a SAR (Search and Rescue Array).

[0004] Examples of a SAR image analysis system configured to perform an image dataset analysis using an image dataset of the same observation site acquired by the SAR at different acquisition times are described in JP 2009-289111 A (hereinafter referred to as "Patent Document 1"), in JP 2017-049089 A (hereinafter referred to as "Patent Document 2") and in JP 2017-215248 A (hereinafter referred to as "Patent Document 3").

[0005] An image processing device (SAR image analysis system) described in patent document 1 uses Coherent Change Detection (CCD). With CCD, phase information is used together with brightness information relating to SAR images to extract a change between two SAR images.

[0006] An information processing device (SAR image analysis system) described in patent document 2 uses observational data relating to an electronic reference point (precise position information group of an electronic reference point) for SAR image analysis and analyzes the image data set of the same observation point acquired at different acquisition times. The observational data relating to the electronic reference point indicate a precise position in a spatial coordinate system used in a global navigation satellite system (GNSS). The information processing device described in patent document 2 uses features of the observational data to determine the absolute value of a difference (change measure) of a pixel at which the electronic reference point is located between the SAR images by means of an interferometric SAR analysis.Additionally, during the process, the information processing unit receives a correlation expression between an absolute coordinate change of the pixel identified by the interferometric SAR analysis and an observation distance of the SAR and uses the correlation expression to correct the SAR image analysis.

[0007] A deformation degree determination system (SAR image analysis system) described in patent document 3 detects the displacement of a target section, for example of a structure, using interferometric SAR. The deformation degree determination system also compares a permissible lower limit for the height of a predefined target object with the detected displacement to determine the risk level of, for example, a dike.

[0008] As described in patent document 3, SAR image analysis is increasingly used to monitor infrastructure such as roads, railways, dams, and various facilities. For example, in PS-InSAR (Persistent Scatterer Interferometry SAR) analysis, a type of SAR image analysis, a large number of image datasets can be analyzed to obtain a displacement velocity of the Earth's surface over a large area with an accuracy of mm / year for each measurement target point. By chronologically analyzing the SAR image dataset, it becomes possible to determine the temporal displacement in units of millimeters for each part of, for example, a specific artificial structure.

[0009] Infrastructure requires enormous effort and financial resources for its upkeep, repair, and maintenance. Currently, a regular repair plan is typically established for infrastructure maintenance, and inspection and repair work is carried out after a prescribed number of years and a prescribed service life. However, when creating a regular repair plan, for various reasons, the repair work is not always performed at a time that coincides with when actual repairs are needed. In some cases, the regular repair plan is so inefficient that appropriate repair work is not carried out at the required time and place, resulting in routine repairs being performed at an unnecessary time and place.

[0010] Besides the maintenance of infrastructure, enormous efforts and financial resources are required to monitor, for example, crustal movements as precursors to landslides and volcanic eruptions, coastal erosion, and the rising and falling of developed land. For instance, under current circumstances, even in an area designated as a special landslide warning zone, a local government can hardly afford to carry out surveying and disaster preparedness work. It is assumed that the current standard operating procedure is still rarely able to detect any signs of a disaster and utilize various sensor systems (e.g., radar, radar, etc.).to install a water level indicator, an automatic displacement measuring device, a water content measuring device, a thermometer and a vibrometer) near a location where damage is expected, while simultaneously taking disaster prevention measures.

[0011] Under the current circumstances, the infrastructure is located near areas of human activity and is equipped with existing sensor systems, which facilitates the detection of early warning signs of a disaster. Meanwhile, as described above, enormous efforts and financial resources are being devoted to monitoring and maintenance.

[0012] Each of patent documents 1 to 3 describes an offset of an analysis point obtained from SAR images and a method for accurately analyzing the offset. Patent document 3 also describes a method for obtaining an infrastructure-inherent hazard from the SAR image analysis. The hazard identification method described in patent document 3 includes a mechanism for defining a location (area) to be monitored and for monitoring that location.

[0013] However, a search to determine which type of repair work is required at which location—that is, a search in a SAR image dataset for a potential repair location—cannot be performed using the hazard determination method described in Patent Document 3. Similarly, Patent Documents 1 and 2 also contain no indication of a mechanism for, for example, searching for a potential repair location. The inventor considers that if the potential repair location can be identified from the SAR image dataset, not only details of the required repair, but also a location that urgently needs inspection and a location that needs repair can be identified from a large number of analysis points obtained through SAR image analysis, thus allowing, for example, their urgency and relative importance to be determined earlier. Brief description of the invention

[0014] The present invention was developed with regard to the aforementioned problem, and it is an object of the invention to provide a SAR image analysis system configured to search the SAR image data set for a candidate site to be repaired.

[0015] According to the present invention, a SAR image analysis system is provided, comprising: a storage unit configured to store a SAR image data set comprising multiple SAR images obtained by observing an observation area and whose acquisition time differs, and a sensor observation data set obtained by a sensor array configured to perform an observation with respect to known coordinates within the observation area; an interferometric analysis unit configured to perform an interferometric analysis with respect to the multiple SAR images in order to obtain interferometric analysis result data;and a repair work estimation unit configured to: extract a correlation between an offset of each of the analysis points contained in the interferometric analysis result data and each observation data element for each set of observation coordinates contained in the sensor observation dataset; estimate a cause of the offset of each of the analysis points contained in the interferometric analysis result data based on a correlation under a presence or absence, a breakdown, a breakdown measure and a breakdown type, or a combination thereof; and extract a repair work type that is related to an estimate of the cause of the offset with respect to a location of a large-offset analysis point among the respective analysis points, or with a structure or topography that features the large-offset analysis point.

[0016] Furthermore, a method is provided that is executed by an information processing resource configured to analyze SAR images to identify a location where repair work is required from the respective analysis points, wherein the method comprises the steps of: receiving a SAR image dataset containing multiple SAR images obtained by observing an observation area, and a sensor observation dataset obtained by a sensor array configured to perform an observation with respect to known coordinates within the observation area; performing an interferometric analysis with respect to the multiple SAR images to obtain interferometric analysis result data;Extracting a correlation between an offset of each of the analysis points contained in the interferometric analysis result data and each observation data element for each set of observation coordinates contained in the sensor observation dataset; estimating a cause of the offset of each of the analysis points contained in the interferometric analysis result data based on a presence or absence, a breakdown, a breakdown measure or a breakdown type of correlation, or a combination thereof; and extracting a repair work type that is related to an estimated cause of the offset with respect to a location of a large-offset analysis point among the respective analysis points, or to a structure or topography that hosts the large-offset analysis point.

[0017] Furthermore, a storage medium is provided on which a SAR image analysis program is stored, causing an information processing resource to operate as: an interferometric analysis device for performing an interferometric analysis with respect to a SAR image dataset containing multiple SAR images obtained by observing an observation area to obtain interferometric analysis result data; and a repair work-type estimation device for: extracting a correlation between an offset of each of the analysis points contained in the interferometric analysis result data and each observation data element for each set of observation coordinates contained in a sensor observation dataset obtained from a sensor device group configured to perform an observation with respect to known coordinates within the observation area;Estimating a cause of the offset of each of the analysis points included in the interferometric analysis result data based on a correlation under a presence or absence, a breakdown, a breakdown measure and a breakdown type, or a combination thereof; and extracting a repair work type that is related to an estimated cause of the offset with respect to a location of an analysis point with a large offset among the respective analysis points, or with a structure or topography that features the analysis point with a large offset. Effect of the invention

[0018] According to one embodiment of the present invention, a SAR image analysis system can be provided that is configured to search a SAR image data set for a candidate area to be repaired. Brief description of the drawings Fig. Figure 1 shows a configuration diagram for representing a SAR image analysis system 1 according to a first embodiment of the present invention; Fig. Figure 2 shows an explanatory table illustrating an example of a correlation between an offset (offsets) of a SAR analysis point (of SAR analysis points), a measurement type (measurement types), an estimated event and a repair work type according to an embodiment of the present invention; Fig. Figure 3 shows an example of a flowchart related to a repair work type estimation process performed by the SAR image analysis system 1 according to the first embodiment of the present invention; Fig. Figure 4 shows a configuration diagram for representing a SAR image analysis system 2 according to a second embodiment of the present invention; Fig. Figure 5 shows an example of a flowchart related to a repair work type estimation process performed by the SAR image analysis system 2 according to the second embodiment of the present invention; Fig. Figure 6 shows a configuration diagram for representing a SAR image analysis system 3 according to a third embodiment of the present invention; Fig. Figure 7 shows an example of a flowchart related to a repair work type estimation process performed by the SAR image analysis system 3 according to the third embodiment of the present invention; Fig. Figure 8 shows a configuration diagram for representing a SAR image analysis system 4 according to a fourth embodiment of the present invention; Fig. Figure 9 shows an example of a flowchart related to a repair work type estimation process performed by the SAR image analysis system 4 according to the fourth embodiment of the present invention; Fig. Figure 10 shows an explanatory diagram to provide an overview of how the SAR image analysis system is used in one embodiment of the present invention; and Fig. Figure 11 shows a block diagram illustrating an example of a configuration of the SAR image analysis system according to an embodiment of the present invention. Description of embodiments

[0019] Embodiments of the present invention are described below with reference to the drawings. First embodiment

[0020] Fig. Figure 1 shows a configuration diagram for representing a SAR image analysis system 1 according to a first embodiment of the present invention. The SAR image analysis system 1 analyzes an image data set using an image data set of the same observation point, acquired by the SAR at different acquisition times, and a sensor observation data set acquired by a sensor array.

[0021] The SAR image analysis system 1 according to the first embodiment comprises an interferometric analysis unit 10, a repair work estimation unit 20, and a storage unit 30. The storage unit 30 stores and holds a SAR image data set (multiple SAR image data sets) with a time sequence spanning at least one image analysis period (evaluation period), obtained from SAR observation waves acquired, for example, by a satellite equipped with the SAR. Each of the SAR image data elements is obtained by observing an observation area at different times, for example, by the satellite. The SAR image analysis system 1 can receive the SAR image data set for the evaluation period in any manner. For example, the SAR image analysis system 1 can download the SAR image data set via a communication network or read the SAR image data set from a storage medium on which the SAR image data set is stored.

[0022] Storage unit 30 further stores a sensor observation data set received from the sensor array group deployed in the observation area, and coordinates of each sensor array in the sensor array group, mapped to the others. The sensor observation data set is managed by linking it to the coordinates of an observation location for each of the sensor arrays, which are installed at different locations in real space. The coordinates are intended to correspond to spatial coordinates within the observation area, which are used to analyze the SAR image data set. Each of the sensor arrays is not necessarily limited to a sensor array installed for, say, disaster relief purposes, and could, for example, be an existing IoT (Internet of Things) device already installed for a purpose other than disaster relief.The sensor observation dataset can primarily consist of sensor observation data obtained, for example, from sensor devices (or a group of sensor devices) (e.g., a water level indicator, a humidity meter, a thermometer, and a vibrometer, depending on the details to be monitored) for areas and buildings to be monitored (e.g., near a river, an embankment, an underground construction site, and a high-rise construction site). There is no particular restriction on the method for collecting the sensor observation dataset. For example, the SAR image analysis system 1 can collect the sensor observation dataset via a mobile communications network, a satellite link, or the internet and accumulate the sensor observation dataset in the storage unit 30.In another case, after the sensor observation data set has been manually collected from each of the sensor devices, the SAR image analysis system 1 can receive the sensor observation data set and accumulate the sensor observation data set in the storage unit 30.

[0023] The interferometric analysis unit 10 performs an interferometric analysis of the SAR image dataset to obtain interferometric analysis result data. By performing the interferometric analysis, the SAR image analysis system 1 derives an offset of each of the same analysis points in different SAR images with respect to an analysis point contained as a reference in a SAR image set within an analysis area of ​​the SAR image dataset being analyzed.

[0024] Repair work estimation unit 20 extracts a correlation between time sequence offsets of each of the analysis points contained in the interferometric analysis result data and time sequence data with respect to each observation data element for each set of observation coordinates contained in the sensor observation dataset, and estimates a cause for the offset of each of the analysis points. Repair work estimation unit 20 further extracts at least one repair work type associated with an estimate of the cause of the offset with respect to a location of an analysis point with a large offset among the respective analysis points, or a structure or topography that features the analysis point with a large offset.

[0025] As a method for estimating the cause of the displacement at each of the analysis points, the analysis can be performed in chronological order to derive the cause by using any information under a presence or absence, a collapse, a collapse measure, a collapse type of correlation, or a combination thereof. For example, it is known that at a landslide hazard site, the groundwater level changes as one of the preceding events of a large-scale collapse.By implementing a relationship between the offset of each of the analysis points and an event (cause) in the SAR image analysis system 1, for example in a case where the offset(s) of a given corner reflector (given corner reflectors) (analysis point(s)) installed on a mountain surface is (are) detected, it is possible, when the correlation between a time sequence relationship of the offset (offsets) and time sequence offsets of the measured value of the water level indicator (sensor device) installed nearby breaks down, to estimate (extract) the offset of the corner reflector (corner reflectors) as an analysis point (as analysis points) to be perceived from the viewpoint (viewpoints) of the landslide (landslides).If one or more water content gauges are located nearby as another type of sensor device(s), it is possible to estimate (extract) whether the offset of the corner reflector(s) represents an analysis point(s) to be detected from the viewpoint of the landslide, based on the correlation between water level fluctuations, the water content gauge in the ground, and the offset of the corner reflector(s). One or more precipitation gauges (sensor devices) can be added to the SAR image analysis system 1 to analyze the correlation, either instead of or in addition to the water content gauge(s).Furthermore, if a soil surface variation (soil surface variations) (offset of the analysis point (analysis points) is greater than or equal to a predefined offset measure and / or greater than or equal to a predefined velocity) and a change in water level (water levels) (variation in the individual observation data) or a change in water content (in the water contents) (variation in the individual observation data) occur almost simultaneously at the observation coordinates assigned to the analysis point (analysis points), the SAR image analysis system 1 can estimate (discriminatively identify) a loosening of the relevant soil, a deep landslide, or a shallow landslide as the cause of the offset of the analysis point.The SAR image analysis system 1 can also estimate the cause of the offset of the analysis point(s) as aging of a road surface, bridge, or similar infrastructure structure based on a correlation breakdown between the vibrometer(s) assigned to the respective analysis points and a ground offset (offset(s) of the analysis point(s)). Regarding individual events that are supposed to be the cause of the offset of the analysis point(s), not only is such a known relationship between an offset phenomenon and an occurrence phenomenon implemented in the SAR image analysis system 1 as the aforementioned relationship for a large-scale breakdown, but a machine learning result of a relationship between an offset phenomenon that occurred in the past and the sensor observation dataset can also be included in estimation conditions.As the observational data (observational dataset) (observational sensor(s)) that is (are) assigned to each of the analysis points, for example, observational data (observational dataset) (observational sensor(s)) that is (are) physically installed in a freely defined area, at the same height or on a similar layer can be freely assigned, and observational data (an observational dataset) (observational sensor(s)) that has a high degree of association can also be automatically assigned by machine learning.In this way, it is sufficient for the repair work estimation unit 20 to estimate the cause of the offset (offsets) of the analysis point (offsets) in addition to, for example, the correlation breakdown between the offset of the position of each observation point contained in the interferometric analysis result data and in the sensor observation data set, by combining, as required, a behavior that deviates from a nominal value with respect to previous data regarding an observation data set of a sensor (of sensors) and whether or not a tendency similar to a previous offset event (previous offset events) of the sensor observation data set.The Repair Work Estimator 20 also extracts a correlation between time-sequence offsets of the corner reflector(s) and time-sequence data with respect to each sensor observation data element (sensor observation dataset) for each set of observation coordinates and estimates the cause of a single event using any information under a presence or absence, a breakdown, a breakdown measure, and a breakdown type of correlation, or a combination thereof. The Repair Work Estimator 20 need not always limit the number of causes for the offset of the analysis point to one. For example, the Repair Work Estimator 20 may estimate at least two events as the causes or may limit the causes in a multi-stage manner.

[0026] Repair Work Estimation Unit 20 also extracts the repair work type that is related to the estimated cause of the displacement with respect to the location of the analysis point(s) with a large displacement among the respective analysis points, or with the structure or topography that hosts the analysis point(s) with a large displacement. This extraction can be performed using database or tabular information where a pre-extracted repair work type and the estimated event are mapped. In the landslide example mentioned above, the repair work type is trench work. If it can be estimated that loosening due to water is strongly suspected, Repair Work Estimation Unit 20 can additionally extract a limiting work type, such as drainage reinforcement work or soil retention work.For example, if it can be estimated that a ground depression or subsidence is strongly suspected, the repair work estimation unit extracts 20 ground improvement works, reinforcement works, or other such repair work types corresponding to the event in question. The repair work type derived from the correlation between the offset of the analysis point with respect to a bridge or steel tower in a mountainous area and the nearby sensor equipment group, for example, would be bridge work or electrical work.

[0027] The derived repair work type and the location of the repair work types can be communicated, for example, to relevant responsible organizations, relevant information processing systems and relevant persons (e.g., companies, administrators, residents, a nationwide emergency warning system and freely selectable service systems).

[0028] Fig. Figure 2 shows several examples of a relationship between an offset of a SAR analysis point (of SAR analysis points), a sensor device type (measurement type), an estimated event (cause), and the repair work type. As shown in Fig. As shown in Figure 2, in SAR image data analysis the offset of each of the analysis points and each observation data element contained in the interferometric analysis result data with respect to each set of observation coordinates contained in the sensor observation data set is read, and the cause of the offset of each of the analysis points is estimated based on a correlation between them in order to extract the repair work type.

[0029] A SAR image analysis method using the SAR image analysis system 1 according to the first embodiment is described below.

[0030] Fig. Figure 3 shows an example of a flowchart related to a repair work type estimation process performed by the SAR image analysis system 1 according to the in Fig. The first embodiment shown in 1 is carried out.

[0031] First, the SAR image analysis system 1 receives the SAR image data set obtained by observing an observation area and the sensor observation data set with respect to the sensor device group and accumulates the SAR image data set and the sensor observation data set in the storage unit 30 (step S101).

[0032] Subsequently, the SAR image analysis system 1 (interferometric analysis unit 10) reads the SAR image data set to be analyzed from the storage unit 30 and performs an interferometric analysis of the SAR image data set to obtain the interferometric analysis result data (step S102). The interferometric analysis result data includes at least the position of each of the extracted analysis points and information about the offset.

[0033] Subsequently, the SAR image analysis system 1 (repair work estimation unit 20) extracts the correlation between the offset of each of the analysis points contained in the interferometric analysis result data obtained by the interferometric analysis unit 10 through analysis and each observation data element with respect to each set of observation coordinates contained in the sensor observation data set (step S103).

[0034] Subsequently, the SAR image analysis system 1 (repair work estimation unit 20) estimates the cause of the offset of each of the analysis points based on information regarding the presence or absence of a correlation breakdown, a breakdown measure, and a breakdown type, or a combination thereof (step S104). By estimating the cause of the offset, the SAR image analysis system 1 can predict the cause of the offset of the analysis point(s) that occurs among the SAR image data that have undergone analysis.

[0035] Subsequently, the SAR image analysis system 1 (repair work estimation unit 20) extracts at least the repair work type that is related to the estimation result of the cause of the offset in relation to the location of the analysis point(s) with a large offset below the respective analysis points or the structure(s) or topography(ies) containing the analysis point(s) with a large offset below the respective analysis points (step S105).

[0036] By operating in the manner described above, the SAR image analysis system 1 can perform a SAR image analysis that includes a search for a job candidate requiring repair. The SAR image analysis identifies the repair work type and the location of the event as a search result for the job candidate requiring repair. An operator uses the search result for the job candidate requiring repair to be able to reduce the time it takes to investigate a target appearing in the SAR image analysis result and to begin the actual repair at an early stage.

[0037] Several embodiments are described next. The embodiments described below can be combined as needed. Descriptions of components and operations that have already been described are simplified or omitted. Second embodiment

[0038] Fig. Figure 4 shows a configuration diagram for representing a SAR image analysis system 2 according to a second embodiment of the present invention. In addition to the configuration of the first embodiment, the SAR image analysis system 2 stores a repairer database in the storage unit 30 and has a mechanism that causes the repair work estimation unit 20 to communicate the SAR image analysis result to the respective repairer.

[0039] In the same way as in the first embodiment, the SAR image analysis system 2 according to the second embodiment comprises the interferometric analysis unit 10, the repair work estimation unit 20 and the storage unit 30.

[0040] Storage unit 30 stores the repairer database along with the SAR image dataset and the sensor observation dataset. The repairer database contains at least several repairers with contact information or similar information associated with the repair work type. The repair work type contained in the repairer database corresponds to the repair work type extracted by repair work estimation unit 20. The repairer database is structured, for example, as a list for managing registered companies and selected business units, such as the multiple repairers.

[0041] The interferometric analysis unit 10 acquires the interferometric analysis result data as described in the first embodiment.

[0042] Repair work estimation unit 20 extracts a correlation between the offsets of each of the analysis points contained in the interferometric analysis result data and each data element with respect to observation data for each set of observation coordinates contained in the sensor observation dataset, and estimates a cause of the offset of each of the analysis points. Repair work estimation unit 20 further extracts at least one repair work type that is related to an estimate of the cause of the offset with respect to a location of your analysis point(s) with a large offset among the respective analysis points, or with a structure (structures) or topography (topographies) that contains the analysis point with a large offset.Additionally, the Repair Work Estimation Unit 20 references the repairer database to transmit a notification, based on the extracted repair work type, to a pre-registered registrant of the corresponding repairer. This notification contains the extracted repair work type(s) and the location(s) of the analysis point(s), with a large offset. The notification is then provided to the registrant, such as a sales or administrative department of the repairer, to support the repairer's business activities. For example, the registrant who receives the notification receives information related to future maintenance or repair work, facilitating business planning regarding, for instance, the provision of necessary personnel and materials.

[0043] Next, the operation of the SAR image analysis system 2 according to a second embodiment is described.

[0044] Fig. Figure 5 shows an example of a flowchart related to a repair work type estimation process performed by a SAR image analysis system 2 according to the second embodiment. The process from step S101 to step S105 is the same as the process performed in the SAR image analysis system 1.

[0045] Following step S105, the SAR image analysis system 2 (repair work estimation unit 20) refers to the repairer database to extract the repairer associated with the repair work type(s) derived in step S105 and transmits the message containing the estimated repair work type(s) and the position(s) of the analysis point(s) that has a large offset to the registrant (group of registrants) that is pre-registered (step S106).

[0046] The SAR image analysis system 2 according to the second embodiment can automatically inform the individual repair companies of the scope of work in addition to searching for the job candidate to be repaired. Third embodiment

[0047] Fig. Figure 6 shows a configuration diagram for representing a SAR image analysis system 3 according to a third embodiment of the present invention. In addition to the configuration of the second embodiment, the SAR image analysis system 3 includes an administrator database and a repair site administrator identification unit 40.

[0048] Storage unit 30 stores the administrator database along with the SAR image dataset, the sensor observation dataset, and the maintenance database. The administrator database lists, stores, and manages, for example, the spatial coordinates and administrator data of the structure(s) or topography to be monitored and any area(s) to be monitored, which were registered in advance. The administrator data referred to here includes, for example, a designation, name, contact information, and similar information regarding a government agency or self-governing municipality that manages infrastructure, a building owner, or a similar party. Furthermore, a business unit responsible for maintenance can be registered in conjunction with, in addition to, or instead of the aforementioned information.For example, a responsible department of a municipal administration is registered as the administrator data for a bridge managed by the municipal administration, and an administrative office or owner is registered as the administrator data for a private entity. The type of repair work to be carried out (contact person) can also be registered in the administrator database if needed. By performing a reverse search for the registered administrator, the SAR image analysis system 3 can locate a notification target for a repair location in the administrator database.

[0049] The repair site manager identification unit 40 references the manager database to extract, for example, the location of the analysis point with a large offset in the interferometric analysis result data, or the structure or topography to be monitored, or the area to be monitored that contains the analysis point with a large offset, as a repair site candidate, and captures the extracted repair site candidate and the manager as the notification target information. At this point, in a case where the repair work type to be performed is pre-registered in the manager database, if the repair work type identified by the repair work estimation unit 20 is the aforementioned repair work type, the repair site manager identification unit 40 captures its assigned manager as the notification target information.With regard to the job candidate to be repaired, as recorded in the notification target information, the repair job manager identification unit 40 also issues a job candidate notification to the appropriate manager. The job candidate notification includes, as details, the repair job type or similar information identified by the repair job estimation unit 20. The job candidate notification may also include, as details, the repair company identified by the repair job estimation unit 20.

[0050] Next, a processing of a repair work type estimation process is described, which is carried out by the SAR image analysis system 3 according to the third embodiment.

[0051] Fig. Figure 7 shows an example of a flowchart related to a repair work type estimation process performed by the SAR image analysis system 3 according to the third embodiment. The process from step S101 to step S102 is the same as the process performed in SAR image analysis systems 1 and 2.

[0052] Following step S102, the SAR image analysis system 3 (repair site manager identification unit 40) refers to the manager database to extract, for example, the location of the analysis point with a large offset in the interferometric analysis result data or of the structure or topography or area to be monitored that contains the analysis point with a large offset as the repair site candidate (step S201).

[0053] Subsequently, the SAR image analysis system 3 (repair site manager identification unit 40) identifies the manager of each repair site in relation to the extracted site candidate to be repaired (step S202).

[0054] Subsequently, the SAR image analysis system 3 (repair site manager identification unit 40) recommends notifying the relevant manager about the site candidate to be repaired (step S203).

[0055] In this way, according to the third embodiment, the SAR image analysis system 3 can identify and notify the repair site manager in addition to searching for the site candidate to be repaired. Fourth embodiment

[0056] Fig. Figure 8 shows a configuration diagram for a SAR image analysis system 4 according to a fourth embodiment of the present invention. In addition to the configuration of the third embodiment, the SAR image analysis system 4 includes a unit 50 for extracting an inspection urgency level. Furthermore, in the fourth embodiment, the storage unit 30 appropriately stores a database of a geographic information system (GIS). The GIS database contains the spatial coordinates of, for example, the topography, a plant area, and an artificial structure as geographic spatial information for a GIS. The GIS database (geographic spatial information for a GIS) need not always be integrated into the SAR image analysis system. The geographic spatial information for a GIS can optionally be accessed via a network.

[0057] Unit 50 for extracting a review urgency level uses a determining condition, exemplified below, to specify one or more analysis points with a high review urgency level. Unit 50 for extracting a review urgency level specifies as the analysis point (or points) with a high review urgency level such that the offset of the analysis point (or points) per unit time in the interferometric analysis result data has increased by a measure greater than or equal to a specified measure than an average of the offset of the analysis point (or points) per unit time in the past.In another case, the unit 50 for extracting a review urgency level 50 can specify an analysis point (or points) with a high review urgency level where the offset of the analysis point (or points) per unit of time has reversed from the offset of the analysis point (or points) per unit of time in the past. Similarly, the unit 50 for extracting a review urgency level can specify an analysis point (or points) with a high review urgency level where the offset of the analysis point (or points) per unit of time has fallen out of correlation with the offset of an analysis point (or points) around the analysis point (or points) per unit of time.Similarly, unit 50 for extracting audit urgency levels can specify an analysis point(s) with a high audit urgency level where the offset of the analysis point(s) per unit time has fallen out of correlation with the observation data of each set of observation coordinates contained in the sensor observation dataset that exhibits a correlation. These conditions for identifying the analysis point(s) with a high audit urgency level are merely examples, and it is desirable to configure the system so that the aforementioned determining conditions indicating that the audit urgency level is high can be combined or added as needed.Unit 50, for extracting an audit priority level, uses the identified analysis points with a high audit priority level to rank the analysis points based on their respective audit priority levels. Additionally, Unit 50 can rank objectives that exhibit the identified analysis points with a high audit priority level based on their respective audit priority levels.

[0058] When referring to the GIS database, Unit 50 can, for example, extract a topography, plant area or artificial structure that has the analysis point(s) with a high level of review urgency from the GIS database and identify the extracted target (for example, topography) as a geographic target with a high level of review urgency.

[0059] Furthermore, Unit 50 can reference the GIS database to extract a group of analysis points contained within an area of ​​the geographic target for which a high audit priority level has been determined, and classify the degree of abnormality of the analysis point(s) for which a high audit priority level has been determined within the geographic target. As a classification of the degree of abnormality, Unit 50 can, for example, perform a trend analysis on an analysis point for which a high audit priority level has been determined and the other analysis points contained in the extracted group of analysis points together, and obtain the degree of abnormality of the analysis point for which a high audit priority level has been determined within the geographic target.In another case, for example, if several analysis points for which a high audit urgency level has been determined are located close together, the unit 50 for extracting an audit urgency level can treat the several analysis points for which a high audit urgency level has been determined in close proximity as a group and perform a trend analysis jointly with respect to the several analysis points and the other analysis points contained in the extracted analysis point group in order to obtain the abnormality level.

[0060] Next, the operation of the SAR image analysis system 4 according to the fourth embodiment is described.

[0061] Fig. Figure 9 shows an example of a flowchart related to a repair work type estimation process performed by the SAR image analysis system 4 according to the fourth embodiment. The process from step S101 to step S102 is the same as the process performed by the SAR image analysis systems 1 to 3.

[0062] After step S102, the SAR image analysis system 4 (unit 50 for extracting an audit urgency level) refers to the administrator database to analyze an offset velocity of each of the analysis points (step S301).

[0063] Subsequently, the SAR image analysis system 4 (unit 50 for extracting an inspection urgency level) orders the analysis points in descending order starting from the analysis point with a larger change in offset speed as the point to be inspected with a high inspection urgency level (step S302).

[0064] Subsequently, the SAR image analysis system 4 (repair site manager identification unit 40) outputs details of the job candidate to be inspected by inserting the details into the job candidate to be repaired notice in descending order from a high-priority job candidate (step S303).At this point, when the SAR Image Analysis System 4 issues the notification about the job candidate to be repaired to each administrator, if a repair work type is required, the analysis point with a high level of review urgency, and as a result a trend analysis performed with respect to the analysis point with the high level of review urgency assigned to the job candidate to be repaired, the SAR Image Analysis System 4 can recommend any information under the repair work type, the analysis point and the result by inserting any information under the repair work type, the analysis point and the result into the notification about the job candidate to be repaired to each administrator.

[0065] In this way, the SAR image analysis system 4 according to the fourth embodiment can order the repair locations in addition to searching for the location candidate to be repaired.

[0066] As in Fig. As shown in Figure 10, the SAR image analysis system can be configured to receive SAR observation data remotely measured by a satellite-mounted SAR and transmitted to a ground station, and to receive observation data sets from various ground-based sensor devices via a communication network. The SAR can be mounted on an aircraft or a drone. This SAR image analysis system extracts analysis points from a large number of ground-based reflective reference points and a large number of freely available reflective reference points, and predicts the cause of any shift in the analysis points based on a correlation between the analysis points and each observation data set. Subsequently, the SAR image analysis system estimates the position (location) and the required type of repair work, providing useful information for maintenance.

[0067] Furthermore, this SAR image analysis system can recommend the administrator to be identified and the level of urgency to the persons concerned.

[0068] The individual units of the SAR image analysis system can be implemented using a combination of hardware and software of a computer system, as described in Fig.Figure 11 is an example. This computer system contains one or more processors and memory, these components being suitable for a desired form. In the present form of the computer system, the respective units can be implemented by loading a program for SAR image analysis into the aforementioned memory and causing the one or more processors, or other suitable hardware, to be controlled by an execution instruction set and a code set based on this program. In this case, this program can, as required, implement the respective units in conjunction with functions provided by the operating system, a microprogram, a driver, or similar software.

[0069] Program data to be loaded into memory includes the execution instruction group and the code group to instruct the processor to operate as one or more of the aforementioned respective units, and optionally a table file and content data.

[0070] Furthermore, this computer system does not always have to be constructed as a single device, but can be designed by combining multiple servers, computers, and virtual machines as a so-called thin client, distributed computing, or cloud computing system. Some or all of the respective units of the computer system can also be replaced by hardware or firmware (for example, a combination of one or more LSI (Large Scale Integration) components, one or more field-programmable gate arrays (FPGAs), and one or more electronic elements). Likewise, only some of the respective units can be replaced by hardware or firmware.

[0071] Furthermore, this program can be stored on a non-volatile storage medium for distribution. The program stored on the storage medium is read into memory via a wired or wireless connection, or via the storage medium itself, to operate the processor or similar hardware.

[0072] In this description, the term "storage medium" is understood to include a data carrier, a storage device, and a storage unit. Examples of storage media include an optical disk, a magnetic disk, a semiconductor storage device, a hard disk drive, and tape. It is also desirable that the storage medium be non-volatile. Furthermore, a combination of a volatile module (for example, random-access memory (RAM)) and a non-volatile module (for example, read-only memory (ROM)) can be used as a storage medium.

[0073] The embodiments of the present invention are described below by way of example. However, specific configurations of the present invention are not limited to the embodiments mentioned above, and modifications are possible within the scope of the invention. For example, modifications such as separating and joining block components and switching processing steps may be freely implemented, as long as the purpose and the aforementioned functions of the present invention are fulfilled, and the present invention is not intended to be limited by the foregoing description.

[0074] Furthermore, some or all of the aforementioned embodiments may also be described as follows. It should be noted that the present invention is not intended to be limited by the following remarks. Supplementary Note 1

[0075] A comprehensive SAR image analysis system: a storage unit configured to store a SAR image data set containing multiple SAR images obtained by observing an observation area and differing in acquisition time, and a sensor observation data set obtained from a sensor facility group configured to perform an observation with respect to known coordinates within the observation area; an interferometric analysis unit configured to perform an interferometric analysis of the multiple SAR images in order to obtain interferometric analysis result data; and a repair work estimation unit configured for this purpose: to extract a correlation between an offset of each of the analysis points contained in the interferometric analysis result data and each observation data element for each set of observation coordinates contained in the sensor observation data set; to estimate a cause of the offset of each of the analysis points included in the interferometric analysis result data based on any of the following: presence or absence, breakdown, breakdown measure and breakdown type of correlation, or a combination thereof; and to extract a repair work type that is related to an estimated cause of the offset in relation to a location of an analysis point with a large offset among the respective analysis points, or to a structure or topography that features the analysis point with a large offset. Supplementary Note 2

[0076] The SAR image analysis system according to Supplementary Note 1, which further includes a repairer database configured to store multiple repairers pre-registered in association with the repair work type, wherein the repair work estimation unit, based on the repairer database, issues a message containing the extracted repair work type and the position of the analysis point with a large offset, based on the extracted repair work type, to one of the several appropriate repairers. Supplementary Note 3

[0077] The SAR image analysis system according to supplementary note 1 or 2, further comprising: an administrator database configured to store administrator data that has been pre-registered in association with each structure and / or topography and / or area to be monitored, together with each spatial coordinate of the structure and / or topography and / or area to be monitored; and a repair site manager identification unit configured to extract a location of the analysis point with a large offset in the interferometric analysis result data or of the structure and / or topography and / or area to be monitored that contains the analysis point as a repair site candidate and, based on the manager database, to transmit a notification about the repair site candidate to the manager assigned to the extracted repair site candidate. Supplementary note 4

[0078] The SAR image analysis system according to any of Supplementary Notes 1 to 3, which further comprises a unit for extracting a review urgency level configured to identify as a high review urgency analysis point any of the following: an analysis point whose offset per unit time in the interferometric analysis result data has become greater than the offset per unit time of the analysis point in the past; an analysis point whose offset per unit time has inverted with respect to the offset per unit time of the analysis point in the past; an analysis point whose offset per unit time has fallen out of correlation with the offset of an analysis point around the analysis point per unit time; and an analysis point whose offset per unit time has fallen out of correlation with each observation data element of each set of observation coordinates.to identify those contained in the sensor observation dataset with a correlation that have fallen out, or a combination thereof. Supplementary note 5

[0079] The SAR image analysis system according to Supplementary Note 4, which further comprises a GIS database configured to store geographic spatial information for a geographic information system (GIS) for storing spatial coordinates of a topography and / or plant area and / or artificial structure, wherein the unit for extracting an audit priority level is configured to reference the GIS database to extract a topography and / or facility area and / or artificial structure containing the analysis point with a high audit priority level, and to identify the extracted topography and / or facility area and / or artificial structure as a geographic target with a high audit priority level. Supplementary Note 6

[0080] SAR image analysis system according to Supplementary Note 5, wherein the unit for extracting an audit urgency level is configured to reference the GIS database to extract an analysis point group contained within an area of ​​the geographic target for which a high audit urgency level has been determined, and to perform a trend analysis on the analysis point for which a high audit urgency level has been determined and on the extracted analysis point group together to classify an abnormality level of the analysis point for which a high audit urgency level has been determined within the geographic target. Supplementary note 7

[0081] The SAR image analysis system according to one of the supplementary notes 1 to 6, wherein spatial coordinates within the observation area are assigned to the sensor observation data set, which are used when the multiple SAR images are analyzed by the interferometric analysis unit, and where the spatial coordinates correspond to the coordinates at which each of the sensor devices included in the sensor device group is installed. Supplementary Note 8

[0082] The SAR image analysis system according to Supplementary Note 3, wherein the repair site manager identification unit is configured to transmit, when the notification about a job candidate to be repaired is transmitted to a manager, if any under a repair work type, a high-urgency analysis point, and a result of a trend analysis performed with respect to the high-urgency analysis point associated with the job candidate to be repaired is communicated, which any under the repair work type, the analysis point, and the result is transmitted by inserting the repair work type, the analysis point, and the result into the notification about the job candidate to be repaired to the manager. Supplementary note 9

[0083] A procedure to be executed by an information processing resource configured to analyze SAR images to identify a location requiring repair work types among the respective analysis points, wherein the procedure comprises the following steps: Receiving a SAR image dataset containing multiple SAR images obtained by observing an observation area, and a sensor observation dataset obtained from a sensor facility group configured to perform an observation at known coordinates within the observation area; Performing an interferometric analysis of the multiple SAR images to obtain interferometric analysis result data; Extracting a correlation between an offset of each of the analysis points contained in the interferometric analysis result data and each observation data element for each set of observation coordinates contained in the sensor observation data set; Estimating a cause of the offset of each of the analysis points included in the interferometric analysis result data based on any presence or absence, breakdown, breakdown measure, and breakdown type of correlation, or a combination thereof; and Extracting a repair work type that is related to an estimated cause of the offset in relation to a location of an analysis point with a large offset among the respective analysis points, or to a structure or topography that features the analysis point with a large offset. Supplementary Note 10

[0084] A storage medium on which a SAR image analysis program is stored, causing an information processing resource to operate as: an interferometric analysis device for performing an interferometric analysis of a SAR image dataset comprising multiple SAR images obtained by observing an observation area in order to obtain interferometric analysis result data; and a repair work type estimation device for: Extracting a correlation between an offset of each of the analysis points contained in the interferometric analysis result data and each observation data element for each set of observation coordinates contained in a sensor observation dataset obtained from a sensor facility group configured to perform an observation with respect to known coordinates within the observation area; Estimating a cause of the offset of each of the analysis points included in the interferometric analysis result data based on any presence or absence, breakdown, breakdown measure, and breakdown type of correlation, or a combination thereof; and Extracting a repair work type that is related to an estimated cause of the offset in relation to a location of a large offset analysis point among the respective analysis points, or to a structure or topography that features the large offset analysis point.

[0085] The aforementioned SAR image analysis system can, for example, be operated as an infrastructure repair recommendation system configured to notify a self-governing community or the owner of a building or other facility that has pre-subscribed to a relevant service about the site candidate for repair when an urgent hazard to an administrator's objective or a change from a normal offset is detected.

Claims

[1] SAR image analysis system with: a storage unit configured to store a SAR image data set containing multiple SAR images obtained by observing an observation area and differing in acquisition time, and a sensor observation data set obtained from a sensor facility group configured to perform an observation with respect to known coordinates within the observation area; an interferometric analysis unit configured to perform an interferometric analysis of the multiple SAR images in order to obtain interferometric analysis result data; and a repair work estimation unit configured for this purpose: to extract a correlation between an offset of each of the analysis points contained in the interferometric analysis result data and each observation data element for each set of observation coordinates contained in the sensor observation data set; to estimate a cause of the offset of each of the analysis points included in the interferometric analysis result data based on any of the following: presence or absence, breakdown, breakdown measure and breakdown type of correlation, or a combination thereof; and to extract a repair work type that is related to an estimated cause of the offset in relation to a location of an analysis point with a large offset among the respective analysis points, or to a structure or topography that features the analysis point with a large offset. [2] SAR image analysis system according to claim 1, further comprising a repairer database configured to store multiple repairers pre-registered in association with the repair work type, wherein the repair work estimation unit, based on the repairer database, issues a message containing the extracted repair work type and the position of the analysis point with a large offset to one of the multiple repairers. [3] SAR image analysis system according to claim 1 or 2, further comprising: an administrator database configured to store administrator data that has been pre-registered in association with each structure and / or topography and / or area to be monitored, together with each spatial coordinate of the structure and / or topography and / or area to be monitored; and a repair site manager identification unit configured to extract a location of the analysis point with a large offset in the interferometric analysis result data or of the structure and / or topography and / or area to be monitored that contains the analysis point as a repair candidate and, based on the manager database, to transmit a notification about the repair site candidate to the manager assigned to the extracted site candidate to be repaired. [4] SAR image analysis system according to claim 3, wherein the repair site manager identification unit is configured to transmit, when the notification about a job candidate to be repaired is transmitted to a manager, if any repair work type, analysis point with a high level of review urgency and result of a trend analysis performed with respect to the analysis point with a high level of review that is assigned to the job candidate to be repaired is communicated, any repair work type, analysis point and result is transmitted by inserting any repair work type, analysis point and result into the notification about the job candidate to be repaired to the manager. [5] SAR image analysis system according to any one of claims 1 to 4, further comprising a unit for extracting a test urgency level, configured to identify as a high test urgency analysis point any of the following: an analysis point whose offset per unit time in the interferometric analysis result data has become larger than the offset per unit time of the analysis point in the past; an analysis point whose offset per unit time has reversed with respect to the offset per unit time of the analysis point in the past; an analysis point whose offset per unit time has fallen out of correlation with the offset of an analysis point around the analysis point per unit time; and an analysis point whose offset per unit time has fallen out of correlation with each observation data element of each set of observation coordinates contained in the sensor observation data set with a correlation.to identify what has fallen out, or a combination thereof. [6] SAR image analysis system according to claim 5, further comprising a GIS database configured to store geographic spatial information for a geographic information system (GIS) for storing spatial coordinates of a topography and / or plant area and / or artificial structure, wherein the unit for extracting an audit priority level is configured to reference the GIS database to extract a topography and / or plant area and / or artificial structure containing the analysis point with a high audit priority level, and to identify the extracted topography and / or plant area and / or artificial structure as a geographic target with a high audit priority level. [7] SAR image analysis system according to claim 6, wherein the unit for extracting an audit urgency level is configured to reference the GIS database to extract an analysis point group contained in an area of ​​the geographic target for which a high audit urgency level has been determined, and to perform a trend analysis for the analysis point for which a high audit urgency level has been determined and for the extracted analysis point group together to classify an abnormality level of the analysis point for which a high audit urgency level has been determined within the geographic target. [8] SAR image analysis system according to any one of claims 1 to 7, where spatial coordinates within the observation area are assigned to the sensor observation dataset, which are used when the multiple SAR images are analyzed by the interferometric analysis unit, and where the spatial coordinates correspond to the coordinates at which each of the sensor devices included in the sensor device group is installed. [9] A method to be performed by an information processing resource configured to analyze SAR images to identify a location where repair work types are required among the respective analysis points, the method comprising the steps: Receiving a SAR image dataset containing multiple SAR images obtained by observing an observation area, and a sensor observation dataset obtained from a sensor facility group configured to perform an observation at known coordinates within the observation area; Performing an interferometric analysis on the multiple SAR images to obtain interferometric analysis result data; Extracting a correlation between an offset of each of the analysis points contained in the interferometric analysis result data and each observation data element for each set of observation coordinates contained in the sensor observation data set; Estimating a cause of the offset of each of the analysis points included in the interferometric analysis result data based on any presence or absence, breakdown, breakdown measure, and breakdown type of correlation, or a combination thereof; and Extracting a repair work type that is related to an estimated cause of the offset in relation to a location of an analysis point with a large offset among the respective analysis points, or to a structure or topography that features the analysis point with a large offset. [10] Storage medium on which a SAR image analysis program is stored, which causes an information processing resource to operate as: an interferometric analysis device for performing an interferometric analysis of a SAR image dataset comprising multiple SAR images obtained by observing an observation area in order to obtain interferometric analysis result data; and a repair work type estimation device for: Extracting a correlation between an offset of each of the analysis points contained in the interferometric analysis result data and each observation data element for each set of observation coordinates contained in a sensor observation dataset obtained from a sensor facility group configured to perform an observation with respect to known coordinates within the observation area; Estimating a cause of the offset of each of the analysis points included in the interferometric analysis result data based on any presence or absence, breakdown, breakdown measure, and breakdown type of correlation, or a combination thereof; and Extracting a repair work type that is related to an estimated cause of the offset in relation to a location of a large offset analysis point among the respective analysis points, or to a structure or topography that features the large offset analysis point.

Images