Information processing system, information processing method, and program

Abstract

In order to more suitably process information about a structure, an information processing system according to the present invention comprises: a displacement acquisition means which acquires a displacement of the structure on the ground surface; a sensor information acquisition means which acquires sensor information related to the surface of the structure; a state determination means which determines the surface layer state of the structure on the basis of the sensor information; and an information output means which outputs, for each section of the structure, the displacement and the surface layer state.

Description

Technical Field

[0001] The present invention relates to information processing, and particularly to information processing related to information on structures.

Background Art

[0002] Patent Document 1 discloses an analysis device that divides observation results of a synthetic aperture radar into a plurality of sections and determines the priority of each section using the state value of the section.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Observation results of a synthetic aperture radar are often difficult for non-experts to understand as they are.

[0005] An object of the present invention is to provide an information processing system or the like that makes it easier to process information on structures on the ground surface based on observation results of a synthetic aperture radar or the like.

Means for Solving the Problems

[0006] An information processing system according to one aspect of the present invention includes displacement acquisition means for acquiring displacement of a structure on the ground surface, sensor information acquisition means for acquiring sensor information related to the surface of the structure, state determination means for determining the surface state of the structure based on the sensor information, and information output means for outputting displacement and surface state for each section in the structure.

[0007] An information provision method in one embodiment of the present invention acquires the displacement of a structure on the ground surface, acquires sensor information related to the surface of the structure, determines the surface condition of the structure based on the sensor information, and outputs the displacement and surface condition for each section of the structure.

[0008] A recording medium in one embodiment of the present invention records a program that causes a computer to perform the following processes: acquiring the displacement of a structure on the ground surface; acquiring sensor information related to the surface of the structure; determining the surface state of the structure based on the sensor information; and outputting the displacement and surface state for each section of the structure. [Effects of the Invention]

[0009] Based on the present invention, it is possible to achieve the effect of making it easier to process information about structures more appropriately. [Brief explanation of the drawing]

[0010] [Figure 1] This is a block diagram showing an example of the configuration of an information processing system according to the first embodiment. [Figure 2] This is a block diagram showing an example of the configuration of an information provision system including an information processing system according to the second embodiment. [Figure 3] This is a flowchart showing an example of the operation of the information processing system according to the second embodiment. [Figure 4] This figure shows an example of how displacement and surface conditions are displayed for each section. [Figure 5] This figure shows an example of a detailed display of displacement and surface conditions. [Figure 6] This block diagram shows an example of the configuration of an information provision system including an information processing system according to the third embodiment. [Figure 7] This figure shows an example of the display of the third embodiment. [Figure 8] This figure shows an example of the display on a different day. [Figure 9] This figure shows an example of displaying displacement and deterioration over multiple days. [Figure 10] This figure shows an example of how to display detailed displacement information for multiple days. [Figure 11] This is a flowchart illustrating an example of the operation of the information processing system according to the third embodiment. [Figure 12] This block diagram shows an example of the hardware configuration of computer devices that make up an information processing system. [Figure 13] This is a conceptual diagram illustrating a specific example of an information provision system. [Modes for carrying out the invention]

[0011] Next, embodiments of the present invention will be described with reference to the drawings. However, the embodiments of the present invention are not limited to those shown in the drawings. Furthermore, the embodiments can be combined as appropriate.

[0012] <First Embodiment> A first embodiment of the present invention will be described with reference to the drawings. Figure 1 is a block diagram showing an example of the configuration of an information processing system 10 according to the first embodiment. The information processing system 10 includes a displacement acquisition unit 110, a sensor information acquisition unit 120, a state determination unit 130, and an information output unit 140. The displacement acquisition unit 110 acquires the displacement of a structure on the ground surface. The sensor information acquisition unit 120 acquires sensor information related to the surface of the structure. The state determination unit 130 determines the surface state of the structure based on the sensor information. The information output unit 140 outputs the displacement and surface state for each section of the structure. Each configuration will be described in more detail below. However, the following description is not limited to the first embodiment.

[0013] The displacement acquisition unit 110 acquires the displacement of the structure on the ground surface. The structure is, for example, a road, a bridge, a railway frame, a levee, a pier, a revetment, or a runway. The structure may include a plurality of structures such as roads and bridges. However, the structure is not limited thereto. For example, the displacement acquisition unit 110 analyzes the observation results by a ground surface observation system to acquire the displacement of the structure. The ground surface observation system is, for example, a system including an observation device for observing the ground surface such as a Synthetic Aperture Radar (SAR). The ground surface observation system will be further described later. Alternatively, the displacement acquisition unit 110 may acquire the displacement of the structure from the ground surface observation system. In the following description, these are collectively described as "the displacement acquisition unit 110 acquires the displacement of the structure on the ground surface".

[0014] The sensor information acquisition unit 120 acquires sensor information related to the surface of the structure. For example, the sensor information acquisition unit 120 acquires, as the sensor information, a surface image of a road photographed by a drive recorder mounted on a vehicle, or an acceleration measured by an accelerometer mounted on the vehicle. However, the sensor information is not limited to the above. Hereinafter, a device for acquiring sensor information such as a drive recorder is collectively referred to as a "sensor information acquisition device". The sensor information acquisition device and the sensor information will be further described later.

[0015] The state determination unit 130 determines the surface state of the structure based on the sensor information. Specifically, the state determination unit 130 determines the deterioration state of the surface. The "surface layer" of the structure is the range where the state can be confirmed from the surface of the structure. For example, the surface layer is the part including the surface and the range from the surface to a predetermined depth. For example, when the structure includes multiple layers, the surface layer is the surface layer of the structure or a predetermined layer including the surface layer. For example, when the structure is an asphalt-paved road, the surface layer is the asphalt layer. In the following description, the part excluding the surface layer of the structure is referred to as the "deep layer". For example, when the structure is an asphalt-paved road, the deep layer is the crushed stone layer, the roadbed, and the road body. However, the surface layer and the deep layer are not limited to the above. For example, when the structure is an asphalt-paved road, the surface layer may be the asphalt layer and the crushed stone layer.

[0016] The information output unit 140 outputs the displacement and the surface state for each section in the structure. For example, the information output unit 140 outputs the displacement and the surface state for each section to a display device (not shown), such as a terminal device including a liquid crystal display. The relationship between the information processing system 10 and the display device is not particularly limited.

[0017] A section is a range obtained by dividing the structure along a predetermined unit or type, such as a management unit of the structure, a determination unit of the state of the structure, a repair unit of the structure, or a combination thereof. For example, the section may be a section corresponding to the user's business or convenience. The section may be set not for the entire structure but for a partial range of the structure. For example, when the structure is a road, it is difficult to obtain the displacement in the range where street trees are planted. Therefore, for example, when the structure is a road, the section may be set in the range excluding the street trees where it is difficult to measure the displacement.

[0018] The plots may be of any shape. For example, a plot may be a rectangle, a triangle, or a polygon such as a hexagon. However, the shape of a plot is not limited to polygons. For example, a plot may be an area arbitrarily designated by the user. Also, at least some plots may have a different shape from other plots, or they may be of different sizes. Alternatively, a plot may have a shape where at least part of its perimeter is curved to match the terrain, such as a river. Thus, the shape and size of the plots are not limited. Furthermore, the shape and size of all plots may be the same, or at least some plots may have different shapes and sizes.

[0019] Alternatively, the information processing system 10 may acquire the shape and location of the structure, as well as instructions on how to set up partitions within the structure, and set up partitions based on these instructions. For example, if the structure is rectangular, the information processing system 10 may divide the structure using the specified number of vertical and horizontal sections to set up partitions. Alternatively, if the partition setting method is the vertical length and horizontal length of the partition, the information processing system 10 may sequentially set up rectangles as partitions, starting from any vertex of the structure, with the vertical and horizontal lengths included in the setting method. Furthermore, the information processing system 10 may calculate the position of each partition using the structure's location, vertical length, and horizontal length. In the following description, the information processing system 10 is assumed to have already saved the locations of the structure and partitions.

[0020] The displacement of structures obtained from the ground surface observation system can be difficult to understand directly. However, the information output unit 140 outputs the displacement and surface condition for each section. Therefore, users of the information processing system 10 can use the surface condition in addition to the displacement to determine the condition of each section of the structure. For example, among several sections with similar ground surface displacements, a section determined to have a deteriorated surface or a significant deterioration of the surface is more likely to require repair than other sections. Therefore, for example, users of the information processing system 10 can determine which sections require repair based on the displacement and surface condition for each section. In this way, because the information processing system 10 outputs both displacement and surface condition, it makes it easier to process structural information for each section of the structure. For example, the information output unit 140 may use sections that correspond to the user's work or convenience, such as a unit for managing the structure, a unit for determining the state of the structure, a unit for repairing the structure, and at least one combination thereof. In this case, users of the information processing system 10 can perform tasks and other operations for each section more appropriately based on the displacement and surface condition of each section.

[0021] <Second Embodiment> The information processing system 10 according to the second embodiment will be described with reference to the drawings. Figure 2 is a block diagram showing an example of the configuration of an information provision system 80 including the information processing system 10 according to the second embodiment. The information provision system 80 includes the information processing system 10, a sensor information acquisition device 20, a ground surface observation system 30, and a display device 40. The number of each component in Figure 2 is an example and is not limited to the number shown in Figure 2. For example, the information provision system 80 may include multiple sensor information acquisition devices 20.

[0022] (1) Sensor information acquisition device 20 The sensor information acquisition device 20 is equipped with a predetermined sensor and uses that sensor to acquire sensor information related to the surface of a structure. For example, the sensor information acquisition device 20 is mounted on or towed by a mobile body moving on or near the top surface of a structure to acquire sensor information related to the surface of the structure. For example, the sensor information acquisition device 20 is a drive recorder mounted on a vehicle, which is an example of a mobile body, and acquires road images, which is an example of sensor information. Alternatively, the sensor information acquisition device 20 may be a vibrometer that measures the vibration of a vehicle, or an accelerometer that measures the acceleration in the vibration of a vehicle. However, the sensor information acquisition device 20 is not limited to a drive recorder, vibrometer, or accelerometer mounted on a vehicle. For example, the sensor information acquisition device 20 may be a fixed device, such as a fixed camera installed on or beside a road. The sensor information acquisition device 20 may also be a device that can change performance related to the acquisition of sensor information, such as the shooting direction and focal length.

[0023] Furthermore, the surface of the structure is not limited to the road surface over which vehicles pass, but may be any surface in contact with the outside, such as the side walls and top surface inside a tunnel; it is not particularly limited. Also, the mobile body on which the sensor information acquisition device 20 is mounted is not limited to a vehicle. For example, an unmanned aerial vehicle (drone) may carry the sensor information acquisition device 20. Alternatively, a person may carry the sensor information acquisition device 20, similar to a wearable dashcam.

[0024] The sensor information acquired by the sensor information acquisition device 20 is information related to the surface of a structure. For example, the sensor information is an image of the surface of a structure, such as an image of the road surface. However, the sensor information is not limited to images. For example, the sensor information may be the magnitude, velocity, or acceleration of vibrations caused by unevenness in the road surface. Alternatively, the sensor information may be three-dimensional data, such as data acquired using radar (Radio Detecting and Ranging (RADAR)) or lidar (light detection and ranging (LiDAR)). The sensor information may not be a single piece of information, but may include multiple pieces of information, such as a combination of an image and acceleration.

[0025] As a concrete example of the correspondence between the sensor information acquisition device 20, the sensor, and the sensor information, we will explain the case where the sensor information acquisition device 20 is a drive recorder mounted on a vehicle. In this case, the sensor is the camera of the drive recorder, and the sensor information is the image captured by the camera. In the following explanation, we will use a drive recorder as the sensor information acquisition device 20, a camera as the sensor, and an image of the surface of a structure as an example of sensor information. We will also use a vehicle as an example of a moving object.

[0026] Sensor information may be accompanied by other information. Examples of information that may be associated with sensor data are described below. • Identification information Information for identifying the sensor information may be associated with the sensor information. For example, an identifier may be associated with the sensor information. Alternatively, the location where the sensor information was acquired may be associated with the sensor information. The location may be a two-dimensional location such as latitude and longitude, or a three-dimensional location including height. Alternatively, the time when the sensor information was acquired may be associated with the sensor information. For example, the information processing system 10 may identify the sensor information using the location and time included in the sensor information. ·Acquisition device information The sensor information acquisition device 20 may be associated with the sensor information. For example, the information associated with the sensor information acquisition device 20 may include at least one of the device name, model name, mounting position, and shooting direction of the sensor information acquisition device 20. Alternatively, information related to the sensor of the sensor information acquisition device 20 may be associated with the sensor information. For example, the information related to the sensor may include at least one of the sensor type, specifications, and performance. For example, if the sensor is a camera, the information related to the sensor may include at least one of the camera's focal length, aperture, diaphragm, shutter speed, and pixel count. • Mobile information If the sensor information acquisition device 20 is mounted on a mobile body, information related to the mobile body on which the sensor information acquisition device 20 is mounted may be included with the sensor information. For example, the sensor information may include at least one of the mobile body's name, model number, and type. Alternatively, information related to the operation of the mobile body may be included with the sensor information. For example, if the mobile body is a vehicle, the information related to the operation of the mobile body may include information on at least one of the following operations: accelerator pedal, brake pedal, shift lever, steering wheel, wipers, turn signals, and opening / closing of doors. • Surrounding area information Surrounding information may be included with the sensor information when it is acquired. Surrounding information may include, for example, at least one of the surrounding weather, temperature, humidity, illuminance, congestion level, and sound. • Worker information Information related to the worker responsible for acquiring the sensor data may be attached to the sensor data. For example, the information related to the worker may include at least one of the worker's name or identifier. Alternatively, information added by the worker may be attached to the sensor data. For example, the information added by the worker may be the worker's comments related to at least one of the structure and the sensor data.

[0027] (2) Ground surface observation system 30 The ground surface observation system 30 observes the ground surface, including structures, using observation equipment and outputs the observation results. For example, the ground surface observation system 30 includes a SAR that observes the ground surface, including structures, and outputs an image of the ground surface as an observation result. The observation equipment in the ground surface observation system 30 is, for example, a SAR mounted on an artificial satellite, an aircraft, or an unmanned aerial vehicle (drone). However, the observation equipment is not limited to SAR, and may also be, for example, an optical sensor or a laser measuring instrument. The ground surface observation system 30 may output observation results using multiple frequencies (multispectral) rather than a single frequency. The ground surface observation system 30 may analyze the observation results and output the displacement of the ground surface.

[0028] (3) Information processing system 10 (3-1) Displacement acquisition unit 110 The displacement acquisition unit 110 acquires the displacement of structures on the ground surface. For example, the displacement acquisition unit 110 acquires the displacement of structures on the ground surface based on the observation results of a ground surface observation system 30, which includes SAR, that observes the ground surface including structures. For example, the displacement acquisition unit 110 acquires observation results from the ground surface observation system 30. Then, the displacement acquisition unit 110 analyzes the observation results to acquire the displacement of structures. For example, the displacement acquisition unit 110 acquires the displacement of the ground surface between two different time points by analyzing images of the ground surface at two different time points. The displacement acquisition unit 110 may also acquire the time of observation.

[0029] When the ground surface observation system 30 outputs the ground surface displacement as a result of analyzing the observation results, the displacement acquisition unit 110 may acquire the ground surface displacement from the ground surface observation system 30. In this case, the displacement acquisition unit 110 may acquire the position of the ground surface displacement. As explained in the first embodiment, the displacement acquisition unit 110 may acquire the displacement by analyzing the observation results acquired from the ground surface observation system 30, or it may acquire the displacement from the ground surface observation system 30. Therefore, in the following description, these will be grouped together and described as the displacement acquisition unit 110 acquiring the displacement of a ground surface structure from the ground surface observation system 30.

[0030] Furthermore, the displacement acquisition unit 110 may perform analyses using observation results that are not limited to the analysis of surface displacement, but may also perform analyses of changes in surface intensity, factors causing surface displacement, the magnitude of risk based on surface displacement, or differences from predictions based on past surface displacement. When performing analyses of changes in surface intensity, etc., the information processing system 10 may use the analysis results of changes in surface intensity, etc., instead of surface displacement in the following description. For example, the information processing system 10 may output the changes in surface intensity and surface conditions for each section. When acquiring changes in surface intensity, etc., instead of surface displacement, the displacement acquisition unit 110 may also acquire changes in surface intensity, etc., from the surface observation system 30. Methods for analyzing surface images include change extraction, time-series interferometry, or coherent change extraction. Alternatively, one method for analyzing surface images is to apply newly acquired surface images to an analysis model generated by machine learning using past surface images and surface displacement to analyze surface displacement.

[0031] When obtaining observation results using multispectral data, the displacement acquisition unit 110 may analyze the type of ground surface in addition to the displacement of the ground surface as part of the analysis of the observation results. The types of ground surfaces that can be analyzed are determined according to the frequency used. For example, the types of ground surfaces include at least one of the following: water surface, mud, garbage, dry soil, grassland, forest, farmland, and snow cover. In this case as well, the displacement acquisition unit 110 may obtain the type of ground surface from the ground surface observation system 30. However, in the following explanation, as an example of analysis of observation results, it will be assumed that the displacement acquisition unit 110 acquires the displacement of the ground surface.

[0032] If the structure is wider than the spatial resolution of the displacement, the displacements at multiple locations will correspond to the displacement of the structure. Therefore, if the structure is wider than the spatial resolution of the displacement, the displacement acquisition unit 110 may acquire the displacements at multiple locations corresponding to the structure so as to cover the structure. Spatial resolution is the minimum distance at which two objects that are close together can be distinguished as two separate objects. For example, the spatial resolution of displacement is the minimum distance between two displacements. When acquiring displacement, the displacement acquisition unit 110 may output the location of the structure or section to the ground observation system 30 and acquire the displacement corresponding to the outputted location. Alternatively, the displacement acquisition unit 110 may extract the displacement of the location corresponding to the section within the structure from the displacement of a predetermined range including the structure acquired from the ground observation system 30. The displacement acquisition unit 110 may also acquire displacement stored in a storage device (not shown). The displacement acquisition unit 110 may acquire the velocity of the displacement, which is the rate of change of the displacement over a predetermined period, or the acceleration, which is the rate of change of the velocity of the displacement.

[0033] (3-2) Sensor information acquisition unit 120 The sensor information acquisition unit 120 acquires sensor information related to the surface of the structure. For example, the sensor information acquisition unit 120 acquires sensor information related to the surface of the structure from a sensor information acquisition device 20 mounted on a mobile body.

[0034] If the structure is larger than the unit for acquiring sensor information, sensor information from multiple locations will constitute sensor information corresponding to the structure. Therefore, if the structure is larger than the unit for acquiring sensor information, the sensor information acquisition unit 120 may acquire sensor information from multiple locations corresponding to the structure so as to cover the structure. Alternatively, if the information provision system 80 includes multiple sensor information acquisition devices 20, the sensor information acquisition unit 120 may acquire sensor information from the multiple sensor information acquisition devices 20. In this case, at least some of the sensor information acquired from the multiple sensor information acquisition devices 20 may have overlapping detection ranges. Alternatively, when acquiring multiple sensor information, the sensor information acquisition unit 120 may acquire sensor information stored in a storage device (not shown) as at least some of the sensor information. The sensor information acquisition unit 120 may output the location of the structure or section to the sensor information acquisition device 20 and acquire sensor information corresponding to the outputted location. Alternatively, the sensor information acquisition unit 120 may acquire sensor information for a predetermined range including the structure and extract sensor information corresponding to the location of the section within the structure from the acquired sensor information.

[0035] (3-3) State determination unit 130 The state determination unit 130 determines the surface condition of the structure based on the sensor information. For example, the state determination unit 130 determines the deterioration state of the surface of the structure based on the sensor information. As a determination method, the state determination unit 130 may use, for example, a determination model generated by machine learning using previously acquired sensor information and correct surface condition data. Alternatively, if the sensor information is an image, the state determination unit 130 may determine the surface condition of the road using predetermined image processing. The state determination unit 130 may determine the surface condition at multiple locations for a single sensor information. The state determination unit 130 may determine multiple types of surface conditions.

[0036] As an example of a surface condition determined by the condition determination unit 130, an example of determining road-related deterioration will be described. For example, the condition determination unit 130 may determine at least one of the following as road deterioration: cracks, ruts, potholes, deterioration of the road surface seal, and fraying around the seal. The condition determination unit 130 may also determine the type of surface condition. For example, the condition determination unit 130 may determine the type of deterioration, such as vertical, horizontal, or tortoise-shell pattern in cracks. Alternatively, the condition determination unit 130 may determine deterioration of objects provided on the road surface, such as fading of white lines and road markings on the road surface, or damage to markings. Alternatively, the condition determination unit 130 may determine surface changes, such as surface wear, rather than damage like cracks. Alternatively, the condition determination unit 130 may determine the condition of processed parts of the road surface, such as straight grooves for drainage or circular grooves for preventing slippage on slopes.

[0037] The condition determination unit 130 may also express the determination result of the surface condition using a "degree of deterioration," which is the degree of deterioration. The degree of deterioration of the road surface used by the condition determination unit 130 may be a commonly used degree of deterioration, or a degree of deterioration set by the user. The condition determination unit 130 may also use the deterioration rate, which is the rate of change of the degree of deterioration over a predetermined period, or the acceleration, which is the rate of change of the deterioration rate. The following are some common degrees of deterioration for roads and runways. Crack ratio: The value obtained by dividing the area of ​​cracks by the area being investigated. Rutting depth: The height from the rutted section to the protruding section within a specified range. A range of 20m is commonly used for this specified range. International Roughness Index (IRI): An index proposed by the World Bank in 1986 to evaluate the unevenness of paved roads. BBI (Boeing Bump Index): A flatness index adopted by the U.S. Federal Aviation Administration in 2009.

[0038] (3-4) Information output unit 140 The information output unit 140 outputs the displacement and surface state for each section of the structure. A section may contain multiple displacements and surface states. For example, if the area of ​​the section is larger than the spatial resolution of the displacement, the displacements at multiple locations will correspond to the displacement of the section. Alternatively, if the area of ​​the section is larger than the spatial resolution of the surface state, the surface states at multiple locations will correspond to the surface state of the section. In these cases, the information output unit 140 may output the displacement and surface state of all locations included in the section.

[0039] However, the information output unit 140 may output some of the displacements or surface conditions. For example, the information output unit 140 may output some types of surface conditions, such as deterioration that requires high repair. Alternatively, the information output unit 140 may output displacements that are greater than a predetermined value among the displacements included in the section. The information output unit 140 may also output a value calculated from at least one of the displacements and surface conditions included in the section, such as the average value of the displacements included in the section or the number of deteriorations.

[0040] As an example of outputting some surface conditions, we will explain using the deterioration of a structure. For example, if the deterioration of a road includes cracks, potholes, and ruts, the information output unit 140 may output all of these as deterioration for each section. However, potholes have a greater impact on traffic and require more repair than cracks and ruts. Therefore, the information output unit 140 may output only potholes as deterioration for each section.

[0041] The information output unit 140 may change at least one of the displacement and surface condition output in accordance with at least one of the displacement and surface condition for each location of the section. For example, the deterioration that is important may differ depending on the location of the structure. Therefore, the information output unit 140 may change at least one of the displacement and surface condition output in accordance with the deterioration for each location of the section. For example, if the deterioration consists of cracks and rutting, the information output unit 140 may output both cracks and rutting, or it may output either cracks or rutting depending on the location of the section. In road deterioration, the need for repair of cracks or rutting may vary depending on the location or type of road. Generally, cracks increase before potholes occur. Therefore, if the deterioration includes cracks and rutting, the information output unit 140 may output cracks for each section. However, for example, in places where the direction of vehicle travel changes frequently, such as intersections, rutting is more likely to affect vehicle operation. Therefore, in the case of a section that includes an intersection, the information output unit 140 may output the ruts for each section.

[0042] The spatial resolution of displacement often differs from the spatial resolution of the surface state. Therefore, the number of displacements corresponding to a section may differ from the number of surface states corresponding to that section. In this case, the information output unit 140 may output the spatial resolution of either the displacement or the surface state, matching the spatial resolution of the other.

[0043] For example, if the spatial resolution of the displacement is lower than the spatial resolution of the surface state, the surface states of multiple locations will be included in the range of a single displacement. The spatial resolution of the surface state is the minimum distance between two surface states determined using sensor information. Therefore, the information output unit 140 may combine the surface states of multiple locations included in the range of displacement to match the spatial resolution of the displacement. For example, the information output unit 140 may output a representative surface state, such as deterioration, that has the highest need for repair, from among the surface states of multiple locations included in the range of displacement. Alternatively, the information output unit 140 may output the number of surface states corresponding to the displacement as a surface state.

[0044] The information output unit 140 may output the displacement and surface condition of all sections included in the structure, or it may output the displacement and surface condition of some sections. For example, the information output unit 140 may output the displacement and surface condition of a section based on a condition that satisfies at least one of the displacement and surface condition included in the section. For example, the information output unit 140 may output the displacement and surface condition of a section whose displacement is greater than a threshold. Alternatively, the information output unit 140 may output the displacement and surface condition of a section that has a predetermined surface condition. A predetermined surface condition includes, but is not limited to, a section where the number of deteriorations such as cracks is greater than a threshold, the area of ​​deterioration is larger than a threshold, or a section with a predetermined type of deterioration such as potholes. Alternatively, the information output unit 140 may output the displacement and surface condition of a section where both the displacement and surface condition satisfy a predetermined condition, such as a section where the displacement is greater than a threshold and the number of deteriorations is large. Thus, the information output unit 140 may output the displacement and surface state of a section in which at least one of the displacement and surface state satisfies a predetermined condition.

[0045] The information output unit 140 may output, for each section, the displacement and surface condition, as well as the velocity, which is the rate of change of at least one of the displacement and surface condition, the acceleration, which is the rate of change of the velocity of change, or a combination of velocity and acceleration. For example, if the displacement at a certain point increases over time, the velocity of the displacement change is the rate at which the magnitude of the displacement changes. Alternatively, for example, if the surface condition is deterioration, the velocity of the surface condition is the rate at which the deterioration of the surface progresses. For example, if cracks are used as the surface condition, the velocity of the surface condition change is the rate at which the crack rate increases, or the rate at which the crack area expands. The velocity of displacement, the velocity of the surface condition, the acceleration of displacement, and the acceleration of the surface condition can be calculated based on the accumulated data. For example, the information output unit 140 may output the displacement and the rate of change of displacement for each section. Alternatively, the information output unit 140 may output deterioration and the rate of deterioration as the surface condition.

[0046] Note that displacement and surface conditions do not necessarily change steadily. Therefore, velocity and acceleration may change depending on the calculation period. Accordingly, the information output unit 140 may use a pre-set period as the calculation period for velocity and acceleration, or it may use a period specified by the user.

[0047] The information output unit 140 may output the displacement and surface state of a section where the rate of change of at least one of the deterioration and surface state satisfies a predetermined condition. Alternatively, the information output unit 140 may output the displacement and surface state of a section where the acceleration of at least one of the deterioration and surface state satisfies a predetermined condition. For example, the information output unit 140 may output the displacement and surface state of a section where the deterioration rate or the rate of change of the surface state exceeds a threshold. In this way, the information output unit 140 may output the displacement and surface state of a section based on at least one of the displacement and surface state. Alternatively, the information output unit 140 may output the displacement and surface state of a section based on the rate of change of at least one of the deterioration and surface state. Alternatively, the information output unit 140 may output the displacement and surface state of a section based on the acceleration, which is the rate of change of the rate of change of at least one of the deterioration and surface state.

[0048] The information output unit 140 may output the displacement and surface state of a section based on a priority set for the section output, which is determined based on at least one of the displacement and surface state. For example, the information output unit 140 may output the displacement and surface state of the section with the highest priority, or the displacement and surface state of sections whose priority falls within a predetermined range. If a priority is set, the information output unit 140 may output the priority set for the section in addition to the displacement and surface state of the section.

[0049] Next, let's explain some examples of priorities. For example, priorities may be set based on the magnitude of displacement. Specifically, for example, the priority of a section with large displacement may be set higher than the priority of a section with small displacement. Alternatively, priorities may correspond to the surface condition. Specifically, for example, if the surface condition is road deterioration, priorities may correspond to the number of cracks, the cracking rate, or the cracking area. Alternatively, if the surface condition includes a type, priorities may correspond to the type of surface condition. For example, if the surface condition is road deterioration, potholes are a type of deterioration that has a greater impact on traffic than cracks or ruts. Therefore, priorities may be set higher for sections where potholes have occurred than for sections where potholes have not occurred.

[0050] Alternatively, priority may be set based on the combination of displacement and surface condition. For example, a section with large displacement and a large number of deteriorations (one of the surface conditions) has a high need for repair. Therefore, the priority of a section with large displacement and a large number of deteriorations may be set higher than that of other sections. Note that a section with large displacement and little deterioration has a higher need for repair than a section with small displacement and a lot of deterioration. However, the priority of a section with large displacement and little deterioration versus a section with small displacement and a lot of deterioration will differ depending on the structure in question. Therefore, for example, users should decide the priority of a section with large displacement and little deterioration versus a section with small displacement and a lot of deterioration by considering the structure and the ease of repair.

[0051] Alternatively, the priority of a section may be set based on at least one of the displacement and surface condition of adjacent or nearby sections. For example, an area where sections with displacements greater than a threshold are clustered together is likely to require monitoring. Or, an area where sections with significant deterioration are clustered together is likely to require monitoring. Therefore, for example, the priority of sections with displacements exceeding a threshold may be set as follows: For example, if the number of adjacent sections with displacements exceeding a threshold exceeds a predetermined number, the priority of those sections where multiple displacements exceed the threshold may be set higher than that of other sections. This is because large displacements in multiple adjacent sections suggest that something may be happening in a predetermined area including multiple sections. However, the above explanation does not limit the priority of this embodiment.

[0052] The information output unit 140 may output the displacement and surface condition of a predetermined location or predetermined type of section. For example, in a structure through which many moving objects pass, such as a road or runway, there are sections that are frequently used and sections that are not frequently used. Sections that are frequently used are important to users. Therefore, the information output unit 140 may output the displacement and surface condition of the frequently used sections.

[0053] For example, on an airport runway, the section used for actual aircraft takeoffs and landings is more frequently used and under greater load than the surrounding sections. In this case, the information output unit 140 may output the displacement and surface condition of the section used for actual aircraft takeoffs and landings.

[0054] Alternatively, if the structure is a road, the road may include multiple types of roads, such as main roads and local roads. In this case, the area affected by road closures, etc., will be wider in the main road section than in the local road section. In this case, the information output unit 140 may output the displacement and surface condition in the main road section. Thus, when a structure includes multiple types of structures, the degree of monitoring necessity may differ for each type. Therefore, the information output unit 140 may output the displacement and surface condition of a specified type of section. Thus, the information output unit 140 may output the displacement and surface condition of a predetermined location or a predetermined type of section, rather than all sections.

[0055] The information output unit 140 may output the displacement and surface state of a specified section. For example, the information output unit 140 may output the displacement and surface state of a section specified by the user. Alternatively, the information output unit 140 may output the displacement and surface state of a section that satisfies conditions specified by the user. The section conditions are, for example, conditions that satisfy at least one of the displacement and surface state. Alternatively, the section conditions may be conditions that satisfy the velocity of at least one of the deterioration and surface state. Alternatively, the section conditions may be conditions that satisfy the acceleration of at least one of the deterioration and surface state. Alternatively, the section conditions may be the priority of the section. However, the section conditions are not limited to the above.

[0056] Structures may be divided into groups of a certain size. For example, roads may be divided into multiple sections at intersections and managed accordingly. Therefore, the sections may be divided in accordance with the groups in the structure. When the sections are divided in accordance with groups, the information output unit 140 may output the displacement and surface condition of the section of the specified group. Alternatively, the information output unit 140 may output the displacement and surface condition of the section based on the conditions that the group satisfies.

[0057] (3-5) Information Processing System 10 Next, the operation of the information processing system 10 will be described with reference to the drawings. Figure 3 is a flowchart showing an example of the operation of the information processing system 10 according to the second embodiment. The displacement acquisition unit 110 acquires the displacement of the structure on the ground surface (step S201). The sensor information acquisition unit 120 acquires sensor information related to the surface of the structure (step S202). The state determination unit 130 determines the surface state of the structure based on the sensor information (step S203). The information output unit 140 outputs the displacement and surface state for each section of the structure (step S204). The operation of step S201 and the operations of steps S202 and S203 may be executed in any order.

[0058] Thus, the information processing system 10 operates in the same manner as in the first embodiment, but processes information related to the section more appropriately. The information processing system 10 may operate on only some of the sections of the target structure, rather than on all of them. In this case, the information output unit 140 outputs the displacement and surface state for each section being operated on in step S204.

[0059] The information processing system 10 may repeatedly output displacement and surface state whenever predetermined conditions are met. For example, the information processing system 10 may output displacement and surface state in response to the timing when at least one of the displacement and sensor information is acquired or updated. Alternatively, for example, the information processing system 10 may reacquire the displacement and sensor information in response to the management cycle of the structure and repeatedly output displacement and surface state. Alternatively, the information processing system 10 may reacquire at least one of the displacement and sensor information in response to a predetermined cycle, such as monthly or weekly, or the update cycle of at least one of the displacement and sensor information, and output displacement and surface state for each section. For example, the information processing system 10 may reacquire the displacement and sensor information on a predetermined day each month and output displacement and surface state for each section.

[0060] Alternatively, when the information processing system 10 receives instructions from the user to output displacement and surface state, it may acquire the displacement and sensor information and output the displacement and surface state for each section. In this case, the information processing system 10 may output the displacement and surface state of a section specified by the user, rather than the entire structure. For example, the information processing system 10 may acquire the displacement and sensor information of a section specified by the user, determine the surface state based on the acquired sensor information, and output the displacement and surface state of that section.

[0061] When the operation is repeated, the information processing system 10 may change the sections for which it outputs displacement and surface state. For example, the information output unit 140 may output the displacement and surface state of all sections at the initial point in time, and thereafter output the displacement and surface state of sections for which at least one of the displacement and surface state satisfies a predetermined condition. For example, the information processing system 10 may output the displacement and surface state of sections where the displacement exceeds a threshold, or sections that have reached a predetermined deterioration state.

[0062] The displacement of a structure can be considered not as deformation of the structure itself, but as displacement including the ground underlying the structure. Therefore, the displacement of a structure has a significant impact on the structure. However, the spatial resolution of the displacement is limited to a certain range. For example, the spatial resolution of SAR is often only a few meters at best.

[0063] On the other hand, the spatial resolution of the surface state determined using sensor information acquired from a sensor information acquisition device 20, such as a dashcam, is approximately a few centimeters to several tens of centimeters. Therefore, the surface state determined by the state determination unit 130 often shows the surface state of the structure in more detail than the displacement acquired by the displacement acquisition unit 110. However, the surface state may not necessarily reflect the state of the ground beneath the structure. For example, the surface state may change in relation to weather conditions such as rain or snow. In this case, the surface state is not a state relating to the entire structure, but rather an individual state of a part of it.

[0064] Therefore, the information output unit 140 outputs the displacement and surface condition for each section. As already explained, the sections can be set according to the user's convenience. In other words, the information processing system 10 outputs the displacement and surface condition for each section according to the user's convenience. As a result, the information processing system 10 makes it easier to process the section information for each section of the structure compared to when only the displacement is considered.

[0065] (4) Display device 40 The display device 40 acquires the displacement and surface condition of each section output by the information output unit 140, and displays the acquired displacement and surface condition for each section. The display device 40 can be of any type or location as long as it can display the displacement and surface condition. For example, it is a display unit included in a local government's road management system, but is not limited to this. In the following description, the display of the display device 40 is determined by the information processing system 10. However, the relationship between the information processing system 10 and the display device 40 is not particularly limited. Therefore, in the following description, for the sake of clarity, it may be stated that "the display device 40 changes the display."

[0066] Referring to the drawings, the display of displacement and surface condition in the display device 40 will be explained. Figure 4 shows an example of the display of displacement and surface condition in each section. In Figure 4, the display device 40 displays sections when the structure is divided into seven horizontally and four vertically. The display device 40 displays a number indicating the column above the structure and an alphabet indicating the row to the left of the structure as an indicator of the section. In the following explanation, alphabets and numbers will be used to specify the row, column, and section of the structure. For example, the third row from the top is row [C], the second column from the left is column [2], and the section at the intersection is section [C2]. The display device 40 classifies the displacement of each section into three types: large, medium, and small, and changes the display of the section according to the magnitude of the displacement. Furthermore, the display device 40 displays deterioration using an icon at the location where deterioration, which is an example of a surface condition, has been determined. Note that the display device 40 may classify the displacement using any scale other than "large, medium, and small" and display the section according to that classification. For example, the display device 40 may classify the displacement in 1 mm increments and display the sections corresponding to those classifications.

[0067] The display device 40 may display the color of a section corresponding to the number, area, or type of surface condition contained in that section, not limited to displacement. For example, in Figure 4, the display device 40 may display the color of a section corresponding to the number, area, or type of deterioration instead of the magnitude, magnitude, and magnitude of displacement. Alternatively, the display device 40 may display the color of a section corresponding to the type of surface condition. For example, the display device 40 may display a section where potholes have occurred using a different color than the other sections. The display device 40 may also display an icon corresponding to the type of surface condition. For example, in Figure 4, the display device 40 may display an icon at the location of a pothole instead of at the location of deterioration.

[0068] Alternatively, in Figure 4, the display device 40 may display the color of the section corresponding to the velocity of at least one of the displacement and the surface state, instead of the large, medium, and small displacements. Alternatively, the display device 40 may display the color of the section corresponding to the acceleration of at least one of the displacement and the surface state, instead of the large, medium, and small displacements. In this way, the display device 40 may display the section corresponding to at least one of the displacement and the surface state.

[0069] The display device 40 may display details of at least one of the displacement and surface condition of a section. For example, the display device 40 may display details of at least one of the displacement and surface condition of a specified section. For example, if section [C2] in Figure 4 is specified, the display device 40 displays details of at least one of the displacement and surface condition of section [C2], which is the user's touch position. Figure 5 is a diagram showing an example of detailed display of displacement and surface condition. In Figure 5, the display device 40 displays details of the displacement and deterioration state of section [C2]. As details of the displacement of section [C2], the display device 40 displays the displacement in the longitudinal direction of section [C2]. The longitudinal direction of the section is the left-right direction shown by the white line in section [C2] in Figure 5. The display device 40 may also present details of at least one of the displacement and surface condition for multiple sections.

[0070] Furthermore, the display device 40 displays an image of section [C2] as a detail of the deterioration of section [C2]. In addition, the display device 40 superimposes squares indicating the location of cracks on the image as a reference for the location where deterioration was detected. The image in Figure 5 was acquired by a drive recorder mounted on a vehicle that traveled from right to left across the structure in Figure 5. Therefore, in Figure 5, the section has a perspective-like trapezoidal shape with a convergence point near the center of the deterioration image. To improve visibility, the display device 40 may deform the shape of the displayed section using predetermined image processing. For example, the display device 40 may deform the perspective-like trapezoidal shape of the section into a rectangle for display.

[0071] When the information processing system 10 repeatedly operates and outputs displacement and surface state again for the area where the position and output were previously obtained, the display device 40 may display the area for which the displacement and surface state have been acquired differently from other areas. For example, the display device 40 may blink the display for the area for which the displacement and surface state have been acquired, or it may display a predetermined shape or icon in that area.

[0072] If there are multiple sensor information items corresponding to a section, the display device 40 may display at least one of the multiple sensor information items and the surface state corresponding to the section. For example, if an image corresponding to a section has been acquired multiple times, the display device 40 may display multiple images as images of that section. Alternatively, if the state of deterioration has been determined based on those multiple images, the display device 40 may display the determined state of deterioration. Note that if the image is a video, the amount of image data can be enormous. Therefore, for example, the display device 40 may extract and display images in which the degree of deterioration is above a threshold. Alternatively, the display device 40 may extract and display images that include predetermined deterioration, such as potholes. In this way, the display device 40 may extract and display some images based on predetermined conditions or priorities. Alternatively, the display device 40 may display some images by thinning them out, such as by thinning out images that do not contain deterioration, based on predetermined conditions or priorities.

[0073] <Third Embodiment> Figure 6 is a block diagram showing an example of the configuration of an information provision system 83, including an information processing system 13 according to the third embodiment. The information provision system 83 has the same configuration as the information provision system 80 of the second embodiment, but includes an information processing system 13 instead of an information processing system 10. Therefore, the information processing system 13 will be described below, and the description of other configurations will be omitted. In addition to the same configuration as the information processing system 10, the information processing system 13 also includes an information storage unit 150. Therefore, the configuration and operation related to the information storage unit 150 will be described in detail.

[0074] The displacement acquisition unit 110, in acquiring displacement from the ground surface observation system 30, also acquires the time when the observation device in the ground surface observation system 30 observed the ground surface. Displacement is acquired by analyzing the observation results. Therefore, the observation time may be referred to as the "displacement time" below. When multiple observation results are used in the analysis of displacement, the displacement time is the time of the last observation. The sensor information acquisition unit 120, in acquiring sensor information from the sensor information acquisition device 20, also acquires the time the sensor information was acquired. The state determination unit 130, in determining the surface state, outputs the time the determined sensor information was acquired as the surface state time. The information storage unit 150 stores at least one of the displacement at multiple times and the surface state at multiple times in one or more sections. The information output unit 140 then outputs the displacement and surface state corresponding to the specified time in each of the one or more sections.

[0075] For example, the information storage unit 150 may store the displacement in association with the time of the displacement. Alternatively, the information storage unit 150 may store the surface state in association with the time of the surface state. In addition, the information storage unit 150 may store the sensor information in association with the time of the sensor information. In this case, the information output unit 140 only needs to obtain the surface state and the time of the surface state determined by the state determination unit 130 based on the sensor information for the target time.

[0076] The information output unit 140 outputs the displacement and surface state corresponding to a specified time for at least some of the sections. For example, the information output unit 140 obtains the displacement and surface state corresponding to a specified time from the information storage unit 150. Then, the information output unit 140 outputs the specified time, displacement, and surface state. For example, the information output unit 140 may output the specified time, displacement, and surface state to the display device 40. In this case, the display device 40 may display the obtained displacement, surface state, and time. If new displacement and surface state are obtained for a section where the displacement and surface state have already been displayed, the display device 40 may add the newly obtained displacement and surface state to the already displayed displacement and surface state and display it. Alternatively, the display device 40 may display the newly obtained displacement and surface state instead of the already displayed displacement and surface state.

[0077] Referring to the drawings, we will now explain the case in which the information output unit 140 outputs the displacement and surface condition corresponding to a specified time. Figure 7 is a diagram showing an example of the display in the third embodiment. Figure 7 shows the displacement and surface condition for October 7, 2020, which is shown as a calendar. Figure 7 also shows details of the displacement and surface condition. Figure 8 is a diagram showing an example of the display for another day. Specifically, Figure 8 shows the displacement and surface condition for April 7, 2020, which is six months earlier than Figure 7. Comparing Figures 7 and 8, the displacement of section [C2] has changed from medium to large over the course of six months. Also, the deterioration of the surface condition of section [C2] has increased in both the number and extent of deterioration. In this way, the information processing system 13 processes the displacement and surface condition for the user more appropriately than in the second embodiment.

[0078] The information output unit 140 may output displacement and surface state corresponding to each of several specified time points, not just one time point, for at least some sections. For example, the information output unit 140 may output displacement and surface state corresponding to multiple time points, such as before and after a disaster or before and after construction, for each section. For example, the information output unit 140 acquires both displacement and surface state corresponding to each of several specified time points from the information storage unit 150 for each section. The information output unit 140 may then output the acquired displacement and surface state for each of the multiple time points for each section. For example, the information output unit 140 may output the displacement and surface state corresponding to multiple time points for each section to the display device 40. In this case, the display device 40 may display the acquired displacement and surface state for each section in association with the multiple time points.

[0079] Figure 9 shows an example of displaying displacement and deterioration over multiple days. Figure 9 shows the progression of displacement and deterioration in section [C2] over one year. Figure 10 shows an example of displaying detailed information on displacement over multiple days. Figure 10 shows the detailed progression of displacement in section [C2] over one year. Thus, the display device 40 may display at least one of the displacement and surface state for multiple times side by side as a display corresponding to multiple times, or it may display at least one of the displacement and surface state for multiple times superimposed. The information output unit 140 may output at least one of the displacement and surface state corresponding to multiple times in multiple sections, not just one. A method of specifying the time other than the calendar display, such as a slider bar, may be used.

[0080] The information output unit 140 may output the displacement and surface condition of a section based on a priority for section output set using at least one of the displacement and surface condition at multiple time points. For example, if the expansion of the area of ​​a section with large displacement is accelerating, it is possible that the expansion of ground displacement is accelerating. Therefore, the priority of sections included in a region where the increase in the number of sections with displacement exceeding a threshold over a predetermined period is greater than a predetermined number, that is, a region where the increase in the number of sections with large displacement is accelerating, may be set higher than the priority of other sections. The information output unit 140 may then output the displacement and surface condition of sections with a priority higher than a predetermined value.

[0081] The information storage unit 150 is not limited to displacement and surface conditions, but may also store other information related to the structure or section. For example, the information storage unit 150 may store the repair history for each section.

[0082] In this case, the information output unit 140 may also output the displacement and surface condition of sections whose repair history stored in the information storage unit 150 satisfies predetermined conditions. For example, the information output unit 140 may output the displacement and surface condition of sections where the displacement exceeds a threshold, or where the number or area of ​​deterioration exceeds a threshold, within a predetermined time since the most recent repair. Alternatively, the information output unit 140 may output the displacement and surface condition of sections where the number of repairs within a predetermined period exceeds a threshold.

[0083] Figure 11 is a flowchart showing an example of the operation of the information processing system 13 of the third embodiment. The displacement acquisition unit 110 acquires the displacement of the structure on the ground surface (step S201). The sensor information acquisition unit 120 acquires sensor information related to the surface of the structure (step S202). The state determination unit 130 determines the surface state of the structure based on the sensor information (step S203). The information storage unit 150 stores the displacement and the time of the displacement, and the surface state and the time of the surface state, associated with each other, for each section (step S215). The operation of step S201 and the operations of steps S202 and S203 may be executed in either order.

[0084] The information output unit 140 acquires the time of displacement and surface state (step S216). The information output unit 140 may acquire multiple time points. The information output unit 140 outputs the displacement and surface state corresponding to the acquired time points for each section (step S217). If multiple time points are acquired, the information output unit 140 may output the displacement and surface state corresponding to multiple time points for at least some sections. The information processing system 13 may repeat the operations of steps S216 and S217.

[0085] The information processing system 13 may operate on only some of the sections, rather than all of them. In this case, the information output unit 140 acquires information indicating the section along with the time in step S216. Then, in step S217, the information output unit 140 outputs information indicating the displacement, surface state, time, and section.

[0086] The observation time used as the basis for displacement analysis may not coincide with the acquisition time of sensor information used as the basis for determining the surface state. In other words, the displacement time may not coincide with the surface state time. Furthermore, the observation time and the acquisition time of sensor information do not necessarily coincide in all sections, and may differ in at least some sections. In such cases, the information output unit 140 outputs the corresponding displacement and surface state from among the displacements and surface states with different timestamps for each section.

[0087] For example, suppose the information storage unit 150 stores weekly displacements and daily surface state data. Also, suppose the day is specified as the time for the displacement and surface state. In this case, the information output unit 140 may output the surface state corresponding to the specified day and the displacement corresponding to the week including that day. Alternatively, if the information storage unit 150 stores the day as the time for the displacement, that is, the acquisition date of the observation results used for the displacement analysis, the information output unit 140 may output the surface state corresponding to the specified day and the displacement corresponding to the acquisition date of the observation results closest to the specified day. In this way, the information output unit 140 should output the corresponding displacement and surface state based on predetermined rules.

[0088] Note that the displacement update cycle may differ from the surface state update cycle. For example, if the displacement update cycle is longer than the surface state update cycle, the information processing system 13 can acquire multiple sensor data between the acquisition of one displacement and the acquisition of the next. In this case, the information output unit 140 may output multiple surface states at multiple times based on sensor data at multiple times for a displacement at one time. Alternatively, if the update cycle of at least some of the sensor data is longer than the displacement update cycle, the information output unit 140 may output multiple displacements at multiple times corresponding to the surface state at one time, as the displacement and surface state of a section. In this way, the information output unit 140 may output a different number of displacements and surface states for each section, as the number of times to be output.

[0089] <Hardware Configuration> Next, the hardware configurations of information processing systems 10 and 13 will be explained using information processing system 10. Each component of information processing system 10 may be composed of hardware circuits. Alternatively, each component of information processing system 10 may be composed of multiple devices connected via a network. For example, information processing system 10 may be configured using cloud computing. Alternatively, multiple components of information processing system 10 may be composed of a single piece of hardware.

[0090] The information processing system 10 may be implemented as a computer device including a Central Processing Unit (CPU), Read Only Memory (ROM), and Random Access Memory (RAM). In addition to the above configuration, the information processing system 10 may also be implemented as a computer device including other components such as a Network Interface Card (NIC).

[0091] Figure 12 is a block diagram showing an example of the hardware configuration of a computer device 600 that constitutes the information processing system 10. The computer device 600 includes a CPU 610, a ROM 620, a RAM 630, a storage device 640, and a NIC 650. The CPU 610 reads a program from at least one of the ROM 620 and the storage device 640. The CPU 610 then controls the RAM 630, the storage device 640, and the NIC 650 based on the program it has read. The computer device 600, including the CPU 610, controls these components and realizes the functions of the information processing system 10 as a displacement acquisition unit 110, a sensor information acquisition unit 120, a state determination unit 130, and an information output unit 140.

[0092] When implementing each function, the CPU 610 may use at least one of the RAM 630 and the storage device 640 as a temporary storage medium for programs and data. Alternatively, the CPU 610 may read programs contained in a storage medium 690, which stores programs in a computer-readable format, using a storage medium reader (not shown). Or, the CPU 610 may obtain programs from other devices (not shown) via the NIC 650, store the obtained programs in at least one of the RAM 630 and the storage device 640, and operate based on the stored programs.

[0093] ROM 620 stores programs executed by the CPU 610 and fixed data. ROM 620 is, for example, a programmable ROM (P-ROM) or flash ROM. RAM 630 temporarily stores at least one of the programs executed by the CPU 610 and data. RAM 630 is, for example, dynamic RAM (D-RAM). Storage device 640 stores data and programs that the computer device 600 stores long-term. Storage device 640 may also operate as a temporary storage device for the CPU 610. Storage device 640 may also operate as an information storage unit 150. Storage device 640 is, for example, a hard disk drive, a magneto-optical disk drive, a solid-state drive (SSD), or a disk array device.

[0094] ROM 620 and storage device 640 are non-transitory recording media. On the other hand, RAM 630 is a volatile recording media. The CPU 610 can operate based on programs stored in at least one of ROM 620, storage device 640, and RAM 630. In other words, the CPU 610 can operate using at least one of a non-volatile recording media and a volatile recording media.

[0095] The NIC650 relays data exchange with other devices (not shown) via the network. The NIC650 is, for example, a Local Area Network (LAN) card. Furthermore, the NIC650 may use wireless communication as well as wired communication. In the computer device 600 configured in this way, the CPU 610 performs functions similar to those of the information processing system 10 or 13 based on a program.

[0096] <Specific examples of information provision systems> Figure 13 is a conceptual diagram showing an information provision system 84, which is a specific example of information provision systems 80 and 83. In information provision system 84, the main components of each part may be the same or different. In Figure 13, the computer device 810 is an example of an information processing system 10. The drive recorder 820 is an example of a sensor information acquisition device 20. The SAR system 830, which includes an artificial satellite equipped with SAR and a ground station, is an example of a ground observation system 30. The terminal device 840 is an example of a display device 40. The vehicle 850 is an example of a mobile body that moves with the drive recorder 820 mounted on it. In Figure 13, for ease of understanding, the drive recorder 820 is mounted outside the vehicle 850. However, the drive recorder 820 may be mounted inside the vehicle 850.

[0097] Network 880 is a communication path that connects each device and system to each other. For example, network 880 may be the internet, a public telephone line, a dedicated communication network, or a combination thereof. However, network 880 is not limited to the above, and may be any communication path that can connect each device and system. Network 880 may be composed of multiple networks rather than just one network. For example, network 880 may be composed of different networks used to connect the computer device 810 and other devices or systems, as shown below. • Connection between computer device 810 and drive recorder 820, • Connection between computer device 810 and SAR system 830, • Connection between computer device 810 and terminal device 840. Alternatively, if there are multiple drive recorders 820, the network 880 may use multiple networks corresponding to the locations of the drive recorders 820 to connect the computer device 810 and the drive recorders 820.

[0098] Thus, the number of configurations included in Figure 13 is just an example and is not limited to the number shown in Figure 13. For example, there may be one, two, or four or more drive recorders 820. Also, the configuration shown in Figure 13 can be replaced with other devices or systems. For example, at least some of the drive recorders 820 may be mounted on a mobile device other than the vehicle 850, such as a drone. Alternatively, the drive recorders 820 may be replaced with fixed cameras.

[0099] Vehicle 850, equipped with a drive recorder 820, travels on roads and structures such as bridges. Vehicle 850 may also travel inside structures such as tunnels. The drive recorder 820 acquires sensor information from roads and structures such as bridges on which vehicle 850 travels, and outputs the acquired sensor information to the computer device 810. For example, the drive recorder 820 acquires images and acceleration as sensor information and outputs them to the computer device 810. The SAR system 830 outputs the ground surface observation results to the computer device 810. Alternatively, the SAR system 830 analyzes the observation results and outputs the displacement of the ground surface, including structures.

[0100] The computer device 810 acquires sensor information from the drive recorder 820 and determines the surface condition of the structure based on the acquired sensor information. The computer device 810 also acquires observation results from the SAR system 830 and analyzes the acquired observation results to obtain the displacement of the structure. Alternatively, the computer device 810 obtains the displacement of the structure from the SAR system 830. In other words, the computer device 810 obtains the displacement of the structure as a result of analysis using the observation results acquired by the SAR system 830. The computer device 810 then outputs the displacement and surface condition for each section to the terminal device 840. The terminal device 840 displays the displacement and surface condition for each section acquired from the computer device 810.

[0101] Generally available products and systems can be used as the computer device 810, drive recorder 820, SAR system 830, terminal device 840, and vehicle 850. For example, a general-purpose personal computer may be used as the computer device 810. Thus, there are no particular restrictions on the devices and systems used as the computer device 810, drive recorder 820, SAR system 830, terminal device 840, and vehicle 850.

[0102] Some or all of the above embodiments may also be described as follows, but are not limited to the following:

[0103] (Note 1) A displacement acquisition means for acquiring the displacement of structures on the ground surface, A sensor information acquisition means for acquiring sensor information related to the surface of a structure, A state determination means for determining the surface condition of a structure based on sensor information, For each section of the structure, an information output means outputs displacement and surface condition. An information processing system that includes this.

[0104] (Note 2) The information output means outputs the displacement and surface state of the section based on at least one of the displacement and surface state. The information processing system described in Appendix 1.

[0105] (Note 3) The information output means outputs the displacement and surface state of the section based on the rate of change of at least one of the displacement and the surface state, and at least one of the acceleration, which is the rate of change of the rate of change of at least one of the displacement and the surface state. The information processing system described in Appendix 2.

[0106] (Note 4) The information output means outputs the displacement and surface state of a section based on the priority of the section set based on at least one of the displacement and surface state. An information processing system as described in either item 2 or 3 of the appendix.

[0107] (Note 5) The information output means outputs the displacement and surface state of a predetermined location or predetermined type of section. An information processing system as described in any one of the items 1 through 4 of the appendix.

[0108] (Note 6) The information output means outputs the displacement and surface condition of the specified section. An information processing system as described in any one of the items 1 through 5 of the appendix.

[0109] (Note 7) The system further includes information storage means for storing at least one of the displacement at multiple time points and the surface state at multiple time points in one or more sections. The information output means outputs the displacement and surface state corresponding to a specified time for each of one or more sections. An information processing system as described in any one of the items 1 through 6 of the appendix.

[0110] (Note 8) The information output means outputs displacement and surface state corresponding to each of the specified multiple time points. The information processing system described in Appendix 7.

[0111] (Note 9) A section is a unit for managing a structure, a unit for determining the condition of a structure, a unit for repairing a structure, or at least one combination thereof. An information processing system as described in any one of the items 1 through 8 of the appendix.

[0112] (Note 10) The sensor information acquisition means acquires sensor information acquired by a sensor information acquisition device mounted on a mobile body. An information processing system as described in any one of the items 1 through 9 of the appendix.

[0113] (Note 11) The moving object is a vehicle. The sensor information acquisition device is a dashcam. The sensor information is an image of the surface of the structure. The information processing system described in Appendix 10.

[0114] (Note 12) The displacement acquisition means acquires the displacement of a structure based on the observation results of a ground observation system, including a synthetic aperture radar that observes the ground surface including the structure. An information processing system as described in any one of the items 1 through 11 of the appendices.

[0115] (Note 13) Obtain the displacement of structures on the ground surface, We acquire sensor information related to the surface of the structure, Based on sensor information, the surface condition of the structure is determined. Output the displacement and surface condition for each section of the structure. Information processing methods.

[0116] (Note 14) A process to obtain the displacement of structures on the ground surface, Process for acquiring sensor information related to the surface of a structure, A process for determining the surface condition of a structure based on sensor information, A process that outputs displacement and surface condition for each section of a structure. A recording medium that stores programs that cause a computer to execute.

[0117] Although the present invention has been described above with reference to embodiments, the present invention is not limited to the above embodiments. Various modifications to the structure and details of the present invention can be made, which can be understood by those skilled in the art within the scope of the present invention. [Explanation of Symbols]

[0118] 10. Information Processing Systems 13 Information Processing Systems 20 Sensor Information Acquisition Device 30. Ground surface observation systems 40 Display device 80 Information Provision System 83 Information Provision System 84 Information Provision System 110 Displacement acquisition unit 120 Sensor Information Acquisition Unit 130 State determination unit 140 Information Output Unit 150 Information Storage Department 600 Computer devices 610 CPU 620 ROM 630 RAM 640 Storage device 650 NIC 810 Computer equipment 820 Dashcam 830 SAR System 840 Terminal devices 850 vehicles 880 Network

Claims

1. Displacement acquisition means for acquiring the displacement of structures on the ground surface from a ground observation system including synthetic aperture radar, A sensor information acquisition means that acquires sensor information related to the surface of the structure from a sensor information acquisition device mounted on the vehicle, A state determination means for determining the surface state of the structure based on the sensor information, For each section of the structure, an information output means is provided to output the displacement and the surface state. Includes, If the spatial resolution of the displacement is lower than the spatial resolution of the surface state, the information output means outputs the surface states of multiple positions included in a single displacement range as a single representative surface state, so as to match the spatial resolution of the surface state to the spatial resolution of the displacement. Information processing system.

2. The information output means outputs the displacement and the surface state of the section based on at least one of the displacement and the surface state. The information processing system according to claim 1.

3. The information output means outputs the displacement and surface state of the section based on at least one of the rate of change of the displacement and the surface state, and the acceleration, which is the rate of change of the rate of change of the displacement and the surface state. The information processing system according to claim 2.

4. The information output means outputs the displacement and surface state of the section based on the priority of the section set based on at least one of the displacement and the surface state. The information processing system according to any one of claims 2 or 3.

5. The information output means outputs the displacement and surface state of the section at a predetermined position or of a predetermined type. The information processing system according to any one of claims 1 to 4.

6. The information output means outputs the displacement and surface state of the designated section. The information processing system according to any one of claims 1 to 5.

7. The system further includes information storage means for storing at least one of the displacement at multiple time points and the surface state at multiple time points in one or more of the above-mentioned compartments, The information output means outputs the displacement and surface state corresponding to a specified time for each of the one or more sections. The information processing system according to any one of claims 1 to 6.

8. The information output means outputs the displacement and the surface state corresponding to each of the specified number of time points. The information processing system according to claim 7.

9. We obtain the displacement of structures on the Earth's surface from a surface observation system including synthetic aperture radar. Sensor information related to the surface of the structure is acquired from a sensor information acquisition device mounted on the vehicle. Based on the sensor information, the surface condition of the structure is determined. For each section of the structure, the displacement and the surface condition are output. If the spatial resolution of the displacement is lower than the spatial resolution of the surface state, the output of the displacement and the surface state will be output by converting the surface states of multiple positions included in a single displacement range into a single representative surface state, so that the spatial resolution of the surface state matches the spatial resolution of the displacement. Information processing methods.

10. A process for acquiring the displacement of structures on the Earth's surface from a surface observation system including synthetic aperture radar, A process for acquiring sensor information related to the surface of the structure from a sensor information acquisition device mounted on the vehicle, A process for determining the surface state of the structure based on the sensor information, A process for outputting the displacement and the surface state for each section of the structure. Have the computer run it, When the spatial resolution of the displacement is lower than the spatial resolution of the surface state, the process of outputting the displacement and the surface state outputs the surface state of multiple positions included in a single range of the displacement as a single representative surface state, so as to match the spatial resolution of the surface state to the spatial resolution of the displacement. program.

Images