Information processing device, information processing method, and program

Abstract

The system associates the correct confirmation results at the location of occurrence with the deterioration detected based on sensor information collected by the mobile object. [Solution] A diagnosis unit 2 of a deterioration diagnosis device 1 diagnoses road deterioration by analyzing sensor information collected by a mobile object and outputs the location of the detected deterioration. An association unit 3 associates the diagnosis result with the confirmation result based on the location of road deterioration confirmed by a person and the location of deterioration detected by the diagnosis. A memory unit 4 stores the associated diagnosis result and confirmation result.

Description

[Technical field]

[0001] The present disclosure relates to Data Processing Device, Data Processing Method, and program Regarding. [Background technology]

[0002] 2. Description of the Related Art In road inspections, deterioration diagnosis systems are being introduced that detect road deterioration by analyzing road images taken from vehicles using computers.

[0003] As an example of such a deterioration diagnosis system, for example, Patent Document 1 discloses a pavement information collection and inspection system that collects road images captured by a vehicle, detects road deterioration, and displays information on the deterioration, etc., on a terminal so that the information can be referenced from a point on a map. Also, Patent Document 2 discloses a defect analysis system that associates road surface defects detected by analyzing road surface image information with the positions of the road surface defects and displays them on a map. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-196680 A [Patent Document 2] JP 2018-017102 A Summary of the Invention [Problem to be solved by the invention]

[0005] When managing road deterioration using a deterioration diagnosis system such as those described in Patent Document 1 and Patent Document 2, the road administrator, etc., must go to the place (site) where the deterioration actually occurs and directly confirm the deterioration by visual inspection, etc., in order to investigate the detailed state of the deterioration. In this case, the road administrator, etc., goes to the site to confirm the deterioration by referring to the state of deterioration and the detection position output by the deterioration diagnosis system, but there is a possibility that the administrator will confirm deterioration different from the deterioration output by the deterioration diagnosis system. For this reason, there is a possibility that an erroneous confirmation result will be associated with the deterioration detected by the deterioration diagnosis system.

[0006] One object of the present disclosure is to solve the above-mentioned problems and provide a degradation diagnosis system, a degradation diagnosis device, a degradation diagnosis method, and a recording medium that can associate the deterioration detected based on sensor information collected by a mobile object with the correct confirmation results at the location where the deterioration occurred. [Means for solving the problem]

[0007] An information processing device in one aspect of the present disclosure includes a first acquisition means for acquiring first information from a mobile body, the first information being information regarding deterioration of a structure acquired by the mobile body, a second acquisition means for acquiring second information from a terminal device, the second information being information regarding deterioration of a structure acquired by the terminal device, and an association means for associating the first information with the second information if the first information and the second information satisfy a predetermined condition.

[0009] An information processing method in one aspect of the present disclosure acquires first information from a mobile body, the first information being information regarding the deterioration of a structure acquired by a mobile body, and acquires second information from a terminal device, the second information being information regarding the deterioration of a structure acquired by a terminal device, and if the first information and the second information satisfy a predetermined condition, associates the first information with the second information.

[0010] A program in one aspect of the present disclosure causes a computer to acquire first information from a mobile body, the first information being information regarding the deterioration of a structure acquired by the mobile body, and acquire second information from a terminal device, the second information being information regarding the deterioration of a structure acquired by the terminal device, and if the first information and the second information satisfy a predetermined condition, execute a process of associating the first information and the second information. Effect of the Invention

[0011] An effect of the present disclosure is that it is possible to associate a correct confirmation result at the location where deterioration has occurred with respect to deterioration detected based on sensor information collected by a mobile object. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram showing a configuration of a degradation diagnosis system 10 in a first embodiment. [Diagram 2] FIG. 4 is a diagram showing an example of a diagnosis result in the first embodiment. [Diagram 3] FIG. 11 is a diagram showing an example of a confirmation result in the first embodiment. [Figure 4] 1 is a block diagram showing the configurations of a degradation diagnosis device 20 and a terminal device 50 in the first embodiment. [Diagram 5] FIG. 4 is a diagram showing an example of degradation information in the first embodiment. [Figure 6] 3 is a flowchart showing the overall operation of the degradation diagnosis system 10 in the first embodiment. [Figure 7] 5 is a flowchart showing details of a diagnosis process (step S11) in the first embodiment. [Figure 8] FIG. 11 is a diagram showing another example of degradation information in the first embodiment. [Figure 9] FIG. 2 is a diagram showing an example of a degradation location map screen of degradation diagnosis device 20 in the first embodiment. [Figure 10] FIG. 4 is a diagram showing an example of a degradation information screen in the first embodiment. [Figure 11] FIG. 2 is a diagram showing an example of a degradation location map screen of the terminal device 50 in the first embodiment. [Figure 12] 6 is a flowchart showing details of route guidance processing (step S17) in the first embodiment. [Figure 13] FIG. 4 is a diagram showing an example of a route guidance screen in the first embodiment. [Figure 14] FIG. 11 is a diagram showing an example of a degradation position notification screen in the first embodiment. [Figure 15] FIG. 11 is a diagram showing an example of a confirmation result input screen in the first embodiment. [Figure 16] 10 is a flowchart showing details of an association process (step S21) in the first embodiment. [Figure 17] FIG. 11 is a diagram showing another example of the degradation location map screen of degradation diagnosis device 20 in the first embodiment. [Figure 18] FIG. 11 is a diagram showing another example of the degradation information screen in the first embodiment. [Figure 19] FIG. 11 is a diagram showing an example of a definition of a display mode of deterioration on a deterioration location map screen in the first embodiment. [Figure 20] FIG. 11 is a diagram showing still another example of degradation information in the first embodiment. [Figure 21] FIG. 11 is a diagram showing still another example of the degradation location map screen in the first embodiment. [Figure 22] 5A to 5C are diagrams illustrating an example of a transition of a display mode of deterioration in the first embodiment. [Diagram 23] 10A to 10C are diagrams illustrating another example of the transition of the display mode of deterioration in the first embodiment. [Figure 24] FIG. 11 is a diagram showing an example of a diagnosis result selection screen in the second embodiment. [Diagram 25] FIG. 11 is a block diagram showing a configuration of a degradation diagnosis device 1 in a third embodiment. [Figure 26] FIG. 5 is a block diagram showing an example of the hardware configuration of a computer 500. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] The embodiments will be described in detail with reference to the drawings. In each drawing and each embodiment described in the specification, the same components are given the same reference numerals, and the description will be omitted as appropriate.

[0014] (First embodiment) A first embodiment will be described.

[0015] First, the overall configuration of the degradation diagnosis system in the first embodiment will be described. Fig. 1 is a diagram showing the configuration of a degradation diagnosis system 10 in the first embodiment. Referring to Fig. 1, the degradation diagnosis system 10 includes a degradation diagnosis device 20, a display device 30, a plurality of vehicles 40_1, 40_2, ... 40_N (N is a natural number) (hereinafter, collectively referred to as vehicles 40), and terminal devices 50_1, 50_2, ... 50_M (M is a natural number) (hereinafter, collectively referred to as terminal devices 50).

[0016] Deterioration diagnosis device 20 and vehicle 40 are connected via a communication network, etc. Deterioration diagnosis device 20 and terminal device 50 are also connected via a communication network, etc.

[0017] The vehicle 40 belongs to a road management organization, such as a local government or a road management company. The vehicle 40 captures road images using an image sensor, such as a drive recorder camera, and transmits the image data together with the shooting position and shooting date and time as image information to the deterioration diagnosis device 20. The vehicle 40 also detects the vertical acceleration of the vehicle 40 using an acceleration sensor, and transmits the detected position and detection date and time as acceleration information to the deterioration diagnosis device 20. Hereinafter, information detected by a sensor mounted on the vehicle, such as image information and acceleration information, will also be referred to as sensor information.

[0018] Deterioration diagnosis device 20 and display device 30 are arranged, for example, in the above-mentioned road management agency. Deterioration diagnosis device 20 and display device 30 may be integrated or separate. Furthermore, deterioration diagnosis device 20 may be arranged in a location other than the above-mentioned road management agency. In this case, deterioration diagnosis device 20 may be realized by a cloud computing system.

[0019] The deterioration diagnosis device 20 diagnoses road deterioration based on the sensor information transmitted from each vehicle 40. Here, the deterioration diagnosis device 20 detects road surface deterioration such as "cracks", "ruts", "potholes", and "abnormal flatness" through diagnosis. Publicly known techniques are used for diagnosing road deterioration based on sensor information. The deterioration diagnosis device 20 outputs the diagnosis results to the road administrator or worker of the road management agency via the display device 30 or terminal device 50.

[0020] Fig. 2 is a diagram showing an example of a diagnosis result in the first embodiment. As shown in Fig. 2, the diagnosis result includes information acquisition date and time, detection position, detection type, detection state, and diagnosis image. Here, the information acquisition date and time indicates the acquisition date and time of the sensor information of the diagnosis target (the capture date and time of the image information or the capture date and time of the acceleration information). The detection position indicates the detection position of the deterioration detected by the diagnosis. The detection position may be the acquisition position of the sensor information of the diagnosis target (the capture position of the image information or the capture position of the acceleration information).

[0021] The detection type indicates the deterioration type detected by the diagnosis. Examples of the deterioration type include "cracks", "rutting", "potholes", and "abnormal flatness" that have occurred on the road surface. The detection state indicates the degree of deterioration according to the detection type. For example, the crack rate is used for the detection type "cracks", and the rutting amount is used for the detection type "rutting". Here, the crack rate is a value indicating the ratio between the area of ​​deterioration included in the road image captured at the detection position (photographing position) and the area of ​​the road included in the image. For example, the International Roughness Index (IRI) may be used for the detection type "abnormal flatness". The IRI is a deterioration index that indicates the flatness of the road (irregularities of the road) calculated based on the upward and downward acceleration included in the acceleration information acquired at the detection position. As the degree of deterioration, the Maintenance Control Index (MCI) may be used. The MCI is a composite deterioration index calculated from the crack rate, the amount of rutting, the flatness, etc. The diagnosis image indicates image data of image information related to the road image to be diagnosed.

[0022] The terminal device 50 is carried by a worker or the like of the road management organization. The terminal device 50 is, for example, a tablet or a smartphone. The worker refers to the diagnosis result output to the terminal device 50 and goes to the location where the detected deterioration is occurring (hereinafter also referred to as the on-site) and directly confirms the deterioration by visual inspection or the like. The worker who has confirmed the deterioration on-site transmits the deterioration confirmation result to the deterioration diagnosis device 20 using the terminal device 50.

[0023] FIG. 3 is a diagram showing an example of a confirmation result in the first embodiment. The confirmation result includes, for example, a confirmation date and time, a confirmation position, a confirmation type, a comment, a confirmation image, and a repair state. Here, the confirmation date and time indicates the date and time when the deterioration was confirmed on-site. For example, the confirmation date and time is set to the photographed date and time of the confirmation image. Note that, for the confirmation date and time, the date and time when the confirmation result is transmitted, or the date and time when the confirmation type or comment is input by the worker may be set to the confirmation date and time. The confirmation position indicates the position of the deterioration confirmed on-site. For example, the photographed position of the confirmation image is set to the confirmation position. Note that, for the confirmation position, the position of the terminal device 50 at the time when the confirmation result is transmitted, or the time when the confirmation type or comment is input by the worker may be set to the confirmation position. The confirmation type indicates the type of deterioration confirmed on-site, which is input by the worker. The comment is a comment about the deterioration confirmed on-site, which is input by the worker. The confirmation image is image data of the deterioration confirmed on-site. For example, the image data of the confirmation image is designated by the worker from one or more image data of the deterioration photographed by the worker when the worker goes to the site and confirms the deterioration. The repair status indicates whether the deterioration confirmed on-site has been repaired. If the deterioration has been repaired, the repair status is set to "repaired." If the deterioration has not been repaired, the repair status is set to "not repaired." Repairs are performed, for example, when an operator confirms the deterioration on-site. Repairs may also be performed after the operator confirms the deterioration on-site. The confirmation result may further include the name and identifier of the operator who performed the confirmation, and the identifier of the terminal device 50 used for the confirmation work.

[0024] Degradation diagnosis device 20 stores the confirmation result received from terminal device 50 in association with the diagnosis result.

[0025] In this embodiment, the mobile body that transmits the sensor information is described as a vehicle 40, but the mobile body may be a bicycle, a drone, or a person as long as it can acquire sensor information and transmit it to the deterioration diagnosis device 20.

[0026] In addition, in this embodiment, the subject of the deterioration diagnosis based on the sensor information is deterioration of the pavement on the road (deterioration of the road surface), and the above-mentioned deterioration type is detected as a result of the diagnosis. However, the subject of the deterioration diagnosis is not limited to this, and may be repair materials such as sealing materials, white lines, guardrails, signs, road signs, street lights, etc., installed on the road. In this case, the type of the item whose deterioration is detected is output as a result of the diagnosis. In addition, as the above-mentioned detection type, the type of the item whose deterioration is detected, such as these repair materials, white lines, guardrails, signs, road signs, street lights, etc., is used instead of the deterioration type. Furthermore, the subject of the diagnosis based on the sensor information is not limited to deterioration, and may be an obstacle such as snow accumulation or fallen objects on the road. In this case, the type of the detected obstacle is output as a result of the diagnosis. In addition, as the above-mentioned detection type, the type of the detected obstacle, such as snow accumulation or fallen objects, is used instead of the deterioration type, and the amount or size of the detected obstacle, such as the amount of snow accumulation or the size of fallen objects, is used as the detection state instead of the above-mentioned deterioration degree.

[0027] Furthermore, the object of deterioration diagnosis may be an airport runway, taxiway, waiting area, railway track, or other road on which vehicles other than automobiles travel.

[0028] Furthermore, the object of deterioration diagnosis is not limited to roadside structures, but may be any structure such as various buildings, facilities, equipment, etc., installed on the ground, so long as it is diagnosed based on sensor information collected by a mobile object.

[0029] Next, a description will be given of the configurations of degradation diagnosis device 20 and terminal device 50 in the first embodiment. Fig. 4 is a block diagram showing the configurations of degradation diagnosis device 20 and terminal device 50 in the first embodiment.

[0030] As shown in FIG. 4, degradation diagnostic device 20 includes a degradation diagnostic section 21, a degradation information processing section 22, a display control section 23, and a transmission / reception section .

[0031] The deterioration diagnosis unit 21 includes a sensor information acquisition unit 24 , a sensor information storage unit 25 , an analysis unit 26 , and an analysis model storage unit 27 .

[0032] The sensor information acquisition unit 24 acquires sensor information from each of the vehicles 40 .

[0033] The analysis unit 26 performs deterioration diagnosis based on the acquired sensor information using known technology, i.e., determines the presence or absence and type of deterioration by analyzing the sensor information. For example, the deterioration diagnosis device 20 analyzes image information using an analysis model that has been trained by machine learning on images of road deterioration. The analysis unit 26 then calculates the degree of deterioration for the detected deterioration. The analysis unit 26 outputs the diagnosis result to the deterioration information processing unit 22.

[0034] The analytical model storage unit 27 stores the analytical model used by the analysis unit 26 .

[0035] The degradation information processing unit 22 includes a degradation information storage unit 29 and a degradation information generating unit 31 .

[0036] The degradation information generating unit 31 generates degradation information. The degradation information is information in which the diagnosis result input from the analysis unit 26 is associated (linked) with the confirmation result received from the terminal device 50. FIG. 5 is a diagram showing an example of degradation information in the first embodiment. As shown in FIG. 5, the degradation information includes a degradation ID (IDentifier), a diagnosis result, and a confirmation result. The degradation ID is an identifier that uniquely identifies the degradation detected by the degradation diagnosis unit 21. The degradation ID is assigned by the degradation information generating unit 31. The degradation information generating unit 31 associates (links) the diagnosis result with the confirmation result based on the detection position included in the diagnosis result and the confirmation position included in the confirmation result.

[0037] The degradation information storage unit 29 stores the degradation information generated by the degradation information generation unit 31 .

[0038] Based on the deterioration information, the display control unit 23 causes a map screen showing the detected position of deterioration (hereinafter, deterioration position map screen) and a screen showing the deterioration information specified on the deterioration position map screen (hereinafter, also referred to as deterioration information screen) to be displayed on the display device 30 and the terminal device 50. The display control unit 23 displays the detected position of deterioration on the deterioration position map screen in a different display mode depending on the presence or absence of a confirmation result, etc.

[0039] The transmitting / receiving unit 28 transmits a degradation location map screen, a degradation information screen, and the contents of the degradation information (for example, the location where degradation was detected) in response to a request from the terminal device 50. In addition, the transmitting / receiving unit 28 receives a confirmation result from the terminal device 50.

[0040] As shown in FIG. 4, the terminal device 50 includes a transmission / reception unit 51, a position acquisition unit 52, a guidance unit 53, an imaging unit 54, a display unit 55, and an input unit 56.

[0041] Transmitting / receiving unit 51 receives the degradation location map screen, the degradation information screen, and the contents of the degradation information (for example, the location where degradation was detected) from degradation diagnosis device 20. Transmitting / receiving unit 51 also transmits the confirmation result to degradation diagnosis device 20.

[0042] The position acquisition unit 52 acquires position information indicating the position of the terminal device 50. The position acquisition unit 52 acquires the position information using, for example, a Global Positioning System (GPS).

[0043] The guidance unit 53 performs route guidance to the detection position based on the position of the terminal device 50 acquired by the position acquisition unit 52 and the detection position of the deterioration received from the deterioration diagnosis device 20. The guidance unit 53 also notifies the worker that the terminal device 50 is approaching the detection position of the deterioration.

[0044] The imaging unit 54 captures video and still images. During route guidance, the imaging unit captures an image of the road in the travel direction. The imaging unit 54 also captures an image of the confirmed deterioration in response to an operation by an operator. The imaging unit 54 is, for example, a camera mounted on a tablet or a smartphone.

[0045] Display unit 55 displays on a map the detected position of the deterioration received from deterioration diagnosis device 20. Display unit 55 also displays the route acquired by guidance unit 53. Display unit 55 further displays an input screen for the worker to input the confirmation result. Display unit 55 is, for example, the display of a tablet or a smartphone.

[0046] The input unit 56 receives input of operation instructions and deterioration confirmation results from the worker to the terminal device 50. The input unit 56 is, for example, a touch panel provided on the display surface of a tablet or a smartphone.

[0047] The degradation diagnosis unit 21, the degradation information generation unit 31, and the degradation information storage unit 29 are embodiments of the diagnosis means, the association means, and the storage means of the present disclosure, respectively. The display control unit 23 is an embodiment of the display control means of the present disclosure. The display device 30 and the terminal device 50 are an embodiment of the display means of the present disclosure.

[0048] Next, the operation of the first embodiment will be described.

[0049] FIG. 6 is a flowchart showing the overall operation of the degradation diagnosis system 10 in the first embodiment.

[0050] Deterioration diagnosis device 20 of deterioration diagnosis system 10 diagnoses road deterioration based on sensor information transmitted from each vehicle 40, and generates a diagnosis result (step S11).

[0051] FIG. 7 is a flowchart showing details of the diagnosis process (step S11) in the first embodiment.

[0052] Each vehicle 40 transmits the acquired sensor information (image information and acceleration information) to deterioration diagnosis device 20 (step S111).

[0053] In the deterioration diagnosis device 20, the sensor information acquisition unit 24 of the deterioration diagnosis unit 21 acquires sensor information (step S112). The analysis unit 26 diagnoses road deterioration by analyzing the sensor information (step S113). The analysis unit 26 generates a diagnosis result for the deterioration detected by the diagnosis (step S114). For example, the analysis unit 26 generates a diagnosis result as shown in FIG. 2. The analysis unit 26 outputs the diagnosis result to the deterioration information processing unit 22.

[0054] The degradation information generating unit 31 of the degradation information processing unit 22 stores the diagnosis result in the degradation information, and stores it in the degradation information storage unit 29 (step S115). Fig. 8 is a diagram showing another example of degradation information in the first embodiment. For example, as shown in Fig. 8, the degradation information generating unit 31 stores the diagnosis result of Fig. 2 for the degradation ID "D1".

[0055] Next, the display control unit 23 causes the display device 30 to display a deterioration location map screen based on the deterioration information (step S12). FIG. 9 is a diagram showing an example of a deterioration location map screen of the deterioration diagnosis device 20 in the first embodiment. In the example of FIG. 9, a white circle is displayed at the detected position of the deterioration "D1" on the map, and further, a "Deterioration Information" button is displayed. Here, the white circle indicates deterioration for which a confirmation result has not been obtained (not associated). For example, the display control unit 23 causes the display device 30 to display the deterioration location map screen of FIG. 9 based on the deterioration information of FIG. 8.

[0056] The display control unit 23 causes the display device 30 to display a degradation information screen showing degradation information of the degradation specified by the road administrator on the degradation location map screen of the display device 30 (step S13). FIG. 10 is a diagram showing an example of a degradation information screen in the first embodiment. FIG. 10 is an example in which degradation "D1" is specified, and shows the information acquisition date and time, detection type, detection state, and diagnosis image in the diagnosis result of degradation "D1". For example, when the road administrator specifies degradation "D1" on the degradation location map screen of FIG. 9 and presses the "Deterioration Information" button, the display control unit 23 causes the display device 30 to display the degradation information screen of FIG. 10 based on the degradation information of FIG. 8.

[0057] The road administrator checks the deterioration diagnosis results on the deterioration information screen, and if it is determined that on-site confirmation of the deterioration is necessary, instructs an operator to carry out on-site confirmation of the deterioration. The operator carries the terminal device 50 and heads to the site.

[0058] Next, in response to an operation by the worker, guidance unit 53 of terminal device 50 requests a deterioration location map screen from degradation diagnosis device 20 (step S14). In response to the request from terminal device 50, display control unit 23 of degradation diagnosis device 20 transmits the deterioration location map screen to terminal device 50 (step S15).

[0059] The guidance unit 53 of the terminal device 50 causes the display unit 55 to display the received deterioration location map screen (step S16). Here, the guidance unit 53 causes the deterioration location map screen to display the location of the terminal device 50 acquired by the location acquisition unit 52. FIG. 11 is a diagram showing an example of a deterioration location map screen of the terminal device 50 in the first embodiment. In the example of FIG. 11, the current location of the terminal device 50 is indicated by a black triangle on the deterioration location map screen similar to that of FIG. 9, and further, a "route guide" button and a "confirmation result input" button are displayed. For example, the guidance unit 53 causes the display unit 55 to display the deterioration location map screen of FIG. 11.

[0060] In addition, similar to step S13 described above, the guidance unit 53 may accept a designation of deterioration from the worker on the deterioration location map screen, obtain a deterioration information screen for the designated deterioration from the display control unit 23 of the deterioration diagnosis device 20, and display it on the display unit 55.

[0061] Next, the guidance unit 53 provides route guidance to the position where the deterioration was detected (step S17).

[0062] FIG. 12 is a flowchart showing details of the route guidance process (step S17) in the first embodiment. The guidance unit 53 accepts a designation of deterioration from an operator on a deterioration position map screen (step S171). The guidance unit 53 acquires a route from the position of the terminal device 50 to the detection position based on the designated detection position of deterioration and the position of the terminal device 50 (step S172). Here, the guidance unit 53 acquires the route from, for example, a server device (not shown) that provides a map information providing service or the like. The guidance unit 53 may also calculate the route based on map information stored in the terminal device 50. The guidance unit 53 causes the display unit 55 to display a route guidance screen in which the acquired route is shown on the deterioration position map screen.

[0063] Fig. 13 is a diagram showing an example of a route guidance screen in the first embodiment. In the example of Fig. 13, a route from the current position of the terminal device 50 to the detection position of the deterioration "D1" is shown in a thick line on the deterioration position map screen, and a "start guidance" button is also displayed. For example, when the operator specifies the deterioration "D1" on the deterioration position map screen of Fig. 11 and presses the "route guidance" button, the guidance unit 53 displays the route guidance screen of Fig. 13. Then, when the operator presses the "start guidance" button on the route guidance screen of Fig. 13, the guidance unit 53 starts route guidance.

[0064] The guidance unit 53 guides the worker to the detected position along the acquired route (step S173). Here, the guidance unit 53 performs necessary guidance at intersections, branching points, etc., using, for example, well-known navigation technology.

[0065] The guiding unit 53 determines whether the distance between the position of the terminal device 50 and the detected position is equal to or less than a predetermined threshold (step S174).

[0066] When the distance is equal to or less than a predetermined threshold (step S174 / Yes), the guidance unit 53 notifies the worker that the terminal device 50 has approached the detection position of the deterioration (step S175). Here, the guidance unit 53 causes the display unit 55 to display, for example, a deterioration position guidance screen showing the detection position of the deterioration in the road image in the travel direction captured by the imaging unit 54. FIG. 14 is a diagram showing an example of the deterioration position guidance screen in the first embodiment. In the example of FIG. 14, a white circle showing the deterioration "D1" and an icon showing the detection type "crack" are superimposed at a position corresponding to the detection position "LD1" on the road image captured by the imaging unit 54. For example, the guidance unit 53 displays the deterioration position guidance screen of FIG. 14. The worker can easily find the deterioration corresponding to the deterioration detected by the deterioration diagnosis device 20 on site by approaching the point where the circle is superimposed while looking at the deterioration position guidance screen.

[0067] The worker directly confirms, for example, by visual inspection, the deterioration corresponding to the deterioration detected by deterioration diagnosis device 20. Here, the worker uses imaging unit 54 to capture an image of the confirmed deterioration.

[0068] Next, the input unit 56 accepts input of the confirmation result for the confirmed deterioration from the worker (step S18). FIG. 15 is a diagram showing an example of a confirmation result input screen in the first embodiment. In the example of FIG. 15, input fields for the confirmation type, comment, repair state, and image data of the confirmation image are displayed on the deterioration location map screen along with the confirmation date and time and the confirmation location, and further a "Send" button is displayed. For example, when the worker presses the "Input confirmation result" button on the deterioration location map screen of FIG. 11, the input unit 56 displays the confirmation result input screen of FIG. 15. Then, when the worker specifies image data of the confirmation image on the confirmation result input screen of FIG. 15, the input unit 56 displays the shooting date and time of the confirmation image and the shooting location in the confirmation date and time and confirmation location.

[0069] Transmitting / receiving unit 51 transmits the confirmation result to degradation diagnosis device 20 (step S19). For example, when the operator presses the “Send” button on the confirmation result input screen of FIG. 15, transmitting / receiving unit 51 transmits the confirmation result of FIG. 3 to degradation diagnosis device 20.

[0070] The transmitter / receiver 28 of the degradation diagnosis device 20 receives the confirmation result from the terminal device 50 (step S20). The degradation information generator 31 of the degradation information processing unit 22 associates the received confirmation result with the diagnosis result of the degradation information stored in the degradation information storage unit 29, and stores the result in the degradation information (step S21).

[0071] FIG. 16 is a flowchart showing details of the association process (step S21) in the first embodiment.

[0072] Deterioration information generating unit 31 of deterioration diagnosis device 20 extracts a diagnosis result that satisfies an association condition with the confirmation result received in step S20 from among the diagnosis results that are not associated with a confirmation result in the deterioration information (step S211). Here, as the association condition, for example, a condition that the distance between the detection position in the diagnosis result and the confirmation position in the confirmation result is equal to or less than a predetermined threshold (hereinafter also referred to as condition 1) is used.

[0073] In addition to condition 1, the time difference between the information acquisition date and time in the diagnosis result and the confirmation date and time in the confirmation result may be less than a predetermined threshold (hereinafter also referred to as condition 2), that is, the AND condition of condition 1 and condition 2 may be used as the association condition.

[0074] In addition to condition 1, the detection type of the diagnosis result and the confirmation type of the confirmation result may be the same (hereinafter also referred to as condition 3), that is, the AND condition of condition 1 and condition 3 may be used as the association condition.

[0075] Moreover, the AND condition of conditions 1, 2, and 3 may be used as the association condition.

[0076] The degradation information generating unit 31 associates the extracted diagnosis result with the confirmation result, stores the result in the degradation information, and stores the result in the degradation information storing unit 29 (step S212).

[0077] For example, when the above-mentioned condition 1 is used as the association condition, and the distance between the confirmation position "LC1" of the confirmation result in Fig. 3 and the detection position "LD1" of the diagnosis result of the deterioration "D1" in the deterioration information in Fig. 8 is equal to or less than a predetermined threshold, the degradation information generation unit 31 extracts the diagnosis result of the deterioration "D1". Then, the degradation information generation unit 31 associates the confirmation result in Fig. 3 with the diagnosis result of the deterioration "D1" as in Fig. 5.

[0078] If a diagnosis result that satisfies the association condition with the confirmation result cannot be extracted in step S211, the degradation information generating unit 31 may store the confirmation result received in step S20 in the degradation information as a new degradation. In this case, the degradation information generating unit 31 may, for example, assign a new degradation ID to the confirmation result and store it in the degradation information.

[0079] Next, the display control unit 23 causes the display device 30 to display a deterioration location map screen based on the updated deterioration information (step S22). FIG. 17 is a diagram showing another example of the deterioration location map screen of the deterioration diagnosis device 20 in the first embodiment. In the example of FIG. 17, a gray circle is displayed at the detection position of the deterioration "D1" on the map. Here, the gray circle indicates the deterioration for which a confirmation result has been obtained (associated). For example, the display control unit 23 causes the display control unit 23 to display the deterioration location map screen of FIG. 17 based on the deterioration information of FIG. 5.

[0080] The display control unit 23 causes the display device 30 to display a deterioration information screen showing the deterioration specified by the road administrator on the deterioration location map screen of the display device 30 (step S23). FIG. 18 is a diagram showing another example of the deterioration information screen in the first embodiment. FIG. 18 is an example in which deterioration "D1" is specified, and in addition to the information acquisition date and time, detection type, detection state, and diagnosis image in the diagnosis result of deterioration "D1", the confirmation date and time, confirmation type, comment, repair state, and confirmation image in the confirmation result are shown. For example, when the road administrator specifies deterioration "D1" on the deterioration location map screen of FIG. 17 and presses the "Deterioration information" button, the display control unit 23 causes the display device 30 to display the deterioration information screen of FIG. 18 based on the deterioration information of FIG. 5.

[0081] Furthermore, similarly to steps S14 to S16 described above, terminal device 50 may also receive from degradation diagnosis device 20 a degradation location map screen and a degradation information screen based on the updated degradation information, and display them.

[0082] Thereafter, when new sensor information is transmitted from vehicle 40 to degradation diagnosis device 20, the operations from step S11 are executed.

[0083] For example, when a diagnosis of new sensor information detects a deterioration of the same detection type as the already detected deterioration in the vicinity of the detection position of the already detected deterioration, the deterioration information generating unit 31 judges the deterioration due to the new diagnosis to be the same as the already detected deterioration. Here, "vicinity" means that the distance is within a predetermined range. In this case, the deterioration information generating unit 31 updates the diagnosis result of the already detected deterioration in the deterioration information with the new diagnosis result.

[0084] On the other hand, if a diagnosis of new sensor information detects a deterioration of a detection type different from that of the previously detected deterioration near the detection position of the previously detected deterioration, the deterioration information generating unit 31 judges the deterioration caused by the new diagnosis as a new deterioration. In this case, the deterioration information generating unit 31 registers the new diagnosis result in the deterioration information as a diagnosis result of the new deterioration.

[0085] This completes the operation of the first embodiment.

[0086] (Modification 1 of the first embodiment) In the above description, the deterioration location map shows deterioration not associated with a confirmation result in the deterioration information and deterioration associated with a confirmation result in different ways (white circles and gray circles). This is not limiting, and deterioration may be displayed in other ways according to the content of the deterioration information. In this case, deterioration may be displayed using, for example, different symbols, figures, characters, patterns, colors, sizes, line types, or combinations thereof according to the content of the deterioration information.

[0087] Fig. 19 is a diagram showing an example of definition of the display mode of deterioration on the deterioration location map screen in the first embodiment. In the example of Fig. 19, different figures are defined according to whether or not the deterioration information is associated with the confirmation result (confirmation result: yes or no), whether or not the detection type of the diagnosis result is the same as or different from the confirmation type of the confirmation result (type: same or different), and whether or not the repair is performed as indicated by the repair status of the confirmation result (repair: done or not).

[0088] The display control unit 23 determines the display mode (figure) of the degradation for each degradation included in the degradation information according to the content of the degradation information, and displays it at the position on the map where the degradation is detected.

[0089] Fig. 20 is a diagram showing yet another example of the deterioration information in the first embodiment. Also, Fig. 21 is a diagram showing yet another example of the deterioration location map screen in the first embodiment. For example, the display control unit 23 causes the display device 30 to display the deterioration location map screen in Fig. 21 based on the definition of the display mode in Fig. 19 and the deterioration information in Fig. 20.

[0090] (Modification 2 of the first embodiment) When a diagnosis of new sensor information detects a deterioration of the same detection type as that of a previously detected deterioration in the vicinity of the detection position of the deterioration, the deterioration information generating unit 31 may determine whether or not the detection state (degree of deterioration) has deteriorated. Here, when the detection state in the new diagnosis result is worse than the previous diagnosis result, the deterioration information generating unit 31 may delete the associated confirmation result and notify the road administrator of the deterioration of the detection state. For example, when the difference between the detection state in the new diagnosis result and the detection state in the previous diagnosis result is equal to or greater than a predetermined threshold, the deterioration information generating unit 31 determines that the detection state has deteriorated.

[0091] Fig. 22 is a diagram showing an example of the transition of the display mode of the deterioration in the first embodiment. In the example of Fig. 22, the previous diagnosis result of the detection position "LD1" of the deterioration "D1" is described as the first diagnosis result, and the new diagnosis result in the vicinity of the detection position "LD1" is described as the second diagnosis result. Moreover, the display mode of the deterioration in Fig. 22 follows the definition in Fig. 19.

[0092] For example, when the predetermined threshold value for the detection condition "crack rate" is "5%", in case 1 of FIG. 22, the difference in the detection condition is less than the predetermined threshold value, so the confirmation result is not deleted. Therefore, the "gray circle" displayed at the time when the confirmation result is obtained for the first diagnosis result does not change even when the second diagnosis result is obtained. On the other hand, in case 2 of FIG. 22, the difference in the detection condition is equal to or greater than the predetermined threshold value, so the confirmation result is deleted. Therefore, the display mode "gray circle" displayed at the time when the confirmation result is obtained for the first diagnosis result is returned to a "white circle" at the time when the second diagnosis result is obtained. Then, a pop-up notifies the user of the deterioration of the detection condition.

[0093] This allows road administrators to know when the detected deterioration has worsened, and they can determine whether rechecking is necessary on-site and instruct workers to do so.

[0094] (Modification 3 of the first embodiment) When a diagnosis of new sensor information detects deterioration of the same detection type as the deterioration in the vicinity of the detection position of the deterioration that has been detected and repaired, there is a possibility that the repair trace is erroneously detected as deterioration. In this case, the deterioration information generating unit 31 may notify the maintenance person of the deterioration diagnosis device 20 of the new diagnosis result and have them confirm whether it is a false detection or not. If the confirmation by the maintenance person or the like indicates a false detection, the deterioration information generating unit 31 does not update the diagnosis result in the deterioration information. On the other hand, if it is not a false detection, the deterioration information generating unit 31 may register the new diagnosis result in the deterioration information as a diagnosis result of a new deterioration and notify the road administrator of the detection of the new deterioration. In this way, by notifying the maintenance person of the new diagnosis result in the vicinity of the detection position of the deterioration that has been detected and repaired, the maintenance person can confirm the data that causes the false detection, which can be useful for improving the accuracy of the diagnosis result of the deterioration diagnosis device 20. Note that the confirmation of the false detection may be performed by a person other than the maintenance person, such as the road administrator.

[0095] Fig. 23 is a diagram showing another example of the transition of the display mode of deterioration in the first embodiment. In the example of Fig. 23, the previous diagnosis result of the detection position "LD1" of the repaired deterioration "D1" is described as the first diagnosis result, and the new diagnosis result in the vicinity of the detection position "LD1" is described as the second diagnosis result. The display mode of deterioration in Fig. 23 also follows the definition in Fig. 19.

[0096] For example, in case 1 of FIG. 23, the check result by the maintenance person or the like is a false positive, so the diagnosis result is not updated. Therefore, the "gray square" displayed at the time when the check result is obtained for the first diagnosis result does not change even when the second diagnosis result is obtained. On the other hand, in case 2 of FIG. 23, the check result by the maintenance person or the like is not a false positive, so the second diagnosis result is registered as the diagnosis result of a new degradation "D6". Therefore, further, a "white circle" is displayed for the second diagnosis result. And a pop-up notifies the detection of the new degradation.

[0097] This allows road administrators to know when new deterioration has occurred near repaired deterioration, and can determine the need for on-site inspection and instruct workers to do so.

[0098] (Fourth Modification of the First Embodiment) In the first embodiment, the conditions for associating the diagnosis result with the confirmation result include the conditions related to the date and time and the deterioration type in addition to the position. However, the present invention is not limited to this, and a condition related to the shooting direction may also be used.

[0099] For example, the degradation diagnosis device 20 acquires sensor information including the shooting direction of the road image from the vehicle 40, includes the sensor information in the diagnosis result, and stores the deterioration information in addition to the diagnosis result. The shooting direction of the road image is acquired, for example, by a gyro sensor mounted on the vehicle. In addition, the degradation diagnosis device 20 acquires a confirmation result including the shooting direction of the confirmation image from the terminal device 50. The shooting direction of the confirmation image is also acquired, for example, by the gyro sensor of the terminal device 50.

[0100] In the above-mentioned association process (step S21), the degradation information generating unit 31 sets the difference between the shooting direction of the diagnosis result and the shooting direction of the confirmation result to be equal to or less than a predetermined threshold as condition 4. Then, the degradation information generating unit 31 associates the diagnosis result with the confirmation result using the AND condition of condition 1 and condition 4, the AND condition of conditions 1, 2, and 4, the AND condition of conditions 1, 3, and 4, and the AND condition of conditions 1, 2, 3, and 4 as association conditions.

[0101] This allows for more accurate correlation between diagnostic results and verification results.

[0102] (Fifth Modification of the First Embodiment) In the first embodiment, a case has been described in which the confirmation result is associated with the diagnosis result stored in the degradation information. However, the present invention is not limited to this, and the diagnosis result may be associated with the confirmation result stored in the degradation information.

[0103] For example, there may be cases where a local resident complains about road deterioration, and an operator goes to the location of the reported deterioration and transmits the results of the confirmation of the deterioration to the deterioration diagnosis device 20. In this case, the road administrator accepts complaints about road deterioration at a certain location from local residents. Complaints about deterioration are accepted, for example, at a counter, by telephone, or by email. The road administrator communicates to the operator information about the location of the deterioration and the type and size of the deterioration in the accepted complaint. Based on such information, the operator goes to the site, confirms the reported deterioration, and transmits the confirmation results to the deterioration diagnosis device 20 using the terminal device 50.

[0104] In degradation diagnosis device 20, degradation information generation unit 31 determines whether or not there is a diagnostic result that satisfies the association condition with the received confirmation result. If there is a diagnostic result that satisfies the association condition, degradation information generation unit 31 associates the confirmation result with the diagnostic result.

[0105] If there is no diagnosis result that satisfies the association condition, the degradation information generating unit 31 stores the confirmation result as a new deterioration in the degradation information. In this case, the degradation information generating unit 31, for example, assigns a new deterioration ID to the confirmation result and stores it in the degradation information. Furthermore, the display control unit 23 may thus display the deterioration with which no diagnosis result is associated in the degradation information at the confirmation position on the above-mentioned deterioration position map. In this case, the display control unit 23 may display the deterioration with which no diagnosis result is associated in a manner different from that of the deterioration with which a diagnosis result has been obtained.

[0106] Thereafter, when a new diagnosis result is acquired by the degradation diagnosis unit 21, the degradation information generation unit 31 determines whether or not there is a confirmation result that satisfies the association condition with the new diagnosis result among the confirmation results that are not associated with a diagnosis result in the degradation information. If there is a confirmation result that satisfies the association condition, the degradation information generation unit 31 associates the diagnosis result with the confirmation result. The display control unit 23 may display the deterioration associated with the diagnosis result in this way at the detection position on the deterioration position map in the same manner as the deterioration for which a confirmation result has been obtained, for example, as shown in FIG. 17.

[0107] This makes it possible to associate the diagnosis result with the confirmation result even if the confirmation result for a certain degradation is obtained before the diagnosis result.

[0108] (Effects of the First Embodiment) According to the first embodiment, it is possible to associate the correct confirmation result at the location of occurrence of the deterioration detected based on the sensor information collected by the mobile body. This is because the deterioration information processing unit 22 of the deterioration diagnosis device 20 associates the diagnosis result with the confirmation result based on the location of the deterioration on the road confirmed by the worker and the location of the deterioration detected by the diagnosis.

[0109] Second Embodiment A second embodiment will now be described.

[0110] In the second embodiment, a case will be described in which there are a plurality of diagnostic results that satisfy the condition for associating with the confirmation results in the association process.

[0111] In the above-mentioned association process (step S21), if there are multiple diagnostic results that satisfy the association condition with the confirmation result, the deterioration information generating unit 31 outputs the diagnostic results that satisfy the association condition to the road administrator as association candidates. Then, the deterioration information generating unit 31 accepts a selection of a diagnostic result to be associated with the confirmation result from the association candidates from the road administrator.

[0112] Fig. 24 is a diagram showing an example of a diagnosis result selection screen in the second embodiment. In the example of Fig. 24, the confirmation results, the diagnosis results of deteriorations "D1" and "D7" that satisfy the association condition with the confirmation results, and the "Select" button for each diagnosis result are displayed.

[0113] The road administrator, for example, compares each diagnostic image with the confirmation image to select a diagnostic result to be associated with the confirmation target.

[0114] For example, the deterioration information generation unit 31 causes the display control unit 23 to display the diagnosis result selection screen of Figure 24 on the display device 30, and associates the confirmation result with the diagnosis result selected by the road administrator by pressing the ``Select'' button, and stores it in the deterioration information.

[0115] (Effects of the second embodiment) According to the second embodiment, in addition to the effects of the first embodiment, even if there are multiple diagnostic results that satisfy the association condition with the confirmation result, the correct confirmation result can be associated with the confirmation result. This is because, when there are multiple diagnostic results that satisfy the association condition, the degradation information processing unit 22 outputs the multiple diagnostic results and accepts the selection of a diagnostic result to be associated with the confirmation result from among the multiple diagnostic results. (Third embodiment) A third embodiment will now be described.

[0116] Fig. 25 is a block diagram showing a configuration of a degradation diagnosis device 1 in the third embodiment. The degradation diagnosis device 1 includes a diagnosis unit 2, an association unit 3, and a storage unit 4. The diagnosis unit 2, the association unit 3, and the storage unit 4 are embodiments of the diagnosis means, the association means, and the storage means of the present disclosure, respectively. Moreover, the diagnosis unit 2, the association unit 3, and the storage unit 4 correspond to the degradation diagnosis unit 21, the degradation information generation unit 31, and the degradation information storage unit 29 of the first embodiment, respectively.

[0117] The diagnosis unit 2 diagnoses road deterioration by analyzing sensor information collected by the mobile object and outputs the location of the detected deterioration. The association unit 3 associates the diagnosis result with the confirmation result based on the location of road deterioration confirmed by a person and the location of deterioration detected by the diagnosis. The memory unit 4 stores the associated diagnosis result and confirmation result.

[0118] (Effects of the third embodiment) According to the third embodiment, it is possible to associate the correct confirmation result at the location where the deterioration detected based on the sensor information collected by the mobile body. This is because the associating unit 3 of the deterioration diagnosis device 1 associates the diagnosis result with the confirmation result based on the location of the deterioration on the road confirmed by a person and the location of the deterioration detected by the diagnosis. (Hardware configuration) In each of the above-described embodiments, each component of degradation diagnosis device 20 or terminal device 50 is shown as a functional block. Some or all of the components of each device may be realized by any combination of computer 500 and a program.

[0119] Fig. 26 is a block diagram showing an example of a hardware configuration of a computer 500. Referring to Fig. 26, the computer 500 includes, for example, a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, a RAM (Random Access Memory) 503, a program 504, a storage device 505, a drive device 507, a communication interface 508, an input device 509, an output device 510, an input / output interface 511, and a bus 512.

[0120] The program 504 includes instructions for implementing each function of each device. The program 504 is stored in advance in the ROM 502, the RAM 503, or the storage device 505. The CPU 501 implements each function of each device by executing instructions included in the program 504. For example, the CPU 501 of the degradation diagnosis device 20 implements the functions of the display control unit 23, the sensor information acquisition unit 24, the analysis unit 26, the transmission / reception unit 28, and the degradation information generation unit 31 by executing instructions included in the program 504. Also, for example, the RAM 503 of the degradation diagnosis device 20 may store data of the analysis model storage unit 27. Also, for example, the storage device 505 of the degradation diagnosis device 20 may store data of the sensor information storage unit 25 and the degradation information storage unit 29.

[0121] The drive device 507 reads and writes data from and to the recording medium 506. The communication interface 508 provides an interface with a communication network. The input device 509 is, for example, a mouse or a keyboard, and receives information input from an operator or the like. The output device 510 is, for example, a display, and outputs (displays) information to an operator or the like. The input / output interface 511 provides an interface with peripheral devices. The bus 512 connects these hardware components. The program 504 may be supplied to the CPU 501 via a communication network, or may be stored in advance in the recording medium 506, read out by the drive device 507, and supplied to the CPU 501.

[0122] It should be noted that the hardware configuration shown in FIG. 26 is merely an example, and other components may be added, or some components may not be included.

[0123] There are various modified examples of the method of realizing degradation diagnosis device 20 and terminal device 50. For example, degradation diagnosis device 20 may be realized by any combination of a different computer and program for each component. Furthermore, multiple components included in each device may be realized by any combination of a single computer and program.

[0124] In addition, some or all of the components of each device may be realized by general-purpose or dedicated circuits including a processor, etc., or a combination of these. These circuits may be configured by a single chip, or may be configured by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and a program.

[0125] Furthermore, when some or all of the components of each device are realized by a plurality of computers, circuits, etc., the plurality of computers, circuits, etc. may be arranged in a centralized manner or in a distributed manner.

[0126] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, the configurations in each embodiment can be combined with each other without departing from the scope of the present disclosure. [Explanation of symbols]

[0127] 1, 20 Deterioration diagnosis device 2 Diagnostics Department 3 Association section 4 Storage section 10. Deterioration diagnosis system 21 Deterioration diagnosis section 22 Degradation information processing section 23 Display control section 24 Sensor information acquisition unit 25 Sensor information storage unit 26 Analysis Department 27 Analysis model storage section 28, 51 Transmitter / receiver 29 Deterioration information storage section 30 Display device 31 Deterioration information generation section 40 vehicles 50 Terminal Equipment 52 Position acquisition part 53 Information Department 54 Imaging unit 55 Display section 56 Input section 500 Computers 501 CPU 502 ROM 503 RAM 504 Program 505 Storage device 506 Recording media 507 Drive Unit 508 Communication Interface 509 Input Device 510 Output Device 511 Input / Output Interface 512 Bus

Claims

1. a first acquisition means for diagnosing deterioration on a road by analyzing sensor information acquired by a sensor provided in the mobile object, and acquiring first information which is information relating to a position of the diagnosed deterioration; A second acquisition means for acquiring second information from a terminal device, the second information being information regarding a location of deterioration on the road confirmed by a person; and an association means for associating the first information with the second information when the first information and the second information satisfy a predetermined condition. Information processing device.

2. An information processing device as described in Claim 1, wherein the association means associates the first information with the second information when the location of road deterioration acquired by the sensor and the location of road deterioration acquired from the terminal device are within a predetermined distance.

3. The first information includes a deterioration type of a road acquired by the sensor, The second information includes a road deterioration type acquired from the terminal device, The information processing device according to claim 1 or claim 2, wherein the associating means associates the first information with the second information when the road deterioration type acquired by the sensor and the road deterioration type acquired from the terminal device are the same deterioration type.

4. The information processing device according to claim 1 , wherein the second information includes an image of a road taken by a user of the terminal device.

5. a display control means for causing a display means to display the first information and the second information in a superimposed manner on a map; 5. The information processing device according to claim 1, wherein the display control means displays the first information and the second information associated by the association means and the first information and the second information that are not associated on a map in different manners superimposed on the map.

6. The information processing apparatus according to claim 5 , wherein the display control means further causes the first information and the second information to be superimposed on the map in a display mode corresponding to the degradation type included in the first information and the second information.

7. Diagnosing deterioration on a road by analyzing sensor information acquired by a sensor provided in the mobile object, and acquiring first information which is information regarding a location of the diagnosed deterioration; obtaining second information from the terminal device, the second information being information regarding the location of the road deterioration confirmed by a person; If the first information and the second information satisfy a predetermined condition, the first information and the second information are associated with each other. Information processing methods.

8. To your computer Diagnosing deterioration on a road by analyzing sensor information acquired by a sensor provided in the mobile object, and acquiring first information which is information regarding a location of the diagnosed deterioration; obtaining second information from the terminal device, the second information being information regarding the location of the road deterioration confirmed by a person; When the first information and the second information satisfy a predetermined condition, a process of associating the first information with the second information is executed. program.

Images