Information processing apparatus, information processing system, information processing method, and program

Abstract

To provide an information processing device, an information processing system, an information processing method, and a program for appropriately confirming a state of a specific position of an object.SOLUTION: In the state inspection system, a data management device which is an information processing device includes an instruction reception unit (communication unit 51) configured to receive instruction information for instructing generation of an image indicating a specific position in an object, and an image generation unit (generation unit 54) configured to generate, based on the instruction information, a surface display image including a surface image indicating a surface of the object and a surface position image indicating a specific position in the surface image, and a cross-section display image including a cross-section image indicating a cross-section of the object and a cross-section position image indicating a specific position in the cross-section image.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing system, an information processing method, and a program. [Background technology]

[0002] Patent Document 1 describes how measurement and area calculations are performed using a design drawing creation means such as CAD from a composite 3D photograph image 14, and a front view 15 and a cross-sectional view 16 are created that show only the deteriorated areas. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 4155976 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present invention is to appropriately check the state of a specific position on an object. [Means for solving the problem]

[0005] The information processing device according to claim 1 of the present invention comprises an instruction receiving means for receiving instruction information instructing the generation of an image showing a specific position on an object, and an image generating means for generating, based on the instruction information, a surface display image including a surface image showing the surface of the object and a surface position image showing the specific position on the surface image, and a cross-sectional display image including a cross-sectional image showing a cross-section of the object and a cross-sectional position image showing the specific position on the cross-sectional image. [Effects of the Invention]

[0006] The present invention can appropriately check the state of a specific position on an object. [Brief explanation of the drawings]

[0007] [Figure 1] 1 is a diagram showing an example of the overall configuration of a state inspection system according to an embodiment; [Figure 2] FIG. 10 is a diagram showing an example of how a slope condition is inspected using the mobile body system according to the embodiment. [Figure 3] FIG. 10 is a diagram illustrating a problem of the embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of a hardware configuration of a data acquisition device. [Figure 5] FIG. 2 is a diagram illustrating an example of a hardware configuration of an evaluation device and a data management device. [Figure 6] FIG. 2 is a diagram illustrating an example of a functional configuration of a state inspection system. [Figure 7] FIG. 10 is a conceptual diagram illustrating an example of a status type management table. [Figure 8] FIG. 10 is a conceptual diagram illustrating an example of a status type management table. [Figure 9] 1A is a conceptual diagram showing an example of an acquired data management table, and FIG. 1B is a conceptual diagram showing an example of a processed data management table. [Figure 10] FIG. 2 is a diagram for explaining a photographed image acquired by a mobile system. [Figure 11] 1A and 1B are explanatory diagrams of a photographed image and a distance measurement image. [Figure 12] FIG. 10 is a sequence diagram illustrating an example of a data acquisition process using a mobile system. [Figure 13] FIG. 10 is a sequence diagram illustrating an example of a process for generating evaluation target data. [Figure 14] FIG. 10 is a sequence diagram showing an example of a process for generating a report that is an evaluation result of a slope condition. [Figure 15] FIG. 10 is a diagram showing an example of an evaluation screen displayed on the evaluation device. [Figure 16] FIG. 10 is a diagram showing an example of an evaluation screen on which processing data is displayed. [Figure 17] 10 is a flowchart illustrating an example of a process for detecting a slope state. [Figure 18] FIG. 10 is a diagram showing an example of an evaluation screen on which detection results of shape data are displayed. [Figure 19] FIG. 10 is a diagram showing an example of a display screen showing damage detection results. [Figure 20] FIG. 10 is a diagram showing an example of a cross-sectional image of the detected shape of a slope. [Figure 21] FIG. 2 is a diagram illustrating an example of map information. [Figure 22] FIG. 10 is a diagram illustrating an example of site information stored in association with map information. [Figure 23] FIG. 10 is a diagram showing an example of an evaluation report generated by the evaluation device. [Figure 24] FIG. 10 is a diagram showing an example of an evaluation report generated by the evaluation device. [Figure 25] FIG. 10 is a diagram showing an example of an evaluation report generated by the evaluation device. [Figure 26] FIG. 10 is a diagram showing another example of a display screen showing damage detection results. [Figure 27] FIG. 10 is a diagram showing another example of a cross-sectional image of the detected shape of a slope. [Figure 28] FIG. 10 is a diagram illustrating an example of a display screen showing a sign detection result. [Figure 29] FIG. 10 is a diagram illustrating an example of an evaluation report including a sign detection result. [Figure 30] FIG. 10 is a diagram showing another example of an evaluation report including a sign detection result. [Figure 31] FIG. 10 is a diagram showing an example of how a slope condition is inspected using a mobile body system according to Modification 1. [Figure 32] FIG. 10 is a diagram showing an example of how the state of a slope is inspected using a mobile body system according to Modification 2. [Figure 33] FIG. 11 is a diagram showing an example of how the state of a slope is inspected using a mobile body system according to Modification 3. [Figure 34] FIG. 10 is a sequence diagram illustrating an example of a display process in the state inspection system. [Figure 35] FIG. 10 is an explanatory diagram of operations on the display screen of the state inspection system. [Figure 36] 34 is a flowchart showing a process based on the operation shown in FIG. 33. [Figure 37] 35 is an example of a display screen after the processing shown in FIG. 34. [Figure 38] 10 is a specific example of a cross-sectional display image displayed on a display screen. [Figure 39] FIG. 2 is an explanatory diagram of a cross-sectional display image displayed on a display screen. [Figure 40] FIG. 10 is an explanatory diagram of operations on the display screen. [Figure 41] 39 is a flowchart showing a process based on the operation shown in FIG. 38. [Figure 42] 40 is an example of a display screen after the processing shown in FIG. 39. [Figure 43] 10 is a flowchart showing a process for confirming a position of a deformation or a position of a predicted deformation. [Figure 44] 10 is a flowchart showing a process related to surface image analysis. [Figure 45] 43 is an example of a display screen after the processing shown in FIG. 42. [Figure 46] 10 is a flowchart showing a process related to cross-sectional image analysis. [Figure 47] 10 is a flowchart showing a process relating to surface image comparison. [Figure 48] 46 is an example of a display screen after the processing shown in FIG. 45. [Figure 49] 10 is a flowchart showing a modified example of the process relating to surface image comparison. [Figure 50] 10 is a flowchart showing a process relating to cross-sectional image comparison. [Figure 51] FIG. 10 is an explanatory diagram of operations on a display screen relating to a 3D image. [Figure 52] 50 is a flowchart showing a process based on the operation shown in FIG. 49. [Figure 53] 51 is an example of a display screen after the processing shown in FIG. 50. [Figure 54] 35 is a flowchart showing a modified example of the process shown in FIG. 34. [Figure 55] 53 is an example of a display screen after the processing shown in FIG. 52. [Figure 56]35 is a flowchart showing a second modified example of the process shown in FIG. 34. [Figure 57] 55 is an example of a display screen after the processing shown in FIG. 54. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the description of the drawings, the same elements are given the same reference numerals, and duplicated explanations will be omitted.

[0009] First embodiment ●System overview First, an overview of the condition inspection system will be described using Figures 1 and 2. Figure 1 is a diagram showing an example of the overall configuration of a condition inspection system according to an embodiment. The condition inspection system 1 shown in Figure 1 is an example of an information processing system, and is a system for inspecting the condition of road earthwork structures using various data acquired by a mobile system 60. Road earthwork structures are a general term for structures constructed to build roads using soil materials such as earth and rock as their main materials, as well as structures associated with them, and refer to cut and slope stabilization facilities, embankments, culverts, and similar structures. Hereinafter, road earthwork structures will be referred to as slopes.

[0010] The condition inspection system 1 is composed of a mobile system 60, an evaluation system 4, a national or local government terminal device 1100, and a contractor terminal device 1200. The mobile system 60 is composed of a data acquisition device 9 and a mobile body 6 such as a vehicle equipped with the data acquisition device 9. The data acquisition device 9 has an imaging device 7, which is an example of a measurement device that measures structures, as well as a distance sensor 8a and a GNSS (Global Navigation Satellite System) sensor 8b. GNSS is a general term for satellite positioning systems such as the GPS (Global Positioning System) or the Quasi-Zenith Satellite System (QZSS).

[0011] The photographing device 7 is a line camera equipped with a line sensor in which photoelectric conversion elements are arranged in one or more rows. The photographing device 7 photographs a position along a predetermined photographing range on a photographing surface along the traveling direction of the moving object 6. Note that the photographing device is not limited to a line camera, but may be a camera equipped with an area sensor in which photoelectric conversion elements are arranged in a plane. The photographing device may also be composed of multiple cameras.

[0012] The distance sensor 8a is a ToF (Time of Flight) sensor that measures the distance to the subject photographed by the photographing device 7. The GNSS sensor 8b is a positioning means that measures a position on Earth by receiving signals transmitted at different times from multiple GNSS satellites and calculating the distance to the satellite from the difference in the time at which each signal was received. The positioning means may be a device dedicated to positioning, or may be a dedicated positioning application installed on a PC (Personal Computer), smartphone, or the like. The distance sensor 8a and the GNSS sensor 8b are examples of sensor devices. The distance sensor 8a is also an example of a three-dimensional sensor.

[0013] The ToF sensor used as the distance sensor 8a measures the distance from the light source to the object by irradiating the object with laser light from the light source and measuring the scattered and reflected light.

[0014] In this embodiment, the distance sensor 8a is a LiDAR (Light Detection and Ranging) sensor. LiDAR is a method of measuring the time of flight of light using pulses, but as another method of ToF sensors, distance may be measured using a phase difference detection method. In the phase difference detection method, a measurement range is irradiated with laser light amplitude-modulated at a fundamental frequency, and the reflected light is received to measure the phase difference between the irradiated light and the reflected light to obtain time, and the distance is calculated by multiplying this time by the speed of light. Alternatively, the distance sensor 8a may be configured with a stereo camera or the like.

[0015] By using a three-dimensional sensor, the mobile system 60 can obtain three-dimensional information that is difficult to obtain from two-dimensional images, such as the height, inclination angle, or protrusion of a slope.

[0016] The mobile body system 60 may further include an angle sensor 8c. The angle sensor 8c is a gyro sensor or the like for detecting the angle (attitude) or angular velocity (or each acceleration) of the image capturing direction of the image capturing device 7.

[0017] The evaluation system 4 is configured by an evaluation device 3 and a data management device 5. The evaluation device 3 and the data management device 5 constituting the evaluation system 4 can communicate with a mobile system 60, a terminal device 1100, and a terminal device 1200 via a communication network 100. The communication network 100 is configured by the Internet, a mobile communication network, a local area network (LAN), or the like. Note that the communication network 100 may include not only wired communication but also wireless communication networks such as 3G (3rd Generation), 4G (4th Generation), 5G (5th Generation), Wi-Fi (Wireless Fidelity) (registered trademark), WiMAX (Worldwide Interoperability for Microwave Access), or LTE (Long Term Evolution). Furthermore, the evaluation device 3 and the data management device 5 may have communication functions using short-range communication technologies such as NFC (Near Field Communication) (registered trademark).

[0018] The data management device 5 is an example of an information processing device, and is a computer such as a PC that manages various data acquired by the data acquisition device 9. The data management device 5 receives various acquired data from the data acquisition device 9 and transfers the received various acquired data to the evaluation device 3 that performs data analysis. Note that the method of transferring the various acquired data from the data management device 5 to the evaluation device 3 may be manual transfer using a USB (Universal Serial Bus) memory or the like.

[0019] The evaluation device 3 is a computer such as a PC that evaluates the condition of the slope based on various acquired data transferred from the data management device 5. A dedicated application program for evaluating the condition of the slope is installed on the evaluation device 3. The evaluation device 3 detects the type or structure of the slope from the captured image data and sensor data, extracts shape data, and performs a detailed analysis by detecting the presence or absence of deformation and the degree of deformation. The evaluation device 3 also generates a report to be submitted to road administrators such as the national government, local government, or contracted business operator using the captured image data, sensor data, evaluation target data, and the results of the detailed analysis. The report data generated by the evaluation device 3 is submitted to the national government or local government via the contracted business operator as electronic data or printed paper. The report generated by the evaluation device 3 is referred to as an inspection record sheet, inspection sheet, inspection ledger, or report. The evaluation device 3 is not limited to a PC and may also be a smartphone, tablet, or other device. The evaluation system 4 may also be configured such that the evaluation device 3 and the data management device 5 are integrated into a single device or terminal.

[0020] The terminal device 1200 is provided at the entrusted business operator, and the terminal device 1100 is provided at the national or local government. The evaluation device 3, the terminal device 1100, and the terminal device 1200 are examples of communication terminals that can communicate with the data management device 5, and various data managed by the data management device 5 can be viewed.

[0021] 2 is a diagram showing an example of how a slope condition is inspected using a mobile body system according to an embodiment. As shown in Fig. 2, the mobile body system 6, which has a data acquisition device 9 mounted thereon, travels along a road while capturing images of a predetermined range of the slope with an image capture device 7.

[0022] As shown in Figure 2, a cut slope is a slope that has been cut, and a fill slope is a slope that has been filled with soil. Furthermore, the side slopes of a road running along the side of a mountain are called natural slopes. Cut and fill slopes can be made more durable by planting vegetation on their surfaces, allowing them to remain unchanged for decades. However, this is not always the case. When cut and fill slopes and natural slopes deteriorate due to wind and rain, shallow collapses occur, causing rocks and soil to fall from the surface, or the mountain collapses, resulting in road closures. To prevent this, techniques are used to slow the rate of deterioration of slopes exposed to wind and rain by spraying mortar on the surface (mortar spraying) or by installing and hardening concrete structures. Structures constructed using these techniques are called earthwork structures. Earthwork structures include retaining walls installed between natural slopes and roads, and rockfall protection fences that prevent rocks from falling onto roads. Both of these structures are intended to prevent road closures or human injury caused by soil or rocks flowing onto the road.

[0023] In recent years, the deterioration of earthwork structures constructed decades ago has become significant, posing a major challenge for the development of social infrastructure. Therefore, it is important to detect deterioration of earthwork structures early and to inspect and maintain them to ensure their longevity. Conventional inspections of natural slopes and earthwork structures involve investigating rockfalls, collapses, landslides, or debris flows on the slopes and formulating repair plans, which are carried out through visual inspections by experts.

[0024] However, visual inspections by experts have problems with efficiency, such as the inability to inspect all of the large number of earthwork structures throughout Japan in a certain period of time, and the inability to inspect embankments at high altitudes or along rivers. In addition, visual inspections are unable to quantitatively grasp the degree of deterioration, such as cracks or peeling that occur on the surface of earthwork structures.

[0025] Therefore, the condition inspection system 1 according to the embodiment acquires photographed image data of the slope of an earthwork structure using the photographing device 7, and acquires sensor data including three-dimensional information using a three-dimensional sensor such as a distance sensor 8a. The evaluation system 4 then combines the acquired photographed image data and sensor data to evaluate the condition of the slope, thereby detecting shape data indicating the three-dimensional shape of the slope and detecting abnormalities such as cracks and peeling. This allows the condition inspection system 1 to efficiently perform evaluations that are difficult to inspect visually by humans.

[0026] Figure 3 is a diagram illustrating the problem of the embodiment. Figure 3(a) is an image showing the surface of the slope five years before the collapse, and Figure 3(b) is an explanatory diagram of the image shown in Figure 3(a). At this stage, cracks in the surface layer of the slope are noticeable, and image analysis shown in a development drawing or the like is effective in detecting surface layer deformation or signs of deformation such as cracks, peeling, and seepage.

[0027] Figure 3(c) is an image showing the surface of the slope two years before the collapse, and Figure 3(d) is an explanatory diagram of the image shown in Figure 3(c). In this state, the inside of the slope has become soil and sand, which has pushed against the surface of the slope, causing the slope to bulge. In order to detect three-dimensional deformation such as cracks, steps, and protrusions, three-dimensional analysis of images such as development drawings plus cross-sections is effective.

[0028] Figure 3(d) is an image showing the surface of the slope five years before the collapse, and Figure 3(b) is an explanatory diagram of the image shown in Figure 3(a). In this state, the surface of the slope was unable to contain the soil and sand, and collapsed.

[0029] To address the above-mentioned issues, the configuration of Patent Document 1 described above makes it possible to confirm the location of the deteriorated area and its internal condition from the front view and cross-sectional view. However, there is room for improvement in terms of visually confirming, for example, where in the front view a cavity shown in the cross-sectional view is located when comparing the front view and the cross-sectional view.

[0030] In view of these problems, the present embodiment aims to provide a data management device 5, a condition inspection system 1, an information processing method and a program executed by the data management device 5 or evaluation device 3, etc., which can properly check the condition of a specific position on a slope by comparing an image of the surface of a slope, which is an example of an object, with an image of the cross section of the slope.

[0031] ●Hardware configuration Next, the hardware configuration of each device constituting the status inspection system 1 will be described with reference to Figures 4 and 5. Note that components may be added or deleted from the hardware configuration shown in Figures 4 and 5 as necessary.

[0032] ○Hardware configuration of data acquisition device○ 4 is a diagram showing an example of the hardware configuration of a data acquisition device 9. The data acquisition device 9 includes the image capture device 7 and the sensor device 8 as shown in FIG. 1, as well as a controller 900 that controls the processing or operation of the data acquisition device 9.

[0033] The controller 900 includes an imaging device I / F (Interface) 901, a sensor device I / F 902, a bus line 910, a CPU (Central Processing Unit) 911, a ROM (Read Only Memory) 912, a RAM (Random Access Memory) 913, a HD (Hard Disk) 914, an HDD (Hard Disk Drive) controller 915, a network I / F 916, a DVD-RW (Digital Versatile Disk Rewritable) drive 918, a media I / F 922, an external device connection I / F 923, and a timer 924.

[0034] Of these, the imaging device I / F 901 is an interface for transmitting and receiving various data or information to and from the imaging device 7. The sensor device I / F 902 is an interface for transmitting and receiving various data or information to and from the sensor device 8. The bus line 910 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 911 shown in FIG. 4.

[0035] Furthermore, the CPU 911 controls the overall operation of the data acquisition device 9. The ROM 912 stores programs used to drive the CPU 911, such as the IPL. The RAM 913 is used as a work area for the CPU 911. The HD 914 stores various data such as programs. The HDD controller 915 controls the reading and writing of various data from and to the HD 914 under the control of the CPU 911. The network I / F 916 is an interface for data communication using the communication network 100. The DVD-RW drive 918 controls reading and writing of various data from and to a DVD-RW 917, which is an example of a removable recording medium. The medium is not limited to a DVD-RW, and may be a DVD-R or a Blu-ray (registered trademark) Disc. The media I / F 922 controls reading and writing (storing) of data from and to a recording medium 921, such as a flash memory. The external device connection I / F 923 is an interface for connecting an external device, such as an external PC 930, which has a display, a reception unit, and a display control unit. The timer 924 is a measuring device with a time measurement function. The timer 924 may be a computer-implemented software timer.

[0036] ○Hardware configuration of evaluation device○ Fig. 5 is a diagram showing an example of the hardware configuration of the evaluation device 3. Each piece of hardware configuration of the evaluation device 3 is indicated by a reference number in the 300 series. As shown in Fig. 5, the evaluation device 3 is constructed by a computer, and includes a CPU 301, a ROM 302, a RAM 303, a HD 304, a HDD controller 305, a display 306, an external device connection I / F 308, a network I / F 309, a bus line 310, a keyboard 311, a pointing device 312, a DVD-RW drive 314, and a media I / F 316.

[0037] Of these, the CPU 301 controls the overall operation of the evaluation device 3. The ROM 302 stores programs, such as an IPL, used to drive the CPU 301. The RAM 303 is used as a work area for the CPU 301. The HD 304 stores various data, such as programs. The HDD controller 305 controls the reading and writing of various data from and to the HD 304 under the control of the CPU 301. The display 306 displays various information, such as a cursor, menus, windows, characters, or images. The display 306 is an example of a display unit. The external device connection I / F 308 is an interface for connecting various external devices. In this case, external devices include, for example, a USB memory or a printer. The network I / F 309 is an interface for data communication using the communication network 100. The bus line 310 is an address bus, a data bus, or the like, for electrically connecting the components, such as the CPU 301, shown in FIG. 5.

[0038] The keyboard 311 is a type of input means having multiple keys for inputting characters, numbers, various instructions, etc. The pointing device 312 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, etc. The DVD-RW drive 314 controls reading and writing of various data from a DVD-RW 313, which is an example of a removable recording medium. Note that this is not limited to a DVD-RW, and may be a DVD-R or Blu-ray Disc, etc. The media I / F 316 controls reading and writing (storing) of data from a recording medium 315, such as a flash memory.

[0039] ○Data management device hardware configuration○ Figure 5 is a diagram showing an example of the hardware configuration of the data management device. Each piece of hardware configuration in the data management device 5 is indicated by a reference number in the 500s in parentheses. As shown in Figure 5, the data management device 5 is constructed by a computer, and as shown in Figure 5, has the same configuration as the evaluation device 3, so a description of each piece of hardware configuration will be omitted. Note that the terminal devices 1100 and 1200 are also constructed by a computer and have the same configuration as the evaluation device 3, but a description of each piece of hardware configuration will be omitted.

[0040] Each of the above programs may be recorded on a computer-readable recording medium as an installable or executable file and distributed. Examples of recording media include CD-Rs (Compact Disc Recordables), DVDs (Digital Versatile Disks), Blu-ray Discs, SD cards, and USB memory sticks. The recording media may also be provided domestically or internationally as program products. For example, the evaluation system 4 according to the embodiment realizes the evaluation method according to the present invention by executing the program according to the present invention.

[0041] ●Function configuration Next, the functional configuration of the state inspection system according to the embodiment will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of the functional configuration of the state inspection system according to the first embodiment. Note that Fig. 6 shows those devices shown in Fig. 1 that are related to the processing or operation described below.

[0042] ○Functional configuration of data acquisition device○ First, the functional configuration of the data acquisition device 9 will be described using FIG. 6. The data acquisition device 9 includes a communication unit 91, a determination unit 92, an image capture device control unit 93, a sensor device control unit 94, a captured image data acquisition unit 95, a sensor data acquisition unit 96, a time data acquisition unit 97, a request reception unit 98, and a storage / readout unit 99. Each of these units is a function or means realized when any of the components shown in FIG. 4 operates in response to an instruction from the CPU 911 in accordance with a program for the data acquisition device loaded from the HD 914 onto the RAM 913. The data acquisition device 9 also includes a storage unit 9000 constructed by the ROM 912 and HD 914 shown in FIG. 4. The external PC 930 connected to the data acquisition device 9 shown in FIG. 4 includes a reception unit and a display control unit.

[0043] The communication unit 91 is mainly realized by processing of the CPU 911 on the network I / F 916, and communicates various data or information with other devices via the communication network 100. The communication unit 91 transmits, for example, acquired data acquired by the captured image data acquisition unit 95 and the sensor data acquisition unit 96 to the data management device 5. The determination unit 92 is realized by processing of the CPU 911, and makes various determinations.

[0044] The imaging device control unit 93 is mainly realized by the processing of the CPU 911 for the imaging device I / F 901, and controls the imaging processing by the imaging device 7. The sensor device control unit 94 is mainly realized by the processing of the CPU 911 for the sensor device I / F 902, and controls the data acquisition processing for the sensor device 8.

[0045] The captured image data acquisition unit 95 is mainly realized by processing by the CPU 911 for the imaging device I / F 901, and acquires captured image data related to an image captured by the imaging device 7. The sensor data acquisition unit 96 is mainly realized by processing by the CPU 911 for the sensor device I / F 902, and acquires sensor data that is the detection result by the sensor device 8. The time data acquisition unit 97 is mainly realized by processing by the CPU 911 for the timer 924, and acquires time data that indicates the time when data was acquired by the captured image data acquisition unit 95 or the sensor data acquisition unit 96.

[0046] The request receiving unit 98 is mainly realized by the processing of the CPU 911 for the external device connection I / F 923, and receives a predetermined request from the external PC 930 or the like.

[0047] The storage / readout unit 99 is mainly realized by the processing of the CPU 911 , and stores various data (or information) in the storage unit 9000 and reads out various data (or information) from the storage unit 9000 .

[0048] ○Functional configuration of evaluation device○ Next, the functional configuration of the evaluation device 3 will be described with reference to Fig. 6. The evaluation device 3 has a communication unit 31, a reception unit 32, a display control unit 33, a determination unit 34, an evaluation target data generation unit 35, a detection unit 36, a map data management unit 37, a report generation unit 38, and a storage / readout unit 39. Each of these units is a function or means realized by one of the components shown in Fig. 5 being loaded from HD 304 onto RAM 303 and operating in accordance with an instruction from CPU 301 in accordance with a program for the evaluation device. The evaluation device 3 also has a storage unit 3000 constructed by ROM 302 and HD 304 shown in Fig. 5.

[0049] The communication unit 31 is mainly realized by the processing of the CPU 301 on the network I / F 309, and communicates various data or information with other devices via the communication network 100. The communication unit 31 transmits and receives various data related to the evaluation of the slope condition to and from the data management device 5, for example.

[0050] The reception unit 32 is mainly realized by the processing of the CPU 301 on the keyboard 311 or the pointing device 312, and receives various selections or inputs from the user. The reception unit 32 receives various selections or inputs on an evaluation screen 400, which will be described later. The display control unit 33 is mainly realized by the processing of the CPU 301, and causes the display 306 to display various images. The display control unit 33 causes the display 306 to display the evaluation screen 400, which will be described later. The determination unit 34 is mainly realized by the processing of the CPU 301, and makes various determinations. The reception unit 32 is an example of an operation reception means.

[0051] The evaluation target data generation unit 35 is realized by the processing of the CPU 301, and generates data to be evaluated. The detection unit 36 ​​is mainly realized by the processing of the CPU 301, and performs a process of detecting the state of the slope using the evaluation target data generated by the evaluation target data generation unit 35. The map data management unit 37 is mainly realized by the processing of the CPU 301, and manages map information acquired from an external server or the like. The map information includes position information for any position on the map.

[0052] The report generation unit 38 is mainly realized by the processing of the CPU 301, and generates an evaluation report to be submitted to the road administrator based on the evaluation results.

[0053] The storage / readout unit 39 is mainly realized by the processing of the CPU 301 , and stores various data (or information) in the storage unit 3000 and reads out various data (or information) from the storage unit 3000 .

[0054] ○Functional configuration of data management device○ Next, the functional configuration of the data management device 5 will be described with reference to Fig. 6. The data management device 5 has a communication unit 51, a determination unit 52, a data management unit 53, and a storage / readout unit 59. Each of these units is a function or means realized when any of the components shown in Fig. 5 operates in response to an instruction from the CPU 501 in accordance with a program for the data management device that is loaded from the HD 504 onto the RAM 503. The data management device 5 also has a storage unit 5000 constructed by the ROM 502 and HD 504 shown in Fig. 5.

[0055] The communication unit 51 is mainly realized by processing of the CPU 501 on the network I / F 509, and communicates various data or information with other devices via the communication network 100. The communication unit 51 receives, for example, photographed image data and sensor data transmitted from the data acquisition device 9. The communication unit 51 also transmits and receives, for example, various data related to the evaluation of the slope condition with the evaluation device 3, etc. The communication unit 51 is an example of an instruction receiving means. The judgment unit 52 is an example of a position generation means, and is realized by processing of the CPU 501, and makes various judgments.

[0056] The data management unit 53 is mainly realized by the processing of the CPU 501, and manages various data related to the evaluation of the slope condition. The data management unit 53, for example, registers photographed image data and sensor data transmitted from the data acquisition device 9 in an acquired data management DB 5001. The data management unit 53 also registers, for example, data processed or generated by the evaluation device 3 in a processed data management DB 5003. The generation unit 54 is mainly realized by the processing of the CPU 501, and generates various image data related to the slope.

[0057] The storage / readout unit 59 is mainly realized by the processing of the CPU 501 , and stores various data (or information) in the storage unit 5000 and reads out various data (or information) from the storage unit 5000 . ○Functional configuration of terminal device○

[0058] Next, the functional configuration of the terminal device 1100 will be described with reference to Fig. 6. The terminal device 1100 has a communication unit 1101, a reception unit 1102, a display control unit 1103, a determination unit 1104, and a storage / readout unit 1105. Each of these units is a function or means realized when any of the components shown in Fig. 5 is loaded from the HD onto the RAM and operates in accordance with an instruction from the CPU in accordance with a program for the terminal device. The data management device 5 also has a storage unit 1106 constructed by the ROM and HD shown in Fig. 5.

[0059] The communication unit 1101 is mainly realized by the processing of the CPU for the network I / F, and communicates various data or information with other devices via the communication network 100.

[0060] The reception unit 1102 is mainly realized by CPU processing of a keyboard or pointing device, and receives various selections or inputs from the user. The display control unit 1103 is mainly realized by CPU processing, and displays various images on the display. The determination unit 1104 is realized by CPU 301 processing, and makes various determinations. The reception unit 1102 is an example of an operation reception means.

[0061] The storage / readout unit 1105 is mainly realized by the processing of the CPU, and stores various data (or information) in the storage unit 1106 and reads out various data (or information) from the storage unit 1106 .

[0062] Next, the functional configuration of the terminal device 1200 will be described with reference to Fig. 6. The terminal device 1200 has a communication unit 1201, a reception unit 1202, a display control unit 1203, a determination unit 1204, and a storage / readout unit 1205. Each of these units is a function or means realized when any of the components shown in Fig. 5 is loaded from the HD onto the RAM and operates in accordance with an instruction from the CPU in accordance with a program for the terminal device. The data management device 5 also has a storage unit 1206 constructed by the ROM and HD shown in Fig. 5.

[0063] The communication unit 1201 is mainly realized by the processing of the CPU for the network I / F, and communicates various data or information with other devices via the communication network 100.

[0064] The reception unit 1202 is mainly realized by CPU processing of the keyboard or pointing device and receives various selections or inputs from the user. The display control unit 1203 is mainly realized by CPU processing and displays various images on the display. The determination unit 1204 is mainly realized by CPU 301 processing and makes various determinations.

[0065] The storage / readout unit 1205 is mainly realized by the processing of the CPU, and stores various data (or information) in the storage unit 1206 and reads out various data (or information) from the storage unit 1206 .

[0066] Status type management table 7 and 8 are conceptual diagrams showing an example of a condition type management table. The condition type management table is a table for managing training data for detecting the condition type of a slope. A condition type management DB 3001 configured with a condition type management table such as that shown in FIGS. 7 and 8 is constructed in the storage unit 3000. In this condition type management table, a type name indicating the condition type, a training image, and a remarks column are associated and managed for each type number.

[0067] Among these, the type name indicates a condition type for identifying the state of the slope, the physical quantities surrounding the slope, and the site information. Here, the condition types include the type of the slope itself, which is a structure such as a retaining wall, a crest, sprayed mortar, wire mesh, a fence, a drainage hole, a pipe, and a berm drainage channel, as well as types indicating physical quantities surrounding the slope, such as spring water, moss, plants, falling rocks, soil, and sunlight. The condition types also include types such as poles, utility poles, signs, and billboards, which serve as site information for supporting data acquisition by the mobile system 60. Furthermore, the condition types may also include, as additional information about the structure, information on markers such as chalking that indicate the presence of abnormalities installed during past inspections or construction work, as well as man-made objects such as measuring devices and traces of countermeasures. The training image is an example of training data and is used in machine learning to identify the condition type of the slope, the physical quantities surrounding the slope, and the site information from photographed image data. Here, the training data is not limited to brightness images, RGB images, etc., which are generally called images, but may be any data that contains information for determining the state type, and may be in the form of depth information, text, audio, etc. The remarks column shows information that serves as the detection criteria for detecting the state type.

[0068] Acquired data management table Fig. 9(A) is a conceptual diagram showing an example of an acquired data management table. The acquired data management table is a table for managing various acquired data acquired by the data acquisition device 9. An acquired data management DB 5001 configured with an acquired data management table such as that shown in Fig. 9(A) is constructed in the storage unit 5000. In this acquired data management table, photographed image data, sensor data, and acquisition time are associated and managed for each folder.

[0069] Of these, the photographed image data and sensor data are data files of acquired data transmitted from the data acquisition device 9. The acquisition time indicates the time when the photographed image data and sensor data were acquired by the data acquisition device 9. Data acquired in one inspection process is stored in the same folder. The photographed image data and the three-dimensional sensor data included in the sensor data are stored in association with coordinates, as described below. The photographed image data and the three-dimensional sensor data included in the sensor data are stored in association with the positioning data included in the sensor data. This makes it possible to select any position in the map information managed by the map data management unit 37 of the evaluation device 3, and read the photographed image data and three-dimensional sensor data for that position from the acquired data management DB 5001.

[0070] Processing data management table Fig. 9(B) is a conceptual diagram showing an example of a processing data management table. The processing data management table is a table for managing various processing data processed by the evaluation device 3. A processing data management DB 5003 configured by a processing data management table such as that shown in Fig. 9(B) is constructed in the storage unit 5000. In this processing data management table, evaluation target data, evaluation data, positioning data, and comments are associated and managed for each folder.

[0071] Of these, the evaluation target data is a data file used for the detection and evaluation of the slope condition by the evaluation device 3. The evaluation data is a data file showing the evaluation results by the evaluation device 3. The positioning data is data showing position information measured by the GNSS sensor 8b. The comments are bibliographic information entered by the evaluator for the evaluation target data or the evaluation data. As a result, when an arbitrary position in the map information managed by the map data management unit 37 of the evaluation device 3 is selected, the evaluation data for that position can be read out from the processing data management DB 5003.

[0072] FIG. 10 is a diagram for explaining a photographed image acquired by a mobile system.

[0073] In the mobile body system 60, while the mobile body 6 is traveling, an image of a slope on a road is captured by the image capturing device 7 provided in the data acquisition device 9. The X-axis direction shown in Fig. 10 indicates the direction of movement of the mobile body 6, the Y-axis direction is the vertical direction, and the Z-axis direction is perpendicular to the X-axis and Y-axis directions and indicates the depth direction from the mobile body 6 toward the slope.

[0074] As the mobile object 6 travels, the data acquisition device 9 acquires a photographed image 1, a ranging image 1, a photographed image 2, and a ranging image 2 in chronological order, as shown in FIG. 10. The ranging image 1 and the ranging image 2 are images acquired by the distance sensor 8a. At this time, the photographing device 7 and the sensor device 8 are time-synchronized, so that the photographed image 1 and the ranging image 1, and the photographed image 2 and the ranging image 2 are images of the same area of ​​the slope. In addition, tilt correction (image correction) is performed on the photographed images based on the vehicle's attitude at the time of shooting, and the image data and positioning data (north latitude and east longitude) are linked based on the time of the photographed images.

[0075] In this way, the mobile system 60 acquires photographed image data of the slope and sensor data acquired in response to photography by the photography device 7 while driving the vehicle serving as the mobile body 6, and uploads the data to the data management device 5.

[0076] FIG. 11 is an explanatory diagram of a photographed image and a distance measurement image.

[0077] Fig. 11(a) shows photographed image data 7A of photographed images 1, 2, etc. shown in Fig. 10. Each pixel 7A1 of the photographed image data 7A acquired by the photographing device 7 is arranged at coordinates corresponding to the X-axis direction and Y-axis direction shown in Fig. 10, and has brightness information corresponding to the amount of stored power.

[0078] Then, the luminance information of each pixel 7A1 of the photographed image data 7A is associated with coordinates corresponding to the X-axis direction and Y-axis direction shown in FIG. 10 and stored in the storage unit 5000 as the photographed image data shown in FIG.

[0079] FIG. 11(b) shows distance measurement image data 8A such as distance measurement images 1 and 2 shown in FIG. 10. Each pixel 8A1 of distance measurement image data 8A acquired by distance sensor 8a is arranged at coordinates corresponding to the X-axis and Y-axis directions shown in FIG. 10, and has distance information in the Z-axis direction shown in FIG. 10 corresponding to the amount of stored power. Note that distance measurement image data 8A is three-dimensional point cloud data, but is generally referred to as distance measurement image data because it is visually displayed with luminance information added when viewed by a user. The captured image data 7A and distance measurement image data 8A are collectively referred to as image data.

[0080] Then, the distance information of each pixel 8A1 of the ranging image data 7B is stored in the memory unit 5000 as three-dimensional data included in the sensor data shown in Figure 9, corresponding to coordinates corresponding to the X-axis and Y-axis directions shown in Figure 10.

[0081] Here, since the photographed image data 7A shown in Figure 11(a) and the distance measurement image data 8A shown in Figure 11(b) are images of the same area of ​​the slope, the brightness information and distance information are stored in the memory unit 5000 in correspondence with the coordinates corresponding to the X-axis and Y-axis directions shown in Figure 10.

[0082] Processing or operation of the embodiment ○Data acquisition processing○ Next, the processing or operation of the condition inspection system 1 according to the embodiment will be described with reference to Figs. 12 to 27. First, the data acquisition process using the mobile body system 60 will be described with reference to Figs. 12 and 10. A slope condition inspector boards the mobile body 6, photographs the slopes on the road, and uploads the acquired data to the data management device 5. This will be described in detail below.

[0083] FIG. 12 is a sequence diagram illustrating an example of data acquisition processing using a mobile system. First, an inspection worker performs a predetermined input operation or the like on the external PC 330, and the request receiving unit 98 of the data acquisition device 9 receives a data acquisition start request (step S11). Then, the data acquisition device 9 executes data acquisition processing using the photographing device 7 and the sensor device 8 (step S12). Specifically, the photographing device control unit 93 issues a photographing request to the photographing device 7 to start photographing processing for a predetermined area. Furthermore, the sensor device control unit 94 starts detection processing by the distance sensor 8a and the GNSS sensor 8b in synchronization with the photographing processing by the photographing device 7. Then, the photographed image data acquisition unit 95 acquires photographed image data acquired by the photographing device 7, and the sensor data acquisition unit 96 acquires sensor data acquired by the distance sensor 8a and the GNSS sensor 8b. Furthermore, the time data acquisition unit 97 acquires time data indicating the time when various data were acquired by the photographed image data acquisition unit 95 and the sensor data acquisition unit 96.

[0084] Next, the inspection worker performs a predetermined input operation on the external PC 330 or the like, and the request receiving unit 98 receives a request to upload the various acquired data (step S13). Then, the communication unit 91 uploads (transmits) the captured image data, sensor data, and time data, which are the acquired data acquired in step S12, to the data management device 5 (step S14). As a result, the communication unit 51 of the data management device 5 receives the acquired data transmitted from the data acquisition device 9. Then, the data management unit 53 of the data management device 5 registers the acquired data received in step S14 in the acquired data management DB 5001 (see FIG. 9(A)) (step S15). The data management unit 53 stores the captured image data and sensor data in a single folder, in association with time data indicating the acquisition time of each data included in the acquired data.

[0085] ○Evaluation of slope conditions○ ○Generating data to be evaluated Next, the process in which the evaluation system 4 evaluates the slope condition using the acquired data stored in the data management device 5 will be described with reference to Fig. 13 and Fig. 27. First, the process of generating evaluation target data to be used in the process of evaluating the slope condition will be described with reference to Fig. 13. Fig. 13 is a sequence diagram showing an example of the process of generating evaluation target data.

[0086] First, the communication unit 31 of the evaluation device 3 transmits a request to generate evaluation target data to the data management device 5 (step S31). This generation request includes the name of the folder in which the data to be generated is stored. As a result, the communication unit 51 of the data management device 5 receives the generation request transmitted from the evaluation device 3.

[0087] Next, the storage / reading unit 59 of the data management device 5 searches the acquired data management DB 5001 using the folder name included in the creation request received in step S31 as a search key, and reads out the acquired data associated with the folder name included in the creation request (step S32). Then, the communication unit 51 transmits the acquired data read out in step S32 to the evaluation device 3 (step S33). This acquired data includes photographed image data, sensor data, and time data, and the communication unit 31 of the evaluation device 3 thereby receives the acquired data transmitted from the data management device 5.

[0088] Next, the evaluation target data generation unit 35 of the evaluation device 3 generates evaluation target data using the acquired data received in step S33 (step S34). Specifically, the evaluation target data generation unit 35 corrects the tilt of the captured image data based on the attitude of the imaging device 7 (mobile body 6) at the time of imaging, based on the sensor data received from the distance sensor 8a. Furthermore, the evaluation target data generation unit 35 links the captured image data with the positioning data, which is the sensor data received from the GNSS sensor 8b, based on the received time data. Furthermore, the evaluation target data generation unit 35 performs a process of combining multiple captured image data into one image data.

[0089] In this way, the evaluation target data generation unit 35 has a function of correcting tilt of image data, a function of linking image data with position information, and a function of combining image data. The evaluation target data generation unit 35 uses the acquired data received from the data management device 5 to perform image correction on the received captured image data so that processing by the detection unit 36 ​​and report generation unit 38 (described later) can be easily performed.

[0090] Next, the communication unit 31 of the evaluation device 3 transmits the generated data generated in step S34 to the data management device 5 (step S35). This generated data includes the evaluation target data, positioning data, and comments generated by the evaluation target data generation unit 35. As a result, the communication unit 51 of the data management device 5 receives the generated data transmitted from the evaluation device 3. Then, the data management unit 53 of the data management device 5 stores the generated data received in step S35 in the processing data management DB 5003 (see FIG. 9(B)) (step S36). Specifically, the data management unit 53 associates the evaluation target data, positioning data, and comments included in the generated data and stores them in one folder.

[0091] In this way, the evaluation system 4 performs image processing based on various data (photographed image data, sensor data, and time data) acquired from the data acquisition device 9, thereby generating evaluation target data to be used in evaluating the slope condition.

[0092] Generate evaluation reports Next, the process of generating an evaluation report to be submitted to the road administrator in the evaluation system 4 will be described with reference to Figures 14 and 25. The evaluator evaluates the condition of the slope using the photographed image data and sensor data acquired by the data acquisition device 9, and generates an evaluation report showing the evaluation results. This will be described in detail below.

[0093] FIG. 14 is a sequence diagram illustrating an example of a process for generating a report that is the evaluation result of the slope condition. First, the display control unit 33 of the evaluation device 3 causes the display 306 to display an evaluation screen 400 for performing the slope condition evaluation process (step S51). FIG. 15 is a diagram illustrating an example of an evaluation screen displayed on the evaluation device. The evaluation screen 400 shown in FIG. 15 includes an evaluation target data selection area 410, an evaluation item selection area 430 for selecting evaluation items for detecting the slope condition, a shape data display area 460 for displaying shape data, an “upload” button 491 pressed to upload the evaluation results to the data management device 5, and a “generate report” button 493 pressed to generate an evaluation report. Of these, the selection area 410 includes a “folder specification” button 411 for specifying a folder in which the evaluation target data is stored, a display area 413 displaying the specified folder name, and an “OK” button 415 pressed to request download of the evaluation target data stored in the specified folder.

[0094] Next, the evaluator specifies a folder using the "Specify folder" button 411, and the reception unit 32 of the evaluation device 3 receives the selection of the evaluation target data (step S52). For example, in the example of Fig. 15, the reception unit 32 receives the selection of the evaluation target data stored in "folder 0615".

[0095] Next, the communication unit 31 transmits a read request for the evaluation target data selected in step S52 to the data management device 5 (step S53). This read request includes the folder name selected in step S52. As a result, the communication unit 51 of the data management device 5 receives the read request transmitted from the evaluation device 3.

[0096] Next, the storage / reading unit 59 of the data management device 5 searches the processing data management DB 5003 (see FIG. 9(B)) using the folder name included in the read request received in step S53 as a search key, and reads out the processing data associated with the folder name included in the read request (step S54). Then, the communication unit 51 transmits the processing data read out in step S54 to the evaluation device 3 (step S55). This processing data includes the evaluation target data, positioning data, and comments. As a result, the communication unit 31 of the evaluation device 3 receives the processing data transmitted from the data management device 5.

[0097] Next, the display control unit 33 of the evaluation device 3 displays the processed data received in step S54 in the evaluation item selection area 430 of the evaluation screen 400 (step S56). FIG. 16 is a diagram showing an example of the evaluation screen on which the processed data is displayed. The evaluation item selection area 430 shown in FIG. 16 includes an image display area 431 that displays an image of the evaluation target data, which is the processed data transmitted from the data management device 5, a bibliographic information display area 433 that displays bibliographic information of the evaluation target data, and a "Back" button 437 and a "Next" button 439 that are pressed to switch images displayed in the image display area 431. The evaluation item selection area 430 also includes a "Shape Detection" button 451 that is pressed to detect the shape of the slope, a "Damage Detection" button 453 that is pressed to detect the damage state of the slope, a "Map Information" button 455 that is pressed to generate map information, and a "Sign Detection" button 457 that is pressed to detect the sign of slope damage.

[0098] Additionally, evaluation areas 435a and 435b are displayed in the image display area 431 superimposed on the image of the evaluation target data. The evaluation areas 435a and 435b indicate the evaluation range in the slope condition detection process described below. The evaluator moves the evaluation areas 435a and 435b and enlarges or reduces the evaluation areas 435a and 435b by input operations such as tapping, dragging, swiping, pinching in, and pinching out on the evaluation areas 435a and 435b. Note that the number of evaluation areas 435a and 435b is not limited to this and may be one, or three or more. Alternatively, the evaluation areas 435a and 435b may not be displayed in the image display area 431, and the entire image display area 431 may be used as the evaluation range.

[0099] Next, the evaluation device 3 performs a process of detecting the slope condition using the evaluation target data (step S57). Here, the process of detecting the slope condition will be described in detail with reference to Fig. 17. Fig. 17 is a flowchart showing an example of the process of detecting the slope condition.

[0100] First, the evaluator presses the "Shape Detection" button 451 included in the evaluation item selection area 430, and the receiving unit 32 receives a shape detection request (step S71). Next, the detection unit 36 ​​performs shape detection processing using the evaluation target data (step S72). Here, the shape data indicating the shape of the slope is expressed by three-dimensional information such as the slope's extension, height, and inclination angle, as well as position information. The slope's extension refers to the length of the slope in a plan view (the depth direction of the cross section where the slope's inclination can be determined). The shape data also includes information indicating the type of slope, whether it is a natural slope or an earthwork structure. If the slope is an earthwork structure, the shape data also includes information on the type of earthwork structure. The type of civil engineering structure can be, for example, a retaining wall, a crest, a mortar coating, the presence or absence of anchors, or an embankment.

[0101] Specifically, the detection unit 36 ​​detects the extension, height, and inclination angle of the slope based on the image data and three-dimensional data included in the evaluation target data. The detection unit 36 ​​also detects the type of slope shown in the image, which is the evaluation target data, using the condition type management DB 3001 (see FIG. 7). In this case, the detection unit 36 ​​detects the type of slope by image matching processing using the teacher image shown in the condition type management table.

[0102] Next, the display control unit 33 displays the shape data, which is the detection result in step S72, in the shape data display area 460 of the evaluation screen 400 (step S73). Fig. 18 is a diagram showing an example of the evaluation screen on which the detection result of the shape data is displayed. The shape data display area 460 shown in Fig. 18 includes a display area 461 for bibliographic information of the shape data indicating the shape detection result by the detection unit 36, and a "display details" button 463 that is pressed to display detailed data of the shape detection result. Of these, the display area 461 displays, for example, the total length of the slope and the proportion of each detected type in the entire slope.

[0103] In the above-described steps S71 to S73, the "shape detection" process may be replaced with the "structure information detection" process.

[0104] In this case, the evaluator presses the "Structure Information Detection" button instead of the "Shape Detection" button 451 included in the evaluation item selection area 430, and the receiving unit 32 receives the structure information detection request (step S71). Next, the detection unit 36 ​​performs a structure information detection process using the evaluation target data (step S72). Then, the display control unit 33 displays the structure information detection information, which is the detection result in step S72, in the structure information display area instead of the shape data display area 460 of the evaluation screen 400 (step S73).

[0105] Here, the structure information includes additional information about the structure in addition to the shape data described above. Specifically, the detection unit 36 ​​detects the type of slope shown in the image, which is the evaluation target data, and the type of additional information about the slope, using the condition type management DB 3001 (see FIGS. 7 and 8), based on the image data and three-dimensional data included in the evaluation target data. In this case, the detection unit 36 ​​detects the type of slope and the additional information about the slope by image matching processing using the teacher image shown in the condition type management table.

[0106] Next, when the evaluator presses the "Damage Detection" button 453 included in the evaluation item selection area 430, the receiving unit 32 transitions the process to step S75 if it receives a damage detection request for detecting damage to the slope condition (YES in step S74). On the other hand, when the damage detection request is not received (NO in step S74), the receiving unit 32 transitions the process to step S77. The detection unit 36 ​​performs damage detection processing of the slope condition on the evaluation target data (step S75).

[0107] Here, the slope condition damage detection process detects the presence or absence of deformation on the slope and the degree of deformation as damage data representing the degree of damage to the slope. The degree of deformation indicates the degree of deterioration of the deformation, such as the width of a crack, the size of a separation, or the size of a lift. The detection unit 36 ​​detects the presence or absence of deformation on the slope and the degree of deformation based on the image data and sensor data included in the evaluation target data. The detection unit 36 ​​also detects whether the degree of deformation exceeds a predetermined value using a predetermined detection formula for the degree of deformation and deterioration. In this case, the detection unit 36 ​​determines whether the crack width is equal to or larger than a certain value, whether the size of the separation is equal to or larger than a certain value, or whether the lift is large, etc.

[0108] Then, in step S36 shown in FIG. 13, the data management unit 53 of the data management device 5 stores the coordinates of the damage position and the type of damage in the processing data management DB 5003 in association with the coordinates corresponding to the X-axis direction and the Y-axis direction in the photographed image data 7A shown in FIG. 11.

[0109] Next, the display control unit 33 causes the display 306 to display a display screen 470 showing the damage detection results obtained in step S75 (step S76). FIG. 19 is a diagram showing an example of a display screen showing the damage detection results. The display screen 470 shown in FIG. 19 includes a display image area 480 showing the detected positions of damage on the entire slope to be evaluated, a detailed information display area 485 showing a captured image corresponding to the position of the detected damage, and a "Cross Section" button 489 that is pressed to display a cross section of the detected slope. Of these, the display image area 480 shows a plan view in which images (P1 to P4) showing the positions of the detected damage are drawn on an image showing the two-dimensional shape of the slope to be evaluated. The display image area 480 also shows position coordinates (positioning data) showing the position of the slope to be evaluated.

[0110] Furthermore, when the evaluator presses the "Cross-Section" button 489, the display control unit 33 causes the display 306 to display the cross-sectional image 475 shown in Fig. 20. The cross-sectional image 475 shown in Fig. 20 shows a cross-sectional view of the slope to be evaluated, drawn based on the shape data detected by the detection unit 36. The shape data is detected using sensor data from the distance sensor 8a (three-dimensional sensor), and therefore, as shown in Fig. 20, it is possible to express in detail three-dimensional information such as the slope inclination or height of the slope, which cannot be calculated from a two-dimensional image alone.

[0111] Next, when the evaluator presses the "Map Information" button 455 included in the evaluation item selection area 430, the receiving unit 32 advances the process to step S78 if it receives a map information acquisition request (YES in step S77). On the other hand, when the receiving unit 32 does not receive a map information acquisition request (NO in step S77), it terminates the process. The detecting unit 36 ​​generates map information indicating the position of the slope condition of the evaluation target (step S78). Specifically, the detecting unit 36 ​​generates map information in which an image indicating the position of the slope is attached to the position (north latitude, east longitude) indicated by the positioning data acquired in step S55, which corresponds to map data available using a predetermined service or application provided by an external web server or the like. The map data provided by the external web server or the like is managed by the map data managing unit 37.

[0112] Next, the display control unit 33 displays the map information 490 generated in step S78 on the display 306 (step S79). FIG. 21 is a diagram showing an example of map information. As described above, the map information 490 includes images 491a and 491b that indicate the position of the slope to be evaluated relative to the map data. In the map information 490 shown in FIG. 21, images 491a and 491b are drawn at the start and end positions of the inspection, and text 493a indicating "start point" and text 493b indicating "end point" are drawn in association with the images 491a and 491b, respectively, to indicate the range of the slope to be inspected. Note that, if it is desired to display the position of the slope more accurately, it is preferable that the detection unit 36 ​​generate the map information by comparing the positioning data with positioning map data held by the Geospatial Information Authority of Japan or the like.

[0113] Fig. 22 is a diagram showing an example of on-site information stored in association with map information. The images shown in Fig. 22(a) to (i) are stored in association with positioning data in the processing data management table shown in Fig. 9(B), and when an arbitrary position is clicked on the map information 490 shown in Fig. 21, the display control unit 33 causes the display 306 to display an image showing the inspection site associated with the positioning data corresponding to the clicked position.

[0114] Here, the "inspection site" refers not only to the section from the start position to the end position of the inspection shown in Figure 21, but also to the surrounding area of ​​the section from the start position to the end position of the inspection that is necessary to determine the soundness.

[0115] Figures 22(a) and (b) are images of the site showing the starting point 491a and the ending point 491b shown in Figure 21. Figure 22(c) is an image showing the sidewalk at the inspection site, and Figure 22(d) is an image showing the gutter at the inspection site.

[0116] Figures 22(e) and (f) are images showing the evacuation space at the inspection site, Figure 22(g) is an image showing the pavement condition at the inspection site, and Figures 22(h) and (i) are images showing the road gradient at the inspection site.

[0117] When going to check the site for re-inspection or the like, the images shown in FIGS. 22(a) to 22(i) can be checked in advance on the display 306, thereby improving the efficiency of advance preparations and on-site work.

[0118] 17, when the evaluator presses the "detect signs" button 457 included in the evaluation item selection area 430, the receiving unit 32 receives a sign detection request for detecting signs of damage to the slope condition (YES in step S80), and the processing proceeds to step S81. On the other hand, when the receiving unit 32 does not receive a sign detection request (NO in step S80), the processing ends. The detection unit 36 ​​performs a sign detection process for the slope condition on the evaluation target data (step S82).

[0119] In the condition inspection system 1, when a deformation of a slope is detected, the condition and location of the deformation have been identified. However, the idea of ​​measuring information indicating the location of the deformation before the deformation occurs on the slope has not been known. Here, the process of detecting signs of damage to the slope condition detects signs of deformation on the slope based on measurement data of the slope including surrounding data indicating physical quantities around the slope as sign data indicating signs of slope damage.

[0120] The measurement data includes photographed image data obtained by photographing the slope with the photographing device 7, or sensor data obtained by measuring the slope with a three-dimensional sensor such as the distance sensor 8a.

[0121] The surrounding data includes measurement data of objects other than the slope, and the objects other than the slope include at least one of spring water, soil, rocks, and plants.

[0122] If the measurement data for the slope includes surrounding data that indicates spring water occurring on the surface of the slope, it is possible that stagnant water is exerting pressure from the back side of the slope, and it is therefore detected that there are signs of deformation of the slope. Specifically, it is not limited to the presence or absence of spring water, but the signs of deformation of the slope are detected based on the amount, type and location of the spring water.

[0123] If the measurement data for the slope includes surrounding data that indicates plants or moss growing on the surface of the slope, it is possible that spring water has occurred and stagnant water is exerting pressure from the back side of the slope, and it is therefore detected that there are signs of slope deformation. Specifically, signs of slope deformation are detected not only based on the presence or absence of plants or moss, but also on the amount, type and location of the plants and moss.

[0124] If the measurement data for the slope includes surrounding data that indicates falling rocks and earth and sand around the slope, it is possible that an abnormality has occurred on the backside or topside of the slope, and it is therefore detected that there are signs of slope deformation. Specifically, it is not limited to the presence or absence of falling rocks and earth and sand, but the signs of slope deformation are detected based on the amount, type and location of falling rocks and earth and sand.

[0125] If the measurement data for the slope includes surrounding data that indicates blockages in drainage holes, pipes, berm drainage channels, etc., it is possible that drainage from the back side of the slope to the front side is being obstructed, and that accumulated water is exerting pressure from the back side of the slope, so it is detected that there are signs of slope deformation. Specifically, it is not just the presence or absence of blockages that are detected, but also the amount, type, and location of the foreign matter that is causing the blockage that is detected as signs of slope deformation.

[0126] In addition, if the drainage holes, pipes, drainage channels of the berms, etc. themselves are damaged, this will be detected as a deformation of the slope, but if the drainage holes, pipes, drainage channels of the berms, etc. are clogged, this will not be detected as a deformation of the slope, but will be detected as a sign of slope deformation.

[0127] The measurement data of objects other than the slope described above may be combined to detect signs of slope deformation. Specifically, even if surrounding data indicating spring water exists only in a small part of the slope, if moss is spread over the entire slope, it is estimated that spring water spreads over the entire slope on a daily basis, and a sign of slope deformation is detected.

[0128] The ambient data also includes measurement data of physical quantities other than the object, and the measurement data of physical quantities other than the object includes measurement data of light.

[0129] If the measurement data for the slope includes surrounding data that indicates good sunlight exposure, it will be combined with the measurement data for objects other than the slope mentioned above to detect signs of slope deformation. Specifically, if moss is growing on a slope that is sunny and prone to drying, it is possible that spring water has formed and stagnant water is exerting pressure from the back side of the slope, and this is detected as a sign of slope deformation.

[0130] The process for detecting signs of damage to the slope condition generates comments about signs of deformation of the slope as sign data indicating signs of slope damage based on the measurement data of the slope including surrounding data indicating physical quantities around the slope. Then, in step S36 shown in Fig. 13, the data management unit 53 of the data management device 5 stores the coordinates of the position of the sign of deformation and the comment in the processed data management DB 5003, in association with coordinates corresponding to the X-axis and Y-axis directions in the photographed image data 7A shown in Fig. 11.

[0131] Specifically, based on photographed image data, which is an example of the acquired surrounding data, a comment is generated indicating the type of physical quantity around the slope, such as spring water, as well as its amount and location, etc., with reference to the teacher image in the condition type management table shown in Fig. 8. As an example, a comment such as "moss rate 30%, mostly distributed around 3-20m height from starting point" is generated.

[0132] Next, the display control unit 33 causes the display 306 to display a display screen 1470 showing the sign detection result in step S81 (step S82). This will be discussed later.

[0133] Furthermore, when the evaluator presses the "Cross-Sectional View" button 1489, the display control unit 33 causes the display 306 to display a cross-sectional image 475 similar to that shown in FIG.

[0134] In this way, the evaluation system 4 detects the shape of the slope including three-dimensional information, the degree of damage to the slope, signs of deformation of the slope, and the position of the slope to be evaluated in order to evaluate the condition of the slope.

[0135] Returning to FIG. 14, when the evaluator presses the "upload" button 491 included in the evaluation screen 400, the receiving unit 32 receives a request to upload the evaluation results (step S58). Then, the communication unit 31 uploads (transmits) the evaluation results to the data management device 5 (step S59). As a result, the communication unit 51 of the data management device 5 receives the evaluation data transmitted from the evaluation device 3. Then, the data management unit 53 of the data management device 5 registers the evaluation data received in step S59 in the processing data management DB 5003 (see FIG. 9(B)) (step S60). In this case, the data management unit 53 stores the evaluation data in a single folder in association with the evaluation target data that has been evaluated, etc.

[0136] Furthermore, when the evaluator presses the "Generate Report" button 493 included in the evaluation screen 400, the reception unit 32 receives a request to generate an evaluation report (step S61). Then, the report generation unit 38 generates an evaluation report based on the detection results of the slope condition by the detection unit 36 ​​(step S62). The report generation unit 38 generates an evaluation report by arranging the evaluation data indicating the above-mentioned evaluation results based on inspection guidelines issued by the government or a format in accordance with requests from the road administrator.

[0137] 23 to 25 are diagrams showing examples of an evaluation report generated by the evaluation device. The first page of the evaluation report shown in Fig. 23 shows bibliographic information such as the route name at the top, and a location map showing the location of the slope to be inspected and the evaluation results at the bottom. The location map shown in Fig. 23 includes map information generated by the detection unit 36 ​​(see Fig. 21).

[0138] The second page of the evaluation report shown in Fig. 24 includes a plan view and a cross-sectional view. The evaluation report shown in Fig. 24 is generated based on the damage detection results and shape detection results obtained by the detection unit 36. The plan view includes an image showing the damage analysis results obtained by the detection unit 36 ​​(see Fig. 19), and the cross-sectional view includes a cross-sectional view of the slope to be evaluated (see Fig. 20), which is drawn based on the shape detection results obtained by the detection unit 36.

[0139] Furthermore, the third page of the evaluation report shown in Fig. 25 shows photographed image data of the slope to be evaluated. The evaluation report shown in Fig. 25 visually shows the condition and shape of the slope shown in the plan view and cross section of Fig. 24.

[0140] In this way, the evaluation device 3 uses the evaluation results of the slope condition to create an evaluation report to be provided to the road administrator. Note that the contents or layout of the evaluation report are not limited to this.

[0141] As described above, the evaluation system 4 generates a report showing the shape of the slope and the location and extent of damage by evaluating the condition of the slope using the photographed image data, sensor data (three-dimensional data), and positioning data acquired by the mobile system 60. This enables the evaluation system 4 to improve the quality and efficiency of the report generation function as an image assessment service used for slope inspection or a slope shape or damage assessment service.

[0142] 17, it is sufficient that the condition detection process by the detection unit 36 ​​is configured to perform at least the shape detection process shown in steps S71 to S73. In addition to the shape detection process, the evaluator can perform the damage detection process shown in steps S74 to S76 and the map information generation process shown in steps S77 to S79 ​​as needed, thereby describing detailed evaluation results in the evaluation report.

[0143] ○ Variations in slope condition evaluation Here, a modified example of the process for evaluating the state of a slope will be described with reference to FIGS.

[0144] Fig. 26 is a diagram showing a display screen showing the damage detection results, and Fig. 27 is a diagram showing a cross-sectional image of the detected slope shape. In addition to the examples shown in Figs. 18 and 19, a newly detected deformation (P5) is depicted on the display screen 470 shown in Fig. 26 and the cross-sectional image 475 shown in Fig. 27. A protrusion (uplift) is detected at the position of P5. In this way, more detailed three-dimensional information can be obtained by performing detection using a distance sensor.

[0145] FIG. 28 is a diagram showing an example of a display screen showing the sign detection result, and corresponds to the display screen displayed on the display 306 in step S82 of FIG.

[0146] 28 includes a display image area 1480 that displays the detected positions of signs of deformation on the entire slope to be evaluated, a detailed information display area 1485 that displays a captured image corresponding to the position of the detected signs of deformation, and a "Cross Section" button 1489 that is pressed to display a cross section of the detected slope. Of these, the display image area 1480 displays a plan view in which images (P1 to P4) indicating the positions of the detected signs of deformation are drawn against an image showing the two-dimensional shape of the slope to be evaluated. The display image area 1480 also displays position coordinates (positioning data) that indicate the position of the slope to be evaluated.

[0147] In the detailed information display area 1485, comments 1401 to 1404 are displayed in association with the images P1 to P4, respectively, which indicate the positions of signs of abnormality.

[0148] As explained in step S82 of FIG. 17, these comments 1401 to 1404 were generated based on images P1 to P4, with reference to the teacher images in the state type management table shown in FIG. 8, as comments indicating the types of physical quantities around the slope.

[0149] 29 and 30 are diagrams showing examples of evaluation reports including the sign detection results.

[0150] The evaluation report including the sign detection results shown in Figure 29 shows photographed images P1 to P4 and comments 1401 to 1404 that indicate signs of deformation of the slope being evaluated, corresponding to the photographed images P1 to P4 and comments 1401 to 1404 displayed in the detailed information display area 1485 of the display 306 shown in Figure 28.

[0151] The evaluation report containing the sign detection results shown in Figure 30 includes photographed images P1 and P2 of the slope being evaluated and comments 1411 and 1412, as well as photographed images P3 and P4 and comments 1413 and 1414 showing signs of deformation of the slope being evaluated.

[0152] The evaluation report including the symptom detection results shown in Figures 29 and 30 may be included in the evaluation report shown in Figures 23 to 25, or may be used as supplementary material to the evaluation report shown in Figures 23 to 25.

[0153] Modified examples of mobile systems ○Variation 1○ Next, modified examples of the mobile body system 60 will be described with reference to Figures 31 to 33. First, Figure 31 is a diagram showing an example of how the state of a slope is inspected using a mobile body system according to Modification 1. The mobile body system 60 according to Modification 1 is a system in which a data acquisition device 9 is fixed to a pole installed on the top surface of the mobile body 6 to enable photography of high places.

[0154] The camera device 7 of the above-described embodiment is low in height from the ground, making it difficult to photograph the berms on retaining walls, berms on crenellations, or berms on sprayed mortar, as shown in FIG. 31. Furthermore, the berms on current road earthwork structures, as shown in FIG. 31, are not covered, and there is a risk of dead leaves and other debris accumulating and clogging the waterway, requiring periodic cleaning. Therefore, by using the mobile body system 60 according to Modification 1, which is capable of photographing from a high altitude, even in cases where it is difficult for a person to climb a slope to check the extent of clogging in the waterway, the image can be confirmed by the photographing process associated with the traveling movement of the mobile body 6, thereby significantly improving inspection efficiency.

[0155] ○Variation 2○ 32 is a diagram showing an example of inspecting the condition of a slope using a mobile body system according to Modification 2. Mobile body system 60 (60a, 60b) according to Modification 2 is a system that uses a drone equipped with a data acquisition device 9 as an example of a mobile body 6 to photograph an embankment slope at a high place or below the side of a road that cannot be photographed even with the pole-mounted camera of Modification 1.

[0156] The drone serving as the mobile object 6 is equipped with not only the imaging device 7 but also a data acquisition device 9 equipped with sensors such as a distance sensor 8a, a GNSS sensor 8b, and an angle sensor 8c, thereby enabling evaluation of the condition of high places and embankments that could not be evaluated by a vehicle serving as the mobile object 6. Embankments and high places are particularly difficult for humans to approach for close visual inspection, making photography by a drone such as that of Modification 2 desirable. Furthermore, embankments and high-place slopes are often overgrown with vegetation such as trees and grass. Therefore, it is preferable for the data acquisition device 9 to be equipped with an imaging device 7 capable of capturing wide-angle images.

[0157] ○Variation 3○ FIG. 33 is a diagram showing an example of inspecting the condition of a slope using a mobile system according to Modification 3. As shown in FIG. 33, a slope has a complex structure, unlike a tunnel or a bridge, which are structures on a road. For example, a slope may be undulating rather than flat (e.g., an earthwork structure in which mortar is sprayed onto a quay), or may be covered with vegetation or wire mesh. Therefore, the mobile system 60 (60a, 60b, 60c) according to Modification 3 is equipped with a spectral camera, an infrared camera, or an expanded depth of field (EDof) camera as the sensor device 8, which is capable of acquiring wavelength information, in order to distinguish between objects such as plants and wire mesh and the shape of the slope.

[0158] Furthermore, the mobile system 60 according to the third modification is preferably configured to be not only a tool for distinguishing the shape of the slope, but also to have a lighting device mounted on the data acquisition device 9 so that the slope can be photographed under various conditions such as weather and sunlight. In this case, the lighting device is preferably a line lighting device that illuminates an area corresponding to the photographing range of the photographing device 7, or a time-sharing lighting device synchronized with the photographing device 7 and the sensor device 8.

[0159] Furthermore, in order to process the data acquired by the mobile system 60 according to the third modification, the evaluation target data generation unit 35 of the evaluation device 3 preferably has image processing functions such as an image stabilization function, a depth of focus correction function (blur correction function), a distortion correction function, or a contrast enhancement function so as not to miss even small abnormalities. The evaluation target data generation unit 35 also preferably has a function to remove noise that obscures abnormalities on earthwork structures, such as grass, moss, or wire mesh, or a function to distinguish between shadows of grass and abnormalities such as cracks. Thus, by using the mobile system 60 according to the third modification, the condition inspection system 1 can accurately evaluate the condition of slopes even in areas with complex structures or areas where grass, moss, or wire mesh is present.

[0160] FIG. 34 is a sequence diagram showing an example of a display process in the state inspection system.

[0161] The sequence between the evaluation device 3 and the data management device 5 will be described below, but the sequence between the data acquisition device 9, the terminal device 1100, the terminal device 1200 and the data management device 5 is similar.

[0162] When the user of the evaluation device 3 specifies a folder using, for example, the "Specify folder" button 411 shown in FIG. 15, the receiving unit 32 of the evaluation device 3 receives the selection of target data (step S91). In the example of FIG. 15, the receiving unit 32 receives the selection of evaluation data stored in "folder 0615". Alternatively, when the user of the evaluation device 3 selects an arbitrary position in map information managed by the map data management unit 37 of the evaluation device 3, the receiving unit 32 of the evaluation device 3 may receive the selection of position information in the map information.

[0163] Next, the communication unit 31 transmits a request for an input / output screen related to the target data selected in step S91 to the data management device 5, and the communication unit 51 of the data management device 5 receives the request transmitted from the evaluation device 3 (step S92). This request includes the folder name selected in step S91. Alternatively, this request may include location information in map information.

[0164] Next, the storage / readout unit 59 of the data management device 5 searches the processed data management DB 5003 (see FIG. 9(B)) using the folder name included in the request received in step S92 as a search key to read out image data associated with the folder name included in the request. Alternatively, the storage / readout unit 59 searches the acquired data management DB 5001 using the location information included in the request received in step S92 as a search key to read out image data associated with the location information included in the request.

[0165] The generating unit 54 of the data management device 5 generates an input / output screen including the image data based on the image data read by the storing / reading unit 59 (step S93). This input / output screen is a screen that accepts an instruction operation to generate an image showing a specific position on the slope.

[0166] The communication unit 51 transmits input / output screen information relating to the input / output screen generated in step S93 to the evaluation device 3, and the communication unit 31 of the evaluation device 3 receives the input / output screen information transmitted from the data management device 5 (step S94). Step S94 is an example of a generation reception screen transmission step.

[0167] Next, the display control unit 33 of the evaluation device 3 displays the input / output screen received in step S94 on the display 306 (step S95). The reception unit 32 of the evaluation device 3 receives a predetermined input operation by the user on the displayed input / output screen. This input operation includes an instruction operation to generate an image showing a specific position on the slope. Step S95 is an example of a reception step.

[0168] The communication unit 31 transmits input information relating to the input operation received by the reception unit 32 to the data management device 5, and the communication unit 51 of the data management device 5 receives the input information transmitted from the evaluation device 3 (step S96). This input information includes instruction information instructing the generation of an image showing a specific position on the slope.

[0169] Based on the received input information, the generation unit 54 of the data management device 5 generates a display image using the image data read by the storage / read unit 59 in step S93 (step S97). This display image includes a surface display image including a surface image showing the surface of the slope and a surface position image showing a specific position in the surface image, and a cross-section display image including a cross-section image showing the cross-section of the slope and a cross-section position image showing a specific position in the cross-section image. Step S97 is an example of an image generation step.

[0170] The communication unit 51 of the data management device 5 transmits the display image generated in step S97 to the evaluation device 3, and the communication unit 31 of the evaluation device 3 receives the display image transmitted from the data management device 5 (step S98). Step S98 is an example of a display image transmission step.

[0171] The display control unit 33 of the evaluation device 3 causes the display image received in step S98 to be displayed on the display 306 (step S99). Step S99 is an example of a display step.

[0172] FIG. 34 shows a sequence relating to the display process between the evaluation device 3 and the data management device 5, but the evaluation device 3 may execute the display process independently.

[0173] In this case, steps S92, 94, 96, and 98 relating to data transmission and reception are omitted, and the evaluation device 3 can perform the same display processing as in Fig. 34 by independently executing steps S91, 93, 95, 97, and 99. The data acquisition device 9, the terminal device 1100, and the terminal device 1200 can also independently execute display processing like the evaluation device 3.

[0174] Generation of surface display images based on operations specifying specific positions Fig. 35 is an explanatory diagram of operations on the display screen of the state inspection system. Fig. 35 shows an input / output screen 2000 displayed on the display 306 of the evaluation device 3 in step S95 of the sequence diagram shown in Fig. 34, but the same applies to the input / output screen 2000 displayed on the respective displays of the data acquisition device 9, terminal device 1100, and terminal device 1200.

[0175] The display control unit 33 of the evaluation device 3 displays an input / output screen 2000 including a designation reception screen 2010 that accepts a designation operation to designate a specific position on a slope, and a generation reception screen 2020 that accepts an instruction operation to instruct the generation of an image showing the specific position on a slope.

[0176] The display control unit 33 displays a surface image 2100 showing the surface of the slope on the specification reception screen 2010, and also displays a pointer 2300 operated by the pointing device 312 on the surface image 2100.

[0177] The surface image 2100 is an image read out in step S92 of FIG. 34 from the captured image data shown in FIG. 9(A), and the display control unit 33 displays the surface image 2100 in association with the captured images 1 and 2 shown in FIG. 10 and the X-axis direction and Y-axis direction shown in the captured image data 7A shown in FIG. 11.

[0178] The display control unit 33 displays a generation reception screen 2020 including a specified position confirmation button 2400, a deformation confirmation button 2410, a deformation sign confirmation button 2420, a front view analysis button 2430, a front view comparison button 2440, a cross-sectional view analysis button 2450, and a cross-sectional view comparison button 2460. The deformation confirmation button 2410, the deformation sign confirmation button 2420, the front view analysis button 2430, the front view comparison button 2440, the cross-sectional view analysis button 2450, and the cross-sectional view comparison button 2460 are buttons for issuing an instruction to generate an image showing a specific position on the slope, using the position of a portion in the surface image 2100 or the cross-sectional image 2200 that satisfies predetermined conditions as the specific position.

[0179] The designated position confirmation button 2400 is a button for confirming the specific position on the slope designated on the designation reception screen 2010 and issuing an instruction to generate an image showing the specific position on the slope.

[0180] The deformation confirmation button 2410 is a button that instructs the generation of an image showing a specific position on the slope, with the position showing a deformation of the slope being the specific position, and the deformation warning confirmation button 2420 is a button that instructs the generation of an image showing a specific position on the slope, with the position showing a warning of a deformation of the slope being the specific position.

[0181] The front view analysis button 2430 is a button that instructs the system to generate an image showing a specific position on a slope, using the portion obtained by analyzing the surface image 2100 as the specific position.The front view comparison button 2440 is a button that instructs the system to generate an image showing a specific position on a slope, using the portion obtained by comparing the surface image 2100 with another image as the specific position.

[0182] The cross-sectional view analysis button 2450 is a button that instructs the system to generate an image showing a specific position on a slope, with the portion obtained by analyzing the cross-sectional image described below as the specific position, and the cross-sectional view comparison button 2460 is a button that instructs the system to generate an image showing a specific position on a slope, with the portion obtained by comparing the cross-sectional image with another image as the specific position.

[0183] Fig. 36 is a flowchart showing the processing based on the operation shown in Fig. 33. Fig. 36(a) shows the processing in the evaluation device 3, and Fig. 36(b) shows the processing in the data management device 5.

[0184] When a predetermined position on the surface image 2100 is pointed to by the pointer 2300, the reception unit 32 of the evaluation device 3 receives the pointing operation (step S101), and when the designated position confirmation button 2400 is operated, the reception unit 32 receives the operation (step S102).

[0185] Next, the determination unit 34 of the evaluation device 3 detects the XY coordinates of the pointed position in the surface image 2100 as a specific position (step S103). This specific position may indicate a point in the XY coordinates or may indicate an area.

[0186] Next, the communication unit 31 of the evaluation device 3 transmits input information relating to the input operation received by the receiving unit 32 to the data management device 5 (step S104). This input information includes designation information for designating a specific position in XY coordinates based on a pointing operation using the pointer 2300, and instruction information for instructing generation of an image showing the specific position on the slope based on operation of the designated position confirmation button 2400.

[0187] The communication unit 51 of the data management device 5 receives the input information transmitted from the evaluation device 3, and the generation unit 54 generates a surface position image that overlaps the XY coordinates of the specific position by superimposing it on the surface image using the image data shown in Fig. 11(A) based on the instruction information and specification information included in the received input information, thereby generating a surface display image (step S105). The surface position image does not necessarily have to completely match the XY coordinates of the specific position, as long as it overlaps the XY coordinates of the specific position.

[0188] Next, the generation unit 54 generates a cross-sectional image corresponding to the X coordinate of the specific position using the image data shown in Fig. 11(A) and the ranging data shown in Fig. 11(B) (step S106). If the ranging data shown in Fig. 11(B) does not include the X coordinate of the specific position, the generation unit 54 generates a cross-sectional image based on data near the X coordinate of the specific position included in the ranging data shown in Fig. 11(B).

[0189] In step S107, the generation unit 54 generated a cross-sectional image of a cross-section including the Z-axis direction and the vertical direction shown in FIG. 10, but it may also generate a cross-sectional image of a cross-section including a direction inclined from the Z-axis direction and the vertical direction, or a cross-sectional image of a cross-section including a direction inclined from the Z-axis direction.

[0190] The generating unit 54 generates a cross-sectional position image that overlaps with the Y coordinate of the specific position by superimposing it on the ridge line of the cross-sectional image, and generates a cross-sectional display image (step S107).

[0191] The communication unit 51 transmits the surface display image generated in step S106 and the cross-section display image generated in step S108 to the evaluation device 3 (step S108).

[0192] Then, as shown in steps S98 and S99 of Figure 34, the communication unit 31 of the evaluation device 3 receives the surface display image and cross-sectional display image transmitted from the data management device 5, and the display control unit 33 of the evaluation device 3 displays the received surface display image and cross-sectional display image on the display 306.

[0193] Fig. 37 is an example of a display screen after the processing shown in Fig. 34. Fig. 37 shows an input / output screen 2000 displayed on the display 306 of the evaluation device 3 in step S99 of the sequence diagram shown in Fig. 34.

[0194] The display contents of the generation reception screen 2020 are the same as those in FIG. 35, but the display contents of the designation reception screen 2010 are different from those in FIG.

[0195] The display control unit 33 of the evaluation device 3 displays, on the specification reception screen 2010, a surface display image 2150 including a surface image 2100 showing the surface of the slope and a surface position image 2110 showing a specific position in the surface image 2100, and a cross-sectional display image 2250 including a cross-sectional image 2200 showing the cross-section of the slope and a cross-sectional position image 2210 showing a specific position in the cross-sectional image 2200.

[0196] The display control unit 33 displays the cross-sectional image 2200 in association with the Y-axis direction and the Z-axis direction shown in FIG.

[0197] The user can appropriately check the state of the specific position by comparing the surface position image 2110 with the cross-sectional position image 2210.

[0198] FIG. 38 shows a specific example of a cross-sectional display image displayed on the display screen.

[0199] The display control unit 33 of the evaluation device 3 displays the cross-section display image 2250 in association with a scale 2251 in the Y-axis direction and a scale 2252 in the Z-axis direction.

[0200] Furthermore, the display control unit 33 displays detailed information 2211 such as the length and height of the specific position in association with the cross-sectional position image 2210.

[0201] Furthermore, when the pointer 2300 is pointed to two points, the display control unit 33 displays a ruler 2212 and distance information 2213 such as 8 cm.

[0202] FIG. 39 is an explanatory diagram of a cross-sectional display image displayed on the display screen.

[0203] In Figure 39(a), the display control unit 33 of the evaluation device 3 also displays parts 2201 that are not related to the slope, such as tree branches and utility poles, along with the cross-sectional display image 2250. However, as shown in Figure 39(b), it is preferable that the display control unit 33 of the evaluation device 3 does not display parts 2201 that are not related to the slope, such as tree branches and utility poles.

[0204] - Generation of cross-sectional images based on operations specifying specific positions Fig. 40 is an explanatory diagram of operations on the display screen. Fig. 40 shows operations on the display screen shown in Fig. 37, and the display control unit 33 displays a pointer 2300 operated by the pointing device 312 on the cross-sectional image 2200.

[0205] FIG. 41 is a flowchart showing the processing based on the operation shown in FIG. 41(a) shows the processing in the evaluation device 3, and FIG. 41(b) shows the processing in the data management device 5.

[0206] When a predetermined position on the cross-sectional image 2200 is pointed to by the pointer 2300, the reception unit 32 of the evaluation device 3 receives the pointing operation (step S111), and when the designated position confirmation button 2400 is operated, the reception unit 32 receives the operation (step S112).

[0207] Next, the determination unit 34 of the evaluation device 3 detects the X coordinate of the cross-sectional image 2200 and the YZ coordinate of the pointed position in the cross-sectional image 2200 as a specific position (step S113). This specific position may indicate a point in the YZ coordinate or may indicate a region.

[0208] Next, the communication unit 31 of the evaluation device 3 transmits input information relating to the input operation received by the receiving unit 32 to the data management device 5 (step S114). This input information includes designation information for designating a specific position in XYZ coordinates based on a pointing operation using the pointer 2300, and instruction information for instructing generation of an image showing the specific position on the slope based on operation of the designated position confirmation button 2400.

[0209] The communication unit 51 of the data management device 5 receives the input information transmitted from the evaluation device 3, and the generation unit 54 generates a cross-sectional position image that overlaps with the YZ coordinates of the specific position by superimposing it on the cross-sectional image using the image data shown in FIG. 11(A) and the ranging data shown in FIG. 11(B) based on the instruction information and specification information contained in the received input information, thereby generating a cross-sectional display image (step S115).

[0210] 11(A), the generation unit 54 generates a surface position image that overlaps with the XY coordinates of the specific position by superimposing it on the surface image, thereby generating a surface display image (step S116). The surface position image does not necessarily have to completely match the XY coordinates of the specific position, as long as it overlaps with the XY coordinates of the specific position.

[0211] The communication unit 51 transmits the cross-section display image generated in step S115 and the surface display image generated in step S116 to the evaluation device 3 (step S117).

[0212] Then, as shown in steps S98 and S99 of Figure 34, the communication unit 31 of the evaluation device 3 receives the surface display image and cross-sectional display image transmitted from the data management device 5, and the display control unit 33 of the evaluation device 3 displays the received surface display image and cross-sectional display image on the display 306.

[0213] Fig. 42 is an example of a display screen after the processing shown in Fig. 41. Fig. 42 shows an input / output screen 2000 displayed on the display 306 of the evaluation device 3 after the processing shown in Fig. 41.

[0214] The display control unit 33 of the evaluation device 3 displays the surface position image 2110 and the cross-sectional position image 2210 at the position operated by the pointer 2300 in FIG.

[0215] - Generation of display images based on specific locations that indicate abnormalities or signs of abnormalities 43 is a flowchart showing the processing for confirming the position of a deformation or the position of a sign of deformation. Fig. 43(a) shows the processing in the evaluation device 3, and Fig. 43(b) shows the processing in the data management device 5.

[0216] When the deformation confirmation button 2410 is operated, the reception unit 32 of the evaluation device 3 receives the operation (step S121), and when the deformation sign confirmation button 2420 is operated, the reception unit 32 receives the operation (step S122).

[0217] The communication unit 31 of the evaluation device 3 transmits, to the data management device 5, input information relating to the input operation accepted by the accepting unit 32.

[0218] When the deformation confirmation button 2410 is operated, the communication unit 31 transmits instruction information instructing the generation of an image showing the specific position on the slope, with the position showing the deformation of the slope set as the specific position (step S123), and when the deformation prediction confirmation button 2420 is operated, the communication unit 31 transmits instruction information instructing the generation of an image showing the specific position on the slope, with the position showing the signs of deformation of the slope set as the specific position (step S124).

[0219] The communication unit 51 of the data management device 5 receives the input information sent from the evaluation device 3, and the judgment unit 52 detects the XY coordinates of the deformation position or deformation prediction position read out from the processing data management DB 5003 by the memory / reading unit 59 as a specific position (step S125).

[0220] 11(A), the generation unit 54 generates a surface position image that overlaps with the XY coordinates of the specific position by superimposing it on the surface image, thereby generating a surface display image (step S126). The surface position image does not necessarily have to completely match the XY coordinates of the specific position, as long as it overlaps with the XY coordinates of the specific position.

[0221] Next, the generation unit 54 generates a cross-sectional image corresponding to the X coordinate of the specific position using the image data shown in Fig. 11(A) and the ranging data shown in Fig. 11(B) (step S127). If the ranging data shown in Fig. 11(B) does not include the X coordinate of the specific position, the generation unit 54 generates a cross-sectional image based on data near the X coordinate of the specific position included in the ranging data shown in Fig. 11(B).

[0222] In step S107, the generation unit 54 generated a cross-sectional image of a cross-section including the Z-axis direction and the vertical direction shown in FIG. 10, but it may also generate a cross-sectional image of a cross-section including a direction inclined from the Z-axis direction and the vertical direction, or a cross-sectional image of a cross-section including a direction inclined from the Z-axis direction.

[0223] The generating unit 54 generates a cross-sectional position image that overlaps with the Y coordinate of the specific position by superimposing it on the ridge line of the cross-sectional image, thereby generating a cross-sectional display image (step S128).

[0224] The communication unit 51 transmits the surface display image generated in step S126 and the cross-section display image generated in step S128 to the evaluation device 3 (step S129).

[0225] Then, as shown in steps S98 and S99 of Figure 34, the communication unit 31 of the evaluation device 3 receives the surface display image and cross-sectional display image transmitted from the data management device 5, and the display control unit 33 of the evaluation device 3 displays the received surface display image and cross-sectional display image on the display 306.

[0226] - Generation of display images based on specific positions in the surface image analysis results 44 is a flowchart showing the processing relating to the surface image analysis, in which (a) of FIG. 44 shows the processing in the evaluation device 3, and (b) of FIG.

[0227] When the front view analysis button 2430 is operated, the reception unit 32 of the evaluation device 3 receives the operation (step S131), and the communication unit 31 of the evaluation device 3 transmits input information related to the input operation received by the reception unit 32 to the data management device 5 (step S132). This input information includes instruction information that instructs the generation of an image showing a specific position on the slope, using a portion obtained by analyzing the surface image 2100 as the specific position.

[0228] The communication unit 51 of the data management device 5 receives the input information transmitted from the evaluation device 3, and the judgment unit 52 compares the surface image read out from the processing data management DB 5003 by the storage / readout unit 59 with the teacher image, and detects the XY coordinates of the part that matches the teacher image as a specific position (step S135). Here, the data management device 5 acquires the teacher images shown in Figures 7 and 8 from the state type management DB 3001 of the evaluation device 3.

[0229] The determination unit 52 can compare the surface image with a plurality of teacher images and detect the XY coordinates of the portions that match with each of the plurality of teacher images as a plurality of specific positions.

[0230] 11(A), the generation unit 54 generates a surface position image that overlaps with the XY coordinates of the specific position by superimposing it on the surface image, thereby generating a surface display image (step S136). The surface position image does not necessarily have to completely match the XY coordinates of the specific position, as long as it overlaps with the XY coordinates of the specific position.

[0231] When there are a plurality of specific positions, the generating unit 54 can generate a surface display image by superimposing, on the surface image, surface position images that overlap with the XY coordinates of each of the plurality of specific positions.

[0232] Next, the generation unit 54 generates a cross-sectional image corresponding to the X coordinate of the specific position using the image data shown in Fig. 11(A) and the ranging data shown in Fig. 11(B) (step S137). If the ranging data shown in Fig. 11(B) does not include the X coordinate of the specific position, the generation unit 54 generates a cross-sectional image based on data near the X coordinate of the specific position included in the ranging data shown in Fig. 11(B).

[0233] In step S137, the generation unit 54 generated a cross-sectional image of a cross-section including the Z-axis direction and the vertical direction shown in FIG. 10, but it may also generate a cross-sectional image of a cross-section including a direction inclined from the Z-axis direction and the vertical direction, or a cross-sectional image of a cross-section including a direction inclined from the Z-axis direction.

[0234] When there are a plurality of specific positions, the generating unit 54 can generate a plurality of cross-sectional images that overlap with the X coordinates of the plurality of specific positions, respectively.

[0235] The generating unit 54 generates a cross-sectional position image that overlaps with the Y coordinate of the specific position by superimposing it on the ridge line of the cross-sectional image, and generates a cross-sectional display image (step S138).

[0236] When there are multiple specific positions, the generating unit 54 can execute step S138 for each of the multiple cross-sectional images.

[0237] The communication unit 51 transmits the surface display image generated in step S136 and the one or more cross-section display images generated in step S138 to the evaluation device 3 (step S139).

[0238] Then, as shown in steps S98 and S99 of Figure 34, the communication unit 31 of the evaluation device 3 receives the surface display image and one or more cross-sectional display images transmitted from the data management device 5, and the display control unit 33 of the evaluation device 3 displays the received surface display image and one or more cross-sectional display images on the display 306.

[0239] Fig. 45 is an example of a display screen after the processing shown in Fig. 44. Fig. 45 shows an input / output screen 2000 displayed on the display 306 of the evaluation device 3 after the processing shown in Fig. 44.

[0240] The display control unit 33 of the evaluation device 3 displays a surface display image 2150 including a surface image 2100, a first surface position image 2110A indicating a first specific position in the surface image 2100, and a second surface position image 2110B indicating a second specific position in the surface image 2100.

[0241] Furthermore, the display control unit 33 displays a first cross-sectional display image 2250A including a first cross-sectional image 2200A and a first cross-sectional position image 2210A indicating a first specific position in the first cross-sectional image 2200A, and also displays a second cross-sectional display image 2250B including a second cross-sectional image 2200B and a second cross-sectional position image 2210B indicating a second specific position in the second cross-sectional image 2200B.

[0242] Here, the first identified position indicates, as an example, a portion of the surface image that is determined to match a teacher image showing a vertical and horizontal crack pattern in step S135 of Fig. 44. Also, the second identified position indicates, as an example, a portion of the surface image that is determined to match a teacher image showing a dense crack pattern in step S135 of Fig. 44.

[0243] - Generation of display images based on specific positions related to the analysis results of cross-sectional images FIG. 46 is a flowchart showing the process related to the cross-sectional image analysis.

[0244] 46(a) shows the processing in the evaluation device 3, and FIG. 46(b) shows the processing in the data management device 5.

[0245] When the cross-sectional view analysis button 2450 is operated, the reception unit 32 of the evaluation device 3 receives the operation (step S141), and the communication unit 31 of the evaluation device 3 transmits input information related to the input operation received by the reception unit 32 to the data management device 5 (step S142). This input information includes instruction information that instructs the generation of an image showing the specific position on the slope, with a portion obtained by analyzing the cross-sectional image 2200 being set as the specific position.

[0246] The communication unit 51 of the data management device 5 receives the input information transmitted from the evaluation device 3, and the determination unit 52 detects a singular point of the ridge line of the cross-sectional image as a specific position (step S145). As an example, the determination unit 52 detects a portion where the slope of the ridge line of the cross-sectional image changes by a predetermined value or more compared to other portions as a singular point and a specific position.

[0247] When the determining unit 52 determines that there are multiple singular points on the ridge line of the cross-sectional image, it can detect each singular point as a specific position.

[0248] The generating unit 54 generates a cross-sectional position image that overlaps with the YZ coordinates of the specific position by superimposing it on the cross-sectional image, thereby generating a cross-sectional display image (step S146).

[0249] The generating unit 54 generates a surface position image that overlaps with the XY coordinates of the specific position by superimposing it on the surface image, thereby generating a surface display image (step S147).

[0250] The communication unit 51 transmits the cross-section display image generated in step S146 and the surface display image generated in step S147 to the evaluation device 3 (step S148).

[0251] Then, as shown in steps S98 and S99 of Figure 34, the communication unit 31 of the evaluation device 3 receives the surface display image and cross-sectional display image transmitted from the data management device 5, and the display control unit 33 of the evaluation device 3 displays the received surface display image and cross-sectional display image on the display 306.

[0252] - Generation of display images based on specific positions in comparison with past images 47 is a flowchart showing the process relating to the surface image comparison, in which (a) of FIG. 47 shows the process in the evaluation device 3, and (b) of FIG. 47 shows the process in the data management device 5.

[0253] When the front view comparison button 2440 is operated, the reception unit 32 of the evaluation device 3 receives the operation (step S151), and the communication unit 31 of the evaluation device 3 transmits input information related to the input operation received by the reception unit 32 to the data management device 5 (step S152). This input information includes instruction information that instructs the generation of an image showing the specific position on the slope, using the portion obtained by comparing the surface image 2100 with another image as the specific position.

[0254] The communication unit 51 of the data management device 5 receives the input information transmitted from the evaluation device 3, and the judgment unit 52 compares the surface image read out from the processing data management DB 5003 by the storage and reading unit 59 with the past surface image, and detects the XY coordinates of the different part as the specific position (step S155). Here, the storage and reading unit 59 can, as an example, read out a past image captured at the same location as the surface image from the processing data management DB 5003 using the positioning data shown in Fig. 9(A) as a search key.

[0255] The determination unit 52 can compare the surface image with the previous image and detect the XY coordinates of a plurality of different portions as a plurality of specific positions.

[0256] The generation unit 54 generates a surface display image by superimposing a surface position image that overlaps the X and Y coordinates of the specific position on the surface image (step S156). The surface position image does not necessarily have to completely match the X and Y coordinates of the specific position, as long as it overlaps the X and Y coordinates of the specific position.

[0257] When there are a plurality of specific positions, the generating unit 54 can generate a surface display image by superimposing, on the surface image, surface position images that overlap with the XY coordinates of each of the plurality of specific positions.

[0258] Then, the generation unit 54 generates another position image that overlaps with the X and Y coordinates of the specific position by superimposing it on the past image, thereby generating a past display image (step S157). The other position image does not necessarily have to completely match the X and Y coordinates of the specific position, but only needs to overlap with the X and Y coordinates of the specific position.

[0259] When there are a plurality of specific positions, the generating unit 54 can generate a past display image by superimposing other position images that overlap with the XY coordinates of each of the plurality of specific positions on the past image.

[0260] Next, the generation unit 54 generates a cross-sectional image corresponding to the X coordinate of the specific position using the image data shown in Fig. 11(A) and the ranging data shown in Fig. 11(B) (step S158). If the ranging data shown in Fig. 11(B) does not include the X coordinate of the specific position, the generation unit 54 generates a cross-sectional image based on data near the X coordinate of the specific position included in the ranging data shown in Fig. 11(B).

[0261] In step S157, the generation unit 54 generated a cross-sectional image of a cross-section including the Z-axis direction and the vertical direction shown in FIG. 10, but may also generate a cross-sectional image of a cross-section including a direction inclined from the Z-axis direction and the vertical direction, or a cross-sectional image of a cross-section including a direction inclined from the Z-axis direction.

[0262] When there are a plurality of specific positions, the generating unit 54 can generate a plurality of cross-sectional images that overlap with the X coordinates of the plurality of specific positions, respectively.

[0263] The generating unit 54 generates a cross-sectional position image that overlaps with the Y coordinate of the specific position by superimposing it on the ridge line of the cross-sectional image, and generates a cross-sectional display image (step S159).

[0264] When there are a plurality of specific positions, the generating unit 54 can execute step S159 for each of the plurality of cross-sectional images.

[0265] The communication unit 51 transmits to the evaluation device 3 the surface display image generated in step S156, the past display image generated in step S157, and one or more cross-section display images generated in step S159 (step S160).

[0266] Then, as shown in steps S98 and S99 of Figure 34, the communication unit 31 of the evaluation device 3 receives the surface display image, the past display image, and one or more cross-sectional display images transmitted from the data management device 5, and the display control unit 33 of the evaluation device 3 displays the received surface display image, the past display image, and one or more cross-sectional display images on the display 306.

[0267] Fig. 48 is an example of a display screen after the processing shown in Fig. 47. Fig. 48 shows an input / output screen 2000 displayed on the display 306 of the evaluation device 3 after the processing shown in Fig. 47.

[0268] The display control unit 33 of the evaluation device 3 displays a surface display image 2150 including the surface image 2100 and the surface position image 2110, a cross-sectional display image 2250 including the cross-sectional image 2200 and the cross-sectional position image 2210, and a past display image 2180 including a past image 2160 and another position image 2170 indicating a specific position in the surface image 2160.

[0269] Fig. 49 is a flowchart showing a modified example of the process relating to the surface image comparison. Fig. 49 shows a modified example of the process in the data management device 5 shown in Fig. 47(b).

[0270] The communication unit 51 of the data management device 5 receives the input information transmitted from the evaluation device 3 and makes a judgment.

[0271] The unit 52 compares the surface image read out from the processing data management DB 5003 by the storage / readout unit 59 with the inspection image, and detects the XY coordinates of the portion in the inspection image that corresponds to the inspection position as the specific position (step S165). Here, the data management device 5 can acquire, as an example, an inspection image in which multiple inspection positions (P1 to P4) are drawn, as shown in the display image area 480 of Fig. 19, from the recording medium 315 or the like.

[0272] The determination unit 52 can detect the XY coordinates of a plurality of inspection positions in the inspection image as a plurality of specific positions.

[0273] The generation unit 54 generates a surface display image by superimposing a surface position image that overlaps the X and Y coordinates of the specific position on the surface image (step S166). The surface position image does not necessarily have to completely match the X and Y coordinates of the specific position, as long as it overlaps the X and Y coordinates of the specific position.

[0274] When there are a plurality of specific positions, the generating unit 54 can generate a surface display image by superimposing, on the surface image, surface position images that overlap with the XY coordinates of each of the plurality of specific positions.

[0275] Next, the generation unit 54 generates a cross-sectional image corresponding to the X coordinate of the specific position using the image data shown in Fig. 11(A) and the ranging data shown in Fig. 11(B) (step S167). If the ranging data shown in Fig. 11(B) does not include the X coordinate of the specific position, the generation unit 54 generates a cross-sectional image based on data near the X coordinate of the specific position included in the ranging data shown in Fig. 11(B).

[0276] In step S167, the generation unit 54 calculates the Z-axis direction and the vertical direction shown in FIG. However, a cross-sectional image of a cross-section including a direction tilted from the Z-axis direction and the vertical direction, or a cross-sectional image of a cross-section including a direction tilted from the Z-axis direction may also be generated.

[0277] When there are a plurality of specific positions, the generating unit 54 can generate a plurality of cross-sectional images that overlap with the X coordinates of the plurality of specific positions, respectively.

[0278] The generating unit 54 generates a cross-sectional position image that overlaps with the Y coordinate of the specific position by superimposing it on the ridge line of the cross-sectional image, and generates a cross-sectional display image (step S168).

[0279] When there are multiple specific positions, the generating unit 54 can execute step S168 for each of the multiple cross-sectional images.

[0280] The communication unit 51 transmits the surface display image generated in step S166 and one or more cross-section display images generated in step S168 to the evaluation device 3 (step S169).

[0281] Then, as shown in steps S98 and S99 of Figure 34, the communication unit 31 of the evaluation device 3 receives the surface display image, the past display image, and one or more cross-sectional display images transmitted from the data management device 5, and the display control unit 33 of the evaluation device 3 displays the received surface display image, the past display image, and one or more cross-sectional display images on the display 306.

[0282] 50 is a flowchart showing the process relating to the cross-sectional image comparison, in which (a) of FIG. 50 shows the process in the evaluation device 3, and (b) of FIG.

[0283] When the cross-sectional view comparison button 2460 is operated, the reception unit 32 of the evaluation device 3 receives the operation (step S171), and the communication unit 31 of the evaluation device 3 transmits input information related to the input operation received by the reception unit 32 to the data management device 5 (step S172). This input information includes instruction information for instructing the generation of an image showing the specific position on the slope, using the portion obtained by comparing the cross-sectional image 2200 with another image as the specific position.

[0284] The communication unit 51 of the data management device 5 receives the input information transmitted from the evaluation device 3, and the determination unit 52 compares the cross-sectional image with the previous cross-sectional image and detects the YZ coordinates of the different part as the specific position (step S175).

[0285] The determination unit 52 can compare the cross-sectional image with the previous image and detect the YZ coordinates of a plurality of different portions as a plurality of specific positions.

[0286] The generation unit 54 generates a cross-sectional position image that overlaps with the YZ coordinates of the specific position by superimposing it on the cross-sectional image, thereby generating a cross-sectional display image (step S176). The cross-sectional position image does not necessarily have to completely match the YZ coordinates of the specific position, but only needs to overlap with the YZ coordinates of the specific position.

[0287] When there are a plurality of specific positions, the generating unit 54 can generate a cross-sectional display image by superimposing cross-sectional position images that overlap with the YZ coordinates of each of the plurality of specific positions on the cross-sectional image.

[0288] Next, the generating unit 54 generates a surface position image that overlaps with the XY coordinates of the specific position by superimposing it on the surface image, thereby generating a surface display image (step S177).

[0289] When there are multiple specific positions, the generating unit 54 can generate a surface display image including multiple surface position images.

[0290] The communication unit 51 transmits the cross-section display image generated in step S176 and the surface display image generated in step S177 to the evaluation device 3 (step S178).

[0291] Then, as shown in steps S98 and S99 of Figure 34, the communication unit 31 of the evaluation device 3 receives the surface display image and cross-sectional display image transmitted from the data management device 5, and the display control unit 33 of the evaluation device 3 displays the received surface display image and cross-sectional display image on the display 306.

[0292] - Generation of 3D surface display images based on operations specifying specific positions FIG. 51 is an explanatory diagram of operations on a display screen relating to a 3D image.

[0293] The display control unit 33 of the evaluation device 3 displays a 3D image 2500 showing the three-dimensional shape of the slope on the specification reception screen 2010 in place of the surface image 2100 shown in Figure 35, and also displays a pointer 2300 operated by the pointing device 312 on the 3D image 2500.

[0294] 3D image 2500 is an image generated using the image data shown in FIG. 11(A) and the ranging data shown in FIG. 11(B), and display control unit 33 displays 3D image 2500 in association with the X-axis direction, Y-axis direction, and Z-axis direction shown in captured images 1 and 2 shown in FIG. 10.

[0295] The display control unit 33 can change the display area of ​​the 3D image 2500 by changing the position and orientation of a virtual camera located at the viewpoint from which the 3D image 2500 is viewed.

[0296] Fig. 52 is a flowchart showing the processing based on the operation shown in Fig. 49. Fig. 52(a) shows the processing in the evaluation device 3, and Fig. 52(b) shows the processing in the data management device 5.

[0297] When a predetermined position on the 3D image 2500 is pointed to by the pointer 2300, the reception unit 32 of the evaluation device 3 receives the pointing operation (step S181), and when the designated position confirmation button 2400 is operated, the reception unit 32 receives the operation (step S182).

[0298] Next, the determination unit 34 of the evaluation device 3 detects the XYZ coordinates of the pointed position in the 3D image 2500 as a specific position (step S183). This specific position may indicate a point in the XYZ coordinates or may indicate an area.

[0299] Next, the communication unit 31 of the evaluation device 3 transmits input information relating to the input operation received by the receiving unit 32 to the data management device 5 (step S184). This input information includes designation information for designating a specific position in XYZ coordinates based on a pointing operation using the pointer 2300, and instruction information for instructing generation of an image showing the specific position on the slope based on operation of the designated position confirmation button 2400.

[0300] The communication unit 51 of the data management device 5 receives the input information transmitted from the evaluation device 3, and the generation unit 54 generates a 3D position image that overlaps the XYZ coordinates of the specific position by superimposing it on the 3D image using the image data shown in Fig. 11(A) based on the instruction information and specification information included in the received input information, thereby generating a 3D display image (step S186). The surface position image does not necessarily have to completely match the XYZ coordinates of the specific position, as long as it overlaps the XYZ coordinates of the specific position.

[0301] Next, the generation unit 54 generates a cross-sectional image corresponding to the X coordinate of the specific position using the image data shown in Fig. 11(A) and the ranging data shown in Fig. 11(B) (step S187). If the ranging data shown in Fig. 11(B) does not include the X coordinate of the specific position, the generation unit 54 generates a cross-sectional image based on data near the X coordinate of the specific position included in the ranging data shown in Fig. 11(B).

[0302] In step S187, the generation unit 54 generates a cross-sectional image of a cross-section including the Z-axis direction and the vertical direction shown in FIG. 10, but may also generate a cross-sectional image of a cross-section including a direction inclined from the Z-axis direction and the vertical direction, or a cross-sectional image of a cross-section including a direction inclined from the Z-axis direction.

[0303] The generating unit 54 generates a cross-sectional position image that overlaps with the Y coordinate of the specific position by superimposing it on the ridge line of the cross-sectional image, and generates a cross-sectional display image (step S188).

[0304] The communication unit 51 transmits the 3D display image generated in step S185 and the cross-sectional display image generated in step S187 to the evaluation device 3 (step S188).

[0305] Then, as shown in steps S98 and S99 of FIG. 34, the communication unit 31 of the evaluation device 3 receives the 3D display image and the cross-sectional display image transmitted from the data management device 5, and the display control unit 33 of the evaluation device 3 displays the received 3D display image and the cross-sectional display image on the display 306.

[0306] 11(A), the generation unit 54 may further generate a surface display image by superimposing a surface position image that overlaps with the XY coordinates of the specific position on the surface image, and the communication unit 51 may further transmit the surface display image to the evaluation device 3. In this case, the communication unit 31 of the evaluation device 3 further receives the surface display image transmitted from the data management device 5, and the display control unit 33 of the evaluation device 3 further displays the received surface display image on the display 306.

[0307] FIG. 53 is an example of a display screen after the processing shown in FIG.

[0308] The display control unit 33 of the evaluation device 3 displays, instead of the surface display image 2150 shown in Figure 37, a 3D display image 2550 including a 3D image 2500 and a 3D position image 2510 indicating a specific position in the 3D image 2500 on the specification reception screen 2010, and also displays a cross-sectional display image 2250 on the specification reception screen 2010.

[0309] The display control unit 33 may further display the surface display image 2150 shown in FIG. 37 on the designation receiving screen 2010, or may switch between the surface display image 2150 and the 3D display image 2550.

[0310] - Generation of multiple cross-sectional images based on the operation of specifying a specific position Fig. 54 is a flowchart showing a modification of the processing shown in Fig. 36. Fig. 54(a) shows the processing in the evaluation device 3, and Fig. 54(b) shows the processing in the data management device 5.

[0311] Steps S191 to S194 shown in FIG. 54(a) are the same as steps S101 to S104 shown in FIG. 36(a).

[0312] The communication unit 51 of the data management device 5 receives the input information transmitted from the evaluation device 3, and the generation unit 54 generates a surface position image that overlaps the XY coordinates of the specific position by superimposing it on the surface image using the image data shown in Fig. 11(A) based on the instruction information and specification information included in the received input information, thereby generating a surface display image (step S195). The surface position image does not necessarily have to completely match the XY coordinates of the specific position, as long as it overlaps the XY coordinates of the specific position.

[0313] Next, the generation unit 54 generates a cross-sectional image corresponding to the X coordinate of the specific position, and also generates cross-sectional images corresponding to X coordinates near the X coordinate of the specific position, using the image data shown in FIG. 11(A) and the ranging data shown in FIG. 11(B) (step S196).

[0314] In step S196, the generation unit 54 generates a cross-sectional image of a cross-section including the Z-axis direction and the vertical direction shown in FIG. 10, but may also generate a cross-sectional image of a cross-section including a direction inclined from the Z-axis direction and the vertical direction, or a cross-sectional image of a cross-section including a direction inclined from the Z-axis direction.

[0315] The generating unit 54 generates a plurality of cross-sectional position images that overlap with the Y coordinate of the specific position by superimposing them on the ridge lines of the respective cross-sectional images, thereby generating a plurality of cross-sectional display images (step S197).

[0316] The communication unit 51 transmits the surface display image generated in step S195 and the multiple cross-section display images generated in step S197 to the evaluation device 3 (step S198).

[0317] Then, as shown in steps S98 and S99 of Figure 34, the communication unit 31 of the evaluation device 3 receives the surface display image and multiple cross-sectional display images transmitted from the data management device 5, and the display control unit 33 of the evaluation device 3 displays the received surface display image and multiple cross-sectional display images on the display 306.

[0318] FIG. 55 is an example of a display screen after the processing shown in FIG.

[0319] The display control unit 33 of the evaluation device 3 displays a plurality of cross-section display images 2250A to 2250E on the designation receiving screen 2010 in place of the cross-section display image 2250 shown in FIG.

[0320] Each of the plurality of cross-section display images 2250A to 2250E includes a corresponding one of the cross-section images 2200A to 2200E and a corresponding one of the cross-section position images 2210A to 2210E.

[0321] The display control unit 33 displays the amount of deviation in the X-axis direction in association with each of the cross-sectional display images 2250A to 2250E.

[0322] In FIG. 55, cross-sectional display image 2250C is used as the ±0 reference, and cross-sectional display image 2250A shows a cross-section that is shifted -20 cm in the X-axis direction from cross-sectional display image 2250C, cross-sectional display image 2250B shows a cross-section that is shifted -10 cm in the X-axis direction from cross-sectional display image 2250C, cross-sectional display image 2250D shows a cross-section that is shifted +10 cm in the X-axis direction from cross-sectional display image 2250C, and cross-sectional display image 2250E shows a cross-section that is shifted +20 cm in the X-axis direction from cross-sectional display image 2250C.

[0323] - Generation of multiple surface display images based on operations specifying specific positions Fig. 56 is a flowchart showing a second modified example of the processing shown in Fig. 36. Fig. 56(a) shows the processing in the evaluation device 3, and Fig. 56(b) shows the processing in the data management device 5.

[0324] Steps S201 to S204 shown in FIG. 56(a) are the same as steps S101 to S104 shown in FIG. 36(a).

[0325] The communication unit 51 of the data management device 5 receives the input information transmitted from the evaluation device 3, and the generation unit 54 generates a surface position image that overlaps the XY coordinates of the specific position by superimposing it on the surface image using the image data shown in Fig. 11(A) based on the instruction information and specification information included in the received input information, thereby generating a surface display image (step S195). The surface position image does not necessarily have to completely match the XY coordinates of the specific position, as long as it overlaps the XY coordinates of the specific position.

[0326] Then, the generating unit 54 generates an enlarged surface display image by superimposing the surface position image that overlaps with the XY coordinates of the specific position on the enlarged image of the surface image (step 206).

[0327] Next, the generation unit 54 generates a cross-sectional image corresponding to the X coordinate of the specific position using the image data shown in Fig. 11(A) and the ranging data shown in Fig. 11(B) (step S207). If the ranging data shown in Fig. 11(B) does not include the X coordinate of the specific position, the cross-sectional image is generated based on data near the X coordinate of the specific position included in the ranging data shown in Fig. 11(B). If the ranging data shown in Fig. 11(B) does not include the X coordinate of the specific position, the cross-sectional image is generated based on data near the X coordinate of the specific position included in the ranging data shown in Fig. 11(B).

[0328] In step S207, the generation unit 54 generates a cross-sectional image of a cross-section including the Z-axis direction and the vertical direction shown in FIG. 10, but may also generate a cross-sectional image of a cross-section including a direction inclined from the Z-axis direction and the vertical direction, or a cross-sectional image of a cross-section including a direction inclined from the Z-axis direction.

[0329] The generating unit 54 generates a cross-sectional position image that overlaps with the Y coordinate of the specific position by superimposing it on the ridge line of the cross-sectional image, thereby generating a cross-sectional display image (step S208).

[0330] The communication unit 51 transmits the surface display image generated in step S205, the enlarged surface display image generated in step S206, and the cross-section display image generated in step S208 to the evaluation device 3 (step S198).

[0331] Then, as shown in steps S98 and S99 of Figure 34, the communication unit 31 of the evaluation device 3 receives the surface display image, enlarged surface display image, and cross-sectional display image transmitted from the data management device 5, and the display control unit 33 of the evaluation device 3 displays the received surface display image, enlarged surface display image, and cross-sectional display image on the display 306.

[0332] FIG. 57 is an example of a display screen after the processing shown in FIG.

[0333] The display control unit 33 of the evaluation device 3 displays, on the specification reception screen 2010, in addition to the surface display image 2150 and cross-sectional display image 2250 shown in Figure 37, an enlarged image 2100E of the surface image 2100 and an enlarged surface position image 2110E showing a specific position in the enlarged image 2100E.

[0334] Effect of the embodiment As explained above, the condition inspection system 1 can quantitatively detect the shape of an earthwork structure, as well as detect changes in the shape of the surface layer of the earthwork structure and abnormalities that occur in the surface layer of the earthwork structure, based on data acquired using three-dimensional sensors such as the camera device 7 and the distance sensor 8a, and can automatically generate evaluation reports such as those shown in Figures 23 to 25, 29 and 30 based on the evaluation results, thereby significantly improving the efficiency of slope inspection.In addition, by using the mobile system 60, the condition inspection system 1 can inspect high places, embankments, and other places where humans cannot enter.

[0335] Furthermore, by combining map data with the results of slope condition evaluation, the condition inspection system 1 can determine the location of the slope to be evaluated, making it possible to extract slopes of earthwork structures that do not require visual inspection and to improve the inspection speed per slope.In addition, by registering the evaluation results in the data management device 5, the condition inspection system 1 can quantitatively accumulate changes in the condition over time, making soundness diagnosis rational and efficient.

[0336] Although the above embodiment has described an example of inspecting and evaluating the condition of a slope, the condition inspection system 1 may be used not only to inspect the condition of a slope, but also in combination with inspecting other structures such as road surfaces, tunnels, bridges, etc. The condition inspection system 1 can further improve the efficiency of infrastructure inspections by inspecting various structures on roads using the mobile system 60.

[0337] ●Summary● As described above, the data management device 5 according to one embodiment of the information processing device of the present invention includes a communication unit 51, which is an example of an instruction receiving means for receiving instruction information instructing the generation of an image showing a specific position on a slope, which is an example of an object, and a generation unit 54, which is an example of an image generation means for generating, based on the instruction information, a surface display image 2150 including a surface image 2100 showing the surface of the slope and a surface position image 2110 showing a specific position in the surface image 2100, and a cross-sectional display image 2250 including a cross-sectional image 2200 showing a cross-section of the slope and a cross-sectional position image 2210 showing a specific position in the cross-sectional image 2200.

[0338] The data management device 5 also includes a generation unit 54 that generates, based on an operation received on a generation reception screen 2020 that receives an operation instructing the generation of an image showing a specific position on the slope, a surface display image 2150 including a surface image 2100 showing the surface of the slope and a surface position image 2110 showing a specific position in the surface image, and a cross-sectional display image 2250 including a cross-sectional image 2200 showing a cross-section of the slope and a cross-sectional position image 2210 showing a specific position in the cross-sectional image.

[0339] According to this embodiment, it is possible to generate a surface position image showing a specific position included in an image of the surface of a slope, and a cross-section position image showing a specific position included in an image of the cross-section of the slope. Note that this embodiment is not limited to slopes, and can be applied to objects for which it is necessary to check the surface image and cross-section image, such as tunnels, bridges, and buildings.

[0340] The data management device 5 further includes a communication unit 51, which is an example of a transmission unit that transmits the surface display image 2150 and the cross section display image 2250 to the communication terminals 3, 9, 1100, and 1200.

[0341] This allows the condition of a specific position to be properly confirmed by comparing the surface position image showing the specific position contained in the image of the surface of the slope with the cross-section position image showing the specific position contained in the image of the cross-section of the slope.

[0342] With the above configuration, the user of the communication terminal 3, 9, 1100, 1200 can easily check the specific position of the slope corresponding to the content of the report that has been submitted or will be submitted in the future.

[0343] In particular, the efficiency of advance preparations and on-site work when national and local government officials visit the site to inspect slopes related to reports that have been submitted or will be submitted in the future will be improved.

[0344] The communication unit 51 further transmits generation acceptance screen information relating to the generation acceptance screen 2020 to the communication terminals 3, 9, 1100, and 1200.

[0345] This allows the communication terminals 3, 9, 1100, and 1200 to receive an operation to instruct generation of an image showing a specific position on a slope.

[0346] The generation unit 54 generates a surface display image 2150 and a cross-sectional display image 2250 based on the specific position specified by the specification operation accepted in the specification acceptance screen information relating to the specification acceptance screen 2010 that accepts the specification operation for specifying the specific position.

[0347] This allows the state of the specific position designated by the designation operation to be properly confirmed by comparing the surface position image with the cross-sectional position image.

[0348] The designation receiving screen 2010 includes the surface image 2100 or the cross-sectional image 2200, so that a specific position included in the image of the surface of the slope or a specific position included in the image of the cross-section of the slope can be easily designated.

[0349] A surface display image 2150 and a cross-section display image 2250 are generated based on a designation operation that sets the position of a portion in the surface image 2100 or the cross-section image 2200 that satisfies a predetermined condition as a specific position.

[0350] This allows the state of a specific position that indicates the position of a portion in the surface image 2100 or the cross-sectional image 2200 that satisfies a predetermined condition to be appropriately confirmed by comparing the surface position image with the cross-sectional position image.

[0351] The generation unit 54 generates a surface display image 2150 and a cross-sectional display image 2250 based on an instruction operation to specify a position that indicates a deformation or a sign of a deformation of the slope, thereby making it possible to properly check the condition of the position that indicates a deformation or a sign of a deformation of the slope.

[0352] The generation unit 54 generates the surface display image 2150 and the cross-sectional display image 2250 based on an instruction operation that specifies the position of a part in the surface image 2100 or the cross-sectional image 2200 that matches or differs from another image 2160 as a specific position, thereby making it possible to appropriately check the state of the part that matches or differs from another image 2160.

[0353] The generation unit 54 further generates another display image 2180 including another image 2160 and another position image 2170 showing a specific position in the other image, thereby making it possible to appropriately check the state of the part in the other image 2160 that matches or differs from the surface image 2100 or the cross-sectional image 2200.

[0354] The generation unit 54 generates the surface display image 2150 and the cross-sectional display image 2250 by setting the position of a part in the surface image 2100 or the cross-sectional image 2200 that corresponds to a specific part in the other image 2160 as the specific position, thereby making it possible to appropriately check the state of the specific part in the other image 2160.

[0355] For example, if a specific portion in the other image 2160 is a position that indicates a deformation or a sign of a deformation of the slope, it is possible to check what the position in the other image 2160 that indicates a deformation or a sign of a deformation of the slope is like in the surface image 2100 or the cross-sectional image 2200.

[0356] The generation unit 54 further generates a three-dimensional surface display image 2550 including a three-dimensional surface image 2500 showing the surface of the slope in three dimensions and a three-dimensional surface position image 2510 showing a specific position in the three-dimensional surface image.

[0357] This allows the state of a specific position to be appropriately confirmed by visually comparing the three-dimensional surface position image 2510 with the surface position image 2110 or the cross-sectional position image 2220.

[0358] The generation unit 54 generates a plurality of cross-sectional images 2200A-E each showing a different cross section of the slope, and also generates a plurality of cross-sectional display images (2250A-E) including cross-sectional position images 2210A-E showing each of the plurality of cross-sectional images 2200A-E and specific positions in each of the cross-sectional images 2200A-E.

[0359] This allows the state of a specific position to be properly confirmed by visually comparing the multiple cross-sectional position images 2220A to 2220E.

[0360] The generation unit 54 generates multiple surface images 2100 each showing a different area on the surface of the slope, and also generates multiple surface display images (2150, 2150E) including each of the multiple surface images 2100, 2100E and surface position images 2110, 2110E showing specific positions in each surface image 2100, 2100E.

[0361] This allows the state of a specific position to be properly confirmed by visually comparing the multiple surface position images 2110 and 2110E.

[0362] A state inspection system 1 according to an embodiment of the information processing system of the present invention includes a data management device 5 and a communication terminal 3, 9, 1100, 1200 capable of communicating with the data management device 5. The data management device 5 includes a communication unit 51 that transmits to the communication terminal 3, 9, 1100, 1200 generation reception screen information relating to a generation reception screen 2020 that receives an operation to instruct the communication terminal 3, 9, 1100, 1200 to generate an image showing a specific position on a slope, and a surface display image 2150 that includes a surface image 2100 showing the surface of the slope and a surface position image 2110 showing the specific position in the surface image, based on the operation received on the generation reception screen 2020. and a generation unit 54 that generates a cross-sectional display image 2250 including a cross-sectional image 2200 showing a surface and a cross-sectional position image 2210 showing a specific position in the cross-sectional image, and the communication unit 51 further transmits the surface display image 2150 and the cross-sectional display image 2250 to the communication terminal 3, 9, 1100, 1200, and the communication terminal 3, 9, 1100, 1200 includes a display control means 33 that displays the generation acceptance screen 2020, the surface display image 2150 and the cross-sectional display image 2250 on a display 306, which is an example of a display unit, and a reception unit 32 that is an example of an operation reception means that receives operations on the generation acceptance screen 2020.

[0363] An information processing method according to one embodiment of the present invention includes a generation reception screen sending step (S94) of sending to a communication terminal 3, 9, 1100, 1200 generation reception screen information relating to a generation reception screen 2020 that accepts an operation instructing the communication terminal 3, 9, 1100, 1200 to generate an image showing a specific position on a slope; an image generation step (S97) of generating, based on the operation accepted on the generation reception screen 2020, a surface display image 2150 including a surface image 2100 showing the surface of the slope and a surface position image 2110 showing a specific position in the surface image, and a cross-section display image 2250 including a cross-section image 2200 showing a cross-section of the slope and a cross-section position image 2210 showing a specific position in the cross-section image; and a display image sending step (S98) of transmitting the surface display image 2150 and the cross-section display image 2250 to the communication terminal 3, 9, 1100, 1200.

[0364] An information processing method according to one embodiment of the present invention includes a receiving step (S95) of receiving an operation to generate an image showing a specific position on a slope; an image generation step (S97) of generating, based on the operation received in the receiving step, a surface display image 2150 including a surface image 2100 showing the surface of the slope and a surface position image 2110 showing the specific position in the surface image, and a cross-section display image 2250 including a cross-section image 2200 showing a cross-section of the slope and a cross-section position image 2210 showing the specific position in the cross-section image; and a display step (S99) of displaying the surface display image 2150 and the cross-section display image 2250 on a display unit.

[0365] A program according to an embodiment of the present invention causes a computer to execute the information processing method shown in steps S94, S97, and S98, or the information processing method shown in steps S95, S97, and S99.

[0366] ●Additional Information● Each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in the present embodiment includes a processor programmed to perform each function by software, such as a processor implemented by an electronic circuit, as well as devices designed to perform each of the above-described functions, such as an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a field programmable gate array (FPGA), a system on a chip (SOC), a graphics processing unit (GPU), and a conventional circuit module.

[0367] Furthermore, the various tables in the embodiments described above may be generated by the learning effects of machine learning, and tables may not be used by classifying data for each associated item using machine learning. Here, machine learning refers to a technology that allows a computer to acquire human-like learning capabilities, in which the computer autonomously generates algorithms necessary for judgments such as data classification from previously acquired learning data and applies these algorithms to new data to make predictions. The learning method for machine learning may be any of supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, and deep learning, or may be a combination of these learning methods. Any learning method for machine learning is acceptable.

[0368] The various tables in the above-described embodiments may be generated using an image processing technique, such as edge detection, line detection, or binarization. Similarly, when handling audio, an audio conversion technique such as a Fourier transform may be used.

[0369] So far, we have described an evaluation system, a status inspection system, an evaluation method, and a program according to one embodiment of the present invention, but the present invention is not limited to the above-described embodiment, and other modifications, such as additions, changes, or deletions, can be made within the scope of what a person skilled in the art can conceive, and any aspect is included in the scope of the present invention as long as it achieves the functions and effects of the present invention. [Explanation of symbols]

[0370] 1. Condition inspection system (an example of an information processing system) 3 Evaluation device (an example of a communication terminal) 4. Rating System 5. Data management device (an example of an information processing device) 6 Mobile 7. Imaging equipment 8 Sensor Device 8a Distance sensor (an example of a three-dimensional sensor) 8c Angle sensor (an example of a three-dimensional sensor) 9. Data acquisition device (an example of a communication terminal) 32 Reception unit (an example of operation reception means) 33 Display control unit (an example of a display control means) 35 Evaluation target data generation unit (an example of evaluation target data generation means) 36 Detection unit (an example of a detection means) 38 Report generation unit (an example of evaluation information generation means) 51 Communication unit (an example of a transmission means, an example of an instruction receiving means) 52 Determination unit (an example of a position generation means) 54 Generation unit (an example of image generation means) 60 Mobile Systems 1100 (an example of a communication terminal) 1200 (an example of a communication terminal) 2000 Input / Output Screen 2010 Designation Reception Screen 2020 Generation Reception Screen 2100 Surface Image 2110 Surface position image 2150 Surface Display Image 2160 other images 2170 other location images 2180 other display images 2200 cross-sectional images 2210 Cross-sectional position image 2250 cross-sectional images 2300 Pointer 2400 Designated position confirmation button 2410 Deformation check button 2420 Deformation Prediction Check Button 2430 Front view analysis button 2440 Front view comparison button 2450 Cross Section Analysis Button 2460 Cross-section comparison button 2500 3D surface images 2510 3D surface position image 2550 3D surface display image

Claims

1. an instruction receiving means for receiving instruction information instructing to generate an image showing a specific position on the object; an image generating means for generating, based on the instruction information, a surface display image including a surface image showing the surface of the object and a surface position image showing the specific position in the surface image, and a cross-section display image including a cross-section image showing a cross-section of the object and a cross-section position image showing the specific position in the cross-section image; An information processing device comprising:

2. An information processing device comprising an image generation means for generating, based on an instruction operation received on a generation reception screen that receives an instruction operation to generate an image showing a specific position on an object, a surface display image including a surface image showing the surface of the object and a surface position image showing the specific position in the surface image, and a cross-sectional display image including a cross-sectional image showing a cross-section of the object and a cross-sectional position image showing the specific position in the cross-sectional image.

3. 3. The information processing apparatus according to claim 2, further comprising a transmitting means for transmitting the surface display image and the cross-section display image to a communication terminal.

4. The information processing apparatus according to claim 3 , wherein the transmission means further transmits generation acceptance screen information relating to the generation acceptance screen to the communication terminal.

5. An information processing device according to any one of claims 1 to 4, wherein the image generation means generates the surface display image and the cross-sectional display image based on the specific position designated by the designation operation accepted in designation acceptance screen information relating to a designation acceptance screen that accepts a designation operation to designate the specific position.

6. The information processing apparatus according to claim 5 , wherein the designation acceptance screen includes the surface image or the cross-sectional image.

7. The image generating means 4. The information processing apparatus according to claim 2, wherein the surface display image and the cross-sectional display image are generated based on the pointing operation that designates the position of a portion in the surface image or the cross-sectional image that satisfies a predetermined condition as the specific position.

8. The image generating means The information processing apparatus according to claim 7 , wherein the surface display image and the cross-sectional display image are generated based on the pointing operation that specifies a position indicating a change or a sign of a change in the object as the specific position.

9. The image generating means 9. The information processing apparatus according to claim 7, wherein the surface display image and the cross-sectional display image are generated based on the pointing operation that designates a position of a portion in the surface image or the cross-sectional image that matches or differs from another image as the specific position.

10. 10. The information processing apparatus according to claim 9, wherein the image generating means further generates another display image including the other image and another position image indicating the specific position in the other image.

11. 10. The information processing apparatus according to claim 9, wherein the image generating means generates the surface display image and the cross-sectional display image by using a position of a portion in the surface image or the cross-sectional image that corresponds to a specific portion in another image as the specific position.

12. An information processing device according to any one of claims 1 to 11, wherein the image generation means further generates a three-dimensional surface display image including a three-dimensional surface image showing the surface of the object in three dimensions and a three-dimensional surface position image showing the specific position in the three-dimensional surface image.

13. The information processing device according to any one of claims 1 to 12, wherein the image generation means generates a plurality of cross-sectional images each showing a different cross-section of the object, and generates a plurality of cross-sectional display images including each of the plurality of cross-sectional images and the cross-sectional position image showing the specific position in each of the cross-sectional images.

14. An information processing device according to any one of claims 1 to 13, wherein the image generation means generates a plurality of surface images each showing a different area on the surface of the object, and generates a plurality of surface display images each including a surface position image showing each of the plurality of surface images and the specific position in each of the surface images.

15. An information processing system including an information processing device and a communication terminal capable of communicating with the information processing device, The information processing device includes: a transmission means for transmitting to the communication terminal generation reception screen information relating to a generation reception screen that receives an operation to instruct generation of an image showing a specific position in an object; an image generation means for generating, based on the operation received on the generation reception screen, a surface display image including a surface image showing a surface of the object and a surface position image showing the specific position in the surface image, and a cross-section display image including a cross-section image showing a cross-section of the object and a cross-section position image showing the specific position in the cross-section image, the transmitting means further transmits the surface display image and the cross-section display image to the communication terminal; The communication terminal a display control means for displaying the generation reception screen, the surface display image, and the cross-section display image on a display unit; an operation receiving means for receiving an operation on the generation receiving screen; An information processing system comprising:

16. a generation acceptance screen sending step of sending, to the communication terminal, generation acceptance screen information relating to a generation acceptance screen that accepts an operation to instruct the communication terminal to generate an image showing a specific position in the object; an image generation step of generating, based on the operation received on the generation reception screen, a surface display image including a surface image showing a surface of the object and a surface position image showing the specific position in the surface image, and a cross-sectional display image including a cross-sectional image showing a cross-section of the object and a cross-sectional position image showing the specific position in the cross-sectional image; a display image transmitting step of transmitting the surface display image and the cross-section display image to the communication terminal; An information processing method comprising:

17. a receiving step of receiving an operation to instruct generation of an image showing a specific position on the object; an image generating step of generating, based on the operation received in the receiving step, a surface display image including a surface image showing a surface of the object and a surface position image showing the specific position in the surface image, and a cross-section display image including a cross-section image showing a cross-section of the object and a cross-section position image showing the specific position in the cross-section image; a display step of displaying the surface display image and the cross-sectional display image on a display unit; An information processing method comprising:

18. A program for causing a computer to execute the information processing method according to claim 16 or 17.

Images