Evaluation system, evaluation method, and program

The evaluation system uses image and sensor data to efficiently assess earthwork structure conditions, addressing inefficiencies in conventional inspections by providing detailed and quantitative analysis of structural integrity.

JP2025166083APending Publication Date: 2025-11-05RICOH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2025132081
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2025-08-07
Publication Date
2025-11-05

AI Technical Summary

Technical Problem

Conventional visual inspections of earthwork structures are inefficient and unable to quantitatively assess the degree of deterioration, such as cracks or peeling, making it difficult to maintain these structures effectively.

Method used

An evaluation system that combines image data from a line camera and sensor data from a GNSS and angle sensor to detect deformations in earthwork structures, generating evaluation information on the condition of slopes, including signs of deformation.

Benefits of technology

Enables efficient and quantitative evaluation of earthwork structure conditions, facilitating early detection of deterioration and improving maintenance efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025166083000001_ABST
    Figure 2025166083000001_ABST
Patent Text Reader

Abstract

To provide an evaluation system, an evaluation method, and a program which can take countermeasure for a state of a structure.SOLUTION: An evaluation system 4 according to the present invention has a detection unit 36 as an example of detection means for detecting a state of a structure based on measured data obtained by measuring the structure, and a report generating unit 38 for generating an evaluation report as an example of evaluation information generating means for generating evaluation information indicating an evaluation result of the state of the structure. The measured data includes surrounding data indicating physical amounts of the surroundings of the structure. The detection unit 36 detects a sign of deformation of the structure based on the measured data. The report generating unit 38 generates the evaluation report including data indicating the sign of the deformation of the structure.SELECTED DRAWING: Figure 26
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an evaluation system, an evaluation method, and a program. [Background technology]

[0002] Patent document 1 (JP 2016-183934) describes a slope photographing device that uses the results of photogrammetry based on the captured image and the photographing position to perform an external observation of the condition of a slope 1, and identifies the condition and location of any deformations that are detected. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2016-183934 A Summary of the Invention [Problem to be solved by the invention]

[0004] The object is to provide an evaluation system, evaluation method, and program that enable measures to be taken for the condition of a structure. [Means for solving the problem]

[0005] The evaluation system for evaluating the condition of a structure according to claim 1 of the present invention comprises a detection means for detecting the condition of the structure based on measurement data obtained by measuring the structure, and an evaluation information generation means for generating evaluation information indicating the evaluation results of the condition of the structure based on the measurement data, wherein the measurement data includes surrounding data indicating physical quantities around the structure, the detection means detects signs of deformation of the structure based on the measurement data, and the evaluation information generation means generates the evaluation information including data indicating signs of deformation of the structure. [Effects of the Invention]

[0006] It is possible to provide an evaluation system, an evaluation method, and a program that enable measures to be taken for the condition of a structure. [Brief explanation of the drawings]

[0007] [Figure 1] 1 is a diagram showing an example of the overall configuration of a state inspection system according to an embodiment; [Figure 2] FIG. 10 is a diagram showing an example of how a slope condition is inspected using the mobile body system according to the embodiment. [Figure 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of a data acquisition device. [Figure 4] FIG. 2 is a diagram illustrating an example of a hardware configuration of an evaluation device and a data management device. [Figure 5] FIG. 2 is a diagram illustrating an example of a functional configuration of a state inspection system. [Figure 6] FIG. 10 is a conceptual diagram illustrating an example of a status type management table. [Figure 7] FIG. 10 is a conceptual diagram illustrating an example of a status type management table. [Figure 8] 1A is a conceptual diagram showing an example of an acquired data management table, and FIG. 1B is a conceptual diagram showing an example of a processed data management table. [Figure 9] FIG. 10 is a sequence diagram illustrating an example of a data acquisition process using a mobile system. [Figure 10] FIG. 2 is a diagram for explaining a photographed image acquired by a mobile system. [Figure 11] FIG. 10 is a sequence diagram illustrating an example of a process for generating evaluation target data. [Figure 12] FIG. 10 is a sequence diagram showing an example of a process for generating a report that is an evaluation result of a slope condition. [Figure 13] FIG. 10 is a diagram showing an example of an evaluation screen displayed on the evaluation device. [Figure 14] FIG. 10 is a diagram showing an example of an evaluation screen on which processing data is displayed. [Figure 15] 10 is a flowchart illustrating an example of a process for detecting a slope state. [Figure 16] FIG. 10 is a diagram showing an example of an evaluation screen on which detection results of shape data are displayed. [Figure 17] FIG. 10 is a diagram showing an example of a display screen showing damage detection results. [Figure 18] FIG. 10 is a diagram showing an example of a cross-sectional image of the detected shape of a slope. [Figure 19] FIG. 2 is a diagram illustrating an example of map information. [Figure 20] FIG. 10 is a diagram illustrating an example of site information stored in association with map information. [Figure 21] FIG. 10 is a diagram showing an example of an evaluation report generated by the evaluation device. [Figure 22] FIG. 10 is a diagram showing an example of an evaluation report generated by the evaluation device. [Figure 23] FIG. 10 is a diagram showing an example of an evaluation report generated by the evaluation device. [Figure 24] FIG. 10 is a diagram showing another example of a display screen showing damage detection results. [Figure 25] FIG. 10 is a diagram showing another example of a cross-sectional image of the detected shape of a slope. [Figure 26] FIG. 10 is a diagram illustrating an example of a display screen showing a sign detection result. [Figure 27] FIG. 10 is a diagram illustrating an example of an evaluation report including a sign detection result. [Figure 28] FIG. 10 is a diagram showing another example of an evaluation report including a sign detection result. [Figure 29] FIG. 10 is a diagram showing an example of how a slope condition is inspected using a mobile body system according to Modification 1. [Figure 30] FIG. 10 is a diagram showing an example of how the state of a slope is inspected using a mobile body system according to Modification 2. [Figure 31] FIG. 11 is a diagram showing an example of how the state of a slope is inspected using a mobile body system according to Modification 3. [Figure 32] FIG. 10 is a diagram showing an example of the overall configuration of a state inspection system according to a fourth modification. [Figure 33] FIG. 13 is a sequence diagram showing an example of an evaluation data display process in the state inspection system according to the fourth modification. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the description of the drawings, the same elements are given the same reference numerals, and duplicated explanations will be omitted.

[0009] First embodiment ●System overview First, an overview of the condition inspection system will be described using Figures 1 and 2. Figure 1 is a diagram showing an example of the overall configuration of a condition inspection system according to an embodiment. The condition inspection system 1 shown in Figure 1 is a system for inspecting the condition of road earthwork structures using various data acquired by a mobile system 60. Road earthwork structures are a general term for structures constructed to build roads that are primarily made of ground materials such as soil and rock, and for structures associated with them, and refer to cut and slope stabilization facilities, embankments, culverts, and similar structures. Hereinafter, road earthwork structures will be referred to as slopes.

[0010] The condition inspection system 1 is composed of a mobile system 60 and an evaluation system 4. The mobile system 60 is composed of a data acquisition device 9 and a mobile device 6, such as a vehicle, on which the data acquisition device 9 is mounted. The data acquisition device 9 has an imaging device 7, which is an example of a measurement device that measures structures, as well as an angle sensor 8a and a GNSS (Global Navigation Satellite System) sensor 8b. GNSS is a general term for satellite positioning systems such as the GPS (Global Positioning System) or the Quasi-Zenith Satellite System (QZSS).

[0011] The photographing device 7 is a line camera equipped with a line sensor in which photoelectric conversion elements are arranged in one or more rows. The photographing device 7 photographs a position along a predetermined photographing range on a photographing surface along the traveling direction of the moving object 6. Note that the photographing device is not limited to a line camera, but may be a camera equipped with an area sensor in which photoelectric conversion elements are arranged in a plane. The photographing device may also be composed of multiple cameras.

[0012] The angle sensor 8a is a gyro sensor or the like for detecting the angle (attitude) or angular velocity (or each acceleration) of the shooting direction of the shooting device 7. The GNSS sensor 8b is a positioning means that measures a position on Earth by receiving signals transmitted at each time from multiple GNSS satellites and calculating the distance to the satellite from the difference in the time at which each signal was received. The positioning means may be a device dedicated to positioning, or may be a dedicated positioning application installed on a PC (Personal Computer), smartphone, or the like. The angle sensor 8a and the GNSS sensor 8b are examples of sensor devices. The angle sensor 8a is also an example of a three-dimensional sensor.

[0013] 2 is a diagram showing an example of how a slope condition is inspected using a mobile body system according to an embodiment. As shown in Fig. 2, the mobile body system 6, which has a data acquisition device 9 mounted thereon, travels along a road while capturing images of a predetermined range of the slope with an image capture device 7.

[0014] As shown in Figure 2, a cut slope is a slope that has been cut, and a fill slope is a slope that has been filled with soil. Furthermore, the side slopes of a road running along the side of a mountain are called natural slopes. Cut and fill slopes can be made more durable by planting vegetation on their surfaces, allowing them to remain unchanged for decades. However, this is not always the case. When cut and fill slopes and natural slopes deteriorate due to wind and rain, shallow collapses occur, causing rocks and soil to fall from the surface, or the mountain collapses, resulting in road closures. To prevent this, techniques are used to slow the rate of deterioration of slopes exposed to wind and rain by spraying mortar on the surface (mortar spraying) or by installing and hardening concrete structures. Structures constructed using these techniques are called earthwork structures. Earthwork structures include retaining walls installed between natural slopes and roads, and rockfall protection fences that prevent rocks from falling onto roads. Both of these structures are intended to prevent road closures or human injury caused by soil or rocks flowing onto the road.

[0015] In recent years, the deterioration of earthwork structures constructed decades ago has become significant, posing a major challenge for the development of social infrastructure. Therefore, it is important to detect deterioration of earthwork structures early and to inspect and maintain them to ensure their longevity. Conventional inspections of natural slopes and earthwork structures involve investigating rockfalls, collapses, landslides, or debris flows on the slopes and formulating repair plans, which are carried out through visual inspections by experts.

[0016] However, visual inspections by experts have problems with efficiency, such as the inability to inspect all of the large number of earthwork structures throughout Japan in a certain period of time, and the inability to inspect embankments at high altitudes or along rivers. In addition, visual inspections are unable to quantitatively grasp the degree of deterioration, such as cracks or peeling that occur on the surface of earthwork structures.

[0017] Therefore, the condition inspection system 1 according to the embodiment acquires photographed image data of the slope of an earthwork structure using the photographing device 7, and acquires sensor data including three-dimensional information using a three-dimensional sensor such as an angle sensor 8a. The evaluation system 4 then combines the acquired photographed image data and sensor data to evaluate the condition of the slope, thereby detecting shape data indicating the three-dimensional shape of the slope and detecting abnormalities such as cracks and peeling. This allows the condition inspection system 1 to efficiently perform evaluations that are difficult to inspect visually by humans.

[0018] Returning to FIG. 1 , the evaluation system 4 is configured by an evaluation device 3 and a data management device 5. The evaluation device 3 and the data management device 5 constituting the evaluation system 4 can communicate via a communication network 100. The communication network 100 is configured by the Internet, a mobile communication network, a LAN (Local Area Network), or the like. Note that the communication network 100 may include not only wired communication but also wireless communication networks such as 3G (3rd Generation), 4G (4th Generation), 5G (5th Generation), Wi-Fi (Wireless Fidelity) (registered trademark), WiMAX (Worldwide Interoperability for Microwave Access), or LTE (Long Term Evolution). Furthermore, the evaluation device 3 and the data management device 5 may have communication functions using short-range communication technologies such as NFC (Near Field Communication) (registered trademark).

[0019] The data management device 5 is a computer such as a PC that manages various data acquired by the data acquisition device 9. The data management device 5 receives various acquired data from the data acquisition device 9 and transfers the received various acquired data to the evaluation device 3 that performs data analysis. Note that the method of transferring the various acquired data from the data management device 5 to the evaluation device 3 may be manual transfer using a USB (Universal Serial Bus) memory or the like.

[0020] The evaluation device 3 is a computer such as a PC that evaluates the condition of the slope based on various acquired data transferred from the data management device 5. A dedicated application program for evaluating the condition of the slope is installed on the evaluation device 3. The evaluation device 3 detects the type or structure of the slope from the captured image data and sensor data, extracts shape data, and performs a detailed analysis by detecting the presence or absence of deformation and the degree of deformation. The evaluation device 3 also generates a report to be submitted to a road administrator, such as a national government, local government, or a contracted business, using the captured image data, sensor data, evaluation target data, and the results of the detailed analysis. The report data generated by the evaluation device 3 is submitted to the road administrator as electronic data or printed on paper. The report generated by the evaluation device 3 is referred to as an inspection record sheet, inspection sheet, inspection ledger, or report. The evaluation device 3 is not limited to a PC and may be a smartphone, tablet, or other device. The evaluation system 4 may also be configured such that the evaluation device 3 and the data management device 5 are integrated into a single device or terminal.

[0021] ●Hardware configuration Next, the hardware configuration of each device constituting the status inspection system 1 will be described with reference to Figures 3 and 4. Note that components may be added or deleted from the hardware configuration shown in Figures 3 and 4 as needed.

[0022] ○Hardware configuration of data acquisition device○ 3 is a diagram showing an example of the hardware configuration of a data acquisition device 9. The data acquisition device 9 includes the image capture device 7 and the sensor device 8 as shown in FIG. 1, as well as a controller 900 that controls the processing or operation of the data acquisition device 9.

[0023] The controller 900 includes an imaging device I / F (Interface) 901, a sensor device I / F 902, a bus line 910, a CPU (Central Processing Unit) 911, a ROM (Read Only Memory) 912, a RAM (Random Access Memory) 913, a HD (Hard Disk) 914, an HDD (Hard Disk Drive) controller 915, a network I / F 916, a DVD-RW (Digital Versatile Disk Rewritable) drive 918, a media I / F 922, an external device connection I / F 923, and a timer 924.

[0024] Of these, the imaging device I / F 901 is an interface for transmitting and receiving various data or information to and from the imaging device 7. The sensor device I / F 902 is an interface for transmitting and receiving various data or information to and from the sensor device 8. The bus line 910 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 911 shown in FIG. 3.

[0025] The CPU 911 also controls the overall operation of the data acquisition device 9. The ROM 912 stores programs, such as an IPL, used to drive the CPU 911. The RAM 913 is used as a work area for the CPU 911. The HD 914 stores various data, such as programs. The HDD controller 915 controls the reading and writing of various data from and to the HD 914 under the control of the CPU 911. The network I / F 916 is an interface for data communication using the communication network 100. The DVD-RW drive 918 controls the reading and writing of various data from and to a DVD-RW 917, which is an example of a removable recording medium. Note that the medium is not limited to a DVD-RW, and may be a DVD-R or a Blu-ray (registered trademark) Disc. The media I / F 922 controls the reading and writing (storage) of data from and to a recording medium 921, such as a flash memory. The external device connection I / F 923 is an interface for connecting an external device, such as an external PC 930. The timer 924 is a measurement device with a time measurement function. The timer 924 may be a computer-based software timer.

[0026] ○Hardware configuration of evaluation device○ Fig. 4 is a diagram showing an example of the hardware configuration of the evaluation device 3. Each piece of hardware configuration of the evaluation device 3 is indicated by a reference number in the 300 series. As shown in Fig. 4, the evaluation device 3 is constructed by a computer, and includes a CPU 301, a ROM 302, a RAM 303, a HD 304, a HDD controller 305, a display 306, an external device connection I / F 308, a network I / F 309, a bus line 310, a keyboard 311, a pointing device 312, a DVD-RW drive 314, and a media I / F 316.

[0027] Of these, the CPU 301 controls the overall operation of the evaluation device 3. The ROM 302 stores programs, such as an IPL, used to drive the CPU 301. The RAM 303 is used as a work area for the CPU 301. The HD 304 stores various data, such as programs. The HDD controller 305 controls the reading and writing of various data from and to the HD 304 under the control of the CPU 301. The display 306 displays various information, such as a cursor, menus, windows, characters, or images. The display 306 is an example of a display unit. The external device connection I / F 308 is an interface for connecting various external devices. In this case, external devices include, for example, a USB memory or a printer. The network I / F 309 is an interface for data communication using the communication network 100. The bus line 310 is an address bus, a data bus, or the like, for electrically connecting the components, such as the CPU 301, shown in FIG. 4.

[0028] The keyboard 311 is a type of input means having multiple keys for inputting characters, numbers, various instructions, etc. The pointing device 312 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, etc. The DVD-RW drive 314 controls reading and writing of various data from a DVD-RW 313, which is an example of a removable recording medium. Note that this is not limited to a DVD-RW, and may be a DVD-R or Blu-ray Disc, etc. The media I / F 316 controls reading and writing (storing) of data from a recording medium 315, such as a flash memory.

[0029] ○Hardware configuration of data management device○ Fig. 4 is a diagram showing an example of the hardware configuration of the data management device. Each piece of hardware configuration of the data management device 5 is indicated by a reference number in the 500s in parentheses. As shown in Fig. 4, the data management device 5 is constructed by a computer, and as shown in Fig. 4, it has the same configuration as the evaluation device 3, so a description of each piece of hardware configuration will be omitted.

[0030] Each of the above programs may be recorded on a computer-readable recording medium as an installable or executable file and distributed. Examples of recording media include CD-Rs (Compact Disc Recordables), DVDs (Digital Versatile Disks), Blu-ray Discs, SD cards, and USB memory sticks. The recording media may also be provided domestically or internationally as program products. For example, the evaluation system 4 according to the embodiment realizes the evaluation method according to the present invention by executing the program according to the present invention.

[0031] ●Function configuration Next, the functional configuration of the state inspection system according to the embodiment will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of the functional configuration of the state inspection system according to the first embodiment. Of the devices shown in Fig. 1, Fig. 5 shows those related to the processing or operation described below.

[0032] ○Functional configuration of data acquisition device○ First, the functional configuration of the data acquisition device 9 will be described with reference to Figure 5. The data acquisition device 9 has a communication unit 91, a determination unit 92, an imaging device control unit 93, a sensor device control unit 94, a captured image data acquisition unit 95, a sensor data acquisition unit 96, a time data acquisition unit 97, a request acceptance unit 98, and a storage / readout unit 99. Each of these units is a function or means realized when any of the components shown in Figure 3 operates in response to an instruction from the CPU 911 in accordance with a program for the data acquisition device that has been loaded from the HD 914 onto the RAM 913. The data acquisition device 9 also has a storage unit 9000 constructed by the ROM 912 and HD 914 shown in Figure 3.

[0033] The communication unit 91 is mainly realized by processing of the CPU 911 on the network I / F 916, and communicates various data or information with other devices via the communication network 100. The communication unit 91 transmits, for example, acquired data acquired by the captured image data acquisition unit 95 and the sensor data acquisition unit 96 to the data management device 5. The determination unit 92 is realized by processing of the CPU 911, and makes various determinations.

[0034] The imaging device control unit 93 is mainly realized by the processing of the CPU 911 for the imaging device I / F 901, and controls the imaging processing by the imaging device 7. The sensor device control unit 94 is mainly realized by the processing of the CPU 911 for the sensor device I / F 902, and controls the data acquisition processing for the sensor device 8.

[0035] The captured image data acquisition unit 95 is mainly realized by processing by the CPU 911 for the imaging device I / F 901, and acquires captured image data related to an image captured by the imaging device 7. The sensor data acquisition unit 96 is mainly realized by processing by the CPU 911 for the sensor device I / F 902, and acquires sensor data that is the detection result by the sensor device 8. The time data acquisition unit 97 is mainly realized by processing by the CPU 911 for the timer 924, and acquires time data that indicates the time when data was acquired by the captured image data acquisition unit 95 or the sensor data acquisition unit 96.

[0036] The request receiving unit 98 is mainly realized by the processing of the CPU 911 for the external device connection I / F 923, and receives a predetermined request from the external PC 930 or the like.

[0037] The storage / readout unit 99 is mainly realized by the processing of the CPU 911 , and stores various data (or information) in the storage unit 9000 and reads out various data (or information) from the storage unit 9000 .

[0038] ○Functional configuration of evaluation device○ Next, the functional configuration of the evaluation device 3 will be described with reference to Fig. 5. The evaluation device 3 has a communication unit 31, a reception unit 32, a display control unit 33, a determination unit 34, an evaluation target data generation unit 35, a detection unit 36, a map data management unit 37, a report generation unit 38, and a storage / readout unit 39. Each of these units is a function or means realized by one of the components shown in Fig. 4 being loaded from HD 304 onto RAM 303 and operating in accordance with an instruction from CPU 301 in accordance with a program for the evaluation device. The evaluation device 3 also has a storage unit 3000 constructed by ROM 302 and HD 304 shown in Fig. 4.

[0039] The communication unit 31 is mainly realized by the processing of the CPU 301 on the network I / F 309, and communicates various data or information with other devices via the communication network 100. The communication unit 31 transmits and receives various data related to the evaluation of the slope condition to and from the data management device 5, for example.

[0040] The reception unit 32 is mainly realized by the processing of the CPU 301 using the keyboard 311 or the pointing device 312, and receives various selections or inputs from the user. The reception unit 32 receives various selections or inputs to an evaluation screen 400, which will be described later. The display control unit 33 is mainly realized by the processing of the CPU 301, and causes the display 306 to display various images. The display control unit 33 causes the display 306 to display the evaluation screen 400, which will be described later. The determination unit 34 is mainly realized by the processing of the CPU 301, and makes various determinations.

[0041] The evaluation target data generation unit 35 is realized by the processing of the CPU 301, and generates data to be evaluated. The detection unit 36 ​​is mainly realized by the processing of the CPU 301, and performs a process of detecting the state of the slope using the evaluation target data generated by the evaluation target data generation unit 35. The map data management unit 37 is mainly realized by the processing of the CPU 301, and manages map information acquired from an external server or the like.

[0042] The report generation unit 38 is mainly realized by the processing of the CPU 301, and generates an evaluation report to be submitted to the road administrator based on the evaluation results.

[0043] The storage / readout unit 39 is mainly realized by the processing of the CPU 301 , and stores various data (or information) in the storage unit 3000 and reads out various data (or information) from the storage unit 3000 .

[0044] Status type management table 6 and 7 are conceptual diagrams showing an example of a condition type management table. The condition type management table is a table for managing training data for detecting the condition type of a slope. A condition type management DB 3001 configured with a condition type management table such as that shown in FIGS. 6 and 7 is constructed in the storage unit 3000. In this condition type management table, a type name indicating the condition type, a training image, and a remarks column are associated and managed for each type number.

[0045] Among these, the type name indicates a condition type for identifying the state of the slope, the physical quantities surrounding the slope, and the site information. Here, the condition types include the type of the slope itself, which is a structure such as a retaining wall, a crest, sprayed mortar, wire mesh, a fence, a drainage hole, a pipe, and a berm drainage channel, as well as types indicating physical quantities surrounding the slope, such as spring water, moss, plants, falling rocks, soil, and sunlight. The condition types also include types such as poles, utility poles, signs, and billboards, which serve as site information for supporting data acquisition by the mobile system 60. Furthermore, the condition types may also include, as additional information about the structure, information on markers such as chalking that indicate the presence of abnormalities installed during past inspections or construction work, as well as man-made structures such as measuring devices and traces of countermeasures. The training image is an example of training data and is used in machine learning to identify the condition type of the slope, the physical quantities surrounding the slope, and the site information from photographed image data. Here, the training data is not limited to brightness images, RGB images, etc., which are generally called images, but may be any data that contains information for determining the state type, and may be in the form of depth information, text, audio, etc. The remarks column shows information that serves as the detection criteria for detecting the state type.

[0046] ○Functional configuration of data management device○ Next, the functional configuration of the data management device 5 will be described with reference to Fig. 5. The data management device 5 has a communication unit 51, a determination unit 52, a data management unit 53, and a storage / readout unit 59. Each of these units is a function or means realized when any of the components shown in Fig. 4 is loaded from HD 504 onto RAM 503 and operates in accordance with an instruction from CPU 501 in accordance with a program for the data management device. The data management device 5 also has a storage unit 5000 constructed by ROM 502 and HD 504 shown in Fig. 4.

[0047] The communication unit 51 is mainly realized by processing of the CPU 501 on the network I / F 509, and communicates various data or information with other devices via the communication network 100. The communication unit 51 receives, for example, photographed image data and sensor data transmitted from the data acquisition device 9. The communication unit 51 also transmits and receives, for example, various data related to the evaluation of the slope condition with the evaluation device 3. The judgment unit 52 is realized by processing of the CPU 501, and makes various judgments.

[0048] The data management unit 53 is mainly realized by the processing of the CPU 501, and manages various data related to the evaluation of the slope condition. The data management unit 53, for example, registers photographed image data and sensor data transmitted from the data acquisition device 9 in an acquired data management DB 5001. The data management unit 53 also registers data processed or generated by the evaluation device 3 in a processed data management DB 5003.

[0049] The storage / readout unit 59 is mainly realized by the processing of the CPU 501 , and stores various data (or information) in the storage unit 5000 and reads out various data (or information) from the storage unit 5000 .

[0050] Acquired data management table Fig. 8(A) is a conceptual diagram showing an example of an acquired data management table. The acquired data management table is a table for managing various acquired data acquired by the data acquisition device 9. An acquired data management DB 5001 configured with an acquired data management table such as that shown in Fig. 8(A) is constructed in the storage unit 5000. In this acquired data management table, photographed image data, sensor data, and acquisition time are associated and managed for each folder.

[0051] Of these, the photographed image data and sensor data are data files of acquired data transmitted from the data acquisition device 9. The acquisition time indicates the time when the photographed image data and sensor data were acquired by the data acquisition device 9. Data acquired in one inspection process is stored in the same folder.

[0052] Processing data management table Fig. 8(B) is a conceptual diagram showing an example of a processing data management table. The processing data management table is a table for managing various processing data processed by the evaluation device 3. A processing data management DB 5003 configured by a processing data management table such as that shown in Fig. 8(B) is constructed in the storage unit 5000. In this processing data management table, evaluation target data, evaluation data, positioning data, and comments are associated and managed for each folder.

[0053] Of these, the evaluation target data is a data file used for detecting and evaluating the slope condition by the evaluation device 3. The evaluation data is a data file showing the evaluation results by the evaluation device 3. The positioning data is data showing the position information measured by the GNSS sensor 8b. The comments are bibliographic information entered by the evaluator for the evaluation target data or the evaluation data.

[0054] Processing or operation of the embodiment ○Data acquisition processing○ Next, the processing or operation of the condition inspection system 1 according to the embodiment will be described with reference to Figs. 9 to 25. First, the data acquisition process using the mobile body system 60 will be described with reference to Figs. 9 and 10. An inspector of the slope condition boards the mobile body 6, takes photographs of the slopes on the road, and uploads the acquired data to the data management device 5. This will be described in detail below.

[0055] FIG. 9 is a sequence diagram illustrating an example of data acquisition processing using a mobile system. First, an inspection worker performs a predetermined input operation or the like on the external PC 330, and the request receiving unit 98 of the data acquisition device 9 receives a data acquisition start request (step S11). Then, the data acquisition device 9 executes data acquisition processing using the photographing device 7 and the sensor device 8 (step S12). Specifically, the photographing device control unit 93 issues a photographing request to the photographing device 7 to start photographing processing for a predetermined area. Furthermore, the sensor device control unit 94 starts detection processing using the angle sensor 8a and the GNSS sensor 8b in synchronization with the photographing processing by the photographing device 7. Then, the photographed image data acquisition unit 95 acquires photographed image data acquired by the photographing device 7, and the sensor data acquisition unit 96 acquires sensor data acquired by the angle sensor 8a and the GNSS sensor 8b. Furthermore, the time data acquisition unit 97 acquires time data indicating the time when various data were acquired by the photographed image data acquisition unit 95 and the sensor data acquisition unit 96.

[0056] Next, the inspection worker performs a predetermined input operation on the external PC 330 or the like, and the request receiving unit 98 receives a request to upload the various acquired data (step S13). Then, the communication unit 91 uploads (transmits) the captured image data, sensor data, and time data, which are the acquired data acquired in step S12, to the data management device 5 (step S14). As a result, the communication unit 51 of the data management device 5 receives the acquired data transmitted from the data acquisition device 9. Then, the data management unit 53 of the data management device 5 registers the acquired data received in step S14 in the acquired data management DB 5001 (see FIG. 8(A)) (step S15). The data management unit 53 stores the captured image data and sensor data in a single folder, in association with time data indicating the acquisition time of each data included in the acquired data.

[0057] Here, an outline of the data acquisition process using the mobile body system 60 will be described with reference to FIG. 10. FIG. 10 is a diagram for explaining captured images acquired by the mobile body system. The mobile body system 60 uses the image capture device 7 provided in the data acquisition device 9 to capture images of a slope on a road while the mobile body 6 is traveling. As the mobile body 6 travels, the data acquisition device 9 acquires captured image 1 and captured image 2 in time series, as shown in FIG. 10. At this time, the image capture device 7 and the sensor device 8 are time-synchronized, and tilt correction (image correction) of the captured image is performed based on the attitude of the vehicle at the time of capture, and image data and positioning data (north latitude and east longitude) are linked based on the time of the captured image.

[0058] In this way, the mobile system 60 acquires photographed image data of the slope and sensor data acquired in response to photography by the photography device 7 while driving the vehicle serving as the mobile body 6, and uploads the data to the data management device 5.

[0059] ○Evaluation of slope conditions○ ○Generating data to be evaluated Next, the process in which the evaluation system 4 evaluates the slope condition using the acquired data stored in the data management device 5 will be described with reference to Fig. 11 and Fig. 25. First, the process of generating evaluation target data to be used in the process of evaluating the slope condition will be described with reference to Fig. 11. Fig. 11 is a sequence diagram showing an example of the process of generating evaluation target data.

[0060] First, the communication unit 31 of the evaluation device 3 transmits a request to generate evaluation target data to the data management device 5 (step S31). This generation request includes the name of the folder in which the data to be generated is stored. As a result, the communication unit 51 of the data management device 5 receives the generation request transmitted from the evaluation device 3.

[0061] Next, the storage / reading unit 59 of the data management device 5 searches the acquired data management DB 5001 using the folder name included in the creation request received in step S31 as a search key, and reads out the acquired data associated with the folder name included in the creation request (step S32). Then, the communication unit 51 transmits the acquired data read out in step S32 to the evaluation device 3 (step S33). This acquired data includes photographed image data, sensor data, and time data, and the communication unit 31 of the evaluation device 3 thereby receives the acquired data transmitted from the data management device 5.

[0062] Next, the evaluation target data generation unit 35 of the evaluation device 3 generates evaluation target data using the acquired data received in step S33 (step S34). Specifically, the evaluation target data generation unit 35 corrects the tilt of the captured image data based on the attitude of the imaging device 7 (mobile body 6) at the time of imaging, based on the received sensor data from the angle sensor 8a. Furthermore, the evaluation target data generation unit 35 links the captured image data with the positioning data, which is the sensor data received from the GNSS sensor 8b, based on the received time data. Furthermore, the evaluation target data generation unit 35 performs a process of combining multiple pieces of captured image data into one image data.

[0063] In this way, the evaluation target data generation unit 35 has a function of correcting tilt of image data, a function of linking image data with position information, and a function of combining image data. The evaluation target data generation unit 35 uses the acquired data received from the data management device 5 to perform image correction on the received captured image data so that processing by the detection unit 36 ​​and report generation unit 38 (described later) can be easily performed.

[0064] Next, the communication unit 31 of the evaluation device 3 transmits the generated data generated in step S34 to the data management device 5 (step S35). This generated data includes the evaluation target data, positioning data, and comments generated by the evaluation target data generation unit 35. As a result, the communication unit 51 of the data management device 5 receives the generated data transmitted from the evaluation device 3. Then, the data management unit 53 of the data management device 5 stores the generated data received in step S35 in the processing data management DB 5003 (see FIG. 8(B)) (step S36). Specifically, the data management unit 53 associates the evaluation target data, positioning data, and comments included in the generated data and stores them in one folder.

[0065] In this way, the evaluation system 4 performs image processing based on various data (photographed image data, sensor data, and time data) acquired from the data acquisition device 9, thereby generating evaluation target data to be used in evaluating the slope condition.

[0066] Generate evaluation reports Next, the process of generating an evaluation report to be submitted to the road administrator in the evaluation system 4 will be described with reference to Figures 12 and 23. The evaluator evaluates the condition of the slope using the photographed image data and sensor data acquired by the data acquisition device 9, and generates an evaluation report showing the evaluation results. This will be described in detail below.

[0067] FIG. 12 is a sequence diagram illustrating an example of a process for generating a report that is the evaluation result of the slope condition. First, the display control unit 33 of the evaluation device 3 causes the display 306 to display an evaluation screen 400 for performing the slope condition evaluation process (step S51). FIG. 13 is a diagram illustrating an example of an evaluation screen displayed on the evaluation device. The evaluation screen 400 shown in FIG. 13 includes an evaluation target data selection area 410, an evaluation item selection area 430 for selecting evaluation items for detecting the slope condition, a shape data display area 460 for displaying shape data, an “upload” button 491 pressed to upload the evaluation results to the data management device 5, and a “generate report” button 493 pressed to generate an evaluation report. Of these, the selection area 410 includes a “folder specification” button 411 for specifying a folder in which the evaluation target data is stored, a display area 413 displaying the specified folder name, and an “OK” button 415 pressed to request download of the evaluation target data stored in the specified folder.

[0068] Next, the evaluator specifies a folder using the "Specify folder" button 411, and the reception unit 32 of the evaluation device 3 receives the selection of the evaluation target data (step S52). For example, in the example of Fig. 13, the reception unit 32 receives the selection of the evaluation target data stored in "folder 0615".

[0069] Next, the communication unit 31 transmits a read request for the evaluation target data selected in step S52 to the data management device 5 (step S53). This read request includes the folder name selected in step S52. As a result, the communication unit 51 of the data management device 5 receives the read request transmitted from the evaluation device 3.

[0070] Next, the storage / reading unit 59 of the data management device 5 searches the processing data management DB 5003 (see FIG. 8(B)) using the folder name included in the read request received in step S53 as a search key, and reads out the processing data associated with the folder name included in the read request (step S54). Then, the communication unit 51 transmits the processing data read out in step S54 to the evaluation device 3 (step S55). This processing data includes the evaluation target data, positioning data, and comments. As a result, the communication unit 31 of the evaluation device 3 receives the processing data transmitted from the data management device 5.

[0071] Next, the display control unit 33 of the evaluation device 3 displays the processed data received in step S54 in the evaluation item selection area 430 of the evaluation screen 400 (step S56). FIG. 14 is a diagram showing an example of the evaluation screen on which the processed data is displayed. The evaluation item selection area 430 shown in FIG. 14 includes an image display area 431 that displays an image of the evaluation target data, which is the processed data transmitted from the data management device 5, a bibliographic information display area 433 that displays bibliographic information of the evaluation target data, and a "Back" button 437 and a "Next" button 439 that are pressed to switch images displayed in the image display area 431. The evaluation item selection area 430 also includes a "Shape Detection" button 451 that is pressed to detect the shape of the slope, a "Damage Detection" button 453 that is pressed to detect the damage state of the slope, a "Map Information" button 455 that is pressed to generate map information, and a "Sign Detection" button 457 that is pressed to detect the sign of slope damage.

[0072] Additionally, evaluation areas 435a and 435b are displayed in the image display area 431 superimposed on the image of the evaluation target data. The evaluation areas 435a and 435b indicate the evaluation range in the slope condition detection process described below. The evaluator moves the evaluation areas 435a and 435b and enlarges or reduces the evaluation areas 435a and 435b by input operations such as tapping, dragging, swiping, pinching in, and pinching out on the evaluation areas 435a and 435b. Note that the number of evaluation areas 435a and 435b is not limited to this and may be one, or three or more. Alternatively, the evaluation areas 435a and 435b may not be displayed in the image display area 431, and the entire image display area 431 may be used as the evaluation range.

[0073] Next, the evaluation device 3 performs a process of detecting the slope condition using the evaluation target data (step S57). The process of detecting the slope condition will now be described in detail with reference to Fig. 15. Fig. 15 is a flowchart showing an example of the process of detecting the slope condition.

[0074] First, the evaluator presses the "Shape Detection" button 451 included in the evaluation item selection area 430, and the receiving unit 32 receives a shape detection request (step S71). Next, the detection unit 36 ​​performs shape detection processing using the evaluation target data (step S72). Here, the shape data indicating the shape of the slope is expressed by three-dimensional information such as the slope's extension, height, and inclination angle, as well as position information. The slope's extension refers to the length of the slope in a plan view (the depth direction of the cross section where the slope's inclination can be determined). The shape data also includes information indicating the type of slope, whether it is a natural slope or an earthwork structure. If the slope is an earthwork structure, the shape data also includes information on the type of earthwork structure. The type of civil engineering structure can be, for example, a retaining wall, a crest, a mortar coating, the presence or absence of anchors, or an embankment.

[0075] Specifically, the detection unit 36 ​​detects the extension, height, and inclination angle of the slope based on the image data and three-dimensional data included in the evaluation target data. The detection unit 36 ​​also detects the type of slope shown in the image, which is the evaluation target data, using the condition type management DB 3001 (see FIG. 6). In this case, the detection unit 36 ​​detects the type of slope by image matching processing using the teacher image shown in the condition type management table.

[0076] Next, the display control unit 33 displays the shape data, which is the detection result in step S72, in the shape data display area 460 of the evaluation screen 400 (step S73). Fig. 16 is a diagram showing an example of the evaluation screen on which the detection result of the shape data is displayed. The shape data display area 460 shown in Fig. 16 includes a display area 461 for bibliographic information of the shape data indicating the shape detection result by the detection unit 36, and a "display details" button 463 that is pressed to display detailed data of the shape detection result. Of these, the display area 461 displays, for example, the total length of the slope and the proportion of each detected type in the entire slope.

[0077] In the above-described steps S71 to S73, the "shape detection" process may be replaced with the "structure information detection" process.

[0078] In this case, the evaluator presses the "Structure Information Detection" button instead of the "Shape Detection" button 451 included in the evaluation item selection area 430, and the receiving unit 32 receives the structure information detection request (step S71). Next, the detection unit 36 ​​performs a structure information detection process using the evaluation target data (step S72). Then, the display control unit 33 displays the structure information detection information, which is the detection result in step S72, in the structure information display area instead of the shape data display area 460 of the evaluation screen 400 (step S73).

[0079] Here, the structure information includes additional information about the structure in addition to the shape data described above. Specifically, the detection unit 36 ​​detects the type of slope shown in the image, which is the evaluation target data, and the type of additional information about the slope, using the condition type management DB 3001 (see FIGS. 6 and 7), based on the image data and three-dimensional data included in the evaluation target data. In this case, the detection unit 36 ​​detects the type of slope and the additional information about the slope by image matching processing using the teacher image shown in the condition type management table.

[0080] Next, when the evaluator presses the "Damage Detection" button 453 included in the evaluation item selection area 430, the receiving unit 32 transitions the process to step S75 if it receives a damage detection request for detecting damage to the slope condition (YES in step S74). On the other hand, when the damage detection request is not received (NO in step S74), the receiving unit 32 transitions the process to step S77. The detection unit 36 ​​performs damage detection processing of the slope condition on the evaluation target data (step S75).

[0081] Here, the slope condition damage detection process detects the presence or absence of deformation on the slope and the degree of deformation as damage data representing the degree of damage to the slope. The degree of deformation indicates the degree of deterioration of the deformation, such as the width of a crack, the size of a separation, or the size of a lift. The detection unit 36 ​​detects the presence or absence of deformation on the slope and the degree of deformation based on the image data and sensor data included in the evaluation target data. The detection unit 36 ​​also detects whether the degree of deformation exceeds a predetermined value using a predetermined detection formula for the degree of deformation and deterioration. In this case, the detection unit 36 ​​determines whether the crack width is equal to or larger than a certain value, whether the size of the separation is equal to or larger than a certain value, or whether the lift is large, etc.

[0082] Next, the display control unit 33 causes the display 306 to display a display screen 470 showing the damage detection results obtained in step S75 (step S76). FIG. 17 is a diagram showing an example of a display screen showing the damage detection results. The display screen 470 shown in FIG. 17 includes a display image area 480 showing the detected positions of damage on the entire slope to be evaluated, a detailed information display area 485 showing a captured image corresponding to the position of the detected damage, and a "Cross Section" button 489 that is pressed to display a cross section of the detected slope. Of these, the display image area 480 shows a plan view in which images (P1 to P4) showing the positions of the detected damage are drawn on an image showing the two-dimensional shape of the slope to be evaluated. The display image area 480 also shows position coordinates (positioning data) showing the position of the slope to be evaluated.

[0083] Furthermore, when the evaluator presses the "Cross-Section" button 489, the display control unit 33 causes the display 306 to display the cross-sectional image 475 shown in Fig. 18. The cross-sectional image 475 shown in Fig. 18 shows a cross-sectional view of the slope to be evaluated, drawn based on the shape data detected by the detection unit 36. The shape data is detected using sensor data from the angle sensor 8a (three-dimensional sensor), and therefore, as shown in Fig. 18, it is possible to express in detail three-dimensional information such as the slope inclination or height of the slope, which cannot be calculated from a two-dimensional image alone.

[0084] Next, when the evaluator presses the "Map Information" button 455 included in the evaluation item selection area 430, the receiving unit 32 advances the process to step S78 if it receives a map information acquisition request (YES in step S77). On the other hand, when the receiving unit 32 does not receive a map information acquisition request (NO in step S77), it terminates the process. The detecting unit 36 ​​generates map information indicating the position of the slope condition of the evaluation target (step S78). Specifically, the detecting unit 36 ​​generates map information in which an image indicating the position of the slope is attached to the position (north latitude, east longitude) indicated by the positioning data acquired in step S55, which corresponds to map data available using a predetermined service or application provided by an external web server or the like. The map data provided by the external web server or the like is managed by the map data managing unit 37.

[0085] Next, the display control unit 33 displays the map information 490 generated in step S78 on the display 306 (step S79). FIG. 19 is a diagram showing an example of map information. As described above, the map information 490 includes images 491a and 491b that indicate the position of the slope to be evaluated relative to the map data. The map information 490 shown in FIG. 19 includes images 491a and 491b that indicate the start and end positions of the inspection, and text 493a indicating "start point" and text 493b indicating "end point" that correspond to the images 491a and 491b, respectively, to indicate the range of the slope to be inspected. Note that, if it is desired to display the position of the slope more accurately, the detection unit 36 ​​preferably generates the map information by comparing the positioning data with positioning map data held by the Geospatial Information Authority of Japan or the like.

[0086] Fig. 20 is a diagram showing an example of site information stored in association with map information. The images shown in Fig. 20(a) to (i) are stored in association with positioning data in the processing data management table shown in Fig. 8(B), and when an arbitrary position is clicked on the map information 490 shown in Fig. 19, the display control unit 33 causes the display 306 to display an image showing the inspection site associated with the positioning data corresponding to the clicked position.

[0087] Here, the "inspection site" refers not only to the section from the start position to the end position of the inspection shown in Figure 19, but also to the surrounding area of ​​the section from the start position to the end position of the inspection that is necessary to determine the soundness.

[0088] Figures 20(a) and (b) are images of the site showing the starting point 491a and the ending point 491b shown in Figure 19. Figure 20(c) is an image showing the sidewalk at the inspection site, and Figure 20(d) is an image showing the gutter at the inspection site.

[0089] Figures 20(e) and (f) are images showing the evacuation space at the inspection site, Figure 20(g) is an image showing the pavement condition at the inspection site, and Figures 20(h) and (i) are images showing the road gradient at the inspection site.

[0090] When visiting the site for re-inspection or the like, the images shown in FIGS. 20(a) to (i) can be checked in advance on the display 306, thereby improving the efficiency of advance preparations and on-site work.

[0091] 15, when the evaluator presses the "detect signs" button 457 included in the evaluation item selection area 430, the receiving unit 32 receives a sign detection request for detecting signs of damage to the slope condition (YES in step S80), and the processing proceeds to step S81. On the other hand, when the receiving unit 32 does not receive a sign detection request (NO in step S80), the processing ends. The detection unit 36 ​​performs a sign detection process for the slope condition on the evaluation target data (step S82).

[0092] In the condition inspection system 1, when a deformation of a slope is detected, the condition and location of the deformation have been identified. However, the idea of ​​measuring information indicating the location of the deformation before the deformation occurs on the slope has not been known. Here, the process of detecting signs of damage to the slope condition detects signs of deformation on the slope based on measurement data of the slope including surrounding data indicating physical quantities around the slope as sign data indicating signs of slope damage.

[0093] The measurement data includes photographed image data obtained by photographing the slope with the photographing device 7, or sensor data obtained by measuring the slope with a three-dimensional sensor such as the angle sensor 8a.

[0094] The surrounding data includes measurement data of objects other than the slope, and the objects other than the slope include at least one of spring water, soil, rocks, and plants.

[0095] If the measurement data for the slope includes surrounding data that indicates spring water occurring on the surface of the slope, it is possible that stagnant water is exerting pressure from the back side of the slope, and it is therefore detected that there are signs of deformation of the slope. Specifically, it is not limited to the presence or absence of spring water, but the signs of deformation of the slope are detected based on the amount, type and location of the spring water.

[0096] If the measurement data for the slope includes surrounding data that indicates plants or moss growing on the surface of the slope, it is possible that spring water has occurred and stagnant water is exerting pressure from the back side of the slope, and it is therefore detected that there are signs of slope deformation. Specifically, signs of slope deformation are detected not only based on the presence or absence of plants or moss, but also on the amount, type and location of the plants and moss.

[0097] If the measurement data for the slope includes surrounding data that indicates falling rocks and earth and sand around the slope, it is possible that an abnormality has occurred on the backside or topside of the slope, and it is therefore detected that there are signs of slope deformation. Specifically, it is not limited to the presence or absence of falling rocks and earth and sand, but the signs of slope deformation are detected based on the amount, type and location of falling rocks and earth and sand.

[0098] If the measurement data for the slope includes surrounding data that indicates blockages in drainage holes, pipes, berm drainage channels, etc., it is possible that drainage from the back side of the slope to the front side is being obstructed, and that accumulated water is exerting pressure from the back side of the slope, so it is detected that there are signs of slope deformation. Specifically, it is not just the presence or absence of blockages that are detected, but also the amount, type, and location of the foreign matter that is causing the blockage that is detected as signs of slope deformation.

[0099] In addition, if the drainage holes, pipes, drainage channels of the berms, etc. themselves are damaged, this will be detected as a deformation of the slope, but if the drainage holes, pipes, drainage channels of the berms, etc. are clogged, this will not be detected as a deformation of the slope, but will be detected as a sign of slope deformation.

[0100] The measurement data of objects other than the slope described above may be combined to detect signs of slope deformation. Specifically, even if surrounding data indicating spring water exists only in a small part of the slope, if moss is spread over the entire slope, it is estimated that spring water spreads over the entire slope on a daily basis, and a sign of slope deformation is detected.

[0101] The ambient data also includes measurement data of physical quantities other than the object, and the measurement data of physical quantities other than the object includes measurement data of light.

[0102] If the measurement data for the slope includes surrounding data that indicates good sunlight exposure, it will be combined with the measurement data for objects other than the slope mentioned above to detect signs of slope deformation. Specifically, if moss is growing on a slope that is sunny and prone to drying, it is possible that spring water has formed and stagnant water is exerting pressure from the back side of the slope, and this is detected as a sign of slope deformation.

[0103] The process for detecting signs of damage to the slope condition generates comments about signs of deformation of the slope based on measurement data of the slope, including surrounding data that indicates physical quantities around the slope, as sign data that indicates signs of damage to the slope.

[0104] Specifically, based on photographed image data, which is an example of the acquired surrounding data, a comment is generated indicating the type of physical quantity around the slope, such as spring water, as well as its amount and location, etc., with reference to the teacher image in the condition type management table shown in Fig. 7. As an example, a comment such as "moss rate 30%, mostly distributed around 3-20m height from starting point" is generated.

[0105] Next, the display control unit 33 causes the display 306 to display a display screen 1470 showing the sign detection result in step S81 (step S82). Details of the display screen will be described later.

[0106] Furthermore, when the evaluator presses the "Cross-Sectional View" button 1489, the display control unit 33 causes the display 306 to display a cross-sectional image 475, similar to that shown in FIG.

[0107] In this way, the evaluation system 4 detects the shape of the slope including three-dimensional information, the degree of damage to the slope, signs of deformation of the slope, and the position of the slope to be evaluated in order to evaluate the condition of the slope.

[0108] Returning to FIG. 12, when the evaluator presses the "upload" button 491 included in the evaluation screen 400, the receiving unit 32 receives a request to upload the evaluation results (step S58). Then, the communication unit 31 uploads (transmits) the evaluation results to the data management device 5 (step S59). As a result, the communication unit 51 of the data management device 5 receives the evaluation data transmitted from the evaluation device 3. Then, the data management unit 53 of the data management device 5 registers the evaluation data received in step S59 in the processing data management DB 5003 (see FIG. 8(B)) (step S60). In this case, the data management unit 53 stores the evaluation data in a single folder in association with the evaluation target data that has been evaluated.

[0109] Furthermore, when the evaluator presses the "Generate Report" button 493 included in the evaluation screen 400, the reception unit 32 receives a request to generate an evaluation report (step S61). Then, the report generation unit 38 generates an evaluation report based on the detection results of the slope condition by the detection unit 36 ​​(step S62). The report generation unit 38 generates an evaluation report by arranging the evaluation data indicating the above-mentioned evaluation results based on inspection guidelines issued by the government or a format in accordance with requests from the road administrator.

[0110] 21 to 23 are diagrams showing an example of an evaluation report generated by the evaluation device. The first page of the evaluation report shown in Fig. 21 shows bibliographical information such as the route name at the top, and a location map showing the location of the slope to be inspected and the evaluation results at the bottom. The location map shown in Fig. 21 includes map information generated by the detection unit 36 ​​(see Fig. 19).

[0111] The second page of the evaluation report shown in Fig. 22 includes a plan view and a cross-sectional view. The evaluation report shown in Fig. 22 is generated based on the damage detection results and shape detection results obtained by the detection unit 36. The plan view includes an image showing the damage analysis results obtained by the detection unit 36 ​​(see Fig. 17), and the cross-sectional view includes a cross-sectional view of the slope to be evaluated (see Fig. 18), which is drawn based on the shape detection results obtained by the detection unit 36.

[0112] Furthermore, the third page of the evaluation report shown in Fig. 23 shows photographed image data of the slope to be evaluated. The evaluation report shown in Fig. 23 visually shows the condition and shape of the slope shown in the plan view and cross section of Fig. 22.

[0113] In this way, the evaluation device 3 uses the evaluation results of the slope condition to create an evaluation report to be provided to the road administrator. Note that the contents or layout of the evaluation report are not limited to this.

[0114] As described above, the evaluation system 4 generates a report showing the shape of the slope and the location and extent of damage by evaluating the condition of the slope using the photographed image data, sensor data (three-dimensional data), and positioning data acquired by the mobile system 60. This enables the evaluation system 4 to improve the quality and efficiency of the report generation function as an image assessment service used for slope inspection or a slope shape or damage assessment service.

[0115] 15, it is sufficient that the condition detection process by the detection unit 36 ​​is configured to perform at least the shape detection process shown in steps S71 to S73. In addition to the shape detection process, the evaluator can perform the damage detection process shown in steps S74 to S76 and the map information generation process shown in steps S77 to S79 ​​as needed, thereby describing detailed evaluation results in the evaluation report.

[0116] ○ Variations in slope condition evaluation 24 and 25, a modified example of the evaluation process for the slope condition will be described. The mobile system 60 may be configured to include a distance sensor 8c, which measures the distance to the subject photographed by the photographing device 7, instead of or in addition to the angle sensor 8a as a three-dimensional sensor. The distance sensor 8c is a LiDAR (Light Detection and Ranging) sensor. By using the distance sensor 8c, the mobile system 60 can obtain three-dimensional information that is difficult to obtain from two-dimensional images, such as the height, inclination angle, or protrusion of the slope.

[0117] FIG. 24 is a diagram showing a display screen showing damage detection results when a distance sensor is used, and FIG. 25 is a diagram showing a cross-sectional image of the slope shape detected using the distance sensor. The display screen 470 shown in FIG. 24 and the cross-sectional image 475 shown in FIG. 25 depict a newly detected deformation (P5) in addition to the examples shown in FIGS. 16 and 17, respectively. A protrusion (uplift) is detected at the position of P5. Thus, by performing detection using a distance sensor, more detailed three-dimensional information can be obtained compared to when only the angle sensor 8a is used. The distance sensor 8c may be a radar sensor, a time-of-flight (TOF) sensor, a stereo camera, or the like.

[0118] FIG. 26 is a diagram showing an example of a display screen showing the sign detection result, and corresponds to the display screen displayed on the display 306 in step S82 of FIG.

[0119] 26 includes a display image area 1480 that displays the detected positions of signs of deformation on the entire slope to be evaluated, a detailed information display area 1485 that displays a captured image corresponding to the position of the detected signs of deformation, and a "Cross Section" button 1489 that is pressed to display a cross section of the detected slope. Of these, the display image area 1480 displays a plan view in which images (P1 to P4) indicating the positions of the detected signs of deformation are drawn against an image showing the two-dimensional shape of the slope to be evaluated. The display image area 1480 also displays position coordinates (positioning data) that indicate the position of the slope to be evaluated.

[0120] In the detailed information display area 1485, comments 1401 to 1404 are displayed in association with the images P1 to P4, respectively, which indicate the positions of signs of abnormality.

[0121] As explained in step S82 of FIG. 15, these comments 1401 to 1404 are generated based on images P1 to P4, with reference to the teacher images in the state type management table shown in FIG. 7, as comments indicating the types of physical quantities around the slope.

[0122] 27 and 28 are diagrams showing examples of evaluation reports including the sign detection results.

[0123] The evaluation report including the sign detection results shown in Figure 27 shows photographed images P1 to P4 and comments 1401 to 1404 that indicate signs of deformation of the slope being evaluated, corresponding to the photographed images P1 to P4 and comments 1401 to 1404 displayed in the detailed information display area 1485 of the display 306 shown in Figure 26.

[0124] The evaluation report containing the sign detection results shown in Figure 28 includes photographed images P1 and P2 of the slope being evaluated and comments 1411 and 1412, as well as photographed images P3 and P4 and comments 1413 and 1414 showing signs of deformation of the slope being evaluated.

[0125] The evaluation report including the symptom detection results shown in Figures 27 and 28 may be included in the evaluation report shown in Figures 21 to 23, or may be used as supplementary material to the evaluation report shown in Figures 21 to 23.

[0126] Modified examples of mobile systems ○Variation 1○ Next, modified examples of the mobile body system 60 will be described with reference to Fig. 29 to Fig. 31. First, Fig. 29 is a diagram showing an example of how the state of a slope is inspected using a mobile body system according to Modification 1. The mobile body system 60 according to Modification 1 is a system in which a data acquisition device 9 is fixed to a pole installed on the top surface of the mobile body 6 to enable photography of high places.

[0127] The camera device 7 of the above-described embodiment is low in height from the ground, making it difficult to photograph the berms on retaining walls, berms on crenellations, or berms on sprayed mortar, as shown in FIG. 29. Furthermore, the berms on current road earthwork structures, as shown in FIG. 29, are not covered, and there is a risk of dead leaves and other debris accumulating and clogging the waterway, requiring periodic cleaning. Therefore, by using the mobile body system 60 according to Modification 1, which is capable of photographing from a high altitude, even in cases where it is difficult for a person to climb a slope to check the degree of clogging of the waterway, the confirmation can be made through the photographing process associated with the traveling movement of the mobile body 6, thereby significantly improving inspection efficiency.

[0128] ○Variation 2○ 30 is a diagram showing an example of inspecting the condition of a slope using a mobile body system according to Modification 2. The mobile body system 60 (60a, 60b) according to Modification 2 is a system that uses a drone equipped with a data acquisition device 9 as an example of a mobile body 6 to photograph an embankment slope at a high place or below the side of a road that cannot be photographed even with the pole-mounted camera of Modification 1.

[0129] The drone serving as the mobile object 6 is equipped with not only the imaging device 7 but also a data acquisition device 9 equipped with sensors such as an angle sensor 8a, a GNSS sensor 8b, or a distance sensor 8c, thereby enabling evaluation of the condition of high places and embankments that could not be evaluated by a vehicle serving as the mobile object 6. Embankments and high places are particularly difficult for humans to approach for close visual inspection, making photography by a drone such as that of Modification 2 desirable. Furthermore, embankments and high-place slopes are often overgrown with vegetation such as trees and grass. Therefore, it is preferable for the data acquisition device 9 to be equipped with an imaging device 7 capable of capturing wide-angle images.

[0130] ○Variation 3○ FIG. 31 is a diagram showing an example of inspecting the condition of a slope using a mobile system according to Modification 3. As shown in FIG. 31, a slope has a complex structure, unlike a tunnel or a bridge, which are structures on a road. For example, a slope may be undulating rather than flat (e.g., an earthwork structure in which mortar is sprayed onto a quay), or may be covered with vegetation or wire mesh. Therefore, the mobile system 60 (60a, 60b, 60c) according to Modification 3 is equipped with a spectral camera, an infrared camera, or an expanded depth of field (EDof) camera as the sensor device 8, which is capable of acquiring wavelength information, in order to distinguish between objects such as plants and wire mesh and the shape of the slope.

[0131] Furthermore, the mobile system 60 according to the third modification is preferably configured to be not only a tool for distinguishing the shape of the slope, but also to have a lighting device mounted on the data acquisition device 9 so that the slope can be photographed under various conditions such as weather and sunlight. In this case, the lighting device is preferably a line lighting device that illuminates an area corresponding to the photographing range of the photographing device 7, or a time-sharing lighting device synchronized with the photographing device 7 and the sensor device 8.

[0132] Furthermore, in order to process the data acquired by the mobile system 60 according to the third modification, the evaluation target data generation unit 35 of the evaluation device 3 preferably has image processing functions such as an image stabilization function, a depth of focus correction function (blur correction function), a distortion correction function, or a contrast enhancement function so as not to miss even small abnormalities. The evaluation target data generation unit 35 also preferably has a function to remove noise that obscures abnormalities on earthwork structures, such as grass, moss, or wire mesh, or a function to distinguish between shadows of grass and abnormalities such as cracks. Thus, by using the mobile system 60 according to the third modification, the condition inspection system 1 can accurately evaluate the condition of slopes even in areas with complex structures or areas where grass, moss, or wire mesh is present.

[0133] FIG. 32 is a diagram showing an example of the overall configuration of a state inspection system according to the fourth modification.

[0134] The status inspection system 1 according to variant example 4 shown in FIG. 32 includes a terminal device 1100 of the national or local government and a terminal device 1200 of the commissioned business operator, and differs from the status inspection system 1 shown in FIG. 1 in that the terminal device 1100 of the national or local government and the terminal device 1200 of the commissioned business operator communicate with the evaluation system 4 via a communication network 100.

[0135] FIG. 33 is a sequence diagram showing an example of an evaluation data display process in the state inspection system according to the fourth modification.

[0136] ○Display processing of evaluation device 3○ The display control unit 33 of the evaluation device 3 causes the display 306 to display the evaluation screen 400 for performing processing to display the evaluation result of the slope condition (step S91). In step S91, the evaluation screen 400 shown in Fig. 13 is displayed.

[0137] Next, the user of the evaluation device 3 specifies a folder using the "Specify folder" button 411, and the reception unit 32 of the evaluation device 3 receives the selection of the evaluation data (step S92). For example, in the example of FIG. 13, the reception unit 32 receives the selection of the evaluation data stored in "folder 0615."

[0138] Next, the communication unit 31 transmits a read request for the evaluation data selected in step S92 to the data management device 5 (step S93). This read request includes the folder name selected in step S92. As a result, the communication unit 51 of the data management device 5 receives the read request transmitted from the evaluation device 3.

[0139] Next, the storage / reading unit 59 of the data management device 5 searches the processing data management DB 5003 (see FIG. 8(B)) using the folder name included in the read request received in step S93 as a search key, and reads out the evaluation data associated with the folder name included in the read request (step S94). This evaluation data is registered in step S60 of FIG. 12. Then, the communication unit 51 transmits the evaluation data read out in step S94 to the evaluation device 3 (step S95). As a result, the communication unit 31 of the evaluation device 3 receives the evaluation data transmitted from the data management device 5.

[0140] Next, the display control unit 33 of the evaluation device 3 displays the evaluation data received in step S94 in the evaluation item selection area 430 of the evaluation screen 400 (step S96). In step S96, the evaluation screen 400 shown in FIG. 14 is displayed.

[0141] The user of the evaluation device 3 can confirm the shape detection results in the shape data display area 460 shown in FIG. 16 by pressing the "shape detection" button 451 on the evaluation screen 400 shown in FIG.

[0142] A user of the evaluation device 3 can confirm the damage detection results on a display screen 470 shown in Fig. 17 by pressing a "Damage Detection" button 453 on the evaluation screen 400 shown in Fig. 14. Furthermore, a user can confirm a cross-sectional image 475 shown in Fig. 18 by pressing a "Cross-Section View" button 489 on the display screen 470 shown in Fig. 17.

[0143] The user of the evaluation device 3 can check the map information 490 shown in Fig. 19 by pressing the "Map Information" button 455 on the evaluation screen 400 shown in Fig. 14. Furthermore, by clicking any position on the map information 490 shown in Fig. 19, the user can check the site information shown in Fig. 20.

[0144] The user of the evaluation device 3 can confirm the sign detection result on a display screen 1470 shown in FIG. 26 by pressing the "sign detection" button 457 on the evaluation screen 400 shown in FIG.

[0145] ○Display processing for national and local government terminal devices 1100○ The display control unit of the terminal device 1100 of the national or local government displays the evaluation screen 400 for performing processing to display the evaluation results of the slope condition on the display of the terminal device 1100 (step S101). In step S101, the evaluation screen 400 shown in Fig. 13 is displayed.

[0146] Next, the user of the terminal device 1100 specifies a folder using the "Specify folder" button 411, and the reception unit of the terminal device 1100 then receives the selection of the evaluation data (step S102). For example, in the example of Fig. 13, the reception unit receives the selection of the evaluation data stored in "folder 0615".

[0147] Next, the communication unit of the terminal device 1100 transmits a read request for the evaluation data selected in step S102 to the data management device 5 (step S103). This read request includes the folder name selected in step S102. As a result, the communication unit 51 of the data management device 5 receives the read request transmitted from the terminal device 1100.

[0148] Next, the storage / reading unit 59 of the data management device 5 searches the processing data management DB 5003 (see FIG. 8(B)) using the folder name included in the read request received in step S103 as a search key, and reads out the evaluation data associated with the folder name included in the read request (step S104). This evaluation data was registered in step S60 of FIG. 12. Then, the communication unit 51 transmits the evaluation data read out in step S104 to the terminal device 1100 (step S105). As a result, the communication unit of the terminal device 1100 receives the evaluation data transmitted from the data management device 5.

[0149] Next, the display control unit of the terminal device 1100 displays the evaluation data received in step S104 in the evaluation item selection area 430 of the evaluation screen 400 (step S106). In step S106, the evaluation screen 400 shown in FIG. 14 is displayed.

[0150] The user of the terminal device 1100 can confirm the shape detection results in the shape data display area 460 shown in FIG. 16 by pressing the "shape detection" button 451 on the evaluation screen 400 shown in FIG.

[0151] The user of the terminal device 1100 can confirm the damage detection results on the display screen 470 shown in Fig. 17 by pressing the "Damage Detection" button 453 on the evaluation screen 400 shown in Fig. 14. Furthermore, by pressing the "Cross-Section View" button 489 on the display screen 470 shown in Fig. 17, the user can confirm the cross-sectional image 475 shown in Fig. 18.

[0152] The user of the terminal device 1100 can check the map information 490 shown in Fig. 19 by pressing the "Map Information" button 455 on the evaluation screen 400 shown in Fig. 14. Furthermore, by clicking any position on the map information 490 shown in Fig. 19, the user can check the site information shown in Fig. 20.

[0153] The user of the terminal device 1100 can confirm the sign detection results on a display screen 1470 shown in FIG. 26 by pressing the "sign detection" button 457 on the evaluation screen 400 shown in FIG.

[0154] With the above configuration, users of the national and local government terminal devices 1100 can easily check the shape detection results, damage detection results, map information, and symptom detection results corresponding to the contents of the submitted report by displaying them on the display.

[0155] This will improve the efficiency of advance preparations and on-site work when national and local government officials visit sites to inspect submitted reports.

[0156] ○Display processing of the entrusted business operator's terminal device 1200○ The display control unit of the terminal device 1200 of the entrusted business operator displays the evaluation screen 400 for performing processing to display the evaluation result of the slope condition on the display of the terminal device 1200 (step S111). In step S111, the evaluation screen 400 shown in Fig. 13 is displayed.

[0157] Next, the user of the terminal device 1200 specifies a folder using the "Specify folder" button 411, and the reception unit of the terminal device 1200 then receives the selection of the evaluation data (step S112). For example, in the example of Fig. 13, the reception unit receives the selection of the evaluation data stored in "folder 0615".

[0158] Next, the communication unit of the terminal device 1200 transmits a read request for the evaluation data selected in step S112 to the data management device 5 (step S113). This read request includes the folder name selected in step S112. As a result, the communication unit 51 of the data management device 5 receives the read request transmitted from the terminal device 1200.

[0159] Next, the storage / reading unit 59 of the data management device 5 searches the processing data management DB 5003 (see FIG. 8(B)) using the folder name included in the read request received in step S113 as a search key, and reads out the evaluation data associated with the folder name included in the read request (step S114). This evaluation data was registered in step S60 of FIG. 12. Then, the communication unit 51 transmits the evaluation data read out in step S114 to the terminal device 1200 (step S115). As a result, the communication unit of the terminal device 1200 receives the evaluation data transmitted from the data management device 5.

[0160] Next, the display control unit of the terminal device 1200 displays the evaluation data received in step S114 in the evaluation item selection area 430 of the evaluation screen 400 (step S116). In step S116, the evaluation screen 400 shown in FIG. 14 is displayed.

[0161] The user of the terminal device 1200 can confirm the shape detection results in the shape data display area 460 shown in FIG. 16 by pressing the "shape detection" button 451 on the evaluation screen 400 shown in FIG.

[0162] The user of the terminal device 1200 can confirm the damage detection results on the display screen 470 shown in Fig. 17 by pressing the "Damage Detection" button 453 on the evaluation screen 400 shown in Fig. 14. Furthermore, by pressing the "Cross-Section View" button 489 on the display screen 470 shown in Fig. 17, the user can confirm the cross-sectional image 475 shown in Fig. 18.

[0163] The user of the terminal device 1200 can check the map information 490 shown in Fig. 19 by pressing the "Map Information" button 455 on the evaluation screen 400 shown in Fig. 14. Furthermore, by clicking any position on the map information 490 shown in Fig. 19, the user can check the site information shown in Fig. 20.

[0164] The user of the terminal device 1200 can confirm the sign detection results on a display screen 1470 shown in FIG. 26 by pressing the "sign detection" button 457 on the evaluation screen 400 shown in FIG.

[0165] With the above configuration, the user of the terminal device 1200 of the commissioned business operator can easily check the shape detection results, damage detection results, map information, and symptom detection results corresponding to the contents of the submitted report by displaying them on the display.

[0166] This will improve the efficiency of pre-preparation and on-site work when a contractor visits the site to inspect a submitted report.

[0167] ○Display processing of mobile system 60○ The display control unit of the mobile body system 60 displays the evaluation screen 400 for performing processing to display the evaluation result of the slope condition on the display of the mobile body system 60 (step S111). In step S111, the evaluation screen 400 shown in Fig. 13 is displayed.

[0168] Next, the user of the mobile system 60 specifies a folder using the "Specify folder" button 411, and the request receiving unit 98 of the mobile system 60 then receives the selection of the evaluation data (step S112). For example, in the example of Fig. 13, the request receiving unit 98 receives the selection of the evaluation data stored in "folder 0615".

[0169] Next, the communication unit 91 of the mobile system 60 transmits a read request for the evaluation data selected in step S112 to the data management device 5 (step S113). This read request includes the folder name selected in step S112. As a result, the communication unit 51 of the data management device 5 receives the read request transmitted from the mobile system 60.

[0170] Next, the storage / reading unit 59 of the data management device 5 searches the processing data management DB 5003 (see FIG. 8(B)) using the folder name included in the read request received in step S113 as a search key, and reads out the evaluation data associated with the folder name included in the read request (step S114). This evaluation data was registered in step S60 of FIG. 12. Then, the communication unit 51 transmits the evaluation data read out in step S114 to the mobile system 60 (step S115). As a result, the communication unit 91 of the mobile system 60 receives the evaluation data transmitted from the data management device 5.

[0171] Next, the display control unit of the mobile system 60 displays the evaluation data received in step S114 in the evaluation item selection area 430 of the evaluation screen 400 (step S116). In step S116, the evaluation screen 400 shown in FIG. 14 is displayed.

[0172] The user of the mobile system 60 can confirm the shape detection results in the shape data display area 460 shown in FIG. 16 by pressing the "shape detection" button 451 on the evaluation screen 400 shown in FIG.

[0173] A user of the mobile system 60 can confirm the damage detection results on a display screen 470 shown in Fig. 17 by pressing a "Damage Detection" button 453 on the evaluation screen 400 shown in Fig. 14. Furthermore, a user can confirm a cross-sectional image 475 shown in Fig. 18 by pressing a "Cross-Section" button 489 on the display screen 470 shown in Fig. 17.

[0174] The user of the mobile system 60 can check the map information 490 shown in Fig. 19 by pressing the "Map Information" button 455 on the evaluation screen 400 shown in Fig. 14. Furthermore, by clicking any position on the map information 490 shown in Fig. 19, the user can check the site information shown in Fig. 20.

[0175] The user of the mobile system 60 can confirm the sign detection results on the display screen 1470 shown in FIG. 26 by pressing the "sign detection" button 457 on the evaluation screen 400 shown in FIG.

[0176] With the above configuration, the user of the mobile system 60 can easily check the shape detection results, damage detection results, map information, and sign detection results corresponding to the contents of the submitted report by displaying them on the display.

[0177] This improves the efficiency of advance preparations and on-site work when an inspector of the mobile system 60 visits the site for a re-inspection or the like to check the site related to the submitted report.

[0178] Effect of the embodiment As explained above, the condition inspection system 1 can quantitatively detect the shape of an earthwork structure, as well as detect changes in the shape of the surface layer of the earthwork structure and abnormalities that occur in the surface layer of the earthwork structure, based on data acquired using three-dimensional sensors such as the camera device 7 and the angle sensor 8a, and can automatically generate evaluation reports such as those shown in Figures 21 to 23, 27 and 28 based on the evaluation results, thereby significantly improving the efficiency of slope inspection.In addition, by using the mobile system 60, the condition inspection system 1 can inspect high places, embankments, and other places where humans cannot enter.

[0179] Furthermore, by combining map data with the results of slope condition evaluation, the condition inspection system 1 can determine the location of the slope to be evaluated, making it possible to extract slopes of earthwork structures that do not require visual inspection and to improve the inspection speed per slope.In addition, by registering the evaluation results in the data management device 5, the condition inspection system 1 can quantitatively accumulate changes in the condition over time, making soundness diagnosis rational and efficient.

[0180] Although the above embodiment has described an example of inspecting and evaluating the condition of a slope, the condition inspection system 1 may be used not only to inspect the condition of a slope, but also in combination with inspecting other structures such as road surfaces, tunnels, bridges, etc. The condition inspection system 1 can further improve the efficiency of infrastructure inspections by inspecting various structures on roads using the mobile system 60.

[0181] ●Summary● As described above, the evaluation system 4 for evaluating the condition of a structure (e.g., a road earthwork structure) according to one embodiment of the present invention comprises a detection unit 36, which is an example of a detection means for detecting the condition of the structure based on measurement data obtained by measuring the structure, and a report generation unit 38, which is an example of an evaluation information generation means for generating an evaluation report, based on the measurement data, that generates evaluation information indicating the evaluation results of the condition of the structure. The measurement data includes surrounding data that indicates physical quantities around the structure, and the detection unit 36 ​​detects signs of deformation of the structure based on the measurement data, and the report generation unit 38 generates an evaluation report that includes data indicating the signs of deformation of the structure.

[0182] This makes it possible to not only identify the location of the defect, but also to identify signs of the defect by checking the photographed image data and other data included in the evaluation report. As a result, it becomes possible to take preventative measures to prevent the defect from occurring, rather than just taking corrective measures such as repairs to the defected location.

[0183] In other words, it becomes possible to take measures not only after deformation of the structure has occurred, but also before deformation occurs.

[0184] The report generation unit 38 includes comments generated based on the measurement data in the evaluation report, and the evaluation system 4 further includes a display control unit 33 which is an example of a display control means that displays the generated comments on a display 306 which is an example of a display unit.

[0185] This makes it possible to check the comments included in the evaluation report and properly identify signs of abnormalities.

[0186] The surrounding data includes measurement data of objects other than structures, and the objects other than structures are at least one of spring water, soil, rocks, and plants.

[0187] This makes it possible to properly detect signs of structural deformation caused by objects other than structures, such as spring water, soil, rocks, and plants.

[0188] The ambient data includes measurement data of physical quantities other than the object included in the measurement data, and the measurement data of physical quantities other than the object includes measurement data of light.

[0189] This makes it possible to appropriately grasp signs of structural deformation caused by physical quantities other than objects, such as light.

[0190] The measurement data includes photographed image data obtained by photographing the structure, or sensor data obtained by measuring the structure with a three-dimensional sensor.

[0191] This makes it possible to accurately detect signs of structural deformation based on these measurement data and appropriately grasp the signs of structural deformation.

[0192] The evaluation method performed by the evaluation system 4 for evaluating the state of a structure according to one embodiment of the present invention includes a detection step of detecting the state of the structure based on measurement data obtained by measuring the structure, and an evaluation information generation step of generating evaluation information indicating the evaluation results of the state of the structure based on the measurement data, where the measurement data includes surrounding data indicating physical quantities around the structure, the detection step includes processing to detect signs of deformation of the structure based on the measurement data, and the evaluation information generation step includes processing to generate evaluation information including data indicating signs of deformation of the structure.

[0193] A program according to one embodiment of the present invention causes an evaluation system 4 for evaluating the condition of a structure to execute a detection step for detecting the condition of the structure based on measurement data obtained by measuring the structure, and an evaluation information generation step for generating evaluation information indicating the evaluation results of the condition of the structure based on the measurement data, wherein the measurement data includes ambient data indicating physical quantities around the structure, the detection step includes processing for detecting signs of deformation of the structure based on the measurement data, and the evaluation information generation step includes processing for generating evaluation information including data indicating signs of deformation of the structure.

[0194] ●Additional Information● Each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in the present embodiment includes a processor programmed to perform each function by software, such as a processor implemented by an electronic circuit, as well as devices designed to perform each of the above-described functions, such as an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a field programmable gate array (FPGA), a system on a chip (SOC), a graphics processing unit (GPU), and a conventional circuit module.

[0195] Furthermore, the various tables in the embodiments described above may be generated by the learning effects of machine learning, and tables may not be used by classifying data for each associated item using machine learning. Here, machine learning refers to a technology that allows a computer to acquire human-like learning capabilities, in which the computer autonomously generates algorithms necessary for judgments such as data classification from previously acquired learning data and applies these algorithms to new data to make predictions. The learning method for machine learning may be any of supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, and deep learning, or may be a combination of these learning methods. Any learning method for machine learning is acceptable.

[0196] The various tables in the above-described embodiments may be generated using an image processing technique, such as edge detection, line detection, or binarization. Similarly, when handling audio, an audio conversion technique such as a Fourier transform may be used.

[0197] So far, we have described an evaluation system, a status inspection system, an evaluation method, and a program according to one embodiment of the present invention, but the present invention is not limited to the above-described embodiment, and other modifications, such as additions, changes, or deletions, can be made within the scope of what a person skilled in the art can conceive, and any aspect is included in the scope of the present invention as long as it achieves the functions and effects of the present invention. [Explanation of symbols]

[0198] 1. Condition Inspection System 3 Evaluation equipment 4. Rating System 5 Data management device 6 Mobile 7. Imaging equipment 8 Sensor Device 8a Angle sensor (an example of a three-dimensional sensor) 8c Distance sensor (an example of a three-dimensional sensor) 9 Data acquisition equipment 32 Reception unit (an example of reception means) 33 Display control unit (an example of a display control means) 35 Evaluation target data generation unit (an example of evaluation target data generation means) 36 Detection unit (an example of a detection means) 38 Report generation unit (an example of evaluation information generation means) 51 Communication unit (an example of a receiving means) 60 Mobile Systems

Claims

1. An evaluation system for evaluating the condition of a structure, comprising: a detection means for detecting a state of the structure based on measurement data obtained by measuring the structure; evaluation information generating means for generating evaluation information indicating an evaluation result of the state of the structure based on the measurement data; Equipped with the measurement data includes surrounding data indicating physical quantities around the structure, the detection means detects a sign of a deformation of the structure based on the measurement data; The evaluation information generating means generates the evaluation information by including data indicating a sign of a deformation of the structure. Rating system.

2. 2. The evaluation system according to claim 1, wherein the evaluation information generating means includes, in the evaluation information, a comment generated based on the measurement data.

3. 3. The evaluation system according to claim 1, further comprising a display control unit for displaying the generated comments on a display unit.

4. 4. The evaluation system according to claim 1, wherein the surrounding data includes measurement data of an object other than the structure.

5. The evaluation system according to claim 4 , wherein the object other than a structure is at least one of spring water, soil, rocks, and plants.

6. 6. The evaluation system according to claim 1, wherein the surrounding data includes measurement data of physical quantities other than those of the object included in the measurement data.

7. 7. The evaluation system according to claim 6, wherein the measurement data of the physical quantity other than the object is measurement data of light.

8. 8. The evaluation system according to claim 1, wherein the measurement data includes photographed image data of the structure.

9. 9. The evaluation system according to claim 1, wherein the measurement data includes sensor data obtained by measuring the structure with a three-dimensional sensor.

10. An evaluation method performed by an evaluation system for evaluating the condition of a structure, comprising: a detection step of detecting a state of the structure based on measurement data obtained by measuring the structure; an evaluation information generating step of generating evaluation information indicating an evaluation result of the state of the structure based on the measurement data; Run the measurement data includes surrounding data indicating physical quantities around the structure, the detecting step includes a process of detecting a sign of a deformation of the structure based on the measurement data, The evaluation information generating step includes a process of generating the evaluation information by including data indicating a sign of a deformation of the structure. Evaluation method.

11. The evaluation system for assessing the condition of structures includes: a detection step of detecting a state of the structure based on measurement data obtained by measuring the structure; an evaluation information generating step of generating evaluation information indicating an evaluation result of the state of the structure based on the measurement data; Execute the measurement data includes surrounding data indicating physical quantities around the structure, the detecting step includes a process of detecting a sign of a deformation of the structure based on the measurement data, The evaluation information generating step includes a process of generating the evaluation information by including data indicating a sign of a deformation of the structure. program.

Citation Information

Patent Citations

  • JP2016‐183934A