Structure inspection support device, structure inspection support method, and program

Abstract

The present invention provides a structure inspection assistance device, a structure inspection assistance method, and a program that make it possible to easily display related information from among text data included in an inspection record, etc. A structure inspection assistance device (10) is provided with a processor, and the processor: acquires three-dimensional model data (101) and inspection data (103) of a structure, and a list of text data for a plurality of inspected parts related to the inspection work of the structure; displays the list of text data on a display device (30); accepts the selection of text data for at least one inspected part from the displayed list of text data; analyzes the selected text data; extracts a corresponding part (102) on the three-dimensional model data (101) and / or the inspection data (103), corresponding to the text data for the inspected part; and displays, on the display device (30), the extracted corresponding part (102) on the three-dimensional model data (101) and / or the extracted inspection data (103).

Description

[Technical Field]

[0001] The present invention relates to a structure inspection support device, a structure inspection support method, and a program. [Background technology]

[0002] Social infrastructure includes structures such as bridges and tunnels. These structures are prone to damage, and because this damage tends to progress, they require regular inspections.

[0003] Inspectors who inspect a structure are required to prepare an inspection report in a prescribed format based on the inspection procedures established by the structure's manager, etc., as a document showing the results of the inspection. By looking at the damage diagram prepared in the prescribed format, even experts other than the inspector who actually inspected the structure can understand the progress of the damage to the structure and formulate a maintenance plan for the structure.

[0004] Similarly, structures such as apartment buildings and office buildings are inspected periodically, and repairs and renovations are carried out based on the inspection results. will be carried out Regarding the creation of inspection reports, Patent Document 1 discloses a system that can reduce the time required to create inspection reports. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 2019-082933 Summary of the Invention [Problem to be solved by the invention]

[0006] By the way, when checking the inspection report, the damage situation can be easily understood from the written information. toThere are cases where it is necessary to refer to related damage fact information (photographs, drawings, 3D model data, etc.). However, since the damage fact information is not linked in the inspection report created in the specified format, there is a problem that referencing it is time-consuming.

[0007] The present invention has been made in consideration of the above circumstances, and its purpose is to provide a structure inspection support device, a structure inspection support method, and a program that can easily display relevant information from text data contained in inspection reports, etc. [Means for solving the problem]

[0008] A first aspect of a structure inspection support device is a structure inspection support device equipped with a processor, in which the processor acquires 3D model data of the structure, inspection data mutually associated with the 3D model data, and a list of text data of multiple inspection locations related to inspection work of the structure, displays the list of text data on a display device, accepts selection of text data of at least one inspection location from the displayed list of text data, analyzes the selected text data, extracts corresponding portions on the 3D model data and / or inspection data that correspond to the text data of the inspection location, and displays the extracted corresponding portions on the 3D model data and / or the extracted inspection data on the display device.

[0009] In the second aspect of the structure inspection support device, the processor analyzes the selected text data, extracts the corresponding portion on the 3D model data that corresponds to the inspection location, and extracts inspection data associated with the extracted corresponding portion on the 3D model data.

[0010] A third aspect of the structure inspection support device includes a memory that stores three-dimensional model data, inspection data that is mutually associated with the three-dimensional model data, and a list of text data, and a processor that acquires the three-dimensional model data, inspection data, and list of text data from the memory.

[0011] In the structure inspection support device of the fourth aspect, the processor maps the extracted inspection data onto three-dimensional model data and displays it on the display device.

[0012] In the structure inspection support device of the fifth aspect, the list of text data is an inspection report.

[0013] In the structure inspection support device of the sixth aspect, the three-dimensional model data includes at least data on a component region and a component.

[0014] In the structure inspection support device of the seventh aspect, the inspection data includes a plurality of types of data.

[0015] In the structure inspection support device of the eighth aspect, the multiple types of data include photographed images, panoramic composite images, damage information, and two-dimensional drawings.

[0016] In the structure inspection support device of the ninth aspect, the processor displays at least one type of data from among a plurality of types of data included in the inspection data on the display device.

[0017] In the structure inspection support device of the tenth aspect, the inspection data includes a plurality of captured images, and the processor displays, on the display device, a captured image that satisfies a condition from the plurality of captured images to be displayed.

[0018] In the eleventh aspect of the structure inspection support device, the processor analyzes the selected text data, extracts past inspection data corresponding to the inspection location, and displays the extracted past inspection data on the display device.

[0019] A twelfth aspect of the method for supporting inspection of a structure is a method for supporting inspection of a structure that uses a structure inspection support device equipped with a processor, in which the processor acquires 3D model data of the structure, inspection data mutually associated with the 3D model data, and a list of text data of multiple inspection locations related to inspection work of the structure, displays the list of text data on a display device, accepts selection of text data of at least one inspection location from the displayed list of text data, analyzes the selected text data, extracts corresponding portions on the 3D model data and / or inspection data that correspond to the text data of the inspection location, and displays the extracted corresponding portions on the 3D model data and / or the extracted inspection data on the display device.

[0020] A program of a thirteenth aspect is a program that causes a structure inspection support device having a processor to execute a structure inspection support method, in which the processor acquires three-dimensional model data of the structure, inspection data mutually associated with the three-dimensional model data, and a list of text data of multiple inspection locations related to structure inspection work, displays the list of text data on a display device, accepts selection of text data of at least one inspection location from the displayed list of text data, analyzes the selected text data, extracts corresponding portions on the three-dimensional model data and / or inspection data that correspond to the text data of the inspection location, and displays the extracted corresponding portions on the three-dimensional model data and / or the extracted inspection data on the display device. [Effects of the Invention]

[0021] According to the structure inspection support device, structure inspection support method, and program of the present invention, related information can be easily displayed from text data included in an inspection report or the like. [Brief explanation of the drawings]

[0022] [Figure 1] FIG. 1 is a block diagram showing an example of a hardware configuration of a structure inspection support device. [Figure 2]FIG. 2 is a block diagram showing the processing functions realized by the CPU. [Figure 3] FIG. 3 is a diagram showing information stored in the storage unit. [Figure 4] FIG. 4 is a flow diagram showing an inspection support method using the structure inspection support device. [Figure 5] Figure 5 shows examples of 3D model data, where Figure 5(A) is a diagram showing a large number of points on the surface of a structure as a 3D point cloud, and Figure 5(B) is a diagram showing texture mapping of a photographed image of the structure onto a polygonal polygon. [Figure 6] FIG. 6 is a diagram showing an example of multiple types of data included in the inspection data. [Figure 7] FIG. 7 is a diagram showing a template of the inspection record data. [Figure 8] FIG. 8 is a diagram for explaining the list display step and the selection receiving step. [Figure 9] FIG. 9 is a diagram illustrating an example of the information extraction step. [Figure 10] FIG. 10 is a diagram for explaining another example of the information extracting step. [Figure 11] FIG. 11 is a diagram showing an example of a screen displayed on the display device in the extracted information display step. [Figure 12] FIG. 12 is a diagram showing another example of a screen displayed on the display device in the extracted information display step. [Figure 13] FIG. 13 is a diagram illustrating another first aspect of the selection receiving step, the information extracting step, and the extracted information displaying step. [Figure 14] FIG. 14 is a diagram illustrating a second alternative aspect of the selection receiving step, the information extracting step, and the extracted information displaying step. [Figure 15] FIG. 15 is a diagram illustrating another third aspect of the selection receiving step, the information extracting step, and the extracted information displaying step. DETAILED DESCRIPTION OF THE INVENTION

[0023] A preferred embodiment of a structure inspection support device, a structure inspection support method, and a program according to one aspect of the present invention will be described below with reference to the accompanying drawings. Here, the term "structure" includes buildings, such as civil engineering structures such as bridges, tunnels, and dams, as well as buildings, houses, and architectural structures such as walls, columns, and beams of buildings.

[0024] [Hardware configuration of the structural inspection support device] FIG. 1 is a block diagram showing an example of a hardware configuration of a structure inspection support device according to an embodiment of the present invention.

[0025] A computer or a workstation can be used as the structure inspection support device 10 shown in Fig. 1. The structure inspection support device 10 in this example is mainly composed of an input / output interface 12, a storage unit 16, an operation unit 18, a CPU (Central Processing Unit) 20, a RAM (Random Access Memory) 22, a ROM (Read Only Memory) 24, and a display control unit 26. A display device 30 is connected to the structure inspection support device 10, and under the command of the CPU 20, an image is displayed on the display device 30 under the control of the display control unit 26. The display device 30 is composed of, for example, a monitor.

[0026] The input / output interface 12 can input various data (information) to the structure inspection support device 10. For example, data to be stored in the storage unit 16 is input via the input / output interface 12.

[0027] The CPU (processor) 20 reads out various programs stored in the storage unit 16 or the ROM 24, etc., and loads them into the RAM 22 to perform calculations, thereby controlling each unit in an integrated manner. The CPU 20 also reads out programs stored in the storage unit 16 or the ROM 24, performs calculations using the RAM 22, and performs various processes of the structure inspection support device 10.

[0028] FIG. 2 is a block diagram showing the processing functions realized by the CPU 20. As shown in FIG.

[0029] The CPU 20 has an information acquisition unit 51, a list display unit 53, a selection acceptance unit 55, an information extraction unit 57, and an extracted information display unit 59. Specific processing functions of each unit will be described later. The information acquisition unit 51, the list display unit 53, the selection acceptance unit 55, the information extraction unit 57, and the extracted information display unit 59 are part of the CPU 20, and therefore it can also be said that the CPU 20 executes the processing of each unit.

[0030] Returning to FIG. 1 , the storage unit (memory) 16 is a memory configured from a hard disk drive, flash memory, etc. The storage unit 16 stores data and programs for operating the structure inspection support device 10, such as an operating system and a program for executing a structure inspection support method. The storage unit 16 also stores information used in the present embodiment described below. The program for operating the structure inspection support device 10 may be recorded and distributed on an external recording medium (not shown) and installed by the CPU 20 from the recording medium. Alternatively, the program for operating the structure inspection support device 10 may be stored in a state accessible from outside on a server connected to a network, downloaded to the storage unit 16 by the CPU 20 upon request, installed, and executed.

[0031] 3 is a diagram showing information etc. stored in the storage unit 16. The storage unit 16 is composed of non-transitory recording media such as a CD (Compact Disk), a DVD (Digital Versatile Disk), a hard disk, various semiconductor memories, etc., and a control unit thereof.

[0032] The storage unit 16 mainly stores three-dimensional model data 101, inspection data 103, and inspection record data 105.

[0033] The three-dimensional model data 101 is, for example, data of a three-dimensional model of a structure created based on a plurality of captured images. The three-dimensional model data 101 includes data on component areas and component names that constitute the structure, and each component area and component name is identified in the three-dimensional model data 101. The component area and component name are identified for the three-dimensional model data 101 based on, for example, a user operation. Furthermore, the component area and component name are automatically identified for the three-dimensional model data 101 from information on the shape, dimensions, etc. of the component.

[0034] The inspection data 103 may include multiple types of data required for inspection. The inspection data 103 may include, for example, photographed images, panoramic composite images, damage information, and 2D drawings. The photographed images are multiple images of a structure, and the panoramic composite image is a collection of images corresponding to specific components synthesized from the photographed images. The 2D drawings may include general drawings, damage drawings, repair drawings, etc. If there is damage to the structure, the photographed images contain the damage, so the damage can be extracted from the photographed images. In addition, damage drawings and repair drawings are automatically created from the extracted damage. The 3D model data 101 and the inspection data 103 are mutually associated. For example, the inspection data 103 is stored in association with positions and components on the 3D model data 101. The inspection data 103 can be displayed by specifying position information on the 3D model data 101. In addition, the 3D model data 101 can be displayed by specifying the inspection data 103.

[0035] The inspection report data 105 is an example of a list of text data for multiple inspection locations related to the inspection work of a structure. The list of text data is data created by a user (e.g., an inspector) by inputting multiple pieces of text data into a template (a document file in a specified format) at predetermined positions. The template may be in a format specified by the Ministry of Land, Infrastructure, Transport and Tourism or a local government. The list of text data preferably includes text data such as findings written by the user (e.g., an inspector).

[0036] 1 includes a keyboard and a mouse, and a user can use these devices to cause the inspection support device 10 to perform necessary processing. By using a touch panel type device, the display device 30 can function as the operation unit.

[0037] The display device 30 is, for example, a device such as a liquid crystal display, and is capable of displaying the three-dimensional model data 101, the inspection data 103, and the inspection record data 105.

[0038] FIG. 4 is a flow diagram showing a structure inspection support method using the structure inspection support device.

[0039] First, the information acquisition unit 51 acquires the 3D model data 101 of the structure, the inspection data 103 mutually associated with the 3D model data 101, and a list of text data (information acquisition step: step S1). In this example, the list of text data is inspection report data 105.

[0040] Next, the list display unit 53 displays the acquired inspection record data 105 on the display device 30 (list display step: step S2). Next, the selection receiving unit 55 receives a selection of text data for at least one inspection location from the displayed inspection record data 105 (selection receiving step: step S3). Next, the information extraction unit 57 analyzes the selected text data and extracts a corresponding portion in the 3D model data 101 and / or inspection data 103 that corresponds to the text data for the inspection location (information extraction step: step S4). Next, the extracted information display unit 59 displays the extracted corresponding portion in the 3D model data 101 and / or the extracted inspection data 103 on the display device 30 (extracted information display step: step S5). Each step will be described below.

[0041] <Information acquisition steps> The information acquisition step (step S1) is executed by the information acquisition unit 51. The information acquisition unit 51 acquires the 3D model data 101, inspection data 103, and inspection record data 105 of the structure stored in the storage unit 16. Note that if the 3D model data 101, inspection data 103, and inspection record data 105 are not stored in the storage unit 16, the information acquisition unit 51 acquires the 3D model data 101, inspection data 103, and inspection record data 105 from outside. For example, the information acquisition unit 51 acquires the 3D model data 101, inspection data 103, and inspection record data 105 over a network via the input / output interface 12.

[0042] It should be noted that the camera parameters (focal length, image size of the image sensor, pixel pitch, etc.) required when applying the SfM (Structure from Motion) method can be those stored in the storage unit 16. Furthermore, since the SfM method cannot determine an absolute scale, it is possible to determine the absolute scale (three-dimensional position) by specifying, for example, a known size of a structure (distance between two points, etc.).

[0043] FIG. 5 is a diagram showing an example of three-dimensional model data 101. The three-dimensional model data 101 can be displayed as a point cloud, polygons (mesh), a solid model, or the like. The three-dimensional model data 101A in FIG. 5(A) is a diagram in which a large number of points on the surface of a structure are represented as a three-dimensional point cloud. The surface of the structure can be represented as a collection of polygonal polygons (e.g., triangular patches) based on this three-dimensional point cloud. Furthermore, the three-dimensional model data 101B in FIG. 5(B) is a diagram in which a photographed image (texture) of the structure is texture-mapped onto the polygonal polygon. The three-dimensional model data 101 is not particularly limited.

[0044] 5B, the three-dimensional model data 101B includes a member name and a member area. The three-dimensional model data 101B is configured, for example, of a floor slab 131, a wall 133, a leg 135, and a solid wall 137.

[0045] In the following description, the three-dimensional model data 101A and the three-dimensional model data 101B may be referred to as the three-dimensional model data 101 without distinction.

[0046] FIG. 6 is a diagram showing examples of multiple types of data included in the inspection data 103. The inspection data 103 includes a captured image group 103A made up of multiple captured images of multiple locations on a structure. An example of a captured image 103B constituting the captured image group 103A is a captured image containing damage. A damage detection result image 103C is created by detecting damage from the captured image 103B. A damage representation method according to the type of damage is applied to the damage detection result image 103C. Note that the damage detection result image 103C represents the peeling and exposed rebar detected in the captured image 103B as a drawing pattern using closed lines (polygons) that surround the area of ​​planar damage.

[0047] The inspection data 103 includes, for example, a damage diagram 103D. The damage diagram 103D lists, for example, for each piece of damage that has occurred in the deck of the bridge being inspected, the damage indication (crack indication, water leakage indication, free lime indication, etc.), the member name (e.g., "deck slab"), the element number, the type of damage (e.g., "crack," "water leakage," "free lime," etc.), and the evaluation category of the degree of damage (rank information).

[0048] 6 are examples, and are not limited to the images that are particularly displayed. The images are not limited to the images displayed in FIG. 6, and may be described as photographed image 103B, damage detection result image 103C, and damage diagram 103D.

[0049] FIG. 7 is a diagram showing an example of a template for inspection record data 105. The template inspection record data 105 shows a state in which no text data has been input. In the inspection record data 105, text data corresponding to material names (material names), symbols, component symbols, degree of damage, necessity of repairs, necessity of detailed investigations, causes, findings, etc. are input. The text data may be input automatically based on the inspection data damage information, etc., or may be input based on user operation. Column G1 is mainly input with text data of component information, column G2 is mainly input with text data of damage information (type, degree, etc.), and column G3 is mainly input with text data of information on the location of damage and findings on the damage status (size, progression, etc.).

[0050] <List display step and selection reception step> The list display step (step S2) is executed by the list display unit 53, and the selection receiving step (step S3) is executed by the selection receiving unit 55.

[0051] FIG. 8 is a diagram for explaining the list display step and the selection receiving step.

[0052] Fig. 8(A) is a diagram showing inspection record data 105 displayed on display device 30. Text data is input into inspection record data 105, and inspection record data 105 constitutes a list of text data. Note that inspection record data 105 in Fig. 8(A) is an example of a list of text data, and the format is not particularly limited.

[0053] FIG. 8(B) is a diagram illustrating a case where the selection of text data of at least one inspection location is accepted from the inspection record data 105. The user manually selects a line that the user has determined to require confirmation in the inspection record data 105 via the operation unit 18. This operation selects the text data of the inspection location. In FIG. 8(B), the text data of the selected inspection location is surrounded by a black frame 110. The selection accepting unit 55 accepts the selected text data. Although not shown in FIG. 8(B), in the selection accepting step (step S3), the selection accepting unit 55 can accept the selection of text data of multiple inspection locations.

[0054] <Information extraction step> Next, an information extraction step (step S4) is executed by the information extraction unit 57. Fig. 9 is a diagram for explaining an example of the information extraction step.

[0055] The information extraction unit 57 (see FIG. 2) analyzes the text data received by the selection receiving unit 55 (see FIG. 2). The information extraction unit 57 determines whether the text data is component information, damage information, damage location, or the like, based on the text data of the inspection record data 105 and the input columns G1 to G3.

[0056] 9, the information extraction unit 57 identifies components, positions, and damage from the text data. Based on the information on the components, positions, and damage, the information extraction unit 57 extracts corresponding portions in the 3D model data 101 and / or inspection data 103 that correspond to the text data.

[0057] The information extraction unit 57 extracts damage diagrams (units of components such as deck slabs, piers, etc.) which are 2D drawings, panoramic composite images (units of components such as deck slabs, piers, etc.), damage information (type, degree, size, etc. of damage), photographed images, etc. contained in the inspection data 103.

[0058] The information extraction unit 57 can extract information not only based on text data but also in response to a user operation.

[0059] In FIG. 9, the information extraction unit 57 directly extracts the corresponding portion on the three-dimensional model data 101 and / or the inspection data 103.

[0060] FIG. 10 is a diagram illustrating another example of the information extraction step. The information extraction unit 57 (see FIG. 2) analyzes the text data received by the selection receiving unit 55 (see FIG. 2). The information extraction unit 57 determines whether the text data is component information, damage information, or the location of damage, based on the text data of the inspection record data 105 and the input columns G1 to G3. For example, named entity recognition (NER) can be used as a method for analyzing text data. Named entity recognition is a technology for recognizing nouns, adjectives, verbs, and the like that appear in text data. For example, named entities in inspection record data are nouns, adjectives, verbs, and the like that represent the type of component, the type of damage, the location of the damage, the progression of the damage, and the like. Rule-based recognition using a dictionary of named entities may be used, or recognition may be performed by artificial intelligence (AI) that has learned the text data of the inspection record data. However, the method for analyzing text data is not limited to the above method.

[0061] 10 , the information extraction unit 57 identifies components, positions, and damage from the text data. Based on the information on the components, positions, and damage, the information extraction unit 57 extracts corresponding portions in the 3D model data 101 that correspond to this text data. The information extraction unit 57 extracts inspection data 103 associated with the extracted corresponding portions in the 3D model data 101. The information extraction unit 57 can extract the inspection data 103 based on the extracted 3D position information in the 3D model data 101.

[0062] In another example of the information extraction step, the inspection data 103 is extracted via the three-dimensional model data 101. Even if the information extraction unit 57 cannot directly extract the inspection data 103, it can indirectly extract the inspection data 103 via the three-dimensional model data 101. Note that, when text data of a plurality of inspection locations is selected and accepted in the selection acceptance step (step S3), in the information extraction step, the information extraction unit 57 can extract corresponding portions on the three-dimensional model data 101 and / or the inspection data 103 that correspond to the plurality of text data.

[0063] <Extracted information display step> The extracted information display step (step S5) is executed by the extracted information display unit 59. The extracted information display unit 59 displays the information extracted by the information extraction unit 57 on the display device 30. FIG. 11 is a diagram showing an example of a display displayed on the display device 30 by the extracted information display unit 59 (see FIG. 2). As shown in FIG. 11, three-dimensional model data 101, a corresponding portion 102 on the three-dimensional model data 101, and inspection data 103 are simultaneously displayed on the display device 30. In FIG. 11, the three-dimensional model data 101 is an overall bird's-eye view, the corresponding portion 102 is an enlarged view of a component, and the inspection data 103 is a photographed image of a location of interest. Damage is captured in the photographed image.

[0064] 12A and 12B are diagrams showing other examples of the display displayed on the display device 30 by the extracted information display unit 59 (see FIG. 2). As shown in FIG. 12A, only the three-dimensional model data 101 is displayed on the display device 30. As shown in FIG. 12B, only the corresponding portion 102 on the three-dimensional model data 101 is displayed on the display device 30. As shown in FIG. 12C, only the inspection data 103 is displayed on the display device 30.

[0065] As shown in Fig. 12, the display on the display device 30 can gradually shift and enlarge from a display of 3D model data 101 (Fig. 12(A)) showing an overall bird's-eye view, to a display of corresponding portion 102 (Fig. 12(B)) showing an enlarged view of a component, to a display of inspection data 103 (Fig. 12(C)) which is a photographed image of a target location. Also, the display on the display device 30 can gradually shift and shrink from a display of inspection data 103 (Fig. 12(C)) to a display of corresponding portion 102 (Fig. 12(B)) to a display of 3D model data 101 (Fig. 12(A)).

[0066] The extracted information display unit 59 displays on the display device 30 at least one type of data from among the multiple types of data included in the inspection data 103 (photographed images, panoramic composite images, damage information, two-dimensional drawings, etc.).

[0067] Next, a first alternative embodiment of the selection receiving step, information extracting step, and extracted information displaying step will be described with reference to FIG.

[0068] As shown in Fig. 13, inspection record data 105 is displayed on the display device 30. The user manually selects a square (cell) that is determined to require confirmation on the inspection record data 105 via the operation unit 18. In Fig. 13, the square surrounded by a black frame 110 contains text data of findings in the inspection record data 105. The selection receiving unit 55 receives the selected text data (selection receiving step).

[0069] The information extraction unit 57 (see FIG. 2) analyzes the text data received by the selection receiving unit 55 (see FIG. 2).

[0070] The information extraction unit 57 extracts inspection data 103 corresponding to the text data. as Images and drawings corresponding to the photographed image 103B, the damage detection result image 103C, and the damage diagram 103D are individually extracted (information extraction step).

[0071] The extracted information display unit 59 displays the images and drawings of the inspection data 103 extracted by the information extracting unit 57 individually on the display device 30 (see FIG. 1) (extracted information display step).

[0072] Furthermore, the extracted information display unit 59 can display three-dimensional model data 120 in which the photographed image 103B is mapped as the inspection data 103. The extracted information display unit 59 can also display three-dimensional model data 122 in which the photographed image 103B and the damage detection result image 103C are mapped as the inspection data 103 (extracted information display step).

[0073] A second alternative embodiment of the selection receiving step, information extraction step, and extracted information display step will be described with reference to Fig. 14. As in the first alternative embodiment, the selection receiving unit 55 receives text data of the selected square (the portion surrounded by the black frame 110) (selection receiving step).

[0074] The information extraction unit 57 extracts inspection data 103 corresponding to the text data. as Images and drawings corresponding to the photographed image 103B, the damage detection result image 103C, and the damage diagram 103D are individually extracted (information extraction step). Furthermore, the information extraction unit 57 analyzes the text data, and if it determines that the text data contains text data related to the progression of damage, it can extract past inspection data 203 corresponding to the inspection data 103 (information extraction step). The past inspection data 203 includes a group of past photographed images 203A, a past photographed image 203B, a past damage detection result image 203C, and a past damage diagram 203D. The past inspection data 203 can be stored in the memory unit 16 or an external memory unit. Note that examples of text data related to the progression of damage include expressions such as "almost no progression observed," "progression is slow," and "progression is rapid."

[0075] The extracted information display unit 59 displays the inspection data 103 extracted by the information extraction unit 57. andThe images and drawings of the past inspection data 203 are individually displayed on the display device 30 (see FIG. 1) (extracted information display step). By displaying the inspection data 103 and the past inspection data 203 on the display device 30 (see FIG. 1), the user can easily understand the progress of the damage.

[0076] A third alternative example of the selection receiving step, information extraction step, and extracted information display step will be described with reference to Fig. 15. As in the first alternative example, the selection receiving unit 55 receives text data of the selected square (selection receiving step).

[0077] The information extraction unit 57 identifies a corresponding portion in the three-dimensional model data 101 that corresponds to the text data. Based on the position information of the corresponding portion in the three-dimensional model data 101, a plurality of captured images 103B (see FIG. 6) are extracted from the captured image group 103A of the inspection data 103 (see FIG. 6) (information extraction step).

[0078] Each captured image 103B in the captured image group 103A has an overlapping area where they overlap each other. Therefore, the captured image group 103A includes a plurality of captured images 103B whose position information on the three-dimensional model data 101 corresponds to each other.

[0079] The extracted information display unit 59 displays the mapped 3D model data 120 that satisfies the conditions from the 3D model data 120 in which the photographed images 103B are mapped as the inspection data 103 to be displayed (extracted information display step). In this example, the mapped 3D model data 120 that satisfies the conditions is displayed. In this case, too, the photographed images 103B that satisfy the conditions are displayed from the multiple photographed images 103B.

[0080] Here, the conditions may be determined arbitrarily by the user or automatically. For example, the conditions may be "the facing degree of the photographed image 103B" or "the distance of the photographed image 103B from the structure," and the extracted information display unit 59 can display the photographed image 103B that satisfies this condition from among the multiple photographed images 103B.

[0081] As another condition, in the case of a captured image 103B that includes damage, the conditions "good image quality" or "damage is at the center of the captured image 103B" can be applied, and the extracted information display unit 59 can display the captured image 103B that meets this condition from multiple captured images 103B.

[0082] The extracted information display unit 59 can display at least one of the optimum photographed image 103B that satisfies the conditions and the damage detection result image 103C for the optimum photographed image 103B.

[0083] As described above, the user can easily check the corresponding portions 102 of the 3D model data 101, the inspection data 103, and the mapped 3D model data 120, 122 from the text data included in the inspection report data 105, which is a list of text data. Note that if corresponding portions in the 3D model data 101 and / or the inspection data 103 corresponding to a plurality of pieces of text data are extracted in the information extraction step, the extracted information display unit 59 can also display the plurality of pieces of inspection data 103 and the corresponding portions 102 of the 3D model data 101 corresponding to each of the text data of a plurality of inspection locations in the extracted information display step (step S5).

[0084] <Other> In the above description, the information acquisition unit 51 acquires information stored in the storage unit 16, but the present invention is not limited to this. For example, if the necessary information is not stored in the storage unit 16, the information acquisition unit 51 may acquire information from outside via the input / output interface 12. Specifically, the information acquisition unit 51 acquires information input from outside the structure inspection support device 10 via the input / output interface 12.

[0085] In the above embodiment, the hardware structure of the processing unit that executes various processes is the following various processors: The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) and functions as various processing units, a programmable logic device (PLD), such as an FPGA (Field Programmable Gate Array), whose circuit configuration can be changed after manufacture, and a dedicated electrical circuit, such as an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing specific processes.

[0086] A single processing unit may be configured with one of these various processors, or may be configured with two or more processors of the same or different types (for example, multiple FPGAs, or a combination of a CPU and an FPGA). Furthermore, multiple processing units can be configured with a single processor. Examples of multiple processing units configured with a single processor include, first, a configuration in which one processor is configured with a combination of one or more CPUs and software, as typified by client or server computers, and this processor functions as multiple processing units. Second, a configuration in which a processor is used to realize the functions of an entire system including multiple processing units on a single IC (Integrated Circuit) chip, as typified by a System on Chip (SoC). In this way, the various processing units are configured with one or more of the above-mentioned various processors as a hardware structure.

[0087] Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit made up of a combination of circuit elements such as semiconductor elements.

[0088] The above-described configurations and functions can be realized by any hardware, software, or a combination of both. For example, the present invention can be applied to a program that causes a computer to execute the above-described processing steps (processing procedures), a computer-readable recording medium (non-transitory recording medium) on which such a program is recorded, or a computer on which such a program can be installed.

[0089] Although examples of the present invention have been described above, it goes without saying that the present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the present invention. [Explanation of symbols]

[0090] 10 Inspection support device 12 Input / Output Interface 16 Memory section 18 Control section 20 CPU 22 RAM 24 ROM 26 Display control unit 30 Display device 51 Information Acquisition Department 53 List display section 55 Selection Reception Section 57 Information extraction part 59 Extracted information display section 101 3D model data 101A 3D model data 101B 3D model data 102 Corresponding part 103 Inspection Data 103A Image Group 103B Image 103C Damage detection result image 103D Damage diagram 105 Inspection report data 110 Black Frame 120 3D model data 122 3D model data 131 Floor slab 133 Wall 135 Legs 137 Hard wall 203 Inspection Data 203A Image Group 203B Photograph 203C Damage detection result image 203D Damage diagram

Claims

1. A structure inspection support device including a processor, The processor: Acquire three-dimensional model data of the structure, inspection data mutually associated with the three-dimensional model data, and inspection report data created in a predetermined format by inputting text data of predetermined information for each inspection location; Displaying the inspection record data on a display device, Accepting a selection of the text data of at least one of the inspection locations from the displayed inspection record data; analyzing the text data of the selected inspection location to identify the component, location, and damage of the inspection location; extracting a corresponding portion of the three-dimensional model data that corresponds to the text data of the selected inspection location based on information on the component, position, and damage of the identified inspection location; extracting the inspection data associated with the corresponding portion on the extracted three-dimensional model data; displaying the extracted corresponding portion on the three-dimensional model data and / or the extracted inspection data on the display device; A structural inspection support device.

2. The inspection report data is created by inputting text data on component information, damage information, information on the location of the damage, and findings on the state of the damage for each inspection location. The structure inspection support device according to claim 1.

3. The processor: analyzing the text data of the selected inspection location, extracting a corresponding portion on the three-dimensional model data corresponding to the inspection location, and extracting the inspection data associated with the extracted corresponding portion on the three-dimensional model data; The structure inspection support device according to claim 1 or 2.

4. a memory that stores the three-dimensional model data, the inspection data that is mutually associated with the three-dimensional model data, and the inspection record data; the processor acquires the three-dimensional model data, the inspection data, and the inspection paper data from the memory; The structure inspection support device according to any one of claims 1 to 3.

5. The processor: The extracted inspection data is mapped onto the three-dimensional model data and displayed on the display device. The structure inspection support device according to any one of claims 1 to 4.

6. The three-dimensional model data includes at least data of a component region and a component. The structure inspection support device according to any one of claims 1 to 5.

7. The inspection data includes multiple types of data. The structure inspection support device according to any one of claims 1 to 6.

8. The multiple types of data include photographed images, panoramic composite images, damage information, and two-dimensional drawings. The structure inspection support device according to claim 7.

9. The processor: displaying at least one type of data from the plurality of types of data included in the inspection data on the display device; The structure inspection support device according to claim 7 or 8.

10. The inspection data includes a plurality of captured images, The processor: displaying, on a display device, the captured image that satisfies a condition from among the plurality of captured images to be displayed; The structure inspection support device according to claim 8.

11. The processor: Analyzing the text data of the selected inspection location and extracting past inspection data corresponding to the inspection location; The extracted past inspection data is displayed on the display device. The structure inspection support device according to any one of claims 1 to 10.

12. A structure inspection support device including a processor, The processor: acquiring inspection data that includes three-dimensional model data of the structure, a photographed image of the structure, or a damage detection result image in which the photographed image and damage detected from the photographed image are displayed in a manner appropriate for the type of damage, and that is mutually associated with the three-dimensional model data, and a list of text data of a plurality of inspection points related to inspection work of the structure; displaying a list of the text data on a display device; Accepting a selection of at least one piece of text data for an inspection location from the displayed list of text data; Analyzing the selected text data and extracting the inspection data corresponding to the text data of the inspection location; displaying, on the display device, the three-dimensional model data in which the photographed image is mapped as the extracted inspection data or the three-dimensional model data in which the photographed image and the damage detection result image are mapped. A structural inspection support device.

13. A structure inspection support device including a processor, The processor: acquiring a list of three-dimensional model data of the structure, inspection data mutually associated with the three-dimensional model data, and text data of a plurality of inspection points related to inspection work of the structure; displaying a list of the text data on a display device; Accepting a selection of the text data of at least one inspection location from the displayed list of text data; Analyzing the selected text data and extracting the inspection data corresponding to the text data of the inspection location; Displaying the extracted inspection data on the display device; analyzing the selected text data to determine whether it includes text data related to injury progression; If it is determined that the text data includes text data related to the progression of damage, extract past inspection data corresponding to the inspection location; The extracted past inspection data is displayed on the display device. A structural inspection support device.

14. A method for supporting inspection of a structure using a structure inspection support device including a processor, comprising: The processor: Acquire three-dimensional model data of the structure, inspection data mutually associated with the three-dimensional model data, and inspection report data created in a predetermined format by inputting text data of predetermined information for each inspection location; Displaying the inspection record data on a display device, Accepting a selection of the text data of at least one of the inspection locations from the displayed inspection record data; analyzing the text data of the selected inspection location to identify the component, location, and damage of the inspection location; extracting a corresponding portion of the three-dimensional model data that corresponds to the text data of the selected inspection location based on information on the component, position, and damage of the identified inspection location; extracting the inspection data associated with the corresponding portion on the extracted three-dimensional model data; displaying the extracted corresponding portion on the three-dimensional model data and / or the extracted inspection data on the display device; A method for supporting inspection of structures.

15. A program for causing a structure inspection support device having a processor to execute a structure inspection support method, The processor: Acquire three-dimensional model data of the structure, inspection data mutually associated with the three-dimensional model data, and inspection report data created in a predetermined format by inputting text data of predetermined information for each inspection location; Displaying the inspection record data on a display device, Accepting a selection of the text data of at least one of the inspection locations from the displayed inspection record data; analyzing the text data of the selected inspection location to identify the component, location, and damage of the inspection location; extracting a corresponding portion of the three-dimensional model data that corresponds to the text data of the selected inspection location based on information on the component, position, and damage of the identified inspection location; extracting the inspection data associated with the corresponding portion on the extracted three-dimensional model data; displaying the extracted corresponding portion on the three-dimensional model data and / or the extracted inspection data on the display device; program.

Images