Inspection support device, inspection support method, and program

Abstract

Provided are an inspection assistance device, an inspection assistance method, and a program with which it is possible to mitigate the complexity of creating a damage drawing. An inspection assistance device comprising a processor that assists in creating a damage drawing of a structure, wherein the processor acquires image data of information that includes a structural drawing of a structure in a medium and damage information relating to damage added to the medium by a user, recognizes the damage information from the acquired image data through image recognition, acquires drawing data that corresponds to the structural drawing, aligns the structural drawing in the image data and the drawing data, and draws the damage information as a damage diagram at a corresponding position in the drawing data to create a damage drawing.

Description

Technical Field

[0006] , ,

[0005] ,

[0001] The present invention relates to an inspection support device for a structure, an inspection support method, and a program.

Background Art

[0002] As social infrastructure, there are structures such as bridges and tunnels. These structures are damaged and the damage has the property of progressing, so it is required to perform inspections regularly. An inspector who inspects a structure creates an inspection report in a predetermined format as a form showing the results of the inspection.

[0003] Patent Document 1 discloses that marks, lead lines, and desired character information are handwritten on a printed form of a steel structure, and the form is converted into image data by a scanner to obtain electronic data in which the marks of the steel structure are linked to the state, degree, and treatment of that part.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] By the way, when creating a damage diagram that illustrates the damage state of a structure, which is one of the inspection reports, for example, a printed matter (so-called field drawing) including a structural diagram of the target structure is prepared based on a design drawing or CAD data. At the inspection site of the structure, changes such as cracks are handwritten on the printed matter of the drawing, and after the inspection, it is necessary to create a damage diagram (CAD drawing) while looking at the field drawing with the changes and the photographed image added at the office, so the work is complicated.

[0006] This invention has been made in view of these circumstances, and its purpose is to provide an inspection support device, an inspection support method, and a program that can reduce the complexity of creating damage diagrams. [Means for solving the problem]

[0007] In an inspection support device equipped with a processor that assists in creating a structural damage diagram of a structure according to the first embodiment, the processor acquires image data of a structural diagram of the target structure on a medium and information including damage information about damage added by the user on the medium, recognizes the damage information from the acquired image data by image recognition, acquires drawing data corresponding to the structural diagram, aligns the structural diagram and drawing data in the image data, and creates a damage diagram by drawing the damage information as a damage figure at the corresponding position in the drawing data.

[0008] In the second embodiment, the processor associates the damaged shape with the string.

[0009] In a third embodiment, the processor accepts and allows editing of the created damage diagram.

[0010] In the fourth embodiment, the processor draws the damaged shape as a vector.

[0011] In the fifth embodiment, the processor recognizes damage information from image data by image recognition using at least one of a machine learning model or an image recognition algorithm.

[0012] In the sixth embodiment, the processor calculates the actual dimensions of the damage from the damaged shape and the dimensional information contained in the drawing data.

[0013] In the seventh embodiment, the processor recognizes additional attribute information contained in the image data by character recognition.

[0014] In the eighth embodiment, the processor associates damage information and additional attribute information based on predetermined conditions.

[0015] In the ninth embodiment, the information includes auxiliary information that identifies additional attribute information, and the processor identifies the location of the additional attribute information based on the auxiliary information.

[0016] In the tenth embodiment, the information includes image identification information of a captured image of the target structure, the processor obtains the captured image from the image identification information, and obtains supplementary information to supplement damage information from the captured image.

[0017] In the eleventh embodiment, the medium includes past damage information of the target structure, and the processor draws the difference between the current damage information and the past damage information as a damage figure based on the current damage information and the past damage information.

[0018] In an inspection support method that assists in the creation of a structural damage diagram using a processor of the 12th embodiment, the processor performs the following steps: acquiring image data of a structural diagram of the target structure on a medium and information including damage information added by the user on the medium; recognizing damage information from the acquired image data; acquiring drawing data corresponding to the structural diagram; aligning the structural diagram and drawing data in the image data; and creating a damage diagram by drawing the damage information as damage figures at the corresponding positions in the drawing data.

[0019] In a program that causes a processor of the 13th embodiment to execute an inspection support method that assists in the creation of a structural damage diagram, the processor is made to execute the following steps: acquire image data of a structural diagram of a target structure on a medium and information including damage information added by the user on the medium; recognize damage information from the acquired image data; acquire drawing data corresponding to the structural diagram; align the structural diagram and drawing data in the image data; and create a damage diagram by drawing the damage information as damage figures at the corresponding positions in the drawing data. [Effects of the Invention]

[0020] According to the inspection support device, inspection support method, and program of the present invention, the complexity of creating a damage diagram can be reduced.

Brief Description of Drawings

[0021] [Figure 1] Figure 1 is a block diagram showing an example of the hardware configuration of an inspection support device for a structure. [Figure 2] Figure 2 is a block diagram showing the processing functions realized by a CPU. [Figure 3] Figure 3 is a diagram showing information and the like stored in a storage unit. [Figure 4] Figure 4 is a flowchart showing an inspection support method using the inspection support device of the embodiment. [Figure 5] Figure 5 is an explanatory diagram of the process of printing a structure diagram on a paper medium using an inspection support device. [Figure 6] Figure 6 is a diagram for explaining the work of a user inspecting a bridge at an inspection site. [Figure 7] Figure 7 is a diagram showing an example of an entry example of an inspection memo. [Figure 8] Figure 8 is a diagram showing an entry example of an inspection memo. [Figure 9] Figure 9 is a diagram showing an entry example of an inspection memo. [Figure 10] Figure 10 is a diagram showing an entry example of an inspection memo. [Figure 11] Figure 11 is an explanatory diagram showing the relationship between damage types of area-based damage and sketch patterns. [Figure 12] Figure 12 is a diagram showing an entry example of an inspection memo. [Figure 13] Figure 13 is a diagram for explaining the process of acquiring image data of an inspection memo. [Figure 14] Figure 14 is a diagram for explaining the process of acquiring complementary information from a photographed image. [Figure 15] Figure 15 is a diagram for explaining the process of acquiring drawing data. [Figure 16] Figure 16 is a diagram for explaining the process of aligning a structure diagram and drawing data. [Figure 17] Figure 17 illustrates the process of creating a damage diagram from image data. [Figure 18] Figure 18 illustrates the process of flagging a damaged area. [Figure 19] Figure 19 is a diagram illustrating the editing process using damage diagrams and damage lists. [Figure 20] Figure 20 illustrates the process of using past damage information and current damage information to draw the difference as a damage shape. [Modes for carrying out the invention]

[0022] Preferred embodiments of the structural inspection support device, structural inspection support method, and program according to the present invention will be described below with reference to the attached drawings. Here, "structure" includes buildings, such as civil engineering structures like bridges, tunnels, and dams, and also includes buildings such as office buildings, houses, and building walls, columns, and beams.

[0023] [Hardware configuration of structural inspection support equipment] Figure 1 is a block diagram showing an example of the hardware configuration of a structural inspection support device according to the present invention.

[0024] As shown in Figure 1, a computer or workstation can be used as the structural inspection support device 10. In this example, the structural inspection support device 10 mainly consists of an input / output interface 12, a storage unit 16, an operation unit 18, a CPU (Central Processing Unit) 20, a RAM (Random Access Memory) 22, a ROM (Read Only Memory) 24, and a display control unit 26. A display device 30, which constitutes a display, is connected to the structural inspection support device 10, and under the command of the CPU 20, the display control unit 26 controls the display device 30. The display device 30 is, for example, a monitor.

[0025] The input / output interface 12 can input various data (information) to the structural inspection support device 10. For example, data stored in the storage unit 16 is input via the input / output interface 12.

[0026] The CPU (processor) 20 reads various programs, including the structural inspection support program of the embodiment, stored in the memory unit 16 or ROM 24, and loads them into the RAM 22 to perform calculations, thereby providing overall control of each unit. The CPU 20 also reads programs stored in the memory unit 16 or ROM 24, uses the RAM 22 to perform calculations, and performs various processes for the structural inspection support device 10.

[0027] Figure 2 is a block diagram showing the processing functions implemented by CPU 20.

[0028] The CPU 20 includes an image data acquisition unit 51, a damage information recognition unit 53, a drawing data acquisition unit 55, a positioning unit 57, and a damage drawing creation unit 59, etc. The specific processing functions of each unit will be explained later. The image data acquisition unit 51, the damage information recognition unit 53, the drawing data acquisition unit 55, the positioning unit 57, and the damage drawing creation unit 59 are all parts of the CPU 20, and the CPU 20 executes the processing of each unit.

[0029] Returning to Figure 1, the memory unit 16 is a memory composed of a hard disk drive, flash memory, etc. The memory unit 16 stores data and programs that operate the structural inspection support device 10, such as the operating system and programs that execute the structural inspection support method. The memory unit 16 also stores information used in this embodiment, which will be described below.

[0030] Figure 3 shows the information stored in the storage unit 16. The storage unit 16 consists of a non-temporary recording medium such as a CD (Compact Disk), DVD (Digital Versatile Disk), hard disk (Hard Disk), and various semiconductor memories, and its control unit.

[0031] The memory unit 16 primarily stores drawing data 101 of the target structure, photographic images 103 of the target structure, and past damage information 105 of the target structure.

[0032] The drawing data 101 of the target structure is data (drawing, CAD data) that includes the shape, dimensions, and members of the target structure at the time of design. The drawing data 101 is stored in association with drawing data identification information (e.g., file name) that can identify the drawing data 101.

[0033] The captured image 103 of the target structure is data of an image of the target structure taken at the inspection site in its current state. The captured image 103 is stored in association with image identification information (e.g., file name) that can identify the captured image 103.

[0034] Past damage information 105 is data containing damage information created during the previous inspection (for example, data in the format of a damage diagram). Past damage information 105 is associated with past images taken during the previous inspection. Past damage information 105 is stored in association with past damage information identification information (for example, a file name). Here, the damage diagram may be in a format specified by the Ministry of Land, Infrastructure, Transport and Tourism or a local government.

[0035] Returning to Figure 1, the control unit 18 includes a keyboard and mouse, allowing the user to perform necessary operations on the inspection support device 10 via these devices. By using a touch panel type device, the display device 30 also functions as a control unit.

[0036] The display device 30 is, for example, a device such as a liquid crystal display, and can display various types of information.

[0037] Next, we will explain the flowchart illustrating the inspection support method using the inspection support device 10. Figure 4 is a flowchart illustrating the inspection support method using the inspection support device 10.

[0038] As shown in Figure 4, the inspection support method includes the steps of acquiring a structural drawing and image data including damage information (step S1), recognizing damage information from the image data (step S2), acquiring drawing data (step S3), aligning the structural drawing and the drawing data (step S4), and creating a damage drawing by drawing damage shapes on the drawing data (step S5).

[0039] First, we will explain the inspection process conducted by users at the inspection site, and then we will explain the media containing information including structural diagrams and damage information, which form the basis of the image data.

[0040] Before conducting an inspection at the inspection site, the user prepares a medium containing damage diagrams of the object to be inspected. As shown in Figure 5, user U inputs an operation command to the inspection support device 10 by operating the operation unit 18. Here, user U inputs conditions for identifying the target structure from the operation unit 18 and extracts the drawing data 101 of the object to be inspected from the storage unit 16 (see Figure 3). The drawing data 101 of the object to be inspected is displayed on the display device 30. User U confirms whether the displayed drawing data 101 corresponds to the target structure. If the drawing data 101 corresponds to the target structure, user U inputs an output command from the operation unit 18. The printing device 32 prints the drawing data 101 as a structural diagram 42 of the target structure onto paper medium 41. This creates a field notebook 40 with the structural diagram 42 printed on paper medium 41. The field notebook 40 contains the bridge name and member names.

[0041] Figure 6 is a diagram illustrating how user U inspects a bridge at an inspection site. A bridge, which is an example of a structure 70 to which the present invention applies, has a bridge 71 comprising a main girder 72, a transverse girder 73, a bracing member 74, and a transverse bracing member 75. A concrete deck slab 76 is provided on top of the main girder 72. The main girder 72 is a member that spans between abutments or piers and supports the load on the deck slab 76. The transverse girder 73 is a member that connects the main girders 72 in order to support the load with multiple main girders 72. The bracing member 74 and the transverse bracing member 75 are members that connect the main girders 72 in order to resist lateral loads in particular.

[0042] As shown in 0600A, at the inspection site, user U, holding a field notebook 40 and a pen 43, visually inspects the bridge, which is the structure to be inspected, to understand its external condition (external characteristics). User U adds damage information 60 (see Figures 7 to 12) regarding the damage 77 to the structure 70 obtained from the visual inspection to the paper medium 41 of the field notebook 40 by hand with the pen 43. The paper medium 41 has a structural diagram 42 printed on it. User U photographs the damage 77 with a digital camera 45 and obtains a captured image 103 (not shown) as objective data. To indicate the positional relationship of the multiple captured images 103 relative to the structure 70, user U adds image identification information (file name) corresponding to the captured image 103 to the paper medium 41 of the field notebook 40 by hand (see Figures 7 to 12).

[0043] In 0600B, user U, instead of using a paper field notebook 40 and pen 43, uses an electronic field notebook 40A and electronic pen 47 on a tablet or other electronic medium 46 to visually assess the condition of the bridge, which is the structure to be inspected, through external inspection. User U adds damage information 60 regarding the damage 77 to the structure 70 obtained through external visual inspection to the electronic medium 46 of the field notebook 40A using the electronic pen 47. In addition, user U photographs the damage 77 with a digital camera 45 and obtains a captured image 103 (not shown) as objective data. To indicate the positional relationship of the multiple captured images 103 relative to the structure 70, user U adds image identification information (file name) corresponding to the captured image 103 to the electronic medium 46 of the field notebook 40A by hand.

[0044] Figure 7 shows an example of a printed paper document 41 (field notebook 40) of the structural diagram 42 of the deck slab A, to which information including damage information 60 has been added by hand, a so-called inspection memo 48. Note that Figure 7 includes multiple entry formats.

[0045] As shown in Figure 7, damage information 60 is added by the user to the paper medium 41 on which the structural diagram 42 of the floor slab A is printed. On the paper medium 41 of the field notebook 40, if necessary, image identification information 61 taken when the damage 77 was photographed is added along with the damage information 60. Furthermore, association information 62 and 63 indicating the relationship between the image identification information 61 and the damage information 60, auxiliary information 64 (see Figure 9), additional attribute information 65, etc. are also included. Handwritten damage information 60 and image identification information 61 are added to the field notebook 40 to create an inspection memo 48.

[0046] Figures 8 to 12 show individual examples of entries in inspection memos.

[0047] Figure 8 shows that 0800A is the first example and 0800B is the second example.

[0048] The first example of 0800A is shown in an inspection memo 48 that includes user-added damage information 60 and captured image identification information 61 regarding damage 77 (see Figure 6) to structure 70. Damage information 60 illustrates damage such as cracks, water leakage, and free lime using lines, line types, or areas. Damage information 60 includes damage information 60A, 60B, 60C, 60D, 60E, and 60F. Damage information 60A, 60B, 60C, 60D, and 60E show the state of damage 77 related to cracks using lines. Damage information 60A is drawn with an orange line and indicates cracks with a width of 0.2 mm or more and less than 0.3 mm. Damage information 60B, 60D, and 60E are drawn with blue lines and indicate cracks with a width of less than 0.2 mm. Damage information 60C is drawn with a red line and indicates cracks with a width of 0.3 mm or more. Damage information 60F shows regional damage 77 as a closed curve with a black dotted line. Regional damage includes, for example, spalling, exposed rebar, free lime, water leakage and delamination, and other damages not belonging to these categories.

[0049] The captured image identification information 61 is the file name or part of the file name (hereinafter referred to as "file name") of the captured image 103 that captured the damage 77, and is composed of characters such as numbers, letters or symbols, or combinations thereof. The captured image identification information 61 includes captured image identification information 61A, 61B, 61C, 61D, 61E, and 61F. For example, captured image identification information 61A contains the string "1510" and represents part of the file name "DSCF1510.jpg". Similarly, captured image identification information 61B, 61C, 61D, 61E, and 61F contain "1511", "1512", "1513", "1514", and "1515", respectively. The length of the file name included in the captured image identification information 61 can be freely determined as long as it is possible to identify captured image identification information 61A, 61B, 61C, 61D, 61E, and 61F. If the captured image identification information 61 includes a file name, the captured image 103 is extracted from the storage unit 16 based on the captured image identification information 61.

[0050] Furthermore, the captured image identification information 61 may include the shooting order instead of the file name. The captured image identification information 61A and 61B may include, for example, "1001" and "1002," respectively. The shooting order is composed of numbers, letters, and combinations thereof, and is preferably composed according to some rule so that the order can be identified. In addition, the shooting order "1001" is associated with the file name "1510." Therefore, the file name is identified from the shooting order included in the captured image identification information 61, and the captured image 103 is extracted from the storage unit 16 based on that file name.

[0051] The second example of 0800B, like the first example of 0800A, includes damage information 60 and captured image identification information 61. On the other hand, the second example of 0800B further includes association information 62 that associates the damage information 60 and the captured image identification information 61.

[0052] Association information 62 is a diagram connecting the corresponding damage information 60 and the captured image identification information 61. Association information 62 includes association information 62A, association information 62B, association information 62C, association information 62D, association information 62E, and association information 62F. For example, association information 62A associates damage information 60A with captured image identification information 61A. Association information 62A consists of a straight line located below the captured image identification information 61A and a straight line extending diagonally downward from the right end of this line to reach the damage information 60A. Similarly, association information 62B associates damage information 60B with captured image identification information 61B, association information 62C associates damage information 60C with captured image identification information 61C, association information 62D associates damage information 60D with captured image identification information 61D, association information 62E associates damage information 60E with captured image identification information 61E, and association information 62F associates damage information 60F with captured image identification information 61F. Note that the shape and type of the line are not limited as long as association information 62 can associate damage information 60 with captured image identification information 61.

[0053] Figure 9 shows that 0900A is the third example and 0900B is the fourth example.

[0054] The third example of 0900A includes damage information 60 and captured image identification information 61, similar to the second example of 0800B. On the other hand, it includes association information 63 that is different from the association information 62 of the second example of 0800B. The association information 63 of the third example is a closed diagram that encloses the corresponding damage information 60 and captured image identification information 61. The association information 63 does not need to enclose all of the damage information 60 and captured image identification information 61; it is sufficient that it includes the damage information 60 and captured image identification information 61 that correspond to the association information 63.

[0055] Association information 63A associates damage information 60A with captured image identification information 61A. Similarly, association information 63B associates damage information 60B with captured image identification information 61B, association information 63C associates damage information 60C with captured image identification information 61C, association information 63D associates damage information 60D with captured image identification information 61D, association information 63E associates damage information 60E with captured image identification information 61E, and association information 63F associates damage information 60F with captured image identification information 61F. Note that the shape and type of the line are not limited as long as association information 63 can associate damage information 60 with captured image identification information 61.

[0056] The fourth example of 0900B, like the second example of 0800B, includes damage information 60, captured image identification information 61, and association information 62. On the other hand, the fourth example of 0900B further includes auxiliary information 64 for identifying the location of the captured image identification information 61. The auxiliary information 64 surrounds the captured image identification information 61 with a predetermined line. Auxiliary information 64A surrounds the captured image identification information 61A. Similarly, auxiliary information 64B surrounds the captured image identification information 61B, auxiliary information 64C surrounds the captured image identification information 61C, auxiliary information 64D surrounds the captured image identification information 61D, auxiliary information 64E surrounds the captured image identification information 61E, and auxiliary information 64F surrounds the captured image identification information 61F. Note that the shape and type of line of the auxiliary information 64 are not limited as long as it can surround the captured image identification information 61.

[0057] Figure 10 shows example 1000A as the fifth example and example 1000B as the sixth example.

[0058] The fifth example of 1000A includes damage information 60, captured image identification information 61, and association information 62.

[0059] Damage information 60 includes damage information 60A, 60B, 60C, 60D, 60E, and 60F. Damage information 60A, 60B, and 60C indicate the state of damage 77 related to cracks, while damage information 60D, 60E, and 60F indicate the state of damage 77 related to regional systems. Damage information 60A is drawn with an orange line, damage information 60B with a blue line, and damage information 60C with a red line. Captured image identification information 61 includes captured image identification information 61A, 61B, 61C, 61D, 61E, and 61F. In addition, association information 62 includes association information 62A, association information 62B, association information 62C, association information 62D, association information 62E, and association information 62F.

[0060] The fifth example of 1000A further includes additional attribute information 65. The additional attribute information 65 consists of characters including numbers and symbols that indicate the type of damage to the region system. Examples of characters for the type of damage include "ハ (H)" representing delamination, "ユ (Y)" representing free lime, "ロ (R)" representing water leakage, and "ウ (U)" representing floating. Additional attribute information 65A includes "ウ (U)", additional attribute information 65B includes "ユ (Y)", and additional attribute information 65C includes "ハ (H)". Additional attribute information 65A is associated with the damage information 60D by association information 62D together with the captured image identification information 61D. Similarly, additional attribute information 65B is associated with the damage information 60E by association information 62E together with the captured image identification information 61E, and additional attribute information 65C is associated with the damage information 60F by association information 62F together with the captured image identification information 61F.

[0061] The sixth example of 1000B, like the fifth example of 1000A, includes damage information 60, captured image identification information 61, and association information 62. On the other hand, in the sixth example of 1000B, in addition to the additional attribute information 65 of the fifth example of 1000A, information equivalent to the additional attribute information 65 is included in the damage information 60D, 60E, and 60F as a sketch pattern indicating the type of damage to the region system.

[0062] Figure 11 is an explanatory diagram of the sketch patterns showing the types of regional damage included in the damage information 60. As shown in Figure 11, the damage types and patterns are associated. There are six types of damage: "spraying," "rebar exposure," "free lime," "water leakage," "other," and "delamination," and each of the six types of damage is associated with a different pattern.

[0063] In the sixth example of 1000B in Figure 10, the damage information 60D, 60E, and 60F, which indicate the state of regional damage, include patterns (see Figure 11). Damage information 60D includes a pattern corresponding to "bubble," damage information 60E includes a pattern corresponding to "free lime," and damage information 60F includes a pattern corresponding to "detachment."

[0064] In the fifth example of 1000A, additional attribute information 65 including text is shown, and in the sixth example of 1000B, an example including the pattern of additional attribute information 65 and damage information 60 for damage to a single region system is shown. However, it is not limited to this, and the sixth example of 1000B in Figure 10 may not include additional attribute information 65.

[0065] Figure 12 shows that 1200A is the seventh example and 1200B is the eighth example.

[0066] The seventh example of 1200A, like the second example of 0800B, includes damage information 60 and association information 62. Damage information 60A, 60B, 60C, 60D, and 60E indicate the state of damage 77 related to cracks, and damage information 60F indicates the state of damage 77 related to the regional system.

[0067] On the other hand, unlike the second example of 0800B, in the seventh example of 1200A, two image identification information 61 correspond to one damage information 60. The two image identification information 61 each correspond to a different captured image 103. For example, one captured image 103 is a close-up image that shows the state of the damage 77, and the other captured image 103 is a distant image that shows the location of the damage 77.

[0068] As shown in 1200A, the damage information 60A is associated with the captured image identification information 61A and 61B by association information 62A. Similarly, the damage information 60B is associated with the captured image identification information 61C and 61D by association information 62B. The damage information 60C is associated with the captured image identification information 61E and 61F by association information 62C. The damage information 60D is associated with the captured image identification information 61G and 61H by association information 62D. The damage information 60E is associated with the captured image identification information 61I and 61J by association information 62E. The damage information 60F is associated with the captured image identification information 61K and 61L by association information 62F.

[0069] The eighth example of 1200B, like the second example of 0800B, includes damage information 60, captured image identification information 61, and association information 62. Damage information 60A, 60B, 60C, 60D, and 60E indicate the state of damage 77 related to cracks, and damage information 60F indicates the state of damage 77 related to regional systems. Captured image identification information 61 includes captured image identification information 61A, 61B, 61C, 61D, 61E, and 61F.

[0070] The eighth example of 1200B further includes additional attribute information 67. Additional attribute information 67 consists of numbers indicating the size of the damage 77. Damage information 60A is associated with captured image identification information 61A and additional attribute information 67A by association information 62A. Additional attribute information 67A includes the number "0.2(1.5)" regarding the size corresponding to damage information 60A. Here, the numbers mean a width of 0.2 mm and a length of 1.5 m. For crack damage, the first number indicates the width (mm), and the number in parentheses indicates the length (m). Therefore, the numbers from additional attribute information 67B to additional attribute information 67E indicate width (mm) and length (m). Note that mm represents millimeters and m represents meters.

[0071] Additional attribute information 67B includes the number "0.1 (0.7)" for size corresponding to damage information 60B. Additional attribute information 67C includes the number "0.3 (2.0)" for size corresponding to damage information 60C. Additional attribute information 67D includes the number "0.15 (0.8)" for size corresponding to damage information 60D. Additional attribute information 67E includes the number "0.15 (0.8)" for size corresponding to damage information 60E.

[0072] Additional attribute information 67F includes the numbers "0.5 × 0.3" related to the size, corresponding to damage information 60F. Here, the numbers represent a length of 0.5m × a width of 0.3m. For damage in a region system, the first number indicates the length (m), and the second number indicates the width (m).

[0073] Figures 8 to 12 illustrate examples of the first to eighth inspection memos 48, but they are not limited to these examples.

[0074] Returning to Figure 4, in step S1, image data 80 (see Figure 13) containing the structural diagram 42 of the target structure on the medium and damage information 60 added to the medium by the user is acquired. The image data acquisition unit 51 of the CPU 20 acquires image data 80 containing the structural diagram 42 of the target structure on the medium and damage information 60 added to the medium by the user (step S1).

[0075] In step S1, as shown in Figure 13, for example, the inspection memo 48 on the paper medium 41 of the sixth example shown in 1000B is read by the scanner device 33, and the read image data 80 is acquired by the inspection support device 10 from the image data acquisition unit 51. Note that the printing device 32 and the scanner device 33 can be configured as a single device that has both functions.

[0076] The inspection memo 48 includes the structural diagram 42, damage information 60 added by user U, captured image identification information 61, association information 62, and additional attribute information 65. The acquired image data 80 of the inspection memo 48 is displayed, for example, on the display device 30. In the case of a field notebook 40A on an electronic medium 46, the image data acquisition unit 51 acquires the field notebook 40A from the electronic medium 46 as image data 80.

[0077] Next, in step S2, damage information is recognized from the acquired image data 80 by image recognition. The damage information recognition unit 53 of the CPU 20 recognizes damage information 60 from the acquired image data 80 by image recognition (step S2).

[0078] In step S2, for the damage information 60 added by user U, image recognition is used to recognize the area of ​​the diagram or sketch lines that represent the location, shape, or attributes (type of damage, size, extent of damage, etc.) of the damage in the damage information 60.

[0079] The damage information recognition unit 53 recognizes differences in the attributes of the damage information 60 from the different colors, line types, and patterns drawn from the image data 80 according to the attributes of the damage information 60. The damage information recognition unit 53 can distinguish differences in attributes based on differences in color and line type. The colors, line types, and patterns applied to the damage information 60 are predetermined by the user U.

[0080] The attributes in the damage information 60 include the type of damage, size, and extent of damage. (1) The type of damage is classified into linear damage and regional damage. Linear damage includes cracks and fissures. Regional damage includes water leakage, free lime, spalling, exposed rebar, rust stains, corrosion, and deterioration of corrosion protection function. (2) Size is, for example, the width of a crack. Crack width can be classified, for example, less than 0.2 mm / 0.2 mm or more but less than 0.3 mm / 0.3 mm or more. (3) The extent of damage includes ranks a, b, c, d, and e of the degree of damage progression, which are classified according to the standards of the inspection procedure established by the manager of the structure, etc. The attributes of the damage information 60 are useful for understanding the condition and diagnosing the soundness during periodic inspections and serve as basic data regarding the state of damage. It can be used for repairs to the structure. It can also be used to recognize the progression of damage at the next periodic inspection.

[0081] The damage information recognition unit 53 preferably recognizes damage information 60 from image data 80 by image recognition using at least one of a machine learning model or an image recognition algorithm. This can improve the recognition accuracy of the damage information 60. The machine learning model is a machine learning model trained using known techniques. For example, training data related to damage information 60 can be prepared, and a machine learning model trained using the training data can be applied. A known algorithm can be applied as the image recognition algorithm.

[0082] In this embodiment, the damage information recognition unit 53 recognizes from the image data 80 that damage information 60A, 60B, and 60C indicate the state of damage related to cracks, and that damage information 60D, 60E, and 60F indicate the state of damage related to regions (see 1000B in Figure 10 for the respective codes of damage information 60A, 60B, 60C, 60D, 60E, and 60F). The damage information recognition unit 53 also recognizes the line types of damage information 60D, 60E, and 60F, that damage information 60A is drawn with an orange line, damage information 60B is drawn with a blue line, and damage information 60C is drawn with a red line. The damage information recognition unit 53 recognizes the classification of the damage width from the line type colors of damage information 60A, 60B, and 60C. The damage width can be classified as less than 0.2 mm, 0.2 mm or more but less than 0.3 mm, 0.3 mm or more, etc. The relationship between the line type color and the width of the damage is stored in the storage unit 16 as attribute reference information, for example, and the damage information recognition unit 53 recognizes the width of the damage from the attribute reference information.

[0083] Furthermore, based on the patterns contained in the damage information 60D, 60E, and 60F, the system recognizes that the type of damage in damage information 60D is "bubbling," the type of damage in damage information 60E is "free lime," and the type of damage in damage information 60F is "scraping." The information showing the relationship between the damage type and the pattern, as shown in Figure 11, is stored in the storage unit 16 as attribute reference information, and the damage information recognition unit 53 recognizes the attributes of the damage based on the reference information.

[0084] Furthermore, the damage information recognition unit 53 recognizes the position of the damage information 60 on the image data 80. For example, the damage information recognition unit 53 recognizes the relative position of the damage information 60 with respect to the structural diagram 42 included in the image data 80. The position of the damage information 60 can be determined based on the structural diagram 42.

[0085] The damage information recognition unit 53 recognizes additional attribute information 65 associated with the damage information 60 contained in the image data 80 by character recognition. It additionally recognizes damage attribute information not included in the damage information 60 using the string of additional attribute information 65. Furthermore, it additionally recognizes more detailed attributes of the attributes recognized from the damage information 60 using the string of additional attribute information 65.

[0086] For example, in the sixth example (1000B in Figure 10), the damage information recognition unit 53 recognizes the character "ウ" in the additional attribute information 65A corresponding to the damage information 60D, the character "ユ" in the additional attribute information 65B corresponding to the damage information 60E, and the character "ハ" in the additional attribute information 65C corresponding to the damage information 60F.

[0087] The damage information recognition unit 53 recognizes the damage information 60 to determine whether it is one of the regional damage types (water leakage, free lime, delamination, floating, etc.) (broad classification of damage type), and then recognizes the specific damage type (water leakage, free lime, delamination, floating, etc.) from the string of associated additional attribute information 65. This allows for more accurate recognition of the attributes of the damage information 60.

[0088] Furthermore, if the inspection memo 48 is the eighth example (1200B in Figure 12), the damage information recognition unit 53 recognizes the additional attribute information 67 associated with the damage information 60 contained in the image data 80 by character recognition. The damage information recognition unit 53 recognizes the number "0.2 (1.5)" related to size as characters from the additional attribute information 67A associated with the damage information 60A. Similarly, the damage information recognition unit 53 recognizes the number "0.1 (0.7)" related to size as characters from the additional attribute information 67B, the number "0.3 (2.0)" related to size as characters from the additional attribute information 67C, the number "0.15 (0.8)" related to size as characters from the additional attribute information 67D, and the number "0.15 (0.8)" related to size as characters from the additional attribute information 67E. As mentioned above, it is predetermined that the first number in the crack damage measurement indicates the width (mm), and the number in parentheses indicates the length (m).

[0089] As a result, the damage information recognition unit 53 recognizes the classification of the crack width (less than 0.2 mm / 0.2 mm or more but less than 0.3 mm / 0.3 mm or more, etc.) from the color of the damage information 60, and recognizes the detailed crack width and length from the characters (numbers) of the additional attribute information 67.

[0090] The damage information recognition unit 53 associates the damage information 60 and additional attribute information 65 contained in the image data 80 based on predetermined conditions. When the inspection memo 48 is the sixth example (1000B in Figure 10), the damage information recognition unit 53 associates the damage information 60 and additional attribute information 65 based on the association information 62 of the image data 80. The association information 62 is a diagram connecting the damage information 60 and the additional attribute information 65, and the damage information recognition unit 53 detects the association information 62 and associates the damage information 60 with the characters that identify the corresponding additional attribute information 65. The association information 62 is not limited to a diagram, and may also be association information 63 (closed diagram) as shown in the third example of the inspection memo 48 (0900A in Figure 9).

[0091] Furthermore, if the image data 80 does not contain association information 62 and 63, the damage information recognition unit 53 associates the additional attribute information 65 that is closest to the damage information 60 as the additional attribute information 65 corresponding to the damage information 60. The user can predetermine the conditions for associating the damage information 60 with the additional attribute information 65, and cause the damage information recognition unit 53 to process based on those conditions.

[0092] The damage information recognition unit 53 detects auxiliary information 64 contained in the image data 80 and recognizes the characters of the additional attribute information 65 based on the auxiliary information 64. For example, the auxiliary information 64 of the fourth example shown in 0900B of the inspection memo 48 can be added to, for example, the sixth example. By surrounding the additional attribute information 65 with the auxiliary information 64, the damage information recognition unit 53 identifies the location of the additional attribute information 65 based on the auxiliary information 64. Identifying the location of the additional attribute information 65 improves the accuracy with which the damage information recognition unit 53 recognizes the characters of the additional attribute information 65.

[0093] If the image data 80 does not contain auxiliary information 64, for example, as shown in Figure 13, when the image data 80 is displayed on the display device 30, assist information equivalent to the auxiliary information 64, such as surrounding the additional attribute information 65, may be input on the image data 80, and the characters of the additional attribute information 65 may be recognized based on the assist information.

[0094] If the image data 80 includes image identification information 61 of a captured image 103 of the target structure, it is preferable to obtain the captured image 103 from the image identification information 61 and obtain supplementary information to complement the damage information 60 from the captured image 103.

[0095] By obtaining supplementary information not only from the damage information 60 and additional attribute information 65 (67) but also from the captured image 103, the condition of the damage 77 can be recognized more accurately.

[0096] For example, as shown in Figure 14, the captured image 103 is acquired from the storage unit 16 based on the captured image identification information 61 contained in the image data 80. The captured image 103 corresponding to the file name "1512" contained in the captured image identification information 61 of the image data 80 is displayed on the display device 30.

[0097] From this captured image 103, the damage information recognition unit 53 recognizes the shape and / or attributes (type, size, and extent, etc.) of the damage 77 through image recognition (machine learning model or image analysis).

[0098] When size recognition is performed based on the captured image 103, the size of the damage 77 can be recognized by inputting the resolution information (mm / pixel) of the captured image 103, or the actual size of a predetermined area or object within the image data 80. The external shape characteristics attribute obtained from the captured image 103 complements the damage information 60 or additional attribute information 65, and the size attribute obtained from the captured image 103 complements the additional attribute information 67.

[0099] Next, in step S3, drawing data 101 corresponding to structural drawing 42 is acquired. The drawing data acquisition unit 55 of the CPU 20 acquires the drawing data 101 (step S3).

[0100] For example, if the image data 80 includes the bridge name and component names, the drawing data acquisition unit 55 extracts and acquires the drawing data 101 corresponding to the structural drawing 42 of the image data 80 from the storage unit 16 based on the bridge name and component names.

[0101] As shown in Figure 15, the display device 30 can display image data 80 and acquired drawing data 101. User U can check whether the structural diagram 42 in the image data 80 corresponds to the drawing data 101. If the structural diagram 42 and the drawing data 101 do not correspond, user U inputs conditions for identifying the target structure from the operation unit 18, and the drawing data acquisition unit 55 can extract the drawing data 101 of the object to be inspected from the storage unit 16 according to the conditions.

[0102] Next, in step S4, the structural diagram 42 and drawing data 101 of the image data 80 are aligned. The alignment unit 57 of the CPU 20 aligns the structural diagram 42 and the drawing data 101 (step S4).

[0103] The alignment unit 57 sets an origin and multiple reference points (e.g., multiple corners) for the structural drawing 42, and similarly sets an origin O and multiple reference points (e.g., multiple corners) for the drawing data 101. For example, in the structural drawing 42, the lower left corner is set as the origin O, and the remaining three corners are set as reference points. Similarly, in the drawing data 101, the lower left corner is set as the origin O, and the remaining three corners are set as reference points. The relative position (direction and distance) from the origin to the reference points in the structural drawing 42 is calculated. Similarly, the relative position (direction and distance) from the origin to the reference points in the drawing data 101 is calculated. As shown in Figure 16, the relative position from the origin to the reference points in the structural drawing 42 is matched with the relative position from the origin to the reference points in the drawing data 101.

[0104] Finally, in step S5, damage information 60 is drawn as damage figures 82 at the corresponding positions on the drawing data 101 to create a damage diagram 84. The damage diagram creation unit 59 of the CPU 20 draws predetermined line types, colors, patterns, or combinations thereof corresponding to the damage information 60 at the corresponding positions on the drawing data 101 to create a damage diagram 84 (step S5).

[0105] As shown in Figure 17, for example, image data 80 is displayed in the upper left of the display device 30, and damage diagram 84, in which damage figures 82 are drawn on drawing data 101, is displayed in the lower left of the display device 30.

[0106] As previously described, in step S2, the damage information recognition unit 53 recognizes the relative position of the damage information 60 with respect to the structural diagram 42 included in the image data 80. This allows the position of the damage information 60 to be identified with respect to the structural diagram 42.

[0107] In step S4, the structural diagram 42 of the image data 80 and the drawing data 101 are aligned. Therefore, by using the relative position information of the damage information 60 with respect to the structural diagram 42 recognized by the damage information recognition unit 53, a damage figure 82 corresponding to the damage information 60 can be drawn on the drawing data 101.

[0108] The damage figure 82 can be drawn on the drawing data 101 by tracing the damage information 60 based on the attribute information of the damage information recognition unit 53. The damage figure 82 can be drawn by vectorizing or polygonizing the recognized damage information 60. Vectorization allows the figure to be drawn as a line diagram showing the start and end points of the damage.

[0109] The damage figure 82 is added to the drawing data 101 as damage figure data, and a damage diagram 84 is created that includes the damage figure data and the drawing data 101. Since the damage diagram 84 includes the damage figure data and the drawing data 101, it can be printed on paper from the printing device 32. The damage diagram 84 is output as electronic data (damage diagram data) and stored in the storage unit 16. At the next periodic inspection, the damage diagram 84 can be used as past damage information 105.

[0110] The damage drawing unit 59 of the CPU 20 calculates the actual dimensions of the damage from the damage figure 82 and the dimensional information contained in the drawing data 101.

[0111] As previously described, based on the length of the line or the size of the area recognized from the damage information 60, the damage figure 82 is drawn on the drawing data 101 which contains the actual size information of the target structure. Therefore, the actual size of the damage can be calculated from the correspondence between the actual size information and the damage figure 82, and the damage figure 82 can be converted into more accurate actual size information.

[0112] As shown in Figure 17, the inspection support device 10 can automatically create a damage diagram 84 from the image data 80 of the inspection memo 48 read by the scanner device 33. As shown on the right side of the display device 30, the user U can edit, add, and delete from the damage diagram 84 using the editing menu 85.

[0113] Next, the flagging function will be explained with reference to Figure 18. The display device 30 displays the confirmed damage diagram 84. The damage diagram 84 includes the damage figure 82 and the drawing data 101.

[0114] The damage diagram creation unit 59 of the CPU 20 automatically flags the damaged figures 82 of the finalized damage diagram 84. The damage diagram creation unit 59 displays the damaged figures 82 in association with strings related to line types or patterns recognized by the damage information recognition unit 53 from the damage information 60. For example, it displays strings indicating attributes (e.g., type, size, degree of damage, or a combination thereof) in association with the position and shape of the damaged figure 82. Alternatively, at least one attribute (expressed by differences in color or line type) is displayed for the position and shape of the damaged figure 82, and strings are displayed in association with the remaining attributes or all attributes. Differences in line color and pattern representing the damage information 60 make it possible to express differences in the type and size of damage in the damaged figure 82. system damage A database of correspondences (such as relationships) is prepared, and the meaning of the lines representing damage information 60 can be interpreted from these correspondences and represented by replacing them with strings. The database of correspondences is editable.

[0115] Figure 18 shows an example of flagging for a single damage figure 82. The flagging display 86 shows a string of characters related to the attributes recognized from the damage information 60. The flagging display 86 includes the arbitrarily determined damage number "NO8", the type of damage "crack", the size of the damage "W=0.15mm, L=0.8m", and the arbitrarily determined photo number "Photo-1004".

[0116] User U can edit, add, and delete from the flag menu 87. The edited results are reflected in the damage diagram data of the damage diagram 84 in real time.

[0117] Next, editing using the damage diagram 84 and damage list 88 will be explained based on Figure 19. As shown in Figure 19, the display device 30 simultaneously displays the damage diagram 84 and the damage list 88. The damage attributes of the damage diagram 84 and the damage list 88 are synchronized. For example, the flag display 86 for damage number 1 in the damage diagram 84 matches the damage number 1 in the damage list 88, and both display "crack". Similarly, the flag display 86 and the damage size in the damage list 88 match.

[0118] User U can add damage shapes 82 to damage diagram 84 by operating the add button. The damage shapes 82 that can be added include "cracks" and regional damage (spraying, free lime, etc.). When a damage shape 82 is added, it is reflected in the damage list 88, and a new damage number and damage description are added. User U can delete a damage shape 82 from damage diagram 84 by operating the delete button.

[0119] User U can edit, modify, add to, and delete content in both the flag display 86 of the damage diagram 84 and the damage list 88. Since the damage diagram 84 and the damage list 88 are synchronized, editing one will reflect the changes in the other.

[0120] User U can output the damage diagram 84 as a CAD file and select the output destination. For example, it can be output to a printer 32, or as electronic data in a general-purpose image format. User U can also output the damage list 88 in a tabular format of a predetermined format. For example, here the damage list 88 is output in the format of a photo log.

[0121] The inspection support device of the embodiment can draw the difference between the damage information 60 and the past damage information 105 of the target structure as a damage figure 82, based on the past damage information 105 and the current damage information 60.

[0122] As shown in 2000A of Figure 20, user U (not shown) prints the structural drawing 42 and damage figures 82 (82A, 82B, 82C, 82D, 82E, and 82F) corresponding to the drawing data 101 based on past damage information 105 onto paper media 41 to create a field notebook 40.

[0123] As shown in 2000B, at the inspection site, user U, holding a field notebook 40 and a pen 43, visually assesses the condition of the bridge, which is the structure to be inspected, by visual inspection. User U then adds the damage information 60 (60A and 60B) regarding the damage 77 to the structure 70 obtained by visual inspection to the paper medium 41 of the field notebook 40 by hand using the pen 43.

[0124] A damage diagram 84 is created from the field notebook 40 after inspection, following the flow shown in Figure 4. At that time, the damage diagram creation unit 59 adds the damage figures 82 corresponding to the current damage information 60 (60A and 60B) as differences to the past damage information 105.

[0125] By adding the difference after each periodic inspection, the progression of damage to structure 70 can be easily grasped.

[0126] <Other> In the above embodiment, the hardware structure of the processing unit that performs various processes is a variety of processors as shown below. These various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) and functions as a processing unit; a Programmable Logic Device (PLD), such as an FPGA (Field Programmable Gate Array), which is a processor whose circuit configuration can be changed after manufacturing; and a dedicated electrical circuit, such as an ASIC (Application Specific Integrated Circuit), which has a circuit configuration specifically designed to perform a particular process.

[0127] A single processing unit may be composed of one of these various processors, or it may be composed of two or more processors of the same or different type (for example, multiple FPGAs, or a combination of a CPU and an FPGA). Furthermore, multiple processing units can be composed of a single processor. Examples of composing multiple processing units with a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as multiple processing units, as is typical of computers such as client and server systems. Secondly, a configuration using a processor that realizes the functions of the entire system, including multiple processing units, on a single IC (Integrated Circuit) chip, as is typical of System-on-a-Chip (SoC) systems. Thus, various processing units are configured, in terms of hardware structure, using one or more of the above-mentioned various processors.

[0128] Furthermore, the hardware structure of these various processors is, more specifically, an electrical circuit composed of circuit elements such as semiconductor devices.

[0129] Each of the above-described configurations and functions can be appropriately implemented using any hardware, software, or a combination thereof. For example, the present invention can also be applied to a program that causes a computer to execute the above-described processing steps (processing procedures), a computer-readable recording medium (non-temporary recording medium) that records such a program, or a computer on which such a program can be installed.

[0130] Although examples of the present invention have been described above, the present invention is not limited to the embodiments described above, and various modifications are possible without departing from the spirit of the invention. [Explanation of Symbols]

[0131] 10. Inspection support device 12 Input / Output Interfaces 16 Memory section 18 Control section 26 Display Control Unit 30 Display device 32 Printing device 33 Scanner device 40 field notebook 40A field notebook 41 Paper media 42 Structural Diagram 43 pens 45 Digital Cameras 46 Electronic media 47 Electronic pen 48 Inspection Memo 51 Image Data Acquisition Unit 53 Damage information recognition unit 55 Drawing data acquisition unit 57 Alignment section 59 Damage Diagram Creation Department 60 Damage information 60A Damage Information 60B Damage information 60C damage information 60D damage information 60E Damage information 60F damage information 61 Image identification information 61A Image identification information 61B Image identification information 61C Image identification information 61D Image Identification Information 61E Image identification information 61F Image Identification Information 61G Image Identification Information 61H Image Identification Information 61I Image identification information 61J Image Identification Information 61K Image Identification Information 61L Image Identification Information 62 Related Information 62A Related Information 62B Related Information 62C Related Information 62D Related Information 62E Related Information 62F Related Information 63 Related Information 63A Related Information 63B Related Information 63C Related Information 63D Related Information 63E Related Information 63F Related Information 64. Supplementary Information 64A Supplementary Information 64B Supplementary Information 64C Supplementary Information 64D Supplementary Information 64E Supplementary Information 64F Supplementary Information 65 Additional attribute information 65A Additional attribute information 65B Additional attribute information 65C Additional attribute information 67 Additional attribute information 67A Additional attribute information 67B Additional attribute information 67C Additional attribute information 67D Additional attribute information 67E Additional attribute information 67F Additional attribute information 70 Structures 71 Bridges 72 Main digit 73 Crossbeam 74. Opposite Inclination 75 Horizontal composition 76 Floor slab 77 Damage 80 Image Data 82 Damage Figures 84 Damage Diagram 85 Edit Menu 86 Flag raising display 87 Flagship Menu 88 Damage List 101 Drawing data 103 Photographed images 105 Past damage information

Claims

1. An inspection support device that assists in creating damage diagrams for structures, Equipped with a processor, The aforementioned processor, The structural diagram of the target structure is displayed, and image data from a medium to which damage information has been added by the user is acquired. The damage information is recognized from the acquired image data by image recognition. Obtain drawing data corresponding to the aforementioned structural drawing, Align the structural diagram and the drawing data of the aforementioned image data, A damage diagram is created by drawing the damage information as a damage figure at the corresponding position in the aforementioned drawing data. Inspection support device.

2. The processor associates the damaged shape with the string. An inspection support device as described in claim 1.

3. The processor accepts editing of the created damage diagram and allows editing of the damage diagram. The inspection support device according to claim 1 or 2.

4. The processor vectorizes and draws the damaged shape. The inspection support device according to claim 1 or 2.

5. The processor recognizes the damage information from the image data by image recognition using at least one of a machine learning model or an image recognition algorithm. The inspection support device according to claim 1 or 2.

6. The aforementioned processor, The actual dimensions of the damage are calculated from the damage figure and the dimensional information included in the drawing data. The inspection support device according to claim 1 or 2.

7. The medium includes additional attribute information, The processor recognizes the additional attribute information from the image data by character recognition. The inspection support device according to claim 1 or 2.

8. The processor associates the damage information and the additional attribute information based on predetermined conditions. The inspection support device according to claim 7.

9. The medium includes auxiliary information that identifies the additional attribute information, The processor identifies the location of the additional attribute information based on the auxiliary information. The inspection support device according to claim 7.

10. Includes image identification information of a photographed image of the target structure taken on the medium, The aforementioned processor, The captured image is obtained from the captured image identification information, Supplementary information is obtained from the aforementioned captured image to complement the damage information. The inspection support device according to claim 1 or 2.

11. The medium includes past damage information of the target structure, The aforementioned processor, Based on the damage information and the past damage information, the difference between the damage information and the past damage information is drawn as the damage figure. The inspection support device according to claim 1 or 2.

12. An inspection support method that assists in the creation of structural damage diagrams using a processor, The aforementioned processor, The steps include: obtaining image data from a medium on which a structural diagram of the target structure is displayed and damage information regarding the damage has been added by the user; The steps include: recognizing the damage information from the acquired image data; The steps include: obtaining drawing data corresponding to the aforementioned structural drawing, The steps include aligning the structural diagram and the drawing data of the image data, The steps include creating a damage diagram by drawing the damage information as a damage figure at the corresponding location in the drawing data, A method for supporting inspections to be performed.

13. A program that causes a processor to execute an inspection support method for assisting in the creation of a damage diagram of a structure, The steps include: obtaining image data from a medium on which a structural diagram of the target structure is displayed and damage information regarding the damage has been added by the user; The steps include: recognizing the damage information from the acquired image data; The steps include: obtaining drawing data corresponding to the aforementioned structural drawing, The steps include aligning the structural diagram and the drawing data of the image data, The steps include creating a damage diagram by drawing the damage information as a damage figure at the corresponding location in the drawing data, A program that causes the processor to execute.

Images