Drawing generation system, drawing generation method, and program

Abstract

To improve work efficiency and reduce human errors.SOLUTION: A drawing generation system for generating a drawing with description of the inspection status of a structure is provided, the system being configured to acquire a captured image of the structure, generate three-dimensional data of the structure based on the acquired captured image, convert the generated three-dimensional data into an orthoimage, extract damage to the structure based on the orthoimage obtained through the conversion, and generate a drawing of the structure reflecting the extracted damage.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a technique that is effective for generating drawings that describe the inspection status of structures such as bridges. [Background technology]

[0002] Traditionally, when inspecting bridges and other structures, inspectors would travel to the site and conduct a site survey (taking photographs for the survey form, checking past reports and design documents, checking inspection methods, checking location conditions, checking environmental conditions, etc.), prepare for the inspection (checking the bridge ledger, checking component number diagrams, checking inspection dates, preparing work vehicles, etc., creating inspection forms, creating survey forms, etc.), and then carry out the inspection (chalking, field notes, photographing damage, hammering tests, etc.).After carrying out the inspection, inspectors would compile the inspection results (damage diagrams, damage level and type, attaching photos of damage, etc.), determine the inspection category and overall inspection results (reviewing the inspection results, determining the damage level, determining the countermeasure category, etc.), and then prepare a report. In recent years, there has been a growing demand for CIM (Construction Information Modeling) to improve the efficiency of construction work. For example, Patent Document 1 discloses a configuration for creating documents to be submitted based on comments written in a field notebook, images taken by an inspector, input contents of detection data from each sensor, and drawings of abnormalities such as cracks present in the images. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2023-51949 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the conventional method, various details had to be written in a field notebook, and after the inspection was completed, the details had to be entered into a computer. This not only required time for the inspection work, but also for the work of entering the information into the computer. In addition, there was a risk of human error during the input work. Therefore, there was a need for technology that would improve work efficiency and reduce human error. Therefore, the present inventors focused on a mechanism for inspecting a structure using photographed images of the structure.

[0005] An object of the present invention is to provide a drawing generation system, a drawing generation method, and a program that can improve work efficiency and reduce human error. [Means for solving the problem]

[0006] The present invention provides a drawing generation system for generating a drawing describing the inspection status of a structure, a photographed image acquisition unit that acquires a photographed image of the structure; a three-dimensional data generation unit that generates three-dimensional data of the structure based on the acquired photographed image; a conversion unit that converts the generated three-dimensional data into an orthoimage; an extraction unit that extracts damage to the structure based on the converted orthoimage; a drawing generation unit that generates a drawing of the structure that reflects the extracted damage; A drawing generation system is provided.

[0007] According to the present invention, the drawing generation system extracts damage from an image of a structure and generates a drawing of the structure that reflects this damage. As a result, there is no need to write in a field notebook at the inspection site, which improves work efficiency during inspection work, and also makes it possible to improve work efficiency and reduce human error in work after the inspection is completed. In addition, because the condition of structures can be checked remotely, there is no need for qualified personnel to carry out inspections at the inspection site, and inspections of multiple structures can be carried out efficiently, which results in improved work efficiency and reduced costs.

[0008] Although the present invention is categorized as a system, the same effects and advantages can be obtained even when it is a method or a program. [Effects of the Invention]

[0009] According to the present invention, it is possible to improve work efficiency and reduce human error. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating an overview of a drawing generation system 1. [Figure 2] FIG. 1 is a diagram showing a functional configuration of a drawing generation system 1. [Figure 3] FIG. 2 is a diagram showing a tapping device 2. [Figure 4] FIG. 10 is a flowchart showing a conversion process executed by the computer 10. [Figure 5] FIG. 1 is a diagram schematically illustrating an example of three-dimensional data of a structure. [Figure 6] FIG. 1 is a diagram schematically illustrating an example of an orthoimage. [Figure 7] FIG. 10 is a flowchart showing a drawing generation process executed by the computer 10. [Figure 8] FIG. 10 is a diagram schematically showing extracted damage to a structure. [Figure 9] FIG. 10 is a diagram schematically showing a drawing of a structure reflecting extracted damage. [Figure 10] FIG. 10 is a flowchart showing a first output process executed by the computer 10. [Figure 11] 10A and 10B are diagrams schematically showing three-dimensional data to be output and a state when input is received. [Figure 12] FIG. 10 is a diagram schematically illustrating an example of an output inspection result. [Figure 13] FIG. 10 is a flowchart showing a second output process executed by the computer 10. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the present invention (hereinafter referred to as "embodiments") will be described in detail with reference to the accompanying drawings. In the following drawings, the same elements are designated by the same numbers or symbols throughout the description of the embodiments.

[0012] [Outline of Drawing Generation System 1] 1 is a schematic diagram for explaining an overview of a drawing generation system 1. Components of the drawing generation system 1 will be described based on FIG. The drawing creation system 1 is a system for creating drawings that describe the inspection status of a structure, and is composed of at least a computer 10 having a server function. In this embodiment, the drawing creation system 1 is a system that includes, in addition to the computer 10, a tapping device 2 that performs a tapping inspection of the structure and is connected to the computer 10 so as to be able to communicate data with the computer 10, and a photographing device 3 that photographs the structure and is connected to the computer 10 so as to be able to communicate data with the computer 10. The tapping device 2 is a device that taps a structure with a certain amount of force when conducting a hammering inspection of the structure, and acquires and transmits vibration data generated by the tapping. Furthermore, the tapping device 2 is a device that acquires and transmits its own location information using a GPS (Global Positioning System). An inspector uses this tapping device 2 to tap a structure and conduct a hammering inspection. The photographing device 3 is a device such as a camera that photographs structures and transmits the photographed images, etc. Furthermore, the photographing device 3 is a device that acquires and transmits its own location information by GPS. The computer 10 has a server function and may be realized, for example, by a single computer, or may be realized by multiple computers, such as a cloud computer. In this specification, a cloud computer may refer to either a computer that uses any computer in a scalable manner to perform a specific function, or a computer that includes multiple functional modules to realize a system and uses the functions in any combination.

[0013] An outline of the processing steps when the drawing generation system 1 generates a drawing that describes the inspection status of a structure will be described.

[0014] The computer 10 acquires a photographed image of a structure (step S1). The computer 10 acquires the photographed image of the structure photographed by the photographing device 3. At this time, the computer 10 also acquires from the photographing device 3 the position information of the photographing location. The computer 10 may also acquire, as the inspection results, vibration data when the tapping device 2 taps the structure and position information of the tapping location.

[0015] The computer 10 generates three-dimensional data of the structure based on the acquired photographed images (step S2). The computer 10 uses a predetermined algorithm to generate three-dimensional data of the structure based on the acquired photographed images.

[0016] The computer 10 converts the generated three-dimensional data into an orthoimage (step S3). The computer 10 converts the generated three-dimensional data into an orthoimage using a predetermined algorithm.

[0017] The computer 10 extracts damage to the structure based on the converted orthoimage (step S4). The computer 10 extracts damage to the structure using a trained model that has been generated in advance based on the results of training using the damage and orthoimages that include this damage.

[0018] The computer 10 generates a drawing of the structure that reflects the extracted damage (step S5). The computer 10 generates a drawing based on the orthoimage, and reflects the extracted damage at a corresponding position on the generated drawing.

[0019] The above is an outline of the processing steps executed by the drawing generation system 1. According to the present drawing generation system 1, it is possible to improve work efficiency and reduce human errors.

[0020] [Device configuration] 2 is a block diagram showing the configuration of the drawing creation system 1. The device configuration of the drawing creation system 1 will be described with reference to FIG. The drawing generation system 1 is a system for generating drawings that describe the inspection status of a structure, and is composed of at least a computer 10 having a server function. In this embodiment, the drawing generation system 1 is a system that includes, in addition to the computer 1, a tapping device 2 that performs a hammering test on the structure, and a photography device 3 that photographs the structure. The drawing generation system 1 is a system in which a computer 10 is connected to a tapping device 2 and a photographing device 3 so as to be able to perform data communication via a network 8 such as a public line network, wired communication, or wireless communication. The method of connecting the computer 10 to the tapping device 2 and the photographing device 3 is not particularly limited. In addition, the drawing generation system 1 may include other terminals and devices in addition to the above-mentioned tapping device 2, photographing device 3, and computer 10, and the number, type, and functions thereof are not particularly limited and can be designed as appropriate.

[0021] The tapping device 2 will now be described. The tapping device 2 is a device that performs a tapping inspection of a structure. The tapping device 2 plays the role of an inspection hammer in the tapping inspection of a structure. The tapping device 2 includes a tapping unit that taps the structure with a certain amount of force, an acquisition unit that acquires vibration data when the structure is tapped and its own position information from a GPS or the like, and a transmission unit that transmits the acquired vibration data and position information to the computer 10. The hitting device 2 is handgun-type (see Figure 3). The hitting device 2 has one or more internal gears, and the rotation of these internal gears causes the structure to be hit instantaneously with a constant amount of force. The hitting device 2 also has an elastic body (such as a spring) that expands as the internal gear rotates, and contracts after the hitting unit 3 hits the structure. The hitting device 2 hits the structure at constant intervals and with a constant amount of force by hitting the structure with the rotation of the internal gear and by the expansion and contraction of the elastic body. The shape of the striking device 2 is not limited to a handgun type, and may be other shapes. The number, size, type, etc. of the internal gears and elastic bodies are not particularly limited, and can be designed as appropriate. Furthermore, the tapping device 2 may have an extendable item (such as a pole of a predetermined length) and a detachable mechanism, and even when attached to this item, it can perform tapping inspection of a structure in the same way as when it is not attached.

[0022] The tapping device 2 will be described with reference to Fig. 3. Fig. 3(a) is a diagram schematically showing the appearance of the tapping device 2. Fig. 3(b) is a diagram schematically showing the internal structure of the tapping device 2. Fig. 3(c) is a diagram schematically showing the structure of the tapping section. The striking device 2 has the appearance of a handgun type device. When an inspector pulls the trigger 20 of the striking device 2, the protrusion 21 strikes the structure. The tip of the protrusion 21 is hemispherical, and its bottom surface is attached to the striking member 33. The tip of the protrusion 21 is rounded so as not to damage the structure. The striking device 2 is also provided with an attachment part 22 to which the above-mentioned extendable article (such as a pole having a predetermined length) is attached. The attachment part 22 may have, for example, a groove or the like into which a connecting part provided at an end of the stretchable article can be fitted, and the connecting part may be detachably fitted into this groove or the like, or the attachment part 22 and the connecting part may engage with each other, or the attachment part 22 may itself have a connecting part, or it may have some other structure. The attachment part 22 may also have a rotating part as a mechanism that allows the hitting device 2 to rotate vertically or horizontally. When the stretchable article is attached, the hitting device 2 may pull the trigger 20 by a device provided on the stretchable article, or may maintain the trigger 20 in a pulled state (for example, by holding the trigger 20 and maintaining the pulled state). Furthermore, the shape of the protrusion 21 is not limited to the example described above. The tapping device 2 has a tapping unit 30 therein. The tapping unit 30 has a plurality of internal gears 31 (first gear 31a, second gear 31b, third gear 31c), a motor 32 that rotates the internal gear 31 in accordance with the movement of the trigger 20, a tapping member 33 to which the bottom surface of the protrusion 21 is attached, a spring 34 that connects to the end of the tapping member 33 opposite the protrusion 21, and a support member 35 that supports the spring 34. The tapping member 33 has a meshing portion 330 formed on the internal gear 31 side, and meshes with the first gear 31a via this meshing portion 330. In the internal gear 31, the first gear 31a meshes with the second gear 31b, and the second gear 31b meshes with the third gear 31c. When an inspector pulls the trigger 20, the motor 32 rotates the internal gear 31 (the third gear 31c rotates, and in accordance with the rotation of the third gear 31c, the second gear 31b rotates, and in accordance with the rotation of the second gear 31b, the first gear 31a rotates). In accordance with the rotation of the first gear 31a, the meshing portion 330 pushes out the striking member 33, and the protrusion 21 strikes the structure. After the protrusion 21 strikes the structure, the spring 34, stretched by the striking member 33, tries to contract and return to its original shape, causing the striking member 33 to move toward the support member 35. After the striking member 33 moves toward the support member 35, the internal gear 31 rotates again (the first gear 31a), and the meshing portion 330 pushes the striking member 33 out in time with the rotation of the first gear 31a, causing the protrusion 21 to strike the structure. By repeating this process, the striking unit 30 instantaneously strikes the structure at regular intervals and with a regular force due to the rotation of the internal gear 31. If an electrical force such as a solenoid structure is used to strike a structure, the striking tool will not bounce back and will stop when it hits the structure, making it impossible to obtain the vibrations generated in the structure. However, by striking the structure using physical forces such as the internal gear 31 and spring 34, the protrusion 21 bounces back the moment it hits the structure, and the vibrations will not stop, making it easier to accurately obtain the vibrations generated in the structure. The internal structure of the tapping unit 30 is not limited to that shown in the drawing. For example, the number and shape of the internal gears 31 are not limited to those shown in the drawing and can be designed as appropriate. Similarly, the shape, number, function, etc. of other components can also be designed as appropriate.

[0023] Returning to FIG. 2, the photographing device 3 will be described. The photographing device 3 is a device used by an inspector to photograph a structure at an inspection site. The photographing device 3 may be, for example, an optical machine or device that captures images such as videos or still images, or may be a terminal device with a camera function such as a mobile phone, smartphone, or tablet terminal. The photographing device 3 includes a transmitting unit and the like that transmits to the computer 10 photographed images of structures that the photographing device 3 itself has taken and its own position information acquired from a GPS or the like.

[0024] The configuration of the computer 10 will now be described. The computer 10 has a server function and may be realized, for example, by a single computer or by multiple computers such as a cloud computer. The computer 10 may also be a terminal device such as a mobile terminal (such as a mobile phone, smartphone, or tablet terminal), a personal computer, or a laptop computer. The computer 10 has a control unit including a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), etc., and a communication unit including a device that enables communication with other terminals and devices, etc., and an image acquisition unit 11 that acquires images of structures. The computer 10 includes a storage unit such as a hard disk, semiconductor memory, recording medium, or data storage unit such as a memory card. The computer 10 includes, as processing units, various devices that perform various processes, a three-dimensional data generation unit 12 that generates three-dimensional data of the structure based on the acquired photographic images, a conversion unit 13 that converts the generated three-dimensional data into an orthoimage, an extraction unit 14 that extracts damage to the structure based on the converted orthoimage, and a drawing generation unit 15 that generates a drawing of the structure that reflects the extracted damage.

[0025] In the computer 10, the control unit reads a predetermined program, and in cooperation with the communication unit, realizes a captured image acquisition module and an examination result acquisition module. In addition, in the computer 10, the control unit reads a predetermined program, thereby realizing a storage module in cooperation with the storage unit. In addition, in computer 10, the control unit reads a specified program and works in cooperation with the processing unit to realize a three-dimensional data generation module, an embedding module, a conversion module, an extraction module, a drawing generation module, a first output module, an input acceptance module, a judgment module, an identification module, a setting module, and a second output module.

[0026] Below, each process executed by the drawing generation system 1 will be explained together with the process executed by each of the modules described above. In this specification, each module may execute its processing content as its own function, or may execute its processing content via a predetermined application.

[0027] [Conversion process performed by computer 10] The conversion process executed by the computer 10 will be described with reference to Fig. 4. This figure shows a flowchart of the conversion process executed by the computer 10. This conversion process includes details of a photographed image acquisition process (step S1) for acquiring a photographed image of the structure described above, a three-dimensional data generation process (step S2) for generating three-dimensional data of the structure based on the acquired photographed image, and a conversion process (step S3) for converting the generated three-dimensional data into an orthoimage.

[0028] The photographed image acquisition module acquires photographed images of the structure (step S10). The inspector uses the photographing device 3 to photograph the structure to be inspected at the inspection site. When photographing the structure, the photographing device 3 also acquires location information of the photographing location from a GPS or the like and links it to the photographed image. There are no particular limitations on the number and content of the photographed images taken by the photographing device 3, as long as the inspector takes them as appropriate. The photographing device 3 transmits the photographed image and location information of the photographed structure to the computer 10. The photographing device 3 transmits the photographed image and location information of the target structure to the computer 10 based on a request to transmit the photographed image from the computer 10, or based on receipt of an input from an inspector regarding the transmission of the photographed image. The photographed image acquisition module receives the photographed image and the position information transmitted by the photographing device 3, and acquires the photographed image of the structure.

[0029] The inspection result acquisition module acquires the inspection results of the hammering inspection of the structure (step S11). The inspection result acquisition module acquires, as inspection results, vibration data when the tapping device 2 taps the structure and position information of the tapping location. The vibration data is a digitalized version of the change in frequency detected by the vibration sensor of the hammering device 2. When hammering, the vibration sensor will detect different frequencies depending on whether the structure is in a normal state or in a state where an abnormality such as cracks, peeling, water leakage, condensation on rebar, or free lime has occurred. The tapping device 2 instantly taps the structure with a constant force. The tapping device 2 uses its own vibration sensor to acquire vibration data when the structure is tapped while the inspector is pulling the trigger 20. The tapping device 2 also acquires its own location information at the time of tapping from a GPS or the like. The tapping device 2 transmits the acquired vibration data and its own location information to the computer 10 as inspection results, linked to the structure's identifier (site name, management number, inspector's identifier (name, ID, management number, etc.)). The inspection result acquisition module receives the inspection result and acquires the inspection result of the hammering inspection of the structure.

[0030] The three-dimensional data generation module generates three-dimensional data of the structure based on the acquired photographed images (step S12). The three-dimensional data generation module uses a predetermined algorithm to generate three-dimensional data based on two-dimensional photographed images (see Figure 5). When generating three-dimensional data of a structure based on the location information of the photographed location linked to the photographed image, the three-dimensional data generation module generates the three-dimensional data including the location information. Because the three-dimensional data generated by the three-dimensional data generation module is based on the photographed image, it includes the chalking results and other artifacts contained in the photographed image. The method by which the three-dimensional data generation module generates three-dimensional data is not particularly limited.

[0031] The three-dimensional data of a structure generated by the three-dimensional data generation module will be described with reference to Fig. 5. The figure is a diagram schematically showing an example of three-dimensional data of a structure generated by the three-dimensional data generation module. In the figure, three-dimensional data 40 is shown. The three-dimensional data 40 is, for example, CAD (computer-aided design) data. The three-dimensional data 40 is data that represents the entire structure in three dimensions based on images taken by an inspector. The three-dimensional data 40 includes location information for the location where the images were taken. The three-dimensional data 40 also includes the results of chalking performed by the inspector on the structure at the inspection site.

[0032] Returning to FIG. 4, the rest of the conversion process will be explained. The embedding module embeds the inspection results at the corresponding positions in the three-dimensional data (step S13). The embedding module references the position information on the generated three-dimensional data and the position information in the inspection results, and embeds the inspection results of the hammering inspection of the structure at the corresponding positions in the three-dimensional data. The inspection results embedded by the embedding module are vibration data and an identifier of the structure.

[0033] The conversion module converts the generated three-dimensional data into an orthoimage (step S14). The conversion module converts the generated 3D data into an orthoimage with a preset resolution using a predetermined algorithm (see Figure 6). When converting into an orthoimage, the conversion module converts the data in a state where the position information contained in the 3D data is also reflected in the orthoimage. Furthermore, the conversion module may convert the inspection results embedded in the 3D data in a state where they are either reflected or not reflected in the orthoimage. The method by which the conversion module converts the three-dimensional data into an orthoimage is not particularly limited.

[0034] The orthoimage converted by the conversion module will be described with reference to Fig. 6. This figure is a diagram schematically showing an example of an orthoimage converted by the conversion module. In this figure, an orthoimage 50 is shown. The orthoimage 50 is obtained by converting the generated three-dimensional data 40 using a predetermined algorithm. The orthoimage 50 includes the chalking results 51 for the structures included in the three-dimensional data, as well as the position information included in the three-dimensional data 40.

[0035] This completes the conversion process. In the above-described conversion process, the computer 10 generates three-dimensional data including the chalking results and converts the orthoimage, but including the chalking results is not a required configuration, and generation and conversion can also be performed without including the chalking results. In this case, inspectors do not need to perform chalking at the inspection site, which makes it possible to further improve work efficiency and reduce human error.

[0036] [Drawing generation process executed by computer 10] The drawing generation process executed by the computer 10 will be described with reference to Fig. 7. This figure shows a flowchart of the drawing generation process executed by the computer 10. This drawing generation process shows details of an extraction process (step S4) that extracts damage to the structure based on the converted orthoimage described above, and a drawing generation process (step S5) that generates a drawing of the structure that reflects the extracted damage.

[0037] The extraction module extracts damage to the structure based on the converted orthoimage (step S20). The damage is at least one of the following: cracks, spalling, water leakage, exposed rebar, and free lime. The extraction module first performs learning (machine learning, neural network learning, etc.) using damage (such as the results of choking) and orthoimages containing this damage, and then extracts damage to the structure using AI (artificial intelligence) that uses a trained model generated based on the learning results. The extraction module performs image analysis on the orthoimages and extracts the chalking results contained in the orthoimages. The extraction module refers to the trained model and extracts structural damage based on the extracted chalking results (see Figure 8). When extracting structural damage, the extraction module also extracts the location information of the structural damage. If the orthoimage does not contain any chalking results, the extraction module can perform image analysis on the orthoimage, identify the state of the structure in the orthoimage, and perform prior learning using damage (such as the state of the structure) and orthoimages containing this damage, and then extract the damage to the structure using an AI that uses a trained model generated based on the learning results.The extraction module analyzes the orthoimage and extracts the state of the structure in the orthoimage.The extraction module references the trained model and extracts the damage to the structure based on the extracted state. Furthermore, the method by which the extraction module extracts damage to a structure is not limited to using a trained model, but may also be to extract damage to a structure by, for example, referring to a database in which damage, its details, and orthoimages containing this damage have been registered in advance, and identifying those that match or are similar to the current orthoimage, or by other methods.

[0038] Damage to a structure extracted by the extraction module will be described with reference to Fig. 8. This figure is a diagram schematically showing damage to a structure extracted by the extraction module. In this figure, an orthoimage 60 is shown. The orthoimage 60 shows damage 61 to the structure extracted by the extraction module. This damage 61 is extracted based on the choking result 51.

[0039] Returning to FIG. 7, the rest of the drawing generation process will be explained. The drawing generation module generates a drawing of the structure that reflects the extracted damage (step S21). The drawing generation module generates a drawing of the structure based on the orthoimage and reflects the extracted damage on this drawing (see Figure 9). In addition to the extracted damage, the drawing generation module also reflects the specific details of the damage (cracks, peeling, water leakage, exposed rebar, type of free lime, etc., damage level, etc.) on the orthoimage. Based on the location information of the extracted damage, the drawing generation module reflects the extracted damage in the corresponding position on the drawing. The drawing generation module may generate a drawing of the structure based on three-dimensional data instead of an orthoimage, and may reflect the extracted damage on this drawing.

[0040] The drawings generated by the drawing generation module will be described with reference to Fig. 9. This figure is a diagram that schematically shows a drawing of a structure that reflects the extracted damage generated by the drawing generation module. In this figure, a drawing 70 is shown. In drawing 70, an overall view 71 shows which part of the structure the reflected damage corresponds to, and a frame line 72 indicates the corresponding part. In drawing 70, an enlarged view 73 of the structure indicated by this frame line 72 is shown. In this enlarged view 73, the drawing generation module reflects the damage extracted from the structure with the display content shown in case example 74. For example, the display content corresponding to the damage is reflected in the position corresponding to the extracted damage on enlarged view 73, and further, a leader line is drawn from this damage to reflect the structure's identifier, management number, damage content, etc.

[0041] Returning to FIG. 7, the rest of the drawing generation process will be explained. The embedding module embeds the inspection results at the corresponding positions on the drawing (step S22). The embedding module references the position information of the extracted damage on the generated drawing and the position information in the inspection results, and embeds the inspection results of the hammering test of the structure at the corresponding position on the drawing (the position where the damage was extracted). The inspection results embedded by the embedding module are vibration data and a structure identifier. The embedding module can also be configured to embed photographed images, three-dimensional data, orthoimages, inspection results, etc. at the location of damage on the drawing.

[0042] The embedding module embeds the extracted damage at a corresponding position on the three-dimensional data (step S23). The embedding module references the position information on the three-dimensional data generated by the processing in step S12 described above and the position information of the extracted damage, and embeds the extracted damage at the corresponding position on the three-dimensional data (the position where the damage was extracted). The damage embedded by the embedding module includes not only the extracted damage itself, but also the specific details of the damage (type and degree of damage, such as cracks, peeling, water leakage, exposed rebar, and free lime).

[0043] The storage module stores the three-dimensional data and the drawing (step S24). The storage module stores the three-dimensional data, drawings, and orthoimages in association with each other, and further stores identifiers of these data in association with each other. The storage module stores the three-dimensional data, drawings, and orthoimages showing damage in chronological order. For example, if three-dimensional data, drawings, and orthoimages showing damage to the same structure exist in the past, the storage module links the three-dimensional data, drawings, and orthoimages to be stored this time to the past three-dimensional data, drawings, and orthoimages, and stores them in chronological order based on the inspection date and time, etc. The storage module may store only three-dimensional data in chronological order, or may store only drawings in chronological order.

[0044] This completes the drawing generation process.

[0045] [First Output Process Executed by Computer 10] The first output processing executed by the computer 10 will be described with reference to Fig. 10. The figure is a flowchart of the first output processing executed by the computer 10.

[0046] The first output module outputs the generated three-dimensional data (step S30). The three-dimensional data output by the first output module is three-dimensional data into which the extracted damage is embedded by the process of step S23 described above. The first output module accepts input from an inspector or the like regarding the output of three-dimensional data (input to launch a specified application, input to select the three-dimensional data to output, etc.), and displays the three-dimensional data on its own display unit or the like via a specified UI (User Interface). The first output module outputs the generated three-dimensional data by displaying the three-dimensional data.

[0047] The input receiving module receives an input for a predetermined position in the output three-dimensional data (step S31). The input reception module receives inputs from an inspector or the like, such as tapping on a predetermined position on the output three-dimensional data, or clicking via an input device such as a mouse.

[0048] The determination module determines whether the inputted predetermined position is the position where the inspection result is embedded (step S32). If the determination module determines that the predetermined position where the input is received is not the position where the inspection result is embedded (step S32 NO), the computer 10 ends the first output process. In this case, the first output module may be configured to output a predetermined message, such as that no damage was detected at this position, to the vicinity of the position where the input was received.

[0049] On the other hand, if the determination module determines that the inputted predetermined position is the position where the inspection result is embedded (YES in step S32), the first output module outputs the embedded inspection result (step S33). The first output module displays the test result embedded in the predetermined position where the input was received, near the predetermined position where the input was received. The first output module outputs the embedded test results by displaying the test results.

[0050] Each process executed by the computer 10 in the first output process will be described with reference to Figures 11 and 12. Figure 11 is a diagram schematically showing a state when the computer 10 outputs three-dimensional data and accepts input at a predetermined position. Figure 12 is a diagram schematically showing an example of an inspection result output by the computer 10. Through the processing of step S30, the first output module outputs the generated three-dimensional data 80. By the processing of step S31, the input receiving module receives an input for a predetermined position in the three-dimensional data 80. In FIG. 11 , the part pointed to by the arrow 81 receives an input such as a tap from an inspector 84 for a predetermined position 83 in three-dimensional data 82, which is enlarged for clarity of explanation. By the processing of step S32, the judgment module determines that the inspection result is embedded in the predetermined position 83 where the input was received, and the first output module outputs the inspection result 85 near this predetermined position 83. The inspection result 85 includes the structure identifier, details of the damage (type and degree of damage such as cracks, peeling, water leakage, exposed rebar, free lime, etc.), etc.

[0051] This completes the first output process. In the first output process, the computer 10 is described as outputting three-dimensional data, but instead of the three-dimensional data, the computer 10 may output a drawing in which the inspection results are embedded by the processes of steps S21 and S22 described above. Even in this case, it is sufficient to execute the same processes as the processes of steps S30 to S33 described above.

[0052] [Second Output Process Executed by Computer 10] The second output process executed by the computer 10 will be described with reference to Fig. 13. The figure is a flowchart of the second output process executed by the computer 10.

[0053] The identification module identifies a repair method and repair cost for the damage based on the extracted damage (step S40). The identification module identifies the repair method and repair cost for the damage based on the extracted damage and its size. The identification module performs learning (machine learning, neural network learning, etc.) in advance using the damage, the size of the damage, the repair method for the damage, and the repair cost for the damage, and identifies the repair method and repair cost for the damage using AI using a trained model generated based on the learning results. The identification module refers to the trained model and identifies the repair method and repair cost required to repair the damage extracted this time and its size. The method by which the identification module identifies the repair method and repair costs is not limited to using a trained model, but may, for example, refer to a database in which damage, the size of the damage, the repair method for this damage, and the repair costs for the damage have been registered in advance, and identify the damage and its size that match or are similar to the damage extracted this time, thereby identifying the repair method and repair costs for the damage, or may use some other method.

[0054] The setting module sets the priority of repairs for the damage based on the identified repair methods and repair costs (step S41). The setting module sets the priority of repairs for damage based on a preset priority setting method (highest to lowest cost, lowest to highest cost, most complex repair method, simplest repair method, most urgent, etc.) or priorities set by an inspector, etc. The setting module sets a priority for each of all the extracted damages.

[0055] The storage module stores the damage, repair method, repair cost, and priority (step S42). The storage module stores the extracted damages for which priority has been set, the repair methods for the damages, the repair costs for the damages, and the set priorities in association with each other. Furthermore, the storage module stores these together with their identifiers in association with each other.

[0056] The second output module outputs the damage, repair method, repair cost, and priority (step S43). The second output module receives inputs related to these outputs (inputs to launch a specified application, inputs to select data to be output, etc.) from inspectors, etc., and displays these on its own display unit via a specified UI. The second output module displays the damage, the repair method, the repair cost, and the priority, thereby outputting the damage, the repair method, the repair cost, and the priority.

[0057] This completes the second output process.

[0058] Although the above-mentioned processes are described as separate processes, the drawing generation system 1 can also be configured to execute a combination of some or all of the above-mentioned processes.

[0059] The above-described means and functions are realized by a computer (including a CPU, an information processing device, and various terminals) reading and executing a predetermined program. The program may be provided, for example, from a computer via a network (Software as a Service (SaaS)) or as a cloud service. The program may also be provided in a form recorded on a computer-readable recording medium. In this case, the computer reads the program from the recording medium, transfers it to an internal or external recording device, records it, and executes it. The program may also be pre-recorded on a recording device (recording medium) and provided to the computer from the recording device via a communication line.

[0060] Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments. Furthermore, the effects described in the embodiments of the present invention are merely a list of the most preferable effects resulting from the present invention, and the effects of the present invention are not limited to those described in the embodiments of the present invention.

[0061] A first aspect disclosed in this embodiment is a drawing generation system that generates a drawing describing an inspection state of a structure, a photographed image acquisition unit that acquires a photographed image of the structure; a three-dimensional data generation unit that generates three-dimensional data of the structure based on the acquired photographed image; a conversion unit that converts the generated three-dimensional data into an orthoimage; an extraction unit that extracts damage to the structure based on the converted orthoimage; a drawing generation unit that generates a drawing of the structure that reflects the extracted damage; A drawing generation system is provided.

[0062] A second aspect disclosed in this embodiment includes an inspection result acquisition unit that acquires inspection results of a hammering inspection of the structure; an embedding unit that embeds the inspection result at a corresponding position in the three-dimensional data; an output unit that outputs the embedded inspection result when receiving an input for the position; The drawing generation system according to the first aspect further comprises:

[0063] A third aspect disclosed in this embodiment includes a storage unit that stores three-dimensional data of the structure in which damage exists in chronological order; The drawing generation system according to the first aspect further comprises:

[0064] A fourth aspect disclosed in this embodiment is the method, wherein the damage is at least one of cracks, peeling, water leakage, exposed rebar, and free lime. According to a first aspect, there is provided a drawing generation system.

[0065] A fifth aspect disclosed in this embodiment includes an identification unit that identifies a repair method and a repair cost for the damage based on the extracted damage; A setting unit that sets a priority order for repairs for the damage based on the identified repair method and repair cost; The drawing generation system according to the first aspect further comprises: [Explanation of symbols]

[0066] 1. Drawing generation system 2 Beating device 3. Imaging equipment 8 Network 10. Computers 11 Image acquisition unit 12 Three-dimensional data generation unit 13 Conversion unit 14 Extraction part 15 Drawing generation section 20 Triggers 21 Protrusion 22 Mounting part 30 Hitting Club 31 Internal Gear 31a 1st gear 31b 2nd gear 31c 3rd gear 32 motor 33 hammering member 330 Meshing part 34 Spring 35 Support member 40 Three-dimensional data 50 orthoimages 51 Choking results 60 orthoimages 61 damage 70 Drawings 71 Overall view 72 Border 73 Enlarged view 74 Case Law 80 Three-dimensional data 81 Arrow 82 Three-dimensional data 83 positions 84 Inspector 85 Test Results

Claims

1. A drawing generation system that generates a drawing describing the inspection status of a structure, a photographed image acquisition unit that acquires a photographed image of the structure; a three-dimensional data generation unit that generates three-dimensional data of the structure based on the acquired photographed image; a conversion unit that converts the generated three-dimensional data into an orthoimage; an extraction unit that extracts damage to the structure based on the converted orthoimage; a drawing generation unit that generates a drawing of the structure that reflects the extracted damage; A drawing generation system comprising:

2. an inspection result acquisition unit that acquires inspection results of the hammering inspection of the structure; an embedding unit that embeds the inspection result at a corresponding position in the three-dimensional data; an output unit that outputs the embedded inspection result when receiving an input for the position; The drawing generation system according to claim 1 , further comprising:

3. a storage unit that stores three-dimensional data of the structure in which damage exists in chronological order; The drawing generation system according to claim 1 , further comprising:

4. The damage is at least one of cracks, spalling, water leakage, exposed rebar, and free lime. The drawing generation system according to claim 1 .

5. an identification unit that identifies a repair method and a repair cost for the damage based on the extracted damage; A setting unit that sets a priority order for repairs for the damage based on the identified repair method and repair cost; The drawing generation system according to claim 1 , further comprising:

6. A computer-implemented drawing generation method for generating a drawing describing an inspection state of a structure, comprising: acquiring an image of the structure; generating three-dimensional data of the structure based on the acquired photographed images; converting the generated three-dimensional data into an orthoimage; extracting damage to the structure based on the converted orthoimage; generating a drawing of the structure that reflects the extracted damage; A drawing generation method comprising:

7. A computer generates drawings showing the inspection status of a structure. acquiring an image of the structure; generating three-dimensional data of the structure based on the acquired photographed images; converting the generated three-dimensional data into an orthoimage; extracting damage to the structure based on the converted orthoimage; generating a drawing of the structure that reflects the extracted damage; A computer-readable program for executing the program.

Images