Method of structure damage object definition and mounting method of 3D object

Abstract

The present invention relates to a structural damage management system and a management method through the definition of a damaged object, and more specifically, to a structural damage management system comprising: a 2D unfolded plane acquisition unit for acquiring a damage management surface for a damaged structure; a damaged object data input unit for recording damage object data for each of the damaged objects extracted on the unfolded plane; and a projection unit for projecting each of the damaged objects including the damage object data onto an actual shape model.

Description

Technology Field

[0001] The present invention relates to a structural damage management system and management method through the definition of a damaged object. Background Technology

[0002] Figure 1 illustrates a schematic diagram of a conventional structural damage recording method (a current damage recording method that does not match the ratio of a bridge with a length of 40 meters and a width of 12 meters).

[0003] As illustrated in Fig. 1, the results of a visual inspection of a structure are generally recorded by hand on a 2D paper drawing of a different scale, and then converted into a 2D CAD file to accumulate the history. For structures with a large ratio of length to width, such as bridges, damage is recorded on a 2D plane that differs from the actual size ratio.

[0004] Current technologies for recording structural damage suffer from the problem of being unable to record damage at its actual size due to the limitations of visual observation and manual recording on paper documents, and cannot quantitatively measure the scale of damage from records made in 2D CAD. Consequently, managing damage by creating separate damage quantity tables presents limitations in accurately tracking not only the precise location of damage but also damage that grows over time. Furthermore, if damage is erased through surface repair, it is difficult to distinguish whether damage manifesting after a certain period is original or newly caused. Additionally, since individual damage is represented as a table on independent drawings, there is a limitation in that information cannot be collected, processed, or managed as digital objects.

[0005] Recently, photorealistic model technology is being utilized to automatically detect damage from point cloud data generated by UAVs, photography, etc., or to apply images to the surfaces of 3D objects.

[0006] Figure 2 illustrates an example of a surface model in which scanned point cloud data is post-processed. Figure 3 illustrates an example of a technology in which an external inspection map is image-processed and applied as a texture to a surface.

[0007] In other words, a technology that generates a surface model from a point cloud obtained by scanning through post-processing and maps it to the corresponding surface of a 3D object is being utilized as a reality modeling.

[0008] However, for large-scale structures with many faces, these technologies result in excessively large data volumes and present difficulties in growth or quantification based on individual damage.

[0009] Furthermore, shape distortion in image mapping at irregular surfaces or intersections can limit the ability to accurately identify the form of damage. This technology also faces difficulties in constructing damage models to predict damage growth or to relatively compare the damage characteristics of similar structures across different environments. Prior art literature

[0010] Published Patent 10-2016-0119988 Republic of Korea Published Patent 10-2022-007640 Republic of Korea Registered Patent 10-1782741 Republic of Korea Published Patent 10-2016-0102844 The problem to be solved

[0011] Accordingly, the present invention has been devised to solve the aforementioned conventional problems. According to an embodiment of the present invention, the purpose is to provide a structural damage management system and management method through the definition of a damaged object, which enables data linkage, accumulation, and monitoring by vectorizing a damaged object created by extracting damage from a 3D model and writing it on an unfolded 2D drawing, or by extracting damage from point cloud data generated by scanning, and recording it on the surface of the corresponding 3D model as an independent and quantifiable damage model.

[0012] According to an embodiment of the present invention, the purpose is to provide a structural damage management system and management method through the definition of damaged objects, which can significantly reduce the massive amount of data generated by directly mapping mechanized inspection data using laser scanning, lidar, photographic UAV scanning, etc., to three-dimensional objects, define individual independent damaged objects with unique IDs, define a damage model over time using accumulated environmental conditions, location, size, and direction data as a data processing technology, and provide a basis for a technology to predict future damage.

[0013] According to an embodiment of the present invention, the purpose is to provide a structural damage management system and a management method through the definition of a damaged object, which can generate a digital twin model at a realistic level and track the growth of damage over time by making it possible to record the exact location of individual damage on a three-dimensional object surface identical to the actual one.

[0014] Meanwhile, the technical problems to be solved by the present invention are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which the present invention belongs from the description below. means of solving the problem

[0015] The first objective of the present invention can be achieved as a structural damage management system through damage object definition, characterized by comprising: a 2D unfolded plane acquisition unit for acquiring a damage management surface for a damaged structure; a damage object data input unit for recording damage object data for each of the damage objects extracted on the unfolded plane; and a projection unit for projecting each of the damage objects including the damage object data onto an actual shape model.

[0016] And it may be characterized by further including a damaged object extraction unit that extracts each damaged object on the above-mentioned development plane.

[0017] In addition, it includes a reference coordinate setting unit for setting a reference point corresponding to a reference coordinate; and the damaged object data may be characterized by including a unique ID assigned to the damaged object, damage location data, and size data.

[0018] In addition, the above position data and size data may be characterized by being derived through the damage start point and direction vector by defining the reference point as relative coordinates in a plane.

[0019] In addition, the above unique ID may be characterized by being assigned according to the type of damage and information of the damage.

[0020] In addition, the above damaged object data may be characterized by including damage growth history data based on past history.

[0021] In addition, the above unique ID may be characterized by having the environmental conditions in which the structure is situated labeled together as metadata.

[0022] And the above 2D unfolding plane may be characterized by being obtained by integrating segmented images continuously captured with respect to the damage management plane.

[0023] In addition, the above damaged object data may be characterized by including depth data for the above damaged object.

[0024] And the damage extraction unit may be characterized by extracting line-shaped damage objects by applying a damage extraction algorithm built by CNN, a machine learning methodology, to the detected damage region from an image obtained through scanning.

[0025] In addition, the damage extraction unit may be characterized by extracting pixel values ​​of damage through image segmentation from an image containing damage, and defining them as lines or regions to extract damaged objects.

[0026] The second objective of the present invention can be achieved as a method for managing structural damage through the definition of a damaged object, characterized by comprising: a step of obtaining a damage management surface for a damaged structure as a 2D unfolded plane; a step of setting a reference point and a reference axis of a reference plane of the 2D unfolded plane; a step of extracting each damaged object on the unfolded plane; a step of recording and inputting damage object data for each extracted damaged object; and a step of projecting each damaged object containing the damage object data onto an actual shape model.

[0027] And in the above-mentioned recording and inputting step, the damaged object data includes a unique ID assigned to the damaged object, damage location data, and size data, wherein the location data and size data are derived through the damage start point and direction vector by defining a reference point as relative coordinates in a plane, and the unique ID may be characterized as being assigned according to the type of damage and damage information.

[0028] In addition, the above-mentioned damaged object data may be characterized by including damage growth history data based on past history.

[0029] In addition, the above unique ID may be characterized by having the environmental conditions in which the structure is situated labeled together with metadata, allowing for the simultaneous search and collection of damage occurring under specific conditions. Effects of the invention

[0030] According to the structural damage management system and management method through the definition of a damaged object according to an embodiment of the present invention, damage to a structure is extracted from a 3D model and written on an unfolded 2D drawing, or damage is extracted from point cloud data generated by scanning and the generated damaged object is vectorized, and recorded on the surface of the corresponding 3D model as an independent and quantifiable damage model, thereby having the effect of enabling data linkage, accumulation, and monitoring.

[0031] According to the structural damage management system and management method through the definition of damaged objects according to an embodiment of the present invention, the massive amount of data generated by directly mapping mechanized inspection data using laser scanning, LiDAR, photographic UAV scanning, etc., to 3D objects can be significantly reduced, and there is an advantage in that individual independent damaged objects are defined with a unique ID, and a damage model over time is defined using data processing technology with accumulated environmental conditions, location, size, and direction data, thereby providing a basis for a technology to predict future damage.

[0032] According to the structural damage management system and management method through the definition of a damaged object according to an embodiment of the present invention, the accurate location of individual damage can be recorded on a three-dimensional object surface identical to the actual one, thereby enabling the creation of a digital twin model at a realistic level and the tracking of the growth of damage over time.

[0033] Meanwhile, the effects obtainable from the present invention are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present invention belongs from the description below. Brief explanation of the drawing

[0034] The following drawings attached to this specification illustrate preferred embodiments of the present invention and serve to further enhance understanding of the technical concept of the present invention together with the detailed description of the invention; therefore, the present invention should not be interpreted as being limited only to the matters described in such drawings. FIG. 1 is a schematic diagram of a conventional structural damage recording method (the current damage recording method, which is not proportional to a bridge with a length of 40 meters and a width of 12 meters). Figure 2 is an example of a surface model obtained by post-processing scanned point cloud data, FIG. 3 is a technical example in which an external inspection network is image-processed and applied as a texture to a surface. FIG. 4 is a block diagram of a structural damage management system through the definition of a damaged object according to an embodiment of the present invention, FIG. 5 is a flowchart of a method for managing structural damage through the definition of a damaged object according to an embodiment of the present invention, FIG. 6 is a step-by-step schematic diagram of a method for managing structural damage through the definition of a damaged object according to an embodiment of the present invention. FIG. 7 is a process for recording damaged object data for a linear damaged object according to an embodiment of the present invention, FIG. 8 is a process for recording damaged object data for a surface-shaped damaged object according to an embodiment of the present invention, FIG. 9a is a schematic diagram of a damage extraction method using CNN according to an embodiment of the present invention, FIG. 9b is a schematic diagram of a method for extracting damage through image segmentation according to an embodiment of the present invention, FIG. 9c is a schematic diagram of a method for directly recording damage on an unfolded plane according to an embodiment of the present invention, FIG. 9d illustrates a schematic diagram of a method for extracting and recording damage in the case of concrete spalling damage according to an embodiment of the present invention. Specific details for implementing the invention

[0035] The above objects, other objects, features, and advantages of the present invention will be easily understood through the following preferred embodiments associated with the accompanying drawings. However, the present invention is not limited to the embodiments described herein and may be embodied in other forms. Rather, the embodiments introduced herein are provided to ensure that the disclosed content is thorough and complete and to ensure that the spirit of the invention is sufficiently conveyed to a person skilled in the art.

[0036] In this specification, when a component is described as being on another component, it means that it may be formed directly on the other component or that a third component may be interposed between them. Also, in the drawings, the thicknesses of the components are exaggerated for the effective description of the technical content.

[0037] The embodiments described herein will be explained with reference to cross-sectional and / or plan views, which are exemplary illustrations of the invention. In the drawings, the thicknesses of films and regions are exaggerated for effective explanation of the technical content. Accordingly, the shapes of the exemplary drawings may be modified by manufacturing techniques and / or tolerances, etc. Accordingly, the embodiments of the invention are not limited to the specific shapes depicted but include variations in shape produced according to the manufacturing process. For example, a region depicted as a right angle may be rounded or have a certain curvature. Accordingly, the regions illustrated in the drawings have properties, and the shapes of the regions illustrated in the drawings are intended to illustrate specific shapes of the regions of the device and are not intended to limit the scope of the invention. Although terms such as first, second, etc., have been used to describe various components in the various embodiments of this specification, these components should not be limited by such terms. These terms are used merely to distinguish one component from another. The embodiments described and illustrated herein also include their complementary embodiments.

[0038] The terms used herein are for describing the embodiments and are not intended to limit the invention. In this specification, the singular form includes the plural form unless specifically stated otherwise in the text. As used herein, 'comprises' and / or 'comprising' do not exclude the presence or addition of one or more other components to the mentioned components.

[0039] In describing the specific embodiments below, various specific details have been included to explain the invention more specifically and to aid understanding. However, a reader with sufficient knowledge in the art to understand the invention will recognize that it can be used without these various specific details. In some cases, it is noted in advance that commonly known parts that are not significantly related to the invention have been omitted to prevent unnecessary confusion in describing the invention.

[0041] Hereinafter, the configuration, function, and damage management method of a structural damage management system through the definition of a damaged object according to an embodiment of the present invention will be described.

[0042] First, FIG. 4 illustrates a block diagram of a structure damage management system through the definition of a damaged object according to an embodiment of the present invention.

[0043] And FIG. 5 illustrates a flowchart of a method for managing structural damage through the definition of a damaged object according to an embodiment of the present invention. Also, FIG. 6 illustrates a step-by-step schematic diagram of a method for managing structural damage through the definition of a damaged object according to an embodiment of the present invention.

[0044] A structure damage management system (100) through damage object definition according to an embodiment of the present invention may be configured to include an unfolded plane acquisition unit (10), a damage object extraction unit (30), a reference coordinate setting unit (20), a damage object data input unit (40), an actual shape model projection unit (50), etc.

[0045] First, when a damage recording structure (1), which is a component to input, record, and manage damage, is selected (S1), the 2D unfolded plane acquisition unit (10) is configured to acquire a 2D unfolded plane image of the damage management surface for the damage management structure (1) (S2).

[0046] This 2D development plane can be obtained by integrating segmented images taken continuously with respect to the damage management plane into a single image.

[0047] The reference coordinate setting unit (20) sets a reference point corresponding to the reference coordinate. That is, it sets a reference plane of the surface to be input with the damaged object (3) (S3), and sets a reference point and a reference axis of this reference plane (S4).

[0048] Then, the damaged object extraction unit (30) extracts each damaged object (3) on the unfolding plane (2) (S5).

[0049] Then, the damaged object data input unit (40) records the damaged object data (4) for each of the damaged objects (3) extracted on the unfolding plane (2) (S6). Finally, each of the damaged objects containing the damaged object data (4) is projected onto the actual shape model (S7).

[0050] The damaged object data (4) according to an embodiment of the present invention includes a unique ID, damage location data, and size data that are independently assigned to each damaged object (3). These location data and size data are derived through the damage start point and direction vector by defining a reference point as relative coordinates in a plane. Additionally, the unique ID is assigned according to the type of damage and information about the damage. That is, the damaged object (3) is assigned a name according to a unique ID system assigned according to the type and degree of damage in the unfolded plane.

[0051] In addition, the unique ID is labeled with metadata regarding the environmental conditions in which the structure (1) is situated, so that damage occurring under specific conditions can be searched and collected at once.

[0052] And the damaged object data (4) may include depth data for the damaged object (3), and the damaged object data (4) may include damage growth history data based on past history.

[0053] FIG. 7 illustrates the process of recording damaged object data for a linear damaged object according to an embodiment of the present invention. FIG. 8 illustrates the process of recording damaged object data for a planar damaged object according to an embodiment of the present invention.

[0054] As shown in FIGS. 7 and 8, the surface recording damage has a planar model unfolded to actual size from the original 3D model.

[0055] A 2D development plane is defined from the shape variable values ​​used in variable-based modeling, and the reference coordinates and the coordinates of each development plane are linked to each other.

[0056] As previously mentioned, each damaged object (3) is named according to a unique ID system assigned based on the type and degree of damage on the unfolded plane (2). The damaged object data (4) defines the reference point defining the damage as relative coordinates on the plane and has a size and direction vector as data.

[0057] From this, a record is automatically added to the corresponding surface of the linked 3D object. Since the unique ID defined for a specific member and part of the structure can be labeled with metadata about the environmental conditions the structure (1) faces, damage occurring under specific conditions can be searched and collected all at once.

[0058] Below, a method for extracting and recording a damaged object (3) through a damaged object extraction unit (30) will be described. FIG. 9a illustrates a schematic diagram of a method for extracting damage through CNN according to an embodiment of the present invention.

[0059] As shown in FIG. 9a, a line-shaped damaged object (3) is generated by applying a damage extraction algorithm built by CNN, a machine learning methodology, to the detected damage area from a photographic image through scanning and a morphology algorithm.

[0060] The damaged object (3) defined by this process calculates the reference point, size, and direction vector values ​​of the damage as previously defined and records them on a two-dimensional plane developed into an independent damaged object.

[0061] At this stage, to define the magnitude and direction of damage during the post-processing of point cloud data, a reference target of a fixed size is used, or the dimensions of the member are utilized to calculate relative values.

[0062] Recognizing a damaged object (3) may be a known technique, but the feature of the present invention is that the size and direction vector of the damaged object (3) are defined and included in the damaged object data for recording. When a corresponding surface is extracted from a 3D object model and recorded on this surface, the reference point and direction vector can be automatically calculated and converted into data.

[0063] FIG. 9b illustrates a schematic diagram of a method for extracting damage through image segmentation according to an embodiment of the present invention.

[0064] As illustrated in FIG. 9b, when damage extraction is not required, pixel values ​​of the damage are extracted from a photographic image containing damage through image segmentation and recorded as a digital damage object by defining them as lines or regions. In this case, reference points must also be defined in the image.

[0065] FIG. 9c illustrates a schematic diagram of a method for recording damage directly on a unfolded plane according to an embodiment of the present invention. As shown in FIG. 9c, a unfolded plane defined as a three-dimensional object on a tablet or mobile device can be displayed and damage can be recorded directly on it.

[0066] In this case, the drawn damage object immediately takes on meaning as a vectorized object and is recorded on the linked 3D object. The damage object consists of a damage ID, a starting point, a direction vector, and an object model. Using this, the damage can be accurately positioned on the 3D object.

[0067] FIG. 9d illustrates a schematic diagram of a method for extracting and recording damage in the case of concrete spalling damage according to an embodiment of the present invention.

[0068] As illustrated in Fig. 9d, in the case of concrete spalling, which is a three-dimensional form of damage, the object can be visualized at the time of initial discovery in the form of maximum depth and area based on a reference point, and the process of the scope expanding as the damage progresses can be represented. Additionally, it can be seen that the exposure of the rebar and the remaining concrete cover can be identified through overlay with an internal rebar model.

[0070] Accordingly, according to the structural damage management system and management method through the definition of a damaged object according to the embodiment of the present invention mentioned above, damage to a structure is extracted from a 3D model and written on an unfolded 2D drawing, or damage is extracted from point cloud data generated by scanning and the generated damaged object is vectorized, and recorded on the surface of the corresponding 3D model as an independent and quantifiable damage model, thereby enabling data linkage, accumulation, and monitoring.

[0071] In addition, according to the structural damage management system and management method through the definition of damaged objects according to the embodiment of the present invention, the massive amount of data generated by directly mapping mechanized inspection data using laser scanning, LiDAR, photographic UAV scanning, etc., to 3D objects can be significantly reduced, and individual independent damaged objects can be defined with a unique ID, and a damage model over time can be defined using data processing technology with accumulated environmental conditions, location, size, and direction data, thereby providing a foundation for a technology to predict future damage.

[0072] In addition, according to the structural damage management system and management method through the definition of a damaged object according to an embodiment of the present invention, the exact location of individual damage can be recorded on a three-dimensional object surface identical to the actual one, thereby enabling the creation of a digital twin model at a realistic level and the tracking of the growth of damage over time.

[0074] In addition, the device and method described above are not limited to the configurations and methods of the embodiments described above; rather, all or part of each embodiment may be selectively combined to allow for various modifications to be made. Explanation of the symbols

[0075] 1: Structure 2: Development plane 3: Damaged object 4: Damaged object data 10: Development plane acquisition unit 20: Reference Coordinate Setting Section 30: Damaged Object Extraction Unit 40: Damaged Object Data Input Section 50: Actual shape model projection 100: Structural Damage Management System through Damage Object Definition

Claims

Claim 1 A structural damage management system comprising: a 2D unfolded plane acquisition unit for acquiring a damage management surface for a damaged structure; a damage object data input unit for recording damage object data for each damaged object extracted on the unfolded plane; a projection unit for projecting each damaged object including the damage object data onto an actual shape model; and a damage object extraction unit for extracting each damaged object on the unfolded plane. and a reference coordinate setting unit for setting a reference point corresponding to the reference coordinates; wherein the 2D unfolding plane is obtained by integrating segmented images continuously captured with respect to the damage management surface; the damage object extraction unit extracts line-shaped damage objects by applying a damage extraction algorithm constructed by CNN, a machine learning methodology, to the detected damage area from the scanned image, and extracts damage objects by extracting pixel values ​​of damage through image segmentation from the image containing the damage and defining them as lines or areas; the damage object data includes a unique ID assigned to the damage object, damage location data, and size data; the location data and size data are derived through the damage start point and direction vector by defining the reference point as relative coordinates in a plane; the damage object data includes damage growth history data based on past history; the damage object data includes depth data for the damage object; the unique ID is labeled together with metadata regarding the environmental conditions facing the structure, and the location of individual damage is on a 3D object surface identical to the actual A structural damage management system through damage object definition characterized by generating a digital twin model by recording. Claim 2 delete Claim 3 delete Claim 4 delete Claim 5 A structural damage management system through damage object definition, characterized in that, in claim 1, the unique ID is assigned according to the type of damage and information of the damage. Claim 6 delete Claim 7 delete Claim 8 delete Claim 9 delete Claim 10 delete Claim 11 delete Claim 12 A method for managing structural damage using a structural damage management system through the definition of a damaged object according to claim 1, comprising: a step of obtaining a damage management surface for a damaged structure as a 2D unfolded plane; a step of setting a reference point and a reference axis of a reference plane of the 2D unfolded plane; a step of extracting each damaged object on the unfolded plane; a step of recording and inputting damage object data for each extracted damaged object; and a step of projecting each damaged object containing the damage object data onto an actual shape model. Claim 13 A method for managing structural damage through the definition of a damaged object, characterized in that, in the step of recording and inputting the above, the damaged object data includes a unique ID assigned to the damaged object, damage location data, and size data, wherein the location data and size data are derived through a damage start point and a direction vector by defining a reference point as relative coordinates in a plane, and the unique ID is assigned according to the type of damage and information of the damage. Claim 14 A method for managing structural damage through the definition of a damaged object, characterized in that, in Clause 13, the damaged object data includes damage growth history data based on past history. Claim 15 A method for managing structural damage through a damage object definition, characterized in that, in Clause 13, the unique ID is labeled with the environmental conditions to which the structure is situated as metadata, thereby enabling the search and collection of damage occurring under specific conditions at once. Claim 16 delete

Images