A method, apparatus, and storage medium for repairing damaged building components of various styles.

Abstract

This invention discloses a method, apparatus, and storage medium for repairing damaged architectural components of multiple styles, belonging to the field of architectural image library construction technology. The method includes constructing a reference image library composed of reference images of architectural components of several single styles; acquiring several images of the same architectural component to be repaired in a multi-style fusion building; preprocessing the images of the architectural component to be repaired; matching reference images with similarity higher than a similarity threshold; obtaining the defect location of the image of the architectural component to be repaired; fusing and reconstructing multiple images of the architectural component to be repaired with different defect locations to form a fused image of the architectural component; and manually reviewing the fused image of the architectural component and adding the compliant fused images to the reference image library. This invention establishes a reference image library by fusing and reconstructing images of damaged architectural components in multi-style fusion buildings, providing a reference for the subsequent repair of multi-style fusion architectural components and their digital images.

Description

[0001] Divisional application

[0002] This application is a divisional application of Chinese invention patent application filed on June 24, 2024 [Application No.: 2024108223548] [Invention Title: A Method and Apparatus for Repairing Damaged Building Components of Multiple Styles, and Storage Medium]. Technical Field

[0003] This invention belongs to the field of building repair technology, and in particular relates to a method, device, and storage medium for repairing damaged building components of various styles. Background Technology

[0004] Multi-style fusion architecture is an architectural form that combines elements of multiple different styles. This style typically integrates various architectural design elements to create a unique and distinctive building form. Multi-style fusion architecture can blend characteristics of different cultures, eras, and styles in its design, showcasing diversity and innovation.

[0005] Shanghai-style architecture is a typical example of multi-style fusion architecture, generally referring to the Shikumen and Lilong (lane) architectural forms with local characteristics that emerged in Shanghai during the first half of the 20th century. These buildings represent a part of Shanghai's history and culture and possess significant historical, cultural, and artistic value.

[0006] Many multi-style buildings, including Shanghai-style architecture, are currently facing certain challenges in their restoration and preservation, such as demolition and reconstruction, lack of maintenance and repair, planning conflicts, and damage from disasters. In order to better protect and inherit the cultural heritage of multi-style buildings and preserve their architectural features, database technology is being innovatively used to digitally preserve the decorative features of Shanghai-style buildings, facilitating subsequent restoration and repair processes.

[0007] In the actual use of the architectural digital image database, it was found that multi-style integrated buildings, due to their special characteristics, had a short period of popularity, covered a small area, and were extremely rare. Moreover, most of the surviving ancient buildings lacked repair and were quite dilapidated, making it difficult to find complete ones as references.

[0008] Chinese patent application CN202010352962.9 discloses a multi-directional repair system and method for damaged ancient building columns. The multi-directional repair system for damaged ancient building columns includes an image acquisition module, an image analysis module, a central control module, a repair location determination module, a damage degree measurement module, a three-dimensional modeling module, a repair simulation module, a repair scheme generation module, a feasibility analysis module, and a display module. The multi-directional repair method for damaged ancient building columns includes acquiring and analyzing images of the ancient building columns; determining the repair location and its area and depth; establishing a three-dimensional model of the column and simulating the repair operation; generating a repair scheme and analyzing its feasibility.

[0009] The aforementioned existing technologies mention methods for repairing ancient buildings by collecting architectural components and determining the repair locations and extent of damage. However, for multi-style buildings that are already extremely rare, it is difficult to find reference objects or / and reference images for repair. Repairs must rely on the restorers' own understanding of the building, and the final result is highly dependent on the restorers' expertise, lacking objectivity.

[0010] Most of the existing ancient buildings that blend various styles are severely damaged, and it is almost impossible to find complete architectural components that can be used directly as a reference for restoration. Summary of the Invention

[0011] The purpose of this invention is to provide a method, apparatus, and storage medium for repairing damaged building components of multiple styles, which partially solves or alleviates the above-mentioned deficiencies in the prior art. By fusing and reconstructing images of damaged building components of multi-style buildings, a reference library is established, providing a reference for the repair of multi-style buildings and their digital images.

[0012] To solve the aforementioned technical problems, the present invention specifically adopts the following technical solution:

[0013] A method for repairing damaged architectural components of various styles, comprising:

[0014] Construct a reference image library consisting of reference images of architectural components in several single styles;

[0015] Acquire several images of the same architectural component to be repaired in a multi-style fusion building;

[0016] The images of the building components to be repaired are preprocessed to extract the contour information of the building components in the images;

[0017] Calculate the similarity between the image of the building component to be repaired and the reference images of each building component in the reference image library, and match the reference images of the building components with a similarity higher than the similarity threshold;

[0018] The contour information of the building component image to be repaired is compared with the matched reference image of the building component to obtain the defect location of the building component image to be repaired.

[0019] Multiple images of building components with different missing locations are fused and reconstructed to form a fused image of the building component;

[0020] The fused images of the building components are manually reviewed, and those that meet the requirements are added to the reference image library.

[0021] As an improvement, the repair method further includes the step of:

[0022] The input image of the building component to be repaired is preprocessed to extract the contour information of the building component in the image;

[0023] The extracted contour information is compared with the corresponding main style reference image of the building component to be repaired in the reference image library to obtain the location and degree of damage of the building component to be repaired.

[0024] Based on the location and extent of the damage to the image of the building component to be repaired, match the fused image of the building component of multiple styles in the reference image library or the reference image of the building component in the reference image library;

[0025] By referencing a fused image of a multi-style building component from a reference image library or a single-style building component reference image from a reference image library, the building component image is repaired to obtain a repaired building component image.

[0026] As an improvement, the steps of matching fused images of multi-style architectural components from a reference image library or reference images of architectural components from a reference image library based on the location and degree of damage to the architectural component images specifically include:

[0027] The defect state of a building component image is obtained by using the location and degree of defect in the image.

[0028] Determine whether the defective state is within a preset first threshold interval, or a second threshold interval, or a third threshold interval;

[0029] When the defective state is within the first threshold range, the style of the building component image is determined to obtain the style of the building component image, and the fused image in the reference image library or the reference image in the reference image library is matched according to the style of the building component image.

[0030] If the defective state is within the second threshold range, match the corresponding fused image in the reference image library;

[0031] When the defective state is within the third threshold range, match the reference image of the building component in the reference image library that has the same main style as the damaged building component.

[0032] As an improvement, the image of the building component to be repaired is a 2D image and / or a 3D image, and the reference image of the building component includes a 2D reference image and a 3D point cloud reference image; the 2D reference image of the building component reference image includes 2D reference images at several angles.

[0033] As an improvement, in the case of acquiring images of architectural components to be repaired from multiple styles of buildings through on-site collection, 2D images and 3D point cloud images of architectural components from several angles are also collected.

[0034] As an improvement, the main style of the building in the image of the building component to be repaired is manually labeled in advance, and then the reference image of the building component that matches the main style of the image of the building component to be repaired is matched in the reference image with a similarity higher than the similarity threshold.

[0035] As an improvement, the degree of damage to the building component image to be repaired is obtained. When multiple images of building components with different damage locations are fused and reconstructed, the image of the building component to be repaired with a degree of damage less than a preset threshold is selected.

[0036] As an improvement, the age and region of the building components in the images of the building components to be repaired are manually labeled; when the defects in the fused image exceed the defect threshold, a reference image of a building component of the same age, region and main style is matched for fusion reconstruction, and the fused and reconstructed image is submitted to manual review, and the fused image that meets the requirements is added to the reference image library.

[0037] The present invention also provides a repair device for damaged building components of various styles, comprising:

[0038] The benchmark image library construction module is used to build a benchmark image library consisting of benchmark images of architectural components in several single styles.

[0039] The contour information extraction module acquires several images of the same building component to be repaired in a multi-style fusion building; it preprocesses the images of the building component to be repaired and extracts the contour information of the building component from the images of the building component to be repaired.

[0040] The similarity calculation module is used to calculate the similarity between the image of the building component to be repaired and the reference images of each building component in the reference image library, and to match the reference images with similarity higher than the similarity threshold.

[0041] The defect location comparison module is used to compare the contour information of the building component image to be repaired with the matched reference image of the building component to obtain the defect location of the building component image to be repaired.

[0042] The fusion and reconstruction module fuses and reconstructs multiple images of building components with different missing locations to form a fused image of the building component.

[0043] The reference image library construction module allows for manual review of the fused images of building components, adding fused images that meet the requirements to the reference image library.

[0044] As an improvement, it also includes: a secondary reconstruction module, which is used to manually label the age and region of the building components in the image of the building components to be repaired; when the defect of the fused image exceeds the defect threshold, it matches the reference image of the same age, region and main style for fusion reconstruction, and submits the fused image after fusion reconstruction to manual review, and adds the fused image that meets the requirements to the reference image library.

[0045] The present invention also provides a storage medium storing a computer program, which, when executed, enables the above-described method for constructing a digital drawing reference library for multi-style integrated architectural restoration.

[0046] A computer system includes a memory and a processor; the memory stores a computer program, which, when executed by the processor, enables the aforementioned method for constructing a digital drawing reference library for multi-style integrated architectural restoration.

[0047] The advantages of this invention are:

[0048] The present invention provides a method for repairing multi-style damaged building components. This method involves constructing a reference image library of building components in a single style (e.g., a dominant style or an external style) to obtain the location and extent of defects in the images of the building components to be repaired within a multi-style fusion building. Then, multiple images of the building components to be repaired with different defect locations are stitched together to form a fused multi-style image of the building component. This method is used to obtain multiple fused images to construct a reference library, which provides a reference for the repair of multi-style damaged building components or multi-style damaged buildings and their images.

[0049] In this invention, the fused image is composed of images of different damaged locations of the same multi-style building. Compared to relying on manual experience or images of other styles (including single-style or multi-style fusion) for restoration, its stylistic consistency can be maintained to the greatest extent. This ensures that when the restored fused image is used as a reference for further restoration of the building itself or its digital image, it can be integrated with the original style as much as possible, avoiding any jarring effect.

[0050] Furthermore, this invention employs manual (expert) review to verify the merged images. Experts' professional knowledge and artistic experience are used to evaluate the merged images, preventing them from deviating from the original style. Once a sufficient number of expert-approved merged images are accumulated and compiled into a library, they can be used for the restoration of buildings themselves and digital architectural images, significantly reducing the workload of experts and making the restoration work more efficient and instructive.

[0051] Finally, for fused images where the defects still exceed the threshold, the present invention further matches and reconstructs them with reference images of the same era, region and main style, and submits the reconstructed fused images for manual review, adding the fused images that meet the requirements to the reference image library. Attached Figure Description

[0052] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. In all the drawings, similar elements or parts are generally identified by similar reference numerals. The elements or parts in the drawings are not necessarily drawn to scale. Obviously, the drawings described below are some embodiments of the present invention, and those skilled in the art can obtain other drawings based on these drawings without any creative effort.

[0053] Figure 1 This is a flowchart of Embodiment 1 of the present invention;

[0054] Figure 2 This is a functional block diagram of Embodiment 2 of the present invention;

[0055] Figure 3 and Figure 4 Images of damaged buildings of various styles collected on-site;

[0056] Figure 5 This is a flowchart of Embodiment 3 of the present invention;

[0057] Figure 6 This is a functional block diagram of Embodiment 4 of the present invention. Detailed Implementation

[0058] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0059] In this document, suffixes such as "module," "part," or "unit" used to denote elements are used only for the purpose of illustrative purposes and have no specific meaning in themselves. Therefore, "module," "part," or "unit" may be used interchangeably.

[0060] In this document, the terms "upper," "lower," "inner," "outer," "front," "rear," "one end," and "the other end," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing the present invention and for simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the present invention. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0061] In this document, unless otherwise explicitly specified and limited, the terms "installed," "equipped with," "connected," etc., should be interpreted broadly. For example, "connection" can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection, a direct connection, or an indirect connection through an intermediate medium; it can be a connection within two components. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the specific circumstances.

[0062] In this document, "and / or" includes any and all combinations of one or more of the listed related items.

[0063] In this article, "multiple" means two or more, that is, it includes two, three, four, five, etc.

[0064] In this article, "multi-style fusion architecture" refers to buildings that integrate multiple architectural styles. Generally, multi-style fusion architecture is formed by incorporating an existing main style with some external styles. In multi-style buildings, some architectural components may represent the main style, while others may represent external styles. It's also possible that a single architectural component represents the main style while incorporating some external styles. Furthermore, the fusion is highly random; the location and extent of the fusion depend on the individual preferences of the craftsmen, and there is no universally applicable rule. Consequently, if any architectural component is damaged, the entire building is damaged, hence the term "damaged multi-style building."

[0065] In this article, "reference image" refers to an image of a complete standard architectural component of a single style. For example, an image of a complete standard architectural component with only the dominant style (e.g., a style characteristic of local architecture), or an image of a complete standard architectural component with only an imported style (e.g., a foreign or expatriate architectural style). Typically, for architectural components of a single style, there is only one reference image for each style. Specifically, this image can be obtained from various architecture-related textbooks or existing materials.

[0066] In this article, "complete image" refers to a single image obtained by stitching together multiple images of the same architectural component with different missing parts. This architectural component incorporates multiple styles; for example, it may be based on a primary style while incorporating at least one other style. The primary style refers to the architectural component in which most of its structure or outline adopts that style, while a small portion of its structure or outline adopts a different style.

[0067] Example 1: Chinese patent application CN202010352962.9 discloses a multi-directional repair system and method for damaged ancient building columns. The multi-directional repair system for damaged ancient building columns includes an image acquisition module, an image analysis module, a central control module, a repair location determination module, a damage degree measurement module, a three-dimensional modeling module, a repair simulation module, a repair scheme generation module, a feasibility analysis module, and a display module. The multi-directional repair method for damaged ancient building columns includes acquiring and analyzing images of the ancient building columns; determining the repair location and its area and depth; establishing a three-dimensional model of the column and simulating the repair operation; generating a repair scheme and analyzing its feasibility.

[0068] The aforementioned existing technologies mention methods for repairing ancient buildings by collecting architectural components and determining the repair locations and extent of damage. However, for multi-style buildings that are already extremely rare, it is difficult to find reference objects or / and reference images for repair. Repairs must rely on the restorers' own understanding of the building, and the final result is highly dependent on the restorers' expertise, lacking objectivity.

[0069] Most of the existing ancient buildings that blend various styles are severely damaged, and it is almost impossible to find complete architectural components that can be used directly as a reference for restoration.

[0070] like Figure 1 As shown, to solve the above-mentioned technical problems, this invention provides a method for repairing damaged building components of multiple styles. This method provides a reference for repair by constructing a digital reference library of multi-style integrated building components. The specific steps include:

[0071] S11 constructs a reference image library consisting of reference images of architectural components in several single styles.

[0072] The architectural components described in this invention include basic elements that make up a building, such as doors, beams, walls, and columns. Buildings of a single style, such as the Huizhou style, have distinctive characteristics and a long period of popularity, resulting in a large number of existing buildings and images. Accordingly, a corresponding reference image library can be established for each style.

[0073] In this implementation, the purpose of constructing the benchmark image library is to serve as a reference for the basic structure of the multi-style architectural component images that are expected to be repaired later. This will be explained in detail later and will not be repeated here.

[0074] Of course, to more closely resemble the image of the damaged building to be restored that incorporates multiple styles (or is called a multi-style fusion building) and / or its multi-style architectural components, a single-style building similar to the multi-style fusion building can be selected. For example, some multi-style fusion buildings are primarily Hui-style architecture, incorporating other elements. Therefore, this step can select a reference image of the architectural components of a Hui-style building.

[0075] In addition, for ease of use later, the reference image in this embodiment includes a 2D reference image and a 3D point cloud reference image; the 2D reference image of the reference image includes 2D reference images from several angles. Since there are many existing physical objects and images of single-style buildings, it is also relatively convenient to acquire 3D point clouds and multi-angle 2D images.

[0076] S12 acquires several images of the same building component to be repaired in a multi-style fusion building; preprocesses the images of the building component to be repaired, and extracts the outline information of the building component in the images of the building component to be repaired.

[0077] There are several ways to obtain images of architectural components to be repaired in multi-style integrated buildings: First, the building itself may be preserved, but a certain architectural component may be missing. In this case, on-site image acquisition can be performed (see [link to relevant documentation]). Figure 3 and Figure 4 In acquiring images of architectural components to be repaired from multiple architectural styles through on-site data collection, 2D images and 3D point cloud images of the architectural components from several angles were also collected.

[0078] Secondly, if the building has been completely destroyed and disappeared, leaving only some pictures or videos, it is necessary to disassemble the various building components as much as possible based on the remaining data to help with subsequent integration and reconstruction.

[0079] This embodiment uses a building component, such as a column, as an example. In this step, multiple images of columns from a multi-style fusion building can be obtained from the aforementioned channels (of course, the building components in these images are all incomplete). Naturally, the more images there are, the more information is available, and the greater the probability of successfully fusing and reconstructing a complete image.

[0080] After obtaining images of the architectural components to be repaired from a multi-style integrated building, these images may contain various background information and other information unrelated to the architectural components. Therefore, it is necessary to preprocess these images of the architectural components to be repaired, mainly by extracting their contour information to obtain the architectural component images of the damaged architectural components themselves, for subsequent comparison.

[0081] In addition, the age and region of the building components in the images of the building components to be repaired can be manually marked.

[0082] S13 calculates the similarity between the image of the building component to be repaired and the reference image of the building component in the reference image library, and matches the reference image with a similarity higher than the similarity threshold.

[0083] Since there are no complete physical objects or images of the building components to be repaired for reference, it is difficult to determine the specific location and extent of the damage. A reference image library actually provides a rough reference. For example, even if columns differ in style, their basic structure is similar, with only decorative patterns and sculptures differing. Therefore, comparing with a reference image can still provide a general understanding of the damage. Preferably, a similarity comparison is performed based on the aforementioned contour information. If multiple images have a similarity threshold, the one with the highest similarity is used as the reference image for comparison. Preferably, the image with the most complete contour information from several images of the building components to be repaired is selected and its similarity is calculated with the reference images of each building component.

[0084] In this implementation, since the reference image library includes reference images of architectural components of various single styles, such as reference images of Hui-style columns, reference images of other single-style columns that differ significantly from the Hui-style style, and reference images of columns of other styles similar to the Hui-style style, the main style of the architectural component image to be repaired or the main style of the building in the architectural component image can be manually annotated in advance. Then, reference images matching the main style of the architectural component image to be repaired can be found among reference images with a similarity higher than a similarity threshold. Of course, in some embodiments, AI annotation can also be used, but its accuracy is not as high as that of manual annotation.

[0085] For example, if the building component to be repaired is a fusion of Huizhou architectural style and other architectural elements, its main style can be manually labeled during preprocessing. Then, in this implementation, provided that the similarity requirement is met, a reference image of a building component with the same main style can be selected, making the reference image of the building component closer to the shape of the building component to be repaired.

[0086] In order to make the similarity calculation more accurate and find a reference image that is closer to the image of the building component to be repaired, the reference image in this implementation should be acquired as much as possible as 3D point cloud images and multi-angle 2D images.

[0087] Furthermore, calculating the similarity between images is a prior art technique and will not be elaborated upon in this invention. For example:

[0088] Commonly used methods for calculating similarity between 2D images include:

[0089] Perceptual Hashing: Maps images to fixed-length hash values ​​and evaluates the similarity between two images by comparing their hash values.

[0090] Structural Similarity Index (SSIM): This measure of similarity between two images is achieved by comparing their brightness, contrast, and structural information. It is typically used to evaluate image quality.

[0091] Histogram Similarity: Compares the color histograms of images and evaluates the similarity between them by calculating the distance between the histograms.

[0092] Common methods for calculating similarity between 3D images include:

[0093] 3D shape matching: Features are extracted from 3D shapes, and then the similarity between two 3D shapes is compared through feature matching.

[0094] 3D mesh alignment: Register or align 3D mesh models, and then evaluate the similarity between 3D models by comparing the differences between mesh coordinates or vertices.

[0095] 3D point cloud registration: Register two 3D point clouds and then evaluate their similarity by measuring the differences between the point cloud transformations.

[0096] S14 compares the contour information of the building component image to be repaired with the matched reference image of the building component to obtain the location of the defect in the building component to be repaired.

[0097] After selecting a suitable reference image, the comparison can be performed.

[0098] When the image of the building component to be repaired is a 3D point cloud, the defect of the building component to be repaired can be obtained by subtracting the 3D point cloud image of the building component to be repaired from the 3D point cloud reference image.

[0099] When the image of the building component to be repaired is a 2D image, the image of the building component to be repaired and the reference image are first segmented into instances. The segmented building components are then compared, and the missing parts are the defects of the building components.

[0100] S15 fuses and reconstructs multiple images of building components with different missing locations to form a fused image of the building component.

[0101] The difficulty in existing technologies is that there are no complete images of building components available for reference. The problem that this invention aims to solve is to combine existing images of a building component with defects in order to construct a complete image of that building component (i.e., a fused image).

[0102] Since the missing locations of each image were identified in the previous step, theoretically, a complete image of the architectural component can be obtained by stitching together multiple images with different missing locations. For example, image A is missing the base of a column, and image B is missing part of the relief on the column; therefore, simply stitching the two together will yield a complete image of the column. Images A and B can be images of the same architectural component on different buildings, or images of the same architectural component on the same building. They can also be images of the same architectural component taken at different times, showing different missing locations and / or degrees of damage.

[0103] Of course, since there are multiple images, it is possible that two images have the same missing location. Therefore, when fusing and reconstructing, the one with the smaller degree of missing is selected. That is, the missing degree of the building component image to be repaired is obtained. When fusing and reconstructing multiple images of building components to be repaired with different missing locations, the one with the missing degree less than the degree threshold is selected.

[0104] S16 manually reviews the fused images of building components and adds fused images that meet the requirements to the reference library.

[0105] In the previous step, multiple images of the building components to be repaired were merged and reconstructed to obtain a fused image. Although images of the same building components from the same multi-style fusion architecture were used, the elements of multi-style fusion architecture are quite complex, and even within the same style, there will be differences between different buildings. Therefore, in this step, it is also necessary to review the fused image to determine whether it conforms to the style.

[0106] Determining the style is actually a rather subjective judgment, which is difficult to accomplish by AI. Therefore, in this step, it is recommended to use human review, so that experts can judge whether the image meets the requirements based on their in-depth understanding of architectural styles.

[0107] Images that meet the requirements can be added to the library for future reference when restoring electronic images of the multi-style fusion building or the building itself.

[0108] S17 If the defect in the fused image exceeds the defect threshold, it matches a reference image of the same era, region and main style for fusion reconstruction, and submits the fused image after reconstruction to manual review. The fused image that meets the requirements is added to the reference image library.

[0109] It is possible that even if multiple images to be repaired are merged, they cannot be pieced together into a complete architectural component image, thus requiring further fusion and reconstruction.

[0110] Step S12 marks the era and region of the building components to be repaired. If the defect in the fused image exceeds a defect threshold, such as 5%, a reference image of the same era, region, and main style is found from the reference image library for fusion reconstruction. Of course, the fused image reconstructed by this method is more likely to be unacceptable, so it also needs to be manually reviewed and approved before being added to the reference image library.

[0111] Once the reference image library is constructed, it can be used to repair building components. For example, an image of the building component to be repaired is input into the system, its contour information is extracted, and a corresponding reference image of the building component is matched based on this contour information for repair. Specifically, the method also includes:

[0112] S18 preprocesses the input image of the building component to be repaired and extracts the contour information of the damaged building component in the image.

[0113] As mentioned earlier, the purpose of obtaining the outline information of building components in the image of building components is to obtain the extent of damage to the building components.

[0114] S19 compares the contour information extracted in step S18 with a reference image in the reference image library that has the same main style as the damaged building component to obtain the location and degree of damage of the image of the building component to be repaired.

[0115] Understandably, the style of the reference image of the building component should match the main style of the building component to be repaired, so as to accurately reconstruct the damage to the building component image. Therefore, a reference image with the same main style is first matched in the reference image library, and then compared with the matched reference image to determine the location and extent of the damage. Since there is only one reference image for each style of building component in the reference image library, once the name and main style of the damaged building component are known (e.g., manually labeled or entered), the system can match a reference image with the same main style in the reference image library.

[0116] When the building component image is a 3D point cloud, the defect of the building component to be repaired can be obtained by directly subtracting the 3D point cloud image of the building component from the 3D point cloud reference image.

[0117] When the building component image is a 2D image, the building component image and the reference image are first segmented into instances. The segmented building components are then compared, and the missing parts are the defects of the building components.

[0118] For a building that blends multiple styles, its architectural components may be complete or incomplete and damaged. This step can determine whether the architectural component image is damaged and the extent of the damage. Of course, for complete architectural component images, the next step of architectural component image restoration work is unnecessary. Alternatively, the complete architectural component image can be added to the image library as a reference image during restoration.

[0119] S20 matches the image of the building component to be repaired with a fused image of a multi-style building component in the reference image library or a reference image of the building component in the reference image library, based on the location and degree of the defect.

[0120] Because the fusion of styles in multi-style architecture is quite complex, when it is possible to determine whether a building component is in the primary style, a primary style fused with other styles, or purely an other style, the style of the building component should be determined first. Then, based on the style of the building component, the appropriate method for repair is determined: whether to use the complete image (multi-style fusion) or the baseline image (single style, including both primary and other styles) for repair.

[0121] Furthermore, when the damage to a building component exceeds a certain level, it becomes difficult to determine which of the aforementioned styles it belongs to. Therefore, this embodiment also includes the following steps:

[0122] First, the defect state of the building component image is obtained based on the location and degree of the defect. Specifically, the defect state = a * defect location score + b * defect degree score, where a and b are defect coefficients. For example, using a 100-point scale, if the defect location is at a corner, the defect location score is 5; if the defect location is at the edge, the defect location score is 10; if the defect location is in the middle, the defect location score is 15. Then, the score is calculated by multiplying the number of defects at each location by the corresponding score, and so on. If the defect area is less than 5%, the defect degree score is 50; if the defect area is between 5% and 10%, the defect degree score is 70; if the defect area is more than 10%, the defect degree score is 100, and so on. The specific values ​​of the defect coefficients can be adjusted according to the actual situation, for example, a is 35% and b is 75%. Finally, the lower the defect state score, the higher the integrity of the building component.

[0123] Then, it is determined whether the calculated defect state is within a preset first threshold interval, second threshold interval, or third threshold interval. If the defect state is within the first threshold interval, the style of the building component image is determined to obtain the style of the building component image, and the style of the building component image is matched with the fused image of multi-style building components in the reference image library or the reference image of the building component in the reference image library. If the defect state is within the second threshold interval, the fused image of multi-style building components in the reference image library is matched. If the defect state is within the third threshold interval, the reference image in the reference image library with the same main style as the building component is matched.

[0124] When the defect is within the first threshold interval, it indicates that the style of the building component's defect can be determined. If it is determined to be a single style, a reference image of that single style can be matched; if it is determined to be a fusion of multiple styles, a complete image of the fusion of multiple styles can be matched. When the defect is within the second threshold interval, it indicates that the style of the building component cannot be determined. In this case, the probability of meeting the requirements after repair using a complete image of the fusion of multiple styles is higher, so a complete image of the fusion of multiple styles is matched. Specifically, since there are various ways to fuse multiple styles, even if multiple styles are manually labeled in advance, multiple complete images may still be matched. Therefore, the complete image with the highest similarity is matched from the multiple matched complete images. For example, the similarity between the contour information and the contour information of the corresponding area in the complete image is calculated, and the complete image with the highest similarity is matched. When the defect is within the third threshold interval, it indicates that the style of the building component cannot be determined and the degree of defect is very serious. In this case, the probability of success is highest when using a reference image of its main style for repair. It can be understood that in this embodiment, the first threshold interval < the second threshold interval < the third threshold interval.

[0125] S21 refers to the fused image of multi-style building components in the reference image library or the reference image of a single-style building component in the reference image library, and repairs the image of the building component to be repaired to obtain the repaired image of the building component.

[0126] With a reference image available, the building components can be repaired according to the reference image. During repair, the positions will be filled in based on the reference image.

[0127] Example 2: As Figure 2 As shown, the present invention also provides a repair device for damaged building components of multiple styles, which provides repair reference sample images for building component repair by constructing a digital pattern reference library for building repair that integrates multiple styles. Specifically, it includes:

[0128] The benchmark image library construction module is used to build a benchmark image library consisting of benchmark images of architectural components in several single styles.

[0129] The contour information extraction module acquires several images of the same building component to be repaired in a multi-style fusion building; it preprocesses the images of the building component to be repaired and extracts the contour information of the building component from the images of the building component to be repaired.

[0130] The similarity calculation module is used to calculate the similarity between the image of the building component to be repaired and the reference image of the building component in the reference image library, and to match the reference image with a similarity higher than the similarity threshold.

[0131] The defect location comparison module is used to compare the contour information of the building component image to be repaired with the matched reference image of the building component to obtain the defect location of the building component image to be repaired.

[0132] The fusion and reconstruction module fuses and reconstructs multiple images of building components with different missing locations to form a fused image of the building component.

[0133] The reference image library construction module allows for manual review of the fused images of building components, adding fused images that meet the requirements to the reference image library.

[0134] In some embodiments, the repair device further includes: a secondary reconstruction module, used to manually mark the age and region of the building components in the building component image to be repaired; when the defect of the fused image exceeds the defect threshold, to match the reference image of the same age, region and main style for fusion reconstruction, and to submit the fused image after fusion reconstruction to manual review, and to add the fused image that meets the requirements to the reference image library.

[0135] In some embodiments, the repair device further includes: a preprocessing module for preprocessing the input image of the building component to be repaired and extracting the contour information of the building component in the image; a defect acquisition module for comparing the contour information of the building component to be repaired with a reference image of the building component to be repaired in a reference image library to obtain the defect location and degree of defect in the image of the building component to be repaired; a matching module for matching a complete image of a building component of a multi-style fusion building in a reference image library or a reference image of the building component in a reference image library according to the defect location and degree of defect in the image of the building component to be repaired; and a building component image repair module for repairing the image of the building component to be repaired by referring to the matched complete image of a building component of a multi-style fusion building in a reference image library or the reference image of the building component to be repaired in a reference image library to obtain a repaired image of the building component to be repaired.

[0136] Example 3: So-called multi-style fusion architecture refers to buildings that integrate multiple architectural styles. Generally, multi-style fusion architecture is formed by combining an existing main style with some foreign styles. In multi-style buildings, some architectural components may be of the main style, while others may be of foreign styles. It is also possible that a certain architectural component is a combination of the main style and some foreign styles. Furthermore, the fusion is highly random; the location and degree of fusion are based on the personal preferences of the craftsmen, without a universal rule, making restoration difficult after the building is damaged.

[0137] In response to the above technical problems, such as Figure 5 As shown, this invention provides a method for repairing damaged buildings of multiple styles (i.e., damaged buildings with a blend of multiple styles). This method repairs digital images of damaged buildings of multiple styles based on the digital pattern reference library constructed in Example 1, and also uses the baseline image library constructed in Example 1. The specific steps of this invention include:

[0138] S1 decomposes the building image to be repaired and obtains individual building component images of each building component in the building image to be repaired.

[0139] In some embodiments, after obtaining an image of a multi-style fusion building to be repaired, it is necessary to decompose it into images of building components.

[0140] There are several ways to obtain images of multi-style architectural structures awaiting restoration: First, the building itself may remain, but some structural components may be missing. In this case, on-site data collection is possible. When obtaining images of the structural components of a multi-style architectural structure awaiting restoration through on-site data collection, 2D images and 3D point cloud images of the structural components from several angles should be acquired.

[0141] Secondly, if the building has been completely destroyed and only some pictures or videos remain, it is necessary to decompose the individual building components as much as possible based on the remaining data. The decomposition method can use an artificial intelligence model for instance segmentation, separating each building component into individual building component images. Instance segmentation is existing technology and will not be elaborated upon in this invention.

[0142] In addition, the era and region of buildings with multiple styles in the architectural images to be restored can be manually marked.

[0143] S2 preprocesses the images of each building component to extract the contour information of the building components from the images.

[0144] Similar to Example 1, the purpose of obtaining the outline information of the building components in the building component image is to obtain the damage status of the building components. For the specific method, please refer to Example 1, and it will not be repeated in this example.

[0145] S3 compares the outline information of the building component with the main style reference image of the building component in the reference image library to obtain the location and degree of damage of the building component image.

[0146] Understandably, the style of the reference image of the building component should match the main style of the multi-style fusion building to be repaired. This allows for the most accurate reconstruction of the missing parts in the building component image. Therefore, given the main style of the building, a reference image with the same main style as the building (i.e., the reference image of the building component's main style) can be matched from the reference image library, and then compared to determine the location and extent of the damage. Since there is only one reference image for each style of building component in the reference image library, once the name of the damaged building component and the corresponding main style of the building are known (e.g., manually labeled or entered), the system can match a reference image with the same main style as the building in the reference image library.

[0147] When the building component image is a 3D point cloud, the defect of the building component to be repaired can be obtained by directly subtracting the 3D point cloud image of the building component from the 3D point cloud reference image.

[0148] When the building component image is a 2D image, the building component image and the reference image are first segmented into instances. The segmented building components are then compared, and the missing parts are the defects of the building components.

[0149] For a building that blends multiple styles, its architectural components may be complete or incomplete and damaged. This step can determine whether the architectural component image is damaged and the extent of the damage. Of course, for complete architectural component images, the next step of architectural component image restoration work is unnecessary. Alternatively, the complete architectural component image can be added to the image library as a reference image during restoration.

[0150] S4 matches the complete image of the architectural component from the reference image library or the reference image of the architectural component from the reference image library based on the location and degree of the missing part.

[0151] Because the fusion of styles in multi-style architecture is quite complex, when it is possible to determine whether a building component is in the primary style, a primary style fused with other styles, or purely an other style, the style of the building component should be determined first. Then, based on the style of the building component, the appropriate method for repair is determined: whether to use the complete image (multi-style fusion) or the baseline image (single style, including both primary and other styles) for repair.

[0152] Furthermore, when the damage to a building component exceeds a certain level, it becomes difficult to determine which of the aforementioned styles it belongs to. Therefore, this embodiment also includes the following steps:

[0153] S41 uses the location and degree of damage of the building component image to obtain the damage state of the building component image.

[0154] Specifically, the steps for obtaining the defect state of building component images include:

[0155] The defect status is calculated as follows: a * defect location score + b * defect severity score, where a and b are defect coefficients. For example, using a 100-point scale, a defect at a corner receives a score of 5; a defect at an edge receives 10; a defect in the center receives 15. The score is then multiplied by the number of defects at each location, and so on. A defect severity score is 50 for a defect area less than 5%; 70 for a defect area between 5% and 10%; and 100 for a defect area greater than 10%, and so on. The specific values ​​of the defect coefficients can be adjusted according to the actual situation; for example, a could be 35% and b could be 75%.

[0156] The lower the score of the missing state, the higher the integrity of the building component.

[0157] S42, when the defective state is within the first threshold range, determines the style of the building component image, obtains the style of the building component image, and matches the complete image of the building component of the multi-style fused building in the reference image library or the reference image of the building component in the reference image library according to the style of the building component image.

[0158] When the defective state falls within the first threshold range, it indicates that the style of the architectural component's defect can be determined. Specifically, this is done by manually labeling the style type beforehand (e.g., labeling the image with the corresponding style for a single-style image, and labeling the multiple styles for a multi-style fusion). If the image is determined to be a single style, a base image of that single style (i.e., the same style) is matched; if the image is determined to be a multi-style fusion, a complete image of the corresponding multi-style fusion is matched.

[0159] S43 matches complete images of architectural components of multi-style fusion buildings in the reference image library when the defective state is within the second threshold range.

[0160] When the missing state falls within the second threshold range, it indicates that the style of the architectural component cannot be determined. In this case, the probability of meeting the requirements after repair using a complete image fused from multiple styles is higher. Therefore, the corresponding complete image fused from multiple styles is matched. Specifically, since there are various ways to fuse multiple styles, even if multiple styles are manually labeled beforehand, multiple complete images may still be matched. Therefore, the complete image with the highest similarity is matched from the multiple matched complete images. For example, the similarity between the contour information and the contour information of the corresponding region in the complete image is calculated, and the complete image with the highest similarity is matched.

[0161] S44 matches the reference image of the main style of the building component in the reference image library when the defective state is within the third threshold range.

[0162] When the defect is within the third threshold range, it means that the architectural component is no longer able to determine the degree of style defect and is already very serious. In this case, using the baseline image of the main style for repair has the highest probability of success.

[0163] It is understood that in this embodiment, the first threshold interval < the second threshold interval < the third threshold interval.

[0164] The S5 reference matching uses a reference library containing complete images of architectural components from multiple styles of buildings or a reference image of the architectural component from a reference image library to repair the architectural component image and obtain a repaired architectural component image.

[0165] With a reference image available, the building components can be repaired according to the reference image. During repair, the positions will be filled in based on the reference image.

[0166] S6 uses building component repair images to restore the building image to be repaired and obtain the restored building image.

[0167] After obtaining the repair images of all the building components (of course, the original complete building component images can be used directly), all the building component images are assembled to obtain the final restored building image.

[0168] In reality, it's impossible to know whether the restored architectural image will meet the requirements; the restored image might even have a jarring style that doesn't meet the specifications. Therefore, after obtaining the restored architectural image, further processing is necessary.

[0169] S7 calculates the degree of manual review based on the defect status of each building component image in the building image to be repaired. If the degree of manual review exceeds the manual review threshold, the restored building image will be submitted to a human reviewer.

[0170] The "damaged state" represents the condition of missing building components. If the degree of damage to the entire building is relatively low, there is confidence in the repair process described above. Therefore, it can be considered that the restoration has been successful and no further steps need to be taken.

[0171] However, when the damage to the entire building exceeds a certain threshold, it is necessary to conduct a manual review, with experts analyzing whether the repair work is up to standard.

[0172] In this step, the method for calculating the degree of manual review based on the defect status of each building component image in the building image to be repaired includes:

[0173] S71 categorizes architectural components into several classes based on their impact on the overall architectural style, and sets a manual review coefficient for the images of each class of architectural components.

[0174] For example, external, more conspicuous building components are grouped into one category, less conspicuous ones into another, and internal, less conspicuous components into yet another. The first category is assigned a higher weight; the second category has a lower weight, and the third category has the lowest weight. The manual review coefficient is then adaptively set based on the weight of each category.

[0175] S72 calculates the average number of defect states in the images of each type of building component, and adjusts the average number by the manual review coefficient of the images of that type of building component to obtain the manual review degree of the images of a single type of building component.

[0176] For example, there are 5 types of building components in the first category. After obtaining the average number of defective building components of this type, multiplying it by the artificial approval coefficient will give the artificial approval degree of this type of building component.

[0177] S73 takes the sum of the manual review scores of all single-class building component images as the manual review score of the building image to be repaired.

[0178] Continuing with the previous example, by summing the human review rates of the three types of building components, we can obtain the human review rate of the entire building.

[0179] Finally, by comparing the degree of manual review with the manual review threshold, it can be determined whether the restored architectural image still needs to be manually reviewed.

[0180] S8 replaces the reference image of the building component with the one in the third threshold range for secondary repair without passing manual review, and obtains a secondary repair image of the building component; replaces the repair image of the building component with the secondary repair image of the building component, and then performs secondary restoration on the building image to be repaired to obtain a secondary restored building image; and performs secondary manual review on the secondary restored building image.

[0181] After manual review by experts, it was determined that the restored architectural image had an jarring style and did not meet the requirements, indicating a problem with the restored architectural component images. At this point, an adjustment to the restoration strategy was necessary.

[0182] The most likely source of problems is the image of the building component whose defect state falls within the third threshold range. In the original strategy, this image was referenced using a baseline image of the main style, but this did not meet the requirements. Therefore, in this step, a complete image fused from multiple styles is used for repair, resulting in a secondary repaired image of the building component.

[0183] Images of building components with defects within the first and second threshold ranges are repaired unchanged according to the original strategy.

[0184] The images are then pieced together again to obtain a second, reconstructed architectural image. This second, reconstructed image then needs to be manually reviewed to determine its suitability.

[0185] S9 If the secondary manual review is not passed, the reference image of the building component in the second threshold range is replaced for secondary repair; the repair image of the building component is replaced by the secondary repair image of the building component, and the building image to be repaired is restored three times to obtain the three-restored building image; the three-restored building image is subject to three manual reviews.

[0186] After manual review by experts, it was determined that the architectural image after secondary restoration still had an abrupt style and did not meet the requirements. This may indicate that there was a problem with the repair of the architectural components in the second threshold range that were in a defective state.

[0187] In the original strategy, the images of the building components with defects within the second threshold range were referenced using a complete image fused from multiple styles, but this did not meet the requirements. Therefore, in this step, a reference image of the main style is used for repair, forming a secondary repaired image of the building component.

[0188] Images of building components with defects within the first and third threshold intervals are repaired unchanged according to the original strategy.

[0189] Then, the images are pieced together and restored three times to obtain the final restored architectural image. These three restored images then require further manual review to determine their suitability.

[0190] S10 If the three manual reviews are not passed, the reference images of the building components in the second and third threshold ranges of the defect state are replaced for secondary repair. The repaired image of the building component is replaced by the secondary repaired image of the building component. The building image to be repaired is restored four times to obtain the four-restored building image. The four-restored building image is then subject to four manual reviews.

[0191] After manual review by experts, it was determined that the architectural images after three restorations still had an abrupt style and did not meet the requirements. This may be because the repair of architectural components in the second and third threshold ranges of the defective state had problems.

[0192] In the original strategy, the images of building components with defects within the third threshold range were referenced using a base image of the main style; the images of building components with defects within the second threshold range were referenced using a complete image fused from multiple styles, but this did not meet the requirements. Therefore, in this step, the images of building components with defects within the second threshold range are repaired using the base image of the main style, forming a secondary repaired image of the building component. The images of building components with defects within the third threshold range are repaired using a complete image fused from multiple styles, forming a secondary repaired image of the building component.

[0193] Images of building components with defects within the first threshold range are repaired unchanged according to the original strategy.

[0194] Then, the images are pieced together and restored four times to obtain the final architectural image. These four restored images then undergo manual review to determine their suitability.

[0195] S11, without passing four rounds of manual review, uses architectural images of the same era, region, and main style as references for restoration based on the main style of the architectural image to be restored.

[0196] If all four restoration attempts fail to pass manual review, the only recourse is to obtain architectural images from the same era and region with the same main style as the building to be restored, and use them as a reference for restoration.

[0197] It is foreseeable that the results of this restoration will still need to be reviewed manually. If the manual review fails again, it means that automatic restoration is hopeless, and the restoration work will have to be taken over entirely by humans.

[0198] Example 4: Figure 6 As shown, the present invention also provides a repair device for damaged buildings of various styles, comprising:

[0199] The decomposition module is used to decompose the building image to be repaired and obtain individual building component images of each building component in the building image to be repaired.

[0200] The preprocessing module preprocesses the images of each building component and extracts the contour information of the building components from the images.

[0201] The defect acquisition module is used to compare the outline information of the building component with the reference image of the building component in the reference image library to obtain the defect location and degree of defect in the building component image;

[0202] The matching module is used to match complete images of architectural components from a multi-style fusion building in a reference image library or a reference image of the architectural component in a reference image library based on the location and degree of the missing parts in the architectural component image.

[0203] The building component image restoration module is used to restore the building component image by referring to the complete image of the building component of a multi-style fusion building in the reference image library or the reference image of the building component in the reference image library to obtain the restored image of the building component.

[0204] The building image restoration module uses building component restoration images to restore the building image to be restored, obtaining the restored building image.

[0205] In some embodiments, the matching module specifically includes:

[0206] The defect state acquisition unit is used to acquire the defect state of the building component image by utilizing the defect location and degree of defect in the building component image;

[0207] The judgment unit is used to determine whether the defect state of the building construction image is within a first threshold interval, or a second threshold interval, or a third threshold region.

[0208] The first reference image acquisition unit is used to determine the main style of the building component image when the judgment unit determines that the defect state of the building component image is within the first threshold range, obtain the style of the building component image, and match the complete image of the building component of the multi-style fused building in the reference image library or the reference image of the building component in the reference image library according to the style of the building component image.

[0209] The second reference image acquisition unit is used to match complete images of architectural components of multi-style fusion buildings in the reference image library when the judgment unit determines that the defect state of the building construction image is within the second threshold range.

[0210] The third reference image acquisition unit is used to match the reference image of the main style of the building component in the reference image library when the judgment unit determines that the defect state of the building construction image is within the third threshold range.

[0211] The present invention also provides a computer-readable storage medium storing a computer program; when the computer program is executed, the above-mentioned repair methods for damaged buildings or damaged building components of various styles can be implemented.

[0212] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0213] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a computer terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0214] The embodiments of the present invention have been described above with reference to the accompanying drawings. However, the present invention is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of the present invention without departing from the spirit and scope of the claims. All of these forms are within the protection scope of the present invention.

Claims

1. A method for repairing damaged architectural components of various styles, characterized in that... include: Construct a reference image library consisting of reference images of architectural components in several single styles; Acquire several images of the same architectural component to be repaired in a multi-style fusion building; The images of the building components to be repaired are preprocessed to extract the contour information of the building components in the images; Calculate the similarity between the image of the building component to be repaired and the reference images of the building components in the reference image library, and match the reference images of the building components with a similarity higher than the similarity threshold; The contour information of the building component image to be repaired is compared with the matched reference image of the building component to obtain the defect location of the building component image to be repaired. Multiple images of building components with different missing locations are fused and reconstructed to form a fused image of the building component. The multiple images of building components with different missing locations are images of the same building component on different buildings. When two images have the same missing location, the degree of missingness of the building component image is obtained. When fusing and reconstructing multiple images of building components with different missing locations, the building component image with a degree of missingness less than the degree threshold is selected. The fused images of building components are manually reviewed, and those that meet the requirements are added to a reference library for repair purposes.

2. The method for repairing damaged architectural components of multiple styles according to claim 1, characterized in that... It also includes the following steps: The input image of the building component to be repaired is preprocessed to extract the contour information of the damaged building component in the image; The extracted contour information is compared with a reference image in the reference image library that has the same main style as the damaged building component to obtain the location and degree of damage of the building component to be repaired. The image of the building component to be repaired is matched with a fused image of a multi-style building component in the reference image library or a reference image of a building component in the reference image library based on the location and degree of the defect. By referring to the fused image of multi-style building components in the reference image library or the reference image of a single-style building component in the reference image library, the image of the building component to be repaired is repaired to obtain a repaired image of the building component; The step of matching a fused image of a multi-style building component from a reference image library or a reference image of a building component from a reference image library with the location and extent of the damage to the image of the building component to be repaired specifically includes: The defect state of the building component image to be repaired is obtained by using the location and degree of the defect. Determine whether the defective state is within a preset first threshold interval, or a second threshold interval, or a third threshold interval; When the defective state is within the first threshold range, the style of the image of the building component to be repaired is determined to obtain the style of the image of the building component to be repaired, and the fused image in the reference image library or the reference image in the reference image library is matched according to the style of the image of the building component to be repaired. If the defective state is within the second threshold range, match the corresponding fused image in the reference image library; If the defective state is within the third threshold range, match the reference image of the building component in the reference image library that has the same main style as the damaged building component.

3. The method for repairing damaged architectural components of multiple styles according to claim 2, characterized in that: When the defective state is within the second threshold range, the step of matching the corresponding fused image in the reference image library specifically includes: when multiple fused images are matched, calculating the similarity between the contour information of the building component to be repaired and the contour information of the corresponding area in the matched fused images, and selecting the fused image with the highest similarity.

4. The method for repairing damaged architectural components of multiple styles according to claim 1, characterized in that: The image of the building component to be repaired is a 2D image and / or a 3D image. The reference image of the building component includes a 2D reference image and a 3D point cloud reference image. The 2D reference image of the building component includes 2D reference images at several angles.

5. The method for repairing damaged architectural components of multiple styles according to claim 4, characterized in that: In the case of acquiring images of architectural components to be repaired from multiple styles of buildings through on-site collection, 2D images and 3D point cloud images of the architectural components from several angles are also collected.

6. The method for repairing damaged architectural components of multiple styles according to claim 1, characterized in that: By manually annotating the main style of the building component image to be repaired, a reference image of a building component that matches the main style of the building component image to be repaired is matched in a reference image with a similarity higher than the similarity threshold.

7. The method for repairing damaged architectural components of multiple styles according to claim 1, characterized in that: The age and region of the building components in the images of the building components to be repaired are manually labeled; when the defects in the fused image exceed the defect threshold, the reference images of building components of the same age, region and main style are matched for fusion reconstruction, and the fused and reconstructed images are submitted to manual review. The fused images that meet the requirements are added to the reference image library.

8. A repair device for damaged building components of various styles, characterized in that... include: The benchmark image library construction module is used to build a benchmark image library consisting of benchmark images of architectural components in several single styles. The contour information extraction module is used to acquire several images of the same building component to be repaired in a multi-style fusion building; preprocess the images of the building component to be repaired to extract the contour information of the building component in the images of the building component to be repaired; The similarity calculation module is used to calculate the similarity between the image of the building component to be repaired and the reference images of the building components in the reference image library, and to match the reference images with a similarity higher than the similarity threshold. The defect location comparison module is used to compare the contour information of the building component image to be repaired with the matched reference image of the building component to obtain the defect location of the building component image to be repaired. The fusion and reconstruction module fuses and reconstructs multiple images of building components with different missing locations to form a fused image of the building component. The multiple images of building components with different missing locations are images of the same building component on different buildings. When two images have the same missing location, the degree of missing location of the building component image to be repaired is obtained. When fusing and reconstructing multiple images of building components with different missing locations, the building component image with a missing location less than a degree threshold is selected. The reference image library construction module manually reviews the fused images of the building components and adds the fused images that meet the requirements to the reference image library.

9. A repair device for multi-style damaged building components according to claim 8, characterized in that... Also includes: The secondary reconstruction module is used to manually label the age and region of the building components in the image of the building components to be repaired; when the defect of the fused image exceeds the defect threshold, it matches the reference image of the same age, region and main style for fusion reconstruction, and submits the fused image after fusion reconstruction to manual review, and adds the fused image that meets the requirements to the reference image library.

10. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, which, when executed, can implement the repair method for multi-style damaged building components as described in any one of claims 1 to 7.

Images