Garden ancient building structure monitoring system and method based on image processing

Abstract

The invention provides a garden ancient building structure monitoring system and method based on image processing, and the method comprises the steps: carrying out the scanning, flaw detection, shooting and recognition of an ancient building, obtaining the internal structure defect feature information of the ancient building, and recognizing a first structure abnormal region and a second structure abnormal region of the ancient building; visible light shooting recognition is carried out on the first structure abnormal area to obtain structure defect feature information, structural mechanical analysis is carried out on the historic building, whether a structure unbalance event occurs or not is judged, early warning operation is carried out, and structural stability monitoring of the historic building is achieved; and thermal infrared shooting identification is carried out on the second structure abnormal area to obtain biological activity feature information, so that structure erosion prediction analysis is carried out on the ancient building, whether a structure fracture event occurs is judged, early warning operation is carried out, and the biological erosion degree of the ancient building is monitored. The structure change of the historic building under the action of external environment factors is accurately identified, and the reliability of historic building structure monitoring is improved.

Description

Technical Field

[0001] The present invention relates to the field of building monitoring, and in particular to an image processing-based system and method for monitoring ancient garden building structures. Background Art

[0002] Ancient buildings are all wooden structures. Under the influence of external environmental factors such as sunlight, rain and biological invasion, they will inevitably suffer structural damage. In order to extend the life of ancient buildings, they need to be regularly maintained. For this reason, the prior art installs different types of sensors on ancient buildings to carry out long-term automatic global monitoring of ancient buildings, obtains real-time monitoring data of ancient buildings in different aspects, and provides a reliable basis for identifying the safety of ancient buildings and performing structural maintenance. However, setting sensors on ancient buildings is a labor-intensive and time-consuming project. Ancient buildings are different from modern buildings in that they can provide space for installing sensors and electrical energy support for maintaining the normal operation of sensors. In addition, under the requirement of maintaining the original appearance of ancient buildings, large-scale sensor installation is usually not carried out on ancient buildings. For this reason, it is necessary to use a variety of different non-contact detection methods to carry out global and sustainable structural monitoring of ancient buildings, accurately identify the structural changes of ancient buildings under the influence of external environmental factors to the maximum extent, and improve the reliability of structural monitoring of ancient buildings. Summary of the invention

[0003] The purpose of the present invention is to provide a garden ancient building structure monitoring system and method based on image processing, which scans the ancient building for flaw detection, photographs and identifies, obtains structural defect feature information inside the ancient building, thereby identifying a first structural abnormality area and a second structural abnormality area existing in the ancient building, and performs zoning identification of different structural abnormalities on the ancient building, providing a basis for subsequent structural monitoring using different image shooting and identification methods; performs visible light photography and identification on the first structural abnormality area to obtain structural defect feature information, thereby performing structural mechanics analysis on the ancient building, judging whether a structural imbalance event occurs and performing early warning operations, and realizing structural stability monitoring of the ancient building; and performs thermal infrared photography and identification on the second structural abnormality area to obtain biological activity feature information, thereby performing structural erosion prediction and analysis on the ancient building, judging whether a structural fracture event occurs and performing early warning operations, realizing biological erosion degree monitoring of the ancient building, accurately identifying structural changes of the ancient building under the action of external environmental factors, and improving the reliability of structural monitoring of the ancient building.

[0004] The present invention is achieved through the following technical solutions:

[0005] A garden ancient building structure monitoring system based on image processing, comprising:

[0006] The flaw detection and recognition module is used to scan and photograph the ancient building to obtain a scanned flaw detection image of the ancient building; identify the scanned flaw detection image to determine the structural defect feature information inside the ancient building;

[0007] A structural abnormality region identification module, used for identifying a first structural abnormality region and a second structural abnormality region of the ancient building based on the structural state characteristic information;

[0008] A visible light visual recognition module, used for performing visible light photography and recognition on the first structural abnormality region to obtain structural defect feature information of the first structural abnormality region;

[0009] A structural imbalance identification and early warning module is used to perform a structural mechanics analysis on the ancient building based on the structural defect characteristic information of all the first structural abnormality areas, determine whether the ancient building will have a structural imbalance event, and perform a first early warning operation;

[0010] A thermal infrared visual recognition module, used for performing thermal infrared photography and recognition on the second structural abnormality region to obtain biological activity feature information of the second structural abnormality region;

[0011] The structural fracture identification and early warning module is used to perform structural erosion prediction and analysis on the ancient building based on the biological activity characteristic information, and determine whether the ancient building will have a structural fracture event, so as to perform a second early warning operation.

[0012] Optionally, the flaw detection and recognition module is used to scan and photograph the ancient building to obtain a scanned flaw detection image of the ancient building; and recognize the scanned flaw detection image to determine the structural defect feature information inside the ancient building, including:

[0013] Based on the characteristic information of the mortise and tenon joints of the ancient building, the ancient building is divided into a number of scanning and shooting areas; based on the characteristic information of the outer contours corresponding to the scanning and shooting areas, the X-ray scanning action parameters of the scanning and shooting areas are adjusted to obtain the scanning and flaw detection images of the scanning and shooting areas; pixel contour recognition is performed on the scanning and flaw detection images to determine the structural crack contour characteristic information of the scanning and flaw detection images;

[0014] The structural abnormality area identification module is used to identify the first structural abnormality area and the second structural abnormality area of ​​the ancient building based on the structural state characteristic information, and includes:

[0015] The structural crack contour feature information is analyzed in contour shape and extension direction to determine whether the structural crack inside the scanning and shooting area is a stress-related crack; if so, the scanning and shooting area is determined as a first structural abnormality area; if not, the scanning and shooting area is determined as a second structural abnormality area.

[0016] Optionally, the visible light visual recognition module is used to perform visible light photography and recognition on the first structural abnormality region to obtain structural defect feature information of the first structural abnormality region, including:

[0017] Performing visible light binocular photography on the first structural abnormality region to obtain a surface binocular image of the first structural abnormality region; generating a corresponding surface three-dimensional image based on the binocular parallax of the surface binocular image; and recognizing the surface three-dimensional image to obtain distribution feature information of surface cracks in the first structural abnormality region in two dimensions of depth and length;

[0018] The structural imbalance identification and early warning module is used to perform structural mechanics analysis on the ancient building based on the structural defect feature information of all the first structural abnormal areas, and determine whether the ancient building will have a structural imbalance event, so as to perform a first early warning operation, including:

[0019] Based on the distribution characteristic information of surface cracks in all first structural abnormal areas in two dimensions of depth and length, a stress distribution analysis is performed on the ancient building to obtain stress distribution information of the column and beam structure of the ancient building; based on the stress distribution information, it is determined whether a structural imbalance event will occur in the ancient building, and when a structural imbalance event occurs, an early warning message containing information on the location where the structural imbalance occurs is sent out.

[0020] Optionally, the thermal infrared visual recognition module is used to perform thermal infrared photography and recognition on the second structural abnormality area to obtain biological activity feature information of the second structural abnormality area, including:

[0021] Performing thermal infrared scanning and photographing on the second structural abnormality area to obtain a thermal infrared dynamic image of the second structural abnormality area; analyzing the thermal infrared dynamic image to obtain termite activity characteristic information inside the second structural abnormality area; wherein the termite activity characteristic information includes termite reproduction speed information and termite activity range information inside the second structural abnormality area;

[0022] The structural fracture identification and early warning module is used to perform structural erosion prediction analysis on the ancient building based on the biological activity characteristic information, and determine whether the ancient building will have a structural fracture event, so as to perform a second early warning operation, including:

[0023] Based on the characteristic information of termite activities in all the second structural abnormal areas, the structural erosion range expansion trend of the ancient building is predicted and analyzed to obtain the expansion trend information of the area inside the ancient building that is corroded by termites; based on the area expansion trend information, it is determined whether the main beam structure of the ancient building will be corroded and fractured; if so, it is determined that a structural fracture event will occur in the ancient building; if not, it is determined that a structural fracture event will not occur in the ancient building; and when a structural fracture event occurs, an early warning message containing the location information of the structural fracture is sent out.

[0024] A method for monitoring ancient garden building structures based on image processing, comprising:

[0025] Scanning and flaw detection photographing of the ancient building to obtain a scanning and flaw detection image of the ancient building; identifying the scanning and flaw detection image to determine characteristic information of structural defects inside the ancient building; and identifying a first structural abnormality area and a second structural abnormality area existing in the ancient building based on the structural state characteristic information;

[0026] Performing visible light photography and identification on the first structural abnormality area to obtain structural defect feature information of the first structural abnormality area; performing structural mechanics analysis on the ancient building based on the structural defect feature information of all first structural abnormality areas to determine whether a structural imbalance event will occur in the ancient building, thereby performing a first early warning operation;

[0027] Perform thermal infrared photography and identification on the second structural abnormality area to obtain biological activity characteristic information of the second structural abnormality area; based on the biological activity characteristic information, perform structural erosion prediction and analysis on the ancient building to determine whether the ancient building will experience structural fracture, so as to perform a second early warning operation.

[0028] Optionally, scanning and flaw detection photography is performed on the ancient building to obtain a scanning and flaw detection image of the ancient building; the scanning and flaw detection image is identified to determine characteristic information of structural defects inside the ancient building; and based on the structural state characteristic information, a first structural abnormality area and a second structural abnormality area existing in the ancient building are identified, including:

[0029] Based on the characteristic information of the mortise and tenon joints of the ancient building, the ancient building is divided into a number of scanning and shooting areas; based on the characteristic information of the outer contours corresponding to the scanning and shooting areas, the X-ray scanning action parameters of the scanning and shooting areas are adjusted to obtain the scanning and flaw detection images of the scanning and shooting areas; pixel contour recognition is performed on the scanning and flaw detection images to determine the structural crack contour characteristic information of the scanning and flaw detection images;

[0030] The structural crack contour feature information is analyzed in contour shape and extension direction to determine whether the structural crack inside the scanning and shooting area is a stress-related crack; if so, the scanning and shooting area is determined as a first structural abnormality area; if not, the scanning and shooting area is determined as a second structural abnormality area.

[0031] Optionally, performing visible light photography and identification on the first structural abnormality area to obtain structural defect feature information of the first structural abnormality area; based on the structural defect feature information of all first structural abnormality areas, performing structural mechanics analysis on the ancient building to determine whether a structural imbalance event will occur in the ancient building, thereby performing a first early warning operation, including:

[0032] Performing visible light binocular photography on the first structural abnormality region to obtain a surface binocular image of the first structural abnormality region; generating a corresponding surface three-dimensional image based on the binocular parallax of the surface binocular image; and recognizing the surface three-dimensional image to obtain distribution feature information of surface cracks in the first structural abnormality region in two dimensions of depth and length;

[0033] Based on the distribution characteristic information of surface cracks in all first structural abnormal areas in two dimensions of depth and length, a stress distribution analysis is performed on the ancient building to obtain stress distribution information of the column and beam structure of the ancient building; based on the stress distribution information, it is determined whether a structural imbalance event will occur in the ancient building, and when a structural imbalance event occurs, an early warning message containing information on the location where the structural imbalance occurs is sent out.

[0034] Optionally, based on the distribution characteristic information of the surface cracks in all the first structural abnormal regions in two dimensions of depth and length, a stress distribution analysis is performed on the ancient building to obtain stress distribution information of the column and beam structure of the ancient building, including:

[0035] Step S1, assuming that the depth of the crack of the column-beam structure of the ancient building from the surface of the wooden structure to the inside is d, the diameter of the column-beam structure of the ancient building is D, the extension length of the crack of the column-beam structure of the ancient building along the surface of the wooden structure is l, and the length of the column-beam structure of the ancient building is L, then the crack influence factor of the column-beam structure of the ancient building is:

[0036]

[0037] In the above formula (1), F is the crack influence factor of the column-beam structure of the ancient building;

[0038] Step S2, assuming that the angle between the crack of the column-beam structure of the ancient building and the longitudinal direction of the wooden structure is θ, then the stress distribution coefficient of the column-beam structure of the ancient building is:

[0039]

[0040] In the above formula (2), k is the stress distribution coefficient of the column-beam structure of the ancient building, and α is the influence coefficient of the preset crack direction;

[0041] Step S3, determining the stress distribution function of the column-beam structure of the ancient building according to the calculation results of the above steps S1 and S2,

[0042]

[0043] In the above formula (3), f(x, y) is the stress distribution function of the column and beam structure of the ancient building, (x, y) is the coordinate of a point on the wooden structure of the ancient building relative to the preset origin, and β and γ are distributed as x-direction factors and y-direction factors.

[0044] Optionally, thermal infrared photography is performed on the second structural abnormal area to obtain biological activity characteristic information of the second structural abnormal area; based on the biological activity characteristic information, structural erosion prediction analysis is performed on the ancient building to determine whether a structural fracture event will occur in the ancient building, thereby performing a second early warning operation, including:

[0045] Performing thermal infrared scanning and photographing on the second structural abnormality area to obtain a thermal infrared dynamic image of the second structural abnormality area; analyzing the thermal infrared dynamic image to obtain termite activity characteristic information inside the second structural abnormality area; wherein the termite activity characteristic information includes termite reproduction speed information and termite activity range information inside the second structural abnormality area;

[0046] Based on the characteristic information of termite activities in all the second structural abnormal areas, the structural erosion range expansion trend of the ancient building is predicted and analyzed to obtain the expansion trend information of the area inside the ancient building that is corroded by termites; based on the area expansion trend information, it is determined whether the main beam structure of the ancient building will be corroded and fractured; if so, it is determined that a structural fracture event will occur in the ancient building; if not, it is determined that a structural fracture event will not occur in the ancient building; and when a structural fracture event occurs, an early warning message containing the location information of the structural fracture is sent out.

[0047] Compared with the prior art, the present invention has the following beneficial effects:

[0048] The present application provides a garden ancient building structure monitoring system and method based on image processing to scan, detect, photograph and identify ancient buildings, obtain structural defect feature information inside the ancient buildings, thereby identifying a first structural abnormality area and a second structural abnormality area existing in the ancient buildings, and performing zoning identification of different structural abnormalities on the ancient buildings, providing a basis for subsequent structural monitoring using different image shooting and identification methods; performing visible light shooting and identification on the first structural abnormality area to obtain structural defect feature information, thereby performing structural mechanics analysis on the ancient buildings, judging whether a structural imbalance event occurs and performing early warning operations, and realizing structural stability monitoring of the ancient buildings; thermal infrared shooting and identification on the second structural abnormality area to obtain biological activity feature information, thereby performing structural erosion prediction and analysis on the ancient buildings, judging whether a structural fracture event occurs and performing early warning operations, realizing monitoring of the degree of biological erosion of the ancient buildings, accurately identifying structural changes of the ancient buildings under the influence of external environmental factors, and improving the reliability of structural monitoring of the ancient buildings. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the prior art descriptions. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. Among them:

[0050] Figure 1 A schematic structural diagram of an ancient garden building structure monitoring system based on image processing provided by the present invention.

[0051] Figure 2 A schematic flow chart of a method for monitoring ancient garden building structures based on image processing provided by the present invention. DETAILED DESCRIPTION

[0052] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are described in detail below in conjunction with the accompanying drawings. It is to be understood that the specific embodiments described herein are only used to explain the present application, rather than to limit the present application. It should also be noted that, for ease of description, only some structures related to the present application are shown in the accompanying drawings, rather than all structures. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0053] The terms "including" and "having" and any variations thereof in this application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.

[0054] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0055] See also Figure 1 As shown, an embodiment of the present application provides a system for monitoring the structure of ancient garden buildings based on image processing. The system for monitoring the structure of ancient garden buildings based on image processing includes:

[0056] The flaw detection and recognition module is used to scan and photograph the ancient building to obtain a scanned flaw detection image of the ancient building; identify the scanned flaw detection image to determine the structural defect feature information inside the ancient building;

[0057] A structural abnormality region identification module is used to identify a first structural abnormality region and a second structural abnormality region of the ancient building based on the structural state characteristic information;

[0058] A visible light visual recognition module is used to perform visible light photography and recognition on the first structural abnormality area to obtain structural defect feature information of the first structural abnormality area;

[0059] The structural imbalance identification and early warning module is used to perform structural mechanics analysis on the ancient building based on the structural defect characteristic information of all the first structural abnormal areas, determine whether the ancient building will have a structural imbalance event, and perform the first early warning operation;

[0060] A thermal infrared visual recognition module is used to perform thermal infrared photography and recognition on the second structural abnormality area to obtain biological activity feature information of the second structural abnormality area;

[0061] The structural fracture identification and early warning module is used to predict and analyze the structural erosion of the ancient building based on the characteristic information of the biological activity, and to determine whether the ancient building will experience a structural fracture event, so as to perform a second early warning operation.

[0062] The beneficial effects of the above embodiments are as follows: the ancient building structure monitoring system based on image processing performs scanning, flaw detection, photography and identification on the ancient building to obtain characteristic information of structural defects inside the ancient building, thereby identifying the first structural abnormality area and the second structural abnormality area existing in the ancient building, and performing zoning identification of different structural abnormalities on the ancient building, providing a basis for subsequent structural monitoring using different image shooting and identification methods; performing visible light photography and identification on the first structural abnormality area to obtain characteristic information of structural defects, thereby performing structural mechanics analysis on the ancient building, determining whether a structural imbalance event occurs and performing early warning operations, and realizing structural stability monitoring of the ancient building; and performing thermal infrared photography and identification on the second structural abnormality area to obtain characteristic information of biological activities, thereby performing structural erosion prediction and analysis on the ancient building, determining whether a structural fracture event occurs and performing early warning operations, realizing monitoring of the degree of biological erosion of the ancient building, accurately identifying structural changes of the ancient building under the influence of external environmental factors, and improving the reliability of structural monitoring of the ancient building.

[0063] In another embodiment, the flaw detection and recognition module is used to scan and photograph the ancient building to obtain a scanned flaw detection image of the ancient building; and to recognize the scanned flaw detection image to determine the structural defect feature information inside the ancient building, including:

[0064] Based on the characteristic information of the mortise and tenon joints of the ancient building, the ancient building is divided into a number of scanning and shooting areas; based on the characteristic information of the outer contours corresponding to the scanning and shooting areas, the X-ray scanning action parameters of the scanning and shooting areas are adjusted to obtain a scanning flaw detection image of the scanning and shooting areas; pixel contour recognition is performed on the scanning flaw detection image to determine the structural crack contour characteristic information of the scanning flaw detection image;

[0065] The structural abnormality region identification module is used to identify the first structural abnormality region and the second structural abnormality region of the ancient building based on the structural state characteristic information, and includes:

[0066] The contour shape and extension direction of the structural crack contour feature information are analyzed to determine whether the structural crack inside the scanning and shooting area is a stress-related crack; if so, the scanning and shooting area is determined as a first structural abnormality area; if not, the scanning and shooting area is determined as a second structural abnormality area.

[0067] The beneficial effect of the above embodiment is that the ancient building connects the columns and beams through the mortise and tenon structure. Generally speaking, there are many columns and beams inside the ancient building. If the ancient building is shot for global single flaw detection, the detailed structural area inside the ancient building may be missed, and the global flaw detection of the ancient building cannot be completely performed. For this reason, all the mortise and tenon connection parts contained in the ancient building are used as nodes to partition the ancient building, and the ancient building is divided into several scanning and shooting areas, so that each scanning and shooting area contains a suitable number of columns and beams, reducing the subsequent scanning and flaw detection shooting workload of each scanning and shooting area. Based on the shape contour feature information corresponding to the scanning and shooting area, the X-ray scanning action parameters of the scanning and shooting area are adjusted to obtain the scanning and flaw detection image of the scanning and shooting area. For example, according to the edge shape contour of the scanning and shooting area, the X-ray scanning range size of the scanning and shooting area is adjusted to ensure the fine global X-ray scanning of the scanning and shooting area, and the pixel contour recognition is performed on the scanning and flaw detection image to determine the structural crack contour feature information of the scanning and flaw detection image, and quantitatively identify the structural cracks inside the scanning and shooting area of ​​the ancient building corresponding to the scanning and shooting area. In addition, the contour shape and extension direction of the structural crack contour feature information are analyzed to determine whether the structural crack inside the scanning and shooting area is a stress-related crack (for example, a neural network analysis is performed on the contour shape and extension direction data included in the structural crack contour feature information to determine whether the structural crack inside the scanning and shooting area is a stress-related crack, which is a conventional technical means in this field and is not described in detail here), and based on the judgment result of whether the structural crack inside the scanning and shooting area is a stress-related crack, the scanning and shooting area is determined as a first structural abnormality area or a second structural abnormality area, providing a basis for subsequent use of different image recognition methods for structural monitoring.

[0068] In another embodiment, the visible light visual recognition module is used to perform visible light photography and recognition on the first structural abnormality region to obtain structural defect feature information of the first structural abnormality region, including:

[0069] Performing visible light binocular photography on the first structural abnormality region to obtain a surface binocular image of the first structural abnormality region; generating a corresponding surface three-dimensional image based on the binocular parallax of the surface binocular image; and recognizing the surface three-dimensional image to obtain distribution characteristic information of surface cracks in the first structural abnormality region in two dimensions of depth and length;

[0070] The structural imbalance identification and early warning module is used to perform structural mechanics analysis on the ancient building based on the structural defect characteristic information of all the first structural abnormal areas, and determine whether the ancient building will have a structural imbalance event, so as to perform the first early warning operation, including:

[0071] Based on the distribution characteristic information of surface cracks in all the first structural abnormal areas in two dimensions of depth and length, a stress distribution analysis is performed on the ancient building to obtain the stress distribution information of the column and beam structure of the ancient building; based on the stress distribution information, it is determined whether a structural imbalance event will occur in the ancient building, and when a structural imbalance event occurs, an early warning message containing the location information of the structural imbalance is sent out.

[0072] The beneficial effect of the above embodiment is that since the structural cracks in the first structural abnormal area are stress-related cracks, the structural cracks inside the first structural abnormal area will gradually occur and extend to the surface corresponding to the first structural abnormal area. The greater the depth and length of the cracks on the surface of the first structural abnormal area, the negative impact it will have on the structural stability of the first structural abnormal area. For this reason, the first structural abnormal area is photographed and identified with visible light binoculars to obtain the distribution characteristic information of the surface cracks in the first structural abnormal area in two dimensions of depth and length. Then, based on the distribution characteristic information of the surface cracks in all first structural abnormal areas in two dimensions of depth and length, the ancient building is subjected to stress distribution analysis to obtain the stress distribution information of the column and beam structure of the ancient building; wherein the stress distribution information may be, but is not limited to, the stress magnitude and direction distribution information inside the columns and beams of the ancient building. Based on the stress distribution information, the magnitude of the force on the column and beam structure of the ancient building in different directions is obtained, so as to judge whether the ancient building will have a structural imbalance event, and when a structural imbalance event occurs, an early warning message containing the location information of the structural imbalance is sent out to realize the structural stability monitoring of the ancient building.

[0073] In another embodiment, the thermal infrared visual recognition module is used to perform thermal infrared photography and recognition on the second structural abnormality area to obtain biological activity feature information of the second structural abnormality area, including:

[0074] Perform thermal infrared scanning and photographing on the second structural abnormality area to obtain a thermal infrared dynamic image of the second structural abnormality area; analyze the thermal infrared dynamic image to obtain characteristic information of termite activity inside the second structural abnormality area; wherein the characteristic information of termite activity includes termite reproduction speed information and termite activity range information inside the second structural abnormality area;

[0075] The structural fracture identification and early warning module is used to perform structural erosion prediction analysis on the ancient building based on the biological activity characteristic information, and determine whether the ancient building will have a structural fracture event, so as to perform a second early warning operation, including:

[0076] Based on the characteristic information of termite activity in all the second structural abnormal areas, the expansion trend of the structural erosion range of the ancient building is predicted and analyzed to obtain the expansion trend information of the area inside the ancient building that is eroded by termites; based on the area expansion trend information, it is judged whether the main beam structure of the ancient building will be corroded and fractured. If so, it is determined that the ancient building will have a structural fracture event; if not, it is determined that the ancient building will not have a structural fracture event; and when a structural fracture event occurs, an early warning message containing the location information of the structural fracture is sent out.

[0077] The beneficial effect of the above embodiment is that wooden buildings can also be eroded by termites, etc., thereby endangering the structural safety of the ancient building. For this reason, the second structural abnormal area is subjected to thermal infrared scanning and shooting identification to obtain the characteristic information of termite activity inside the second structural abnormal area, and the termite activity behavior inside the ancient building is accurately identified. Based on the characteristic information of termite activity in all second structural abnormal areas, the ancient building is subjected to a structural erosion range expansion trend forecast analysis to obtain the expansion trend information of the area eroded by termites inside the ancient building (such as the expansion direction and expansion speed of the area eroded by termites inside the ancient building), so as to judge whether the main beam structure of the ancient building is eroded by termites in a large range and fractured, and when a structural fracture event occurs, an early warning message containing the location information of the structural fracture is sent out to realize the monitoring of the degree of biological erosion of the ancient building.

[0078] See also Figure 2 As shown, an embodiment of the present application provides an ancient building structure monitoring method based on image processing. The ancient building structure monitoring method based on image processing includes:

[0079] Scanning and flaw detection photographing of the ancient building to obtain a scanning and flaw detection image of the ancient building; identifying the scanning and flaw detection image to determine characteristic information of structural defects inside the ancient building; based on the structural state characteristic information, identifying a first structural abnormality area and a second structural abnormality area existing in the ancient building;

[0080] Perform visible light photography and identification on the first structural abnormality area to obtain structural defect feature information of the first structural abnormality area; based on the structural defect feature information of all first structural abnormality areas, perform structural mechanics analysis on the ancient building to determine whether a structural imbalance event will occur in the ancient building, thereby performing a first early warning operation;

[0081] Thermal infrared photography is performed on the second structural abnormality area to obtain biological activity characteristic information of the second structural abnormality area; based on the biological activity characteristic information, structural erosion prediction and analysis of the ancient building is performed to determine whether a structural fracture event will occur in the ancient building, so as to perform a second early warning operation.

[0082] The beneficial effects of the above embodiments are as follows: the ancient building structure monitoring method based on image processing performs scanning, flaw detection, photography and identification on the ancient building to obtain characteristic information of structural defects inside the ancient building, thereby identifying the first structural abnormality area and the second structural abnormality area existing in the ancient building, and performing zoning identification of different structural abnormalities on the ancient building, providing a basis for subsequent structural monitoring using different image shooting and identification methods; performing visible light photography and identification on the first structural abnormality area to obtain characteristic information of structural defects, thereby performing structural mechanics analysis on the ancient building, determining whether a structural imbalance event occurs and performing early warning operations, and realizing structural stability monitoring of the ancient building; and performing thermal infrared photography and identification on the second structural abnormality area to obtain characteristic information of biological activities, thereby performing structural erosion prediction and analysis on the ancient building, determining whether a structural fracture event occurs and performing early warning operations, realizing monitoring of the degree of biological erosion of the ancient building, accurately identifying structural changes of the ancient building under the influence of external environmental factors, and improving the reliability of structural monitoring of the ancient building.

[0083] In another embodiment, scanning and flaw detection photography is performed on an ancient building to obtain a scanning and flaw detection image of the ancient building; the scanning and flaw detection image is identified to determine characteristic information of structural defects inside the ancient building; and based on the structural state characteristic information, a first structural abnormality region and a second structural abnormality region existing in the ancient building are identified, including:

[0084] Based on the characteristic information of the mortise and tenon joints of the ancient building, the ancient building is divided into a number of scanning and shooting areas; based on the characteristic information of the outer contours corresponding to the scanning and shooting areas, the X-ray scanning action parameters of the scanning and shooting areas are adjusted to obtain a scanning flaw detection image of the scanning and shooting areas; pixel contour recognition is performed on the scanning flaw detection image to determine the structural crack contour characteristic information of the scanning flaw detection image;

[0085] The contour shape and extension direction of the structural crack contour feature information are analyzed to determine whether the structural crack inside the scanning and shooting area is a stress-related crack; if so, the scanning and shooting area is determined as a first structural abnormality area; if not, the scanning and shooting area is determined as a second structural abnormality area.

[0086] The beneficial effect of the above embodiment is that the ancient building connects the columns and beams through the mortise and tenon structure. Generally speaking, there are many columns and beams inside the ancient building. If the ancient building is shot for global single flaw detection, the detailed structural area inside the ancient building may be missed, and the global flaw detection of the ancient building cannot be completely performed. For this reason, all the mortise and tenon connection parts contained in the ancient building are used as nodes to partition the ancient building, and the ancient building is divided into several scanning and shooting areas, so that each scanning and shooting area contains a suitable number of columns and beams, reducing the subsequent scanning and flaw detection shooting workload of each scanning and shooting area. Based on the shape contour feature information corresponding to the scanning and shooting area, the X-ray scanning action parameters of the scanning and shooting area are adjusted to obtain the scanning and flaw detection image of the scanning and shooting area. For example, according to the edge shape contour of the scanning and shooting area, the X-ray scanning range size of the scanning and shooting area is adjusted to ensure the fine global X-ray scanning of the scanning and shooting area, and the pixel contour recognition is performed on the scanning and flaw detection image to determine the structural crack contour feature information of the scanning and flaw detection image, and quantitatively identify the structural cracks inside the scanning and shooting area of ​​the ancient building corresponding to the scanning and shooting area. In addition, the contour shape and extension direction of the structural crack contour feature information are analyzed to determine whether the structural crack inside the scanning and shooting area is a stress-related crack (for example, a neural network analysis is performed on the contour shape and extension direction data included in the structural crack contour feature information to determine whether the structural crack inside the scanning and shooting area is a stress-related crack, which is a conventional technical means in this field and is not described in detail here), and based on the judgment result of whether the structural crack inside the scanning and shooting area is a stress-related crack, the scanning and shooting area is determined as a first structural abnormality area or a second structural abnormality area, providing a basis for subsequent use of different image recognition methods for structural monitoring.

[0087] In another embodiment, the first structural abnormality region is photographed and identified with visible light to obtain structural defect feature information of the first structural abnormality region; based on the structural defect feature information of all first structural abnormality regions, a structural mechanics analysis is performed on the ancient building to determine whether a structural imbalance event will occur in the ancient building, thereby performing a first early warning operation, including:

[0088] Performing visible light binocular photography on the first structural abnormality region to obtain a surface binocular image of the first structural abnormality region; generating a corresponding surface three-dimensional image based on the binocular parallax of the surface binocular image; and recognizing the surface three-dimensional image to obtain distribution characteristic information of surface cracks in the first structural abnormality region in two dimensions of depth and length;

[0089] Based on the distribution characteristic information of surface cracks in all the first structural abnormal areas in two dimensions of depth and length, a stress distribution analysis is performed on the ancient building to obtain the stress distribution information of the column and beam structure of the ancient building; based on the stress distribution information, it is determined whether a structural imbalance event will occur in the ancient building, and when a structural imbalance event occurs, an early warning message containing the location information of the structural imbalance is sent out.

[0090] The beneficial effect of the above embodiment is that since the structural cracks in the first structural abnormal area are stress-related cracks, the structural cracks inside the first structural abnormal area will gradually occur and extend to the surface corresponding to the first structural abnormal area. The greater the depth and length of the cracks on the surface of the first structural abnormal area, the negative impact it will have on the structural stability of the first structural abnormal area. For this reason, the first structural abnormal area is photographed and identified with visible light binoculars to obtain the distribution characteristic information of the surface cracks in the first structural abnormal area in two dimensions of depth and length. Then, based on the distribution characteristic information of the surface cracks in all first structural abnormal areas in two dimensions of depth and length, the ancient building is subjected to stress distribution analysis to obtain the stress distribution information of the column and beam structure of the ancient building; wherein the stress distribution information may be, but is not limited to, the stress magnitude and direction distribution information inside the columns and beams of the ancient building. Based on the stress distribution information, the magnitude of the force on the column and beam structure of the ancient building in different directions is obtained, so as to judge whether the ancient building will have a structural imbalance event, and when a structural imbalance event occurs, an early warning message containing the location information of the structural imbalance is sent out to realize the structural stability monitoring of the ancient building.

[0091] In another embodiment, based on the distribution characteristic information of the surface cracks in all the first structural abnormal regions in two dimensions of depth and length, a stress distribution analysis is performed on the ancient building to obtain stress distribution information of the column and beam structure of the ancient building, including:

[0092] Step S1, assuming that the depth of the crack of the column-beam structure of the ancient building from the surface of the wooden structure to the inside is d, the diameter of the column-beam structure of the ancient building is D, the extension length of the crack of the column-beam structure of the ancient building along the surface of the wooden structure is l, and the length of the column-beam structure of the ancient building is L, then the crack influence factor of the column-beam structure of the ancient building is:

[0093]

[0094] In the above formula (1), F is the crack influence factor of the column-beam structure of the ancient building;

[0095] Step S2, assuming that the angle between the crack of the column-beam structure of the ancient building and the longitudinal direction of the wooden structure is θ, then the stress distribution coefficient of the column-beam structure of the ancient building is:

[0096]

[0097] In the above formula (2), k is the stress distribution coefficient of the column-beam structure of the ancient building, and α is the influence coefficient of the preset crack direction;

[0098] Step S3, determining the stress distribution function of the column-beam structure of the ancient building according to the calculation results of the above steps S1 and S2,

[0099]

[0100] In the above formula (3), f(x, y) is the stress distribution function of the column-beam structure of the ancient building, (x, y) is the coordinate of a point on the wooden structure of the ancient building relative to the preset origin, and β and γ are distributed as x-direction factors and y-direction factors.

[0101] The beneficial effects of the above embodiments are as follows: since cracks will appear on the surface of the wooden structures (such as columns and beams) of the ancient buildings, as these cracks continue to deepen and lengthen, they will affect the size and continuity of the stress distribution of these wooden structures, causing the stress of the wooden structures to be distorted and leading to the tilt of the wooden structures; based on the crack depth and length information of the column and beam structures of the ancient buildings, the stress distribution information of the column and beam structures of the ancient buildings is accurately characterized, providing important data basis for subsequent related monitoring work.

[0102] In another embodiment, thermal infrared photography is performed on the second structural abnormal area to obtain biological activity characteristic information of the second structural abnormal area; based on the biological activity characteristic information, structural erosion prediction analysis is performed on the ancient building to determine whether a structural fracture event will occur in the ancient building, thereby performing a second early warning operation, including:

[0103] Perform thermal infrared scanning and photographing on the second structural abnormality area to obtain a thermal infrared dynamic image of the second structural abnormality area; analyze the thermal infrared dynamic image to obtain characteristic information of termite activity inside the second structural abnormality area; wherein the characteristic information of termite activity includes termite reproduction speed information and termite activity range information inside the second structural abnormality area;

[0104] Based on the characteristic information of termite activity in all the second structural abnormal areas, the expansion trend of the structural erosion range of the ancient building is predicted and analyzed to obtain the expansion trend information of the area inside the ancient building that is eroded by termites; based on the area expansion trend information, it is judged whether the main beam structure of the ancient building will be corroded and fractured. If so, it is determined that the ancient building will have a structural fracture event; if not, it is determined that the ancient building will not have a structural fracture event; and when a structural fracture event occurs, an early warning message containing the location information of the structural fracture is sent out.

[0105] The beneficial effect of the above embodiment is that wooden buildings can also be eroded by termites, etc., thereby endangering the structural safety of the ancient building. For this reason, the second structural abnormal area is subjected to thermal infrared scanning and shooting identification to obtain the characteristic information of termite activity inside the second structural abnormal area, and the termite activity behavior inside the ancient building is accurately identified. Based on the characteristic information of termite activity in all second structural abnormal areas, the ancient building is subjected to a structural erosion range expansion trend forecast analysis to obtain the expansion trend information of the area eroded by termites inside the ancient building (such as the expansion direction and expansion speed of the area eroded by termites inside the ancient building), so as to judge whether the main beam structure of the ancient building is eroded by termites in a large range and fractured, and when a structural fracture event occurs, an early warning message containing the location information of the structural fracture is sent out to realize the monitoring of the degree of biological erosion of the ancient building.

[0106] In general, the ancient building structure monitoring system and method based on image processing scans, detects, photographs and identifies the ancient building to obtain the characteristic information of the structural defects inside the ancient building, thereby identifying the first structural abnormality area and the second structural abnormality area of ​​the ancient building, and zoning and identifying the different structural abnormalities of the ancient building, providing a basis for subsequent structural monitoring using different image shooting and recognition methods; the first structural abnormality area is photographed and identified with visible light to obtain the characteristic information of the structural defects, thereby performing structural mechanics analysis on the ancient building, judging whether a structural imbalance event occurs and performing early warning operations, thereby realizing structural stability monitoring of the ancient building; thermal infrared photography and identification is also performed on the second structural abnormality area to obtain the characteristic information of biological activities, thereby performing structural erosion prediction and analysis on the ancient building, judging whether a structural fracture event occurs and performing early warning operations, thereby realizing monitoring of the degree of biological erosion of the ancient building, accurately identifying the structural changes of the ancient building under the influence of external environmental factors, and improving the reliability of structural monitoring of the ancient building.

[0107] The above is only a specific implementation of the present invention, and any other improvements made based on the concept of the present invention are considered to be within the protection scope of the present invention.

Claims

1. A garden ancient building structure monitoring system based on image processing, characterized in that: include: A flaw detection and identification module is used to scan and detect the ancient building and obtain a scanning flaw detection image of the ancient building; Identify the scanning flaw detection image to determine the structural defect feature information inside the ancient building; A structural abnormality region identification module, used for identifying a first structural abnormality region and a second structural abnormality region of the ancient building based on the structural state characteristic information; A visible light visual recognition module, used for performing visible light photography and recognition on the first structural abnormality region to obtain structural defect feature information of the first structural abnormality region; A structural imbalance identification and early warning module is used to perform a structural mechanics analysis on the ancient building based on the structural defect characteristic information of all the first structural abnormality areas, determine whether the ancient building will have a structural imbalance event, and perform a first early warning operation; A thermal infrared visual recognition module, used for performing thermal infrared photography and recognition on the second structural abnormality region to obtain biological activity feature information of the second structural abnormality region; The structural fracture identification and early warning module is used to perform structural erosion prediction and analysis on the ancient building based on the biological activity characteristic information, and determine whether the ancient building will have a structural fracture event, so as to perform a second early warning operation.

2. The garden ancient building structure monitoring system based on image processing as claimed in claim 1, characterized in that: The flaw detection and identification module is used to scan and detect the ancient building to obtain a scanning flaw detection image of the ancient building; Identifying the scanning flaw detection image to determine the structural defect feature information inside the ancient building includes: Based on the characteristic information of the mortise and tenon joints of the ancient building, the ancient building is divided into a number of scanning and shooting areas; based on the characteristic information of the outer contours corresponding to the scanning and shooting areas, the X-ray scanning action parameters of the scanning and shooting areas are adjusted to obtain the scanning and flaw detection images of the scanning and shooting areas; pixel contour recognition is performed on the scanning and flaw detection images to determine the structural crack contour characteristic information of the scanning and flaw detection images; The structural abnormality area identification module is used to identify the first structural abnormality area and the second structural abnormality area of ​​the ancient building based on the structural state characteristic information, including: The structural crack contour feature information is analyzed in contour shape and extension direction to determine whether the structural crack inside the scanning and shooting area is a stress-related crack; if so, the scanning and shooting area is determined as a first structural abnormality area; if not, the scanning and shooting area is determined as a second structural abnormality area.

3. The garden ancient building structure monitoring system based on image processing as claimed in claim 1, characterized in that: The visible light visual recognition module is used to perform visible light photography and recognition on the first structural abnormality area to obtain structural defect feature information of the first structural abnormality area, including: Performing visible light binocular photography on the first structural abnormality region to obtain a surface binocular image of the first structural abnormality region; generating a corresponding surface three-dimensional image based on the binocular parallax of the surface binocular image; and recognizing the surface three-dimensional image to obtain distribution feature information of surface cracks in the first structural abnormality region in two dimensions of depth and length; The structural imbalance identification and early warning module is used to perform structural mechanics analysis on the ancient building based on the structural defect feature information of all the first structural abnormal areas, and determine whether the ancient building will have a structural imbalance event, so as to perform a first early warning operation, including: Based on the distribution characteristic information of surface cracks in all first structural abnormal areas in two dimensions of depth and length, a stress distribution analysis is performed on the ancient building to obtain stress distribution information of the column and beam structure of the ancient building; based on the stress distribution information, it is determined whether a structural imbalance event will occur in the ancient building, and when a structural imbalance event occurs, an early warning message containing information on the location where the structural imbalance occurs is sent out.

4. The garden ancient building structure monitoring system based on image processing as claimed in claim 1, characterized in that: The thermal infrared visual recognition module is used to perform thermal infrared photography and recognition on the second structural abnormality area to obtain biological activity feature information of the second structural abnormality area, including: Performing thermal infrared scanning and photographing on the second structural abnormality area to obtain a thermal infrared dynamic image of the second structural abnormality area; analyzing the thermal infrared dynamic image to obtain termite activity characteristic information inside the second structural abnormality area; wherein the termite activity characteristic information includes termite reproduction speed information and termite activity range information inside the second structural abnormality area; The structural fracture identification and early warning module is used to perform structural erosion prediction analysis on the ancient building based on the biological activity characteristic information, and determine whether the ancient building will have a structural fracture event, so as to perform a second early warning operation, including: Based on the characteristic information of termite activities in all the second structural abnormal areas, the structural erosion range expansion trend of the ancient building is predicted and analyzed to obtain the expansion trend information of the area inside the ancient building that is corroded by termites; based on the area expansion trend information, it is determined whether the main beam structure of the ancient building will be corroded and fractured; if so, it is determined that a structural fracture event will occur in the ancient building; if not, it is determined that a structural fracture event will not occur in the ancient building; and when a structural fracture event occurs, an early warning message containing the location information of the structural fracture is sent out.

5. A method for monitoring the structure of ancient garden buildings based on image processing, characterized in that: include: Scanning and flaw detection photography of the ancient building to obtain a scanning and flaw detection image of the ancient building; Identify the scanning flaw detection image to determine the structural defect feature information inside the ancient building; Based on the structural state characteristic information, identifying a first structural abnormality area and a second structural abnormality area of ​​the ancient building; Performing visible light photography and identification on the first structural abnormality region to obtain structural defect feature information of the first structural abnormality region; Based on the structural defect characteristic information of all the first structural abnormality areas, a structural mechanics analysis is performed on the ancient building to determine whether a structural imbalance event will occur in the ancient building, thereby performing a first warning operation; Perform thermal infrared photography and identification on the second structural abnormality area to obtain biological activity characteristic information of the second structural abnormality area; based on the biological activity characteristic information, perform structural erosion prediction and analysis on the ancient building to determine whether the ancient building will experience structural fracture, so as to perform a second early warning operation.

6. The method for monitoring ancient garden building structures based on image processing according to claim 5, characterized in that: Scanning and flaw detection photographing of the ancient building to obtain a scanning and flaw detection image of the ancient building; identifying the scanning and flaw detection image to determine characteristic information of structural defects inside the ancient building; Based on the structural state characteristic information, identifying a first structural abnormality area and a second structural abnormality area of ​​the ancient building, comprising: Based on the mortise and tenon joint feature information of the ancient building, the ancient building is divided into a number of scanning and shooting areas; Based on the shape contour feature information corresponding to the scanning and shooting area, adjusting the X-ray scanning action parameters of the scanning and shooting area to obtain the scanning and flaw detection image of the scanning and shooting area; performing pixel contour recognition on the scanning and flaw detection image to determine the structural crack contour feature information of the scanning and flaw detection image; The structural crack contour feature information is analyzed in contour shape and extension direction to determine whether the structural crack inside the scanning and shooting area is a stress-related crack; if so, the scanning and shooting area is determined as a first structural abnormality area; if not, the scanning and shooting area is determined as a second structural abnormality area.

7. The method for monitoring ancient garden building structures based on image processing according to claim 5, characterized in that: Performing visible light photography and identification on the first structural abnormality region to obtain structural defect feature information of the first structural abnormality region; Based on the structural defect characteristic information of all the first structural abnormality areas, a structural mechanics analysis is performed on the ancient building to determine whether a structural imbalance event will occur in the ancient building, thereby performing a first warning operation, including: Performing visible light binocular photography on the first structural abnormality region to obtain a surface binocular image of the first structural abnormality region; generating a corresponding surface three-dimensional image based on the binocular parallax of the surface binocular image; and recognizing the surface three-dimensional image to obtain distribution feature information of surface cracks in the first structural abnormality region in two dimensions of depth and length; Based on the distribution characteristic information of surface cracks in all first structural abnormal areas in two dimensions of depth and length, a stress distribution analysis is performed on the ancient building to obtain stress distribution information of the column and beam structure of the ancient building; based on the stress distribution information, it is determined whether a structural imbalance event will occur in the ancient building, and when a structural imbalance event occurs, an early warning message containing information on the location where the structural imbalance occurs is sent out.

8. The method for monitoring ancient garden building structures based on image processing according to claim 7, characterized in that: Based on the distribution characteristic information of the surface cracks in all the first structural abnormal areas in two dimensions of depth and length, the stress distribution analysis of the ancient building is performed to obtain the stress distribution information of the column and beam structure of the ancient building, including: Step S1, assuming that the depth of the crack of the column-beam structure of the ancient building from the surface of the wooden structure to the inside is d, the diameter of the column-beam structure of the ancient building is D, the extension length of the crack of the column-beam structure of the ancient building along the surface of the wooden structure is l, and the length of the column-beam structure of the ancient building is L, then the crack influence factor of the column-beam structure of the ancient building is: In the above formula (1), F is the crack influence factor of the column-beam structure of the ancient building; Step S2, assuming that the angle between the crack of the column-beam structure of the ancient building and the longitudinal direction of the wooden structure is θ, then the stress distribution coefficient of the column-beam structure of the ancient building is: In the above formula (2), k is the stress distribution coefficient of the column-beam structure of the ancient building, and α is the influence coefficient of the preset crack direction; Step S3, determining the stress distribution function of the column-beam structure of the ancient building according to the calculation results of the above steps S1 and S2, In the above formula (3), f(x, y) is the stress distribution function of the column-beam structure of the ancient building. (x, y) is the coordinate of a point on the wooden structure of the ancient building relative to a preset origin, and β and γ are distributed as x-direction factors and y-direction factors.

9. The method for monitoring ancient garden building structures based on image processing according to claim 5, characterized in that: Perform thermal infrared photography and identification on the second structural abnormal area to obtain biological activity characteristic information of the second structural abnormal area; based on the biological activity characteristic information, perform structural erosion prediction and analysis on the ancient building to determine whether a structural fracture event will occur in the ancient building, thereby performing a second early warning operation, including: Performing thermal infrared scanning and photographing on the second structural abnormality area to obtain a thermal infrared dynamic image of the second structural abnormality area; analyzing the thermal infrared dynamic image to obtain termite activity characteristic information inside the second structural abnormality area; wherein the termite activity characteristic information includes termite reproduction speed information and termite activity range information inside the second structural abnormality area; Based on the termite activity characteristic information of all the second structural abnormal areas, the structural erosion range expansion trend prediction analysis is performed on the ancient building to obtain the area expansion trend information of the ancient building that is eroded by termites; based on the area expansion trend information, it is determined whether the main beam structure of the ancient building will be corroded and fractured, and if so, it is determined that the ancient building will have a structural fracture event; If not, it is determined that the ancient building will not have a structural fracture event; and when a structural fracture event occurs, an early warning message containing information on the location where the structural fracture occurred is sent out.

Images