Building heritage protection monitoring system and method based on three-dimensional image recognition technology

Abstract

A building heritage protection monitoring system based on a three-dimensional image recognition technology comprises a plurality of reference marking devices which correspond to building heritage and are used for forming a plurality of reference marking points on the side of the building heritage; the task management subsystem is used for generating a monitoring task corresponding to the building heritage; the dynamic monitoring subsystem is used for monitoring the building heritage based on the monitoring task and the reference mark point and generating a dynamic three-dimensional image corresponding to the building heritage; and the data analysis subsystem is used for analyzing the dynamic three-dimensional image and generating dynamic three-dimensional data corresponding to the building heritage. According to the building heritage protection monitoring system and method based on the three-dimensional image recognition technology provided by the invention, the building heritage is dynamically monitored by adopting a mode of pre-allocating the monitoring task, the monitoring efficiency can be effectively improved, and excessive and frequent monitoring can be avoided because the change of the building heritage is slow.

Description

Technical Field

[0001] The present invention relates to the technical field of architectural heritage management, and in particular to an architectural heritage protection monitoring system and method based on three-dimensional image recognition technology. Background Art

[0002] Architectural heritage refers to buildings and architectural groups with important historical, cultural, artistic, scientific, and social values. Architectural heritage is of great value and is easily damaged by environmental erosion. Therefore, it is necessary to monitor architectural heritage for timely protection. In the existing technology, the monitoring of architectural heritage is mostly daily maintenance patrols, and the data that can be obtained is very limited, which is not conducive to the protection of architectural heritage. Summary of the invention

[0003] In order to address the deficiencies in the prior art, the present invention provides a system and method for monitoring the protection of architectural heritage based on three-dimensional image recognition technology. The system and method adopt a method of pre-assigning monitoring tasks to dynamically monitor the architectural heritage, which can effectively improve the monitoring efficiency. Because the changes in the architectural heritage are slow, over-frequent monitoring can be avoided. Moreover, by setting reference marking points on the sides of the architectural heritage, the architectural heritage can be monitored based on the reference marking points, and the reference marking points are in the same position during each monitoring, thereby ensuring the matching degree of dynamic three-dimensional images obtained from multiple monitorings, so as to facilitate the calculation of the degree of change of the architectural heritage based on the dynamic three-dimensional data.

[0004] In order to achieve the above object, the specific scheme adopted by the present invention is: A building heritage protection monitoring system based on three-dimensional image recognition technology, comprising: A plurality of reference marking devices, the reference marking devices corresponding to the architectural heritage, and used to form a plurality of reference marking points on the side of the architectural heritage; A task management subsystem, used for generating monitoring tasks corresponding to the architectural heritage; A dynamic monitoring subsystem, configured to monitor the architectural heritage based on the monitoring task and the reference marking points, and generate a dynamic three-dimensional image corresponding to the architectural heritage; The data analysis subsystem is used to analyze the dynamic three-dimensional image and generate dynamic three-dimensional data corresponding to the architectural heritage.

[0005] Preferably, the reference mark device includes a plurality of reference mark rods, wherein the reference mark rods are fixedly arranged on the peripheral side of the architectural heritage, and a reference mark graphic is arranged on the top of the reference mark rod, wherein the reference mark graphic forms the reference mark point, and the reference mark graphics on different reference mark rods have different colors.

[0006] Preferably, the dynamic monitoring subsystem includes a plurality of monitoring drones, and the monitoring drones are used to photograph and scan the architectural heritage based on the monitoring task, and perform position correction based on the reference marker points during the photographing and scanning process.

[0007] Preferably, the data analysis subsystem includes multiple data analysis devices, all of which are communicatively connected, and each of the data analysis devices is provided with at least one data interface, and the data interface is used to cooperate with the monitoring drone to obtain the dynamic three-dimensional image from the monitoring drone. The task management subsystem is also used to generate analysis tasks corresponding to the data analysis devices.

[0008] A method for monitoring architectural heritage protection based on three-dimensional image recognition technology comprises the following steps: The reference marking device is arranged on the side of the architectural heritage corresponding to the reference marking device; generating the monitoring task using the task management subsystem; The architectural heritage is photographed and scanned by the dynamic monitoring subsystem to generate the dynamic three-dimensional image, and position correction is performed based on the reference marking device during the photographing and scanning process; The data analysis subsystem is used to analyze the dynamic three-dimensional image to generate dynamic three-dimensional data corresponding to the architectural heritage.

[0009] Preferably, the specific method of setting the reference marking device corresponding to the side of the architectural heritage includes: Determine three-dimensional geographic data surrounding the said architectural heritage; Taking the architectural heritage as the center, determine several circular candidate areas; In the candidate area, determining at least one installation point based on the three-dimensional geographic data; The reference marking device is correspondingly arranged at the installation point.

[0010] Preferably, the specific method for determining at least one installation point in the candidate area includes: Segmenting the candidate area to obtain a plurality of candidate areas where the reference marking device can be installed; Select at least two high points in the candidate area based on the three-dimensional geographic information; Based on the obstruction between the high point and the architectural heritage, one of the high points is determined as the installation point.

[0011] Preferably, the specific method of generating the monitoring task using the task management subsystem includes: Determining a plurality of monitoring time periods based on a preset monitoring cycle, and generating benchmark tasks corresponding to the monitoring time periods; Acquire meteorological data around the architectural heritage in real time, and generate a plurality of extended tasks based on the meteorological data; The benchmark task and the extended task are integrated to obtain the monitoring task, and the monitoring task corresponds to the architectural heritage.

[0012] Preferably, the specific method for performing position correction based on the reference marking device during the photographing and scanning process includes: The shooting and scanning angles are adjusted until the position of the reference marking device in the image field is the same as the standard position.

[0013] Preferably, the dynamic three-dimensional image includes a plurality of reference images and a plurality of connection images, and the connection images have overlapping portions with at least two of the reference images.

[0014] The present invention adopts a method of pre-assigning monitoring tasks to dynamically monitor architectural heritage, which can effectively improve the monitoring efficiency. Because the changes in architectural heritage are slow, over-frequent monitoring can be avoided. In addition, by setting reference marking points on the side of the architectural heritage, the architectural heritage can be monitored based on the reference marking points, and they are in the same position during each monitoring, thereby ensuring the matching degree of dynamic three-dimensional images obtained by multiple monitorings, so as to calculate the degree of change of the architectural heritage based on the dynamic three-dimensional data. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0016] Figure 1 is a schematic diagram of the setting method of the reference marking device; Figure 2 It is a structural block diagram of the system of the present invention; Figure 3 is a flow chart of the method of the present invention. DETAILED DESCRIPTION

[0017] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0018] See also Figures 1 to 3 , Figure 1 is a schematic diagram of the setting method of the reference marking device, Figure 2 is a structural block diagram of the system of the present invention, Figure 3 is a flow chart of the method of the present invention.

[0019] A building heritage protection monitoring system based on three-dimensional image recognition technology includes a task management subsystem, a dynamic monitoring subsystem, a data analysis subsystem and a plurality of reference marking devices.

[0020] A plurality of reference marking devices, the reference marking devices corresponding to the architectural heritage, are used to form a plurality of reference marking points on the side of the architectural heritage.

[0021] The task management subsystem is used to generate monitoring tasks corresponding to architectural heritage.

[0022] The dynamic monitoring subsystem is used to monitor the architectural heritage based on monitoring tasks and reference markers, and generate dynamic three-dimensional images corresponding to the architectural heritage.

[0023] The data analysis subsystem is used to analyze the dynamic three-dimensional images and generate dynamic three-dimensional data corresponding to the architectural heritage.

[0024] When the present invention is used to carry out protection monitoring of architectural heritage, firstly, a reference marking device is set on the side of the architectural heritage, and a reference marking point is formed on the side of the architectural heritage by using the reference marking device; then, a monitoring task is generated by using a task management subsystem, and the monitoring task corresponds to the architectural heritage; thereafter, the architectural heritage is monitored based on the monitoring task by using a dynamic monitoring subsystem, and a dynamic three-dimensional image corresponding to the architectural heritage is generated based on the reference marking point on the side of the architectural heritage during the monitoring process; after the dynamic three-dimensional image is acquired, the dynamic three-dimensional image is analyzed by using a data analysis subsystem to obtain dynamic three-dimensional data corresponding to the architectural heritage, and based on the difference between the dynamic three-dimensional data obtained in multiple monitorings of the architectural heritage, the change of the architectural heritage can be calculated.

[0025] The present invention adopts a method of pre-assigning monitoring tasks to dynamically monitor architectural heritage, which can effectively improve the monitoring efficiency. Because the changes in architectural heritage are slow, over-frequent monitoring can be avoided. In addition, by setting reference marking points on the side of the architectural heritage, the architectural heritage can be monitored based on the reference marking points, and they are in the same position during each monitoring, thereby ensuring the matching degree of dynamic three-dimensional images obtained by multiple monitorings, so as to calculate the degree of change of the architectural heritage based on the dynamic three-dimensional data.

[0026] The specific structure of the reference marker device is as follows: the reference marker device includes a plurality of reference marker rods, which are fixedly arranged on the periphery of the architectural heritage, and the top of the reference marker rod is provided with a reference marker pattern, which forms a reference marker point, and the reference marker patterns on different reference marker rods have different colors. The setting of the reference marker rod needs to refer to the surrounding environment to avoid being disturbed by factors such as surrounding plants, and the reference marker rod needs to be set at a high position around the architectural heritage to ensure that the reference marker rod can be used as a reference smoothly during monitoring.

[0027] The specific structure of the dynamic monitoring subsystem is as follows: the dynamic monitoring subsystem includes multiple monitoring drones, which are used to photograph and scan the architectural heritage based on the monitoring task, and perform position correction based on the reference markers during the photographing and scanning process. The drones can be used to photograph and scan the architectural heritage from the sides of the architectural heritage to obtain dynamic three-dimensional images. The monitoring drones can adjust their positions according to the reference markers within the field of view to ensure that the positions of the reference markers within the field of view are the same each time the monitoring is performed, thereby analyzing the dynamic three-dimensional images and performing difference calculations on the dynamic three-dimensional data.

[0028] The specific structure of the data analysis subsystem is as follows: the data analysis subsystem includes a plurality of data analysis devices, all of which are in communication connection, and each data analysis device is provided with at least one data interface, which is used to cooperate with the monitoring drone to obtain dynamic three-dimensional images from the monitoring drone, and the task management subsystem is also used to generate analysis tasks corresponding to the data analysis device. After obtaining the dynamic three-dimensional images of the architectural heritage, the task management subsystem generates analysis tasks corresponding to the data analysis device, and distributes the dynamic three-dimensional images to be analyzed to the data analysis device or distributes the dynamic three-dimensional images to the data analysis device after segmentation, thereby using the data analysis device for distributed processing, which can avoid the inefficiency caused by excessive load on a single data analysis device, and can efficiently utilize the data analysis device.

[0029] In a specific embodiment of the present invention, a building heritage protection monitoring system based on three-dimensional image recognition technology includes a task management subsystem, a dynamic monitoring subsystem, a data analysis subsystem and a plurality of reference marking devices.

[0030] A plurality of reference marking devices, the reference marking devices correspond to the architectural heritage and are used to form a plurality of reference marking points on the side of the architectural heritage. The reference marking devices include a plurality of reference marking rods, the reference marking rods are fixedly arranged on the circumference of the architectural heritage, the tops of the reference marking rods are provided with reference marking patterns, the reference marking patterns form reference marking points, and the reference marking patterns on different reference marking rods have different colors.

[0031] The task management subsystem is used to generate monitoring tasks corresponding to architectural heritage.

[0032] The dynamic monitoring subsystem is used to monitor the architectural heritage based on the monitoring tasks and reference markers, and generate dynamic three-dimensional images corresponding to the architectural heritage. The dynamic monitoring subsystem includes multiple monitoring drones, which are used to photograph and scan the architectural heritage based on the monitoring tasks, and perform position correction based on the reference markers during the photographing and scanning process.

[0033] The data analysis subsystem is used to analyze the dynamic three-dimensional image and generate dynamic three-dimensional data corresponding to the architectural heritage. The data analysis subsystem includes multiple data analysis devices, all of which are connected in communication, and each data analysis device is provided with at least one data interface, which is used to cooperate with the monitoring drone to obtain dynamic three-dimensional images from the monitoring drone. The task management subsystem is also used to generate analysis tasks corresponding to the data analysis devices.

[0034] The present invention further provides a method for monitoring the protection of architectural heritage based on three-dimensional image recognition technology, and a system for monitoring the protection of architectural heritage based on the above three-dimensional image recognition technology, comprising the following steps: S1: Setting a reference marking device on the side of the architectural heritage. The specific method of setting a reference marking device on the side of the architectural heritage includes S11 to S14: S11: Determine the three-dimensional geographic data around the architectural heritage. The three-dimensional geographic data can be directly obtained from the existing geographic information management system, which will not be described in detail here.

[0035] S12: With the architectural heritage as the center, determine several annular candidate areas. In order to facilitate the monitoring drone to determine the position of the reference marker pole within the field of view, it is necessary to have a certain distance between two adjacent reference marker poles, and the interval cannot be too close. Therefore, first determine several annular candidate areas with the architectural heritage as the center, and at least one reference marker pole can be set in each candidate area.

[0036] S13: In the candidate area, determine at least one installation point based on the three-dimensional geographic data. In the candidate area, select multiple points whose heights exceed a preset height threshold as installation points based on the three-dimensional geographic data, so that after the installation of the reference marker pole, its top has a certain height, which can avoid the reference marker pole being disturbed by surrounding plants and other factors as much as possible, thereby ensuring that the monitoring drone can smoothly determine the position of the reference marker point within the field of view. Among them, the specific method of determining at least one installation point in the candidate area includes S131 to S133: S131: Segment the candidate area to obtain multiple candidate areas where the reference marking device can be installed. The candidate area is segmented based on the height data of the candidate area, and the part with an average height close to or exceeding the height threshold needs to be selected as the candidate area.

[0037] S132: Select at least two high points in the candidate area based on the three-dimensional geographic information. In order to fully avoid interference of the reference marker pole by surrounding plants and other factors, at least two high points need to be selected as backup, and after field investigation, a suitable high point is selected.

[0038] S133: Determine one of the high points as the installation point based on the shielding between the high point and the architectural heritage. The number of installation points is determined by the number of reference marker poles to be set, and can be flexibly selected according to actual needs.

[0039] S14: A reference marking device is provided at the corresponding installation point.

[0040] S2: Generate monitoring tasks using the task management subsystem. The specific method of generating monitoring tasks using the task management subsystem includes S21 to S23: S21: Determine a plurality of monitoring time periods based on a preset monitoring cycle, and generate reference tasks corresponding to the monitoring time periods.

[0041] S22: Acquire meteorological data around the architectural heritage in real time, and generate several extended tasks based on the meteorological data.

[0042] S23: Integrate the baseline task and the extended task to obtain the monitoring task, which corresponds to the architectural heritage.

[0043] In the monitoring tasks, the baseline task is used to monitor the architectural heritage periodically, and the extended task is used to flexibly monitor the architectural heritage when meteorological disasters occur around the architectural heritage or abnormal meteorological conditions that may affect the architectural heritage occur, thereby fully ensuring the accuracy of the monitoring results of the architectural heritage.

[0044] S3: Using the dynamic monitoring subsystem to photograph and scan the architectural heritage to generate a dynamic three-dimensional image, and performing position correction based on the reference marker device during the photographing and scanning process. The specific method of performing position correction based on the reference marker device during the photographing and scanning process includes S31 to S32: S31: Adjust the shooting and scanning angles until the position of the reference marker device in the image field of view is the same as the standard position. The standard position is the position where the reference marker rod needs to be within the field of view of the monitoring drone.

[0045] S32: The dynamic three-dimensional image includes a plurality of reference images and a plurality of connection images, and the connection images have overlapping portions with at least two reference images.

[0046] S4: Analyze the dynamic three-dimensional image using the data analysis subsystem to generate dynamic three-dimensional data corresponding to the architectural heritage. The specific method of analyzing the dynamic three-dimensional image and generating dynamic three-dimensional data belongs to the prior art and will not be described here. The obtained dynamic three-dimensional data can be the point cloud data of the architectural heritage.

[0047] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0048] The above description of the disclosed embodiments enables one skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A building heritage protection monitoring system based on three-dimensional image recognition technology, characterized in that: include: A plurality of reference marking devices, the reference marking devices corresponding to the architectural heritage, and used to form a plurality of reference marking points on the side of the architectural heritage; A task management subsystem, used for generating monitoring tasks corresponding to the architectural heritage; A dynamic monitoring subsystem, configured to monitor the architectural heritage based on the monitoring task and the reference marking points, and generate a dynamic three-dimensional image corresponding to the architectural heritage; The data analysis subsystem is used to analyze the dynamic three-dimensional image and generate dynamic three-dimensional data corresponding to the architectural heritage.

2. The architectural heritage protection monitoring system based on three-dimensional image recognition technology as claimed in claim 1, characterized in that: The reference mark device includes a plurality of reference mark rods, wherein the reference mark rods are fixedly arranged on the peripheral side of the architectural heritage, and a reference mark graphic is arranged on the top of the reference mark rod, wherein the reference mark graphic forms the reference mark point, and the reference mark graphics on different reference mark rods have different colors.

3. The architectural heritage protection monitoring system based on three-dimensional image recognition technology as claimed in claim 2, characterized in that: The dynamic monitoring subsystem includes a plurality of monitoring drones, which are used to photograph and scan the architectural heritage based on the monitoring task, and perform position correction based on the reference marking points during the photographing and scanning process.

4. The architectural heritage protection monitoring system based on three-dimensional image recognition technology as claimed in claim 3, characterized in that: The data analysis subsystem includes multiple data analysis devices, all of which are communicatively connected. Each of the data analysis devices is provided with at least one data interface, and the data interface is used to cooperate with the monitoring drone to obtain the dynamic three-dimensional image from the monitoring drone. The task management subsystem is also used to generate analysis tasks corresponding to the data analysis devices.

5. A monitoring method of a building heritage protection monitoring system based on the three-dimensional image recognition technology as claimed in any one of claims 1 to 4, characterized in that: The steps include: The reference marking device is arranged on the side of the architectural heritage corresponding to the reference marking device; generating the monitoring task using the task management subsystem; The architectural heritage is photographed and scanned by the dynamic monitoring subsystem to generate the dynamic three-dimensional image, and position correction is performed based on the reference marking device during the photographing and scanning process; The data analysis subsystem is used to analyze the dynamic three-dimensional image to generate dynamic three-dimensional data corresponding to the architectural heritage.

6. The architectural heritage protection monitoring method based on three-dimensional image recognition technology as claimed in claim 5, characterized in that: The specific method of setting the reference marking device corresponding to the side of the architectural heritage includes: Determine three-dimensional geographic data surrounding the said architectural heritage; Taking the architectural heritage as the center, determine several circular candidate areas; In the candidate area, determining at least one installation point based on the three-dimensional geographic data; The reference marking device is correspondingly arranged at the installation point.

7. The architectural heritage protection monitoring method based on three-dimensional image recognition technology as claimed in claim 6, characterized in that: The specific method for determining at least one installation point in the candidate area includes: Segmenting the candidate area to obtain a plurality of candidate areas where the reference marking device can be installed; Select at least two high points in the candidate area based on the three-dimensional geographic information; Based on the obstruction between the high point and the architectural heritage, one of the high points is determined as the installation point.

8. The architectural heritage protection monitoring method based on three-dimensional image recognition technology as claimed in claim 5, characterized in that: The specific method of generating the monitoring task by using the task management subsystem includes: Determining a plurality of monitoring time periods based on a preset monitoring cycle, and generating benchmark tasks corresponding to the monitoring time periods; Acquire meteorological data around the architectural heritage in real time, and generate a plurality of extended tasks based on the meteorological data; The benchmark task and the extended task are integrated to obtain the monitoring task, and the monitoring task corresponds to the architectural heritage.

9. The architectural heritage protection monitoring method based on three-dimensional image recognition technology as claimed in claim 5, characterized in that: The specific method for performing position correction based on the reference marking device during the shooting and scanning process includes: The shooting and scanning angles are adjusted until the position of the reference marking device in the image field is the same as the standard position.

10. The architectural heritage protection monitoring method based on three-dimensional image recognition technology according to claim 5, characterized in that: The dynamic three-dimensional image includes a plurality of reference images and a plurality of connection images, and the connection images have overlapping parts with at least two of the reference images.

Images