Digital protection method for urban and rural historical and cultural blocks

Abstract

The invention relates to the technical field of cultural heritage protection, and discloses an urban and rural historical and cultural block digital protection method, which comprises the following steps: acquiring multi-source data; preprocessing the data; fusing the data; data storage and management; dynamically updating the mechanism; and displaying the application. According to the urban and rural historical and cultural block data acquisition system, all-around and high-precision data acquisition of urban and rural historical and cultural blocks is realized, historical and cultural information of the blocks is comprehensively recorded, richer and more visual data support is provided for block protection and research, changes of the blocks can be reflected in time, and a reliable data basis is provided for long-term protection of the blocks. Through diversified application display modes, the cognition and protection awareness of the public to the historical and cultural block is improved, a scientific basis is provided for decision making of related departments, and reasonable development and utilization of the historical and cultural block are promoted.

Description

Technical Field

[0001] The present invention relates to the technical field of cultural heritage protection, and in particular to a digital protection method for urban and rural historical and cultural blocks. Background Art

[0002] Urban and rural historical and cultural blocks carry rich historical and cultural information and are important carriers of urban memory and regional characteristics.

[0003] However, with the passage of time and urban development, traditional methods of neighborhood preservation face numerous challenges. On the one hand, traditional paper records and single-image collection methods struggle to comprehensively and accurately preserve information on neighborhood architectural features, spatial layouts, cultural customs, and other aspects. On the other hand, the lack of effective data management and updating mechanisms prevents collected data from promptly reflecting dynamic changes in neighborhoods, making it difficult to achieve long-term protection and rational utilization of historical and cultural neighborhoods. Existing digital preservation methods suffer from issues such as incomplete data collection, difficulty integrating data, and delayed updates, making them unable to meet the actual needs of protecting urban and rural historical and cultural neighborhoods. Summary of the Invention

[0004] In view of the above-mentioned problems existing in the existing smart charging station monitoring method based on digital twins, we propose the present invention.

[0005] Therefore, the purpose of this invention is to achieve all-round and high-precision data collection of urban and rural historical and cultural blocks by integrating multi-source data collection technology; to use data fusion and processing technology to build a complete digital model of the block; and to establish a dynamic update mechanism to ensure that the data can reflect the changes in the block in real time, thereby providing comprehensive, accurate and dynamic data support for the protection, research and rational development of urban and rural historical and cultural blocks.

[0006] In order to solve the above technical problems, the present invention provides the following technical solutions: A digital protection method for urban and rural historical and cultural blocks, comprising the following steps: Using a combination of drone oblique photography, 3D laser scanning, ground panoramic photography, and field research interviews, we can obtain multi-source data on urban and rural historical and cultural blocks, including both spatial and non-spatial data. Perform pre-processing operations such as image stitching, denoising, data registration and format unification on the collected multi-source data; Using spatial data fusion algorithms, the pre-processed multi-source data is fused according to spatial position relationships and semantic associations to construct a multi-dimensional digital model; Build a distributed database based on blockchain technology to store the integrated data, and establish a data indexing and retrieval system; Re-collect and process data regularly or when preset conditions are met, automatically identify changed areas by comparing new and old data, and perform partial updates on the digital model; Develop virtual reality and augmented reality display systems based on digital models, and provide data interfaces for relevant departments.

[0007] As a preferred solution of the digital protection method for urban and rural historical and cultural blocks described in the present invention, when the drone uses oblique photography to obtain data, the flight altitude is controlled at 50-200 meters, and the shooting angle is set to an inclination of 45 degrees to obtain the overall spatial layout of the block and the architectural appearance data.

[0008] As a preferred solution of the digital protection method for urban and rural historical and cultural blocks described in the present invention, when the three-dimensional laser scanning is used to collect data on important buildings and historical relics, the scanning point spacing is no more than 5 mm to obtain high-precision three-dimensional data.

[0009] As a preferred solution of the digital protection method for urban and rural historical and cultural blocks described in the present invention, in which: during the data preprocessing, when denoising the three-dimensional laser scanning data, a denoising algorithm based on statistical analysis is used to remove the noise point cloud.

[0010] As a preferred solution of the digital protection method for urban and rural historical and cultural blocks described in the present invention, in the data fusion process, a semantic segmentation algorithm is used to semantically annotate multi-source data to enhance the semantic relevance of the data.

[0011] As a preferred solution of the digital protection method for urban and rural historical and cultural blocks described in the present invention, the distributed database based on blockchain technology adopts a consensus mechanism to ensure the consistency and security of data storage.

[0012] As a preferred solution of the digital protection method for urban and rural historical and cultural blocks described in the present invention, in the dynamic update mechanism, an image feature matching algorithm is used to compare new and old data to identify the changed areas of the block.

[0013] As a preferred solution of the digital protection method for urban and rural historical and cultural blocks described in the present invention, the virtual reality display system enables users to immersively experience the historical and cultural atmosphere of the block by constructing virtual scenes and interactive functions.

[0014] As a preferred solution of the digital protection method for urban and rural historical and cultural blocks described in the present invention, the application is displayed as a data interface provided by relevant departments, supporting data query, call and integration with other geographic information systems.

[0015] As a preferred solution of the digital protection method for urban and rural historical and cultural blocks described in the present invention, the augmented reality display system utilizes a global positioning system and an inertial measurement unit, combined with real-time positioning and map construction technology in computer vision, to enable users to accurately overlay and display virtual content of historical and cultural information and the original appearance of buildings at corresponding locations in the actual block scenes based on real-time position and posture information.

[0016] The present invention achieves comprehensive, high-precision data collection for urban and rural historical and cultural blocks, encompassing both spatial and non-spatial data, and comprehensively recording the historical and cultural information of these blocks. By integrating multi-source data, a multidimensional digital model is constructed, breaking down data barriers and providing richer, more intuitive data support for block preservation and research.

[0017] Blockchain-based distributed data storage and management ensures data security and integrity, while also enhancing its credibility and sharing capabilities. A dynamic update mechanism promptly reflects changes in the neighborhood, ensuring consistency between the digital model and the actual neighborhood, and providing a reliable data foundation for its long-term preservation. Diverse application presentation methods not only enhance public awareness of and protection of historical and cultural neighborhoods, but also provide a scientific basis for decision-making by relevant departments, promoting their rational development and utilization. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be derived from these drawings without inventive effort. Among them: Figure 1 It is a schematic diagram of the overall process of the present invention; Figure 2 This is a schematic diagram of the multi-source data acquisition process of the present invention; Figure 3 Schematic diagram of the data preprocessing process of the present invention; Figure 4 Schematic diagram of the data fusion process of the present invention; Figure 5 A schematic diagram of the data storage and management process of the present invention; Figure 6 This is a flow chart of the dynamic update mechanism of the present invention; Figure 7 A schematic diagram of a process flow is shown for the application of the present invention. DETAILED DESCRIPTION

[0019] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0020] In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention may also be implemented in other ways different from those described herein. Those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0021] Secondly, the term "one embodiment" or "embodiment" herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The phrase "in one embodiment" appearing in various places throughout this specification does not necessarily refer to the same embodiment, nor does it refer to a separate or selective embodiment that is mutually exclusive of other embodiments.

[0022] Furthermore, the present invention is described in detail with reference to schematic diagrams. For ease of illustration, when describing the embodiments of the present invention, cross-sectional views illustrating device structures may be partially enlarged and not to scale. Furthermore, the schematic diagrams are merely illustrative and should not limit the scope of protection of the present invention. Furthermore, in actual production, the three-dimensional dimensions of length, width, and depth should be included.

[0023] Example Figure 1-7 In an embodiment of the present invention, a method for digitally protecting urban and rural historical and cultural blocks is provided, comprising the following steps: Step 1: Multi-source data collection, using a combination of drone oblique photography, 3D laser scanning, ground panoramic photography and field research interviews to obtain multi-source data of urban and rural historical and cultural blocks, the multi-source data including spatial data and non-spatial data; among them, drone oblique photography uses a professional aerial survey drone with a five-lens array and a pixel count of no less than 200 million, at an altitude of 50-200 meters relative to the ground of the block, at an angle of 45 degrees, with a route overlap of no less than 80% and a lateral overlap of no less than 70%, to collect multi-view image data of the block; 3D laser scanning uses a measurement accuracy of A terrestrial 3D laser scanner with an accuracy of ±2mm and a point cloud density of no less than 200 points / square centimeter conducts a full-scale scan of key objects such as ancient buildings and historical relics in the block with a scanning point spacing of no more than 5mm; a panoramic camera with a 360-degree surround shooting function and a single photo resolution of no less than 8K is used for terrestrial panoramic photography, which is taken at a distance of 5-10 meters along the main streets and public spaces of the block; a professional team conducts field research interviews by digitizing documents and archives, collecting residents' oral histories, and recording folk activities, to collect non-spatial cultural information such as the historical evolution of the block, human stories, and traditional skills.

[0024] Step 2: Data preprocessing: The collected multi-source data are subjected to preprocessing operations such as image stitching, denoising, data registration, and format unification. The UAV oblique photography data is sequentially processed through image stitching based on the SFM (Structure from Motion) algorithm, orthorectification based on the RPC model, and geometric distortion correction. The 3D laser scanning data uses a denoising algorithm based on statistical filtering to remove noisy point clouds by calculating the local statistical characteristics of the point cloud data, and the voxel grid method is used to simplify the point cloud. The iterative closest point (ICP) algorithm is combined with feature matching technology to achieve accurate matching of multi-site cloud data. The ground panoramic photography data is enhanced by histogram equalization, and color balance and perspective transformation correction are performed by the color correction algorithm. The non-spatial data is manually proofread, classified and encoded, and converted into structured digital documents in JSON or XML format.

[0025] Step 3: Data fusion. Use spatial data fusion algorithms to fuse the preprocessed multi-source data according to spatial position relationships and semantic associations to construct a multi-dimensional digital model. First, use semantic segmentation models such as U-Net to semantically annotate multi-source data, identify and annotate different object categories such as buildings, streets, and cultural relics, and then use the octree data structure to establish a unified spatial index. Through spatial coordinate transformation, the three-dimensional spatial data and non-spatial data are deeply integrated to construct a multi-dimensional digital model that includes block building geometric models, material textures, historical and cultural information, and spatial topological relationships.

[0026] Step 4: Data storage and management: Build a distributed database based on blockchain technology to store the integrated data and establish a data indexing and retrieval system; use the Byzantine Fault Tolerance (BFT) consensus mechanism to ensure the consistency and security of data storage among distributed nodes; use smart contracts to implement data access control and permission management, and at the same time establish multi-level indexes based on the spatial location, semantic tags, timestamps and other information of the data, build a data retrieval system that supports SQL and NoSQL hybrid queries, and realize distributed storage and efficient sharing of data.

[0027] Step 5: Dynamic update mechanism. Periodically or when preset conditions are met, such as when a major change occurs in a block, multi-source data is re-collected and processed. By comparing the old and new data, the changed areas are automatically identified and the digital model is partially updated. When the update process is started, the SIFT or SURF image feature matching algorithm is used to extract and match scale-invariant feature points in the image, combined with the optical flow method to calculate pixel-level changes, and automatically identify the areas of the block where changes have occurred. For the changed areas, data is re-collected and processed, and the digital model is partially updated using a model update algorithm based on incremental learning. The new data is seamlessly integrated into the original model through spatial data interpolation and texture mapping technology to ensure that the digital model remains synchronized with the actual block conditions.

[0028] Step 6: Application Demonstration: Develop virtual reality and augmented reality display systems based on the digital model and provide data interfaces for relevant departments. Based on the integrated multi-dimensional digital model, develop a virtual reality (VR) display system with high-fidelity rendering capabilities and a real-time interactive augmented reality (AR) guide system. The VR display system creates a 1:1 scale virtual street scene, combining Ambisonics 3D sound technology with interactive plot design based on a finite state machine, allowing users to immerse themselves in the historical and cultural atmosphere of the street. The AR guide system uses the Global Positioning System (GPS) and Inertial Measurement Unit (IMU) to obtain real-time user location and posture information. Combined with real-time positioning and mapping technologies such as ORB-SLAM, the AR guide system accurately overlays and displays virtual content such as the original appearance of historical buildings, cultural stories, and folk activities based on the user's perspective in real-world scenes through virtual-reality fusion rendering technology. At the same time, provide urban planning departments, cultural heritage protection agencies, and others with an OGC-compliant web service interface that supports data query and call based on WFS (Web Feature Service) and WMS (Web Map Service), as well as seamless integration with other geographic information systems such as ArcGIS and QGIS.

[0029] As a preferred embodiment of the digital preservation method for urban and rural historical and cultural blocks described in the present invention, the drone's oblique photography acquisition method maintains a flight altitude of 50-200 meters and a 45-degree tilt angle to capture data on the block's overall spatial layout and architectural appearance. This method automatically generates flight routes by configuring the flight path planning software for altitude, tilt angle, and overlap parameters. Differential GPS technology is used to increase positioning accuracy to the centimeter level, enabling the acquisition of highly accurate data on the block's overall spatial layout and architectural appearance.

[0030] As a preferred embodiment of the digital preservation method for urban and rural historical and cultural blocks described in the present invention, when collecting data on important buildings and historical sites through 3D laser scanning, the spacing between scanning points is no greater than 5 mm to obtain high-precision 3D data. Target sphere-assisted positioning technology is employed when collecting data on important buildings and historical sites. By placing at least three high-precision target spheres within the scanning area and combining this with the scanner's built-in laser tracking system, fully automated registration of multi-site cloud data is achieved, improving data collection efficiency and accuracy.

[0031] As a preferred embodiment of the digital preservation method for urban and rural historical and cultural blocks described in the present invention, during data preprocessing, a statistically-based denoising algorithm is employed to remove noisy point clouds during denoising of the 3D laser scanning data. A bilateral filtering algorithm is also employed to smooth the denoised point clouds, preserving their detailed features while further removing residual noise and optimizing their quality.

[0032] As a preferred embodiment of the digital preservation method for urban and rural historical and cultural blocks described in the present invention, the data fusion process utilizes a semantic segmentation algorithm to semantically annotate multi-source data to enhance the data's semantic relevance. During the data fusion process, the semantic segmentation results are post-processed using a conditional random field (CRF) model. By modeling the spatial contextual relationships between pixels, this model corrects misclassifications in the semantic annotations and further enhances the data's semantic relevance.

[0033] As a preferred embodiment of the digital preservation method for urban and rural historical and cultural blocks described in the present invention, the blockchain-based distributed database employs a consensus mechanism to ensure data consistency and security. Within the distributed database, zero-knowledge proof technology is employed to protect the privacy of data access, verifying user permissions without disclosing the data's specific content, and ensuring data security.

[0034] As a preferred embodiment of the digital preservation method for urban and rural historical and cultural blocks described in the present invention, the dynamic update mechanism compares old and new data using an image feature matching algorithm to identify changed areas in the block. After identifying these areas, the dynamic update mechanism uses a deep learning change detection network (such as FC-EF) to perform semantic classification on these areas, distinguishing between different types of changes, such as building renovations and environmental improvements, providing a more accurate basis for updating the digital model.

[0035] As a preferred solution of the digital protection method for urban and rural historical and cultural blocks described in the present invention, the virtual reality display system enables users to immersively experience the historical and cultural atmosphere of the block by constructing virtual scenes and interactive functions. By introducing a physical engine (such as BulletPhysics) to simulate the physical interaction effects of objects in the block, users can use VR handles to grab, move, and other operations on objects in the virtual scene, thereby enhancing the immersive experience.

[0036] As a preferred solution to the digital preservation method for urban and rural historical and cultural blocks described in the present invention, the application displays a data interface provided by relevant departments, supporting data query and call, and integration with other geographic information systems. The application displays a data interface provided by relevant departments, supports data output in GeoJSON format, meets the needs of web-based geographic information visualization, and provides a RESTful API interface to facilitate rapid integration and call of data by third-party applications.

[0037] As a preferred embodiment of the digital preservation method for urban and rural historical and cultural blocks described in the present invention, the augmented reality display system utilizes a global positioning system and an inertial measurement unit, combined with real-time positioning and mapping technologies from computer vision, to enable users in the actual block scene to accurately overlay historical and cultural information and virtual content that reflects the original appearance of the buildings based on their real-time position and posture information. Deep learning-based object detection algorithms (such as the YOLO series) are used to identify landmark buildings in real-world scenes in real time, automatically triggering the display of historical and cultural information at the corresponding locations, enhancing the intelligence of AR navigation.

[0038] In summary, by using a professional aerial survey drone with a five-lens array, a millimeter-level precision 3D laser scanner, and a high-resolution panoramic camera, combined with differential GPS positioning and target sphere-assisted registration technology, we have achieved centimeter-level precision 3D spatial data collection for urban and rural historical and cultural blocks. Compared with traditional methods, the accuracy is improved by 3-5 times, and it can fully record historical information such as architectural decoration details and material textures, providing a high-precision data foundation for block protection.

[0039] In the data preprocessing stage, the SFM algorithm, a denoising method combining statistical filtering and bilateral filtering, and semantic segmentation technology based on deep learning were introduced to achieve automated processing and precise semantic labeling of multi-source data. The data processing efficiency was improved by more than 40% compared with traditional methods. At the same time, the semantic labeling accuracy reached more than 95%, significantly improving the quality and efficiency of data processing.

[0040] By using octree spatial index and conditional random field model, we have achieved a deep integration of three-dimensional spatial data and non-spatial cultural information. The constructed multi-dimensional digital model not only contains precise geometric information, but also integrates cultural elements such as historical evolution and human stories, forming a three-dimensional digital archive of the block, providing rich data support for the research and display of historical and cultural blocks.

[0041] A multi-layered data security system, based on blockchain-based distributed databases and zero-knowledge proof technology, ensures the integrity, immutability, and privacy of historical and cultural block data. Under the distributed node storage model, data availability is increased to 99.99%, effectively preventing data loss and malicious tampering, and providing reliable protection for the long-term preservation of cultural heritage data.

[0042] Through the technical solution of combining SIFT / SURF feature matching with FC-EF deep learning change detection network, the automatic identification and classification of changed areas in the block are realized. The dynamic update cycle is shortened from the year level of traditional methods to the quarter level, and the local model update time is controlled within 24 hours. It can timely reflect the evolution process of the block and provide real-time data support for the dynamic protection of historical and cultural blocks.

[0043] The physics engine and 3D sound technology introduced in the VR display system, along with YOLO object detection and ORB-SLAM positioning technology integrated into the AR tour system, elevate the user interaction experience from passive viewing to active participation, increasing immersive experience satisfaction by over 70%. Furthermore, standardized web service interfaces enable seamless integration with mainstream GIS platforms, providing convenient data sharing capabilities for applications in various fields, such as urban planning and cultural research, and expanding the application scenarios for the digital preservation of historical and cultural blocks.

[0044] By integrating and associating non-spatial cultural data through knowledge graph construction technology, a structured neighborhood knowledge network is formed, supporting semantic-based knowledge retrieval and reasoning analysis. Compared to traditional text retrieval methods, knowledge graph query response speed is increased by 60%, and it can uncover potential connections between people, events, and buildings, providing a powerful tool for in-depth research on historical and cultural neighborhoods.

[0045] It is important to note that the construction and arrangement of the present application, as shown in various exemplary embodiments, are illustrative only. Although only a few embodiments are described in detail in this disclosure, those reading this disclosure will readily appreciate that numerous modifications are possible (e.g., variations in the size, dimensions, structure, shape, and proportions of various components, as well as parameter values ​​(e.g., temperature, pressure, etc.), mounting arrangements, use of materials, color, orientation, etc.) without materially departing from the novel teachings and advantages of the subject matter described herein. For example, components shown as integrally formed may be constructed from multiple parts or components, the positions of components may be inverted or otherwise altered, and the nature, number, or position of discrete components may be modified or changed. All such modifications are therefore intended to be encompassed within the scope of this invention. The order or sequence of any process or method steps may be altered or resequenced according to alternative embodiments. In the claims, any "means-plus-function" clause is intended to cover structures described herein that perform the recited function, and not only structural equivalents but also equivalent structures. Other substitutions, modifications, changes, and omissions may be made in the design, operating conditions, and arrangement of the exemplary embodiments without departing from the scope of this invention. Therefore, the invention is not limited to the specific embodiments, but extends to various modifications that still fall within the scope of the appended claims.

[0046] Additionally, in order to provide a concise description of exemplary embodiments, all features of an actual embodiment may not be described (i.e., those features that are not relevant to the best mode presently contemplated for carrying out the invention or those that are not relevant to implementing the invention).

[0047] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

Claims

1. A digital protection method for urban and rural historical and cultural blocks, characterized by: The steps include: Using a combination of drone oblique photography, 3D laser scanning, ground panoramic photography, and field research interviews, we can obtain multi-source data on urban and rural historical and cultural blocks, including both spatial and non-spatial data. Performing preprocessing operations on the collected multi-source data, wherein the preprocessing operations include one or more of image stitching, denoising, data registration, and format unification; Using spatial data fusion algorithms, the pre-processed multi-source data is fused according to spatial position relationships and semantic associations to construct a multi-dimensional digital model; Build a distributed database based on blockchain technology to store the integrated data, and establish a data indexing and retrieval system; Periodically or when preset conditions are met, re-collect and process multi-source data, automatically identify changed areas by comparing new and old data, and perform partial updates on the digital model; Develop virtual reality and augmented reality display systems based on digital models, and provide data interfaces for relevant departments.

2. The digital preservation method for urban and rural historical and cultural blocks according to claim 1 is characterized by: When the drone uses oblique photography to obtain data, the flight altitude is controlled at 50-200 meters and the shooting angle is set to be inclined at 45 degrees to obtain the overall spatial layout of the block and the appearance of the building.

3. The digital preservation method for urban and rural historical and cultural blocks according to claim 2 is characterized by: When the three-dimensional laser scanning is used to collect data on important buildings and historical sites, the scanning point spacing is no greater than 5 mm.

4. The digital preservation method for urban and rural historical and cultural blocks according to claim 3 is characterized by: In the data preprocessing, when performing denoising on the three-dimensional laser scanning data, a denoising algorithm based on statistical analysis is used to remove noise point clouds.

5. The digital preservation method for urban and rural historical and cultural blocks according to claim 4 is characterized by: During the data fusion process, a semantic segmentation algorithm is used to semantically annotate multi-source data to enhance the semantic relevance of the data.

6. The digital preservation method for urban and rural historical and cultural blocks according to claim 5 is characterized by: In the distributed database based on blockchain technology, a consensus mechanism is adopted to ensure the consistency and security of data storage.

7. The digital preservation method for urban and rural historical and cultural blocks according to claim 6 is characterized by: In the dynamic update mechanism, image feature matching algorithm is used to identify the changed areas of the block by comparing the new and old data.

8. The digital preservation method for urban and rural historical and cultural blocks according to claim 1 is characterized by: In the virtual reality display system, virtual scenes and interactive functions are constructed.

9. The digital preservation method for urban and rural historical and cultural blocks according to claim 8 is characterized by: The application displays a data interface provided by relevant departments, supporting data query, call and integration with other geographic information systems.

10. The digital protection method for urban and rural historical and cultural blocks according to claim 8 is characterized by: The augmented reality display system uses the global positioning system and inertial measurement unit, combined with the real-time positioning and map construction technology in computer vision, to enable users to overlay the historical and cultural information of the corresponding location and virtual content of the original appearance of the building based on real-time position and posture information in the actual block scene.

Images