Digital protection method, system and equipment for three-dimensional reconstruction and restoration of cultural relics and medium

Abstract

The invention belongs to the technical field of three-dimensional modeling, and relates to a digital protection method, system and equipment for three-dimensional reconstruction and restoration of cultural relics and a medium. According to the method, the point cloud data and the texture image of the complete cultural relic are acquired, and the acquisition of the point cloud data provides a basis for subsequent three-dimensional modeling. The color three-dimensional model of the cultural relic is constructed according to the point cloud data and the texture image of the cultural relic, and the color three-dimensional model is generated through the point cloud data and the texture image, so that the precision and reality sense of the three-dimensional model of the cultural relic can be improved. And identifying a damaged area on the surface of the cultural relic, generating corresponding virtual repair fragments according to features of the damaged area, and performing splicing repair on the damaged area of the color three-dimensional model by using the virtual repair fragments. The virtual repair technology avoids direct operation on the real cultural relics, reduces the risk of secondary damage, and in addition, through computer-assisted repair, the cultural relic repair process is more automatic and intelligent, and the efficiency and accuracy of repair work can be greatly improved.

Description

Technical Field

[0001] The invention belongs to the technical field of three-dimensional modeling, and relates to a digital protection method, system, equipment and medium for three-dimensional reconstruction and restoration of cultural relics. Background Art

[0002] As an important innovation in the field of cultural heritage protection, digital protection technology for cultural relics has received widespread attention and rapid application in recent years. The development of this technology not only provides new solutions for the long-term preservation and inheritance of cultural relics, but also enables the public to access and understand historical and cultural heritage in a more intuitive and vivid way. Among them, 3D reconstruction technology, as one of the core means of digital protection of cultural relics, is particularly important.

[0003] Traditional 3D reconstruction methods, such as image-based modeling and laser scanning, can generate 3D models of cultural relics to a certain extent, but some problems have gradually been exposed in practical applications. Especially when dealing with cultural relics with complex surface details and structures, traditional methods often find it difficult to accurately capture and restore these subtle features, resulting in a lack of accuracy in the generated 3D model. This not only affects the realism and visualization of the model, but also limits its application potential in cultural relic research, display and restoration to a certain extent.

[0004] In addition, for the digital restoration of damaged cultural relics, traditional methods mainly rely on the experience and subjective judgment of professionals, lacking objective and unified restoration standards and intelligent technical support. This makes it difficult to guarantee the accuracy and efficiency of digital restoration of cultural relics, and the restoration results often vary from person to person, making it difficult to achieve the ideal restoration effect. At the same time, traditional methods are also unable to cope with large amounts of damaged data and cannot meet the needs of large-scale digital restoration of cultural relics.

[0005] In summary, the existing digital protection technology for cultural relics has problems of poor accuracy and low efficiency. Summary of the invention

[0006] In order to overcome the shortcomings of the above-mentioned prior art, the purpose of the present invention is to provide a digital protection method, system, equipment and medium for three-dimensional reconstruction and restoration of cultural relics. The present invention can realize digital three-dimensional reconstruction and restoration of cultural relics, has high efficiency in generating three-dimensional models of cultural relics, and has high precision of three-dimensional models of cultural relics, and can realize digital restoration of a large number of damaged cultural relics.

[0007] In order to achieve the above object, the present invention adopts the following technical solutions:

[0008] In a first aspect, the present invention provides a digital protection method for three-dimensional reconstruction and restoration of cultural relics, comprising the following steps:

[0009] Obtain complete point cloud data and texture images of cultural relics;

[0010] Construct a color 3D model of the cultural relic based on its point cloud data and texture image;

[0011] Identify the damaged areas on the surface of the cultural relics, generate corresponding virtual repair fragments according to the characteristics of the damaged areas, and use the virtual repair fragments to splice and repair the damaged areas of the color 3D model.

[0012] In a second aspect, the present invention provides a digital protection system for three-dimensional reconstruction and restoration of cultural relics, comprising a data acquisition module, a model building module and a model restoration module connected in sequence, wherein:

[0013] Data acquisition module, used to obtain complete point cloud data and texture images of cultural relics;

[0014] A model building module, used to build a color three-dimensional model of the cultural relic based on the point cloud data and texture image of the cultural relic;

[0015] The model repair module is used to identify the damaged areas on the surface of the cultural relics, generate corresponding virtual repair fragments according to the characteristics of the damaged areas, and use the virtual repair fragments to splice and repair the damaged areas of the color 3D model.

[0016] In a third aspect, the present invention provides an electronic device comprising: a processor; a memory for storing computer program instructions; and steps for implementing a digital protection method for three-dimensional reconstruction and restoration of cultural relics when executing the computer program.

[0017] In a fourth aspect, the present invention provides a storage medium storing computer program instructions. When the computer program instructions are loaded and executed by a processor, the processor executes a digital protection method for three-dimensional reconstruction and restoration of cultural relics.

[0018] Compared with the prior art, the present invention has the following beneficial effects:

[0019] 1. The method of the present invention obtains the point cloud data and texture image of the complete cultural relics. The collection of point cloud data provides a basis for subsequent three-dimensional modeling, ensures the authenticity and accuracy of the model, and the collection of texture image provides rich surface information for the three-dimensional model. The color three-dimensional model of the cultural relics is constructed according to the point cloud data and texture image of the cultural relics. The color three-dimensional model is generated by the point cloud data and texture image, which is conducive to improving the accuracy and realism of the three-dimensional model of the cultural relics, making the cultural relics model more realistic and vivid visually. The damaged area on the surface of the cultural relics is identified, and the corresponding virtual repair fragments are generated according to the characteristics of the damaged area. The damaged area of ​​the color three-dimensional model is spliced ​​and repaired using the virtual repair fragments. Virtual repair technology avoids direct operation of physical cultural relics, reduces the risk of secondary damage, and contributes to the long-term preservation of cultural relics. In addition, through computer-assisted repair, the cultural relics repair process is made more automated and intelligent, which can greatly improve the efficiency and accuracy of the repair work, reduce the cost of manpower and material resources, and can realize the digital repair of a large number of damaged cultural relics.

[0020] 2. By combining deep learning and point cloud fusion technology, the improved 3D reconstruction algorithm in the present invention can more accurately capture the tiny details of the surface of cultural relics, significantly improving the accuracy and realism of the 3D model. This is particularly important for the protection and research of cultural heritage that requires high-precision data.

[0021] 3. The method of the present invention obtains a disparity map through point cloud data of multiple perspectives, optimizes the mapped texture image using the disparity map to obtain an optimized texture image, obtains depth information through the disparity map to reduce noise and fill holes in the texture image, which is beneficial to improving the accuracy of the model.

[0022] 4. The system of the present invention includes a data acquisition module, a model construction module and a model repair module, wherein: the data acquisition module is used to obtain the complete point cloud data and texture image of the cultural relic; the model construction module is used to construct a color three-dimensional model of the cultural relic based on the point cloud data and texture image of the cultural relic; the model repair module is used to identify the damaged area on the surface of the cultural relic, generate corresponding virtual repair fragments according to the characteristics of the damaged area, and use the virtual repair fragments to splice and repair the damaged area of ​​the color three-dimensional model. The various modules cooperate with each other to realize the digital three-dimensional reconstruction and repair of cultural relics, and the efficiency of generating the three-dimensional model of cultural relics is high, and the three-dimensional model of cultural relics is high in precision.

[0023] 5. The device and medium of the present invention can also realize the digital three-dimensional reconstruction and restoration of cultural relics, and the efficiency of generating the three-dimensional model of cultural relics is high, and the three-dimensional model of cultural relics is high. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 is a flow chart of a method according to an embodiment of the present invention;

[0025] Figure 2 A flow chart of a three-dimensional reconstruction algorithm according to an embodiment of the present invention;

[0026] Figure 3 This is an unrepaired three-dimensional model diagram of an embodiment of the present invention;

[0027] Figure 4 A texture image synthesis diagram according to an embodiment of the present invention;

[0028] Figure 5 An aerial triangulation map according to an embodiment of the present invention;

[0029] Figure 6 A three-dimensional model diagram after restoration according to an embodiment of the present invention;

[0030] Figure 7 is a flow chart of the method of the present invention;

[0031] Figure 8 It is a system module diagram of the present invention. DETAILED DESCRIPTION

[0032] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0033] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0034] The present invention is further described in detail below in conjunction with the accompanying drawings:

[0035] See also Figure 7 The present invention discloses a digital protection method for three-dimensional reconstruction and restoration of cultural relics, comprising the following steps:

[0036] S1. Obtain the complete point cloud data and texture image of the cultural relics, as follows:

[0037] The cultural relics are photographed at multiple angles, with one shot taken every 15° rotation in the horizontal direction and one shot taken every 30° rotation in the vertical direction, to obtain complete point cloud data and texture images of the cultural relics.

[0038] S2. Construct a color 3D model of the cultural relic based on the point cloud data and texture image of the cultural relic, as follows:

[0039] Deep learning technology is used to extract features and classify point cloud data, and a 3D model is constructed based on the classification results. By combining deep learning and point cloud fusion technology, the improved 3D reconstruction algorithm in the present invention can more accurately capture the tiny details of the surface of cultural relics, significantly improving the accuracy and realism of the 3D model. This is particularly important for the protection and research of cultural heritage that requires high-precision data.

[0040] The texture image is accurately mapped to the surface of the 3D model through texture mapping, as follows:

[0041] The texture image is color corrected, denoised, filtered and registered to obtain a preprocessed texture image, as follows:

[0042] Performing color calibration on the texture image to obtain a color-calibrated texture image;

[0043] Use median filtering or Gaussian filtering to smooth and reduce noise on the color-corrected texture image;

[0044] Filtering the denoised texture image;

[0045] The filtered texture images are registered using an iterative closest point algorithm or a feature-based matching method;

[0046] Correct and stitch the pre-processed texture image to generate a complete cultural relic texture image;

[0047] The complete cultural relic texture image is accurately mapped to the 3D model surface through texture mapping.

[0048] Obtain a disparity map through point cloud data from multiple perspectives, and use the disparity map to optimize the mapped texture image to obtain an optimized texture image;

[0049] The 3D model and the optimized texture image are merged into a color 3D model through point cloud fusion technology.

[0050] Preferably, feature matching is performed during texture mapping, and the Euclidean distance is used to calculate the Euclidean distance during the feature matching.

[0051] S3. Identify the damaged area on the surface of the cultural relic, generate corresponding virtual repair fragments according to the characteristics of the damaged area, and use the virtual repair fragments to splice and repair the damaged area of ​​the color 3D model, as follows:

[0052] Use image analysis and deep learning technology to automatically identify damaged areas and defect shapes on the surface of cultural relics;

[0053] The feature points on the surface of the cultural relics are extracted by using the scale-invariant feature transformation detection algorithm and the accelerated robust feature detection algorithm;

[0054] Analyze the damaged area, defect shape, texture features, characteristic points on the surface of the cultural relic and material information to determine the virtual restoration plan, so as to dynamically fine-tune the virtual restoration algorithm and make the 3D model after virtual restoration closer to the texture of the real cultural relic;

[0055] The optimized similarity algorithm was obtained by optimizing the similarity algorithm through the virtual restoration scheme. During the specific implementation process, it was found through continuous testing that after increasing the number of numerators and denominators in the exponential part of the original similarity algorithm by one, the restored cultural relic model was significantly improved.

[0056] The corresponding virtual repair fragments are generated according to the damaged area and defect shape, and the shape adjustment, texture mapping and color matching operations are performed on the virtual repair fragments using an optimized similarity algorithm, so that the virtual repair fragments are seamlessly integrated with the color 3D model to achieve virtual repair.

[0057] See also Figure 7 In another feasible embodiment of the present invention, the following is adaptively modified according to the situation. It includes the following steps: obtaining the point cloud data and texture image of the complete cultural relic, the collection of the point cloud data provides a basis for the subsequent three-dimensional modeling, ensures the authenticity and accuracy of the model, and the collection of the texture image provides rich surface information for the three-dimensional model. Constructing a color three-dimensional model of the cultural relic according to the point cloud data and texture image of the cultural relic, generating a color three-dimensional model through the point cloud data and texture image, which is conducive to improving the accuracy and realism of the three-dimensional model of the cultural relic, making the cultural relic model more realistic and vivid visually. Identify the damaged area on the surface of the cultural relic, generate corresponding virtual repair fragments according to the characteristics of the damaged area, and use the virtual repair fragments to splice and repair the damaged area of ​​the color three-dimensional model. Virtual repair technology avoids direct operation of physical cultural relics, reduces the risk of secondary damage, and contributes to the long-term preservation of cultural relics. In addition, through computer-assisted repair, the cultural relic repair process is made more automated and intelligent, which is conducive to the digital repair of a large number of damaged cultural relics, and can greatly improve the efficiency and accuracy of the repair work, and reduce the cost of manpower and material resources. That is, the present invention can realize the digital three-dimensional reconstruction and repair of cultural relics, and the efficiency of generating the three-dimensional model of cultural relics is high, and the accuracy of the three-dimensional model of cultural relics is high.

[0058] Embodiment 1:

[0059] This embodiment discloses a digital protection method for three-dimensional reconstruction and restoration of cultural relics, see Figure 1 , including the following steps:

[0060] S1. High-precision three-dimensional data acquisition;

[0061] Equipment selection: Use multi-site high-definition cameras as data collection equipment to ensure high density and accuracy of data.

[0062] Scanning strategy: Design optimized scanning paths and parameter settings, including scanning site layout, scanning angles and resolution, to obtain complete cultural relic point cloud data and texture images to ensure full coverage of the cultural relic surface.

[0063] S2. Improved 3D reconstruction algorithm, see Figure 2 ;

[0064] Algorithm design: Improve the MVS 3D reconstruction algorithm based on deep learning and point cloud fusion. The MVS 3D reconstruction algorithm is a multi-view stereoscopic vision 3D reconstruction algorithm. The improved algorithm restores the 3D geometric structure of the scene by images taken from different angles. The basic steps include: image acquisition, feature matching, disparity map calculation, triangulation, and finally 3D reconstruction through fusion. The specific steps are as follows:

[0065] First, the acquired cultural relic images are used to extract and classify the point cloud data using deep learning technology to identify different areas and feature points on the surface of the cultural relic and construct a three-dimensional model. Figure 3 ;

[0066] Then, the color, texture, pattern and other two-dimensional image data of the cultural relic surface are accurately mapped to the three-dimensional model surface through texture mapping, and then the depth information of different points is obtained through disparity map calculation to reduce noise and fill the holes of the texture image to obtain the optimized texture image. Figure 4 and Figure 5 ;

[0067] Finally, the 3D models corresponding to different angles and positions and the textured images are combined into a complete 3D model through point cloud fusion technology. Figure 6 .

[0068] When performing feature matching during texture mapping, Euclidean distance is used for calculation, and the formula is as follows:

[0069]

[0070] Among them, a i and b iis the feature vector, n is the dimension of the feature vector, and d is the Euclidean distance.

[0071] When calculating the disparity map D(x, y), the three-dimensional point P(x, y, z) can be reconstructed from the two-dimensional image coordinates (x, y) using the following formula:

[0072]

[0073]

[0074] Among them, the baseline distance B, the focal length f, (c x , c y ) are the coordinates of the camera optical center on the image plane, usually the center of the image.

[0075] During texture mapping, data processing and model optimization are as follows:

[0076] Perform pre-processing operations such as color correction, noise reduction, filtering and registration on the collected point cloud data to improve data quality;

[0077] At the same time, the texture image is corrected and spliced ​​to generate a complete texture map of the cultural relics. Among them, the point cloud data is smoothed and denoised by using methods such as median filtering or Gaussian filtering; the point cloud data of different sites are aligned using the iterative closest point (ICP) algorithm or feature-based matching method, that is, the cloud data is unified into the same coordinate system. Among them, the Gaussian filtering algorithm is as follows:

[0078]

[0079] Among them, α is the Gaussian standard deviation, Neighborhood is the set of neighborhood points around the current point, Filtered(x,y,z), i, j, k are the three-dimensional coordinates of the neighborhood points, and Input(i,j,k) is the neighborhood point.

[0080] Furthermore, algorithms such as Poisson reconstruction and moving least squares (MLS) are used to construct the three-dimensional surface texture image of the cultural relic from the point cloud data, and then the texture image is accurately mapped to the three-dimensional geometric model using the collinear equation and image matching technology to generate a realistic color three-dimensional model. At the same time, the model is smoothed and the details are enhanced to improve the visual effect and realism of the model.

[0081] S3. Virtual restoration technology;

[0082] Damage identification: Use image analysis and deep learning technology to automatically identify damaged areas and defect shapes on the surface of cultural relics, and extract feature points on the surface of cultural relics by using feature detection algorithms such as SIFT (Scale Invariant Feature Transform) and SURF (Speeded Robust Features). Determine the virtual repair plan by analyzing the geometric shape, texture features and material information of the damaged area.

[0083] Virtual restoration: Generate corresponding virtual restoration fragments based on the characteristics of the damaged area (shape and size, etc.). Use optimized similarity algorithms to perform shape adjustment, texture mapping, and color matching on the virtual restoration fragments to achieve seamless integration with the surface of the cultural relic.

[0084] When splicing model fragments during virtual restoration, the optimized shape matching algorithm is used to find the best splicing position by calculating the shape similarity between the fragments. The optimized similarity algorithm is as follows:

[0085]

[0086] Among them, Feature i are feature points on the fragments and surfaces, α is a parameter that controls the attenuation of similarity, Similarity is the overall similarity between two pairs or feature sets, Fragment is a fragment (part) of the i-th feature, indicating a specific aspect of the feature being segmented or extracted, and Surface is the feature vector of the i-th feature, which is used for comparison with Fragment.

[0087] Restoration evaluation: Through user interaction and automatic optimization algorithms, users are allowed to evaluate and provide feedback on the restoration effect. Based on user feedback, the virtual restoration solution is further optimized until it meets the requirements.

[0088] S4. Display and application;

[0089] Virtual reality (VR) demonstrations;

[0090] Immersive experience: By wearing a VR helmet, the audience can enter a virtual world composed entirely of digital artifacts. They can walk freely in this space, observe the artifacts from all angles and distances, and even "touch" the details of the artifacts, and experience the feeling of being in a museum or archaeological site.

[0091] Interactive Navigation: Design a user-friendly interface and navigation system to enable visitors to choose the cultural relic area they want to explore based on their interests, while obtaining detailed information such as the historical background and production process of the cultural relics.

[0092] Augmented reality (AR) display;

[0093] 1. Reality overlay: AR technology allows virtual three-dimensional models to be superimposed on real-world scenes. Audiences only need to scan specific images or markers through devices such as mobile phones or tablets to see the cultural relic models appear on the screen above the real world, achieving a combination of virtual and real effects.

[0094] 2. Interactive interpretation: Combined with AR technology, while viewing the cultural relic models, the audience can also receive multimedia content such as detailed introductions to the cultural relics and story explanations by triggering specific actions or sounds, thereby enhancing the fun and interactivity of learning.

[0095] protection and monitoring;

[0096] 1. Condition monitoring: Using high-precision 3D scanning technology to regularly obtain 3D data of cultural relics and compare and analyze it with previous scanning results can accurately assess the morphological changes and degree of damage of cultural relics, providing a scientific basis for formulating protection strategies.

[0097] 2. Environmental simulation: Based on the three-dimensional model, a virtual environment for cultural relics can be constructed to simulate the impact of different climatic conditions, natural disasters and other factors on cultural relics, predict potential damage risks, and take protective measures in advance.

[0098] In summary, the present invention produces the following beneficial effects:

[0099] 1. Significantly improved model accuracy: By combining deep learning and point cloud fusion technology, the improved 3D reconstruction algorithm in this invention can more accurately capture the tiny details on the surface of cultural relics, significantly improving the accuracy and realism of 3D models. This is particularly important for the protection and research of cultural heritage that requires high-precision data.

[0100] 2. Significantly enhanced intelligence: The introduction of intelligent virtual restoration technology makes the restoration process of cultural relics more automated and intelligent. The system can automatically identify damaged areas and generate virtual restoration plans that conform to the original appearance of the cultural relics, reducing the impact of manual intervention and subjective judgment, and improving restoration efficiency and accuracy.

[0101] 3. Provide a comprehensive solution: The present invention not only focuses on the two key links of 3D reconstruction and virtual restoration, but also provides a full-process solution from data collection to display application. This comprehensive approach can better meet the various needs of cultural heritage protection, including the collection, protection, restoration, display and research of cultural relics.

[0102] 4. Reduce costs and risks: Traditional cultural relics restoration often requires a lot of manpower, material resources and time investment, and there is a risk of secondary damage to the cultural relics. The virtual restoration technology of the present invention can be repaired without touching the physical cultural relics, which greatly reduces the cost and risk of restoration and provides a strong guarantee for the long-term preservation and inheritance of cultural relics.

[0103] Application prospects:

[0104] With the continuous advancement of science and technology and the increasing awareness of cultural heritage protection, the digital protection method of cultural relics based on improved three-dimensional reconstruction and virtual restoration technology will have broad application prospects. In the future, this method will further integrate advanced technologies such as artificial intelligence and big data to achieve more intelligent and personalized cultural relics protection and restoration services. At the same time, with the vigorous development of the digital cultural and creative industry, the technical achievements of this invention will also inject new vitality into the cultural and creative industry and promote the creative transformation and innovative development of cultural heritage.

[0105] The present invention can be widely used in cultural heritage protection institutions such as museums and archaeological sites to provide technical support for the digital protection and restoration of cultural relics.

[0106] Through the display of three-dimensional models and virtual restoration technology, students can be provided with a more intuitive and vivid learning experience, promoting the dissemination and popularization of cultural heritage knowledge.

[0107] Combined with virtual reality (VR) and augmented reality (AR) technologies, the present invention can be applied to the field of digital cultural creation, creating an immersive cultural experience scene and promoting the development of the cultural industry.

[0108] Embodiment 2:

[0109] This embodiment discloses a digital protection method for three-dimensional reconstruction and restoration of cultural relics, see Figure 1 , including the following steps:

[0110] S1. Data collection stage;

[0111] Equipment preparation:

[0112] Prepare high-definition cameras with more than 45 million pixels to ensure that the equipment performance meets the data collection requirements;

[0113] Adopt LED cold light source for lighting;

[0114] 24-color standard calibration card;

[0115] Mobile turntable and power supply, etc.

[0116] Computers equipped with high-performance GPUs ensure efficient processing of large-scale 3D data of cultural relics. This project uses an Intel i9-14900HXC processor, a screen refresh rate of 240HZ, a 2.5K high-resolution screen display, 64G+2T memory and hard disk capacity, and an RTX4090 graphics card.

[0117] On-site layout and data collection:

[0118] According to the shape and size of the cultural relics, the scanning stations are arranged reasonably to ensure that the surface of the cultural relics can be fully covered. Figure 5 , Figure 6 , as follows:

[0119] 1. Build a shooting platform:

[0120] Build a stable shooting platform in a suitable location and place the camera and tripod in front of the platform. Make sure the height, angle and position of the shooting platform can meet the requirements of the shooting plan.

[0121] 2. Set the light:

[0122] Use professional photography lighting equipment to set up even, soft light around the cultural relics. Avoid direct light on the cultural relics to reduce the impact of reflections and shadows on the shooting effect. Adjust the intensity and color of the light as needed to highlight the details and colors of the cultural relics.

[0123] 3. Adjust camera parameters:

[0124] Adjust the camera's aperture, shutter speed, ISO and other parameters according to the shooting plan and lighting conditions. Use manual mode to shoot to ensure consistent photo parameters each time. Regularly perform white balance correction and exposure compensation adjustments to ensure accurate color and brightness in photos.

[0125] 4. Take panoramic photos: According to the predetermined shooting plan, the cultural relics are photographed in a multi-angle circular manner. The turntable takes a photo every 15° in the horizontal direction to ensure that the images have enough overlap. The camera takes a photo every 30° in the vertical direction. During the circular shooting process, it is ensured that the focus of each part of the collection image is clear and the details and characteristics of the cultural relics can be fully displayed.

[0126] S2. 3D reconstruction stage;

[0127] like Figure 2 , specifically follow these steps:

[0128] Data preprocessing: Perform preprocessing operations such as color correction, noise reduction, filtering and registration on the collected point cloud data to improve data quality.

[0129] Feature extraction and classification: Use deep learning technology to extract and classify features of pre-processed point cloud data to identify different areas and features on the surface of cultural relics.

[0130] Texture mapping: Accurately map the texture image onto the 3D geometric model, and perform processing such as smoothing, surface reduction, and detail enhancement.

[0131] Disparity map calculation: It is calculated based on the principle of binocular stereo vision. It represents the horizontal offset of image pixels in the same scene at different viewing angles. This offset can be used to calculate the depth information of different objects in the scene to reduce noise and fill holes, thereby achieving 3D reconstruction. Through disparity map calculation, we can construct the 3D model coordinates of the object.

[0132] Point cloud fusion and model optimization: Point cloud fusion technology is used to integrate multiple point cloud data sets acquired from different angles and positions into a complete 3D model, and texture maps are imported into the improved algorithm model to generate realistic color 3D models.

[0133] S3. Virtual repair stage;

[0134] like Figure 3 , specifically follow these steps:

[0135] Damage identification: Use image analysis and deep learning technology to automatically identify damaged areas and defect shapes on the surface of cultural relics, and extract feature points on the surface of cultural relics by using feature detection algorithms such as SIFT (Scale Invariant Feature Transform) and SURF (Speeded Robust Features). Determine the virtual repair plan by analyzing the geometric shape, texture features and material information of the damaged area.

[0136] Virtual restoration: An intelligent virtual restoration algorithm is designed to generate corresponding virtual restoration fragments according to the characteristics of the damaged area, including the shape and size of the damaged area. The optimized shape matching algorithm is used to perform shape adjustment, texture mapping, and color matching on the virtual restoration fragments to achieve seamless integration with the surface of the cultural relic.

[0137] When splicing model fragments during virtual restoration, the optimized shape matching algorithm is used to find the best splicing position by calculating the shape similarity between the fragments. The optimized similarity algorithm is as follows:

[0138]

[0139] Among them, Feature i are feature points on the fragments and surfaces, α is a parameter that controls the attenuation of similarity, Similarity is the overall similarity between two pairs or feature sets, Fragment is a fragment (part) of the i-th feature, indicating a specific aspect of the feature being segmented or extracted, and Surface is the feature vector of the i-th feature, which is used for comparison with Fragment.

[0140] Restoration evaluation: Verify the effect of the restored model, use professional software (such as MeshLab) to compare it with the original cultural relic data, evaluate the authenticity and accuracy of the restoration, and further optimize the virtual restoration plan based on the feedback.

[0141] S4. Demonstration and application stage;

[0142] See Figure 7 , the specific applications are as follows:

[0143] 1. 3D model display: Use virtual reality (VR), augmented reality (AR) and other technologies to virtually display the restored 3D model.

[0144] 2. Protection and monitoring: Use three-dimensional models to conduct long-term monitoring and protection planning of cultural relics.

[0145] 3. Technology iteration and upgrade: With the continuous advancement of technology, the cultural relics digital protection system will be iterated and upgraded regularly, introducing more advanced 3D reconstruction algorithms, virtual restoration technology and display methods to maintain the system's advancement and practicality.

[0146] The present invention aims to solve the deficiencies of existing digital cultural relic protection technologies in terms of 3D reconstruction accuracy, virtual restoration efficiency and intelligence. Through high-precision 3D data acquisition, 3D model construction, and precise restoration and display in a virtual environment, the accuracy and detail capture capability of 3D reconstruction can be improved, the authenticity of the reconstructed model can be ensured, the virtual restoration process can be optimized, and the restoration efficiency and effect can be improved, especially in dealing with complex damage and detail restoration. The overall cost of digital protection technology can be reduced, so that it can be applied in more cultural relic protection projects, realize comprehensive digital protection and inheritance of cultural relics, and provide strong support for the protection and research of cultural heritage.

[0147] Based on the above method, the present invention also discloses a digital protection system for three-dimensional reconstruction and restoration of cultural relics, see Figure 8 , including data acquisition module, model building module and model repair module, among which:

[0148] Data acquisition module, used to obtain complete point cloud data and texture images of cultural relics;

[0149] A model building module, used to build a color three-dimensional model of the cultural relic based on the point cloud data and texture image of the cultural relic;

[0150] The model repair module is used to identify the damaged areas on the surface of the cultural relics, generate corresponding virtual repair fragments according to the characteristics of the damaged areas, and use the virtual repair fragments to splice and repair the damaged areas of the color 3D model.

[0151] The modules of the system of the present invention cooperate with each other to realize the digital three-dimensional reconstruction and restoration of cultural relics, and the efficiency of generating the three-dimensional model of cultural relics is high and the three-dimensional model of cultural relics is high.

[0152] An electronic device comprises: a processor; a memory for storing computer program instructions; and steps of a digital protection method for realizing three-dimensional reconstruction and restoration of cultural relics when executing the computer program.

[0153] A storage medium stores computer program instructions. When the computer program instructions are loaded and run by a processor, the processor executes a digital protection method for three-dimensional reconstruction and restoration of cultural relics.

[0154] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0155] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0156] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0157] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0158] The above contents are only for explaining the technical idea of ​​the present invention and cannot be used to limit the protection scope of the present invention. Any changes made on the basis of the technical solution in accordance with the technical idea proposed by the present invention shall fall within the protection scope of the claims of the present invention.

Claims

1. A digital protection method for three-dimensional reconstruction and restoration of cultural relics, characterized in that: The following steps are involved: Obtain complete point cloud data and texture images of cultural relics; Construct a color 3D model of the cultural relic based on its point cloud data and texture image; Identify the damaged areas on the surface of the cultural relics, generate corresponding virtual repair fragments according to the characteristics of the damaged areas, and use the virtual repair fragments to splice and repair the damaged areas of the color 3D model.

2. The digital protection method for three-dimensional reconstruction and restoration of cultural relics according to claim 1 is characterized in that: The steps of obtaining the complete point cloud data and texture image of the cultural relics are as follows: The cultural relics are photographed at multiple angles, with one shot taken every 15° rotation in the horizontal direction and one shot taken every 30° rotation in the vertical direction, to obtain complete point cloud data and texture images of the cultural relics.

3. The digital protection method for three-dimensional reconstruction and restoration of cultural relics according to claim 1 is characterized in that: The steps of constructing a color 3D model of a cultural relic based on the point cloud data and texture image of the cultural relic are specifically as follows: Preprocess the point cloud data; Use deep learning technology to extract features and classify the preprocessed point cloud data, and build a 3D model based on the classification results; The texture image is accurately mapped onto the surface of the three-dimensional model through texture mapping; Obtain a disparity map through point cloud data from multiple perspectives, and use the disparity map to optimize the mapped texture image to obtain an optimized texture image; The 3D model and the optimized texture image are merged into a color 3D model through point cloud fusion technology.

4. The digital protection method for three-dimensional reconstruction and restoration of cultural relics according to claim 3 is characterized in that: The step of accurately mapping the texture image to the surface of the three-dimensional model through texture mapping, performing feature matching during the texture mapping process, and using the Euclidean distance to calculate the Euclidean distance during the feature matching process.

5. The digital protection method for three-dimensional reconstruction and restoration of cultural relics according to claim 3 is characterized in that: The steps of accurately mapping the texture image to the surface of the three-dimensional model by texture mapping are specifically as follows: Performing color correction, noise reduction, filtering and registration on the texture image to obtain a preprocessed texture image; Correct and stitch the pre-processed texture image to generate a complete cultural relic texture image; The complete cultural relic texture image is accurately mapped to the 3D model surface through texture mapping.

6. The digital protection method for three-dimensional reconstruction and restoration of cultural relics according to claim 5 is characterized in that: The steps of color correction, noise reduction, filtering and registration of the texture image to obtain the pre-processed texture image are specifically as follows: Performing color calibration on the texture image to obtain a color-calibrated texture image; Use median filtering or Gaussian filtering to smooth and reduce noise on the color-corrected texture image; Filtering the denoised texture image; The filtered texture images are registered using an iterative closest point algorithm or a feature-based matching method.

7. The digital protection method for three-dimensional reconstruction and restoration of cultural relics according to claim 1 is characterized in that: The steps of identifying the damaged area on the surface of the cultural relic, generating corresponding virtual repair fragments according to the characteristics of the damaged area, and using the virtual repair fragments to splice and repair the damaged area of ​​the color three-dimensional model are as follows: Use image analysis and deep learning technology to automatically identify damaged areas and defect shapes on the surface of cultural relics; The feature points on the surface of the cultural relics are extracted by using the scale-invariant feature transformation detection algorithm and the accelerated robust feature detection algorithm; Analyze the damaged area, defect shape, texture characteristics, characteristic points on the surface of the cultural relic and material information to determine the virtual restoration plan; The similarity algorithm is optimized by using a virtual repair scheme to obtain an optimized similarity algorithm; The corresponding virtual repair fragments are generated according to the damaged area and defect shape, and the shape adjustment, texture mapping and color matching operations are performed on the virtual repair fragments using an optimized similarity algorithm, so that the virtual repair fragments are seamlessly integrated with the color 3D model to achieve virtual repair.

8. A digital protection system for three-dimensional reconstruction and restoration of cultural relics for implementing the method described in any one of claims 1 to 7, characterized in that: It includes data acquisition module, model building module and model repair module, among which: Data acquisition module, used to obtain complete point cloud data and texture images of cultural relics; A model building module, used to build a color three-dimensional model of the cultural relic based on the point cloud data and texture image of the cultural relic; The model repair module is used to identify the damaged areas on the surface of the cultural relics, generate corresponding virtual repair fragments according to the characteristics of the damaged areas, and use the virtual repair fragments to splice and repair the damaged areas of the color 3D model.

9. An electronic device, comprising: Processor; memory, electronic device used to store computer program instructions; characterized in that it is used to implement the steps of the digital protection method for three-dimensional reconstruction and restoration of cultural relics as described in any one of claims 1-7 when executing the computer program.

10. A storage medium storing computer program instructions, characterized in that: When the computer program instructions are loaded and executed by the processor, the processor executes the digital protection method for three-dimensional reconstruction and restoration of cultural relics as described in any one of claims 1-7.

Images